2023-07-29T01:39:21.593 INFO:root:teuthology version: 0.0.1.dev172+g6114016 2023-07-29T01:39:21.594 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}} --archive /home/teuthworker/archive/yuriw-2023-07-28_23:11:59-fs-reef-release-distro-default-smithi/7355992 --name yuriw-2023-07-28_23:11:59-fs-reef-release-distro-default-smithi --verbose -- /home/teuthworker/archive/yuriw-2023-07-28_23:11:59-fs-reef-release-distro-default-smithi/7355992/orig.config.yaml 2023-07-29T01:39:21.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T01:39:21.746 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-07-28_23:11:59-fs-reef-release-distro-default-smithi/7355992 branch: reef-release description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}} email: yweinste@redhat.com first_in_suite: false job_id: '7355992' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-07-28_23:11:59-fs-reef-release-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: reef-release ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: false mds_sleep_rank_change: 5000000.0 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - Replacing daemon mds sha1: 0484097b0572e96f42cf6402cbe0ac8dcb046577 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: 0484097b0572e96f42cf6402cbe0ac8dcb046577 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef-release sha1: 0484097b0572e96f42cf6402cbe0ac8dcb046577 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 7230 sha1: 0484097b0572e96f42cf6402cbe0ac8dcb046577 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: reef-release suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 0484097b0572e96f42cf6402cbe0ac8dcb046577 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi042.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi144.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - mds_thrash: null - workunit: clients: all: - fs/snaps timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 61140164d2579c30ffff3970615e0f82e40c6470 timestamp: 2023-07-28_23:11:59 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-29T01:39:21.746 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa; will attempt to use it 2023-07-29T01:39:21.748 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks 2023-07-29T01:39:21.749 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-29T01:39:21.751 INFO:teuthology.task.internal:Checking packages... 2023-07-29T01:39:21.794 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '0484097b0572e96f42cf6402cbe0ac8dcb046577' 2023-07-29T01:39:21.794 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-29T01:39:21.795 INFO:teuthology.packaging:ref: None 2023-07-29T01:39:21.795 INFO:teuthology.packaging:tag: None 2023-07-29T01:39:21.796 INFO:teuthology.packaging:branch: reef-release 2023-07-29T01:39:21.796 INFO:teuthology.packaging:sha1: 0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T01:39:21.797 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef-release 2023-07-29T01:39:30.115 INFO:teuthology.task.internal:Found packages for ceph version 18.1.3-11.g0484097b 2023-07-29T01:39:30.115 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-29T01:39:30.123 INFO:teuthology.task.internal:no buildpackages task found 2023-07-29T01:39:30.124 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-29T01:39:30.190 INFO:teuthology.task.internal:Saving configuration 2023-07-29T01:39:30.207 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-29T01:39:30.222 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T01:39:31.024 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-28_23:11:59-fs-reef-release-distro-default-smithi/7355992', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 01:34:37.080035', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-29T01:39:31.045 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-28_23:11:59-fs-reef-release-distro-default-smithi/7355992', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 01:34:37.081772', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-29T01:39:31.046 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-29T01:39:31.052 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-07-29T01:39:31.052 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-07-29T01:39:31.053 INFO:teuthology.run_tasks:Running task console_log... 2023-07-29T01:39:31.152 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcc1f456f70>, signals=[15]) 2023-07-29T01:39:31.153 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-29T01:39:31.159 INFO:teuthology.task.internal:Opening connections... 2023-07-29T01:39:31.160 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi042.front.sepia.ceph.com 2023-07-29T01:39:31.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T01:39:31.232 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2023-07-29T01:39:31.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T01:39:31.303 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-29T01:39:31.309 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2023-07-29T01:39:31.328 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2023-07-29T01:39:31.328 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2023-07-29T01:39:31.386 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="Red Hat Enterprise Linux" 2023-07-29T01:39:31.386 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="8.6 (Ootpa)" 2023-07-29T01:39:31.386 INFO:teuthology.orchestra.run.smithi042.stdout:ID="rhel" 2023-07-29T01:39:31.386 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="fedora" 2023-07-29T01:39:31.387 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="8.6" 2023-07-29T01:39:31.387 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el8" 2023-07-29T01:39:31.387 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-29T01:39:31.387 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2023-07-29T01:39:31.387 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-29T01:39:31.387 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://www.redhat.com/" 2023-07-29T01:39:31.387 INFO:teuthology.orchestra.run.smithi042.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-29T01:39:31.388 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T01:39:31.388 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:39:31.388 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-29T01:39:31.388 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-29T01:39:31.388 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-29T01:39:31.388 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-29T01:39:31.389 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2023-07-29T01:39:31.413 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2023-07-29T01:39:31.433 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2023-07-29T01:39:31.433 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-07-29T01:39:31.490 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux" 2023-07-29T01:39:31.491 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.6 (Ootpa)" 2023-07-29T01:39:31.491 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel" 2023-07-29T01:39:31.491 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora" 2023-07-29T01:39:31.491 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.6" 2023-07-29T01:39:31.491 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-07-29T01:39:31.491 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-29T01:39:31.492 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-07-29T01:39:31.492 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-29T01:39:31.492 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/" 2023-07-29T01:39:31.492 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-29T01:39:31.492 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T01:39:31.492 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:39:31.493 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-29T01:39:31.493 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-29T01:39:31.493 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-29T01:39:31.493 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-29T01:39:31.493 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-07-29T01:39:31.521 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-29T01:39:31.535 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-29T01:39:31.582 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-29T01:39:31.582 DEBUG:teuthology.orchestra.run.smithi042:> test '!' -e /home/ubuntu/cephtest 2023-07-29T01:39:31.585 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2023-07-29T01:39:31.602 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-29T01:39:31.630 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-29T01:39:31.630 DEBUG:teuthology.orchestra.run.smithi042:> test -z $(ls -A /var/lib/ceph) 2023-07-29T01:39:31.643 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2023-07-29T01:39:31.668 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-29T01:39:31.726 INFO:teuthology.run_tasks:Running task kernel... 2023-07-29T01:39:31.745 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-07-29T01:39:31.746 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2023-07-29T01:39:31.746 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2023-07-29T01:39:31.747 DEBUG:teuthology.orchestra.run.smithi042:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-29T01:39:31.764 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T01:39:31.765 DEBUG:teuthology.orchestra.run.smithi042:> uname -r 2023-07-29T01:39:31.825 INFO:teuthology.orchestra.run.smithi042.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-29T01:39:31.825 INFO:teuthology.task.kernel:Running kernel on smithi042: 4.18.0-372.9.1.el8.x86_64 2023-07-29T01:39:31.826 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum install -y kernel 2023-07-29T01:39:33.052 INFO:teuthology.orchestra.run.smithi042.stdout:Updating Subscription Management repositories. 2023-07-29T01:39:33.053 INFO:teuthology.orchestra.run.smithi042.stdout:Unable to read consumer identity 2023-07-29T01:39:35.092 INFO:teuthology.orchestra.run.smithi042.stdout:Copr repo for python3-asyncssh owned by ceph 5.3 kB/s | 3.5 kB 00:00 2023-07-29T01:39:56.281 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 755 kB/s | 16 MB 00:21 2023-07-29T01:40:00.023 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 455 kB/s | 24 kB 00:00 2023-07-29T01:40:00.750 INFO:teuthology.orchestra.run.smithi042.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-29T01:40:00.792 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2023-07-29T01:40:00.793 INFO:teuthology.orchestra.run.smithi042.stdout:Nothing to do. 2023-07-29T01:40:00.794 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2023-07-29T01:40:00.936 DEBUG:teuthology.orchestra.run.smithi042:> echo no | sudo yum reinstall kernel || true 2023-07-29T01:40:01.291 INFO:teuthology.orchestra.run.smithi042.stdout:Updating Subscription Management repositories. 2023-07-29T01:40:01.291 INFO:teuthology.orchestra.run.smithi042.stdout:Unable to read consumer identity 2023-07-29T01:40:01.563 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:02 ago on Sat 29 Jul 2023 01:39:59 AM UTC. 2023-07-29T01:40:01.606 INFO:teuthology.orchestra.run.smithi042.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-29T01:40:01.635 INFO:teuthology.orchestra.run.smithi042.stderr:Error: No packages marked for reinstall. 2023-07-29T01:40:01.682 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum reinstall -y kernel || true 2023-07-29T01:40:02.034 INFO:teuthology.orchestra.run.smithi042.stdout:Updating Subscription Management repositories. 2023-07-29T01:40:02.035 INFO:teuthology.orchestra.run.smithi042.stdout:Unable to read consumer identity 2023-07-29T01:40:02.301 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:00:03 ago on Sat 29 Jul 2023 01:39:59 AM UTC. 2023-07-29T01:40:02.344 INFO:teuthology.orchestra.run.smithi042.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-29T01:40:02.393 INFO:teuthology.orchestra.run.smithi042.stderr:Error: No packages marked for reinstall. 2023-07-29T01:40:02.445 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q kernel | sort -rV | head -n 1 2023-07-29T01:40:02.528 INFO:teuthology.orchestra.run.smithi042.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-29T01:40:02.528 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-29T01:40:02.528 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-29T01:40:02.529 DEBUG:teuthology.parallel:result is None 2023-07-29T01:40:02.529 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-29T01:40:02.536 INFO:teuthology.task.internal:Creating test directory... 2023-07-29T01:40:02.537 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-29T01:40:02.539 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-29T01:40:02.561 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-29T01:40:02.569 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-29T01:40:02.583 INFO:teuthology.task.internal:Creating archive directory... 2023-07-29T01:40:02.583 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-29T01:40:02.595 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-29T01:40:02.640 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-29T01:40:02.648 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-29T01:40:02.648 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-29T01:40:02.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T01:40:02.693 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-29T01:40:02.695 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-29T01:40:02.739 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-29T01:40:02.758 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-29T01:40:02.791 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-29T01:40:02.807 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-29T01:40:02.809 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-29T01:40:02.816 INFO:teuthology.task.internal:Configuring sudo... 2023-07-29T01:40:02.816 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-29T01:40:02.819 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-29T01:40:02.847 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-29T01:40:02.856 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-29T01:40:02.857 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-29T01:40:02.887 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-29T01:40:02.905 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T01:40:07.859 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T01:40:07.900 DEBUG:teuthology.orchestra.run.smithi042:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T01:40:07.989 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T01:40:08.036 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:40:08.038 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-29T01:40:08.110 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T01:40:08.161 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-29T01:40:08.208 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T01:40:08.296 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-29T01:40:08.339 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:40:08.340 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-29T01:40:08.409 DEBUG:teuthology.orchestra.run.smithi042:> sudo service rsyslog restart 2023-07-29T01:40:08.412 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2023-07-29T01:40:08.475 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-29T01:40:08.509 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-29T01:40:08.953 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-29T01:40:08.960 INFO:teuthology.task.internal:Starting timer... 2023-07-29T01:40:08.961 INFO:teuthology.run_tasks:Running task pcp... 2023-07-29T01:40:08.971 INFO:teuthology.run_tasks:Running task selinux... 2023-07-29T01:40:08.981 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-07-29T01:40:08.982 DEBUG:teuthology.orchestra.run.smithi042:> sudo service auditd rotate 2023-07-29T01:40:09.054 INFO:teuthology.orchestra.run.smithi042.stdout:Rotating logs: 2023-07-29T01:40:09.056 DEBUG:teuthology.orchestra.run.smithi144:> sudo service auditd rotate 2023-07-29T01:40:09.126 INFO:teuthology.orchestra.run.smithi144.stdout:Rotating logs: 2023-07-29T01:40:09.127 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-29T01:40:09.128 DEBUG:teuthology.orchestra.run.smithi042:> /usr/sbin/getenforce 2023-07-29T01:40:09.150 INFO:teuthology.orchestra.run.smithi042.stdout:Permissive 2023-07-29T01:40:09.150 DEBUG:teuthology.orchestra.run.smithi144:> /usr/sbin/getenforce 2023-07-29T01:40:09.174 INFO:teuthology.orchestra.run.smithi144.stdout:Permissive 2023-07-29T01:40:09.175 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi042.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi144.front.sepia.ceph.com': 'permissive'} 2023-07-29T01:40:09.175 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-29T01:40:09.218 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T01:40:09.219 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-29T01:40:09.246 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T01:40:09.247 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-29T01:40:09.247 DEBUG:teuthology.orchestra.run.smithi042:> sudo /usr/sbin/setenforce permissive 2023-07-29T01:40:09.288 DEBUG:teuthology.orchestra.run.smithi144:> sudo /usr/sbin/setenforce permissive 2023-07-29T01:40:09.315 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-29T01:40:09.324 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-07-29T01:40:09.331 INFO:teuthology.repo_utils:Fetching main from origin 2023-07-29T01:40:14.522 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-29T01:40:14.544 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-29T01:40:14.546 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi042.front.sepia.ceph.com,smithi144.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-29T01:55:45.145 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi042.front.sepia.ceph.com'), Remote(name='ubuntu@smithi144.front.sepia.ceph.com')] 2023-07-29T01:55:45.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2023-07-29T01:55:45.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T01:55:45.215 DEBUG:teuthology.orchestra.run.smithi042:> true 2023-07-29T01:55:45.281 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2023-07-29T01:55:45.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-07-29T01:55:45.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T01:55:45.350 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-07-29T01:55:45.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-07-29T01:55:45.418 INFO:teuthology.run_tasks:Running task clock... 2023-07-29T01:55:45.430 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-29T01:55:45.430 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-29T01:55:45.431 DEBUG:teuthology.orchestra.run.smithi042:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-29T01:55:45.433 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-29T01:55:45.434 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-29T01:55:45.465 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-29T01:55:45.481 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-29T01:55:45.489 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-29T01:55:45.503 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-29T01:55:45.554 INFO:teuthology.orchestra.run.smithi042.stderr:sudo: ntpd: command not found 2023-07-29T01:55:45.566 INFO:teuthology.orchestra.run.smithi042.stdout:506 Cannot talk to daemon 2023-07-29T01:55:45.581 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-29T01:55:45.582 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: ntpd: command not found 2023-07-29T01:55:45.594 INFO:teuthology.orchestra.run.smithi144.stdout:506 Cannot talk to daemon 2023-07-29T01:55:45.596 INFO:teuthology.orchestra.run.smithi042.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-29T01:55:45.608 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-29T01:55:45.623 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-29T01:55:45.665 INFO:teuthology.orchestra.run.smithi042.stderr:bash: ntpq: command not found 2023-07-29T01:55:45.669 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-29T01:55:45.669 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2023-07-29T01:55:45.669 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T01:55:45.670 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T01:55:45.670 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T01:55:45.670 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T01:55:45.691 INFO:teuthology.orchestra.run.smithi144.stderr:bash: ntpq: command not found 2023-07-29T01:55:45.695 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-29T01:55:45.695 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2023-07-29T01:55:45.695 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T01:55:45.695 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T01:55:45.695 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T01:55:45.696 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T01:55:45.696 INFO:teuthology.run_tasks:Running task install... 2023-07-29T01:55:45.708 DEBUG:teuthology.task.install:project ceph 2023-07-29T01:55:45.709 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}} 2023-07-29T01:55:45.710 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'} 2023-07-29T01:55:45.710 INFO:teuthology.task.install:Using flavor: default 2023-07-29T01:55:45.720 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-29T01:55:45.720 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-29T01:55:45.721 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577', 'tag': None, 'wait_for_package': False} 2023-07-29T01:55:45.721 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T01:55:45.723 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577', 'tag': None, 'wait_for_package': False} 2023-07-29T01:55:45.724 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T01:55:46.204 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/ 2023-07-29T01:55:46.205 INFO:teuthology.task.install.rpm:Package version is 18.1.3-11.g0484097b 2023-07-29T01:55:51.214 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/ 2023-07-29T01:55:51.214 INFO:teuthology.task.install.rpm:Package version is 18.1.3-11.g0484097b 2023-07-29T01:55:56.506 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-29T01:55:56.506 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:55:56.506 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-29T01:55:56.541 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-29T01:55:56.541 DEBUG:teuthology.orchestra.run.smithi042:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0484097b0572e96f42cf6402cbe0ac8dcb046577/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-29T01:55:56.599 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/reef-release/0484097b0572e96f42cf6402cbe0ac8dcb046577/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-29T01:55:56.600 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:55:56.600 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-29T01:55:56.613 DEBUG:teuthology.orchestra.run.smithi042:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-29T01:55:56.633 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-29T01:55:56.634 DEBUG:teuthology.orchestra.run.smithi144:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/0484097b0572e96f42cf6402cbe0ac8dcb046577/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-29T01:55:56.696 DEBUG:teuthology.orchestra.run.smithi042:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-29T01:55:56.704 DEBUG:teuthology.orchestra.run.smithi144:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-29T01:55:56.725 INFO:teuthology.orchestra.run.smithi042.stdout:check_obsoletes = 1 2023-07-29T01:55:56.726 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum clean all 2023-07-29T01:55:56.784 DEBUG:teuthology.orchestra.run.smithi144:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-29T01:55:56.852 INFO:teuthology.orchestra.run.smithi144.stdout:check_obsoletes = 1 2023-07-29T01:55:56.853 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum clean all 2023-07-29T01:55:57.120 INFO:teuthology.orchestra.run.smithi042.stdout:Updating Subscription Management repositories. 2023-07-29T01:55:57.224 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-07-29T01:55:57.507 INFO:teuthology.orchestra.run.smithi144.stdout:44 files removed 2023-07-29T01:55:57.536 INFO:teuthology.orchestra.run.smithi042.stdout:44 files removed 2023-07-29T01:55:57.555 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-29T01:55:57.584 DEBUG:teuthology.orchestra.run.smithi042:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-29T01:55:57.883 INFO:teuthology.orchestra.run.smithi144.stdout:Updating Subscription Management repositories. 2023-07-29T01:55:57.935 INFO:teuthology.orchestra.run.smithi042.stdout:Updating Subscription Management repositories. 2023-07-29T01:55:59.295 INFO:teuthology.orchestra.run.smithi144.stdout:ceph packages for x86_64 77 kB/s | 80 kB 00:01 2023-07-29T01:55:59.348 INFO:teuthology.orchestra.run.smithi042.stdout:ceph packages for x86_64 77 kB/s | 80 kB 00:01 2023-07-29T01:56:00.070 INFO:teuthology.orchestra.run.smithi144.stdout:ceph noarch packages 13 kB/s | 9.4 kB 00:00 2023-07-29T01:56:00.140 INFO:teuthology.orchestra.run.smithi042.stdout:ceph noarch packages 12 kB/s | 9.4 kB 00:00 2023-07-29T01:56:00.871 INFO:teuthology.orchestra.run.smithi144.stdout:ceph source packages 1.9 kB/s | 1.5 kB 00:00 2023-07-29T01:56:00.972 INFO:teuthology.orchestra.run.smithi042.stdout:ceph source packages 1.8 kB/s | 1.5 kB 00:00 2023-07-29T01:56:01.355 INFO:teuthology.orchestra.run.smithi144.stdout:Copr repo for python3-asyncssh owned by ceph 7.5 kB/s | 3.5 kB 00:00 2023-07-29T01:56:01.516 INFO:teuthology.orchestra.run.smithi042.stdout:Copr repo for python3-asyncssh owned by ceph 6.6 kB/s | 3.5 kB 00:00 2023-07-29T01:56:04.991 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 4.3 MB/s | 16 MB 00:03 2023-07-29T01:56:07.208 INFO:teuthology.orchestra.run.smithi042.stdout:Extra Packages for Enterprise Linux 2.8 MB/s | 16 MB 00:05 2023-07-29T01:56:08.463 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 457 kB/s | 24 kB 00:00 2023-07-29T01:56:09.357 INFO:teuthology.orchestra.run.smithi144.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 MB/s | 53 MB 00:00 2023-07-29T01:56:10.885 INFO:teuthology.orchestra.run.smithi042.stdout:lab-extras 391 kB/s | 24 kB 00:00 2023-07-29T01:56:11.854 INFO:teuthology.orchestra.run.smithi042.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 53 MB/s | 47 MB 00:00 2023-07-29T01:56:17.399 INFO:teuthology.orchestra.run.smithi144.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 61 MB/s | 47 MB 00:00 2023-07-29T01:56:20.296 INFO:teuthology.orchestra.run.smithi042.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 57 MB/s | 53 MB 00:00 2023-07-29T01:56:28.313 INFO:teuthology.orchestra.run.smithi144.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-29T01:56:28.314 INFO:teuthology.orchestra.run.smithi144.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-29T01:56:28.329 INFO:teuthology.orchestra.run.smithi144.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-29T01:56:28.330 INFO:teuthology.orchestra.run.smithi144.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-29T01:56:28.331 INFO:teuthology.orchestra.run.smithi144.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-29T01:56:28.332 INFO:teuthology.orchestra.run.smithi144.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-29T01:56:28.334 INFO:teuthology.orchestra.run.smithi144.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-29T01:56:28.337 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-29T01:56:28.338 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-29T01:56:28.473 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2023-07-29T01:56:28.485 INFO:teuthology.orchestra.run.smithi144.stdout:=========================================================================================================================== 2023-07-29T01:56:28.485 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2023-07-29T01:56:28.485 INFO:teuthology.orchestra.run.smithi144.stdout:=========================================================================================================================== 2023-07-29T01:56:28.486 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2023-07-29T01:56:28.486 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-29T01:56:28.486 INFO:teuthology.orchestra.run.smithi144.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-29T01:56:28.486 INFO:teuthology.orchestra.run.smithi144.stdout: ceph x86_64 2:18.1.3-11.g0484097b.el8 ceph 6.4 k 2023-07-29T01:56:28.486 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base x86_64 2:18.1.3-11.g0484097b.el8 ceph 5.4 M 2023-07-29T01:56:28.486 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse x86_64 2:18.1.3-11.g0484097b.el8 ceph 847 k 2023-07-29T01:56:28.486 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache x86_64 2:18.1.3-11.g0484097b.el8 ceph 165 k 2023-07-29T01:56:28.487 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr x86_64 2:18.1.3-11.g0484097b.el8 ceph 1.5 M 2023-07-29T01:56:28.487 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 127 k 2023-07-29T01:56:28.487 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 1.7 M 2023-07-29T01:56:28.487 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 7.4 M 2023-07-29T01:56:28.487 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 47 k 2023-07-29T01:56:28.487 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw x86_64 2:18.1.3-11.g0484097b.el8 ceph 13 M 2023-07-29T01:56:28.488 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test x86_64 2:18.1.3-11.g0484097b.el8 ceph 47 M 2023-07-29T01:56:28.488 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 258 k 2023-07-29T01:56:28.488 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 160 k 2023-07-29T01:56:28.488 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror x86_64 2:18.1.3-11.g0484097b.el8 ceph 257 k 2023-07-29T01:56:28.488 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 18 k 2023-07-29T01:56:28.488 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-29T01:56:28.488 INFO:teuthology.orchestra.run.smithi144.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-29T01:56:28.489 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-29T01:56:28.489 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel x86_64 2:18.1.3-11.g0484097b.el8 ceph 30 k 2023-07-29T01:56:28.489 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 769 k 2023-07-29T01:56:28.489 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel x86_64 2:18.1.3-11.g0484097b.el8 ceph 139 k 2023-07-29T01:56:28.489 INFO:teuthology.orchestra.run.smithi144.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-29T01:56:28.489 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-29T01:56:28.490 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-29T01:56:28.490 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-29T01:56:28.490 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-29T01:56:28.490 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-29T01:56:28.490 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs x86_64 2:18.1.3-11.g0484097b.el8 ceph 190 k 2023-07-29T01:56:28.490 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados x86_64 2:18.1.3-11.g0484097b.el8 ceph 371 k 2023-07-29T01:56:28.491 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd x86_64 2:18.1.3-11.g0484097b.el8 ceph 364 k 2023-07-29T01:56:28.491 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw x86_64 2:18.1.3-11.g0484097b.el8 ceph 107 k 2023-07-29T01:56:28.491 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse x86_64 2:18.1.3-11.g0484097b.el8 ceph 94 k 2023-07-29T01:56:28.491 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.4 M 2023-07-29T01:56:28.491 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd x86_64 2:18.1.3-11.g0484097b.el8 ceph 179 k 2023-07-29T01:56:28.491 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-29T01:56:28.491 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2023-07-29T01:56:28.492 INFO:teuthology.orchestra.run.smithi144.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-29T01:56:28.492 INFO:teuthology.orchestra.run.smithi144.stdout: librados2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.7 M 2023-07-29T01:56:28.492 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1 x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.6 M 2023-07-29T01:56:28.492 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2023-07-29T01:56:28.492 INFO:teuthology.orchestra.run.smithi144.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-29T01:56:28.492 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common x86_64 2:18.1.3-11.g0484097b.el8 ceph 22 M 2023-07-29T01:56:28.492 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 23 k 2023-07-29T01:56:28.493 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds x86_64 2:18.1.3-11.g0484097b.el8 ceph 2.3 M 2023-07-29T01:56:28.493 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 240 k 2023-07-29T01:56:28.493 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon x86_64 2:18.1.3-11.g0484097b.el8 ceph 4.6 M 2023-07-29T01:56:28.493 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd x86_64 2:18.1.3-11.g0484097b.el8 ceph 18 M 2023-07-29T01:56:28.493 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 15 k 2023-07-29T01:56:28.493 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux x86_64 2:18.1.3-11.g0484097b.el8 ceph 24 k 2023-07-29T01:56:28.493 INFO:teuthology.orchestra.run.smithi144.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-29T01:56:28.494 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-29T01:56:28.494 INFO:teuthology.orchestra.run.smithi144.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-29T01:56:28.494 INFO:teuthology.orchestra.run.smithi144.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-29T01:56:28.494 INFO:teuthology.orchestra.run.smithi144.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-29T01:56:28.494 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite x86_64 2:18.1.3-11.g0484097b.el8 ceph 137 k 2023-07-29T01:56:28.494 INFO:teuthology.orchestra.run.smithi144.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-29T01:56:28.494 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-29T01:56:28.495 INFO:teuthology.orchestra.run.smithi144.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-29T01:56:28.495 INFO:teuthology.orchestra.run.smithi144.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-29T01:56:28.495 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-29T01:56:28.495 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-29T01:56:28.495 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1 x86_64 2:18.1.3-11.g0484097b.el8 ceph 474 k 2023-07-29T01:56:28.495 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-29T01:56:28.496 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 6.5 M 2023-07-29T01:56:28.496 INFO:teuthology.orchestra.run.smithi144.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-29T01:56:28.496 INFO:teuthology.orchestra.run.smithi144.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-29T01:56:28.496 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-29T01:56:28.496 INFO:teuthology.orchestra.run.smithi144.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-29T01:56:28.496 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-29T01:56:28.496 INFO:teuthology.orchestra.run.smithi144.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-29T01:56:28.497 INFO:teuthology.orchestra.run.smithi144.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-29T01:56:28.497 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-29T01:56:28.497 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-29T01:56:28.497 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-29T01:56:28.497 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-29T01:56:28.497 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-29T01:56:28.497 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-29T01:56:28.498 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-29T01:56:28.498 INFO:teuthology.orchestra.run.smithi144.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-29T01:56:28.498 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-29T01:56:28.498 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse x86_64 2:18.1.3-11.g0484097b.el8 ceph 45 k 2023-07-29T01:56:28.498 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common x86_64 2:18.1.3-11.g0484097b.el8 ceph 119 k 2023-07-29T01:56:28.498 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-29T01:56:28.498 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-29T01:56:28.499 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-29T01:56:28.499 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-29T01:56:28.499 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-29T01:56:28.499 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-29T01:56:28.499 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-29T01:56:28.499 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-29T01:56:28.499 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-29T01:56:28.500 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-29T01:56:28.500 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-29T01:56:28.500 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-29T01:56:28.500 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-29T01:56:28.500 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-29T01:56:28.500 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-29T01:56:28.501 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-29T01:56:28.501 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-29T01:56:28.501 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-29T01:56:28.501 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-29T01:56:28.501 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-29T01:56:28.501 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-29T01:56:28.501 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-29T01:56:28.502 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-29T01:56:28.502 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-29T01:56:28.502 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-29T01:56:28.502 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-29T01:56:28.502 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-29T01:56:28.503 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-29T01:56:28.503 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-29T01:56:28.503 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-29T01:56:28.503 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-29T01:56:28.503 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-29T01:56:28.503 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-07-29T01:56:28.503 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-29T01:56:28.504 INFO:teuthology.orchestra.run.smithi144.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-29T01:56:28.504 INFO:teuthology.orchestra.run.smithi144.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-29T01:56:28.504 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-29T01:56:28.504 INFO:teuthology.orchestra.run.smithi144.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-29T01:56:28.504 INFO:teuthology.orchestra.run.smithi144.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-29T01:56:28.504 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-29T01:56:28.505 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-29T01:56:28.505 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-29T01:56:28.505 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-29T01:56:28.505 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-29T01:56:28.505 INFO:teuthology.orchestra.run.smithi144.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-29T01:56:28.505 INFO:teuthology.orchestra.run.smithi144.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-29T01:56:28.505 INFO:teuthology.orchestra.run.smithi144.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-29T01:56:28.506 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-29T01:56:28.506 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-29T01:56:28.506 INFO:teuthology.orchestra.run.smithi144.stdout:Enabling module streams: 2023-07-29T01:56:28.506 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql 10 2023-07-29T01:56:28.506 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:56:28.506 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2023-07-29T01:56:28.507 INFO:teuthology.orchestra.run.smithi144.stdout:=========================================================================================================================== 2023-07-29T01:56:28.507 INFO:teuthology.orchestra.run.smithi144.stdout:Install 128 Packages 2023-07-29T01:56:28.507 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 3 Packages 2023-07-29T01:56:28.507 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:56:28.508 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 203 M 2023-07-29T01:56:28.508 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2023-07-29T01:56:29.299 INFO:teuthology.orchestra.run.smithi144.stdout:(1/131): ceph-18.1.3-11.g0484097b.el8.x86_64.rp 19 kB/s | 6.4 kB 00:00 2023-07-29T01:56:30.432 INFO:teuthology.orchestra.run.smithi144.stdout:(2/131): ceph-fuse-18.1.3-11.g0484097b.el8.x86_ 748 kB/s | 847 kB 00:01 2023-07-29T01:56:30.824 INFO:teuthology.orchestra.run.smithi144.stdout:(3/131): ceph-immutable-object-cache-18.1.3-11. 423 kB/s | 165 kB 00:00 2023-07-29T01:56:32.413 INFO:teuthology.orchestra.run.smithi042.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-29T01:56:32.414 INFO:teuthology.orchestra.run.smithi042.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-29T01:56:32.429 INFO:teuthology.orchestra.run.smithi042.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-29T01:56:32.431 INFO:teuthology.orchestra.run.smithi042.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-29T01:56:32.432 INFO:teuthology.orchestra.run.smithi042.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-29T01:56:32.433 INFO:teuthology.orchestra.run.smithi042.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-29T01:56:32.435 INFO:teuthology.orchestra.run.smithi042.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-29T01:56:32.438 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-29T01:56:32.440 INFO:teuthology.orchestra.run.smithi042.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-29T01:56:32.586 INFO:teuthology.orchestra.run.smithi042.stdout:Dependencies resolved. 2023-07-29T01:56:32.599 INFO:teuthology.orchestra.run.smithi042.stdout:=========================================================================================================================== 2023-07-29T01:56:32.599 INFO:teuthology.orchestra.run.smithi042.stdout: Package Arch Version Repository Size 2023-07-29T01:56:32.599 INFO:teuthology.orchestra.run.smithi042.stdout:=========================================================================================================================== 2023-07-29T01:56:32.599 INFO:teuthology.orchestra.run.smithi042.stdout:Installing: 2023-07-29T01:56:32.599 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-29T01:56:32.600 INFO:teuthology.orchestra.run.smithi042.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-29T01:56:32.600 INFO:teuthology.orchestra.run.smithi042.stdout: ceph x86_64 2:18.1.3-11.g0484097b.el8 ceph 6.4 k 2023-07-29T01:56:32.600 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base x86_64 2:18.1.3-11.g0484097b.el8 ceph 5.4 M 2023-07-29T01:56:32.600 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse x86_64 2:18.1.3-11.g0484097b.el8 ceph 847 k 2023-07-29T01:56:32.600 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache x86_64 2:18.1.3-11.g0484097b.el8 ceph 165 k 2023-07-29T01:56:32.600 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr x86_64 2:18.1.3-11.g0484097b.el8 ceph 1.5 M 2023-07-29T01:56:32.600 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 127 k 2023-07-29T01:56:32.601 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 1.7 M 2023-07-29T01:56:32.601 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 7.4 M 2023-07-29T01:56:32.601 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 47 k 2023-07-29T01:56:32.601 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw x86_64 2:18.1.3-11.g0484097b.el8 ceph 13 M 2023-07-29T01:56:32.601 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test x86_64 2:18.1.3-11.g0484097b.el8 ceph 47 M 2023-07-29T01:56:32.601 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 258 k 2023-07-29T01:56:32.601 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 160 k 2023-07-29T01:56:32.602 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-mirror x86_64 2:18.1.3-11.g0484097b.el8 ceph 257 k 2023-07-29T01:56:32.602 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-top noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 18 k 2023-07-29T01:56:32.602 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-29T01:56:32.602 INFO:teuthology.orchestra.run.smithi042.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-29T01:56:32.602 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-29T01:56:32.602 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel x86_64 2:18.1.3-11.g0484097b.el8 ceph 30 k 2023-07-29T01:56:32.602 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 769 k 2023-07-29T01:56:32.602 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel x86_64 2:18.1.3-11.g0484097b.el8 ceph 139 k 2023-07-29T01:56:32.603 INFO:teuthology.orchestra.run.smithi042.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-29T01:56:32.603 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-29T01:56:32.603 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-29T01:56:32.603 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-29T01:56:32.603 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-29T01:56:32.603 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-29T01:56:32.603 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs x86_64 2:18.1.3-11.g0484097b.el8 ceph 190 k 2023-07-29T01:56:32.604 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados x86_64 2:18.1.3-11.g0484097b.el8 ceph 371 k 2023-07-29T01:56:32.604 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd x86_64 2:18.1.3-11.g0484097b.el8 ceph 364 k 2023-07-29T01:56:32.604 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw x86_64 2:18.1.3-11.g0484097b.el8 ceph 107 k 2023-07-29T01:56:32.604 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse x86_64 2:18.1.3-11.g0484097b.el8 ceph 94 k 2023-07-29T01:56:32.604 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.4 M 2023-07-29T01:56:32.604 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd x86_64 2:18.1.3-11.g0484097b.el8 ceph 179 k 2023-07-29T01:56:32.604 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-29T01:56:32.605 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrading: 2023-07-29T01:56:32.605 INFO:teuthology.orchestra.run.smithi042.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-29T01:56:32.605 INFO:teuthology.orchestra.run.smithi042.stdout: librados2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.7 M 2023-07-29T01:56:32.605 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1 x86_64 2:18.1.3-11.g0484097b.el8 ceph 3.6 M 2023-07-29T01:56:32.605 INFO:teuthology.orchestra.run.smithi042.stdout:Installing dependencies: 2023-07-29T01:56:32.605 INFO:teuthology.orchestra.run.smithi042.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-29T01:56:32.605 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common x86_64 2:18.1.3-11.g0484097b.el8 ceph 22 M 2023-07-29T01:56:32.606 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 23 k 2023-07-29T01:56:32.606 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds x86_64 2:18.1.3-11.g0484097b.el8 ceph 2.3 M 2023-07-29T01:56:32.606 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 240 k 2023-07-29T01:56:32.606 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon x86_64 2:18.1.3-11.g0484097b.el8 ceph 4.6 M 2023-07-29T01:56:32.606 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd x86_64 2:18.1.3-11.g0484097b.el8 ceph 18 M 2023-07-29T01:56:32.606 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts noarch 2:18.1.3-11.g0484097b.el8 ceph-noarch 15 k 2023-07-29T01:56:32.606 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux x86_64 2:18.1.3-11.g0484097b.el8 ceph 24 k 2023-07-29T01:56:32.606 INFO:teuthology.orchestra.run.smithi042.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-29T01:56:32.607 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-29T01:56:32.607 INFO:teuthology.orchestra.run.smithi042.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-29T01:56:32.607 INFO:teuthology.orchestra.run.smithi042.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-29T01:56:32.607 INFO:teuthology.orchestra.run.smithi042.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-29T01:56:32.607 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite x86_64 2:18.1.3-11.g0484097b.el8 ceph 137 k 2023-07-29T01:56:32.607 INFO:teuthology.orchestra.run.smithi042.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-29T01:56:32.607 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-29T01:56:32.607 INFO:teuthology.orchestra.run.smithi042.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-29T01:56:32.608 INFO:teuthology.orchestra.run.smithi042.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-29T01:56:32.608 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-29T01:56:32.608 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-29T01:56:32.608 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1 x86_64 2:18.1.3-11.g0484097b.el8 ceph 474 k 2023-07-29T01:56:32.608 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-29T01:56:32.608 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2 x86_64 2:18.1.3-11.g0484097b.el8 ceph 6.5 M 2023-07-29T01:56:32.609 INFO:teuthology.orchestra.run.smithi042.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-29T01:56:32.609 INFO:teuthology.orchestra.run.smithi042.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-29T01:56:32.609 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-29T01:56:32.609 INFO:teuthology.orchestra.run.smithi042.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-29T01:56:32.609 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-29T01:56:32.609 INFO:teuthology.orchestra.run.smithi042.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-29T01:56:32.609 INFO:teuthology.orchestra.run.smithi042.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-29T01:56:32.610 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-29T01:56:32.610 INFO:teuthology.orchestra.run.smithi042.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-29T01:56:32.610 INFO:teuthology.orchestra.run.smithi042.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-29T01:56:32.610 INFO:teuthology.orchestra.run.smithi042.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-29T01:56:32.610 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-29T01:56:32.610 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-29T01:56:32.610 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-29T01:56:32.611 INFO:teuthology.orchestra.run.smithi042.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-29T01:56:32.611 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-29T01:56:32.611 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse x86_64 2:18.1.3-11.g0484097b.el8 ceph 45 k 2023-07-29T01:56:32.611 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common x86_64 2:18.1.3-11.g0484097b.el8 ceph 119 k 2023-07-29T01:56:32.611 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-29T01:56:32.611 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-29T01:56:32.611 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-29T01:56:32.612 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-29T01:56:32.612 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-29T01:56:32.612 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-29T01:56:32.612 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-29T01:56:32.612 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-29T01:56:32.612 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-29T01:56:32.613 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-29T01:56:32.613 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-29T01:56:32.613 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-29T01:56:32.613 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-29T01:56:32.613 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-29T01:56:32.613 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-29T01:56:32.613 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-29T01:56:32.613 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-29T01:56:32.614 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-29T01:56:32.614 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-29T01:56:32.614 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-29T01:56:32.614 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-29T01:56:32.614 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-29T01:56:32.614 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-29T01:56:32.614 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-29T01:56:32.615 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-29T01:56:32.615 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-29T01:56:32.615 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-29T01:56:32.615 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-29T01:56:32.615 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-29T01:56:32.615 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-29T01:56:32.615 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-29T01:56:32.616 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-29T01:56:32.616 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-07-29T01:56:32.616 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-29T01:56:32.616 INFO:teuthology.orchestra.run.smithi042.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-29T01:56:32.616 INFO:teuthology.orchestra.run.smithi042.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-29T01:56:32.616 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-29T01:56:32.616 INFO:teuthology.orchestra.run.smithi042.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-29T01:56:32.617 INFO:teuthology.orchestra.run.smithi042.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-29T01:56:32.617 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-29T01:56:32.617 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-29T01:56:32.617 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-29T01:56:32.617 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-29T01:56:32.617 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-29T01:56:32.617 INFO:teuthology.orchestra.run.smithi042.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-29T01:56:32.617 INFO:teuthology.orchestra.run.smithi042.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-29T01:56:32.618 INFO:teuthology.orchestra.run.smithi042.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-29T01:56:32.618 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-29T01:56:32.618 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-29T01:56:32.618 INFO:teuthology.orchestra.run.smithi042.stdout:Enabling module streams: 2023-07-29T01:56:32.618 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql 10 2023-07-29T01:56:32.618 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:56:32.618 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary 2023-07-29T01:56:32.619 INFO:teuthology.orchestra.run.smithi042.stdout:=========================================================================================================================== 2023-07-29T01:56:32.619 INFO:teuthology.orchestra.run.smithi042.stdout:Install 128 Packages 2023-07-29T01:56:32.619 INFO:teuthology.orchestra.run.smithi042.stdout:Upgrade 3 Packages 2023-07-29T01:56:32.619 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:56:32.619 INFO:teuthology.orchestra.run.smithi042.stdout:Total download size: 203 M 2023-07-29T01:56:32.620 INFO:teuthology.orchestra.run.smithi042.stdout:Downloading Packages: 2023-07-29T01:56:33.831 INFO:teuthology.orchestra.run.smithi042.stdout:(1/131): ceph-18.1.3-11.g0484097b.el8.x86_64.rp 12 kB/s | 6.4 kB 00:00 2023-07-29T01:56:35.173 INFO:teuthology.orchestra.run.smithi042.stdout:(2/131): ceph-fuse-18.1.3-11.g0484097b.el8.x86_ 632 kB/s | 847 kB 00:01 2023-07-29T01:56:35.464 INFO:teuthology.orchestra.run.smithi042.stdout:(3/131): ceph-immutable-object-cache-18.1.3-11. 568 kB/s | 165 kB 00:00 2023-07-29T01:56:36.856 INFO:teuthology.orchestra.run.smithi042.stdout:(4/131): ceph-mds-18.1.3-11.g0484097b.el8.x86_6 1.6 MB/s | 2.3 MB 00:01 2023-07-29T01:56:37.015 INFO:teuthology.orchestra.run.smithi042.stdout:(5/131): ceph-base-18.1.3-11.g0484097b.el8.x86_ 1.4 MB/s | 5.4 MB 00:03 2023-07-29T01:56:37.423 INFO:teuthology.orchestra.run.smithi042.stdout:(6/131): ceph-mgr-18.1.3-11.g0484097b.el8.x86_6 2.7 MB/s | 1.5 MB 00:00 2023-07-29T01:56:37.465 INFO:teuthology.orchestra.run.smithi144.stdout:(4/131): ceph-mds-18.1.3-11.g0484097b.el8.x86_6 351 kB/s | 2.3 MB 00:06 2023-07-29T01:56:38.124 INFO:teuthology.orchestra.run.smithi042.stdout:(7/131): ceph-mon-18.1.3-11.g0484097b.el8.x86_6 4.2 MB/s | 4.6 MB 00:01 2023-07-29T01:56:38.849 INFO:teuthology.orchestra.run.smithi144.stdout:(5/131): ceph-base-18.1.3-11.g0484097b.el8.x86_ 558 kB/s | 5.4 MB 00:09 2023-07-29T01:56:39.284 INFO:teuthology.orchestra.run.smithi042.stdout:(8/131): ceph-common-18.1.3-11.g0484097b.el8.x8 3.6 MB/s | 22 MB 00:05 2023-07-29T01:56:39.399 INFO:teuthology.orchestra.run.smithi042.stdout:(9/131): ceph-selinux-18.1.3-11.g0484097b.el8.x 208 kB/s | 24 kB 00:00 2023-07-29T01:56:39.400 INFO:teuthology.orchestra.run.smithi144.stdout:(6/131): ceph-mgr-18.1.3-11.g0484097b.el8.x86_6 820 kB/s | 1.5 MB 00:01 2023-07-29T01:56:39.733 INFO:teuthology.orchestra.run.smithi042.stdout:(10/131): ceph-radosgw-18.1.3-11.g0484097b.el8. 8.1 MB/s | 13 MB 00:01 2023-07-29T01:56:39.883 INFO:teuthology.orchestra.run.smithi042.stdout:(11/131): cephfs-mirror-18.1.3-11.g0484097b.el8 1.7 MB/s | 257 kB 00:00 2023-07-29T01:56:40.025 INFO:teuthology.orchestra.run.smithi042.stdout:(12/131): libcephfs-devel-18.1.3-11.g0484097b.e 215 kB/s | 30 kB 00:00 2023-07-29T01:56:40.300 INFO:teuthology.orchestra.run.smithi042.stdout:(13/131): ceph-osd-18.1.3-11.g0484097b.el8.x86_ 6.1 MB/s | 18 MB 00:02 2023-07-29T01:56:40.342 INFO:teuthology.orchestra.run.smithi042.stdout:(14/131): libcephfs2-18.1.3-11.g0484097b.el8.x8 2.4 MB/s | 769 kB 00:00 2023-07-29T01:56:40.418 INFO:teuthology.orchestra.run.smithi042.stdout:(15/131): libcephsqlite-18.1.3-11.g0484097b.el8 1.1 MB/s | 137 kB 00:00 2023-07-29T01:56:40.501 INFO:teuthology.orchestra.run.smithi042.stdout:(16/131): librados-devel-18.1.3-11.g0484097b.el 875 kB/s | 139 kB 00:00 2023-07-29T01:56:40.552 INFO:teuthology.orchestra.run.smithi042.stdout:(17/131): libradosstriper1-18.1.3-11.g0484097b. 3.5 MB/s | 474 kB 00:00 2023-07-29T01:56:40.702 INFO:teuthology.orchestra.run.smithi042.stdout:(18/131): python3-ceph-argparse-18.1.3-11.g0484 297 kB/s | 45 kB 00:00 2023-07-29T01:56:40.844 INFO:teuthology.orchestra.run.smithi042.stdout:(19/131): python3-ceph-common-18.1.3-11.g048409 839 kB/s | 119 kB 00:00 2023-07-29T01:56:41.011 INFO:teuthology.orchestra.run.smithi042.stdout:(20/131): python3-cephfs-18.1.3-11.g0484097b.el 1.1 MB/s | 190 kB 00:00 2023-07-29T01:56:41.428 INFO:teuthology.orchestra.run.smithi042.stdout:(21/131): librgw2-18.1.3-11.g0484097b.el8.x86_6 7.0 MB/s | 6.5 MB 00:00 2023-07-29T01:56:41.603 INFO:teuthology.orchestra.run.smithi042.stdout:(22/131): python3-rados-18.1.3-11.g0484097b.el8 626 kB/s | 371 kB 00:00 2023-07-29T01:56:41.737 INFO:teuthology.orchestra.run.smithi042.stdout:(23/131): python3-rgw-18.1.3-11.g0484097b.el8.x 801 kB/s | 107 kB 00:00 2023-07-29T01:56:41.762 INFO:teuthology.orchestra.run.smithi042.stdout:(24/131): python3-rbd-18.1.3-11.g0484097b.el8.x 1.1 MB/s | 364 kB 00:00 2023-07-29T01:56:41.866 INFO:teuthology.orchestra.run.smithi144.stdout:(7/131): ceph-mon-18.1.3-11.g0484097b.el8.x86_6 1.5 MB/s | 4.6 MB 00:03 2023-07-29T01:56:41.870 INFO:teuthology.orchestra.run.smithi042.stdout:(25/131): rbd-fuse-18.1.3-11.g0484097b.el8.x86_ 707 kB/s | 94 kB 00:00 2023-07-29T01:56:42.029 INFO:teuthology.orchestra.run.smithi042.stdout:(26/131): rbd-nbd-18.1.3-11.g0484097b.el8.x86_6 1.1 MB/s | 179 kB 00:00 2023-07-29T01:56:42.343 INFO:teuthology.orchestra.run.smithi042.stdout:(27/131): ceph-grafana-dashboards-18.1.3-11.g04 73 kB/s | 23 kB 00:00 2023-07-29T01:56:42.525 INFO:teuthology.orchestra.run.smithi042.stdout:(28/131): ceph-mgr-cephadm-18.1.3-11.g0484097b. 704 kB/s | 127 kB 00:00 2023-07-29T01:56:43.172 INFO:teuthology.orchestra.run.smithi042.stdout:(29/131): ceph-mgr-dashboard-18.1.3-11.g0484097 2.6 MB/s | 1.7 MB 00:00 2023-07-29T01:56:43.339 INFO:teuthology.orchestra.run.smithi042.stdout:(30/131): rbd-mirror-18.1.3-11.g0484097b.el8.x8 2.2 MB/s | 3.4 MB 00:01 2023-07-29T01:56:43.498 INFO:teuthology.orchestra.run.smithi042.stdout:(31/131): ceph-mgr-modules-core-18.1.3-11.g0484 1.5 MB/s | 240 kB 00:00 2023-07-29T01:56:43.640 INFO:teuthology.orchestra.run.smithi042.stdout:(32/131): ceph-mgr-rook-18.1.3-11.g0484097b.el8 334 kB/s | 47 kB 00:00 2023-07-29T01:56:43.782 INFO:teuthology.orchestra.run.smithi042.stdout:(33/131): ceph-prometheus-alerts-18.1.3-11.g048 103 kB/s | 15 kB 00:00 2023-07-29T01:56:43.949 INFO:teuthology.orchestra.run.smithi042.stdout:(34/131): ceph-volume-18.1.3-11.g0484097b.el8.n 1.5 MB/s | 258 kB 00:00 2023-07-29T01:56:44.116 INFO:teuthology.orchestra.run.smithi042.stdout:(35/131): cephadm-18.1.3-11.g0484097b.el8.noarc 959 kB/s | 160 kB 00:00 2023-07-29T01:56:44.283 INFO:teuthology.orchestra.run.smithi042.stdout:(36/131): cephfs-top-18.1.3-11.g0484097b.el8.no 108 kB/s | 18 kB 00:00 2023-07-29T01:56:44.866 INFO:teuthology.orchestra.run.smithi042.stdout:(37/131): ceph-mgr-diskprediction-local-18.1.3- 4.4 MB/s | 7.4 MB 00:01 2023-07-29T01:56:45.333 INFO:teuthology.orchestra.run.smithi042.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 292 kB/s | 306 kB 00:01 2023-07-29T01:56:45.559 INFO:teuthology.orchestra.run.smithi042.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 334 kB/s | 75 kB 00:00 2023-07-29T01:56:46.449 INFO:teuthology.orchestra.run.smithi144.stdout:(8/131): ceph-common-18.1.3-11.g0484097b.el8.x8 1.2 MB/s | 22 MB 00:17 2023-07-29T01:56:46.582 INFO:teuthology.orchestra.run.smithi144.stdout:(9/131): ceph-selinux-18.1.3-11.g0484097b.el8.x 182 kB/s | 24 kB 00:00 2023-07-29T01:56:46.637 INFO:teuthology.orchestra.run.smithi042.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 33 kB/s | 59 kB 00:01 2023-07-29T01:56:46.967 INFO:teuthology.orchestra.run.smithi042.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 132 kB/s | 44 kB 00:00 2023-07-29T01:56:47.001 INFO:teuthology.orchestra.run.smithi042.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 330 kB/s | 476 kB 00:01 2023-07-29T01:56:47.535 INFO:teuthology.orchestra.run.smithi042.stdout:(43/131): ceph-test-18.1.3-11.g0484097b.el8.x86 5.7 MB/s | 47 MB 00:08 2023-07-29T01:56:47.560 INFO:teuthology.orchestra.run.smithi042.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 59 kB/s | 33 kB 00:00 2023-07-29T01:56:47.874 INFO:teuthology.orchestra.run.smithi144.stdout:(10/131): ceph-radosgw-18.1.3-11.g0484097b.el8. 2.2 MB/s | 13 MB 00:06 2023-07-29T01:56:47.918 INFO:teuthology.orchestra.run.smithi042.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 42 kB/s | 16 kB 00:00 2023-07-29T01:56:48.144 INFO:teuthology.orchestra.run.smithi042.stdout:(46/131): python3-beautifulsoup4-4.6.3-2.el8.1. 157 kB/s | 185 kB 00:01 2023-07-29T01:56:48.216 INFO:teuthology.orchestra.run.smithi144.stdout:(11/131): ceph-osd-18.1.3-11.g0484097b.el8.x86_ 2.0 MB/s | 18 MB 00:08 2023-07-29T01:56:48.241 INFO:teuthology.orchestra.run.smithi144.stdout:(12/131): cephfs-mirror-18.1.3-11.g0484097b.el8 702 kB/s | 257 kB 00:00 2023-07-29T01:56:48.319 INFO:teuthology.orchestra.run.smithi042.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 227 kB/s | 173 kB 00:00 2023-07-29T01:56:48.333 INFO:teuthology.orchestra.run.smithi144.stdout:(13/131): libcephfs-devel-18.1.3-11.g0484097b.e 261 kB/s | 30 kB 00:00 2023-07-29T01:56:48.467 INFO:teuthology.orchestra.run.smithi144.stdout:(14/131): libcephsqlite-18.1.3-11.g0484097b.el8 1.0 MB/s | 137 kB 00:00 2023-07-29T01:56:48.469 INFO:teuthology.orchestra.run.smithi042.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 74 kB/s | 11 kB 00:00 2023-07-29T01:56:48.512 INFO:teuthology.orchestra.run.smithi042.stdout:(49/131): python3-google-auth-1.1.1-10.el8.noar 221 kB/s | 81 kB 00:00 2023-07-29T01:56:48.634 INFO:teuthology.orchestra.run.smithi144.stdout:(15/131): librados-devel-18.1.3-11.g0484097b.el 834 kB/s | 139 kB 00:00 2023-07-29T01:56:48.636 INFO:teuthology.orchestra.run.smithi042.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 105 kB/s | 18 kB 00:00 2023-07-29T01:56:48.759 INFO:teuthology.orchestra.run.smithi144.stdout:(16/131): libcephfs2-18.1.3-11.g0484097b.el8.x8 1.5 MB/s | 769 kB 00:00 2023-07-29T01:56:48.920 INFO:teuthology.orchestra.run.smithi042.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 172 kB/s | 49 kB 00:00 2023-07-29T01:56:49.018 INFO:teuthology.orchestra.run.smithi144.stdout:(17/131): libradosstriper1-18.1.3-11.g0484097b. 1.2 MB/s | 474 kB 00:00 2023-07-29T01:56:49.037 INFO:teuthology.orchestra.run.smithi042.stdout:(52/131): python3-cherrypy-18.4.0-1.el8.noarch. 344 kB/s | 384 kB 00:01 2023-07-29T01:56:49.168 INFO:teuthology.orchestra.run.smithi144.stdout:(18/131): python3-ceph-argparse-18.1.3-11.g0484 298 kB/s | 45 kB 00:00 2023-07-29T01:56:49.221 INFO:teuthology.orchestra.run.smithi042.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 195 kB/s | 59 kB 00:00 2023-07-29T01:56:49.326 INFO:teuthology.orchestra.run.smithi144.stdout:(19/131): python3-ceph-common-18.1.3-11.g048409 750 kB/s | 119 kB 00:00 2023-07-29T01:56:49.330 INFO:teuthology.orchestra.run.smithi042.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 206 kB/s | 60 kB 00:00 2023-07-29T01:56:49.477 INFO:teuthology.orchestra.run.smithi144.stdout:(20/131): python3-cephfs-18.1.3-11.g0484097b.el 1.2 MB/s | 190 kB 00:00 2023-07-29T01:56:49.488 INFO:teuthology.orchestra.run.smithi042.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 98 kB/s | 16 kB 00:00 2023-07-29T01:56:49.655 INFO:teuthology.orchestra.run.smithi042.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 202 kB/s | 34 kB 00:00 2023-07-29T01:56:49.760 INFO:teuthology.orchestra.run.smithi144.stdout:(21/131): python3-rados-18.1.3-11.g0484097b.el8 1.3 MB/s | 371 kB 00:00 2023-07-29T01:56:50.052 INFO:teuthology.orchestra.run.smithi144.stdout:(22/131): python3-rbd-18.1.3-11.g0484097b.el8.x 1.2 MB/s | 364 kB 00:00 2023-07-29T01:56:50.227 INFO:teuthology.orchestra.run.smithi144.stdout:(23/131): python3-rgw-18.1.3-11.g0484097b.el8.x 610 kB/s | 107 kB 00:00 2023-07-29T01:56:50.264 INFO:teuthology.orchestra.run.smithi042.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 271 kB/s | 283 kB 00:01 2023-07-29T01:56:50.289 INFO:teuthology.orchestra.run.smithi042.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 310 kB/s | 196 kB 00:00 2023-07-29T01:56:50.361 INFO:teuthology.orchestra.run.smithi144.stdout:(24/131): rbd-fuse-18.1.3-11.g0484097b.el8.x86_ 708 kB/s | 94 kB 00:00 2023-07-29T01:56:50.423 INFO:teuthology.orchestra.run.smithi042.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 140 kB/s | 19 kB 00:00 2023-07-29T01:56:50.523 INFO:teuthology.orchestra.run.smithi042.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 248 kB/s | 64 kB 00:00 2023-07-29T01:56:50.590 INFO:teuthology.orchestra.run.smithi042.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 143 kB/s | 24 kB 00:00 2023-07-29T01:56:50.682 INFO:teuthology.orchestra.run.smithi042.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 184 kB/s | 29 kB 00:00 2023-07-29T01:56:50.766 INFO:teuthology.orchestra.run.smithi042.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 157 kB/s | 27 kB 00:00 2023-07-29T01:56:51.441 INFO:teuthology.orchestra.run.smithi042.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 337 kB/s | 255 kB 00:00 2023-07-29T01:56:51.524 INFO:teuthology.orchestra.run.smithi042.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 331 kB/s | 251 kB 00:00 2023-07-29T01:56:51.633 INFO:teuthology.orchestra.run.smithi042.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 319 kB/s | 61 kB 00:00 2023-07-29T01:56:51.717 INFO:teuthology.orchestra.run.smithi042.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 444 kB/s | 85 kB 00:00 2023-07-29T01:56:51.784 INFO:teuthology.orchestra.run.smithi042.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 152 kB/s | 23 kB 00:00 2023-07-29T01:56:51.809 INFO:teuthology.orchestra.run.smithi042.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-07-29T01:56:52.151 INFO:teuthology.orchestra.run.smithi042.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 40 MB/s | 14 MB 00:00 2023-07-29T01:56:52.193 INFO:teuthology.orchestra.run.smithi042.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-07-29T01:56:52.218 INFO:teuthology.orchestra.run.smithi042.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2023-07-29T01:56:52.286 INFO:teuthology.orchestra.run.smithi042.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.8 MB/s | 259 kB 00:00 2023-07-29T01:56:52.328 INFO:teuthology.orchestra.run.smithi144.stdout:(25/131): librgw2-18.1.3-11.g0484097b.el8.x86_6 1.8 MB/s | 6.5 MB 00:03 2023-07-29T01:56:52.335 INFO:teuthology.orchestra.run.smithi042.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.4 MB/s | 323 kB 00:00 2023-07-29T01:56:52.361 INFO:teuthology.orchestra.run.smithi042.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 1.5 MB/s | 39 kB 00:00 2023-07-29T01:56:52.395 INFO:teuthology.orchestra.run.smithi144.stdout:(26/131): rbd-mirror-18.1.3-11.g0484097b.el8.x8 1.7 MB/s | 3.4 MB 00:02 2023-07-29T01:56:52.419 INFO:teuthology.orchestra.run.smithi042.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-07-29T01:56:52.470 INFO:teuthology.orchestra.run.smithi042.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 10 MB/s | 538 kB 00:00 2023-07-29T01:56:52.503 INFO:teuthology.orchestra.run.smithi144.stdout:(27/131): ceph-grafana-dashboards-18.1.3-11.g04 213 kB/s | 23 kB 00:00 2023-07-29T01:56:52.512 INFO:teuthology.orchestra.run.smithi042.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-07-29T01:56:52.529 INFO:teuthology.orchestra.run.smithi144.stdout:(28/131): rbd-nbd-18.1.3-11.g0484097b.el8.x86_6 893 kB/s | 179 kB 00:00 2023-07-29T01:56:52.554 INFO:teuthology.orchestra.run.smithi042.stdout:(79/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-07-29T01:56:52.621 INFO:teuthology.orchestra.run.smithi042.stdout:(80/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-07-29T01:56:52.637 INFO:teuthology.orchestra.run.smithi144.stdout:(29/131): ceph-mgr-cephadm-18.1.3-11.g0484097b. 953 kB/s | 127 kB 00:00 2023-07-29T01:56:52.755 INFO:teuthology.orchestra.run.smithi042.stdout:(81/131): python3-babel-2.5.1-7.el8.noarch.rpm 36 MB/s | 4.8 MB 00:00 2023-07-29T01:56:52.814 INFO:teuthology.orchestra.run.smithi042.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 455 kB/s | 27 kB 00:00 2023-07-29T01:56:52.864 INFO:teuthology.orchestra.run.smithi042.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-07-29T01:56:53.156 INFO:teuthology.orchestra.run.smithi042.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 151 kB/s | 44 kB 00:00 2023-07-29T01:56:53.273 INFO:teuthology.orchestra.run.smithi042.stdout:(85/131): python3-numpy-1.14.3-10.el8.x86_64.rp 32 MB/s | 3.7 MB 00:00 2023-07-29T01:56:53.332 INFO:teuthology.orchestra.run.smithi042.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 7.7 MB/s | 457 kB 00:00 2023-07-29T01:56:53.373 INFO:teuthology.orchestra.run.smithi042.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-07-29T01:56:53.424 INFO:teuthology.orchestra.run.smithi042.stdout:(88/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-07-29T01:56:53.466 INFO:teuthology.orchestra.run.smithi042.stdout:(89/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.0 MB/s | 126 kB 00:00 2023-07-29T01:56:53.508 INFO:teuthology.orchestra.run.smithi042.stdout:(90/131): python3-jsonpointer-1.10-11.el8.noarc 479 kB/s | 20 kB 00:00 2023-07-29T01:56:53.541 INFO:teuthology.orchestra.run.smithi042.stdout:(91/131): python3-kubernetes-11.0.0-6.el8.noarc 237 kB/s | 1.2 MB 00:05 2023-07-29T01:56:53.567 INFO:teuthology.orchestra.run.smithi042.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.7 MB/s | 103 kB 00:00 2023-07-29T01:56:53.642 INFO:teuthology.orchestra.run.smithi042.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 6.9 MB/s | 709 kB 00:00 2023-07-29T01:56:53.692 INFO:teuthology.orchestra.run.smithi042.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2023-07-29T01:56:53.721 INFO:teuthology.orchestra.run.smithi144.stdout:(30/131): ceph-mgr-dashboard-18.1.3-11.g0484097 1.4 MB/s | 1.7 MB 00:01 2023-07-29T01:56:53.776 INFO:teuthology.orchestra.run.smithi042.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 24 MB/s | 4.9 MB 00:00 2023-07-29T01:56:53.843 INFO:teuthology.orchestra.run.smithi042.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 3.0 MB/s | 202 kB 00:00 2023-07-29T01:56:53.885 INFO:teuthology.orchestra.run.smithi042.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-07-29T01:56:53.968 INFO:teuthology.orchestra.run.smithi042.stdout:(98/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-07-29T01:56:53.988 INFO:teuthology.orchestra.run.smithi144.stdout:(31/131): ceph-mgr-modules-core-18.1.3-11.g0484 902 kB/s | 240 kB 00:00 2023-07-29T01:56:54.044 INFO:teuthology.orchestra.run.smithi042.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 11 MB/s | 808 kB 00:00 2023-07-29T01:56:54.128 INFO:teuthology.orchestra.run.smithi042.stdout:(100/131): postgresql-server-10.21-2.module+el8 21 MB/s | 5.1 MB 00:00 2023-07-29T01:56:54.138 INFO:teuthology.orchestra.run.smithi144.stdout:(32/131): ceph-mgr-rook-18.1.3-11.g0484097b.el8 316 kB/s | 47 kB 00:00 2023-07-29T01:56:54.186 INFO:teuthology.orchestra.run.smithi042.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-07-29T01:56:54.203 INFO:teuthology.orchestra.run.smithi042.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 624 kB/s | 47 kB 00:00 2023-07-29T01:56:54.254 INFO:teuthology.orchestra.run.smithi042.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-07-29T01:56:54.271 INFO:teuthology.orchestra.run.smithi042.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 634 kB/s | 43 kB 00:00 2023-07-29T01:56:54.272 INFO:teuthology.orchestra.run.smithi144.stdout:(33/131): ceph-prometheus-alerts-18.1.3-11.g048 109 kB/s | 15 kB 00:00 2023-07-29T01:56:54.304 INFO:teuthology.orchestra.run.smithi042.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-07-29T01:56:54.363 INFO:teuthology.orchestra.run.smithi042.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 522 kB/s | 48 kB 00:00 2023-07-29T01:56:54.388 INFO:teuthology.orchestra.run.smithi042.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2023-07-29T01:56:54.422 INFO:teuthology.orchestra.run.smithi042.stdout:(108/131): thrift-0.13.0-2.el8.x86_64.rpm 657 kB/s | 1.7 MB 00:02 2023-07-29T01:56:54.447 INFO:teuthology.orchestra.run.smithi042.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 509 kB/s | 43 kB 00:00 2023-07-29T01:56:54.481 INFO:teuthology.orchestra.run.smithi042.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 1.2 MB/s | 109 kB 00:00 2023-07-29T01:56:54.530 INFO:teuthology.orchestra.run.smithi144.stdout:(34/131): ceph-volume-18.1.3-11.g0484097b.el8.n 1.0 MB/s | 258 kB 00:00 2023-07-29T01:56:54.531 INFO:teuthology.orchestra.run.smithi042.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 7.3 MB/s | 560 kB 00:00 2023-07-29T01:56:54.556 INFO:teuthology.orchestra.run.smithi042.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 248 kB/s | 19 kB 00:00 2023-07-29T01:56:54.582 INFO:teuthology.orchestra.run.smithi042.stdout:(113/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.4 MB/s | 229 kB 00:00 2023-07-29T01:56:54.607 INFO:teuthology.orchestra.run.smithi042.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 2.0 MB/s | 155 kB 00:00 2023-07-29T01:56:54.632 INFO:teuthology.orchestra.run.smithi042.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 357 kB/s | 18 kB 00:00 2023-07-29T01:56:54.666 INFO:teuthology.orchestra.run.smithi042.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 5.0 MB/s | 559 kB 00:00 2023-07-29T01:56:54.680 INFO:teuthology.orchestra.run.smithi144.stdout:(35/131): cephadm-18.1.3-11.g0484097b.el8.noarc 1.0 MB/s | 160 kB 00:00 2023-07-29T01:56:54.699 INFO:teuthology.orchestra.run.smithi042.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 6.4 MB/s | 605 kB 00:00 2023-07-29T01:56:54.725 INFO:teuthology.orchestra.run.smithi042.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2023-07-29T01:56:54.750 INFO:teuthology.orchestra.run.smithi042.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-07-29T01:56:54.767 INFO:teuthology.orchestra.run.smithi042.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-07-29T01:56:54.831 INFO:teuthology.orchestra.run.smithi144.stdout:(36/131): cephfs-top-18.1.3-11.g0484097b.el8.no 120 kB/s | 18 kB 00:00 2023-07-29T01:56:54.860 INFO:teuthology.orchestra.run.smithi042.stdout:(121/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 12 MB/s | 2.3 MB 00:00 2023-07-29T01:56:54.893 INFO:teuthology.orchestra.run.smithi042.stdout:(122/131): elfutils-libelf-devel-0.186-1.el8.x8 421 kB/s | 60 kB 00:00 2023-07-29T01:56:54.918 INFO:teuthology.orchestra.run.smithi042.stdout:(123/131): libuuid-devel-2.32.1-35.el8.x86_64.r 651 kB/s | 98 kB 00:00 2023-07-29T01:56:54.943 INFO:teuthology.orchestra.run.smithi042.stdout:(124/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 695 kB/s | 58 kB 00:00 2023-07-29T01:56:54.969 INFO:teuthology.orchestra.run.smithi042.stdout:(125/131): libcom_err-devel-1.45.6-4.el8.x86_64 511 kB/s | 39 kB 00:00 2023-07-29T01:56:54.994 INFO:teuthology.orchestra.run.smithi042.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 3.3 MB/s | 171 kB 00:00 2023-07-29T01:56:55.019 INFO:teuthology.orchestra.run.smithi042.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-07-29T01:56:55.053 INFO:teuthology.orchestra.run.smithi042.stdout:(128/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 4.7 MB/s | 644 kB 00:00 2023-07-29T01:56:55.111 INFO:teuthology.orchestra.run.smithi042.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-07-29T01:56:56.122 INFO:teuthology.orchestra.run.smithi144.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 237 kB/s | 306 kB 00:01 2023-07-29T01:56:56.290 INFO:teuthology.orchestra.run.smithi144.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 353 kB/s | 59 kB 00:00 2023-07-29T01:56:56.328 INFO:teuthology.orchestra.run.smithi042.stdout:(130/131): librados2-18.1.3-11.g0484097b.el8.x8 2.7 MB/s | 3.7 MB 00:01 2023-07-29T01:56:56.490 INFO:teuthology.orchestra.run.smithi144.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 376 kB/s | 75 kB 00:00 2023-07-29T01:56:56.664 INFO:teuthology.orchestra.run.smithi042.stdout:(131/131): librbd1-18.1.3-11.g0484097b.el8.x86_ 2.2 MB/s | 3.6 MB 00:01 2023-07-29T01:56:56.669 INFO:teuthology.orchestra.run.smithi042.stdout:-------------------------------------------------------------------------------- 2023-07-29T01:56:56.669 INFO:teuthology.orchestra.run.smithi042.stdout:Total 8.4 MB/s | 203 MB 00:24 2023-07-29T01:56:56.707 INFO:teuthology.orchestra.run.smithi144.stdout:(40/131): ceph-mgr-diskprediction-local-18.1.3- 1.8 MB/s | 7.4 MB 00:04 2023-07-29T01:56:57.098 INFO:teuthology.orchestra.run.smithi144.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 111 kB/s | 44 kB 00:00 2023-07-29T01:56:57.490 INFO:teuthology.orchestra.run.smithi144.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 473 kB/s | 185 kB 00:00 2023-07-29T01:56:57.507 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check 2023-07-29T01:56:57.516 INFO:teuthology.orchestra.run.smithi144.stdout:(43/131): python3-asyncssh-2.7.0-2.el8.noarch.r 464 kB/s | 476 kB 00:01 2023-07-29T01:56:57.599 INFO:teuthology.orchestra.run.smithi144.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 303 kB/s | 33 kB 00:00 2023-07-29T01:56:57.633 INFO:teuthology.orchestra.run.smithi144.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 139 kB/s | 16 kB 00:00 2023-07-29T01:56:57.639 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded. 2023-07-29T01:56:57.639 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction test 2023-07-29T01:56:58.017 INFO:teuthology.orchestra.run.smithi144.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 414 kB/s | 173 kB 00:00 2023-07-29T01:56:58.267 INFO:teuthology.orchestra.run.smithi144.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 325 kB/s | 81 kB 00:00 2023-07-29T01:56:58.376 INFO:teuthology.orchestra.run.smithi144.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2023-07-29T01:56:58.484 INFO:teuthology.orchestra.run.smithi144.stdout:(49/131): python3-cherrypy-18.4.0-1.el8.noarch. 452 kB/s | 384 kB 00:00 2023-07-29T01:56:58.509 INFO:teuthology.orchestra.run.smithi144.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 131 kB/s | 18 kB 00:00 2023-07-29T01:56:58.635 INFO:teuthology.orchestra.run.smithi144.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 390 kB/s | 49 kB 00:00 2023-07-29T01:56:58.870 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction test succeeded. 2023-07-29T01:56:58.875 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction 2023-07-29T01:56:58.902 INFO:teuthology.orchestra.run.smithi144.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 220 kB/s | 59 kB 00:00 2023-07-29T01:56:59.152 INFO:teuthology.orchestra.run.smithi144.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 241 kB/s | 60 kB 00:00 2023-07-29T01:56:59.944 INFO:teuthology.orchestra.run.smithi144.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 357 kB/s | 283 kB 00:00 2023-07-29T01:57:00.070 INFO:teuthology.orchestra.run.smithi144.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 125 kB/s | 16 kB 00:00 2023-07-29T01:57:00.220 INFO:teuthology.orchestra.run.smithi144.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 224 kB/s | 34 kB 00:00 2023-07-29T01:57:00.737 INFO:teuthology.orchestra.run.smithi144.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 380 kB/s | 196 kB 00:00 2023-07-29T01:57:00.787 INFO:teuthology.orchestra.run.smithi144.stdout:(58/131): python3-kubernetes-11.0.0-6.el8.noarc 518 kB/s | 1.2 MB 00:02 2023-07-29T01:57:00.929 INFO:teuthology.orchestra.run.smithi144.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 132 kB/s | 19 kB 00:00 2023-07-29T01:57:00.963 INFO:teuthology.orchestra.run.smithi144.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 285 kB/s | 64 kB 00:00 2023-07-29T01:57:01.063 INFO:teuthology.orchestra.run.smithi144.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 179 kB/s | 24 kB 00:00 2023-07-29T01:57:01.088 INFO:teuthology.orchestra.run.smithi144.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 233 kB/s | 29 kB 00:00 2023-07-29T01:57:01.180 INFO:teuthology.orchestra.run.smithi144.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 235 kB/s | 27 kB 00:00 2023-07-29T01:57:01.764 INFO:teuthology.orchestra.run.smithi144.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 378 kB/s | 255 kB 00:00 2023-07-29T01:57:01.889 INFO:teuthology.orchestra.run.smithi144.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 354 kB/s | 251 kB 00:00 2023-07-29T01:57:02.014 INFO:teuthology.orchestra.run.smithi144.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 244 kB/s | 61 kB 00:00 2023-07-29T01:57:02.156 INFO:teuthology.orchestra.run.smithi144.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 162 kB/s | 23 kB 00:00 2023-07-29T01:57:02.173 INFO:teuthology.orchestra.run.smithi144.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 301 kB/s | 85 kB 00:00 2023-07-29T01:57:02.207 INFO:teuthology.orchestra.run.smithi144.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.0 MB/s | 70 kB 00:00 2023-07-29T01:57:02.265 INFO:teuthology.orchestra.run.smithi144.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 804 kB/s | 47 kB 00:00 2023-07-29T01:57:02.308 INFO:teuthology.orchestra.run.smithi144.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 4.7 MB/s | 200 kB 00:00 2023-07-29T01:57:02.349 INFO:teuthology.orchestra.run.smithi144.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-07-29T01:57:02.391 INFO:teuthology.orchestra.run.smithi144.stdout:(73/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2023-07-29T01:57:02.433 INFO:teuthology.orchestra.run.smithi144.stdout:(74/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.1 MB/s | 48 kB 00:00 2023-07-29T01:57:02.467 INFO:teuthology.orchestra.run.smithi144.stdout:(75/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.6 MB/s | 87 kB 00:00 2023-07-29T01:57:02.501 INFO:teuthology.orchestra.run.smithi144.stdout:(76/131): python3-requests-oauthlib-1.0.0-1.el8 1.3 MB/s | 43 kB 00:00 2023-07-29T01:57:02.552 INFO:teuthology.orchestra.run.smithi144.stdout:(77/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-07-29T01:57:02.601 INFO:teuthology.orchestra.run.smithi144.stdout:(78/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.6 MB/s | 229 kB 00:00 2023-07-29T01:57:02.677 INFO:teuthology.orchestra.run.smithi144.stdout:(79/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 7.3 MB/s | 560 kB 00:00 2023-07-29T01:57:02.710 INFO:teuthology.orchestra.run.smithi144.stdout:(80/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 564 kB/s | 19 kB 00:00 2023-07-29T01:57:02.744 INFO:teuthology.orchestra.run.smithi144.stdout:(81/131): python3-oauthlib-2.1.0-1.el8.noarch.r 4.5 MB/s | 155 kB 00:00 2023-07-29T01:57:02.794 INFO:teuthology.orchestra.run.smithi144.stdout:(82/131): python3-cryptography-3.2.1-5.el8.x86_ 11 MB/s | 559 kB 00:00 2023-07-29T01:57:02.836 INFO:teuthology.orchestra.run.smithi144.stdout:(83/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 429 kB/s | 18 kB 00:00 2023-07-29T01:57:02.886 INFO:teuthology.orchestra.run.smithi144.stdout:(84/131): pcre2-devel-10.32-2.el8.x86_64.rpm 12 MB/s | 605 kB 00:00 2023-07-29T01:57:02.928 INFO:teuthology.orchestra.run.smithi144.stdout:(85/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 5.6 MB/s | 238 kB 00:00 2023-07-29T01:57:03.012 INFO:teuthology.orchestra.run.smithi144.stdout:(86/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 28 MB/s | 2.3 MB 00:00 2023-07-29T01:57:03.054 INFO:teuthology.orchestra.run.smithi144.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.7 MB/s | 72 kB 00:00 2023-07-29T01:57:03.096 INFO:teuthology.orchestra.run.smithi144.stdout:(88/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-07-29T01:57:03.138 INFO:teuthology.orchestra.run.smithi144.stdout:(89/131): elfutils-libelf-devel-0.186-1.el8.x86 1.4 MB/s | 60 kB 00:00 2023-07-29T01:57:03.180 INFO:teuthology.orchestra.run.smithi144.stdout:(90/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 2.3 MB/s | 98 kB 00:00 2023-07-29T01:57:03.222 INFO:teuthology.orchestra.run.smithi144.stdout:(91/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2023-07-29T01:57:03.264 INFO:teuthology.orchestra.run.smithi144.stdout:(92/131): libcom_err-devel-1.45.6-4.el8.x86_64. 929 kB/s | 39 kB 00:00 2023-07-29T01:57:03.339 INFO:teuthology.orchestra.run.smithi144.stdout:(93/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 8.4 MB/s | 644 kB 00:00 2023-07-29T01:57:03.381 INFO:teuthology.orchestra.run.smithi144.stdout:(94/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 4.0 MB/s | 171 kB 00:00 2023-07-29T01:57:03.423 INFO:teuthology.orchestra.run.smithi144.stdout:(95/131): NetworkManager-initscripts-updown-1.3 3.2 MB/s | 138 kB 00:00 2023-07-29T01:57:03.707 INFO:teuthology.orchestra.run.smithi144.stdout:(96/131): python3-scipy-1.0.0-21.module+el8.5.0 48 MB/s | 14 MB 00:00 2023-07-29T01:57:03.749 INFO:teuthology.orchestra.run.smithi144.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-07-29T01:57:03.841 INFO:teuthology.orchestra.run.smithi144.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 592 kB/s | 54 kB 00:00 2023-07-29T01:57:03.874 INFO:teuthology.orchestra.run.smithi042.stdout: Preparing : 1/1 2023-07-29T01:57:03.883 INFO:teuthology.orchestra.run.smithi144.stdout:(99/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-07-29T01:57:03.925 INFO:teuthology.orchestra.run.smithi144.stdout:(100/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-07-29T01:57:03.958 INFO:teuthology.orchestra.run.smithi144.stdout:(101/131): python3-markupsafe-0.23-19.el8.x86_6 1.1 MB/s | 39 kB 00:00 2023-07-29T01:57:04.008 INFO:teuthology.orchestra.run.smithi144.stdout:(102/131): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2023-07-29T01:57:04.038 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-29T01:57:04.059 INFO:teuthology.orchestra.run.smithi144.stdout:(103/131): python3-jinja2-2.10.1-3.el8.noarch.r 11 MB/s | 538 kB 00:00 2023-07-29T01:57:04.117 INFO:teuthology.orchestra.run.smithi144.stdout:(104/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-07-29T01:57:04.159 INFO:teuthology.orchestra.run.smithi144.stdout:(105/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-07-29T01:57:04.210 INFO:teuthology.orchestra.run.smithi144.stdout:(106/131): automake-1.16.1-7.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2023-07-29T01:57:04.335 INFO:teuthology.orchestra.run.smithi144.stdout:(107/131): python3-babel-2.5.1-7.el8.noarch.rpm 38 MB/s | 4.8 MB 00:00 2023-07-29T01:57:04.377 INFO:teuthology.orchestra.run.smithi144.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 639 kB/s | 27 kB 00:00 2023-07-29T01:57:04.419 INFO:teuthology.orchestra.run.smithi144.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-07-29T01:57:04.461 INFO:teuthology.orchestra.run.smithi144.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.0 MB/s | 44 kB 00:00 2023-07-29T01:57:04.469 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-29T01:57:04.562 INFO:teuthology.orchestra.run.smithi144.stdout:(111/131): python3-numpy-1.14.3-10.el8.x86_64.r 37 MB/s | 3.7 MB 00:00 2023-07-29T01:57:04.612 INFO:teuthology.orchestra.run.smithi144.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-07-29T01:57:04.654 INFO:teuthology.orchestra.run.smithi144.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-07-29T01:57:04.695 INFO:teuthology.orchestra.run.smithi144.stdout:(114/131): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-07-29T01:57:04.707 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-07-29T01:57:04.737 INFO:teuthology.orchestra.run.smithi144.stdout:(115/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 3.0 MB/s | 126 kB 00:00 2023-07-29T01:57:04.771 INFO:teuthology.orchestra.run.smithi144.stdout:(116/131): python3-jsonpointer-1.10-11.el8.noar 600 kB/s | 20 kB 00:00 2023-07-29T01:57:04.805 INFO:teuthology.orchestra.run.smithi144.stdout:(117/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 3.0 MB/s | 103 kB 00:00 2023-07-29T01:57:04.848 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-29T01:57:04.879 INFO:teuthology.orchestra.run.smithi144.stdout:(118/131): libtool-2.4.6-25.el8.x86_64.rpm 9.4 MB/s | 709 kB 00:00 2023-07-29T01:57:04.977 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-29T01:57:05.006 INFO:teuthology.orchestra.run.smithi144.stdout:(119/131): openblas-threads-0.3.15-3.el8.x86_64 38 MB/s | 4.9 MB 00:00 2023-07-29T01:57:05.048 INFO:teuthology.orchestra.run.smithi144.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-07-29T01:57:05.173 INFO:teuthology.orchestra.run.smithi144.stdout:(121/131): openblas-0.3.15-3.el8.x86_64.rpm 38 MB/s | 4.7 MB 00:00 2023-07-29T01:57:05.189 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-29T01:57:05.215 INFO:teuthology.orchestra.run.smithi144.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-07-29T01:57:05.257 INFO:teuthology.orchestra.run.smithi144.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-07-29T01:57:05.374 INFO:teuthology.orchestra.run.smithi144.stdout:(124/131): postgresql-server-10.21-2.module+el8 43 MB/s | 5.1 MB 00:00 2023-07-29T01:57:05.424 INFO:teuthology.orchestra.run.smithi144.stdout:(125/131): postgresql-contrib-10.21-2.module+el 16 MB/s | 808 kB 00:00 2023-07-29T01:57:05.483 INFO:teuthology.orchestra.run.smithi144.stdout:(126/131): postgresql-10.21-2.module+el8.6.0+15 26 MB/s | 1.5 MB 00:00 2023-07-29T01:57:05.619 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-29T01:57:05.833 INFO:teuthology.orchestra.run.smithi144.stdout:(127/131): thrift-0.13.0-2.el8.x86_64.rpm 483 kB/s | 1.7 MB 00:03 2023-07-29T01:57:05.864 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librados2-2:18.1.3-11.g0484097b.el8.x86_64 6/134 2023-07-29T01:57:06.296 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-2:18.1.3-11.g0484097b.el8.x86_64 6/134 2023-07-29T01:57:06.464 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : librbd1-2:18.1.3-11.g0484097b.el8.x86_64 7/134 2023-07-29T01:57:06.577 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-2:18.1.3-11.g0484097b.el8.x86_64 7/134 2023-07-29T01:57:06.798 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 8/134 2023-07-29T01:57:06.882 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 8/134 2023-07-29T01:57:07.058 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 9/134 2023-07-29T01:57:07.339 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-29T01:57:07.526 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-29T01:57:07.683 INFO:teuthology.orchestra.run.smithi144.stdout:(128/131): librados2-18.1.3-11.g0484097b.el8.x8 1.7 MB/s | 3.7 MB 00:02 2023-07-29T01:57:07.741 INFO:teuthology.orchestra.run.smithi144.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-07-29T01:57:07.938 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-29T01:57:08.033 INFO:teuthology.orchestra.run.smithi144.stdout:(130/131): librbd1-18.1.3-11.g0484097b.el8.x86_ 1.6 MB/s | 3.6 MB 00:02 2023-07-29T01:57:08.168 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-29T01:57:08.364 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 14/134 2023-07-29T01:57:08.456 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 14/134 2023-07-29T01:57:08.614 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 15/134 2023-07-29T01:57:08.688 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 15/134 2023-07-29T01:57:08.839 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-29T01:57:08.993 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-29T01:57:09.131 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-29T01:57:09.790 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-29T01:57:09.947 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-29T01:57:10.580 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-29T01:57:10.747 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-07-29T01:57:11.533 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-07-29T01:57:11.774 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-07-29T01:57:12.039 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-07-29T01:57:12.252 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-07-29T01:57:12.446 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-07-29T01:57:12.642 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-07-29T01:57:12.827 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-29T01:57:13.029 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-common-2:18.1.3-11.g0484097b.el8.x8 26/134 2023-07-29T01:57:13.159 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-ceph-argparse-2:18.1.3-11.g0484097b.el8. 27/134 2023-07-29T01:57:13.725 INFO:teuthology.orchestra.run.smithi144.stdout:(131/131): ceph-test-18.1.3-11.g0484097b.el8.x8 1.7 MB/s | 47 MB 00:27 2023-07-29T01:57:13.728 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2023-07-29T01:57:13.728 INFO:teuthology.orchestra.run.smithi144.stdout:Total 4.5 MB/s | 203 MB 00:45 2023-07-29T01:57:14.106 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 28/134 2023-07-29T01:57:14.486 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-07-29T01:57:14.570 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2023-07-29T01:57:14.689 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2023-07-29T01:57:14.689 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2023-07-29T01:57:14.737 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-07-29T01:57:14.977 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-07-29T01:57:15.171 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-29T01:57:15.782 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2023-07-29T01:57:15.786 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2023-07-29T01:57:17.049 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-29T01:57:17.358 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-07-29T01:57:17.588 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-07-29T01:57:17.776 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-29T01:57:17.927 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 36/134 2023-07-29T01:57:18.109 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 37/134 2023-07-29T01:57:18.266 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-07-29T01:57:18.457 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-07-29T01:57:18.666 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-07-29T01:57:18.785 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-07-29T01:57:18.974 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-07-29T01:57:19.207 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-07-29T01:57:19.549 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-07-29T01:57:19.809 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-07-29T01:57:19.999 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-07-29T01:57:20.256 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-07-29T01:57:20.477 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-07-29T01:57:20.679 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2023-07-29T01:57:20.807 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-07-29T01:57:20.864 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-29T01:57:21.037 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-07-29T01:57:21.106 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-29T01:57:21.246 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-07-29T01:57:21.283 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-29T01:57:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-29T01:57:21.455 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-07-29T01:57:21.606 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-07-29T01:57:21.619 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-29T01:57:21.784 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-07-29T01:57:22.004 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-29T01:57:22.111 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-07-29T01:57:22.233 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librados2-2:18.1.3-11.g0484097b.el8.x86_64 5/134 2023-07-29T01:57:22.387 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-07-29T01:57:22.629 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-07-29T01:57:22.633 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:18.1.3-11.g0484097b.el8.x86_64 5/134 2023-07-29T01:57:22.833 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librbd1-2:18.1.3-11.g0484097b.el8.x86_64 6/134 2023-07-29T01:57:22.869 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-07-29T01:57:22.957 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:18.1.3-11.g0484097b.el8.x86_64 6/134 2023-07-29T01:57:23.028 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-07-29T01:57:23.175 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 7/134 2023-07-29T01:57:23.189 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-07-29T01:57:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 7/134 2023-07-29T01:57:23.362 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-07-29T01:57:23.438 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-07-29T01:57:23.471 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 8/134 2023-07-29T01:57:23.658 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-07-29T01:57:23.662 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-07-29T01:57:23.859 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-07-29T01:57:23.894 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-29T01:57:24.004 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-29T01:57:24.084 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-29T01:57:24.144 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-29T01:57:24.337 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-07-29T01:57:24.497 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-07-29T01:57:24.580 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-29T01:57:24.646 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-29T01:57:24.845 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-29T01:57:24.969 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-29T01:57:25.109 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-29T01:57:25.158 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 14/134 2023-07-29T01:57:25.261 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 14/134 2023-07-29T01:57:25.320 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-29T01:57:25.433 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 15/134 2023-07-29T01:57:25.459 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-29T01:57:25.562 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 15/134 2023-07-29T01:57:25.583 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-29T01:57:25.769 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-07-29T01:57:25.801 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-29T01:57:25.938 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-07-29T01:57:25.969 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-29T01:57:26.127 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-07-29T01:57:26.134 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-29T01:57:26.257 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-29T01:57:26.323 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-29T01:57:26.396 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-29T01:57:26.460 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-29T01:57:26.549 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-29T01:57:26.655 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-29T01:57:26.875 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-29T01:57:27.043 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-29T01:57:27.151 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-29T01:57:27.300 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-29T01:57:27.341 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-29T01:57:27.512 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-29T01:57:27.671 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-29T01:57:27.902 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-29T01:57:27.935 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-29T01:57:28.132 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-07-29T01:57:28.824 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-07-29T01:57:29.019 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-29T01:57:29.105 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-07-29T01:57:29.268 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-29T01:57:29.313 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-07-29T01:57:29.513 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-29T01:57:29.578 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-29T01:57:29.747 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-common-2:18.1.3-11.g0484097b.el8.x8 26/134 2023-07-29T01:57:29.788 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-29T01:57:29.906 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-argparse-2:18.1.3-11.g0484097b.el8. 27/134 2023-07-29T01:57:30.073 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-29T01:57:30.163 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 28/134 2023-07-29T01:57:30.231 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-29T01:57:30.382 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-29T01:57:31.105 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-29T01:57:31.244 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : librgw2-2:18.1.3-11.g0484097b.el8.x86_64 92/134 2023-07-29T01:57:31.320 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librgw2-2:18.1.3-11.g0484097b.el8.x86_64 92/134 2023-07-29T01:57:31.512 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 93/134 2023-07-29T01:57:32.140 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-29T01:57:33.168 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-07-29T01:57:33.528 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-07-29T01:57:33.808 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-07-29T01:57:34.039 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-07-29T01:57:34.251 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-07-29T01:57:34.458 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-29T01:57:34.644 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 36/134 2023-07-29T01:57:34.813 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 37/134 2023-07-29T01:57:34.971 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-07-29T01:57:35.115 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-07-29T01:57:35.305 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-07-29T01:57:35.356 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 94/134 2023-07-29T01:57:35.371 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-07-29T01:57:35.608 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-07-29T01:57:35.834 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-07-29T01:57:35.997 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-29T01:57:36.058 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-29T01:57:36.285 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-07-29T01:57:36.369 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 94/134 2023-07-29T01:57:36.492 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-07-29T01:57:36.676 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-07-29T01:57:36.832 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-07-29T01:57:37.004 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 94/134 2023-07-29T01:57:37.016 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-07-29T01:57:37.217 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-07-29T01:57:37.298 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 95/134 2023-07-29T01:57:37.382 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 95/134 2023-07-29T01:57:37.412 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-07-29T01:57:37.527 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 96/134 2023-07-29T01:57:37.620 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-07-29T01:57:37.985 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-07-29T01:57:38.256 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-07-29T01:57:38.474 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-07-29T01:57:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-07-29T01:57:38.985 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-07-29T01:57:39.286 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-07-29T01:57:39.554 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-07-29T01:57:39.767 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-07-29T01:57:39.979 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-07-29T01:57:40.154 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-07-29T01:57:40.350 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-07-29T01:57:40.677 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-07-29T01:57:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-07-29T01:57:41.201 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-07-29T01:57:41.439 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-07-29T01:57:41.612 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-29T01:57:41.815 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-29T01:57:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-29T01:57:42.294 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-29T01:57:42.442 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-29T01:57:42.631 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-29T01:57:42.836 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-29T01:57:43.039 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-29T01:57:43.230 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-29T01:57:43.423 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-29T01:57:43.593 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-29T01:57:43.820 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-29T01:57:44.082 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-29T01:57:44.268 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-29T01:57:44.533 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-29T01:57:44.846 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-29T01:57:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-29T01:57:45.289 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-29T01:57:46.367 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-29T01:57:46.615 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-29T01:57:46.845 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-29T01:57:47.131 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-29T01:57:47.422 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-29T01:57:47.620 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-29T01:57:48.437 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-29T01:57:48.611 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librgw2-2:18.1.3-11.g0484097b.el8.x86_64 92/134 2023-07-29T01:57:48.717 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librgw2-2:18.1.3-11.g0484097b.el8.x86_64 92/134 2023-07-29T01:57:48.904 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 93/134 2023-07-29T01:57:52.552 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 94/134 2023-07-29T01:57:52.778 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 94/134 2023-07-29T01:57:53.380 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 94/134 2023-07-29T01:57:53.685 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 95/134 2023-07-29T01:57:53.767 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 95/134 2023-07-29T01:57:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 96/134 2023-07-29T01:57:57.158 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 96/134 2023-07-29T01:57:57.159 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /sys 2023-07-29T01:57:57.159 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /proc 2023-07-29T01:57:57.159 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /dev 2023-07-29T01:57:57.159 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /run 2023-07-29T01:57:57.159 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /mnt 2023-07-29T01:57:57.160 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /var/tmp 2023-07-29T01:57:57.160 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /home 2023-07-29T01:57:57.160 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /tmp 2023-07-29T01:57:57.160 INFO:teuthology.orchestra.run.smithi042.stdout:skipping the directory /dev 2023-07-29T01:57:57.160 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:57:57.482 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 97/134 2023-07-29T01:57:59.161 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 97/134 2023-07-29T01:57:59.304 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 98/134 2023-07-29T01:57:59.534 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 98/134 2023-07-29T01:57:59.699 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 99/134 2023-07-29T01:58:00.188 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 99/134 2023-07-29T01:58:00.374 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 100/134 2023-07-29T01:58:00.392 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 100/134 2023-07-29T01:58:02.154 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephadm-2:18.1.3-11.g0484097b.el8.noarch 101/134 2023-07-29T01:58:02.306 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephadm-2:18.1.3-11.g0484097b.el8.noarch 101/134 2023-07-29T01:58:02.430 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8 102/134 2023-07-29T01:58:02.607 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el 103/134 2023-07-29T01:58:02.807 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 104/134 2023-07-29T01:58:03.029 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 104/134 2023-07-29T01:58:03.354 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 105/134 2023-07-29T01:58:04.379 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 105/134 2023-07-29T01:58:04.532 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 106/134 2023-07-29T01:58:04.629 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 106/134 2023-07-29T01:58:05.015 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8. 107/134 2023-07-29T01:58:05.178 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 108/134 2023-07-29T01:58:05.215 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 108/134 2023-07-29T01:58:05.390 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 109/134 2023-07-29T01:58:05.401 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 109/134 2023-07-29T01:58:06.720 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-2:18.1.3-11.g0484097b.el8.x86_64 110/134 2023-07-29T01:58:06.980 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 111/134 2023-07-29T01:58:07.015 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 111/134 2023-07-29T01:58:07.140 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-immutable-object-cache-2:18.1.3-11.g0484097 112/134 2023-07-29T01:58:07.184 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.1.3-11.g0484097 112/134 2023-07-29T01:58:07.315 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-mirror-2:18.1.3-11.g0484097b.el8.x86_64 113/134 2023-07-29T01:58:07.682 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: cephfs-mirror-2:18.1.3-11.g0484097b.el8.x86_64 113/134 2023-07-29T01:58:07.823 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 114/134 2023-07-29T01:58:12.550 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 114/134 2023-07-29T01:58:12.698 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 96/134 2023-07-29T01:58:12.698 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /sys 2023-07-29T01:58:12.699 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /proc 2023-07-29T01:58:12.699 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /dev 2023-07-29T01:58:12.699 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /run 2023-07-29T01:58:12.699 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /mnt 2023-07-29T01:58:12.699 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /var/tmp 2023-07-29T01:58:12.699 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /home 2023-07-29T01:58:12.699 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /tmp 2023-07-29T01:58:12.699 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /dev 2023-07-29T01:58:12.700 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:58:12.846 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 115/134 2023-07-29T01:58:12.989 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-07-29T01:58:13.049 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 97/134 2023-07-29T01:58:13.196 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-07-29T01:58:14.137 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-07-29T01:58:14.442 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-07-29T01:58:14.636 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 97/134 2023-07-29T01:58:14.641 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 119/134 2023-07-29T01:58:14.798 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 98/134 2023-07-29T01:58:14.818 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-29T01:58:14.993 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 121/134 2023-07-29T01:58:15.015 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 98/134 2023-07-29T01:58:15.156 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-29T01:58:15.157 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 99/134 2023-07-29T01:58:15.623 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 99/134 2023-07-29T01:58:15.865 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 100/134 2023-07-29T01:58:15.883 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 100/134 2023-07-29T01:58:17.492 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-29T01:58:17.522 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephadm-2:18.1.3-11.g0484097b.el8.noarch 101/134 2023-07-29T01:58:17.692 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephadm-2:18.1.3-11.g0484097b.el8.noarch 101/134 2023-07-29T01:58:17.746 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-29T01:58:17.765 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-29T01:58:17.812 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8 102/134 2023-07-29T01:58:17.905 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : cephfs-top-2:18.1.3-11.g0484097b.el8.noarch 124/134 2023-07-29T01:58:18.046 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el 103/134 2023-07-29T01:58:18.205 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 125/134 2023-07-29T01:58:18.224 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 104/134 2023-07-29T01:58:18.437 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 104/134 2023-07-29T01:58:18.494 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 126/134 2023-07-29T01:58:18.739 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 105/134 2023-07-29T01:58:18.823 INFO:teuthology.orchestra.run.smithi042.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-29T01:58:18.954 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-29T01:58:18.964 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-29T01:58:19.140 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-07-29T01:58:19.346 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-07-29T01:58:19.430 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-07-29T01:58:19.613 INFO:teuthology.orchestra.run.smithi042.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-07-29T01:58:19.626 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-07-29T01:58:19.626 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-29T01:58:19.698 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 105/134 2023-07-29T01:58:19.833 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-29T01:58:19.833 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-29T01:58:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 106/134 2023-07-29T01:58:19.937 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 106/134 2023-07-29T01:58:20.051 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-29T01:58:20.212 INFO:teuthology.orchestra.run.smithi042.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-29T01:58:20.291 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8. 107/134 2023-07-29T01:58:20.480 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 108/134 2023-07-29T01:58:20.516 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 108/134 2023-07-29T01:58:20.680 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 109/134 2023-07-29T01:58:20.692 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 109/134 2023-07-29T01:58:20.775 INFO:teuthology.orchestra.run.smithi042.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-29T01:58:20.775 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-2:18.1.3-11.g0484097b.el8.x86_64 1/134 2023-07-29T01:58:20.775 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 2/134 2023-07-29T01:58:20.776 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 3/134 2023-07-29T01:58:20.776 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 4/134 2023-07-29T01:58:20.776 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-immutable-object-cache-2:18.1.3-11.g0484097 5/134 2023-07-29T01:58:20.776 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 6/134 2023-07-29T01:58:20.776 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 7/134 2023-07-29T01:58:20.776 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 8/134 2023-07-29T01:58:20.776 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 9/134 2023-07-29T01:58:20.777 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 10/134 2023-07-29T01:58:20.777 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 11/134 2023-07-29T01:58:20.777 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 12/134 2023-07-29T01:58:20.777 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-mirror-2:18.1.3-11.g0484097b.el8.x86_64 13/134 2023-07-29T01:58:20.777 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 14/134 2023-07-29T01:58:20.777 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 15/134 2023-07-29T01:58:20.777 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 16/134 2023-07-29T01:58:20.777 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 17/134 2023-07-29T01:58:20.778 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 18/134 2023-07-29T01:58:20.778 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librgw2-2:18.1.3-11.g0484097b.el8.x86_64 19/134 2023-07-29T01:58:20.778 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-argparse-2:18.1.3-11.g0484097b.el8. 20/134 2023-07-29T01:58:20.778 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-ceph-common-2:18.1.3-11.g0484097b.el8.x8 21/134 2023-07-29T01:58:20.778 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 22/134 2023-07-29T01:58:20.778 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 23/134 2023-07-29T01:58:20.778 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 24/134 2023-07-29T01:58:20.778 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 25/134 2023-07-29T01:58:20.779 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 26/134 2023-07-29T01:58:20.779 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 27/134 2023-07-29T01:58:20.779 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 28/134 2023-07-29T01:58:20.779 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el 29/134 2023-07-29T01:58:20.779 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 30/134 2023-07-29T01:58:20.786 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 31/134 2023-07-29T01:58:20.786 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 32/134 2023-07-29T01:58:20.786 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8. 33/134 2023-07-29T01:58:20.786 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 34/134 2023-07-29T01:58:20.786 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8 35/134 2023-07-29T01:58:20.786 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 36/134 2023-07-29T01:58:20.787 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephadm-2:18.1.3-11.g0484097b.el8.noarch 37/134 2023-07-29T01:58:20.787 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : cephfs-top-2:18.1.3-11.g0484097b.el8.noarch 38/134 2023-07-29T01:58:20.787 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-29T01:58:20.787 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-29T01:58:20.787 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-29T01:58:20.787 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-29T01:58:20.787 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-29T01:58:20.787 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-29T01:58:20.788 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-29T01:58:20.788 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-29T01:58:20.788 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-29T01:58:20.788 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-29T01:58:20.788 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-29T01:58:20.788 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-29T01:58:20.788 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-29T01:58:20.789 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-29T01:58:20.789 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-29T01:58:20.789 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-29T01:58:20.789 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-29T01:58:20.789 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-29T01:58:20.789 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-29T01:58:20.789 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-29T01:58:20.789 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-29T01:58:20.790 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-07-29T01:58:20.790 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-29T01:58:20.790 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-29T01:58:20.790 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-29T01:58:20.790 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-29T01:58:20.790 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-29T01:58:20.790 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-29T01:58:20.790 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-29T01:58:20.791 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-29T01:58:20.791 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-29T01:58:20.791 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-29T01:58:20.791 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-29T01:58:20.791 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-07-29T01:58:20.791 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-07-29T01:58:20.791 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-07-29T01:58:20.791 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-07-29T01:58:20.792 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-07-29T01:58:20.792 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-07-29T01:58:20.792 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-07-29T01:58:20.792 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-07-29T01:58:20.792 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-07-29T01:58:20.792 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-07-29T01:58:20.792 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-07-29T01:58:20.793 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-07-29T01:58:20.793 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-07-29T01:58:20.793 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-07-29T01:58:20.793 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-07-29T01:58:20.793 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-07-29T01:58:20.793 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-07-29T01:58:20.793 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-07-29T01:58:20.793 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-07-29T01:58:20.794 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-07-29T01:58:20.794 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-07-29T01:58:20.794 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-07-29T01:58:20.794 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-07-29T01:58:20.794 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-07-29T01:58:20.794 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-07-29T01:58:20.794 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-07-29T01:58:20.794 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-07-29T01:58:20.795 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-07-29T01:58:20.795 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-07-29T01:58:20.795 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-07-29T01:58:20.795 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-07-29T01:58:20.795 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-07-29T01:58:20.795 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-07-29T01:58:20.795 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-07-29T01:58:20.795 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-07-29T01:58:20.796 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-07-29T01:58:20.796 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-07-29T01:58:20.796 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-07-29T01:58:20.796 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-07-29T01:58:20.796 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-07-29T01:58:20.796 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-07-29T01:58:20.796 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-07-29T01:58:20.796 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-07-29T01:58:20.797 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-07-29T01:58:20.797 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-07-29T01:58:20.797 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-07-29T01:58:20.797 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-07-29T01:58:20.797 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-07-29T01:58:20.797 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-29T01:58:20.797 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-07-29T01:58:20.798 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-29T01:58:20.798 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-07-29T01:58:20.798 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-07-29T01:58:20.798 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-07-29T01:58:20.798 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-07-29T01:58:20.798 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-07-29T01:58:20.798 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-29T01:58:20.798 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-2:18.1.3-11.g0484097b.el8.x86_64 129/134 2023-07-29T01:58:20.799 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-29T01:58:20.799 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-2:18.1.3-11.g0484097b.el8.x86_64 131/134 2023-07-29T01:58:20.799 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-29T01:58:20.799 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-29T01:58:21.947 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-2:18.1.3-11.g0484097b.el8.x86_64 110/134 2023-07-29T01:58:22.181 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 111/134 2023-07-29T01:58:22.215 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 111/134 2023-07-29T01:58:22.372 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-immutable-object-cache-2:18.1.3-11.g0484097 112/134 2023-07-29T01:58:22.414 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.1.3-11.g0484097 112/134 2023-07-29T01:58:22.597 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-mirror-2:18.1.3-11.g0484097b.el8.x86_64 113/134 2023-07-29T01:58:22.942 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephfs-mirror-2:18.1.3-11.g0484097b.el8.x86_64 113/134 2023-07-29T01:58:23.097 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 114/134 2023-07-29T01:58:23.317 INFO:teuthology.orchestra.run.smithi042.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-29T01:58:23.318 INFO:teuthology.orchestra.run.smithi042.stdout:Last metadata expiration check: 0:02:03 ago on Sat 29 Jul 2023 01:56:20 AM UTC. 2023-07-29T01:58:25.975 INFO:teuthology.orchestra.run.smithi042.stdout:Installed products updated. 2023-07-29T01:58:26.276 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:58:26.276 INFO:teuthology.orchestra.run.smithi042.stdout:Upgraded: 2023-07-29T01:58:26.276 INFO:teuthology.orchestra.run.smithi042.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-29T01:58:26.276 INFO:teuthology.orchestra.run.smithi042.stdout: librados2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: librbd1-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.277 INFO:teuthology.orchestra.run.smithi042.stdout:Installed: 2023-07-29T01:58:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-29T01:58:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: automake-1.16.1-7.el8.noarch 2023-07-29T01:58:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: bison-3.0.4-10.el8.x86_64 2023-07-29T01:58:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.277 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T01:58:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-immutable-object-cache-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T01:58:26.278 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T01:58:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-diskprediction-local-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T01:58:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T01:58:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T01:58:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T01:58:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.279 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T01:58:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: cephadm-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T01:58:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-mirror-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: cephfs-top-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T01:58:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-29T01:58:26.280 INFO:teuthology.orchestra.run.smithi042.stdout: flex-2.6.1-9.el8.x86_64 2023-07-29T01:58:26.281 INFO:teuthology.orchestra.run.smithi042.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-29T01:58:26.281 INFO:teuthology.orchestra.run.smithi042.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-29T01:58:26.281 INFO:teuthology.orchestra.run.smithi042.stdout: jq-1.6-3.el8.x86_64 2023-07-29T01:58:26.281 INFO:teuthology.orchestra.run.smithi042.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-29T01:58:26.281 INFO:teuthology.orchestra.run.smithi042.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-29T01:58:26.281 INFO:teuthology.orchestra.run.smithi042.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-29T01:58:26.281 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-29T01:58:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-29T01:58:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-29T01:58:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: libpq-13.5-1.el8.x86_64 2023-07-29T01:58:26.282 INFO:teuthology.orchestra.run.smithi042.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-29T01:58:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-29T01:58:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-29T01:58:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: librgw2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-29T01:58:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-29T01:58:26.283 INFO:teuthology.orchestra.run.smithi042.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-29T01:58:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-29T01:58:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-29T01:58:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-29T01:58:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-29T01:58:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-29T01:58:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-29T01:58:26.284 INFO:teuthology.orchestra.run.smithi042.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-29T01:58:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-29T01:58:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-29T01:58:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-29T01:58:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-29T01:58:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-29T01:58:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-29T01:58:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-29T01:58:26.285 INFO:teuthology.orchestra.run.smithi042.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-29T01:58:26.286 INFO:teuthology.orchestra.run.smithi042.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-29T01:58:26.286 INFO:teuthology.orchestra.run.smithi042.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-29T01:58:26.286 INFO:teuthology.orchestra.run.smithi042.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-29T01:58:26.286 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-29T01:58:26.286 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-argparse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.286 INFO:teuthology.orchestra.run.smithi042.stdout: python3-ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.286 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.286 INFO:teuthology.orchestra.run.smithi042.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-29T01:58:26.287 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-29T01:58:26.287 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-29T01:58:26.287 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-29T01:58:26.287 INFO:teuthology.orchestra.run.smithi042.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-29T01:58:26.287 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-29T01:58:26.287 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-29T01:58:26.287 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-29T01:58:26.287 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-29T01:58:26.288 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-29T01:58:26.288 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-29T01:58:26.288 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-29T01:58:26.288 INFO:teuthology.orchestra.run.smithi042.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-29T01:58:26.288 INFO:teuthology.orchestra.run.smithi042.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-29T01:58:26.288 INFO:teuthology.orchestra.run.smithi042.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-29T01:58:26.288 INFO:teuthology.orchestra.run.smithi042.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-29T01:58:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-29T01:58:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-29T01:58:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-29T01:58:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-29T01:58:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-29T01:58:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-29T01:58:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: python3-portend-2.6-1.el8.noarch 2023-07-29T01:58:26.289 INFO:teuthology.orchestra.run.smithi042.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-29T01:58:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-29T01:58:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-29T01:58:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-29T01:58:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-29T01:58:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-29T01:58:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.290 INFO:teuthology.orchestra.run.smithi042.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-29T01:58:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-29T01:58:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-29T01:58:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: python3-rsa-4.9-2.el8.noarch 2023-07-29T01:58:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-29T01:58:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-29T01:58:26.291 INFO:teuthology.orchestra.run.smithi042.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-29T01:58:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-29T01:58:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-29T01:58:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-29T01:58:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-29T01:58:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-29T01:58:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-29T01:58:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-29T01:58:26.292 INFO:teuthology.orchestra.run.smithi042.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-29T01:58:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-29T01:58:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-29T01:58:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-29T01:58:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-29T01:58:26.293 INFO:teuthology.orchestra.run.smithi042.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-29T01:58:26.294 INFO:teuthology.orchestra.run.smithi042.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-29T01:58:26.294 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:58:26.294 INFO:teuthology.orchestra.run.smithi042.stdout:Complete! 2023-07-29T01:58:26.522 DEBUG:teuthology.parallel:result is None 2023-07-29T01:58:27.527 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 114/134 2023-07-29T01:58:28.405 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 115/134 2023-07-29T01:58:28.719 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-07-29T01:58:28.925 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 117/134 2023-07-29T01:58:29.172 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-07-29T01:58:29.329 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-07-29T01:58:29.520 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-07-29T01:58:29.758 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-07-29T01:58:29.958 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 121/134 2023-07-29T01:58:30.105 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-29T01:58:32.203 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-29T01:58:32.437 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-29T01:58:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-29T01:58:32.645 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-top-2:18.1.3-11.g0484097b.el8.noarch 124/134 2023-07-29T01:58:32.920 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 125/134 2023-07-29T01:58:33.195 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 126/134 2023-07-29T01:58:33.562 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-29T01:58:33.728 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-07-29T01:58:33.807 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-07-29T01:58:34.011 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-07-29T01:58:34.024 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-07-29T01:58:34.228 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-29T01:58:34.237 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-29T01:58:34.380 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-07-29T01:58:34.381 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-29T01:58:34.581 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-29T01:58:34.581 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-29T01:58:34.819 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-29T01:58:35.035 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-29T01:58:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-29T01:58:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-2:18.1.3-11.g0484097b.el8.x86_64 1/134 2023-07-29T01:58:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 2/134 2023-07-29T01:58:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 3/134 2023-07-29T01:58:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 4/134 2023-07-29T01:58:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-immutable-object-cache-2:18.1.3-11.g0484097 5/134 2023-07-29T01:58:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 6/134 2023-07-29T01:58:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 7/134 2023-07-29T01:58:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 8/134 2023-07-29T01:58:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 9/134 2023-07-29T01:58:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 10/134 2023-07-29T01:58:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 11/134 2023-07-29T01:58:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 12/134 2023-07-29T01:58:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-mirror-2:18.1.3-11.g0484097b.el8.x86_64 13/134 2023-07-29T01:58:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 14/134 2023-07-29T01:58:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 15/134 2023-07-29T01:58:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 16/134 2023-07-29T01:58:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 17/134 2023-07-29T01:58:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_6 18/134 2023-07-29T01:58:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librgw2-2:18.1.3-11.g0484097b.el8.x86_64 19/134 2023-07-29T01:58:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-argparse-2:18.1.3-11.g0484097b.el8. 20/134 2023-07-29T01:58:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-common-2:18.1.3-11.g0484097b.el8.x8 21/134 2023-07-29T01:58:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 22/134 2023-07-29T01:58:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 23/134 2023-07-29T01:58:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 24/134 2023-07-29T01:58:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 25/134 2023-07-29T01:58:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 26/134 2023-07-29T01:58:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 27/134 2023-07-29T01:58:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 28/134 2023-07-29T01:58:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el 29/134 2023-07-29T01:58:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarc 30/134 2023-07-29T01:58:35.537 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noa 31/134 2023-07-29T01:58:35.537 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.1.3-11.g04840 32/134 2023-07-29T01:58:35.537 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8. 33/134 2023-07-29T01:58:35.537 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 34/134 2023-07-29T01:58:35.538 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8 35/134 2023-07-29T01:58:35.538 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 36/134 2023-07-29T01:58:35.538 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephadm-2:18.1.3-11.g0484097b.el8.noarch 37/134 2023-07-29T01:58:35.538 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-top-2:18.1.3-11.g0484097b.el8.noarch 38/134 2023-07-29T01:58:35.538 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-29T01:58:35.538 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-29T01:58:35.538 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-29T01:58:35.539 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-29T01:58:35.539 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-29T01:58:35.539 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-29T01:58:35.539 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-29T01:58:35.539 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-29T01:58:35.539 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-29T01:58:35.539 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-29T01:58:35.539 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-29T01:58:35.540 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-29T01:58:35.540 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-29T01:58:35.540 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-29T01:58:35.540 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-29T01:58:35.540 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-29T01:58:35.540 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-29T01:58:35.541 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-29T01:58:35.541 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-29T01:58:35.541 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-29T01:58:35.541 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-29T01:58:35.541 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-07-29T01:58:35.541 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-29T01:58:35.541 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-29T01:58:35.542 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-29T01:58:35.542 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-29T01:58:35.542 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-29T01:58:35.542 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-29T01:58:35.542 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-29T01:58:35.542 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-29T01:58:35.542 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-29T01:58:35.543 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-29T01:58:35.543 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-29T01:58:35.543 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-07-29T01:58:35.543 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-07-29T01:58:35.543 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-07-29T01:58:35.543 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-07-29T01:58:35.543 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-07-29T01:58:35.543 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-07-29T01:58:35.544 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-07-29T01:58:35.544 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-07-29T01:58:35.544 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-07-29T01:58:35.544 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-07-29T01:58:35.544 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-07-29T01:58:35.544 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-07-29T01:58:35.544 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-07-29T01:58:35.545 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-07-29T01:58:35.545 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-07-29T01:58:35.545 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-07-29T01:58:35.546 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-07-29T01:58:35.546 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-07-29T01:58:35.546 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-07-29T01:58:35.546 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-07-29T01:58:35.546 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-07-29T01:58:35.546 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-07-29T01:58:35.546 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-07-29T01:58:35.547 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-07-29T01:58:35.547 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-07-29T01:58:35.547 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-07-29T01:58:35.547 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-07-29T01:58:35.547 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-07-29T01:58:35.547 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-07-29T01:58:35.547 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-07-29T01:58:35.547 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-07-29T01:58:35.548 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-07-29T01:58:35.548 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-07-29T01:58:35.548 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-07-29T01:58:35.548 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-07-29T01:58:35.548 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-07-29T01:58:35.548 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-07-29T01:58:35.548 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-07-29T01:58:35.549 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-07-29T01:58:35.549 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-07-29T01:58:35.549 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-07-29T01:58:35.549 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-07-29T01:58:35.549 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-07-29T01:58:35.549 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-07-29T01:58:35.549 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-07-29T01:58:35.549 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-07-29T01:58:35.551 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-07-29T01:58:35.551 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-07-29T01:58:35.551 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-07-29T01:58:35.551 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-07-29T01:58:35.551 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-07-29T01:58:35.551 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-07-29T01:58:35.552 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-07-29T01:58:35.552 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-07-29T01:58:35.552 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-07-29T01:58:35.552 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-07-29T01:58:35.552 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-07-29T01:58:35.552 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:18.1.3-11.g0484097b.el8.x86_64 129/134 2023-07-29T01:58:35.552 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-29T01:58:35.553 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:18.1.3-11.g0484097b.el8.x86_64 131/134 2023-07-29T01:58:35.553 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-29T01:58:35.553 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-29T01:58:38.114 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-29T01:58:38.114 INFO:teuthology.orchestra.run.smithi144.stdout:Last metadata expiration check: 0:02:22 ago on Sat 29 Jul 2023 01:56:16 AM UTC. 2023-07-29T01:58:43.239 INFO:teuthology.orchestra.run.smithi144.stdout:Installed products updated. 2023-07-29T01:58:43.476 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:58:43.477 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2023-07-29T01:58:43.477 INFO:teuthology.orchestra.run.smithi144.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-29T01:58:43.477 INFO:teuthology.orchestra.run.smithi144.stdout: librados2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.477 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.477 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2023-07-29T01:58:43.477 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-29T01:58:43.477 INFO:teuthology.orchestra.run.smithi144.stdout: automake-1.16.1-7.el8.noarch 2023-07-29T01:58:43.478 INFO:teuthology.orchestra.run.smithi144.stdout: bison-3.0.4-10.el8.x86_64 2023-07-29T01:58:43.478 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.478 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.478 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.478 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.478 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T01:58:43.478 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.479 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.479 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.479 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T01:58:43.479 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T01:58:43.479 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T01:58:43.479 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T01:58:43.479 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T01:58:43.479 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.480 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.480 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T01:58:43.480 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.480 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.480 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.480 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T01:58:43.480 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T01:58:43.481 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.481 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top-2:18.1.3-11.g0484097b.el8.noarch 2023-07-29T01:58:43.481 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-29T01:58:43.481 INFO:teuthology.orchestra.run.smithi144.stdout: flex-2.6.1-9.el8.x86_64 2023-07-29T01:58:43.481 INFO:teuthology.orchestra.run.smithi144.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-29T01:58:43.482 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-29T01:58:43.482 INFO:teuthology.orchestra.run.smithi144.stdout: jq-1.6-3.el8.x86_64 2023-07-29T01:58:43.482 INFO:teuthology.orchestra.run.smithi144.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-29T01:58:43.483 INFO:teuthology.orchestra.run.smithi144.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-29T01:58:43.483 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-29T01:58:43.483 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.483 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.484 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.484 INFO:teuthology.orchestra.run.smithi144.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-29T01:58:43.484 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-29T01:58:43.484 INFO:teuthology.orchestra.run.smithi144.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-29T01:58:43.485 INFO:teuthology.orchestra.run.smithi144.stdout: libpq-13.5-1.el8.x86_64 2023-07-29T01:58:43.485 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-29T01:58:43.485 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-29T01:58:43.485 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.486 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.486 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-29T01:58:43.486 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.487 INFO:teuthology.orchestra.run.smithi144.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-29T01:58:43.487 INFO:teuthology.orchestra.run.smithi144.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-29T01:58:43.487 INFO:teuthology.orchestra.run.smithi144.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-29T01:58:43.487 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-29T01:58:43.487 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-29T01:58:43.488 INFO:teuthology.orchestra.run.smithi144.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-29T01:58:43.488 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-29T01:58:43.488 INFO:teuthology.orchestra.run.smithi144.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-29T01:58:43.488 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-29T01:58:43.488 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-29T01:58:43.488 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-29T01:58:43.488 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-29T01:58:43.489 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-29T01:58:43.489 INFO:teuthology.orchestra.run.smithi144.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-29T01:58:43.489 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-29T01:58:43.489 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-29T01:58:43.489 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-29T01:58:43.489 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-29T01:58:43.489 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-29T01:58:43.490 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-29T01:58:43.490 INFO:teuthology.orchestra.run.smithi144.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-29T01:58:43.490 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-29T01:58:43.490 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.490 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.490 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.490 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-29T01:58:43.490 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-29T01:58:43.491 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-29T01:58:43.491 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-29T01:58:43.491 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-29T01:58:43.491 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-29T01:58:43.491 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-29T01:58:43.491 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-29T01:58:43.491 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-29T01:58:43.492 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-29T01:58:43.492 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-29T01:58:43.492 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-29T01:58:43.492 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-29T01:58:43.492 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-29T01:58:43.492 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-29T01:58:43.492 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-29T01:58:43.492 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-29T01:58:43.493 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-29T01:58:43.493 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-29T01:58:43.493 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-29T01:58:43.493 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-29T01:58:43.493 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-29T01:58:43.493 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend-2.6-1.el8.noarch 2023-07-29T01:58:43.493 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-29T01:58:43.494 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-29T01:58:43.494 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-29T01:58:43.494 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-29T01:58:43.494 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-29T01:58:43.494 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-29T01:58:43.494 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.494 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.494 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-29T01:58:43.495 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-29T01:58:43.495 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.495 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-29T01:58:43.495 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa-4.9-2.el8.noarch 2023-07-29T01:58:43.495 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-29T01:58:43.495 INFO:teuthology.orchestra.run.smithi144.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-29T01:58:43.495 INFO:teuthology.orchestra.run.smithi144.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-29T01:58:43.496 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-29T01:58:43.496 INFO:teuthology.orchestra.run.smithi144.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-29T01:58:43.496 INFO:teuthology.orchestra.run.smithi144.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-29T01:58:43.496 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-29T01:58:43.496 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-29T01:58:43.496 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-29T01:58:43.497 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-29T01:58:43.497 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-29T01:58:43.497 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.497 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.497 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd-2:18.1.3-11.g0484097b.el8.x86_64 2023-07-29T01:58:43.497 INFO:teuthology.orchestra.run.smithi144.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-29T01:58:43.497 INFO:teuthology.orchestra.run.smithi144.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-29T01:58:43.498 INFO:teuthology.orchestra.run.smithi144.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-29T01:58:43.498 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-29T01:58:43.498 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-29T01:58:43.498 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-29T01:58:43.498 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:58:43.499 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2023-07-29T01:58:43.669 DEBUG:teuthology.parallel:result is None 2023-07-29T01:58:43.670 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T01:58:49.307 DEBUG:teuthology.orchestra.run.smithi042:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-29T01:58:49.336 INFO:teuthology.orchestra.run.smithi042.stdout:18.1.3-11.g0484097b.el8 2023-07-29T01:58:49.337 INFO:teuthology.packaging:The installed version of ceph is 18.1.3-11.g0484097b.el8 2023-07-29T01:58:49.338 INFO:teuthology.task.install:The correct ceph version 18.1.3-11.g0484097b is installed. 2023-07-29T01:58:49.338 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T01:58:54.839 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-29T01:58:54.865 INFO:teuthology.orchestra.run.smithi144.stdout:18.1.3-11.g0484097b.el8 2023-07-29T01:58:54.865 INFO:teuthology.packaging:The installed version of ceph is 18.1.3-11.g0484097b.el8 2023-07-29T01:58:54.866 INFO:teuthology.task.install:The correct ceph version 18.1.3-11.g0484097b is installed. 2023-07-29T01:58:54.866 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-29T01:58:54.867 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:58:54.867 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-29T01:58:54.916 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:58:54.917 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-29T01:58:54.960 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-29T01:58:54.961 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:58:54.961 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/daemon-helper 2023-07-29T01:58:54.993 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-29T01:58:55.062 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:58:55.063 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2023-07-29T01:58:55.089 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-29T01:58:55.156 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-29T01:58:55.156 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:58:55.157 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-29T01:58:55.185 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-29T01:58:55.254 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:58:55.255 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-29T01:58:55.280 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-29T01:58:55.348 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-29T01:58:55.349 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:58:55.349 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/usr/bin/stdin-killer 2023-07-29T01:58:55.377 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-29T01:58:55.445 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:58:55.446 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/stdin-killer 2023-07-29T01:58:55.472 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-29T01:58:55.540 INFO:teuthology.run_tasks:Running task ceph... 2023-07-29T01:58:55.609 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-29T01:58:55.610 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 777 /var/log/ceph 2023-07-29T01:58:55.612 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /var/log/ceph 2023-07-29T01:58:55.639 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-29T01:58:55.640 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-29T01:58:55.680 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-29T01:58:55.706 INFO:tasks.ceph:Creating extra log directories... 2023-07-29T01:58:55.707 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-29T01:58:55.747 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-29T01:58:55.780 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-29T01:58:55.781 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-29T01:58:55.781 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-29T01:58:55.781 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:58:55.781 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-29T01:58:55.829 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-29T01:58:59.674 DEBUG:teuthology.orchestra.run.smithi042:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-29T01:58:59.708 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:58:59.709 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-29T01:58:59.725 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-29T01:59:05.001 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-29T01:59:05.040 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-29T01:59:05.040 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': False, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'Replacing daemon mds'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-29T01:59:05.041 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-07-28_23:11:59-fs-reef-release-distro-default-smithi/7355992', 'branch': 'reef-release', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7355992', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-07-28_23:11:59-fs-reef-release-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'reef-release'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': False, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'Replacing daemon mds'], 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef-release', 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 7230, 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'reef-release', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi042.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi144.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '0484097b0572e96f42cf6402cbe0ac8dcb046577'}}, {'ceph': None}, {'kclient': None}, {'mds_thrash': None}, {'workunit': {'clients': {'all': ['fs/snaps']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '61140164d2579c30ffff3970615e0f82e40c6470', 'timestamp': '2023-07-28_23:11:59', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-29T01:59:05.042 DEBUG:teuthology.orchestra.run.smithi042:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-29T01:59:05.044 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-29T01:59:05.094 DEBUG:teuthology.orchestra.run.smithi042:> sudo install -d -m0777 -- /var/run/ceph 2023-07-29T01:59:05.106 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/run/ceph 2023-07-29T01:59:05.165 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:59:05.165 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/scratch_devs of=/dev/stdout 2023-07-29T01:59:05.195 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-29T01:59:05.196 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_1 2023-07-29T01:59:05.254 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-29T01:59:05.255 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T01:59:05.255 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 378101 Links: 1 2023-07-29T01:59:05.255 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T01:59:05.255 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T01:59:05.255 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2023-07-29 01:58:20.461068779 +0000 2023-07-29T01:59:05.255 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2023-07-29 01:48:29.903871672 +0000 2023-07-29T01:59:05.256 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2023-07-29 01:48:29.903871672 +0000 2023-07-29T01:59:05.256 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: - 2023-07-29T01:59:05.256 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-29T01:59:05.323 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2023-07-29T01:59:05.323 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2023-07-29T01:59:05.323 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000127289 s, 4.0 MB/s 2023-07-29T01:59:05.324 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-29T01:59:05.384 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_2 2023-07-29T01:59:05.442 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-29T01:59:05.443 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T01:59:05.443 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 379435 Links: 1 2023-07-29T01:59:05.443 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T01:59:05.443 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T01:59:05.443 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2023-07-29 01:58:20.461068779 +0000 2023-07-29T01:59:05.443 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2023-07-29 01:48:30.425867749 +0000 2023-07-29T01:59:05.444 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2023-07-29 01:48:30.425867749 +0000 2023-07-29T01:59:05.444 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: - 2023-07-29T01:59:05.444 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-29T01:59:05.509 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2023-07-29T01:59:05.510 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2023-07-29T01:59:05.510 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000103093 s, 5.0 MB/s 2023-07-29T01:59:05.511 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-29T01:59:05.569 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_3 2023-07-29T01:59:05.627 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-29T01:59:05.627 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T01:59:05.628 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 380246 Links: 1 2023-07-29T01:59:05.628 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T01:59:05.628 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T01:59:05.628 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2023-07-29 01:58:20.461068779 +0000 2023-07-29T01:59:05.628 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2023-07-29 01:48:30.934863924 +0000 2023-07-29T01:59:05.628 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2023-07-29 01:48:30.934863924 +0000 2023-07-29T01:59:05.628 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: - 2023-07-29T01:59:05.629 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-29T01:59:05.694 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2023-07-29T01:59:05.694 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2023-07-29T01:59:05.695 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.0001142 s, 4.5 MB/s 2023-07-29T01:59:05.696 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-29T01:59:05.754 DEBUG:teuthology.orchestra.run.smithi042:> stat /dev/vg_nvme/lv_4 2023-07-29T01:59:05.812 INFO:teuthology.orchestra.run.smithi042.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-29T01:59:05.812 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T01:59:05.812 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 6h/6d Inode: 381950 Links: 1 2023-07-29T01:59:05.813 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T01:59:05.813 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T01:59:05.813 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 2023-07-29 01:58:20.461068779 +0000 2023-07-29T01:59:05.813 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2023-07-29 01:48:31.457859994 +0000 2023-07-29T01:59:05.813 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2023-07-29 01:48:31.457859994 +0000 2023-07-29T01:59:05.813 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: - 2023-07-29T01:59:05.814 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-29T01:59:05.879 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records in 2023-07-29T01:59:05.879 INFO:teuthology.orchestra.run.smithi042.stderr:1+0 records out 2023-07-29T01:59:05.879 INFO:teuthology.orchestra.run.smithi042.stderr:512 bytes copied, 0.000113367 s, 4.5 MB/s 2023-07-29T01:59:05.880 DEBUG:teuthology.orchestra.run.smithi042:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-29T01:59:05.938 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-29T01:59:05.939 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:59:05.939 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/scratch_devs of=/dev/stdout 2023-07-29T01:59:05.959 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-29T01:59:05.960 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_1 2023-07-29T01:59:06.019 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-29T01:59:06.019 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T01:59:06.019 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 369656 Links: 1 2023-07-29T01:59:06.019 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T01:59:06.020 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T01:59:06.020 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-07-29 01:58:35.242231310 +0000 2023-07-29T01:59:06.020 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-07-29 01:55:15.360644480 +0000 2023-07-29T01:59:06.020 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-07-29 01:55:15.360644480 +0000 2023-07-29T01:59:06.020 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2023-07-29T01:59:06.021 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-29T01:59:06.088 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-07-29T01:59:06.088 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-07-29T01:59:06.089 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000261136 s, 2.0 MB/s 2023-07-29T01:59:06.089 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-29T01:59:06.149 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_2 2023-07-29T01:59:06.206 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-29T01:59:06.207 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T01:59:06.207 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 383074 Links: 1 2023-07-29T01:59:06.207 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T01:59:06.207 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T01:59:06.207 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-07-29 01:58:35.242231310 +0000 2023-07-29T01:59:06.207 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-07-29 01:55:15.869635837 +0000 2023-07-29T01:59:06.207 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-07-29 01:55:15.869635837 +0000 2023-07-29T01:59:06.208 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2023-07-29T01:59:06.208 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-29T01:59:06.274 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-07-29T01:59:06.274 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-07-29T01:59:06.274 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000208254 s, 2.5 MB/s 2023-07-29T01:59:06.276 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-29T01:59:06.333 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_3 2023-07-29T01:59:06.391 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-29T01:59:06.391 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T01:59:06.392 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 382099 Links: 1 2023-07-29T01:59:06.392 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T01:59:06.392 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T01:59:06.392 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-07-29 01:58:35.242231310 +0000 2023-07-29T01:59:06.392 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-07-29 01:55:16.385627076 +0000 2023-07-29T01:59:06.392 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-07-29 01:55:16.385627076 +0000 2023-07-29T01:59:06.393 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2023-07-29T01:59:06.393 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-29T01:59:06.458 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-07-29T01:59:06.458 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-07-29T01:59:06.458 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000233142 s, 2.2 MB/s 2023-07-29T01:59:06.459 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-29T01:59:06.518 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_4 2023-07-29T01:59:06.575 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-29T01:59:06.575 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-29T01:59:06.575 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 375688 Links: 1 2023-07-29T01:59:06.575 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T01:59:06.576 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2023-07-29T01:59:06.576 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2023-07-29 01:58:35.242231310 +0000 2023-07-29T01:59:06.576 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2023-07-29 01:55:16.882618638 +0000 2023-07-29T01:59:06.576 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2023-07-29 01:55:16.882618638 +0000 2023-07-29T01:59:06.576 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2023-07-29T01:59:06.576 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-29T01:59:06.640 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2023-07-29T01:59:06.640 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2023-07-29T01:59:06.641 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000225099 s, 2.3 MB/s 2023-07-29T01:59:06.641 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-29T01:59:06.700 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-29T01:59:06.700 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-29T01:59:06.701 INFO:tasks.ceph:Generating config... 2023-07-29T01:59:06.702 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-29T01:59:06.702 INFO:tasks.ceph:[client] debug client = 20 2023-07-29T01:59:06.702 INFO:tasks.ceph:[client] debug ms = 1 2023-07-29T01:59:06.703 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-29T01:59:06.703 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-29T01:59:06.703 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-29T01:59:06.703 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-29T01:59:06.703 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-29T01:59:06.704 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-29T01:59:06.704 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2023-07-29T01:59:06.704 INFO:tasks.ceph:[mds] mds bal merge size = 5 2023-07-29T01:59:06.704 INFO:tasks.ceph:[mds] mds bal split bits = 3 2023-07-29T01:59:06.704 INFO:tasks.ceph:[mds] mds bal split size = 100 2023-07-29T01:59:06.705 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-29T01:59:06.705 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-29T01:59:06.705 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2023-07-29T01:59:06.705 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-29T01:59:06.705 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-29T01:59:06.706 INFO:tasks.ceph:[mds] mds_dir_prefetch = False 2023-07-29T01:59:06.706 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2023-07-29T01:59:06.706 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-29T01:59:06.706 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-29T01:59:06.707 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-29T01:59:06.707 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-29T01:59:06.707 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-29T01:59:06.707 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-29T01:59:06.708 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-29T01:59:06.708 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-29T01:59:06.708 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-29T01:59:06.708 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-29T01:59:06.708 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-07-29T01:59:06.709 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-29T01:59:06.709 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-07-29T01:59:06.709 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-07-29T01:59:06.709 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-29T01:59:06.709 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-29T01:59:06.710 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-07-29T01:59:06.710 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-29T01:59:06.710 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-29T01:59:06.710 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-29T01:59:06.710 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2023-07-29T01:59:06.711 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-29T01:59:06.711 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2023-07-29T01:59:06.711 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-29T01:59:06.711 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-29T01:59:06.712 INFO:tasks.ceph:Setting up mon.a... 2023-07-29T01:59:06.712 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-29T01:59:06.770 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.keyring 2023-07-29T01:59:06.776 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-29T01:59:06.826 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-29T01:59:06.855 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.42'), ('mon.b', '172.21.15.144'), ('mon.c', '[v2:172.21.15.144:3301,v1:172.21.15.144:6790]')] 2023-07-29T01:59:06.855 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.42,172.21.15.144,[v2:172.21.15.144:3301,v1:172.21.15.144:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': False, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-29T01:59:06.856 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:59:06.857 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-29T01:59:06.913 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.42 --add b 172.21.15.144 --addv c '[v2:172.21.15.144:3301,v1:172.21.15.144:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-29T01:59:07.003 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-29T01:59:07.003 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: generated fsid f97a53ee-a392-4212-b8f0-a81cb72fe6f6 2023-07-29T01:59:07.003 INFO:teuthology.orchestra.run.smithi042.stdout:setting min_mon_release = pacific 2023-07-29T01:59:07.003 INFO:teuthology.orchestra.run.smithi042.stdout:epoch 0 2023-07-29T01:59:07.003 INFO:teuthology.orchestra.run.smithi042.stdout:fsid f97a53ee-a392-4212-b8f0-a81cb72fe6f6 2023-07-29T01:59:07.004 INFO:teuthology.orchestra.run.smithi042.stdout:last_changed 2023-07-29T01:59:07.015274+0000 2023-07-29T01:59:07.004 INFO:teuthology.orchestra.run.smithi042.stdout:created 2023-07-29T01:59:07.015274+0000 2023-07-29T01:59:07.004 INFO:teuthology.orchestra.run.smithi042.stdout:min_mon_release 16 (pacific) 2023-07-29T01:59:07.004 INFO:teuthology.orchestra.run.smithi042.stdout:election_strategy: 1 2023-07-29T01:59:07.004 INFO:teuthology.orchestra.run.smithi042.stdout:0: [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] mon.a 2023-07-29T01:59:07.004 INFO:teuthology.orchestra.run.smithi042.stdout:1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.b 2023-07-29T01:59:07.004 INFO:teuthology.orchestra.run.smithi042.stdout:2: [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] mon.c 2023-07-29T01:59:07.005 INFO:teuthology.orchestra.run.smithi042.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-29T01:59:07.006 DEBUG:teuthology.orchestra.run.smithi042:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-29T01:59:07.023 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f97a53ee-a392-4212-b8f0-a81cb72fe6f6... 2023-07-29T01:59:07.024 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-29T01:59:07.064 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-29T01:59:07.109 INFO:teuthology.orchestra.run.smithi042.stdout:[global] 2023-07-29T01:59:07.109 INFO:teuthology.orchestra.run.smithi042.stdout: chdir = "" 2023-07-29T01:59:07.109 INFO:teuthology.orchestra.run.smithi042.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-29T01:59:07.109 INFO:teuthology.orchestra.run.smithi042.stdout: auth supported = cephx 2023-07-29T01:59:07.109 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.110 INFO:teuthology.orchestra.run.smithi042.stdout: filestore xattr use omap = true 2023-07-29T01:59:07.110 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.110 INFO:teuthology.orchestra.run.smithi042.stdout: mon clock drift allowed = 1.000 2023-07-29T01:59:07.110 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.110 INFO:teuthology.orchestra.run.smithi042.stdout: osd crush chooseleaf type = 0 2023-07-29T01:59:07.110 INFO:teuthology.orchestra.run.smithi042.stdout: auth debug = true 2023-07-29T01:59:07.110 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.111 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on old message = true 2023-07-29T01:59:07.111 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on bug = true 2023-07-29T01:59:07.111 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.111 INFO:teuthology.orchestra.run.smithi042.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-29T01:59:07.111 INFO:teuthology.orchestra.run.smithi042.stdout: mon pg warn max object skew = 0 2023-07-29T01:59:07.111 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.111 INFO:teuthology.orchestra.run.smithi042.stdout: # disable pg_autoscaler by default for new pools 2023-07-29T01:59:07.111 INFO:teuthology.orchestra.run.smithi042.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-29T01:59:07.112 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.112 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default size = 2 2023-07-29T01:59:07.112 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.112 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow primary affinity = true 2023-07-29T01:59:07.112 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd allow pg remap = true 2023-07-29T01:59:07.112 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on legacy crush tunables = false 2023-07-29T01:59:07.112 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on crush straw calc version zero = false 2023-07-29T01:59:07.113 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on no sortbitwise = false 2023-07-29T01:59:07.113 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on osd down out interval zero = false 2023-07-29T01:59:07.113 INFO:teuthology.orchestra.run.smithi042.stdout: mon warn on too few osds = false 2023-07-29T01:59:07.113 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-29T01:59:07.113 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-29T01:59:07.113 INFO:teuthology.orchestra.run.smithi042.stdout: mon_allow_pool_size_one = true 2023-07-29T01:59:07.113 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.113 INFO:teuthology.orchestra.run.smithi042.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-29T01:59:07.114 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.114 INFO:teuthology.orchestra.run.smithi042.stdout: osd default data pool replay window = 5 2023-07-29T01:59:07.114 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.114 INFO:teuthology.orchestra.run.smithi042.stdout: mon allow pool delete = true 2023-07-29T01:59:07.114 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.114 INFO:teuthology.orchestra.run.smithi042.stdout: mon cluster log file level = debug 2023-07-29T01:59:07.114 INFO:teuthology.orchestra.run.smithi042.stdout: debug asserts on shutdown = true 2023-07-29T01:59:07.114 INFO:teuthology.orchestra.run.smithi042.stdout: mon health detail to clog = false 2023-07-29T01:59:07.115 INFO:teuthology.orchestra.run.smithi042.stdout: mon host = "172.21.15.42,172.21.15.144,[v2:172.21.15.144:3301,v1:172.21.15.144:6790]" 2023-07-29T01:59:07.115 INFO:teuthology.orchestra.run.smithi042.stdout: ms die on skipped message = False 2023-07-29T01:59:07.115 INFO:teuthology.orchestra.run.smithi042.stdout: fsid = f97a53ee-a392-4212-b8f0-a81cb72fe6f6 2023-07-29T01:59:07.115 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.115 INFO:teuthology.orchestra.run.smithi042.stdout:[osd] 2023-07-29T01:59:07.115 INFO:teuthology.orchestra.run.smithi042.stdout: osd journal size = 100 2023-07-29T01:59:07.115 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.116 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub load threshold = 5.0 2023-07-29T01:59:07.116 INFO:teuthology.orchestra.run.smithi042.stdout: osd scrub max interval = 600 2023-07-29T01:59:07.116 INFO:teuthology.orchestra.run.smithi042.stdout: osd mclock profile = high_recovery_ops 2023-07-29T01:59:07.116 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.116 INFO:teuthology.orchestra.run.smithi042.stdout: osd recover clone overlap = true 2023-07-29T01:59:07.116 INFO:teuthology.orchestra.run.smithi042.stdout: osd recovery max chunk = 1048576 2023-07-29T01:59:07.116 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.116 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug shutdown = true 2023-07-29T01:59:07.117 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug op order = true 2023-07-29T01:59:07.117 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug verify stray on activate = true 2023-07-29T01:59:07.117 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.117 INFO:teuthology.orchestra.run.smithi042.stdout: osd open classes on start = true 2023-07-29T01:59:07.117 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug pg log writeout = true 2023-07-29T01:59:07.117 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.117 INFO:teuthology.orchestra.run.smithi042.stdout: osd deep scrub update digest min age = 30 2023-07-29T01:59:07.117 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.118 INFO:teuthology.orchestra.run.smithi042.stdout: osd map max advance = 10 2023-07-29T01:59:07.118 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.118 INFO:teuthology.orchestra.run.smithi042.stdout: journal zero on create = true 2023-07-29T01:59:07.118 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.118 INFO:teuthology.orchestra.run.smithi042.stdout: filestore ondisk finisher threads = 3 2023-07-29T01:59:07.118 INFO:teuthology.orchestra.run.smithi042.stdout: filestore apply finisher threads = 3 2023-07-29T01:59:07.118 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.119 INFO:teuthology.orchestra.run.smithi042.stdout: bdev debug aio = true 2023-07-29T01:59:07.119 INFO:teuthology.orchestra.run.smithi042.stdout: osd debug misdirected ops = true 2023-07-29T01:59:07.119 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore block size = 96636764160 2023-07-29T01:59:07.119 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore compression mode = aggressive 2023-07-29T01:59:07.119 INFO:teuthology.orchestra.run.smithi042.stdout: bluestore fsck on mount = True 2023-07-29T01:59:07.119 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluefs = 20 2023-07-29T01:59:07.119 INFO:teuthology.orchestra.run.smithi042.stdout: debug bluestore = 20 2023-07-29T01:59:07.119 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2023-07-29T01:59:07.120 INFO:teuthology.orchestra.run.smithi042.stdout: debug osd = 20 2023-07-29T01:59:07.120 INFO:teuthology.orchestra.run.smithi042.stdout: debug rocksdb = 10 2023-07-29T01:59:07.120 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd backfillfull_ratio = 0.85 2023-07-29T01:59:07.120 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd full ratio = 0.9 2023-07-29T01:59:07.120 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd nearfull ratio = 0.8 2023-07-29T01:59:07.120 INFO:teuthology.orchestra.run.smithi042.stdout: osd blocked scrub grace period = 3600 2023-07-29T01:59:07.120 INFO:teuthology.orchestra.run.smithi042.stdout: osd failsafe full ratio = 0.95 2023-07-29T01:59:07.120 INFO:teuthology.orchestra.run.smithi042.stdout: osd max markdown count = 1000 2023-07-29T01:59:07.121 INFO:teuthology.orchestra.run.smithi042.stdout: osd objectstore = bluestore 2023-07-29T01:59:07.121 INFO:teuthology.orchestra.run.smithi042.stdout: osd op complaint time = 180 2023-07-29T01:59:07.121 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.121 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr] 2023-07-29T01:59:07.121 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2023-07-29T01:59:07.121 INFO:teuthology.orchestra.run.smithi042.stdout: debug mgr = 20 2023-07-29T01:59:07.121 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2023-07-29T01:59:07.122 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2023-07-29T01:59:07.122 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2023-07-29T01:59:07.122 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2023-07-29T01:59:07.122 INFO:teuthology.orchestra.run.smithi042.stdout: mgr/telemetry/nag = false 2023-07-29T01:59:07.122 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.123 INFO:teuthology.orchestra.run.smithi042.stdout:[mon] 2023-07-29T01:59:07.123 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2023-07-29T01:59:07.123 INFO:teuthology.orchestra.run.smithi042.stdout: debug mon = 20 2023-07-29T01:59:07.123 INFO:teuthology.orchestra.run.smithi042.stdout: debug paxos = 20 2023-07-29T01:59:07.123 INFO:teuthology.orchestra.run.smithi042.stdout: debug auth = 20 2023-07-29T01:59:07.123 INFO:teuthology.orchestra.run.smithi042.stdout: mon data avail warn = 5 2023-07-29T01:59:07.123 INFO:teuthology.orchestra.run.smithi042.stdout: mon mgr mkfs grace = 240 2023-07-29T01:59:07.124 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min pgs per osd = 4 2023-07-29T01:59:07.124 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd reporter subtree level = osd 2023-07-29T01:59:07.124 INFO:teuthology.orchestra.run.smithi042.stdout: mon osd prime pg temp = true 2023-07-29T01:59:07.124 INFO:teuthology.orchestra.run.smithi042.stdout: mon reweight min bytes per osd = 10 2023-07-29T01:59:07.125 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.125 INFO:teuthology.orchestra.run.smithi042.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-29T01:59:07.125 INFO:teuthology.orchestra.run.smithi042.stdout: auth mon ticket ttl = 660 # 11m 2023-07-29T01:59:07.125 INFO:teuthology.orchestra.run.smithi042.stdout: auth service ticket ttl = 240 # 4m 2023-07-29T01:59:07.125 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.125 INFO:teuthology.orchestra.run.smithi042.stdout: # don't complain about insecure global_id in the test suite 2023-07-29T01:59:07.125 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-29T01:59:07.126 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-29T01:59:07.126 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.126 INFO:teuthology.orchestra.run.smithi042.stdout: # 1m isn't quite enough 2023-07-29T01:59:07.126 INFO:teuthology.orchestra.run.smithi042.stdout: mon_down_mkfs_grace = 2m 2023-07-29T01:59:07.126 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.126 INFO:teuthology.orchestra.run.smithi042.stdout: mon_warn_on_filestore_osds = false 2023-07-29T01:59:07.126 INFO:teuthology.orchestra.run.smithi042.stdout: mon op complaint time = 120 2023-07-29T01:59:07.126 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:07.127 INFO:teuthology.orchestra.run.smithi042.stdout:[client] 2023-07-29T01:59:07.127 INFO:teuthology.orchestra.run.smithi042.stdout: rgw cache enabled = true 2023-07-29T01:59:07.127 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable ops log = true 2023-07-29T01:59:07.127 INFO:teuthology.orchestra.run.smithi042.stdout: rgw enable usage log = true 2023-07-29T01:59:07.127 INFO:teuthology.orchestra.run.smithi042.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-29T01:59:07.127 INFO:teuthology.orchestra.run.smithi042.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-29T01:59:07.127 INFO:teuthology.orchestra.run.smithi042.stdout: client mount timeout = 600 2023-07-29T01:59:07.127 INFO:teuthology.orchestra.run.smithi042.stdout: debug client = 20 2023-07-29T01:59:07.128 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2023-07-29T01:59:07.128 INFO:teuthology.orchestra.run.smithi042.stdout: rados mon op timeout = 900 2023-07-29T01:59:07.128 INFO:teuthology.orchestra.run.smithi042.stdout: rados osd op timeout = 900 2023-07-29T01:59:07.128 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.a] 2023-07-29T01:59:07.128 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.b] 2023-07-29T01:59:07.128 INFO:teuthology.orchestra.run.smithi042.stdout:[mon.c] 2023-07-29T01:59:07.128 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a] 2023-07-29T01:59:07.129 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.c] 2023-07-29T01:59:07.129 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.e] 2023-07-29T01:59:07.129 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b] 2023-07-29T01:59:07.129 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.d] 2023-07-29T01:59:07.129 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.f] 2023-07-29T01:59:07.129 INFO:teuthology.orchestra.run.smithi042.stdout:[mds] 2023-07-29T01:59:07.129 INFO:teuthology.orchestra.run.smithi042.stdout: debug mds = 20 2023-07-29T01:59:07.129 INFO:teuthology.orchestra.run.smithi042.stdout: debug mds balancer = 20 2023-07-29T01:59:07.130 INFO:teuthology.orchestra.run.smithi042.stdout: debug ms = 1 2023-07-29T01:59:07.130 INFO:teuthology.orchestra.run.smithi042.stdout: mds bal fragment size max = 10000 2023-07-29T01:59:07.130 INFO:teuthology.orchestra.run.smithi042.stdout: mds bal merge size = 5 2023-07-29T01:59:07.130 INFO:teuthology.orchestra.run.smithi042.stdout: mds bal split bits = 3 2023-07-29T01:59:07.130 INFO:teuthology.orchestra.run.smithi042.stdout: mds bal split size = 100 2023-07-29T01:59:07.130 INFO:teuthology.orchestra.run.smithi042.stdout: mds debug frag = True 2023-07-29T01:59:07.130 INFO:teuthology.orchestra.run.smithi042.stdout: mds debug scatterstat = True 2023-07-29T01:59:07.130 INFO:teuthology.orchestra.run.smithi042.stdout: mds oft prefetch dirfrags = True 2023-07-29T01:59:07.131 INFO:teuthology.orchestra.run.smithi042.stdout: mds op complaint time = 180 2023-07-29T01:59:07.131 INFO:teuthology.orchestra.run.smithi042.stdout: mds verify scatter = True 2023-07-29T01:59:07.131 INFO:teuthology.orchestra.run.smithi042.stdout: mds_dir_prefetch = False 2023-07-29T01:59:07.131 INFO:teuthology.orchestra.run.smithi042.stdout: mds_sleep_rank_change = 5000000.0 2023-07-29T01:59:07.131 INFO:teuthology.orchestra.run.smithi042.stdout: osd op complaint time = 180 2023-07-29T01:59:07.131 INFO:teuthology.orchestra.run.smithi042.stdout: rados mon op timeout = 900 2023-07-29T01:59:07.131 INFO:teuthology.orchestra.run.smithi042.stdout: rados osd op timeout = 900 2023-07-29T01:59:07.132 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2023-07-29T01:59:07.133 INFO:teuthology.orchestra.run.smithi144.stdout: chdir = "" 2023-07-29T01:59:07.133 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-29T01:59:07.133 INFO:teuthology.orchestra.run.smithi144.stdout: auth supported = cephx 2023-07-29T01:59:07.133 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.133 INFO:teuthology.orchestra.run.smithi144.stdout: filestore xattr use omap = true 2023-07-29T01:59:07.133 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.134 INFO:teuthology.orchestra.run.smithi144.stdout: mon clock drift allowed = 1.000 2023-07-29T01:59:07.134 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.134 INFO:teuthology.orchestra.run.smithi144.stdout: osd crush chooseleaf type = 0 2023-07-29T01:59:07.134 INFO:teuthology.orchestra.run.smithi144.stdout: auth debug = true 2023-07-29T01:59:07.134 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.134 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on old message = true 2023-07-29T01:59:07.134 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on bug = true 2023-07-29T01:59:07.134 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.135 INFO:teuthology.orchestra.run.smithi144.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-29T01:59:07.135 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn max object skew = 0 2023-07-29T01:59:07.135 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.135 INFO:teuthology.orchestra.run.smithi144.stdout: # disable pg_autoscaler by default for new pools 2023-07-29T01:59:07.135 INFO:teuthology.orchestra.run.smithi144.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-29T01:59:07.135 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.135 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default size = 2 2023-07-29T01:59:07.135 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.136 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow primary affinity = true 2023-07-29T01:59:07.136 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow pg remap = true 2023-07-29T01:59:07.136 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on legacy crush tunables = false 2023-07-29T01:59:07.136 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on crush straw calc version zero = false 2023-07-29T01:59:07.136 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on no sortbitwise = false 2023-07-29T01:59:07.136 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on osd down out interval zero = false 2023-07-29T01:59:07.136 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on too few osds = false 2023-07-29T01:59:07.136 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-29T01:59:07.137 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-29T01:59:07.137 INFO:teuthology.orchestra.run.smithi144.stdout: mon_allow_pool_size_one = true 2023-07-29T01:59:07.137 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.137 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-29T01:59:07.137 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.137 INFO:teuthology.orchestra.run.smithi144.stdout: osd default data pool replay window = 5 2023-07-29T01:59:07.137 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.138 INFO:teuthology.orchestra.run.smithi144.stdout: mon allow pool delete = true 2023-07-29T01:59:07.138 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.138 INFO:teuthology.orchestra.run.smithi144.stdout: mon cluster log file level = debug 2023-07-29T01:59:07.138 INFO:teuthology.orchestra.run.smithi144.stdout: debug asserts on shutdown = true 2023-07-29T01:59:07.138 INFO:teuthology.orchestra.run.smithi144.stdout: mon health detail to clog = false 2023-07-29T01:59:07.138 INFO:teuthology.orchestra.run.smithi144.stdout: mon host = "172.21.15.42,172.21.15.144,[v2:172.21.15.144:3301,v1:172.21.15.144:6790]" 2023-07-29T01:59:07.138 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on skipped message = False 2023-07-29T01:59:07.139 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = f97a53ee-a392-4212-b8f0-a81cb72fe6f6 2023-07-29T01:59:07.139 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.139 INFO:teuthology.orchestra.run.smithi144.stdout:[osd] 2023-07-29T01:59:07.139 INFO:teuthology.orchestra.run.smithi144.stdout: osd journal size = 100 2023-07-29T01:59:07.139 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.139 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub load threshold = 5.0 2023-07-29T01:59:07.139 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub max interval = 600 2023-07-29T01:59:07.139 INFO:teuthology.orchestra.run.smithi144.stdout: osd mclock profile = high_recovery_ops 2023-07-29T01:59:07.140 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.140 INFO:teuthology.orchestra.run.smithi144.stdout: osd recover clone overlap = true 2023-07-29T01:59:07.140 INFO:teuthology.orchestra.run.smithi144.stdout: osd recovery max chunk = 1048576 2023-07-29T01:59:07.140 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.140 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug shutdown = true 2023-07-29T01:59:07.140 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug op order = true 2023-07-29T01:59:07.140 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug verify stray on activate = true 2023-07-29T01:59:07.141 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.141 INFO:teuthology.orchestra.run.smithi144.stdout: osd open classes on start = true 2023-07-29T01:59:07.141 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug pg log writeout = true 2023-07-29T01:59:07.141 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.141 INFO:teuthology.orchestra.run.smithi144.stdout: osd deep scrub update digest min age = 30 2023-07-29T01:59:07.141 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.141 INFO:teuthology.orchestra.run.smithi144.stdout: osd map max advance = 10 2023-07-29T01:59:07.141 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.142 INFO:teuthology.orchestra.run.smithi144.stdout: journal zero on create = true 2023-07-29T01:59:07.142 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.142 INFO:teuthology.orchestra.run.smithi144.stdout: filestore ondisk finisher threads = 3 2023-07-29T01:59:07.142 INFO:teuthology.orchestra.run.smithi144.stdout: filestore apply finisher threads = 3 2023-07-29T01:59:07.142 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.142 INFO:teuthology.orchestra.run.smithi144.stdout: bdev debug aio = true 2023-07-29T01:59:07.142 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug misdirected ops = true 2023-07-29T01:59:07.142 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore block size = 96636764160 2023-07-29T01:59:07.143 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore compression mode = aggressive 2023-07-29T01:59:07.143 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore fsck on mount = True 2023-07-29T01:59:07.143 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluefs = 20 2023-07-29T01:59:07.143 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluestore = 20 2023-07-29T01:59:07.143 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-07-29T01:59:07.143 INFO:teuthology.orchestra.run.smithi144.stdout: debug osd = 20 2023-07-29T01:59:07.143 INFO:teuthology.orchestra.run.smithi144.stdout: debug rocksdb = 10 2023-07-29T01:59:07.143 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull_ratio = 0.85 2023-07-29T01:59:07.144 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.9 2023-07-29T01:59:07.144 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.8 2023-07-29T01:59:07.144 INFO:teuthology.orchestra.run.smithi144.stdout: osd blocked scrub grace period = 3600 2023-07-29T01:59:07.144 INFO:teuthology.orchestra.run.smithi144.stdout: osd failsafe full ratio = 0.95 2023-07-29T01:59:07.144 INFO:teuthology.orchestra.run.smithi144.stdout: osd max markdown count = 1000 2023-07-29T01:59:07.144 INFO:teuthology.orchestra.run.smithi144.stdout: osd objectstore = bluestore 2023-07-29T01:59:07.144 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2023-07-29T01:59:07.145 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.145 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr] 2023-07-29T01:59:07.145 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-07-29T01:59:07.145 INFO:teuthology.orchestra.run.smithi144.stdout: debug mgr = 20 2023-07-29T01:59:07.145 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2023-07-29T01:59:07.145 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2023-07-29T01:59:07.145 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2023-07-29T01:59:07.145 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2023-07-29T01:59:07.146 INFO:teuthology.orchestra.run.smithi144.stdout: mgr/telemetry/nag = false 2023-07-29T01:59:07.146 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.146 INFO:teuthology.orchestra.run.smithi144.stdout:[mon] 2023-07-29T01:59:07.146 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-07-29T01:59:07.146 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2023-07-29T01:59:07.146 INFO:teuthology.orchestra.run.smithi144.stdout: debug paxos = 20 2023-07-29T01:59:07.146 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2023-07-29T01:59:07.146 INFO:teuthology.orchestra.run.smithi144.stdout: mon data avail warn = 5 2023-07-29T01:59:07.147 INFO:teuthology.orchestra.run.smithi144.stdout: mon mgr mkfs grace = 240 2023-07-29T01:59:07.147 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2023-07-29T01:59:07.147 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd reporter subtree level = osd 2023-07-29T01:59:07.147 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd prime pg temp = true 2023-07-29T01:59:07.147 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2023-07-29T01:59:07.147 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.147 INFO:teuthology.orchestra.run.smithi144.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-29T01:59:07.147 INFO:teuthology.orchestra.run.smithi144.stdout: auth mon ticket ttl = 660 # 11m 2023-07-29T01:59:07.148 INFO:teuthology.orchestra.run.smithi144.stdout: auth service ticket ttl = 240 # 4m 2023-07-29T01:59:07.148 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.148 INFO:teuthology.orchestra.run.smithi144.stdout: # don't complain about insecure global_id in the test suite 2023-07-29T01:59:07.148 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-29T01:59:07.148 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-29T01:59:07.148 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.148 INFO:teuthology.orchestra.run.smithi144.stdout: # 1m isn't quite enough 2023-07-29T01:59:07.149 INFO:teuthology.orchestra.run.smithi144.stdout: mon_down_mkfs_grace = 2m 2023-07-29T01:59:07.149 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.149 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_filestore_osds = false 2023-07-29T01:59:07.149 INFO:teuthology.orchestra.run.smithi144.stdout: mon op complaint time = 120 2023-07-29T01:59:07.149 INFO:teuthology.orchestra.run.smithi144.stdout: 2023-07-29T01:59:07.149 INFO:teuthology.orchestra.run.smithi144.stdout:[client] 2023-07-29T01:59:07.149 INFO:teuthology.orchestra.run.smithi144.stdout: rgw cache enabled = true 2023-07-29T01:59:07.149 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable ops log = true 2023-07-29T01:59:07.150 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable usage log = true 2023-07-29T01:59:07.150 INFO:teuthology.orchestra.run.smithi144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-29T01:59:07.150 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-29T01:59:07.150 INFO:teuthology.orchestra.run.smithi144.stdout: client mount timeout = 600 2023-07-29T01:59:07.150 INFO:teuthology.orchestra.run.smithi144.stdout: debug client = 20 2023-07-29T01:59:07.150 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-07-29T01:59:07.150 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2023-07-29T01:59:07.151 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2023-07-29T01:59:07.151 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.a] 2023-07-29T01:59:07.151 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.b] 2023-07-29T01:59:07.151 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.c] 2023-07-29T01:59:07.151 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2023-07-29T01:59:07.151 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2023-07-29T01:59:07.151 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.e] 2023-07-29T01:59:07.151 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2023-07-29T01:59:07.152 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d] 2023-07-29T01:59:07.152 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.f] 2023-07-29T01:59:07.152 INFO:teuthology.orchestra.run.smithi144.stdout:[mds] 2023-07-29T01:59:07.152 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds = 20 2023-07-29T01:59:07.152 INFO:teuthology.orchestra.run.smithi144.stdout: debug mds balancer = 20 2023-07-29T01:59:07.152 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2023-07-29T01:59:07.152 INFO:teuthology.orchestra.run.smithi144.stdout: mds bal fragment size max = 10000 2023-07-29T01:59:07.153 INFO:teuthology.orchestra.run.smithi144.stdout: mds bal merge size = 5 2023-07-29T01:59:07.153 INFO:teuthology.orchestra.run.smithi144.stdout: mds bal split bits = 3 2023-07-29T01:59:07.153 INFO:teuthology.orchestra.run.smithi144.stdout: mds bal split size = 100 2023-07-29T01:59:07.153 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug frag = True 2023-07-29T01:59:07.153 INFO:teuthology.orchestra.run.smithi144.stdout: mds debug scatterstat = True 2023-07-29T01:59:07.153 INFO:teuthology.orchestra.run.smithi144.stdout: mds oft prefetch dirfrags = True 2023-07-29T01:59:07.153 INFO:teuthology.orchestra.run.smithi144.stdout: mds op complaint time = 180 2023-07-29T01:59:07.153 INFO:teuthology.orchestra.run.smithi144.stdout: mds verify scatter = True 2023-07-29T01:59:07.154 INFO:teuthology.orchestra.run.smithi144.stdout: mds_dir_prefetch = False 2023-07-29T01:59:07.154 INFO:teuthology.orchestra.run.smithi144.stdout: mds_sleep_rank_change = 5000000.0 2023-07-29T01:59:07.154 INFO:teuthology.orchestra.run.smithi144.stdout: osd op complaint time = 180 2023-07-29T01:59:07.154 INFO:teuthology.orchestra.run.smithi144.stdout: rados mon op timeout = 900 2023-07-29T01:59:07.154 INFO:teuthology.orchestra.run.smithi144.stdout: rados osd op timeout = 900 2023-07-29T01:59:07.154 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-29T01:59:07.155 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-29T01:59:07.231 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-29T01:59:07.231 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:59:07.231 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-29T01:59:07.248 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:59:07.248 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-29T01:59:07.305 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi042.front.sepia.ceph.com 2023-07-29T01:59:07.305 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:59:07.306 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-29T01:59:07.306 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-29T01:59:07.383 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:59:07.384 DEBUG:teuthology.orchestra.run.smithi042:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-29T01:59:07.440 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi144.front.sepia.ceph.com 2023-07-29T01:59:07.440 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:59:07.441 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-29T01:59:07.441 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-29T01:59:07.481 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:59:07.481 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-29T01:59:07.540 INFO:tasks.ceph:Setting up mon nodes... 2023-07-29T01:59:07.540 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-29T01:59:07.540 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-29T01:59:07.597 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-29T01:59:07.600 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-29T01:59:07.668 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-29T01:59:07.670 INFO:tasks.ceph:Setting up mds nodes... 2023-07-29T01:59:07.671 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-29T01:59:07.726 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-29T01:59:07.729 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-29T01:59:07.756 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-29T01:59:07.851 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-29T01:59:07.854 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-29T01:59:07.883 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2023-07-29T01:59:07.978 INFO:teuthology.orchestra.run.smithi042.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2023-07-29T01:59:07.981 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2023-07-29T01:59:08.008 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-29T01:59:08.066 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-29T01:59:08.068 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-29T01:59:08.095 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-29T01:59:08.189 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-29T01:59:08.192 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-29T01:59:08.217 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2023-07-29T01:59:08.310 INFO:teuthology.orchestra.run.smithi144.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2023-07-29T01:59:08.313 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2023-07-29T01:59:08.339 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-29T01:59:08.340 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-29T01:59:08.387 INFO:teuthology.orchestra.run.smithi042.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-29T01:59:08.401 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-29T01:59:08.401 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi042.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-29T01:59:08.402 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-29T01:59:08.429 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-29T01:59:08.429 INFO:tasks.ceph:role: osd.0 2023-07-29T01:59:08.430 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com 2023-07-29T01:59:08.430 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-29T01:59:08.496 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-29T01:59:08.497 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-29T01:59:08.497 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-29T01:59:08.497 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-29T01:59:08.497 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-29T01:59:08.498 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2023-07-29T01:59:08.498 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-29T01:59:08.498 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-29T01:59:08.498 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-29T01:59:08.499 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-29T01:59:08.519 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2023-07-29T01:59:08.521 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2023-07-29T01:59:08.521 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-29T01:59:08.603 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-29T01:59:08.674 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-29T01:59:08.742 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-29T01:59:08.742 INFO:tasks.ceph:role: osd.1 2023-07-29T01:59:08.742 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com 2023-07-29T01:59:08.742 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-29T01:59:08.808 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-29T01:59:08.808 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-29T01:59:08.809 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-29T01:59:08.809 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-29T01:59:08.809 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-29T01:59:08.809 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2023-07-29T01:59:08.810 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-29T01:59:08.810 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-29T01:59:08.810 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-29T01:59:08.810 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-29T01:59:08.830 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2023-07-29T01:59:08.833 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2023-07-29T01:59:08.833 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-29T01:59:08.913 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-29T01:59:08.983 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-29T01:59:09.050 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-29T01:59:09.051 INFO:tasks.ceph:role: osd.2 2023-07-29T01:59:09.051 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com 2023-07-29T01:59:09.051 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-29T01:59:09.117 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-29T01:59:09.117 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-29T01:59:09.118 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-29T01:59:09.118 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-29T01:59:09.118 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-29T01:59:09.118 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2023-07-29T01:59:09.119 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-29T01:59:09.119 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-29T01:59:09.119 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-29T01:59:09.119 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-29T01:59:09.139 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2023-07-29T01:59:09.141 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2023-07-29T01:59:09.141 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-29T01:59:09.221 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-29T01:59:09.292 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-29T01:59:09.360 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-29T01:59:09.360 INFO:tasks.ceph:role: osd.3 2023-07-29T01:59:09.360 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi042.front.sepia.ceph.com 2023-07-29T01:59:09.361 DEBUG:teuthology.orchestra.run.smithi042:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-29T01:59:09.427 INFO:teuthology.orchestra.run.smithi042.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-29T01:59:09.427 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-29T01:59:09.427 INFO:teuthology.orchestra.run.smithi042.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-29T01:59:09.427 INFO:teuthology.orchestra.run.smithi042.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-29T01:59:09.427 INFO:teuthology.orchestra.run.smithi042.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-29T01:59:09.428 INFO:teuthology.orchestra.run.smithi042.stdout: = sunit=0 swidth=0 blks 2023-07-29T01:59:09.428 INFO:teuthology.orchestra.run.smithi042.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-29T01:59:09.428 INFO:teuthology.orchestra.run.smithi042.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-29T01:59:09.428 INFO:teuthology.orchestra.run.smithi042.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-29T01:59:09.428 INFO:teuthology.orchestra.run.smithi042.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-29T01:59:09.450 INFO:teuthology.orchestra.run.smithi042.stdout:Discarding blocks...Done. 2023-07-29T01:59:09.451 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi042.front.sepia.ceph.com -o noatime 2023-07-29T01:59:09.452 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-29T01:59:09.532 DEBUG:teuthology.orchestra.run.smithi042:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-29T01:59:09.602 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-29T01:59:09.714 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:09.725+0000 7f50eda8b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-29T01:59:09.715 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:09.726+0000 7f50eda8b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-29T01:59:09.715 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:09.726+0000 7f50eda8b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-29T01:59:09.715 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:09.726+0000 7f50eda8b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-29T01:59:09.715 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:09.726+0000 7f50eda8b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-29T01:59:09.715 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:09.726+0000 7f50eda8b640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-29T01:59:12.579 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-29T01:59:12.612 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-29T01:59:12.707 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:12.718+0000 7f3303896640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-29T01:59:12.707 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:12.718+0000 7f3303896640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-29T01:59:12.707 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:12.718+0000 7f3303896640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-29T01:59:12.707 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:12.718+0000 7f3303896640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-29T01:59:12.707 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:12.718+0000 7f3303896640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-29T01:59:12.708 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:12.718+0000 7f3303896640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-29T01:59:15.575 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-29T01:59:15.608 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-29T01:59:15.703 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:15.714+0000 7fb61e790640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-29T01:59:15.703 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:15.714+0000 7fb61e790640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-29T01:59:15.703 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:15.714+0000 7fb61e790640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-29T01:59:15.703 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:15.714+0000 7fb61e790640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-29T01:59:15.704 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:15.714+0000 7fb61e790640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-29T01:59:15.704 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:15.714+0000 7fb61e790640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-29T01:59:18.562 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-29T01:59:18.595 DEBUG:teuthology.orchestra.run.smithi042:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-29T01:59:18.688 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:18.699+0000 7f33a3496640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-29T01:59:18.688 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:18.699+0000 7f33a3496640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-29T01:59:18.688 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:18.699+0000 7f33a3496640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-29T01:59:18.689 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:18.699+0000 7f33a3496640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-29T01:59:18.689 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:18.699+0000 7f33a3496640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-29T01:59:18.689 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:18.700+0000 7f33a3496640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-29T01:59:21.548 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-29T01:59:21.581 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-29T01:59:21.613 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-29T01:59:21.613 INFO:tasks.ceph:role: osd.4 2023-07-29T01:59:21.613 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com 2023-07-29T01:59:21.614 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-29T01:59:21.692 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-29T01:59:21.692 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-29T01:59:21.692 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-29T01:59:21.692 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-29T01:59:21.693 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-29T01:59:21.693 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-07-29T01:59:21.693 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-29T01:59:21.693 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-29T01:59:21.693 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-29T01:59:21.694 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-29T01:59:22.128 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-07-29T01:59:22.129 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-07-29T01:59:22.130 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-29T01:59:22.287 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-29T01:59:22.325 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-29T01:59:22.395 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-29T01:59:22.396 INFO:tasks.ceph:role: osd.5 2023-07-29T01:59:22.396 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com 2023-07-29T01:59:22.397 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-29T01:59:22.471 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-29T01:59:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-29T01:59:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-29T01:59:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-29T01:59:22.472 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-29T01:59:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-07-29T01:59:22.472 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-29T01:59:22.472 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-29T01:59:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-29T01:59:22.473 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-29T01:59:22.887 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-07-29T01:59:22.889 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-07-29T01:59:22.889 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-29T01:59:23.002 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-29T01:59:23.035 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-29T01:59:23.103 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-29T01:59:23.104 INFO:tasks.ceph:role: osd.6 2023-07-29T01:59:23.104 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com 2023-07-29T01:59:23.104 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-29T01:59:23.178 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-29T01:59:23.179 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-29T01:59:23.179 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-29T01:59:23.179 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-29T01:59:23.179 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-29T01:59:23.179 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-07-29T01:59:23.179 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-29T01:59:23.179 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-29T01:59:23.180 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-29T01:59:23.180 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-29T01:59:23.633 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-07-29T01:59:23.635 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-07-29T01:59:23.635 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-29T01:59:23.804 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-29T01:59:23.836 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-29T01:59:23.904 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-29T01:59:23.904 INFO:tasks.ceph:role: osd.7 2023-07-29T01:59:23.904 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi144.front.sepia.ceph.com 2023-07-29T01:59:23.905 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-29T01:59:23.978 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-29T01:59:23.978 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-29T01:59:23.978 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-29T01:59:23.978 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-29T01:59:23.978 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-29T01:59:23.978 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2023-07-29T01:59:23.979 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-29T01:59:23.979 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-29T01:59:23.979 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-29T01:59:23.979 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-29T01:59:24.407 INFO:teuthology.orchestra.run.smithi144.stdout:Discarding blocks...Done. 2023-07-29T01:59:24.409 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2023-07-29T01:59:24.409 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-29T01:59:24.571 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-29T01:59:24.606 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-29T01:59:24.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:24.730+0000 7f138a172640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-29T01:59:24.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:24.730+0000 7f138a172640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-29T01:59:24.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:24.730+0000 7f138a172640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-29T01:59:24.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:24.730+0000 7f138a172640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-29T01:59:24.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:24.730+0000 7f138a172640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-29T01:59:24.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:24.731+0000 7f138a172640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-29T01:59:27.589 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-29T01:59:27.619 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-29T01:59:27.712 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:27.723+0000 7f57f6ef8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-29T01:59:27.713 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:27.724+0000 7f57f6ef8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-29T01:59:27.713 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:27.724+0000 7f57f6ef8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-29T01:59:27.713 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:27.724+0000 7f57f6ef8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-29T01:59:27.713 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:27.724+0000 7f57f6ef8640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-29T01:59:27.713 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:27.724+0000 7f57f6ef8640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-29T01:59:30.574 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-29T01:59:30.605 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-29T01:59:30.697 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:30.708+0000 7fa49ed24640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-29T01:59:30.697 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:30.709+0000 7fa49ed24640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-29T01:59:30.698 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:30.709+0000 7fa49ed24640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-29T01:59:30.698 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:30.709+0000 7fa49ed24640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-29T01:59:30.698 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:30.709+0000 7fa49ed24640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-29T01:59:30.698 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:30.709+0000 7fa49ed24640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-29T01:59:33.559 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-29T01:59:33.590 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-29T01:59:33.684 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:33.696+0000 7f3d669e1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-29T01:59:33.685 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:33.696+0000 7f3d669e1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-29T01:59:33.685 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:33.696+0000 7f3d669e1640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-29T01:59:33.685 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:33.696+0000 7f3d669e1640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-29T01:59:33.685 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:33.696+0000 7f3d669e1640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-29T01:59:33.685 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:33.697+0000 7f3d669e1640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-29T01:59:35.043 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T01:59:35.045 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T01:59:36.551 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-29T01:59:36.581 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-29T01:59:36.581 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:59:36.581 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-29T01:59:36.614 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:59:36.615 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-29T01:59:36.687 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:59:36.688 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-29T01:59:36.760 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:59:36.761 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2023-07-29T01:59:36.834 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:59:36.834 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-29T01:59:36.905 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:59:36.905 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-29T01:59:36.976 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:59:36.976 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-29T01:59:37.046 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:59:37.046 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-29T01:59:37.116 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:59:37.117 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-29T01:59:37.149 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:59:37.149 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-29T01:59:37.218 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:59:37.218 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-29T01:59:37.287 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:59:37.288 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2023-07-29T01:59:37.357 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:59:37.357 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-29T01:59:37.426 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:59:37.426 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-29T01:59:37.494 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:59:37.495 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-29T01:59:37.560 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:59:37.561 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-29T01:59:37.626 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:59:37.627 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-29T01:59:37.647 INFO:tasks.ceph:Adding keys to all mons... 2023-07-29T01:59:37.647 DEBUG:teuthology.orchestra.run.smithi042:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-29T01:59:37.689 DEBUG:teuthology.orchestra.run.smithi144:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-29T01:59:37.714 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.y] 2023-07-29T01:59:37.715 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBrcsRkjAZgJBAAY0ovlFVIaaEvOE84SgbeQw== 2023-07-29T01:59:37.715 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2023-07-29T01:59:37.715 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBrcsRk70MKLBAAzsC6C96HNNHvXGGQc38giQ== 2023-07-29T01:59:37.715 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.c] 2023-07-29T01:59:37.715 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBrcsRkSNWDMxAAOd7zkOYzOAWnFKw8ZTpyeA== 2023-07-29T01:59:37.715 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.e] 2023-07-29T01:59:37.716 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBrcsRkD9EWOxAAYp9R4yaImmr2lNHkp7XFWQ== 2023-07-29T01:59:37.716 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.0] 2023-07-29T01:59:37.716 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBtcsRkHY5UKxAAz7kTJ5+jQA43UZDMZcAfyg== 2023-07-29T01:59:37.716 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.1] 2023-07-29T01:59:37.716 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBwcsRkaCzcKhAAkRE4lDHRHzmxVNwlDRdsfw== 2023-07-29T01:59:37.716 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.2] 2023-07-29T01:59:37.716 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBzcsRkMv6kKhAAi7VF5GwRFV1lQCsqWUQdKw== 2023-07-29T01:59:37.717 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.3] 2023-07-29T01:59:37.717 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQB2csRkh4nAKRAABCZR8apSPZxWxb03LkVtQg== 2023-07-29T01:59:37.717 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr.x] 2023-07-29T01:59:37.717 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBrcsRk4HiRKBAAXBjaeiwBFc9oEX03EahFLw== 2023-07-29T01:59:37.717 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.b] 2023-07-29T01:59:37.717 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBscsRkV2OxBBAAgpKn6yDv9EXFxoIfgrbivg== 2023-07-29T01:59:37.717 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.d] 2023-07-29T01:59:37.718 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBscsRk1MMNDBAAjOy6k2uGpU7uG/wzciRWYw== 2023-07-29T01:59:37.718 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.f] 2023-07-29T01:59:37.718 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBscsRkU89FExAAl/aIQrTbisLdgLm7VzYjNg== 2023-07-29T01:59:37.718 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.4] 2023-07-29T01:59:37.718 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQB8csRkty+bKxAARx/YhG0tNcnnboGaL8n6Yg== 2023-07-29T01:59:37.718 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.5] 2023-07-29T01:59:37.718 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQB/csRkpVA4KxAA9pmhLQTXf1RC4wlQsOoSSg== 2023-07-29T01:59:37.718 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.6] 2023-07-29T01:59:37.719 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCCcsRktFNRKhAAomoyAr4AqBAdg7RhfosbkA== 2023-07-29T01:59:37.719 INFO:teuthology.orchestra.run.smithi144.stdout:[osd.7] 2023-07-29T01:59:37.719 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQCFcsRkH52QKRAAWpvoUgjC6sKGkAmn7JknJQ== 2023-07-29T01:59:37.719 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2023-07-29T01:59:37.719 INFO:teuthology.orchestra.run.smithi144.stdout: key = AQBscsRkLSHOFxAALtaC1FggAXDorsyUIixU1A== 2023-07-29T01:59:37.720 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr.y] 2023-07-29T01:59:37.720 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBrcsRkjAZgJBAAY0ovlFVIaaEvOE84SgbeQw== 2023-07-29T01:59:37.721 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.a] 2023-07-29T01:59:37.721 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBrcsRk70MKLBAAzsC6C96HNNHvXGGQc38giQ== 2023-07-29T01:59:37.721 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.c] 2023-07-29T01:59:37.721 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBrcsRkSNWDMxAAOd7zkOYzOAWnFKw8ZTpyeA== 2023-07-29T01:59:37.721 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.e] 2023-07-29T01:59:37.721 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBrcsRkD9EWOxAAYp9R4yaImmr2lNHkp7XFWQ== 2023-07-29T01:59:37.722 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.0] 2023-07-29T01:59:37.722 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBtcsRkHY5UKxAAz7kTJ5+jQA43UZDMZcAfyg== 2023-07-29T01:59:37.722 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.1] 2023-07-29T01:59:37.722 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBwcsRkaCzcKhAAkRE4lDHRHzmxVNwlDRdsfw== 2023-07-29T01:59:37.722 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.2] 2023-07-29T01:59:37.722 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBzcsRkMv6kKhAAi7VF5GwRFV1lQCsqWUQdKw== 2023-07-29T01:59:37.722 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.3] 2023-07-29T01:59:37.722 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQB2csRkh4nAKRAABCZR8apSPZxWxb03LkVtQg== 2023-07-29T01:59:37.723 INFO:teuthology.orchestra.run.smithi042.stdout:[mgr.x] 2023-07-29T01:59:37.723 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBrcsRk4HiRKBAAXBjaeiwBFc9oEX03EahFLw== 2023-07-29T01:59:37.723 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.b] 2023-07-29T01:59:37.723 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBscsRkV2OxBBAAgpKn6yDv9EXFxoIfgrbivg== 2023-07-29T01:59:37.723 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.d] 2023-07-29T01:59:37.723 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBscsRk1MMNDBAAjOy6k2uGpU7uG/wzciRWYw== 2023-07-29T01:59:37.723 INFO:teuthology.orchestra.run.smithi042.stdout:[mds.f] 2023-07-29T01:59:37.724 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBscsRkU89FExAAl/aIQrTbisLdgLm7VzYjNg== 2023-07-29T01:59:37.724 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.4] 2023-07-29T01:59:37.724 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQB8csRkty+bKxAARx/YhG0tNcnnboGaL8n6Yg== 2023-07-29T01:59:37.724 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.5] 2023-07-29T01:59:37.724 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQB/csRkpVA4KxAA9pmhLQTXf1RC4wlQsOoSSg== 2023-07-29T01:59:37.724 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.6] 2023-07-29T01:59:37.724 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCCcsRktFNRKhAAomoyAr4AqBAdg7RhfosbkA== 2023-07-29T01:59:37.724 INFO:teuthology.orchestra.run.smithi042.stdout:[osd.7] 2023-07-29T01:59:37.725 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQCFcsRkH52QKRAAWpvoUgjC6sKGkAmn7JknJQ== 2023-07-29T01:59:37.725 INFO:teuthology.orchestra.run.smithi042.stdout:[client.0] 2023-07-29T01:59:37.725 INFO:teuthology.orchestra.run.smithi042.stdout: key = AQBscsRkLSHOFxAALtaC1FggAXDorsyUIixU1A== 2023-07-29T01:59:37.725 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-29T01:59:37.763 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-29T01:59:37.823 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-29T01:59:37.826 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-29T01:59:37.884 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-29T01:59:37.886 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-29T01:59:37.943 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-29T01:59:37.945 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-29T01:59:38.001 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T01:59:38.003 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T01:59:38.055 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T01:59:38.057 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T01:59:38.109 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T01:59:38.112 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T01:59:38.164 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T01:59:38.167 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T01:59:38.220 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-29T01:59:38.222 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-29T01:59:38.275 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-29T01:59:38.277 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-29T01:59:38.333 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-29T01:59:38.335 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-29T01:59:38.390 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-29T01:59:38.392 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-29T01:59:38.448 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T01:59:38.450 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T01:59:38.503 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T01:59:38.505 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T01:59:38.558 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T01:59:38.560 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T01:59:38.613 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T01:59:38.615 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-29T01:59:38.668 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-29T01:59:38.670 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-29T01:59:38.726 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-29T01:59:38.726 DEBUG:teuthology.orchestra.run.smithi042:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-29T01:59:38.753 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-29T01:59:38.853 DEBUG:teuthology.orchestra.run.smithi042:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-29T01:59:38.880 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-29T01:59:38.907 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-29T01:59:39.004 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-29T01:59:39.031 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-29T01:59:39.097 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-29T01:59:39.195 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-29T01:59:39.221 DEBUG:teuthology.orchestra.run.smithi042:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-29T01:59:39.223 DEBUG:teuthology.orchestra.run.smithi144:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-29T01:59:39.277 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-29T01:59:39.277 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-29T01:59:39.278 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-29T01:59:39.281 INFO:tasks.ceph.mon.a:Started 2023-07-29T01:59:39.281 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-29T01:59:39.281 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-29T01:59:39.319 INFO:tasks.ceph.mon.b:Started 2023-07-29T01:59:39.319 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-29T01:59:39.320 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-29T01:59:39.321 INFO:tasks.ceph.mon.c:Started 2023-07-29T01:59:39.321 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-29T01:59:39.322 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-29T01:59:39.322 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-29T01:59:39.324 INFO:tasks.ceph.mgr.y:Started 2023-07-29T01:59:39.324 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-29T01:59:39.325 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-29T01:59:39.326 INFO:tasks.ceph.mgr.x:Started 2023-07-29T01:59:39.327 INFO:tasks.ceph:Setting crush tunables to default 2023-07-29T01:59:39.327 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd crush tunables default 2023-07-29T01:59:39.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.466+0000 7ff1fffa7700 1 Processor -- start 2023-07-29T01:59:39.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.466+0000 7ff1fffa7700 1 -- start start 2023-07-29T01:59:39.456 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.467+0000 7ff1fffa7700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff1f814fc20 0x7ff1f80c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:39.456 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.467+0000 7ff1fffa7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1f806b860 0x7ff1f806bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:39.456 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.467+0000 7ff1fffa7700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f80c91b0 con 0x7ff1f814fff0 2023-07-29T01:59:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.467+0000 7ff1fffa7700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f81592f0 con 0x7ff1f814fc20 2023-07-29T01:59:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.467+0000 7ff1fffa7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f81595d0 con 0x7ff1f806b860 2023-07-29T01:59:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.467+0000 7ff1fd542700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff1f814fff0 0x7ff1f8070b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:48842/0 (socket says 172.21.15.42:48842) 2023-07-29T01:59:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.467+0000 7ff1fd542700 1 -- 172.21.15.42:0/1707137766 learned_addr learned my addr 172.21.15.42:0/1707137766 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T01:59:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.468+0000 7ff1fe544700 1 --2- 172.21.15.42:0/1707137766 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1f806b860 0x7ff1f806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.468+0000 7ff1fdd43700 1 --2- 172.21.15.42:0/1707137766 >> v2:172.21.15.144:3300/0 conn(0x7ff1f814fc20 0x7ff1f80c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:39.457 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.468+0000 7ff1fdd43700 1 -- 172.21.15.42:0/1707137766 >> v2:172.21.15.144:3300/0 conn(0x7ff1f814fc20 msgr2=0x7ff1f80c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-29T01:59:39.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.468+0000 7ff1fdd43700 1 -- 172.21.15.42:0/1707137766 >> v2:172.21.15.144:3300/0 conn(0x7ff1f814fc20 msgr2=0x7ff1f80c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-29T01:59:39.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.468+0000 7ff1fe544700 1 -- 172.21.15.42:0/1707137766 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1f806b860 msgr2=0x7ff1f806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-29T01:59:39.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.468+0000 7ff1fdd43700 1 --2- 172.21.15.42:0/1707137766 >> v2:172.21.15.144:3300/0 conn(0x7ff1f814fc20 0x7ff1f80c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-29T01:59:39.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.468+0000 7ff1fe544700 1 -- 172.21.15.42:0/1707137766 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1f806b860 msgr2=0x7ff1f806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-29T01:59:39.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.468+0000 7ff1fe544700 1 --2- 172.21.15.42:0/1707137766 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1f806b860 0x7ff1f806bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-29T01:59:39.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.468+0000 7ff1fdd43700 1 --2- 172.21.15.42:0/1707137766 >> v2:172.21.15.144:3300/0 conn(0x7ff1f814fc20 0x7ff1f80c8920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-29T01:59:39.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.468+0000 7ff1fe544700 1 --2- 172.21.15.42:0/1707137766 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1f806b860 0x7ff1f806bce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-29T01:59:39.632 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.642+0000 7ff1fcd41700 1 -- 172.21.15.42:0/1707137766 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790796760 0 0) 0x7ff1f80c91b0 con 0x7ff1f814fff0 2023-07-29T01:59:39.633 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.642+0000 7ff1fcd41700 1 -- 172.21.15.42:0/1707137766 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1e40035b0 con 0x7ff1f814fff0 2023-07-29T01:59:39.633 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.642+0000 7ff1fcd41700 1 -- 172.21.15.42:0/1707137766 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1537342040 0 0) 0x7ff1e40035b0 con 0x7ff1f814fff0 2023-07-29T01:59:39.633 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.642+0000 7ff1fcd41700 1 -- 172.21.15.42:0/1707137766 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1f806b860 msgr2=0x7ff1f806bce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-29T01:59:39.633 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.642+0000 7ff1fcd41700 1 --2- 172.21.15.42:0/1707137766 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1f806b860 0x7ff1f806bce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:39.633 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.642+0000 7ff1fcd41700 1 -- 172.21.15.42:0/1707137766 >> v2:172.21.15.144:3300/0 conn(0x7ff1f814fc20 msgr2=0x7ff1f80c8920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-29T01:59:39.633 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.642+0000 7ff1fcd41700 1 --2- 172.21.15.42:0/1707137766 >> v2:172.21.15.144:3300/0 conn(0x7ff1f814fc20 0x7ff1f80c8920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:39.633 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.642+0000 7ff1fcd41700 1 -- 172.21.15.42:0/1707137766 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f81598b0 con 0x7ff1f814fff0 2023-07-29T01:59:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.642+0000 7ff1fcd41700 1 -- 172.21.15.42:0/1707137766 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7ff1e8001670 con 0x7ff1f814fff0 2023-07-29T01:59:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.643+0000 7ff1fcd41700 1 -- 172.21.15.42:0/1707137766 >> v1:172.21.15.42:6789/0 conn(0x7ff1f814fff0 legacy=0x7ff1f8070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.643+0000 7ff1fcd41700 1 --2- 172.21.15.42:0/1707137766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4003a00 0x7ff1e4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.643+0000 7ff1fcd41700 1 --2- 172.21.15.42:0/1707137766 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1f806b860 0x7ff1e4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.643+0000 7ff1fcd41700 1 --2- 172.21.15.42:0/1707137766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1e4004d90 0x7ff1e4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.643+0000 7ff1fcd41700 1 -- 172.21.15.42:0/1707137766 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f81592f0 con 0x7ff1e4003a00 2023-07-29T01:59:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.643+0000 7ff1fcd41700 1 -- 172.21.15.42:0/1707137766 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f81595d0 con 0x7ff1e4004d90 2023-07-29T01:59:39.634 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.643+0000 7ff1fcd41700 1 -- 172.21.15.42:0/1707137766 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e400dcd0 con 0x7ff1f806b860 2023-07-29T01:59:39.635 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.643+0000 7ff1fdd43700 1 --2- 172.21.15.42:0/1707137766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4003a00 0x7ff1e4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:39.635 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.643+0000 7ff1fd542700 1 --2- 172.21.15.42:0/1707137766 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1f806b860 0x7ff1e4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:39.635 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.643+0000 7ff1fe544700 1 --2- 172.21.15.42:0/1707137766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1e4004d90 0x7ff1e4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:39.635 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.643+0000 7ff1fdd43700 1 -- 172.21.15.42:0/1707137766 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1f806b860 msgr2=0x7ff1e4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:39.635 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.643+0000 7ff1fdd43700 1 --2- 172.21.15.42:0/1707137766 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1f806b860 0x7ff1e4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:39.635 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.643+0000 7ff1fdd43700 1 -- 172.21.15.42:0/1707137766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1e4004d90 msgr2=0x7ff1e4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:39.635 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.643+0000 7ff1fdd43700 1 --2- 172.21.15.42:0/1707137766 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1e4004d90 0x7ff1e4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:39.636 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.643+0000 7ff1fdd43700 1 -- 172.21.15.42:0/1707137766 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e40035b0 con 0x7ff1e4003a00 2023-07-29T01:59:39.636 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.643+0000 7ff1fdd43700 1 --2- 172.21.15.42:0/1707137766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4003a00 0x7ff1e4003e10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009fd0 tx=0x7ff1e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa08bbfd9ee0fa7 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:39.636 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.643+0000 7ff1fcd41700 1 -- 172.21.15.42:0/1707137766 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0007e20 con 0x7ff1e4003a00 2023-07-29T01:59:39.636 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.643+0000 7ff1fcd41700 1 -- 172.21.15.42:0/1707137766 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f0003a20 con 0x7ff1e4003a00 2023-07-29T01:59:39.636 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.643+0000 7ff1fcd41700 1 -- 172.21.15.42:0/1707137766 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0003dd0 con 0x7ff1e4003a00 2023-07-29T01:59:39.636 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.644+0000 7ff1fffa7700 1 -- 172.21.15.42:0/1707137766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4003a00 msgr2=0x7ff1e4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:39.636 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.644+0000 7ff1fffa7700 1 --2- 172.21.15.42:0/1707137766 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4003a00 0x7ff1e4003e10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009fd0 tx=0x7ff1e4005880 comp rx=0 tx=0).stop 2023-07-29T01:59:39.637 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.644+0000 7ff1fe544700 1 -- 172.21.15.42:0/1707137766 reap_dead start 2023-07-29T01:59:39.637 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.644+0000 7ff1fffa7700 1 -- 172.21.15.42:0/1707137766 shutdown_connections 2023-07-29T01:59:39.637 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.644+0000 7ff1fffa7700 1 -- 172.21.15.42:0/1707137766 >> 172.21.15.42:0/1707137766 conn(0x7ff1f80cc420 msgr2=0x7ff1f80c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:39.642 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.644+0000 7ff1fffa7700 1 -- 172.21.15.42:0/1707137766 shutdown_connections 2023-07-29T01:59:39.642 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.644+0000 7ff1fffa7700 1 -- 172.21.15.42:0/1707137766 wait complete. 2023-07-29T01:59:39.642 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.646+0000 7ff1fffa7700 1 Processor -- start 2023-07-29T01:59:39.642 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.646+0000 7ff1fffa7700 1 -- start start 2023-07-29T01:59:39.643 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.646+0000 7ff1fffa7700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4003a00 0x7ff1f81ed740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:39.643 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.646+0000 7ff1fffa7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1f80c2360 0x7ff1f8143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:39.643 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.646+0000 7ff1fffa7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1f80ca8b0 0x7ff1f81437a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:39.643 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.646+0000 7ff1fffa7700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f80c9810 con 0x7ff1e4003a00 2023-07-29T01:59:39.643 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.646+0000 7ff1fffa7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f814a3c0 con 0x7ff1f80c2360 2023-07-29T01:59:39.643 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.646+0000 7ff1fffa7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f80c9df0 con 0x7ff1f80ca8b0 2023-07-29T01:59:39.643 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.646+0000 7ff1fdd43700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4003a00 0x7ff1f81ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:39.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.647+0000 7ff1fdd43700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4003a00 0x7ff1f81ed740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55056/0 (socket says 172.21.15.42:55056) 2023-07-29T01:59:39.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.647+0000 7ff1fdd43700 1 -- 172.21.15.42:0/2477521871 learned_addr learned my addr 172.21.15.42:0/2477521871 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:39.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.647+0000 7ff1fe544700 1 --2- 172.21.15.42:0/2477521871 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1f80ca8b0 0x7ff1f81437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:39.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.647+0000 7ff1fd542700 1 --2- 172.21.15.42:0/2477521871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1f80c2360 0x7ff1f8143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:39.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.647+0000 7ff1fdd43700 1 -- 172.21.15.42:0/2477521871 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1f80ca8b0 msgr2=0x7ff1f81437a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:39.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.647+0000 7ff1fdd43700 1 --2- 172.21.15.42:0/2477521871 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1f80ca8b0 0x7ff1f81437a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:39.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.647+0000 7ff1fdd43700 1 -- 172.21.15.42:0/2477521871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1f80c2360 msgr2=0x7ff1f8143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:39.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.647+0000 7ff1fdd43700 1 --2- 172.21.15.42:0/2477521871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1f80c2360 0x7ff1f8143260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:39.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.647+0000 7ff1fdd43700 1 -- 172.21.15.42:0/2477521871 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f814c820 con 0x7ff1e4003a00 2023-07-29T01:59:39.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.647+0000 7ff1fe544700 1 --2- 172.21.15.42:0/2477521871 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1f80ca8b0 0x7ff1f81437a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T01:59:39.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.647+0000 7ff1fdd43700 1 --2- 172.21.15.42:0/2477521871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4003a00 0x7ff1f81ed740 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009a10 tx=0x7ff1f0004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:39.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.647+0000 7ff1ee7fc700 1 -- 172.21.15.42:0/2477521871 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0004470 con 0x7ff1e4003a00 2023-07-29T01:59:39.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.647+0000 7ff1ee7fc700 1 -- 172.21.15.42:0/2477521871 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f00045f0 con 0x7ff1e4003a00 2023-07-29T01:59:39.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.647+0000 7ff1fffa7700 1 -- 172.21.15.42:0/2477521871 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f814cb00 con 0x7ff1e4003a00 2023-07-29T01:59:39.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.647+0000 7ff1ee7fc700 1 -- 172.21.15.42:0/2477521871 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f001f440 con 0x7ff1e4003a00 2023-07-29T01:59:39.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.647+0000 7ff1fffa7700 1 -- 172.21.15.42:0/2477521871 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f80ca390 con 0x7ff1e4003a00 2023-07-29T01:59:39.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.647+0000 7ff1ee7fc700 1 -- 172.21.15.42:0/2477521871 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff1f001f8a0 con 0x7ff1e4003a00 2023-07-29T01:59:39.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.647+0000 7ff1ee7fc700 1 -- 172.21.15.42:0/2477521871 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff1f0028ac0 con 0x7ff1e4003a00 2023-07-29T01:59:39.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.648+0000 7ff1fffa7700 1 -- 172.21.15.42:0/2477521871 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f804ea50 con 0x7ff1e4003a00 2023-07-29T01:59:39.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.651+0000 7ff1ee7fc700 1 -- 172.21.15.42:0/2477521871 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7ff1f002d060 con 0x7ff1e4003a00 2023-07-29T01:59:39.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.729+0000 7ff1fffa7700 1 -- 172.21.15.42:0/2477521871 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff1f8153610 con 0x7ff1e4003a00 2023-07-29T01:59:39.719 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.731+0000 7ff1ee7fc700 1 -- 172.21.15.42:0/2477521871 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff1f0023030 con 0x7ff1e4003a00 2023-07-29T01:59:39.720 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.732+0000 7ff1fffa7700 1 -- 172.21.15.42:0/2477521871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4003a00 msgr2=0x7ff1f81ed740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:39.721 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.732+0000 7ff1fffa7700 1 --2- 172.21.15.42:0/2477521871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4003a00 0x7ff1f81ed740 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009a10 tx=0x7ff1f0004b40 comp rx=0 tx=0).stop 2023-07-29T01:59:39.721 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.732+0000 7ff1fffa7700 1 -- 172.21.15.42:0/2477521871 shutdown_connections 2023-07-29T01:59:39.721 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.732+0000 7ff1fffa7700 1 --2- 172.21.15.42:0/2477521871 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff1f80ca8b0 0x7ff1f81437a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:39.721 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.732+0000 7ff1fffa7700 1 --2- 172.21.15.42:0/2477521871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff1e4003a00 0x7ff1f81ed740 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:39.721 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.732+0000 7ff1fffa7700 1 --2- 172.21.15.42:0/2477521871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1f80c2360 0x7ff1f8143260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:39.721 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.732+0000 7ff1fffa7700 1 -- 172.21.15.42:0/2477521871 >> 172.21.15.42:0/2477521871 conn(0x7ff1f80cc420 msgr2=0x7ff1f80c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:39.722 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.732+0000 7ff1fffa7700 1 -- 172.21.15.42:0/2477521871 shutdown_connections 2023-07-29T01:59:39.722 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:39.732+0000 7ff1fffa7700 1 -- 172.21.15.42:0/2477521871 wait complete. 2023-07-29T01:59:39.722 INFO:teuthology.orchestra.run.smithi042.stderr:adjusted tunables profile to default 2023-07-29T01:59:39.732 INFO:tasks.ceph:check_enable_crimson: False 2023-07-29T01:59:39.733 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-29T01:59:39.733 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:59:39.733 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-29T01:59:39.748 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:39.760+0000 7f97f03a5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-29T01:59:39.760 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:59:39.760 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-29T01:59:39.762 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:39.774+0000 7f037bb9f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-29T01:59:39.788 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:59:39.788 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-29T01:59:39.813 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:39.824+0000 7f97f03a5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-29T01:59:39.835 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:39.847+0000 7f037bb9f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-29T01:59:39.855 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T01:59:39.855 DEBUG:teuthology.orchestra.run.smithi042:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-29T01:59:39.887 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:39.898+0000 7f97f03a5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-29T01:59:39.920 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:39.932+0000 7f037bb9f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-29T01:59:39.923 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:59:39.923 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-29T01:59:39.949 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:59:39.950 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-29T01:59:39.967 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:39.978+0000 7f97f03a5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-29T01:59:39.992 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:59:39.992 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-29T01:59:40.003 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:40.015+0000 7f037bb9f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-29T01:59:40.057 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2023-07-29T01:59:40.058 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-29T01:59:40.116 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:40.128+0000 7f97f03a5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-29T01:59:40.125 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new fdf64905-a76d-4d05-b23e-22a6d0792e2d 0 2023-07-29T01:59:40.153 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:40.164+0000 7f037bb9f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-29T01:59:40.286 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.297+0000 7f7c46f15700 1 Processor -- start 2023-07-29T01:59:40.286 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.297+0000 7f7c46f15700 1 -- start start 2023-07-29T01:59:40.288 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.298+0000 7f7c46f15700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7c401531a0 0x7f7c4006f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:40.288 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.298+0000 7f7c46f15700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7c40071840 0x7f7c4006a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:40.288 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.298+0000 7f7c46f15700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c4006c870 con 0x7f7c400c8580 2023-07-29T01:59:40.288 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.298+0000 7f7c46f15700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c400c74a0 con 0x7f7c401531a0 2023-07-29T01:59:40.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.298+0000 7f7c46f15700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4006fa50 con 0x7f7c40071840 2023-07-29T01:59:40.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.298+0000 7f7c454b2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7c40071840 0x7f7c4006a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:40.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.298+0000 7f7c454b2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7c40071840 0x7f7c4006a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:55570/0 (socket says 172.21.15.144:55570) 2023-07-29T01:59:40.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.298+0000 7f7c454b2700 1 -- 172.21.15.144:0/2148568899 learned_addr learned my addr 172.21.15.144:0/2148568899 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-07-29T01:59:40.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.298+0000 7f7c44cb1700 1 --2- 172.21.15.144:0/2148568899 >> v2:172.21.15.42:3300/0 conn(0x7f7c401531a0 0x7f7c4006f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:40.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.299+0000 7f7c454b2700 1 -- 172.21.15.144:0/2148568899 >> v2:172.21.15.42:3300/0 conn(0x7f7c401531a0 msgr2=0x7f7c4006f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:40.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.299+0000 7f7c454b2700 1 --2- 172.21.15.144:0/2148568899 >> v2:172.21.15.42:3300/0 conn(0x7f7c401531a0 0x7f7c4006f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.289 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.299+0000 7f7c454b2700 1 -- 172.21.15.144:0/2148568899 >> v1:172.21.15.144:6789/0 conn(0x7f7c400c8580 legacy=0x7f7c4015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.299+0000 7f7c454b2700 1 -- 172.21.15.144:0/2148568899 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4006d450 con 0x7f7c40071840 2023-07-29T01:59:40.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.299+0000 7f7c44cb1700 1 --2- 172.21.15.144:0/2148568899 >> v2:172.21.15.42:3300/0 conn(0x7f7c401531a0 0x7f7c4006f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T01:59:40.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.299+0000 7f7c454b2700 1 --2- 172.21.15.144:0/2148568899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c40071840 0x7f7c4006a750 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7c400b1bc0 tx=0x7f7c3800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5772c1dc0060fde4 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:40.290 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.299+0000 7f7c3f7fe700 1 -- 172.21.15.144:0/2148568899 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3800e070 con 0x7f7c40071840 2023-07-29T01:59:40.291 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.299+0000 7f7c3f7fe700 1 -- 172.21.15.144:0/2148568899 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3800b9c0 con 0x7f7c40071840 2023-07-29T01:59:40.291 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.299+0000 7f7c3f7fe700 1 -- 172.21.15.144:0/2148568899 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3800bd70 con 0x7f7c40071840 2023-07-29T01:59:40.291 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.299+0000 7f7c46f15700 1 -- 172.21.15.144:0/2148568899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c40071840 msgr2=0x7f7c4006a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.291 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.299+0000 7f7c46f15700 1 --2- 172.21.15.144:0/2148568899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c40071840 0x7f7c4006a750 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7c400b1bc0 tx=0x7f7c3800b330 comp rx=0 tx=0).stop 2023-07-29T01:59:40.291 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.299+0000 7f7c46f15700 1 -- 172.21.15.144:0/2148568899 shutdown_connections 2023-07-29T01:59:40.291 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.299+0000 7f7c46f15700 1 --2- 172.21.15.144:0/2148568899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c40071840 0x7f7c4006a750 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.291 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.299+0000 7f7c46f15700 1 --2- 172.21.15.144:0/2148568899 >> v2:172.21.15.42:3300/0 conn(0x7f7c401531a0 0x7f7c4006f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.291 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.299+0000 7f7c46f15700 1 -- 172.21.15.144:0/2148568899 >> 172.21.15.144:0/2148568899 conn(0x7f7c400cbf10 msgr2=0x7f7c400cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:40.292 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.300+0000 7f7c46f15700 1 -- 172.21.15.144:0/2148568899 shutdown_connections 2023-07-29T01:59:40.292 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.300+0000 7f7c46f15700 1 -- 172.21.15.144:0/2148568899 wait complete. 2023-07-29T01:59:40.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.301+0000 7f7c46f15700 1 Processor -- start 2023-07-29T01:59:40.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.301+0000 7f7c46f15700 1 -- start start 2023-07-29T01:59:40.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.301+0000 7f7c46f15700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c40071840 0x7f7c401e6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:40.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c46f15700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c400c8580 0x7f7c401537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:40.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c46f15700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c401531a0 0x7f7c401ef210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:40.294 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c46f15700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4015a070 con 0x7f7c40071840 2023-07-29T01:59:40.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c46f15700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c401eed10 con 0x7f7c401531a0 2023-07-29T01:59:40.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c46f15700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4014d300 con 0x7f7c400c8580 2023-07-29T01:59:40.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c454b2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c401531a0 0x7f7c401ef210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:40.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c3ffff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c400c8580 0x7f7c401537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:40.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c44cb1700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c40071840 0x7f7c401e6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:40.295 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c44cb1700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c40071840 0x7f7c401e6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.144:35262/0 (socket says 172.21.15.144:35262) 2023-07-29T01:59:40.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c44cb1700 1 -- 172.21.15.144:0/2387216528 learned_addr learned my addr 172.21.15.144:0/2387216528 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-07-29T01:59:40.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c454b2700 1 -- 172.21.15.144:0/2387216528 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c400c8580 msgr2=0x7f7c401537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c454b2700 1 --2- 172.21.15.144:0/2387216528 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c400c8580 0x7f7c401537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c454b2700 1 -- 172.21.15.144:0/2387216528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c40071840 msgr2=0x7f7c401e6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c454b2700 1 --2- 172.21.15.144:0/2387216528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c40071840 0x7f7c401e6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c454b2700 1 -- 172.21.15.144:0/2387216528 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c38009b30 con 0x7f7c401531a0 2023-07-29T01:59:40.296 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c3ffff700 1 --2- 172.21.15.144:0/2387216528 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c400c8580 0x7f7c401537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T01:59:40.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c454b2700 1 --2- 172.21.15.144:0/2387216528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c401531a0 0x7f7c401ef210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7c38015000 tx=0x7f7c38004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:40.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c3d7fa700 1 -- 172.21.15.144:0/2387216528 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c38004880 con 0x7f7c401531a0 2023-07-29T01:59:40.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c3d7fa700 1 -- 172.21.15.144:0/2387216528 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c380092e0 con 0x7f7c401531a0 2023-07-29T01:59:40.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c46f15700 1 -- 172.21.15.144:0/2387216528 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c4014d5e0 con 0x7f7c401531a0 2023-07-29T01:59:40.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c3d7fa700 1 -- 172.21.15.144:0/2387216528 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3801c660 con 0x7f7c401531a0 2023-07-29T01:59:40.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c46f15700 1 -- 172.21.15.144:0/2387216528 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4014dba0 con 0x7f7c401531a0 2023-07-29T01:59:40.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.302+0000 7f7c3d7fa700 1 -- 172.21.15.144:0/2387216528 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7c3801cac0 con 0x7f7c401531a0 2023-07-29T01:59:40.297 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.303+0000 7f7c3d7fa700 1 -- 172.21.15.144:0/2387216528 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7c38025be0 con 0x7f7c401531a0 2023-07-29T01:59:40.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.303+0000 7f7c46f15700 1 -- 172.21.15.144:0/2387216528 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c40152300 con 0x7f7c401531a0 2023-07-29T01:59:40.298 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.307+0000 7f7c3d7fa700 1 -- 172.21.15.144:0/2387216528 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f7c38020070 con 0x7f7c401531a0 2023-07-29T01:59:40.377 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.388+0000 7f7c46f15700 1 -- 172.21.15.144:0/2387216528 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fdf64905-a76d-4d05-b23e-22a6d0792e2d", "id": 0} v 0) v1 -- 0x7f7c4004ea50 con 0x7f7c401531a0 2023-07-29T01:59:40.382 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.394+0000 7f7c3d7fa700 1 -- 172.21.15.144:0/2387216528 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fdf64905-a76d-4d05-b23e-22a6d0792e2d", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7c3802e430 con 0x7f7c401531a0 2023-07-29T01:59:40.383 INFO:teuthology.orchestra.run.smithi144.stdout:0 2023-07-29T01:59:40.383 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.396+0000 7f7c46f15700 1 -- 172.21.15.144:0/2387216528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c401531a0 msgr2=0x7f7c401ef210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.384 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.396+0000 7f7c46f15700 1 --2- 172.21.15.144:0/2387216528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c401531a0 0x7f7c401ef210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7c38015000 tx=0x7f7c38004ad0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.384 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.396+0000 7f7c46f15700 1 -- 172.21.15.144:0/2387216528 shutdown_connections 2023-07-29T01:59:40.384 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.396+0000 7f7c46f15700 1 --2- 172.21.15.144:0/2387216528 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7c401531a0 0x7f7c401ef210 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.385 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.396+0000 7f7c46f15700 1 --2- 172.21.15.144:0/2387216528 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7c40071840 0x7f7c401e6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.385 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.396+0000 7f7c46f15700 1 --2- 172.21.15.144:0/2387216528 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7c400c8580 0x7f7c401537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.385 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.396+0000 7f7c46f15700 1 -- 172.21.15.144:0/2387216528 >> 172.21.15.144:0/2387216528 conn(0x7f7c400cbf10 msgr2=0x7f7c4006a750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:40.385 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.396+0000 7f7c46f15700 1 -- 172.21.15.144:0/2387216528 shutdown_connections 2023-07-29T01:59:40.385 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.396+0000 7f7c46f15700 1 -- 172.21.15.144:0/2387216528 wait complete. 2023-07-29T01:59:40.395 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new e36fc394-42da-4732-87b2-b7fa6b2d4d0d 1 2023-07-29T01:59:40.469 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:40.480+0000 7f97f03a5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-29T01:59:40.502 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:40.513+0000 7f037bb9f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-29T01:59:40.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.526+0000 7f9d46e1d700 1 Processor -- start 2023-07-29T01:59:40.514 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.526+0000 7f9d46e1d700 1 -- start start 2023-07-29T01:59:40.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.527+0000 7f9d46e1d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9d400c20f0 0x7f9d400c2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:40.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.527+0000 7f9d46e1d700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d40159110 con 0x7f9d4015ced0 2023-07-29T01:59:40.516 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.527+0000 7f9d46e1d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d400c2a70 con 0x7f9d40153380 2023-07-29T01:59:40.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.527+0000 7f9d46e1d700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d40153750 con 0x7f9d400c20f0 2023-07-29T01:59:40.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.527+0000 7f9d44bb9700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9d40153380 0x7f9d400c7d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47970/0 (socket says 172.21.15.144:47970) 2023-07-29T01:59:40.517 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.527+0000 7f9d44bb9700 1 -- 172.21.15.144:0/1512365799 learned_addr learned my addr 172.21.15.144:0/1512365799 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-07-29T01:59:40.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.527+0000 7f9d453ba700 1 --2- 172.21.15.144:0/1512365799 >> v2:172.21.15.42:3300/0 conn(0x7f9d400c20f0 0x7f9d400c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:40.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.527+0000 7f9d3f7fe700 1 -- 172.21.15.144:0/1512365799 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951499681 0 0) 0x7f9d400c2a70 con 0x7f9d40153380 2023-07-29T01:59:40.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.527+0000 7f9d3f7fe700 1 -- 172.21.15.144:0/1512365799 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d300035b0 con 0x7f9d40153380 2023-07-29T01:59:40.518 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.527+0000 7f9d453ba700 1 -- 172.21.15.144:0/1512365799 >> v1:172.21.15.144:6789/0 conn(0x7f9d40153380 legacy=0x7f9d400c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.527+0000 7f9d453ba700 1 -- 172.21.15.144:0/1512365799 >> v1:172.21.15.42:6789/0 conn(0x7f9d4015ced0 legacy=0x7f9d400ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.527+0000 7f9d3f7fe700 1 -- 172.21.15.144:0/1512365799 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168614903 0 0) 0x7f9d40159110 con 0x7f9d4015ced0 2023-07-29T01:59:40.519 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.527+0000 7f9d453ba700 1 -- 172.21.15.144:0/1512365799 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d401593d0 con 0x7f9d400c20f0 2023-07-29T01:59:40.520 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.527+0000 7f9d453ba700 1 --2- 172.21.15.144:0/1512365799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d400c20f0 0x7f9d400c2530 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9d38009d90 tx=0x7f9d3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b999cc9b5a4255c server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:40.520 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.528+0000 7f9d3f7fe700 1 -- 172.21.15.144:0/1512365799 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3800e070 con 0x7f9d400c20f0 2023-07-29T01:59:40.520 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.528+0000 7f9d3f7fe700 1 -- 172.21.15.144:0/1512365799 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3800bb20 con 0x7f9d400c20f0 2023-07-29T01:59:40.521 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.528+0000 7f9d3f7fe700 1 -- 172.21.15.144:0/1512365799 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3800bed0 con 0x7f9d400c20f0 2023-07-29T01:59:40.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.528+0000 7f9d46e1d700 1 -- 172.21.15.144:0/1512365799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d400c20f0 msgr2=0x7f9d400c2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.528+0000 7f9d46e1d700 1 --2- 172.21.15.144:0/1512365799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d400c20f0 0x7f9d400c2530 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9d38009d90 tx=0x7f9d3800b330 comp rx=0 tx=0).stop 2023-07-29T01:59:40.525 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.528+0000 7f9d46e1d700 1 -- 172.21.15.144:0/1512365799 shutdown_connections 2023-07-29T01:59:40.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.528+0000 7f9d46e1d700 1 --2- 172.21.15.144:0/1512365799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d400c20f0 0x7f9d400c2530 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.528+0000 7f9d46e1d700 1 -- 172.21.15.144:0/1512365799 >> 172.21.15.144:0/1512365799 conn(0x7f9d40061190 msgr2=0x7f9d40061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:40.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.528+0000 7f9d46e1d700 1 -- 172.21.15.144:0/1512365799 shutdown_connections 2023-07-29T01:59:40.526 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.528+0000 7f9d46e1d700 1 -- 172.21.15.144:0/1512365799 wait complete. 2023-07-29T01:59:40.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.529+0000 7f9d46e1d700 1 Processor -- start 2023-07-29T01:59:40.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.529+0000 7f9d46e1d700 1 -- start start 2023-07-29T01:59:40.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.530+0000 7f9d46e1d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d400c20f0 0x7f9d40151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:40.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.530+0000 7f9d46e1d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d40153380 0x7f9d400c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:40.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.530+0000 7f9d46e1d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d4015ced0 0x7f9d4014b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:40.527 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.530+0000 7f9d46e1d700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d400c6f40 con 0x7f9d4015ced0 2023-07-29T01:59:40.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.530+0000 7f9d46e1d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d400c6b70 con 0x7f9d40153380 2023-07-29T01:59:40.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.530+0000 7f9d46e1d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d400c7150 con 0x7f9d400c20f0 2023-07-29T01:59:40.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.530+0000 7f9d3ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d40153380 0x7f9d400c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:40.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.530+0000 7f9d44bb9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d400c20f0 0x7f9d40151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:40.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.530+0000 7f9d3ffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d40153380 0x7f9d400c5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:55584/0 (socket says 172.21.15.144:55584) 2023-07-29T01:59:40.528 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.530+0000 7f9d3ffff700 1 -- 172.21.15.144:0/2687939470 learned_addr learned my addr 172.21.15.144:0/2687939470 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-07-29T01:59:40.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.530+0000 7f9d44bb9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d400c20f0 0x7f9d40151950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:33358/0 (socket says 172.21.15.144:33358) 2023-07-29T01:59:40.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.530+0000 7f9d453ba700 1 --2- 172.21.15.144:0/2687939470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d4015ced0 0x7f9d4014b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:40.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.531+0000 7f9d3ffff700 1 -- 172.21.15.144:0/2687939470 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d400c20f0 msgr2=0x7f9d40151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.531+0000 7f9d3ffff700 1 --2- 172.21.15.144:0/2687939470 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d400c20f0 0x7f9d40151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.531+0000 7f9d3ffff700 1 -- 172.21.15.144:0/2687939470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d4015ced0 msgr2=0x7f9d4014b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.531+0000 7f9d3ffff700 1 --2- 172.21.15.144:0/2687939470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d4015ced0 0x7f9d4014b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.529 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.531+0000 7f9d3ffff700 1 -- 172.21.15.144:0/2687939470 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d38009a70 con 0x7f9d40153380 2023-07-29T01:59:40.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.531+0000 7f9d453ba700 1 --2- 172.21.15.144:0/2687939470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d4015ced0 0x7f9d4014b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T01:59:40.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.531+0000 7f9d3ffff700 1 --2- 172.21.15.144:0/2687939470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d40153380 0x7f9d400c5250 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c00c550 tx=0x7f9d2c00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:40.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.531+0000 7f9d3d7fa700 1 -- 172.21.15.144:0/2687939470 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c0054e0 con 0x7f9d40153380 2023-07-29T01:59:40.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.531+0000 7f9d3d7fa700 1 -- 172.21.15.144:0/2687939470 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2c003680 con 0x7f9d40153380 2023-07-29T01:59:40.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.531+0000 7f9d46e1d700 1 -- 172.21.15.144:0/2687939470 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d401f2b40 con 0x7f9d40153380 2023-07-29T01:59:40.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.531+0000 7f9d3d7fa700 1 -- 172.21.15.144:0/2687939470 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c003a30 con 0x7f9d40153380 2023-07-29T01:59:40.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.531+0000 7f9d46e1d700 1 -- 172.21.15.144:0/2687939470 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4015bde0 con 0x7f9d40153380 2023-07-29T01:59:40.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.531+0000 7f9d3d7fa700 1 -- 172.21.15.144:0/2687939470 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9d2c01c440 con 0x7f9d40153380 2023-07-29T01:59:40.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.531+0000 7f9d3d7fa700 1 -- 172.21.15.144:0/2687939470 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f9d2c0127b0 con 0x7f9d40153380 2023-07-29T01:59:40.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.532+0000 7f9d46e1d700 1 -- 172.21.15.144:0/2687939470 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d40159940 con 0x7f9d40153380 2023-07-29T01:59:40.531 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.534+0000 7f9d3d7fa700 1 -- 172.21.15.144:0/2687939470 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f9d2c017070 con 0x7f9d40153380 2023-07-29T01:59:40.548 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:40.560+0000 7f97f03a5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-29T01:59:40.580 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:40.592+0000 7f037bb9f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-29T01:59:40.607 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.618+0000 7f9d46e1d700 1 -- 172.21.15.144:0/2687939470 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e36fc394-42da-4732-87b2-b7fa6b2d4d0d", "id": 1} v 0) v1 -- 0x7f9d4014e2b0 con 0x7f9d40153380 2023-07-29T01:59:40.612 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.624+0000 7f9d3d7fa700 1 -- 172.21.15.144:0/2687939470 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e36fc394-42da-4732-87b2-b7fa6b2d4d0d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9d2c01c9f0 con 0x7f9d40153380 2023-07-29T01:59:40.613 INFO:teuthology.orchestra.run.smithi144.stdout:1 2023-07-29T01:59:40.614 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.625+0000 7f9d46e1d700 1 -- 172.21.15.144:0/2687939470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d40153380 msgr2=0x7f9d400c5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.614 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.625+0000 7f9d46e1d700 1 --2- 172.21.15.144:0/2687939470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d40153380 0x7f9d400c5250 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c00c550 tx=0x7f9d2c00c860 comp rx=0 tx=0).stop 2023-07-29T01:59:40.614 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.625+0000 7f9d46e1d700 1 -- 172.21.15.144:0/2687939470 shutdown_connections 2023-07-29T01:59:40.614 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.625+0000 7f9d46e1d700 1 --2- 172.21.15.144:0/2687939470 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d4015ced0 0x7f9d4014b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.614 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.625+0000 7f9d46e1d700 1 --2- 172.21.15.144:0/2687939470 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d400c20f0 0x7f9d40151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.614 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.625+0000 7f9d46e1d700 1 --2- 172.21.15.144:0/2687939470 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d40153380 0x7f9d400c5250 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.615 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.625+0000 7f9d46e1d700 1 -- 172.21.15.144:0/2687939470 >> 172.21.15.144:0/2687939470 conn(0x7f9d40061190 msgr2=0x7f9d400c24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:40.615 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.625+0000 7f9d46e1d700 1 -- 172.21.15.144:0/2687939470 shutdown_connections 2023-07-29T01:59:40.615 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.625+0000 7f9d46e1d700 1 -- 172.21.15.144:0/2687939470 wait complete. 2023-07-29T01:59:40.626 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new b99ddaf3-1eae-419d-a886-c573ba210780 2 2023-07-29T01:59:40.686 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:40.698+0000 7f97f03a5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-29T01:59:40.727 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:40.739+0000 7f037bb9f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-29T01:59:40.746 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.758+0000 7f3082caf700 1 Processor -- start 2023-07-29T01:59:40.747 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.758+0000 7f3082caf700 1 -- start start 2023-07-29T01:59:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.759+0000 7f3082caf700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f307c14fff0 0x7f307c070b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.759+0000 7f3082caf700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f307c06b860 0x7f307c06bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:40.748 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.759+0000 7f3082caf700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f307c0c91b0 con 0x7f307c14fc20 2023-07-29T01:59:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.759+0000 7f3082caf700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f307c1592f0 con 0x7f307c06b860 2023-07-29T01:59:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.759+0000 7f3082caf700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f307c1595d0 con 0x7f307c14fff0 2023-07-29T01:59:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.759+0000 7f307bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f307c14fff0 0x7f307c070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.759+0000 7f307bfff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f307c14fff0 0x7f307c070b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:55590/0 (socket says 172.21.15.144:55590) 2023-07-29T01:59:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.759+0000 7f307bfff700 1 -- 172.21.15.144:0/609923372 learned_addr learned my addr 172.21.15.144:0/609923372 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-07-29T01:59:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.759+0000 7f308124c700 1 --2- 172.21.15.144:0/609923372 >> v2:172.21.15.42:3300/0 conn(0x7f307c06b860 0x7f307c06bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:40.749 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.759+0000 7f307bfff700 1 -- 172.21.15.144:0/609923372 >> v2:172.21.15.42:3300/0 conn(0x7f307c06b860 msgr2=0x7f307c06bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.759+0000 7f307bfff700 1 --2- 172.21.15.144:0/609923372 >> v2:172.21.15.42:3300/0 conn(0x7f307c06b860 0x7f307c06bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.759+0000 7f307bfff700 1 -- 172.21.15.144:0/609923372 >> v1:172.21.15.144:6789/0 conn(0x7f307c14fc20 legacy=0x7f307c0c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.759+0000 7f307bfff700 1 -- 172.21.15.144:0/609923372 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307c1598b0 con 0x7f307c14fff0 2023-07-29T01:59:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.759+0000 7f308124c700 1 --2- 172.21.15.144:0/609923372 >> v2:172.21.15.42:3300/0 conn(0x7f307c06b860 0x7f307c06bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T01:59:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.759+0000 7f307bfff700 1 --2- 172.21.15.144:0/609923372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f307c14fff0 0x7f307c070b00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f306800bb90 tx=0x7f306800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f6fe40958092925 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.760+0000 7f307b7fe700 1 -- 172.21.15.144:0/609923372 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306800dd10 con 0x7f307c14fff0 2023-07-29T01:59:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.760+0000 7f307b7fe700 1 -- 172.21.15.144:0/609923372 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306800de70 con 0x7f307c14fff0 2023-07-29T01:59:40.750 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.760+0000 7f307b7fe700 1 -- 172.21.15.144:0/609923372 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3068010670 con 0x7f307c14fff0 2023-07-29T01:59:40.751 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.760+0000 7f3082caf700 1 -- 172.21.15.144:0/609923372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f307c14fff0 msgr2=0x7f307c070b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.760+0000 7f3082caf700 1 --2- 172.21.15.144:0/609923372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f307c14fff0 0x7f307c070b00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f306800bb90 tx=0x7f306800bea0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.760+0000 7f3082caf700 1 -- 172.21.15.144:0/609923372 shutdown_connections 2023-07-29T01:59:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.760+0000 7f3082caf700 1 --2- 172.21.15.144:0/609923372 >> v2:172.21.15.42:3300/0 conn(0x7f307c06b860 0x7f307c06bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.760+0000 7f3082caf700 1 --2- 172.21.15.144:0/609923372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f307c14fff0 0x7f307c070b00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.760+0000 7f3082caf700 1 -- 172.21.15.144:0/609923372 >> 172.21.15.144:0/609923372 conn(0x7f307c0cc420 msgr2=0x7f307c0c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.760+0000 7f3082caf700 1 -- 172.21.15.144:0/609923372 shutdown_connections 2023-07-29T01:59:40.752 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.760+0000 7f3082caf700 1 -- 172.21.15.144:0/609923372 wait complete. 2023-07-29T01:59:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.762+0000 7f3082caf700 1 Processor -- start 2023-07-29T01:59:40.753 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.762+0000 7f3082caf700 1 -- start start 2023-07-29T01:59:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f3082caf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f307c06b860 0x7f307c149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:40.754 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f3082caf700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f307c14fc20 0x7f307c149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:40.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f3082caf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f307c14fff0 0x7f307c0ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:40.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f3082caf700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c158ce0 con 0x7f307c14fc20 2023-07-29T01:59:40.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f3082caf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307c158990 con 0x7f307c14fff0 2023-07-29T01:59:40.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f3082caf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307c149550 con 0x7f307c06b860 2023-07-29T01:59:40.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f308124c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f307c14fff0 0x7f307c0ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:40.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f3080a4b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f307c06b860 0x7f307c149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:40.755 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f308124c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f307c14fff0 0x7f307c0ca6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:55598/0 (socket says 172.21.15.144:55598) 2023-07-29T01:59:40.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f3080a4b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f307c06b860 0x7f307c149d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:33370/0 (socket says 172.21.15.144:33370) 2023-07-29T01:59:40.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f308124c700 1 -- 172.21.15.144:0/2703114530 learned_addr learned my addr 172.21.15.144:0/2703114530 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-07-29T01:59:40.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f307bfff700 1 --2- 172.21.15.144:0/2703114530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f307c14fc20 0x7f307c149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:40.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f308124c700 1 -- 172.21.15.144:0/2703114530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f307c06b860 msgr2=0x7f307c149d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f308124c700 1 --2- 172.21.15.144:0/2703114530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f307c06b860 0x7f307c149d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f308124c700 1 -- 172.21.15.144:0/2703114530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f307c14fc20 msgr2=0x7f307c149010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.756 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f308124c700 1 --2- 172.21.15.144:0/2703114530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f307c14fc20 0x7f307c149010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f308124c700 1 -- 172.21.15.144:0/2703114530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306800b7f0 con 0x7f307c14fff0 2023-07-29T01:59:40.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f308124c700 1 --2- 172.21.15.144:0/2703114530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f307c14fff0 0x7f307c0ca6f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3074007ef0 tx=0x7f307400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:40.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f30797fa700 1 -- 172.21.15.144:0/2703114530 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307400dd80 con 0x7f307c14fff0 2023-07-29T01:59:40.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f3082caf700 1 -- 172.21.15.144:0/2703114530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f307c1edec0 con 0x7f307c14fff0 2023-07-29T01:59:40.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f30797fa700 1 -- 172.21.15.144:0/2703114530 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307400f040 con 0x7f307c14fff0 2023-07-29T01:59:40.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f30797fa700 1 -- 172.21.15.144:0/2703114530 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3074003c60 con 0x7f307c14fff0 2023-07-29T01:59:40.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f3082caf700 1 -- 172.21.15.144:0/2703114530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f307c156f30 con 0x7f307c14fff0 2023-07-29T01:59:40.757 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f30797fa700 1 -- 172.21.15.144:0/2703114530 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3074004330 con 0x7f307c14fff0 2023-07-29T01:59:40.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.765+0000 7f30797fa700 1 -- 172.21.15.144:0/2703114530 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f3074003dc0 con 0x7f307c14fff0 2023-07-29T01:59:40.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.766+0000 7f3082caf700 1 -- 172.21.15.144:0/2703114530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f307c158e20 con 0x7f307c14fff0 2023-07-29T01:59:40.758 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.769+0000 7f30797fa700 1 -- 172.21.15.144:0/2703114530 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f307c158e20 con 0x7f307c14fff0 2023-07-29T01:59:40.773 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:40.785+0000 7f97f03a5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-29T01:59:40.811 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:40.823+0000 7f037bb9f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-29T01:59:40.839 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.851+0000 7f3082caf700 1 -- 172.21.15.144:0/2703114530 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b99ddaf3-1eae-419d-a886-c573ba210780", "id": 2} v 0) v1 -- 0x7f307c04ea50 con 0x7f307c14fff0 2023-07-29T01:59:40.842 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.854+0000 7f30797fa700 1 -- 172.21.15.144:0/2703114530 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b99ddaf3-1eae-419d-a886-c573ba210780", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f307401a070 con 0x7f307c14fff0 2023-07-29T01:59:40.842 INFO:teuthology.orchestra.run.smithi144.stdout:2 2023-07-29T01:59:40.844 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.855+0000 7f3082caf700 1 -- 172.21.15.144:0/2703114530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f307c14fff0 msgr2=0x7f307c0ca6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.844 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.855+0000 7f3082caf700 1 --2- 172.21.15.144:0/2703114530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f307c14fff0 0x7f307c0ca6f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3074007ef0 tx=0x7f307400d3b0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.844 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.855+0000 7f3082caf700 1 -- 172.21.15.144:0/2703114530 shutdown_connections 2023-07-29T01:59:40.844 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.855+0000 7f3082caf700 1 --2- 172.21.15.144:0/2703114530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f307c14fff0 0x7f307c0ca6f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.845 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.855+0000 7f3082caf700 1 --2- 172.21.15.144:0/2703114530 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f307c06b860 0x7f307c149d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.845 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.855+0000 7f3082caf700 1 --2- 172.21.15.144:0/2703114530 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f307c14fc20 0x7f307c149010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.845 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.855+0000 7f3082caf700 1 -- 172.21.15.144:0/2703114530 >> 172.21.15.144:0/2703114530 conn(0x7f307c0cc420 msgr2=0x7f307c0c8960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:40.845 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.855+0000 7f3082caf700 1 -- 172.21.15.144:0/2703114530 shutdown_connections 2023-07-29T01:59:40.845 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.855+0000 7f3082caf700 1 -- 172.21.15.144:0/2703114530 wait complete. 2023-07-29T01:59:40.860 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new b5076220-edcf-4760-9a01-946dd8a781cc 3 2023-07-29T01:59:40.983 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.994+0000 7f68a9784700 1 Processor -- start 2023-07-29T01:59:40.983 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.994+0000 7f68a9784700 1 -- start start 2023-07-29T01:59:40.985 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.996+0000 7f68a9784700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68a4071840 0x7f68a406f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:40.985 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.996+0000 7f68a9784700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a406c870 con 0x7f68a41531a0 2023-07-29T01:59:40.985 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.996+0000 7f68a9784700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a406fa50 con 0x7f68a40c8580 2023-07-29T01:59:40.985 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.996+0000 7f68a9784700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a40c74a0 con 0x7f68a4071840 2023-07-29T01:59:40.985 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.996+0000 7f68a27fc700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f68a40c8580 0x7f68a406a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:47994/0 (socket says 172.21.15.144:47994) 2023-07-29T01:59:40.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.996+0000 7f68a27fc700 1 -- 172.21.15.144:0/1175523230 learned_addr learned my addr 172.21.15.144:0/1175523230 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-07-29T01:59:40.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.996+0000 7f68a37fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68a4071840 0x7f68a406f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:40.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.996+0000 7f68a1ffb700 1 -- 172.21.15.144:0/1175523230 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759275148 0 0) 0x7f68a406fa50 con 0x7f68a40c8580 2023-07-29T01:59:40.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.996+0000 7f68a1ffb700 1 -- 172.21.15.144:0/1175523230 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f688c0035b0 con 0x7f68a40c8580 2023-07-29T01:59:40.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.996+0000 7f68a37fe700 1 -- 172.21.15.144:0/1175523230 >> v1:172.21.15.144:6789/0 conn(0x7f68a40c8580 legacy=0x7f68a406a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.996+0000 7f68a37fe700 1 -- 172.21.15.144:0/1175523230 >> v1:172.21.15.42:6789/0 conn(0x7f68a41531a0 legacy=0x7f68a415c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.996+0000 7f68a37fe700 1 -- 172.21.15.144:0/1175523230 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a406d450 con 0x7f68a4071840 2023-07-29T01:59:40.986 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.996+0000 7f68a37fe700 1 --2- 172.21.15.144:0/1175523230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68a4071840 0x7f68a406f510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f689c009dc0 tx=0x7f689c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=936351a4ed7f6b6c server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:40.987 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.996+0000 7f68a1ffb700 1 -- 172.21.15.144:0/1175523230 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c00e070 con 0x7f68a4071840 2023-07-29T01:59:40.987 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.996+0000 7f68a1ffb700 1 -- 172.21.15.144:0/1175523230 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689c00bb20 con 0x7f68a4071840 2023-07-29T01:59:40.987 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.996+0000 7f68a1ffb700 1 -- 172.21.15.144:0/1175523230 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c012430 con 0x7f68a4071840 2023-07-29T01:59:40.989 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.997+0000 7f68a9784700 1 -- 172.21.15.144:0/1175523230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68a4071840 msgr2=0x7f68a406f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.997+0000 7f68a9784700 1 --2- 172.21.15.144:0/1175523230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68a4071840 0x7f68a406f510 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f689c009dc0 tx=0x7f689c00b330 comp rx=0 tx=0).stop 2023-07-29T01:59:40.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.997+0000 7f68a9784700 1 -- 172.21.15.144:0/1175523230 shutdown_connections 2023-07-29T01:59:40.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.997+0000 7f68a9784700 1 --2- 172.21.15.144:0/1175523230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68a4071840 0x7f68a406f510 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.997+0000 7f68a9784700 1 -- 172.21.15.144:0/1175523230 >> 172.21.15.144:0/1175523230 conn(0x7f68a40cbf10 msgr2=0x7f68a40cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:40.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.997+0000 7f68a9784700 1 -- 172.21.15.144:0/1175523230 shutdown_connections 2023-07-29T01:59:40.990 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.997+0000 7f68a9784700 1 -- 172.21.15.144:0/1175523230 wait complete. 2023-07-29T01:59:40.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.998+0000 7f68a9784700 1 Processor -- start 2023-07-29T01:59:40.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.998+0000 7f68a9784700 1 -- start start 2023-07-29T01:59:40.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.999+0000 7f68a9784700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68a4071840 0x7f68a41557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:40.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.999+0000 7f68a9784700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68a40c8580 0x7f68a41e57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:40.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.999+0000 7f68a9784700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68a41531a0 0x7f68a41e5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:40.991 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.999+0000 7f68a9784700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a41537c0 con 0x7f68a41531a0 2023-07-29T01:59:40.992 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.999+0000 7f68a9784700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a414e690 con 0x7f68a40c8580 2023-07-29T01:59:40.992 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.999+0000 7f68a9784700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a414e950 con 0x7f68a4071840 2023-07-29T01:59:40.992 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.999+0000 7f68a27fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68a40c8580 0x7f68a41e57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:40.992 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.999+0000 7f68a2ffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68a4071840 0x7f68a41557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:40.992 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.999+0000 7f68a27fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68a40c8580 0x7f68a41e57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:55608/0 (socket says 172.21.15.144:55608) 2023-07-29T01:59:40.992 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.999+0000 7f68a27fc700 1 -- 172.21.15.144:0/3359365759 learned_addr learned my addr 172.21.15.144:0/3359365759 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-07-29T01:59:40.992 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.999+0000 7f68a37fe700 1 --2- 172.21.15.144:0/3359365759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68a41531a0 0x7f68a41e5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:40.993 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:40.999+0000 7f68a27fc700 1 -- 172.21.15.144:0/3359365759 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68a4071840 msgr2=0x7f68a41557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.993 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.000+0000 7f68a27fc700 1 --2- 172.21.15.144:0/3359365759 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68a4071840 0x7f68a41557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.993 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.000+0000 7f68a27fc700 1 -- 172.21.15.144:0/3359365759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68a41531a0 msgr2=0x7f68a41e5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:40.993 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.000+0000 7f68a27fc700 1 --2- 172.21.15.144:0/3359365759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68a41531a0 0x7f68a41e5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:40.993 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.000+0000 7f68a27fc700 1 -- 172.21.15.144:0/3359365759 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c009a70 con 0x7f68a40c8580 2023-07-29T01:59:40.993 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.000+0000 7f68a2ffd700 1 --2- 172.21.15.144:0/3359365759 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68a4071840 0x7f68a41557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T01:59:40.993 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.000+0000 7f68a37fe700 1 --2- 172.21.15.144:0/3359365759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68a41531a0 0x7f68a41e5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T01:59:40.993 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.000+0000 7f68a27fc700 1 --2- 172.21.15.144:0/3359365759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68a40c8580 0x7f68a41e57c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f689800c700 tx=0x7f689800ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:40.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.000+0000 7f688b7fe700 1 -- 172.21.15.144:0/3359365759 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6898005d70 con 0x7f68a40c8580 2023-07-29T01:59:40.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.000+0000 7f688b7fe700 1 -- 172.21.15.144:0/3359365759 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68980070d0 con 0x7f68a40c8580 2023-07-29T01:59:40.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.000+0000 7f68a9784700 1 -- 172.21.15.144:0/3359365759 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a414ec30 con 0x7f68a40c8580 2023-07-29T01:59:40.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.000+0000 7f688b7fe700 1 -- 172.21.15.144:0/3359365759 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6898007460 con 0x7f68a40c8580 2023-07-29T01:59:40.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.000+0000 7f68a9784700 1 -- 172.21.15.144:0/3359365759 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a4153cb0 con 0x7f68a40c8580 2023-07-29T01:59:40.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.000+0000 7f688b7fe700 1 -- 172.21.15.144:0/3359365759 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f689801c440 con 0x7f68a40c8580 2023-07-29T01:59:40.994 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.000+0000 7f688b7fe700 1 -- 172.21.15.144:0/3359365759 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f6898012890 con 0x7f68a40c8580 2023-07-29T01:59:40.995 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.001+0000 7f68a9784700 1 -- 172.21.15.144:0/3359365759 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a4068200 con 0x7f68a40c8580 2023-07-29T01:59:40.995 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.003+0000 7f688b7fe700 1 -- 172.21.15.144:0/3359365759 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f68a4068200 con 0x7f68a40c8580 2023-07-29T01:59:41.075 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.086+0000 7f68a9784700 1 -- 172.21.15.144:0/3359365759 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b5076220-edcf-4760-9a01-946dd8a781cc", "id": 3} v 0) v1 -- 0x7f68a41e54e0 con 0x7f68a40c8580 2023-07-29T01:59:41.078 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.089+0000 7f688b7fe700 1 -- 172.21.15.144:0/3359365759 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b5076220-edcf-4760-9a01-946dd8a781cc", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6898017070 con 0x7f68a40c8580 2023-07-29T01:59:41.078 INFO:teuthology.orchestra.run.smithi144.stdout:3 2023-07-29T01:59:41.079 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.090+0000 7f68a9784700 1 -- 172.21.15.144:0/3359365759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68a40c8580 msgr2=0x7f68a41e57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.079 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.090+0000 7f68a9784700 1 --2- 172.21.15.144:0/3359365759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68a40c8580 0x7f68a41e57c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f689800c700 tx=0x7f689800ca10 comp rx=0 tx=0).stop 2023-07-29T01:59:41.079 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.091+0000 7f68a9784700 1 -- 172.21.15.144:0/3359365759 shutdown_connections 2023-07-29T01:59:41.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.091+0000 7f68a9784700 1 --2- 172.21.15.144:0/3359365759 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f68a41531a0 0x7f68a41e5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.091+0000 7f68a9784700 1 --2- 172.21.15.144:0/3359365759 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f68a4071840 0x7f68a41557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.091+0000 7f68a9784700 1 --2- 172.21.15.144:0/3359365759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68a40c8580 0x7f68a41e57c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.091+0000 7f68a9784700 1 -- 172.21.15.144:0/3359365759 >> 172.21.15.144:0/3359365759 conn(0x7f68a40cbf10 msgr2=0x7f68a40738a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:41.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.091+0000 7f68a9784700 1 -- 172.21.15.144:0/3359365759 shutdown_connections 2023-07-29T01:59:41.080 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.091+0000 7f68a9784700 1 -- 172.21.15.144:0/3359365759 wait complete. 2023-07-29T01:59:41.090 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new d5d15d77-8516-41ab-882b-c16450be0603 4 2023-07-29T01:59:41.210 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.222+0000 7fabad632700 1 Processor -- start 2023-07-29T01:59:41.211 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.222+0000 7fabad632700 1 -- start start 2023-07-29T01:59:41.214 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.223+0000 7fabad632700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faba81531a0 0x7faba806f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:41.214 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.223+0000 7fabad632700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7faba8071840 0x7faba806a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:41.214 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.223+0000 7fabad632700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba806c870 con 0x7faba80c8580 2023-07-29T01:59:41.215 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.223+0000 7fabad632700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba80c74a0 con 0x7faba8071840 2023-07-29T01:59:41.215 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.223+0000 7fabad632700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba806fa50 con 0x7faba81531a0 2023-07-29T01:59:41.215 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.223+0000 7faba67fc700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7faba80c8580 0x7faba815c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48004/0 (socket says 172.21.15.144:48004) 2023-07-29T01:59:41.215 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.223+0000 7faba67fc700 1 -- 172.21.15.144:0/749285418 learned_addr learned my addr 172.21.15.144:0/749285418 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-07-29T01:59:41.215 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.223+0000 7faba6ffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faba81531a0 0x7faba806f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:41.215 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.223+0000 7faba77fe700 1 --2- 172.21.15.144:0/749285418 >> v2:172.21.15.42:3300/0 conn(0x7faba8071840 0x7faba806a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:41.215 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.223+0000 7faba5ffb700 1 -- 172.21.15.144:0/749285418 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147447900 0 0) 0x7faba806c870 con 0x7faba80c8580 2023-07-29T01:59:41.216 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.223+0000 7faba6ffd700 1 -- 172.21.15.144:0/749285418 >> v2:172.21.15.42:3300/0 conn(0x7faba8071840 msgr2=0x7faba806a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:41.216 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.223+0000 7faba6ffd700 1 --2- 172.21.15.144:0/749285418 >> v2:172.21.15.42:3300/0 conn(0x7faba8071840 0x7faba806a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.216 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.223+0000 7faba6ffd700 1 -- 172.21.15.144:0/749285418 >> v1:172.21.15.144:6789/0 conn(0x7faba80c8580 legacy=0x7faba815c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.216 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.223+0000 7faba6ffd700 1 -- 172.21.15.144:0/749285418 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba806d450 con 0x7faba81531a0 2023-07-29T01:59:41.216 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.223+0000 7faba6ffd700 1 --2- 172.21.15.144:0/749285418 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faba81531a0 0x7faba806f510 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fab98009840 tx=0x7fab98009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37de52ad6a936b42 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:41.216 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.224+0000 7faba5ffb700 1 -- 172.21.15.144:0/749285418 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98011830 con 0x7faba81531a0 2023-07-29T01:59:41.216 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.224+0000 7faba5ffb700 1 -- 172.21.15.144:0/749285418 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab98011990 con 0x7faba81531a0 2023-07-29T01:59:41.217 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.224+0000 7faba5ffb700 1 -- 172.21.15.144:0/749285418 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98011d20 con 0x7faba81531a0 2023-07-29T01:59:41.217 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.224+0000 7fabad632700 1 -- 172.21.15.144:0/749285418 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faba81531a0 msgr2=0x7faba806f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.217 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.224+0000 7fabad632700 1 --2- 172.21.15.144:0/749285418 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faba81531a0 0x7faba806f510 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fab98009840 tx=0x7fab98009b50 comp rx=0 tx=0).stop 2023-07-29T01:59:41.217 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.224+0000 7fabad632700 1 -- 172.21.15.144:0/749285418 shutdown_connections 2023-07-29T01:59:41.217 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.224+0000 7fabad632700 1 --2- 172.21.15.144:0/749285418 >> v2:172.21.15.42:3300/0 conn(0x7faba8071840 0x7faba806a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.217 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.224+0000 7fabad632700 1 --2- 172.21.15.144:0/749285418 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faba81531a0 0x7faba806f510 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.217 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.224+0000 7fabad632700 1 -- 172.21.15.144:0/749285418 >> 172.21.15.144:0/749285418 conn(0x7faba80cbf10 msgr2=0x7faba80cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:41.217 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.224+0000 7fabad632700 1 -- 172.21.15.144:0/749285418 shutdown_connections 2023-07-29T01:59:41.218 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.224+0000 7fabad632700 1 -- 172.21.15.144:0/749285418 wait complete. 2023-07-29T01:59:41.218 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.226+0000 7fabad632700 1 Processor -- start 2023-07-29T01:59:41.218 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.226+0000 7fabad632700 1 -- start start 2023-07-29T01:59:41.220 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.226+0000 7fabad632700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faba8071840 0x7faba81e2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:41.220 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.226+0000 7fabad632700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faba80c8580 0x7faba8155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:41.220 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.226+0000 7fabad632700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faba81531a0 0x7faba8155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:41.220 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.226+0000 7fabad632700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba8153a70 con 0x7faba8071840 2023-07-29T01:59:41.220 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.226+0000 7fabad632700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba81f2590 con 0x7faba80c8580 2023-07-29T01:59:41.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.226+0000 7fabad632700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba8154c80 con 0x7faba81531a0 2023-07-29T01:59:41.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.226+0000 7faba67fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faba80c8580 0x7faba8155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:41.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.226+0000 7faba77fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faba81531a0 0x7faba8155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:41.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.226+0000 7faba67fc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faba80c8580 0x7faba8155440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:55618/0 (socket says 172.21.15.144:55618) 2023-07-29T01:59:41.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.226+0000 7faba67fc700 1 -- 172.21.15.144:0/751297843 learned_addr learned my addr 172.21.15.144:0/751297843 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-07-29T01:59:41.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.226+0000 7faba77fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faba81531a0 0x7faba8155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:33396/0 (socket says 172.21.15.144:33396) 2023-07-29T01:59:41.221 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.226+0000 7faba6ffd700 1 --2- 172.21.15.144:0/751297843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faba8071840 0x7faba81e2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:41.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.227+0000 7faba77fe700 1 -- 172.21.15.144:0/751297843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faba80c8580 msgr2=0x7faba8155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.227+0000 7faba77fe700 1 --2- 172.21.15.144:0/751297843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faba80c8580 0x7faba8155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.227+0000 7faba77fe700 1 -- 172.21.15.144:0/751297843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faba8071840 msgr2=0x7faba81e2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.227+0000 7faba77fe700 1 --2- 172.21.15.144:0/751297843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faba8071840 0x7faba81e2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.227+0000 7faba77fe700 1 -- 172.21.15.144:0/751297843 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab980094a0 con 0x7faba81531a0 2023-07-29T01:59:41.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.227+0000 7faba67fc700 1 --2- 172.21.15.144:0/751297843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faba80c8580 0x7faba8155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T01:59:41.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.227+0000 7faba6ffd700 1 --2- 172.21.15.144:0/751297843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faba8071840 0x7faba81e2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T01:59:41.222 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.227+0000 7faba77fe700 1 --2- 172.21.15.144:0/751297843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faba81531a0 0x7faba8155980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faba0009d90 tx=0x7faba000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:41.223 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.227+0000 7fab8f7fe700 1 -- 172.21.15.144:0/751297843 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba0009c00 con 0x7faba81531a0 2023-07-29T01:59:41.223 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.227+0000 7fab8f7fe700 1 -- 172.21.15.144:0/751297843 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba000f040 con 0x7faba81531a0 2023-07-29T01:59:41.223 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.227+0000 7fab8f7fe700 1 -- 172.21.15.144:0/751297843 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba0014480 con 0x7faba81531a0 2023-07-29T01:59:41.223 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.227+0000 7fabad632700 1 -- 172.21.15.144:0/751297843 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba815b4e0 con 0x7faba81531a0 2023-07-29T01:59:41.223 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.227+0000 7fabad632700 1 -- 172.21.15.144:0/751297843 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba8154f20 con 0x7faba81531a0 2023-07-29T01:59:41.223 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.227+0000 7fab8f7fe700 1 -- 172.21.15.144:0/751297843 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faba00148e0 con 0x7faba81531a0 2023-07-29T01:59:41.223 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.227+0000 7fab8f7fe700 1 -- 172.21.15.144:0/751297843 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7faba00133e0 con 0x7faba81531a0 2023-07-29T01:59:41.224 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.228+0000 7fabad632700 1 -- 172.21.15.144:0/751297843 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba8155140 con 0x7faba81531a0 2023-07-29T01:59:41.224 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.230+0000 7fab8f7fe700 1 -- 172.21.15.144:0/751297843 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7faba003bb00 con 0x7faba81531a0 2023-07-29T01:59:41.246 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:41.258+0000 7f97f03a5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-29T01:59:41.277 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:41.289+0000 7f037bb9f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-29T01:59:41.302 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.313+0000 7fabad632700 1 -- 172.21.15.144:0/751297843 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d5d15d77-8516-41ab-882b-c16450be0603", "id": 4} v 0) v1 -- 0x7faba804ea50 con 0x7faba81531a0 2023-07-29T01:59:41.305 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.316+0000 7fab8f7fe700 1 -- 172.21.15.144:0/751297843 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d5d15d77-8516-41ab-882b-c16450be0603", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7faba002a070 con 0x7faba81531a0 2023-07-29T01:59:41.305 INFO:teuthology.orchestra.run.smithi144.stdout:4 2023-07-29T01:59:41.306 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.317+0000 7fabad632700 1 -- 172.21.15.144:0/751297843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faba81531a0 msgr2=0x7faba8155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.306 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.317+0000 7fabad632700 1 --2- 172.21.15.144:0/751297843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faba81531a0 0x7faba8155980 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faba0009d90 tx=0x7faba000c3a0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.306 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.317+0000 7fabad632700 1 -- 172.21.15.144:0/751297843 shutdown_connections 2023-07-29T01:59:41.306 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.317+0000 7fabad632700 1 --2- 172.21.15.144:0/751297843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faba81531a0 0x7faba8155980 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.317+0000 7fabad632700 1 --2- 172.21.15.144:0/751297843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faba8071840 0x7faba81e2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.317+0000 7fabad632700 1 --2- 172.21.15.144:0/751297843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faba80c8580 0x7faba8155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.318+0000 7fabad632700 1 -- 172.21.15.144:0/751297843 >> 172.21.15.144:0/751297843 conn(0x7faba80cbf10 msgr2=0x7faba81524b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:41.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.318+0000 7fabad632700 1 -- 172.21.15.144:0/751297843 shutdown_connections 2023-07-29T01:59:41.307 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.318+0000 7fabad632700 1 -- 172.21.15.144:0/751297843 wait complete. 2023-07-29T01:59:41.319 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 1d18158d-082a-4454-a171-799298ba0005 5 2023-07-29T01:59:41.440 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.453+0000 7f1fb8dfc700 1 Processor -- start 2023-07-29T01:59:41.441 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.453+0000 7f1fb8dfc700 1 -- start start 2023-07-29T01:59:41.442 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.454+0000 7f1fb8dfc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb40ccfa0 0x7f1fb40cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:41.442 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.454+0000 7f1fb8dfc700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb415b1d0 con 0x7f1fb40c3890 2023-07-29T01:59:41.442 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.454+0000 7f1fb8dfc700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb415a650 con 0x7f1fb406f530 2023-07-29T01:59:41.442 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.454+0000 7f1fb8dfc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb40c9820 con 0x7f1fb40ccfa0 2023-07-29T01:59:41.443 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.454+0000 7f1fb259c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb40ccfa0 0x7f1fb40cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:41.443 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.454+0000 7f1fb1d9b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f1fb406f530 0x7f1fb406dc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48014/0 (socket says 172.21.15.144:48014) 2023-07-29T01:59:41.443 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.454+0000 7f1fb1d9b700 1 -- 172.21.15.144:0/1859013242 learned_addr learned my addr 172.21.15.144:0/1859013242 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-07-29T01:59:41.443 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.454+0000 7f1fb159a700 1 -- 172.21.15.144:0/1859013242 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429851568 0 0) 0x7f1fb415a650 con 0x7f1fb406f530 2023-07-29T01:59:41.443 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.454+0000 7f1fb159a700 1 -- 172.21.15.144:0/1859013242 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f9c0035b0 con 0x7f1fb406f530 2023-07-29T01:59:41.443 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.454+0000 7f1fb259c700 1 -- 172.21.15.144:0/1859013242 >> v1:172.21.15.144:6789/0 conn(0x7f1fb406f530 legacy=0x7f1fb406dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.443 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.454+0000 7f1fb259c700 1 -- 172.21.15.144:0/1859013242 >> v1:172.21.15.42:6789/0 conn(0x7f1fb40c3890 legacy=0x7f1fb41615a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.443 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.454+0000 7f1fb259c700 1 -- 172.21.15.144:0/1859013242 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb415a930 con 0x7f1fb40ccfa0 2023-07-29T01:59:41.444 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.455+0000 7f1fb259c700 1 --2- 172.21.15.144:0/1859013242 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb40ccfa0 0x7f1fb40cd370 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009850 tx=0x7f1fa4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4436bcf83a86d441 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:41.444 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.455+0000 7f1fb159a700 1 -- 172.21.15.144:0/1859013242 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4005e30 con 0x7f1fb40ccfa0 2023-07-29T01:59:41.444 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.455+0000 7f1fb159a700 1 -- 172.21.15.144:0/1859013242 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa4006030 con 0x7f1fb40ccfa0 2023-07-29T01:59:41.444 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.455+0000 7f1fb159a700 1 -- 172.21.15.144:0/1859013242 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa40063e0 con 0x7f1fb40ccfa0 2023-07-29T01:59:41.446 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.455+0000 7f1fb8dfc700 1 -- 172.21.15.144:0/1859013242 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb40ccfa0 msgr2=0x7f1fb40cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.446 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.455+0000 7f1fb8dfc700 1 --2- 172.21.15.144:0/1859013242 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb40ccfa0 0x7f1fb40cd370 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009850 tx=0x7f1fa4009b60 comp rx=0 tx=0).stop 2023-07-29T01:59:41.447 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.455+0000 7f1fb8dfc700 1 -- 172.21.15.144:0/1859013242 shutdown_connections 2023-07-29T01:59:41.447 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.455+0000 7f1fb8dfc700 1 --2- 172.21.15.144:0/1859013242 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb40ccfa0 0x7f1fb40cd370 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.447 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.455+0000 7f1fb8dfc700 1 -- 172.21.15.144:0/1859013242 >> 172.21.15.144:0/1859013242 conn(0x7f1fb4061190 msgr2=0x7f1fb4061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:41.447 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.455+0000 7f1fb8dfc700 1 -- 172.21.15.144:0/1859013242 shutdown_connections 2023-07-29T01:59:41.447 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.456+0000 7f1fb8dfc700 1 -- 172.21.15.144:0/1859013242 wait complete. 2023-07-29T01:59:41.447 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.457+0000 7f1fb8dfc700 1 Processor -- start 2023-07-29T01:59:41.447 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.457+0000 7f1fb8dfc700 1 -- start start 2023-07-29T01:59:41.447 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.457+0000 7f1fb8dfc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb406f530 0x7f1fb4153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:41.448 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.457+0000 7f1fb8dfc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fb40c3890 0x7f1fb41f0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:41.448 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.457+0000 7f1fb8dfc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fb40ccfa0 0x7f1fb40cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:41.448 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.457+0000 7f1fb8dfc700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb41efd30 con 0x7f1fb40c3890 2023-07-29T01:59:41.448 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.457+0000 7f1fb8dfc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb4153750 con 0x7f1fb40ccfa0 2023-07-29T01:59:41.448 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.457+0000 7f1fb8dfc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb4153b10 con 0x7f1fb406f530 2023-07-29T01:59:41.448 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.458+0000 7f1fb2d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fb40ccfa0 0x7f1fb40cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:41.448 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.458+0000 7f1fb2d9d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fb40ccfa0 0x7f1fb40cbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:55630/0 (socket says 172.21.15.144:55630) 2023-07-29T01:59:41.449 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.458+0000 7f1fb2d9d700 1 -- 172.21.15.144:0/2951898249 learned_addr learned my addr 172.21.15.144:0/2951898249 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-07-29T01:59:41.449 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.458+0000 7f1fb1d9b700 1 --2- 172.21.15.144:0/2951898249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fb40c3890 0x7f1fb41f0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:41.449 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.458+0000 7f1fb259c700 1 --2- 172.21.15.144:0/2951898249 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb406f530 0x7f1fb4153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:41.449 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.458+0000 7f1fb259c700 1 -- 172.21.15.144:0/2951898249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fb40ccfa0 msgr2=0x7f1fb40cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.449 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.458+0000 7f1fb259c700 1 --2- 172.21.15.144:0/2951898249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fb40ccfa0 0x7f1fb40cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.449 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.458+0000 7f1fb259c700 1 -- 172.21.15.144:0/2951898249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fb40c3890 msgr2=0x7f1fb41f0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.449 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.458+0000 7f1fb259c700 1 --2- 172.21.15.144:0/2951898249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fb40c3890 0x7f1fb41f0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.449 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.458+0000 7f1fb259c700 1 -- 172.21.15.144:0/2951898249 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa4009430 con 0x7f1fb406f530 2023-07-29T01:59:41.450 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.458+0000 7f1fb2d9d700 1 --2- 172.21.15.144:0/2951898249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fb40ccfa0 0x7f1fb40cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T01:59:41.450 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.458+0000 7f1fb259c700 1 --2- 172.21.15.144:0/2951898249 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb406f530 0x7f1fb4153210 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4015000 tx=0x7f1fa4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:41.450 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.458+0000 7f1fa2ffd700 1 -- 172.21.15.144:0/2951898249 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa40068d0 con 0x7f1fb406f530 2023-07-29T01:59:41.450 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.458+0000 7f1fa2ffd700 1 -- 172.21.15.144:0/2951898249 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa4020070 con 0x7f1fb406f530 2023-07-29T01:59:41.450 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.458+0000 7f1fa2ffd700 1 -- 172.21.15.144:0/2951898249 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4025670 con 0x7f1fb406f530 2023-07-29T01:59:41.450 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.458+0000 7f1fb8dfc700 1 -- 172.21.15.144:0/2951898249 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb4150990 con 0x7f1fb406f530 2023-07-29T01:59:41.450 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.458+0000 7f1fb8dfc700 1 -- 172.21.15.144:0/2951898249 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb4154180 con 0x7f1fb406f530 2023-07-29T01:59:41.451 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.458+0000 7f1fa2ffd700 1 -- 172.21.15.144:0/2951898249 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1fa4022030 con 0x7f1fb406f530 2023-07-29T01:59:41.451 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.458+0000 7f1fa2ffd700 1 -- 172.21.15.144:0/2951898249 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f1fa4011db0 con 0x7f1fb406f530 2023-07-29T01:59:41.451 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.459+0000 7f1fb8dfc700 1 -- 172.21.15.144:0/2951898249 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb404ea50 con 0x7f1fb406f530 2023-07-29T01:59:41.451 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.461+0000 7f1fa2ffd700 1 -- 172.21.15.144:0/2951898249 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f1fa4011420 con 0x7f1fb406f530 2023-07-29T01:59:41.530 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.543+0000 7f1fb8dfc700 1 -- 172.21.15.144:0/2951898249 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1d18158d-082a-4454-a171-799298ba0005", "id": 5} v 0) v1 -- 0x7f1fb4151d40 con 0x7f1fb406f530 2023-07-29T01:59:41.533 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.546+0000 7f1fa2ffd700 1 -- 172.21.15.144:0/2951898249 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1d18158d-082a-4454-a171-799298ba0005", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1fa4011900 con 0x7f1fb406f530 2023-07-29T01:59:41.534 INFO:teuthology.orchestra.run.smithi144.stdout:5 2023-07-29T01:59:41.534 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.547+0000 7f1fb8dfc700 1 -- 172.21.15.144:0/2951898249 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb406f530 msgr2=0x7f1fb4153210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.547+0000 7f1fb8dfc700 1 --2- 172.21.15.144:0/2951898249 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb406f530 0x7f1fb4153210 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4015000 tx=0x7f1fa4004750 comp rx=0 tx=0).stop 2023-07-29T01:59:41.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.547+0000 7f1fb8dfc700 1 -- 172.21.15.144:0/2951898249 shutdown_connections 2023-07-29T01:59:41.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.547+0000 7f1fb8dfc700 1 --2- 172.21.15.144:0/2951898249 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fb40ccfa0 0x7f1fb40cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.547+0000 7f1fb8dfc700 1 --2- 172.21.15.144:0/2951898249 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fb406f530 0x7f1fb4153210 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.547+0000 7f1fb8dfc700 1 --2- 172.21.15.144:0/2951898249 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fb40c3890 0x7f1fb41f0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.535 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.547+0000 7f1fb8dfc700 1 -- 172.21.15.144:0/2951898249 >> 172.21.15.144:0/2951898249 conn(0x7f1fb4061190 msgr2=0x7f1fb4145f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:41.536 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.547+0000 7f1fb8dfc700 1 -- 172.21.15.144:0/2951898249 shutdown_connections 2023-07-29T01:59:41.536 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.547+0000 7f1fb8dfc700 1 -- 172.21.15.144:0/2951898249 wait complete. 2023-07-29T01:59:41.547 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 84894abb-9795-4cc8-bc72-8f6c0767e93a 6 2023-07-29T01:59:41.707 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.720+0000 7fa5f8818700 1 Processor -- start 2023-07-29T01:59:41.708 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.720+0000 7fa5f8818700 1 -- start start 2023-07-29T01:59:41.709 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.721+0000 7fa5f8818700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5f414f4c0 0x7fa5f406d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:41.710 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.721+0000 7fa5f8818700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa5f40bfeb0 0x7fa5f406def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:41.710 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.721+0000 7fa5f8818700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f40c5b40 con 0x7fa5f40c73d0 2023-07-29T01:59:41.710 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.721+0000 7fa5f8818700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f406c210 con 0x7fa5f40bfeb0 2023-07-29T01:59:41.710 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.721+0000 7fa5f8818700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f406c4f0 con 0x7fa5f414f4c0 2023-07-29T01:59:41.710 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.722+0000 7fa5f1d9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa5f40bfeb0 0x7fa5f406def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:41.710 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.722+0000 7fa5f259c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5f414f4c0 0x7fa5f406d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:41.710 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.722+0000 7fa5f259c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5f414f4c0 0x7fa5f406d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:33408/0 (socket says 172.21.15.144:33408) 2023-07-29T01:59:41.711 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.722+0000 7fa5f1d9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa5f40bfeb0 0x7fa5f406def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:55632/0 (socket says 172.21.15.144:55632) 2023-07-29T01:59:41.711 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.722+0000 7fa5f259c700 1 -- 172.21.15.144:0/1308546345 learned_addr learned my addr 172.21.15.144:0/1308546345 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-07-29T01:59:41.711 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.722+0000 7fa5f259c700 1 -- 172.21.15.144:0/1308546345 >> v2:172.21.15.144:3300/0 conn(0x7fa5f40bfeb0 msgr2=0x7fa5f406def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:41.711 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.722+0000 7fa5f259c700 1 --2- 172.21.15.144:0/1308546345 >> v2:172.21.15.144:3300/0 conn(0x7fa5f40bfeb0 0x7fa5f406def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.711 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.722+0000 7fa5f259c700 1 -- 172.21.15.144:0/1308546345 >> v1:172.21.15.144:6789/0 conn(0x7fa5f40c73d0 legacy=0x7fa5f4158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.711 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.722+0000 7fa5f259c700 1 -- 172.21.15.144:0/1308546345 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f40c5d90 con 0x7fa5f414f4c0 2023-07-29T01:59:41.711 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.722+0000 7fa5f159a700 1 -- 172.21.15.144:0/1308546345 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267739293 0 0) 0x7fa5f40c5b40 con 0x7fa5f40c73d0 2023-07-29T01:59:41.712 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.722+0000 7fa5f1d9b700 1 --2- 172.21.15.144:0/1308546345 >> v2:172.21.15.144:3300/0 conn(0x7fa5f40bfeb0 0x7fa5f406def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T01:59:41.712 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.722+0000 7fa5f259c700 1 --2- 172.21.15.144:0/1308546345 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5f414f4c0 0x7fa5f406d9b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40098f0 tx=0x7fa5e4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5752cd259ceadd82 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:41.712 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.722+0000 7fa5f159a700 1 -- 172.21.15.144:0/1308546345 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4011830 con 0x7fa5f414f4c0 2023-07-29T01:59:41.712 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.722+0000 7fa5f159a700 1 -- 172.21.15.144:0/1308546345 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e4011990 con 0x7fa5f414f4c0 2023-07-29T01:59:41.712 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.722+0000 7fa5f159a700 1 -- 172.21.15.144:0/1308546345 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4011d20 con 0x7fa5f414f4c0 2023-07-29T01:59:41.714 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.723+0000 7fa5f8818700 1 -- 172.21.15.144:0/1308546345 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5f414f4c0 msgr2=0x7fa5f406d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.723+0000 7fa5f8818700 1 --2- 172.21.15.144:0/1308546345 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5f414f4c0 0x7fa5f406d9b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40098f0 tx=0x7fa5e4009c00 comp rx=0 tx=0).stop 2023-07-29T01:59:41.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.723+0000 7fa5f8818700 1 -- 172.21.15.144:0/1308546345 shutdown_connections 2023-07-29T01:59:41.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.723+0000 7fa5f8818700 1 --2- 172.21.15.144:0/1308546345 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5f414f4c0 0x7fa5f406d9b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.723+0000 7fa5f8818700 1 --2- 172.21.15.144:0/1308546345 >> v2:172.21.15.144:3300/0 conn(0x7fa5f40bfeb0 0x7fa5f406def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.723+0000 7fa5f8818700 1 -- 172.21.15.144:0/1308546345 >> 172.21.15.144:0/1308546345 conn(0x7fa5f40cae90 msgr2=0x7fa5f40cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:41.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.723+0000 7fa5f8818700 1 -- 172.21.15.144:0/1308546345 shutdown_connections 2023-07-29T01:59:41.715 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.723+0000 7fa5f8818700 1 -- 172.21.15.144:0/1308546345 wait complete. 2023-07-29T01:59:41.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.724+0000 7fa5f8818700 1 Processor -- start 2023-07-29T01:59:41.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.725+0000 7fa5f8818700 1 -- start start 2023-07-29T01:59:41.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.725+0000 7fa5f8818700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5f40c73d0 0x7fa5f40c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:41.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.725+0000 7fa5f8818700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f414f4c0 0x7fa5f40c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:41.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.725+0000 7fa5f8818700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5f4150bd0 0x7fa5f41ef820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:41.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.725+0000 7fa5f8818700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f41523d0 con 0x7fa5f40c73d0 2023-07-29T01:59:41.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.725+0000 7fa5f8818700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f4151560 con 0x7fa5f414f4c0 2023-07-29T01:59:41.716 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.725+0000 7fa5f8818700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f4151800 con 0x7fa5f4150bd0 2023-07-29T01:59:41.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.725+0000 7fa5f2d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5f4150bd0 0x7fa5f41ef820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:41.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.725+0000 7fa5f1d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f414f4c0 0x7fa5f40c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:41.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.725+0000 7fa5f2d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5f4150bd0 0x7fa5f41ef820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:33418/0 (socket says 172.21.15.144:33418) 2023-07-29T01:59:41.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.725+0000 7fa5f1d9b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f414f4c0 0x7fa5f40c2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:55640/0 (socket says 172.21.15.144:55640) 2023-07-29T01:59:41.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.725+0000 7fa5f2d9d700 1 -- 172.21.15.144:0/615851656 learned_addr learned my addr 172.21.15.144:0/615851656 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-07-29T01:59:41.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.725+0000 7fa5f259c700 1 --2- 172.21.15.144:0/615851656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5f40c73d0 0x7fa5f40c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:41.717 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.726+0000 7fa5f2d9d700 1 -- 172.21.15.144:0/615851656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f414f4c0 msgr2=0x7fa5f40c2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.726+0000 7fa5f2d9d700 1 --2- 172.21.15.144:0/615851656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f414f4c0 0x7fa5f40c2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.726+0000 7fa5f2d9d700 1 -- 172.21.15.144:0/615851656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5f40c73d0 msgr2=0x7fa5f40c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.726+0000 7fa5f2d9d700 1 --2- 172.21.15.144:0/615851656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5f40c73d0 0x7fa5f40c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.726+0000 7fa5f2d9d700 1 -- 172.21.15.144:0/615851656 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e80094a0 con 0x7fa5f4150bd0 2023-07-29T01:59:41.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.726+0000 7fa5f1d9b700 1 --2- 172.21.15.144:0/615851656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f414f4c0 0x7fa5f40c2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T01:59:41.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.726+0000 7fa5f259c700 1 --2- 172.21.15.144:0/615851656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5f40c73d0 0x7fa5f40c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T01:59:41.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.726+0000 7fa5f2d9d700 1 --2- 172.21.15.144:0/615851656 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5f4150bd0 0x7fa5f41ef820 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00c820 tx=0x7fa5ec00cb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:41.718 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.726+0000 7fa5e2ffd700 1 -- 172.21.15.144:0/615851656 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec003e30 con 0x7fa5f4150bd0 2023-07-29T01:59:41.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.726+0000 7fa5e2ffd700 1 -- 172.21.15.144:0/615851656 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ec0050f0 con 0x7fa5f4150bd0 2023-07-29T01:59:41.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.726+0000 7fa5f8818700 1 -- 172.21.15.144:0/615851656 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e4009550 con 0x7fa5f4150bd0 2023-07-29T01:59:41.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.726+0000 7fa5e2ffd700 1 -- 172.21.15.144:0/615851656 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec0054a0 con 0x7fa5f4150bd0 2023-07-29T01:59:41.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.726+0000 7fa5f8818700 1 -- 172.21.15.144:0/615851656 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f4151d80 con 0x7fa5f4150bd0 2023-07-29T01:59:41.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.726+0000 7fa5e2ffd700 1 -- 172.21.15.144:0/615851656 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa5ec01c440 con 0x7fa5f4150bd0 2023-07-29T01:59:41.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.726+0000 7fa5e2ffd700 1 -- 172.21.15.144:0/615851656 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fa5ec0129f0 con 0x7fa5f4150bd0 2023-07-29T01:59:41.719 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.727+0000 7fa5f8818700 1 -- 172.21.15.144:0/615851656 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f40c2250 con 0x7fa5f4150bd0 2023-07-29T01:59:41.720 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.729+0000 7fa5e2ffd700 1 -- 172.21.15.144:0/615851656 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fa5ec017070 con 0x7fa5f4150bd0 2023-07-29T01:59:41.798 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.811+0000 7fa5f8818700 1 -- 172.21.15.144:0/615851656 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd new", "uuid": "84894abb-9795-4cc8-bc72-8f6c0767e93a", "id": 6} v 0) v1 -- 0x7fa5f404ea50 con 0x7fa5f4150bd0 2023-07-29T01:59:41.806 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.818+0000 7fa5e2ffd700 1 -- 172.21.15.144:0/615851656 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "84894abb-9795-4cc8-bc72-8f6c0767e93a", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa5ec012400 con 0x7fa5f4150bd0 2023-07-29T01:59:41.806 INFO:teuthology.orchestra.run.smithi144.stdout:6 2023-07-29T01:59:41.807 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.819+0000 7fa5f8818700 1 -- 172.21.15.144:0/615851656 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5f4150bd0 msgr2=0x7fa5f41ef820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.807 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.819+0000 7fa5f8818700 1 --2- 172.21.15.144:0/615851656 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5f4150bd0 0x7fa5f41ef820 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00c820 tx=0x7fa5ec00cb30 comp rx=0 tx=0).stop 2023-07-29T01:59:41.807 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.819+0000 7fa5f8818700 1 -- 172.21.15.144:0/615851656 shutdown_connections 2023-07-29T01:59:41.807 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.819+0000 7fa5f8818700 1 --2- 172.21.15.144:0/615851656 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5f4150bd0 0x7fa5f41ef820 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.807 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.819+0000 7fa5f8818700 1 --2- 172.21.15.144:0/615851656 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa5f40c73d0 0x7fa5f40c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.808 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.819+0000 7fa5f8818700 1 --2- 172.21.15.144:0/615851656 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa5f414f4c0 0x7fa5f40c2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.808 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.820+0000 7fa5f8818700 1 -- 172.21.15.144:0/615851656 >> 172.21.15.144:0/615851656 conn(0x7fa5f40cae90 msgr2=0x7fa5f414c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:41.808 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.820+0000 7fa5f8818700 1 -- 172.21.15.144:0/615851656 shutdown_connections 2023-07-29T01:59:41.808 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.820+0000 7fa5f8818700 1 -- 172.21.15.144:0/615851656 wait complete. 2023-07-29T01:59:41.819 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 74d10cab-82c0-4da4-b971-365cd3885bb3 7 2023-07-29T01:59:41.831 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:41.844+0000 7f97f03a5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-29T01:59:41.874 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:41.886+0000 7f037bb9f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-29T01:59:41.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.954+0000 7f471977d700 1 Processor -- start 2023-07-29T01:59:41.942 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.954+0000 7f471977d700 1 -- start start 2023-07-29T01:59:41.943 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.955+0000 7f471977d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47141531a0 0x7f471406f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:41.943 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.955+0000 7f471977d700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f471406c870 con 0x7f47140c8580 2023-07-29T01:59:41.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.955+0000 7f471977d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f471406fa50 con 0x7f4714071840 2023-07-29T01:59:41.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.955+0000 7f471977d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47140c74a0 con 0x7f47141531a0 2023-07-29T01:59:41.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.955+0000 7f4712ffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47141531a0 0x7f471406f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:41.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.955+0000 7f47137fe700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4714071840 0x7f471406a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.144:48040/0 (socket says 172.21.15.144:48040) 2023-07-29T01:59:41.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.955+0000 7f47137fe700 1 -- 172.21.15.144:0/2508093287 learned_addr learned my addr 172.21.15.144:0/2508093287 (peer_addr_for_me v1:172.21.15.144:0/0) 2023-07-29T01:59:41.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.955+0000 7f4712ffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47141531a0 0x7f471406f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:33420/0 (socket says 172.21.15.144:33420) 2023-07-29T01:59:41.944 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.956+0000 7f4711ffb700 1 -- 172.21.15.144:0/2508093287 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370505310 0 0) 0x7f471406fa50 con 0x7f4714071840 2023-07-29T01:59:41.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.956+0000 7f4712ffd700 1 -- 172.21.15.144:0/2508093287 >> v1:172.21.15.144:6789/0 conn(0x7f4714071840 legacy=0x7f471406a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.956+0000 7f4712ffd700 1 -- 172.21.15.144:0/2508093287 >> v1:172.21.15.42:6789/0 conn(0x7f47140c8580 legacy=0x7f471415c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.956+0000 7f4712ffd700 1 -- 172.21.15.144:0/2508093287 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471406d450 con 0x7f47141531a0 2023-07-29T01:59:41.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.956+0000 7f4712ffd700 1 --2- 172.21.15.144:0/2508093287 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47141531a0 0x7f471406f510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4704009870 tx=0x7f4704009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24e1c4e3b103fd64 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:41.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.956+0000 7f4711ffb700 1 -- 172.21.15.144:0/2508093287 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704011830 con 0x7f47141531a0 2023-07-29T01:59:41.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.956+0000 7f4711ffb700 1 -- 172.21.15.144:0/2508093287 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4704011990 con 0x7f47141531a0 2023-07-29T01:59:41.945 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.956+0000 7f4711ffb700 1 -- 172.21.15.144:0/2508093287 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704011d20 con 0x7f47141531a0 2023-07-29T01:59:41.947 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.956+0000 7f471977d700 1 -- 172.21.15.144:0/2508093287 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47141531a0 msgr2=0x7f471406f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.956+0000 7f471977d700 1 --2- 172.21.15.144:0/2508093287 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47141531a0 0x7f471406f510 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4704009870 tx=0x7f4704009b80 comp rx=0 tx=0).stop 2023-07-29T01:59:41.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.957+0000 7f471977d700 1 -- 172.21.15.144:0/2508093287 shutdown_connections 2023-07-29T01:59:41.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.957+0000 7f471977d700 1 --2- 172.21.15.144:0/2508093287 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f47141531a0 0x7f471406f510 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.957+0000 7f471977d700 1 -- 172.21.15.144:0/2508093287 >> 172.21.15.144:0/2508093287 conn(0x7f47140cbf10 msgr2=0x7f47140cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:41.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.957+0000 7f471977d700 1 -- 172.21.15.144:0/2508093287 shutdown_connections 2023-07-29T01:59:41.948 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.957+0000 7f471977d700 1 -- 172.21.15.144:0/2508093287 wait complete. 2023-07-29T01:59:41.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.958+0000 7f471977d700 1 Processor -- start 2023-07-29T01:59:41.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.958+0000 7f471977d700 1 -- start start 2023-07-29T01:59:41.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f471977d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4714071840 0x7f4714157d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:41.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f471977d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47140c8580 0x7f47140ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:41.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f471977d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47141531a0 0x7f47141ef540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:41.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f471977d700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47140cb400 con 0x7f47140c8580 2023-07-29T01:59:41.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f471977d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47141efa80 con 0x7f47141531a0 2023-07-29T01:59:41.949 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f471977d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47140cbbf0 con 0x7f4714071840 2023-07-29T01:59:41.950 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f4712ffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4714071840 0x7f4714157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:41.950 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f47137fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47141531a0 0x7f47141ef540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:41.950 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f4712ffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4714071840 0x7f4714157d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.144:33426/0 (socket says 172.21.15.144:33426) 2023-07-29T01:59:41.950 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f4712ffd700 1 -- 172.21.15.144:0/771643490 learned_addr learned my addr 172.21.15.144:0/771643490 (peer_addr_for_me v2:172.21.15.144:0/0) 2023-07-29T01:59:41.950 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f47137fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47141531a0 0x7f47141ef540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:55654/0 (socket says 172.21.15.144:55654) 2023-07-29T01:59:41.950 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f47127fc700 1 --2- 172.21.15.144:0/771643490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47140c8580 0x7f47140ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:41.950 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f47137fe700 1 -- 172.21.15.144:0/771643490 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4714071840 msgr2=0x7f4714157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.951 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f47137fe700 1 --2- 172.21.15.144:0/771643490 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4714071840 0x7f4714157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.951 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f47137fe700 1 -- 172.21.15.144:0/771643490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47140c8580 msgr2=0x7f47140ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:41.951 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f47137fe700 1 --2- 172.21.15.144:0/771643490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47140c8580 0x7f47140ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:41.951 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f47137fe700 1 -- 172.21.15.144:0/771643490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47040094a0 con 0x7f47141531a0 2023-07-29T01:59:41.951 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f4712ffd700 1 --2- 172.21.15.144:0/771643490 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4714071840 0x7f4714157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T01:59:41.951 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f47137fe700 1 --2- 172.21.15.144:0/771643490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47141531a0 0x7f47141ef540 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f470c00cbe0 tx=0x7f470c00cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:41.951 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f46fb7fe700 1 -- 172.21.15.144:0/771643490 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c00aa40 con 0x7f47141531a0 2023-07-29T01:59:41.951 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f46fb7fe700 1 -- 172.21.15.144:0/771643490 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470c00abc0 con 0x7f47141531a0 2023-07-29T01:59:41.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f471977d700 1 -- 172.21.15.144:0/771643490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47140cb630 con 0x7f47141531a0 2023-07-29T01:59:41.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f46fb7fe700 1 -- 172.21.15.144:0/771643490 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470c0070d0 con 0x7f47141531a0 2023-07-29T01:59:41.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.959+0000 7f471977d700 1 -- 172.21.15.144:0/771643490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47140c9db0 con 0x7f47141531a0 2023-07-29T01:59:41.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.960+0000 7f46fb7fe700 1 -- 172.21.15.144:0/771643490 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f470c007530 con 0x7f47141531a0 2023-07-29T01:59:41.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.960+0000 7f46fb7fe700 1 -- 172.21.15.144:0/771643490 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f470c012a60 con 0x7f47141531a0 2023-07-29T01:59:41.952 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.960+0000 7f471977d700 1 -- 172.21.15.144:0/771643490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f471404ea50 con 0x7f47141531a0 2023-07-29T01:59:41.953 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:41.962+0000 7f46fb7fe700 1 -- 172.21.15.144:0/771643490 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f470c018070 con 0x7f47141531a0 2023-07-29T01:59:42.004 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:42.017+0000 7f97f03a5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-29T01:59:42.036 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:42.048+0000 7f037bb9f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-29T01:59:42.044 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:42.056+0000 7f471977d700 1 -- 172.21.15.144:0/771643490 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd new", "uuid": "74d10cab-82c0-4da4-b971-365cd3885bb3", "id": 7} v 0) v1 -- 0x7f47141568f0 con 0x7f47141531a0 2023-07-29T01:59:42.052 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:42.064+0000 7f46fb7fe700 1 -- 172.21.15.144:0/771643490 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "74d10cab-82c0-4da4-b971-365cd3885bb3", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f470c007970 con 0x7f47141531a0 2023-07-29T01:59:42.052 INFO:teuthology.orchestra.run.smithi144.stdout:7 2023-07-29T01:59:42.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:42.065+0000 7f471977d700 1 -- 172.21.15.144:0/771643490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47141531a0 msgr2=0x7f47141ef540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:42.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:42.065+0000 7f471977d700 1 --2- 172.21.15.144:0/771643490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47141531a0 0x7f47141ef540 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f470c00cbe0 tx=0x7f470c00cef0 comp rx=0 tx=0).stop 2023-07-29T01:59:42.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:42.065+0000 7f471977d700 1 -- 172.21.15.144:0/771643490 shutdown_connections 2023-07-29T01:59:42.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:42.065+0000 7f471977d700 1 --2- 172.21.15.144:0/771643490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f47141531a0 0x7f47141ef540 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:42.054 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:42.065+0000 7f471977d700 1 --2- 172.21.15.144:0/771643490 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4714071840 0x7f4714157d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:42.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:42.065+0000 7f471977d700 1 --2- 172.21.15.144:0/771643490 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f47140c8580 0x7f47140ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:42.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:42.065+0000 7f471977d700 1 -- 172.21.15.144:0/771643490 >> 172.21.15.144:0/771643490 conn(0x7f47140cbf10 msgr2=0x7f47140739a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:42.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:42.065+0000 7f471977d700 1 -- 172.21.15.144:0/771643490 shutdown_connections 2023-07-29T01:59:42.055 INFO:teuthology.orchestra.run.smithi144.stderr:2023-07-29T01:59:42.065+0000 7f471977d700 1 -- 172.21.15.144:0/771643490 wait complete. 2023-07-29T01:59:42.065 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-29T01:59:42.065 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-29T01:59:42.067 INFO:tasks.ceph.osd.0:Started 2023-07-29T01:59:42.068 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-29T01:59:42.068 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-29T01:59:42.069 INFO:tasks.ceph.osd.1:Started 2023-07-29T01:59:42.070 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-29T01:59:42.070 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-29T01:59:42.072 INFO:tasks.ceph.osd.2:Started 2023-07-29T01:59:42.072 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-29T01:59:42.072 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-29T01:59:42.074 INFO:tasks.ceph.osd.3:Started 2023-07-29T01:59:42.074 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-29T01:59:42.075 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-29T01:59:42.107 INFO:tasks.ceph.osd.4:Started 2023-07-29T01:59:42.108 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-29T01:59:42.108 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-29T01:59:42.110 INFO:tasks.ceph.osd.5:Started 2023-07-29T01:59:42.110 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-29T01:59:42.111 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-29T01:59:42.113 INFO:tasks.ceph.osd.6:Started 2023-07-29T01:59:42.113 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-29T01:59:42.113 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-29T01:59:42.115 INFO:tasks.ceph.osd.7:Started 2023-07-29T01:59:42.116 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T01:59:42.258 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.270+0000 7fd74350f700 1 Processor -- start 2023-07-29T01:59:42.259 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.270+0000 7fd74350f700 1 -- start start 2023-07-29T01:59:42.260 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.271+0000 7fd74350f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fd73c1567d0 0x7fd73c159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:42.260 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.271+0000 7fd74350f700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd73c0c7210 0x7fd73c06cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:42.260 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.271+0000 7fd74350f700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73c0c7700 con 0x7fd73c159e90 2023-07-29T01:59:42.260 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.271+0000 7fd74350f700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73c06b160 con 0x7fd73c0c7210 2023-07-29T01:59:42.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.271+0000 7fd74350f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73c159170 con 0x7fd73c1567d0 2023-07-29T01:59:42.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.271+0000 7fd740aaa700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fd73c0c7210 0x7fd73c06cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:42.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.271+0000 7fd741aac700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd73c159e90 0x7fd73c15c6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:48912/0 (socket says 172.21.15.42:48912) 2023-07-29T01:59:42.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.271+0000 7fd741aac700 1 -- 172.21.15.42:0/2216852591 learned_addr learned my addr 172.21.15.42:0/2216852591 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T01:59:42.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.271+0000 7fd7412ab700 1 --2- 172.21.15.42:0/2216852591 >> v2:172.21.15.144:3300/0 conn(0x7fd73c1567d0 0x7fd73c159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:42.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.271+0000 7fd740aaa700 1 -- 172.21.15.42:0/2216852591 >> v2:172.21.15.144:3300/0 conn(0x7fd73c1567d0 msgr2=0x7fd73c159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.271+0000 7fd740aaa700 1 --2- 172.21.15.42:0/2216852591 >> v2:172.21.15.144:3300/0 conn(0x7fd73c1567d0 0x7fd73c159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.272+0000 7fd740aaa700 1 -- 172.21.15.42:0/2216852591 >> v1:172.21.15.42:6789/0 conn(0x7fd73c159e90 legacy=0x7fd73c15c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.272+0000 7fd733fff700 1 -- 172.21.15.42:0/2216852591 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1464970141 0 0) 0x7fd73c0c7700 con 0x7fd73c159e90 2023-07-29T01:59:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.272+0000 7fd740aaa700 1 -- 172.21.15.42:0/2216852591 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c156ba0 con 0x7fd73c0c7210 2023-07-29T01:59:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.272+0000 7fd740aaa700 1 --2- 172.21.15.42:0/2216852591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd73c0c7210 0x7fd73c06cd10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd73c0704b0 tx=0x7fd738009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a2cd94644326cb server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:42.262 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.272+0000 7fd733fff700 1 -- 172.21.15.42:0/2216852591 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738011830 con 0x7fd73c0c7210 2023-07-29T01:59:42.263 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.272+0000 7fd733fff700 1 -- 172.21.15.42:0/2216852591 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd738011990 con 0x7fd73c0c7210 2023-07-29T01:59:42.263 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.272+0000 7fd733fff700 1 -- 172.21.15.42:0/2216852591 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738011d20 con 0x7fd73c0c7210 2023-07-29T01:59:42.265 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.272+0000 7fd74350f700 1 -- 172.21.15.42:0/2216852591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd73c0c7210 msgr2=0x7fd73c06cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:42.265 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.272+0000 7fd74350f700 1 --2- 172.21.15.42:0/2216852591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd73c0c7210 0x7fd73c06cd10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd73c0704b0 tx=0x7fd738009b20 comp rx=0 tx=0).stop 2023-07-29T01:59:42.265 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.273+0000 7fd74350f700 1 -- 172.21.15.42:0/2216852591 shutdown_connections 2023-07-29T01:59:42.265 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.273+0000 7fd74350f700 1 --2- 172.21.15.42:0/2216852591 >> v2:172.21.15.144:3300/0 conn(0x7fd73c1567d0 0x7fd73c159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:42.266 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.273+0000 7fd74350f700 1 --2- 172.21.15.42:0/2216852591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd73c0c7210 0x7fd73c06cd10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:42.266 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.273+0000 7fd74350f700 1 -- 172.21.15.42:0/2216852591 >> 172.21.15.42:0/2216852591 conn(0x7fd73c0c8970 msgr2=0x7fd73c0c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:42.266 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.273+0000 7fd74350f700 1 -- 172.21.15.42:0/2216852591 shutdown_connections 2023-07-29T01:59:42.266 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.273+0000 7fd74350f700 1 -- 172.21.15.42:0/2216852591 wait complete. 2023-07-29T01:59:42.266 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.274+0000 7fd74350f700 1 Processor -- start 2023-07-29T01:59:42.266 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.274+0000 7fd74350f700 1 -- start start 2023-07-29T01:59:42.266 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd74350f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd73c0c7210 0x7fd73c1e2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:42.266 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd74350f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd73c1567d0 0x7fd73c143580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:42.267 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd74350f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd73c159e90 0x7fd73c0c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:42.267 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd74350f700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c1f3420 con 0x7fd73c159e90 2023-07-29T01:59:42.267 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd74350f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c1f27a0 con 0x7fd73c0c7210 2023-07-29T01:59:42.267 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd74350f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c1f2a80 con 0x7fd73c1567d0 2023-07-29T01:59:42.267 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd741aac700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd73c159e90 0x7fd73c0c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:42.267 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd741aac700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd73c159e90 0x7fd73c0c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55114/0 (socket says 172.21.15.42:55114) 2023-07-29T01:59:42.267 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd7412ab700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd73c0c7210 0x7fd73c1e2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:42.267 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd741aac700 1 -- 172.21.15.42:0/4181943911 learned_addr learned my addr 172.21.15.42:0/4181943911 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:42.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd740aaa700 1 --2- 172.21.15.42:0/4181943911 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd73c1567d0 0x7fd73c143580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:42.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd7412ab700 1 -- 172.21.15.42:0/4181943911 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd73c1567d0 msgr2=0x7fd73c143580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:42.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd7412ab700 1 --2- 172.21.15.42:0/4181943911 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd73c1567d0 0x7fd73c143580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:42.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd7412ab700 1 -- 172.21.15.42:0/4181943911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd73c159e90 msgr2=0x7fd73c0c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:42.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd7412ab700 1 --2- 172.21.15.42:0/4181943911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd73c159e90 0x7fd73c0c8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:42.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd7412ab700 1 -- 172.21.15.42:0/4181943911 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380094a0 con 0x7fd73c0c7210 2023-07-29T01:59:42.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd741aac700 1 --2- 172.21.15.42:0/4181943911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd73c159e90 0x7fd73c0c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T01:59:42.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd740aaa700 1 --2- 172.21.15.42:0/4181943911 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd73c1567d0 0x7fd73c143580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T01:59:42.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd7412ab700 1 --2- 172.21.15.42:0/4181943911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd73c0c7210 0x7fd73c1e2f50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd72c00e8d0 tx=0x7fd72c00ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:42.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd731ffb700 1 -- 172.21.15.42:0/4181943911 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c013680 con 0x7fd73c0c7210 2023-07-29T01:59:42.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd731ffb700 1 -- 172.21.15.42:0/4181943911 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72c0137e0 con 0x7fd73c0c7210 2023-07-29T01:59:42.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd731ffb700 1 -- 172.21.15.42:0/4181943911 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c013b90 con 0x7fd73c0c7210 2023-07-29T01:59:42.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.275+0000 7fd74350f700 1 -- 172.21.15.42:0/4181943911 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73c1f2d60 con 0x7fd73c0c7210 2023-07-29T01:59:42.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.276+0000 7fd74350f700 1 -- 172.21.15.42:0/4181943911 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73c143ac0 con 0x7fd73c0c7210 2023-07-29T01:59:42.270 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.276+0000 7fd731ffb700 1 -- 172.21.15.42:0/4181943911 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd72c005a20 con 0x7fd73c0c7210 2023-07-29T01:59:42.270 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.276+0000 7fd731ffb700 1 -- 172.21.15.42:0/4181943911 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd72c005cd0 con 0x7fd73c0c7210 2023-07-29T01:59:42.270 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.277+0000 7fd74350f700 1 -- 172.21.15.42:0/4181943911 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73c1ef0b0 con 0x7fd73c0c7210 2023-07-29T01:59:42.270 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.281+0000 7fd731ffb700 1 -- 172.21.15.42:0/4181943911 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fd72c021060 con 0x7fd73c0c7210 2023-07-29T01:59:42.339 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.351+0000 7fd74350f700 1 -- 172.21.15.42:0/4181943911 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd73c074740 con 0x7fd73c0c7210 2023-07-29T01:59:42.340 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.352+0000 7fd731ffb700 1 -- 172.21.15.42:0/4181943911 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd72c017070 con 0x7fd73c0c7210 2023-07-29T01:59:42.340 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:42.341 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T01:59:42.057866+0000","last_up_change":"0.000000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T01:59:42.341 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.353+0000 7fd74350f700 1 -- 172.21.15.42:0/4181943911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd73c0c7210 msgr2=0x7fd73c1e2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:42.342 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.353+0000 7fd74350f700 1 --2- 172.21.15.42:0/4181943911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd73c0c7210 0x7fd73c1e2f50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd72c00e8d0 tx=0x7fd72c00ebe0 comp rx=0 tx=0).stop 2023-07-29T01:59:42.342 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.353+0000 7fd74350f700 1 -- 172.21.15.42:0/4181943911 shutdown_connections 2023-07-29T01:59:42.342 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.353+0000 7fd74350f700 1 --2- 172.21.15.42:0/4181943911 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd73c159e90 0x7fd73c0c8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:42.342 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.353+0000 7fd74350f700 1 --2- 172.21.15.42:0/4181943911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd73c0c7210 0x7fd73c1e2f50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:42.342 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.353+0000 7fd74350f700 1 --2- 172.21.15.42:0/4181943911 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd73c1567d0 0x7fd73c143580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:42.342 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.353+0000 7fd74350f700 1 -- 172.21.15.42:0/4181943911 >> 172.21.15.42:0/4181943911 conn(0x7fd73c0c8970 msgr2=0x7fd73c151d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:42.343 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.353+0000 7fd74350f700 1 -- 172.21.15.42:0/4181943911 shutdown_connections 2023-07-29T01:59:42.343 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:42.353+0000 7fd74350f700 1 -- 172.21.15.42:0/4181943911 wait complete. 2023-07-29T01:59:42.353 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-29T01:59:42.354 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-29T01:59:42.704 INFO:tasks.ceph.osd.1.smithi042.stderr:2023-07-29T01:59:42.716+0000 7f980667a640 -1 Falling back to public interface 2023-07-29T01:59:42.706 INFO:tasks.ceph.osd.2.smithi042.stderr:2023-07-29T01:59:42.718+0000 7f78f13be640 -1 Falling back to public interface 2023-07-29T01:59:42.710 INFO:tasks.ceph.osd.0.smithi042.stderr:2023-07-29T01:59:42.722+0000 7fc0b793d640 -1 Falling back to public interface 2023-07-29T01:59:42.711 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:42.724+0000 7f97f03a5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-29T01:59:42.715 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-07-29T01:59:42.728+0000 7fa584082640 -1 Falling back to public interface 2023-07-29T01:59:42.718 INFO:tasks.ceph.osd.3.smithi042.stderr:2023-07-29T01:59:42.730+0000 7f50a4fbb640 -1 Falling back to public interface 2023-07-29T01:59:42.720 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-07-29T01:59:42.733+0000 7fcd791a4640 -1 Falling back to public interface 2023-07-29T01:59:42.732 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-07-29T01:59:42.745+0000 7fc191417640 -1 Falling back to public interface 2023-07-29T01:59:42.740 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-07-29T01:59:42.750+0000 7f3ff26b2640 -1 Falling back to public interface 2023-07-29T01:59:42.791 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:42.804+0000 7f97f03a5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-29T01:59:42.798 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:42.810+0000 7f037bb9f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-29T01:59:42.881 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:42.891+0000 7f037bb9f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-29T01:59:42.929 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:42.942+0000 7f97f03a5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-29T01:59:43.025 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:43.036+0000 7f037bb9f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-29T01:59:43.160 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-29T01:59:43.162 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:43.175+0000 7f97f03a5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-29T01:59:43.235 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:43.248+0000 7f97f03a5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-29T01:59:43.269 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:43.281+0000 7f037bb9f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-29T01:59:43.276 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.288+0000 7ff97f364700 1 Processor -- start 2023-07-29T01:59:43.276 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.288+0000 7ff97f364700 1 -- start start 2023-07-29T01:59:43.277 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.289+0000 7ff97f364700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff97814ca00 0x7ff97806c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:43.277 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.289+0000 7ff97f364700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff97806ce40 con 0x7ff97814c630 2023-07-29T01:59:43.278 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.289+0000 7ff97f364700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff978155d50 con 0x7ff9780c7270 2023-07-29T01:59:43.278 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.289+0000 7ff97f364700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff978156010 con 0x7ff97814ca00 2023-07-29T01:59:43.278 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.289+0000 7ff97d100700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff97814c630 0x7ff9780c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:48920/0 (socket says 172.21.15.42:48920) 2023-07-29T01:59:43.278 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.289+0000 7ff97d100700 1 -- 172.21.15.42:0/3229506117 learned_addr learned my addr 172.21.15.42:0/3229506117 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T01:59:43.278 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.289+0000 7ff97c8ff700 1 --2- 172.21.15.42:0/3229506117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff97814ca00 0x7ff97806c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:43.278 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.289+0000 7ff96ffff700 1 -- 172.21.15.42:0/3229506117 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192808412 0 0) 0x7ff97806ce40 con 0x7ff97814c630 2023-07-29T01:59:43.278 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.289+0000 7ff96ffff700 1 -- 172.21.15.42:0/3229506117 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9640035b0 con 0x7ff97814c630 2023-07-29T01:59:43.278 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.289+0000 7ff96ffff700 1 -- 172.21.15.42:0/3229506117 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290272301 0 0) 0x7ff978155d50 con 0x7ff9780c7270 2023-07-29T01:59:43.279 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.289+0000 7ff96ffff700 1 -- 172.21.15.42:0/3229506117 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff97806ce40 con 0x7ff9780c7270 2023-07-29T01:59:43.279 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.289+0000 7ff97c8ff700 1 -- 172.21.15.42:0/3229506117 >> v1:172.21.15.144:6789/0 conn(0x7ff9780c7270 legacy=0x7ff97806d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:43.279 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.289+0000 7ff97c8ff700 1 -- 172.21.15.42:0/3229506117 >> v1:172.21.15.42:6789/0 conn(0x7ff97814c630 legacy=0x7ff9780c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:43.279 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.289+0000 7ff97c8ff700 1 -- 172.21.15.42:0/3229506117 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9781562f0 con 0x7ff97814ca00 2023-07-29T01:59:43.279 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.289+0000 7ff97c8ff700 1 --2- 172.21.15.42:0/3229506117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff97814ca00 0x7ff97806c270 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff968009870 tx=0x7ff968009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec706a50dee9f314 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:43.281 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.290+0000 7ff96ffff700 1 -- 172.21.15.42:0/3229506117 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff968011830 con 0x7ff97814ca00 2023-07-29T01:59:43.281 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.290+0000 7ff96ffff700 1 -- 172.21.15.42:0/3229506117 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff968011990 con 0x7ff97814ca00 2023-07-29T01:59:43.281 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.290+0000 7ff96ffff700 1 -- 172.21.15.42:0/3229506117 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff968011d20 con 0x7ff97814ca00 2023-07-29T01:59:43.282 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.290+0000 7ff97f364700 1 -- 172.21.15.42:0/3229506117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff97814ca00 msgr2=0x7ff97806c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:43.282 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.290+0000 7ff97f364700 1 --2- 172.21.15.42:0/3229506117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff97814ca00 0x7ff97806c270 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff968009870 tx=0x7ff968009b80 comp rx=0 tx=0).stop 2023-07-29T01:59:43.282 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.290+0000 7ff97f364700 1 -- 172.21.15.42:0/3229506117 shutdown_connections 2023-07-29T01:59:43.282 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.290+0000 7ff97f364700 1 --2- 172.21.15.42:0/3229506117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff97814ca00 0x7ff97806c270 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:43.282 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.290+0000 7ff97f364700 1 -- 172.21.15.42:0/3229506117 >> 172.21.15.42:0/3229506117 conn(0x7ff9780c8970 msgr2=0x7ff9780c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:43.282 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.290+0000 7ff97f364700 1 -- 172.21.15.42:0/3229506117 shutdown_connections 2023-07-29T01:59:43.282 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.290+0000 7ff97f364700 1 -- 172.21.15.42:0/3229506117 wait complete. 2023-07-29T01:59:43.283 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.292+0000 7ff97f364700 1 Processor -- start 2023-07-29T01:59:43.283 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.292+0000 7ff97f364700 1 -- start start 2023-07-29T01:59:43.283 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.292+0000 7ff97f364700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9780c7270 0x7ff9780c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:43.283 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.292+0000 7ff97f364700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff97814c630 0x7ff9781df160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:43.283 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.292+0000 7ff97f364700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9781df6a0 0x7ff9780c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:43.283 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.292+0000 7ff97f364700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9780c5700 con 0x7ff97814c630 2023-07-29T01:59:43.283 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.292+0000 7ff97f364700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9781e0790 con 0x7ff9781df6a0 2023-07-29T01:59:43.283 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.292+0000 7ff97f364700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9781556b0 con 0x7ff9780c7270 2023-07-29T01:59:43.284 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.292+0000 7ff97c8ff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff97814c630 0x7ff9781df160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:43.284 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.292+0000 7ff97d100700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9780c7270 0x7ff9780c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:43.284 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.292+0000 7ff97c8ff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff97814c630 0x7ff9781df160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55124/0 (socket says 172.21.15.42:55124) 2023-07-29T01:59:43.284 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.292+0000 7ff97c8ff700 1 -- 172.21.15.42:0/642853828 learned_addr learned my addr 172.21.15.42:0/642853828 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:43.284 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.292+0000 7ff97d901700 1 --2- 172.21.15.42:0/642853828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9781df6a0 0x7ff9780c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:43.284 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.293+0000 7ff97c8ff700 1 -- 172.21.15.42:0/642853828 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9780c7270 msgr2=0x7ff9780c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:43.284 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.293+0000 7ff97c8ff700 1 --2- 172.21.15.42:0/642853828 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9780c7270 0x7ff9780c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:43.285 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.293+0000 7ff97c8ff700 1 -- 172.21.15.42:0/642853828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9781df6a0 msgr2=0x7ff9780c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:43.285 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.293+0000 7ff97c8ff700 1 --2- 172.21.15.42:0/642853828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9781df6a0 0x7ff9780c33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:43.285 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.293+0000 7ff97c8ff700 1 -- 172.21.15.42:0/642853828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9680094a0 con 0x7ff97814c630 2023-07-29T01:59:43.285 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.293+0000 7ff97c8ff700 1 --2- 172.21.15.42:0/642853828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff97814c630 0x7ff9781df160 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff9680090b0 tx=0x7ff968004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:43.285 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.293+0000 7ff96dffb700 1 -- 172.21.15.42:0/642853828 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96801a6e0 con 0x7ff97814c630 2023-07-29T01:59:43.285 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.293+0000 7ff96dffb700 1 -- 172.21.15.42:0/642853828 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96801a840 con 0x7ff97814c630 2023-07-29T01:59:43.285 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.293+0000 7ff97f364700 1 -- 172.21.15.42:0/642853828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff978154c10 con 0x7ff97814c630 2023-07-29T01:59:43.285 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.293+0000 7ff96dffb700 1 -- 172.21.15.42:0/642853828 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96801abb0 con 0x7ff97814c630 2023-07-29T01:59:43.286 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.293+0000 7ff97f364700 1 -- 172.21.15.42:0/642853828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9781e1b90 con 0x7ff97814c630 2023-07-29T01:59:43.286 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.293+0000 7ff96dffb700 1 -- 172.21.15.42:0/642853828 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff968022070 con 0x7ff97814c630 2023-07-29T01:59:43.286 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.294+0000 7ff96dffb700 1 -- 172.21.15.42:0/642853828 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff96801ad10 con 0x7ff97814c630 2023-07-29T01:59:43.286 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.294+0000 7ff97f364700 1 -- 172.21.15.42:0/642853828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff978074740 con 0x7ff97814c630 2023-07-29T01:59:43.287 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.297+0000 7ff96dffb700 1 -- 172.21.15.42:0/642853828 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7ff968029070 con 0x7ff97814c630 2023-07-29T01:59:43.349 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:43.361+0000 7f037bb9f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-29T01:59:43.356 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.367+0000 7ff97f364700 1 -- 172.21.15.42:0/642853828 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff97804ea50 con 0x7ff97814c630 2023-07-29T01:59:43.357 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.368+0000 7ff96dffb700 1 -- 172.21.15.42:0/642853828 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff968015020 con 0x7ff97814c630 2023-07-29T01:59:43.357 INFO:teuthology.misc.health.smithi042.stdout: 2023-07-29T01:59:43.358 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":10,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T01:59:42.057866+0000","last_up_change":"0.000000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T01:59:43.359 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.369+0000 7ff97f364700 1 -- 172.21.15.42:0/642853828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff97814c630 msgr2=0x7ff9781df160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:43.360 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.369+0000 7ff97f364700 1 --2- 172.21.15.42:0/642853828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff97814c630 0x7ff9781df160 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff9680090b0 tx=0x7ff968004750 comp rx=0 tx=0).stop 2023-07-29T01:59:43.360 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.369+0000 7ff97f364700 1 -- 172.21.15.42:0/642853828 shutdown_connections 2023-07-29T01:59:43.360 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.369+0000 7ff97f364700 1 --2- 172.21.15.42:0/642853828 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9781df6a0 0x7ff9780c33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:43.360 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.369+0000 7ff97f364700 1 --2- 172.21.15.42:0/642853828 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9780c7270 0x7ff9780c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:43.361 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.369+0000 7ff97f364700 1 --2- 172.21.15.42:0/642853828 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff97814c630 0x7ff9781df160 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:43.361 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.369+0000 7ff97f364700 1 -- 172.21.15.42:0/642853828 >> 172.21.15.42:0/642853828 conn(0x7ff9780c8970 msgr2=0x7ff97814a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:43.361 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.369+0000 7ff97f364700 1 -- 172.21.15.42:0/642853828 shutdown_connections 2023-07-29T01:59:43.362 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:43.369+0000 7ff97f364700 1 -- 172.21.15.42:0/642853828 wait complete. 2023-07-29T01:59:43.368 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-29T01:59:43.512 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:43.524+0000 7f97f03a5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-29T01:59:43.633 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:43.645+0000 7f037bb9f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-29T01:59:43.731 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:43.743+0000 7f97f03a5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-29T01:59:43.859 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:43.871+0000 7f037bb9f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-29T01:59:43.885 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:43.898+0000 7f97f03a5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-29T01:59:43.998 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:44.011+0000 7f97f03a5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-29T01:59:44.020 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:44.032+0000 7f037bb9f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-29T01:59:44.141 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:44.153+0000 7f037bb9f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-29T01:59:44.322 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:44.335+0000 7f97f03a5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-29T01:59:44.423 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:44.435+0000 7f97f03a5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-29T01:59:44.474 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:44.486+0000 7f037bb9f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-29T01:59:44.577 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:44.589+0000 7f037bb9f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-29T01:59:44.605 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:44.618+0000 7f97f03a5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-29T01:59:44.767 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:44.779+0000 7f037bb9f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-29T01:59:45.192 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:45.205+0000 7f97f03a5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-29T01:59:45.392 INFO:tasks.ceph.mgr.y.smithi042.stderr:2023-07-29T01:59:45.404+0000 7f037bb9f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-29T01:59:46.208 INFO:tasks.ceph.osd.3.smithi042.stderr:2023-07-29T01:59:46.220+0000 7f50a4fbb640 -1 osd.3 0 log_to_monitors true 2023-07-29T01:59:46.218 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-07-29T01:59:46.231+0000 7fcd791a4640 -1 osd.5 0 log_to_monitors true 2023-07-29T01:59:46.220 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:46.232+0000 7f97a860b700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-29T01:59:46.224 INFO:tasks.ceph.mgr.x.smithi144.stderr:2023-07-29T01:59:46.237+0000 7f97a860b700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-29T01:59:46.250 INFO:tasks.ceph.osd.2.smithi042.stderr:2023-07-29T01:59:46.262+0000 7f78f13be640 -1 osd.2 0 log_to_monitors true 2023-07-29T01:59:46.252 INFO:tasks.ceph.osd.0.smithi042.stderr:2023-07-29T01:59:46.264+0000 7fc0b793d640 -1 osd.0 0 log_to_monitors true 2023-07-29T01:59:46.252 INFO:tasks.ceph.osd.1.smithi042.stderr:2023-07-29T01:59:46.264+0000 7f980667a640 -1 osd.1 0 log_to_monitors true 2023-07-29T01:59:46.290 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-07-29T01:59:46.303+0000 7f3ff26b2640 -1 osd.6 0 log_to_monitors true 2023-07-29T01:59:46.294 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-07-29T01:59:46.307+0000 7fa584082640 -1 osd.4 0 log_to_monitors true 2023-07-29T01:59:46.297 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-07-29T01:59:46.310+0000 7fc191417640 -1 osd.7 0 log_to_monitors true 2023-07-29T01:59:48.274 INFO:tasks.ceph.osd.1.smithi042.stderr:2023-07-29T01:59:48.286+0000 7f97faa32700 -1 osd.1 0 waiting for initial osdmap 2023-07-29T01:59:48.295 INFO:tasks.ceph.osd.1.smithi042.stderr:2023-07-29T01:59:48.306+0000 7f97f260c700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-29T01:59:48.296 INFO:tasks.ceph.osd.3.smithi042.stderr:2023-07-29T01:59:48.308+0000 7f5099b74700 -1 osd.3 0 waiting for initial osdmap 2023-07-29T01:59:48.310 INFO:tasks.ceph.osd.3.smithi042.stderr:2023-07-29T01:59:48.322+0000 7f5090f4d700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-29T01:59:48.320 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-07-29T01:59:48.333+0000 7fcd6d55c700 -1 osd.5 0 waiting for initial osdmap 2023-07-29T01:59:48.332 INFO:tasks.ceph.osd.5.smithi144.stderr:2023-07-29T01:59:48.345+0000 7fcd65136700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-29T01:59:48.339 INFO:tasks.ceph.osd.2.smithi042.stderr:2023-07-29T01:59:48.350+0000 7f78e5776700 -1 osd.2 0 waiting for initial osdmap 2023-07-29T01:59:48.354 INFO:tasks.ceph.osd.2.smithi042.stderr:2023-07-29T01:59:48.366+0000 7f78dd350700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-29T01:59:48.356 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-07-29T01:59:48.368+0000 7fa57843a700 -1 osd.4 0 waiting for initial osdmap 2023-07-29T01:59:48.367 INFO:tasks.ceph.osd.4.smithi144.stderr:2023-07-29T01:59:48.380+0000 7fa570014700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-29T01:59:48.368 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-07-29T01:59:48.380+0000 7fc1857cf700 -1 osd.7 0 waiting for initial osdmap 2023-07-29T01:59:48.384 INFO:tasks.ceph.osd.7.smithi144.stderr:2023-07-29T01:59:48.397+0000 7fc17d3a9700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-29T01:59:48.415 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-07-29T01:59:48.428+0000 7f3fe726b700 -1 osd.6 0 waiting for initial osdmap 2023-07-29T01:59:48.427 INFO:tasks.ceph.osd.6.smithi144.stderr:2023-07-29T01:59:48.440+0000 7f3fde644700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-29T01:59:48.993 INFO:tasks.ceph.osd.0.smithi042.stderr:2023-07-29T01:59:49.005+0000 7fc0abcf5700 -1 osd.0 0 waiting for initial osdmap 2023-07-29T01:59:49.003 INFO:tasks.ceph.osd.0.smithi042.stderr:2023-07-29T01:59:49.015+0000 7fc0a38cf700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-29T01:59:50.173 DEBUG:teuthology.orchestra.run.smithi042:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-29T01:59:50.303 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.315+0000 7f4dc8e2f700 1 Processor -- start 2023-07-29T01:59:50.303 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.315+0000 7f4dc8e2f700 1 -- start start 2023-07-29T01:59:50.306 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.316+0000 7f4dc8e2f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4dc41533f0 0x7f4dc4072980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:50.306 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.316+0000 7f4dc8e2f700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4dc40c8450 0x7f4dc40719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:50.306 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.316+0000 7f4dc8e2f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4dc406d2c0 0x7f4dc406a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:50.306 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.316+0000 7f4dc8e2f700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc4071190 con 0x7f4dc40c8450 2023-07-29T01:59:50.306 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.316+0000 7f4dc8e2f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc4071410 con 0x7f4dc41533f0 2023-07-29T01:59:50.306 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.316+0000 7f4dc8e2f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40716f0 con 0x7f4dc406d2c0 2023-07-29T01:59:50.307 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.316+0000 7f4dc1d9b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4dc40c8450 0x7f4dc40719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:50.307 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.316+0000 7f4dc1d9b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4dc40c8450 0x7f4dc40719a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55318/0 (socket says 172.21.15.42:55318) 2023-07-29T01:59:50.307 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.316+0000 7f4dc1d9b700 1 -- 172.21.15.42:0/4242986712 learned_addr learned my addr 172.21.15.42:0/4242986712 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:50.307 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.316+0000 7f4dc259c700 1 --2- 172.21.15.42:0/4242986712 >> v2:172.21.15.144:3300/0 conn(0x7f4dc41533f0 0x7f4dc4072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:50.307 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.316+0000 7f4dc2d9d700 1 --2- 172.21.15.42:0/4242986712 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4dc406d2c0 0x7f4dc406a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:50.307 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.317+0000 7f4dc1d9b700 1 -- 172.21.15.42:0/4242986712 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4dc406d2c0 msgr2=0x7f4dc406a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:50.307 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.317+0000 7f4dc1d9b700 1 --2- 172.21.15.42:0/4242986712 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4dc406d2c0 0x7f4dc406a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:50.308 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.317+0000 7f4dc1d9b700 1 -- 172.21.15.42:0/4242986712 >> v2:172.21.15.144:3300/0 conn(0x7f4dc41533f0 msgr2=0x7f4dc4072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:50.308 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.317+0000 7f4dc1d9b700 1 --2- 172.21.15.42:0/4242986712 >> v2:172.21.15.144:3300/0 conn(0x7f4dc41533f0 0x7f4dc4072980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:50.308 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.317+0000 7f4dc1d9b700 1 -- 172.21.15.42:0/4242986712 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc40c68d0 con 0x7f4dc40c8450 2023-07-29T01:59:50.308 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.317+0000 7f4dc2d9d700 1 --2- 172.21.15.42:0/4242986712 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4dc406d2c0 0x7f4dc406a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T01:59:50.308 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.317+0000 7f4dc1d9b700 1 --2- 172.21.15.42:0/4242986712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dc40c8450 0x7f4dc40719a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4070f90 tx=0x7f4db4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51b3e18eaa9d740 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:50.308 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.317+0000 7f4dc159a700 1 -- 172.21.15.42:0/4242986712 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4011830 con 0x7f4dc40c8450 2023-07-29T01:59:50.309 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.317+0000 7f4dc159a700 1 -- 172.21.15.42:0/4242986712 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db4011990 con 0x7f4dc40c8450 2023-07-29T01:59:50.309 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.317+0000 7f4dc159a700 1 -- 172.21.15.42:0/4242986712 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4011d20 con 0x7f4dc40c8450 2023-07-29T01:59:50.309 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.317+0000 7f4dc8e2f700 1 -- 172.21.15.42:0/4242986712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dc40c8450 msgr2=0x7f4dc40719a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:50.309 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.317+0000 7f4dc8e2f700 1 --2- 172.21.15.42:0/4242986712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dc40c8450 0x7f4dc40719a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4070f90 tx=0x7f4db4009bd0 comp rx=0 tx=0).stop 2023-07-29T01:59:50.309 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.317+0000 7f4dc8e2f700 1 -- 172.21.15.42:0/4242986712 shutdown_connections 2023-07-29T01:59:50.310 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.317+0000 7f4dc8e2f700 1 --2- 172.21.15.42:0/4242986712 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4dc406d2c0 0x7f4dc406a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:50.310 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.318+0000 7f4dc8e2f700 1 --2- 172.21.15.42:0/4242986712 >> v2:172.21.15.144:3300/0 conn(0x7f4dc41533f0 0x7f4dc4072980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:50.310 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.318+0000 7f4dc8e2f700 1 --2- 172.21.15.42:0/4242986712 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dc40c8450 0x7f4dc40719a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:50.310 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.318+0000 7f4dc8e2f700 1 -- 172.21.15.42:0/4242986712 >> 172.21.15.42:0/4242986712 conn(0x7f4dc40c8930 msgr2=0x7f4dc40c8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:50.310 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.318+0000 7f4dc8e2f700 1 -- 172.21.15.42:0/4242986712 shutdown_connections 2023-07-29T01:59:50.310 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.318+0000 7f4dc8e2f700 1 -- 172.21.15.42:0/4242986712 wait complete. 2023-07-29T01:59:50.313 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.319+0000 7f4dc8e2f700 1 Processor -- start 2023-07-29T01:59:50.313 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.319+0000 7f4dc8e2f700 1 -- start start 2023-07-29T01:59:50.313 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.320+0000 7f4dc8e2f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dc406d2c0 0x7f4dc4148930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:50.313 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.320+0000 7f4dc8e2f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4dc41533f0 0x7f4dc414a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:50.313 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.320+0000 7f4dc8e2f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dc4147780 0x7f4dc4142a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:50.314 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.320+0000 7f4dc8e2f700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc415c110 con 0x7f4dc4147780 2023-07-29T01:59:50.314 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.320+0000 7f4dc8e2f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc4148e70 con 0x7f4dc406d2c0 2023-07-29T01:59:50.314 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.320+0000 7f4dc8e2f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc414a570 con 0x7f4dc41533f0 2023-07-29T01:59:50.314 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.320+0000 7f4dc2d9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dc4147780 0x7f4dc4142a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:50.314 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.320+0000 7f4dc2d9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dc4147780 0x7f4dc4142a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55326/0 (socket says 172.21.15.42:55326) 2023-07-29T01:59:50.314 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.320+0000 7f4dc2d9d700 1 -- 172.21.15.42:0/1218876013 learned_addr learned my addr 172.21.15.42:0/1218876013 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:50.314 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.320+0000 7f4dc1d9b700 1 --2- 172.21.15.42:0/1218876013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4dc41533f0 0x7f4dc414a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:50.314 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.320+0000 7f4dc259c700 1 --2- 172.21.15.42:0/1218876013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dc406d2c0 0x7f4dc4148930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:50.315 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.320+0000 7f4dc2d9d700 1 -- 172.21.15.42:0/1218876013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4dc41533f0 msgr2=0x7f4dc414a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:50.315 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.320+0000 7f4dc2d9d700 1 --2- 172.21.15.42:0/1218876013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4dc41533f0 0x7f4dc414a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:50.315 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.320+0000 7f4dc2d9d700 1 -- 172.21.15.42:0/1218876013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dc406d2c0 msgr2=0x7f4dc4148930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:50.315 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.320+0000 7f4dc2d9d700 1 --2- 172.21.15.42:0/1218876013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dc406d2c0 0x7f4dc4148930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:50.315 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.320+0000 7f4dc2d9d700 1 -- 172.21.15.42:0/1218876013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db4009550 con 0x7f4dc4147780 2023-07-29T01:59:50.315 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.320+0000 7f4dc2d9d700 1 --2- 172.21.15.42:0/1218876013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dc4147780 0x7f4dc4142a10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc007dc0 tx=0x7f4dbc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:50.315 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.320+0000 7f4db2ffd700 1 -- 172.21.15.42:0/1218876013 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc00ddd0 con 0x7f4dc4147780 2023-07-29T01:59:50.316 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.321+0000 7f4db2ffd700 1 -- 172.21.15.42:0/1218876013 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc00f040 con 0x7f4dc4147780 2023-07-29T01:59:50.316 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.321+0000 7f4dc8e2f700 1 -- 172.21.15.42:0/1218876013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc415c9b0 con 0x7f4dc4147780 2023-07-29T01:59:50.316 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.321+0000 7f4db2ffd700 1 -- 172.21.15.42:0/1218876013 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc015640 con 0x7f4dc4147780 2023-07-29T01:59:50.316 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.321+0000 7f4dc8e2f700 1 -- 172.21.15.42:0/1218876013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc415d0e0 con 0x7f4dc4147780 2023-07-29T01:59:50.316 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.322+0000 7f4dc8e2f700 1 -- 172.21.15.42:0/1218876013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc406da10 con 0x7f4dc4147780 2023-07-29T01:59:50.316 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.322+0000 7f4db2ffd700 1 -- 172.21.15.42:0/1218876013 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 88153+0+0 (secure 0 0 0) 0x7f4dbc01e3b0 con 0x7f4dc4147780 2023-07-29T01:59:50.316 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.322+0000 7f4db2ffd700 1 --2- 172.21.15.42:0/1218876013 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4da406a600 0x7f4da406cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:50.316 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.323+0000 7f4db2ffd700 1 -- 172.21.15.42:0/1218876013 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f4dbc088410 con 0x7f4dc4147780 2023-07-29T01:59:50.317 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.323+0000 7f4dc259c700 1 --2- 172.21.15.42:0/1218876013 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4da406a600 0x7f4da406cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:50.317 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.323+0000 7f4dc259c700 1 --2- 172.21.15.42:0/1218876013 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4da406a600 0x7f4da406cab0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4dc406fb20 tx=0x7f4db8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:50.317 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.327+0000 7f4db2ffd700 1 -- 172.21.15.42:0/1218876013 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f4dbc053fb0 con 0x7f4dc4147780 2023-07-29T01:59:50.514 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.526+0000 7f4dc8e2f700 1 -- 172.21.15.42:0/1218876013 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4dc404ea50 con 0x7f4dc4147780 2023-07-29T01:59:50.515 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.527+0000 7f4db2ffd700 1 -- 172.21.15.42:0/1218876013 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10720 (secure 0 0 0) 0x7f4dbc0575d0 con 0x7f4dc4147780 2023-07-29T01:59:50.515 INFO:teuthology.misc.health.smithi042.stdout: 2023-07-29T01:59:50.515 INFO:teuthology.misc.health.smithi042.stdout:{"epoch":14,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T01:59:50.295289+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T01:59:50.517 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.529+0000 7f4dc8e2f700 1 -- 172.21.15.42:0/1218876013 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4da406a600 msgr2=0x7f4da406cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:50.517 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.529+0000 7f4dc8e2f700 1 --2- 172.21.15.42:0/1218876013 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4da406a600 0x7f4da406cab0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4dc406fb20 tx=0x7f4db8008040 comp rx=0 tx=0).stop 2023-07-29T01:59:50.517 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.529+0000 7f4dc8e2f700 1 -- 172.21.15.42:0/1218876013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dc4147780 msgr2=0x7f4dc4142a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:50.517 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.529+0000 7f4dc8e2f700 1 --2- 172.21.15.42:0/1218876013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dc4147780 0x7f4dc4142a10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc007dc0 tx=0x7f4dbc00d3b0 comp rx=0 tx=0).stop 2023-07-29T01:59:50.518 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.529+0000 7f4dc8e2f700 1 -- 172.21.15.42:0/1218876013 shutdown_connections 2023-07-29T01:59:50.518 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.529+0000 7f4dc8e2f700 1 --2- 172.21.15.42:0/1218876013 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4da406a600 0x7f4da406cab0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:50.518 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.529+0000 7f4dc8e2f700 1 --2- 172.21.15.42:0/1218876013 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4dc4147780 0x7f4dc4142a10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:50.518 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.529+0000 7f4dc8e2f700 1 --2- 172.21.15.42:0/1218876013 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4dc406d2c0 0x7f4dc4148930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:50.518 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.529+0000 7f4dc8e2f700 1 --2- 172.21.15.42:0/1218876013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4dc41533f0 0x7f4dc414a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:50.518 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.529+0000 7f4dc8e2f700 1 -- 172.21.15.42:0/1218876013 >> 172.21.15.42:0/1218876013 conn(0x7f4dc40c8930 msgr2=0x7f4dc40c8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:50.518 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.529+0000 7f4dc8e2f700 1 -- 172.21.15.42:0/1218876013 shutdown_connections 2023-07-29T01:59:50.519 INFO:teuthology.misc.health.smithi042.stderr:2023-07-29T01:59:50.529+0000 7f4dc8e2f700 1 -- 172.21.15.42:0/1218876013 wait complete. 2023-07-29T01:59:50.528 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-29T01:59:50.528 INFO:tasks.ceph:Creating RBD pool 2023-07-29T01:59:50.529 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-29T01:59:50.654 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.666+0000 7f9a2302f700 1 Processor -- start 2023-07-29T01:59:50.654 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.666+0000 7f9a2302f700 1 -- start start 2023-07-29T01:59:50.657 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a2302f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9a1c071840 0x7f9a1c06f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:50.657 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a2302f700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1c06c870 con 0x7f9a1c1531a0 2023-07-29T01:59:50.657 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a2302f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1c06fa50 con 0x7f9a1c0c8580 2023-07-29T01:59:50.657 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a2302f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1c0c74a0 con 0x7f9a1c071840 2023-07-29T01:59:50.657 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a20dcb700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f9a1c1531a0 0x7f9a1c15c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49134/0 (socket says 172.21.15.42:49134) 2023-07-29T01:59:50.657 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a20dcb700 1 -- 172.21.15.42:0/2890429346 learned_addr learned my addr 172.21.15.42:0/2890429346 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T01:59:50.658 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a1b7fe700 1 -- 172.21.15.42:0/2890429346 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389961171 0 0) 0x7f9a1c06c870 con 0x7f9a1c1531a0 2023-07-29T01:59:50.658 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a215cc700 1 --2- 172.21.15.42:0/2890429346 >> v2:172.21.15.144:3300/0 conn(0x7f9a1c071840 0x7f9a1c06f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:50.658 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a1b7fe700 1 -- 172.21.15.42:0/2890429346 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a0c0035b0 con 0x7f9a1c1531a0 2023-07-29T01:59:50.658 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a1b7fe700 1 -- 172.21.15.42:0/2890429346 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2853091030 0 0) 0x7f9a0c0035b0 con 0x7f9a1c1531a0 2023-07-29T01:59:50.658 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a1b7fe700 1 -- 172.21.15.42:0/2890429346 >> v2:172.21.15.144:3300/0 conn(0x7f9a1c071840 msgr2=0x7f9a1c06f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:50.658 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a1b7fe700 1 --2- 172.21.15.42:0/2890429346 >> v2:172.21.15.144:3300/0 conn(0x7f9a1c071840 0x7f9a1c06f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:50.658 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a1b7fe700 1 -- 172.21.15.42:0/2890429346 >> v1:172.21.15.144:6789/0 conn(0x7f9a1c0c8580 legacy=0x7f9a1c06a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:50.659 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a1b7fe700 1 -- 172.21.15.42:0/2890429346 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c06d450 con 0x7f9a1c1531a0 2023-07-29T01:59:50.659 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a1b7fe700 1 -- 172.21.15.42:0/2890429346 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7f9a10001670 con 0x7f9a1c1531a0 2023-07-29T01:59:50.659 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a1b7fe700 1 -- 172.21.15.42:0/2890429346 >> v1:172.21.15.42:6789/0 conn(0x7f9a1c1531a0 legacy=0x7f9a1c15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:50.659 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a1b7fe700 1 --2- 172.21.15.42:0/2890429346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a0c003a00 0x7f9a0c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:50.659 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a1b7fe700 1 --2- 172.21.15.42:0/2890429346 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a0c004850 0x7f9a0c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:50.659 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a1b7fe700 1 --2- 172.21.15.42:0/2890429346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a0c005200 0x7f9a0c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:50.659 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a1b7fe700 1 -- 172.21.15.42:0/2890429346 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c00c060 con 0x7f9a0c005200 2023-07-29T01:59:50.660 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a1b7fe700 1 -- 172.21.15.42:0/2890429346 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c00c1d0 con 0x7f9a0c003a00 2023-07-29T01:59:50.660 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.667+0000 7f9a1b7fe700 1 -- 172.21.15.42:0/2890429346 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c00c390 con 0x7f9a0c004850 2023-07-29T01:59:50.660 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.668+0000 7f9a215cc700 1 --2- 172.21.15.42:0/2890429346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a0c005200 0x7f9a0c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:50.660 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.668+0000 7f9a20dcb700 1 --2- 172.21.15.42:0/2890429346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a0c003a00 0x7f9a0c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:50.660 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.668+0000 7f9a1bfff700 1 --2- 172.21.15.42:0/2890429346 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a0c004850 0x7f9a0c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:50.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.668+0000 7f9a215cc700 1 -- 172.21.15.42:0/2890429346 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a0c004850 msgr2=0x7f9a0c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:50.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.668+0000 7f9a215cc700 1 --2- 172.21.15.42:0/2890429346 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a0c004850 0x7f9a0c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:50.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.668+0000 7f9a215cc700 1 -- 172.21.15.42:0/2890429346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a0c003a00 msgr2=0x7f9a0c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:50.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.668+0000 7f9a215cc700 1 --2- 172.21.15.42:0/2890429346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a0c003a00 0x7f9a0c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:50.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.668+0000 7f9a215cc700 1 -- 172.21.15.42:0/2890429346 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c0035b0 con 0x7f9a0c005200 2023-07-29T01:59:50.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.668+0000 7f9a1bfff700 1 --2- 172.21.15.42:0/2890429346 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a0c004850 0x7f9a0c004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T01:59:50.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.668+0000 7f9a215cc700 1 -- 172.21.15.42:0/2890429346 reap_dead start 2023-07-29T01:59:50.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.668+0000 7f9a215cc700 1 --2- 172.21.15.42:0/2890429346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a0c005200 0x7f9a0c00ba10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009fc0 tx=0x7f9a0c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac57a648abaa1ea server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:50.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.668+0000 7f9a1b7fe700 1 -- 172.21.15.42:0/2890429346 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14003a20 con 0x7f9a0c005200 2023-07-29T01:59:50.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.668+0000 7f9a1b7fe700 1 -- 172.21.15.42:0/2890429346 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1400f040 con 0x7f9a0c005200 2023-07-29T01:59:50.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.668+0000 7f9a1b7fe700 1 -- 172.21.15.42:0/2890429346 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14003de0 con 0x7f9a0c005200 2023-07-29T01:59:50.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.669+0000 7f9a2302f700 1 -- 172.21.15.42:0/2890429346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a0c005200 msgr2=0x7f9a0c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:50.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.669+0000 7f9a2302f700 1 --2- 172.21.15.42:0/2890429346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a0c005200 0x7f9a0c00ba10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009fc0 tx=0x7f9a0c005880 comp rx=0 tx=0).stop 2023-07-29T01:59:50.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.669+0000 7f9a2302f700 1 -- 172.21.15.42:0/2890429346 shutdown_connections 2023-07-29T01:59:50.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.669+0000 7f9a2302f700 1 --2- 172.21.15.42:0/2890429346 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a0c005200 0x7f9a0c00ba10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:50.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.669+0000 7f9a2302f700 1 -- 172.21.15.42:0/2890429346 >> 172.21.15.42:0/2890429346 conn(0x7f9a1c0cbf10 msgr2=0x7f9a1c0cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:50.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.669+0000 7f9a2302f700 1 -- 172.21.15.42:0/2890429346 shutdown_connections 2023-07-29T01:59:50.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.669+0000 7f9a2302f700 1 -- 172.21.15.42:0/2890429346 wait complete. 2023-07-29T01:59:50.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.670+0000 7f9a2302f700 1 Processor -- start 2023-07-29T01:59:50.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.670+0000 7f9a2302f700 1 -- start start 2023-07-29T01:59:50.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a2302f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a0c005200 0x7f9a1c1e28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:50.666 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a2302f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a1c148810 0x7f9a1c1578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:50.666 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a2302f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a1c1e3440 0x7f9a1c1e38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:50.666 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a2302f700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c151af0 con 0x7f9a0c005200 2023-07-29T01:59:50.666 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a2302f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c151f10 con 0x7f9a1c1e3440 2023-07-29T01:59:50.666 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a2302f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c14e620 con 0x7f9a1c148810 2023-07-29T01:59:50.666 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a20dcb700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a0c005200 0x7f9a1c1e28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:50.666 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a20dcb700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a0c005200 0x7f9a1c1e28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55340/0 (socket says 172.21.15.42:55340) 2023-07-29T01:59:50.667 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a20dcb700 1 -- 172.21.15.42:0/4149430927 learned_addr learned my addr 172.21.15.42:0/4149430927 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:50.667 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a1bfff700 1 --2- 172.21.15.42:0/4149430927 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a1c148810 0x7f9a1c1578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:50.667 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a215cc700 1 --2- 172.21.15.42:0/4149430927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a1c1e3440 0x7f9a1c1e38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:50.667 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a20dcb700 1 -- 172.21.15.42:0/4149430927 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a1c148810 msgr2=0x7f9a1c1578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:50.667 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a20dcb700 1 --2- 172.21.15.42:0/4149430927 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a1c148810 0x7f9a1c1578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:50.667 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a20dcb700 1 -- 172.21.15.42:0/4149430927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a1c1e3440 msgr2=0x7f9a1c1e38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:50.667 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a20dcb700 1 --2- 172.21.15.42:0/4149430927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a1c1e3440 0x7f9a1c1e38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:50.667 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a20dcb700 1 -- 172.21.15.42:0/4149430927 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c14e870 con 0x7f9a0c005200 2023-07-29T01:59:50.668 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a20dcb700 1 --2- 172.21.15.42:0/4149430927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a0c005200 0x7f9a1c1e28e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9a100072f0 tx=0x7f9a10007600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:50.668 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a197fa700 1 -- 172.21.15.42:0/4149430927 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a10011580 con 0x7f9a0c005200 2023-07-29T01:59:50.668 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a197fa700 1 -- 172.21.15.42:0/4149430927 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a10011700 con 0x7f9a0c005200 2023-07-29T01:59:50.668 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a197fa700 1 -- 172.21.15.42:0/4149430927 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a10011ab0 con 0x7f9a0c005200 2023-07-29T01:59:50.668 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.671+0000 7f9a2302f700 1 -- 172.21.15.42:0/4149430927 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1c14eb50 con 0x7f9a0c005200 2023-07-29T01:59:50.668 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.672+0000 7f9a2302f700 1 -- 172.21.15.42:0/4149430927 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a1c151710 con 0x7f9a0c005200 2023-07-29T01:59:50.668 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.672+0000 7f9a2302f700 1 -- 172.21.15.42:0/4149430927 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a1c0c6470 con 0x7f9a0c005200 2023-07-29T01:59:50.669 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.673+0000 7f9a197fa700 1 -- 172.21.15.42:0/4149430927 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 88153+0+0 (secure 0 0 0) 0x7f9a10011c10 con 0x7f9a0c005200 2023-07-29T01:59:50.669 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.673+0000 7f9a197fa700 1 --2- 172.21.15.42:0/4149430927 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a0006a5d0 0x7f9a0006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:50.669 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.673+0000 7f9a197fa700 1 -- 172.21.15.42:0/4149430927 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f9a100879a0 con 0x7f9a0c005200 2023-07-29T01:59:50.669 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.673+0000 7f9a1bfff700 1 --2- 172.21.15.42:0/4149430927 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a0006a5d0 0x7f9a0006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:50.669 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.674+0000 7f9a1bfff700 1 --2- 172.21.15.42:0/4149430927 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a0006a5d0 0x7f9a0006ca80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c06b1b0 tx=0x7f9a08009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:50.670 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.677+0000 7f9a197fa700 1 -- 172.21.15.42:0/4149430927 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f9a100534b0 con 0x7f9a0c005200 2023-07-29T01:59:50.864 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:50.875+0000 7f9a2302f700 1 -- 172.21.15.42:0/4149430927 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f9a1c04ea50 con 0x7f9a0c005200 2023-07-29T01:59:51.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.435+0000 7f9a197fa700 1 -- 172.21.15.42:0/4149430927 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f9a1001a0a0 con 0x7f9a0c005200 2023-07-29T01:59:51.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.437+0000 7f9a2302f700 1 -- 172.21.15.42:0/4149430927 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a0006a5d0 msgr2=0x7f9a0006ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:51.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.438+0000 7f9a2302f700 1 --2- 172.21.15.42:0/4149430927 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a0006a5d0 0x7f9a0006ca80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c06b1b0 tx=0x7f9a08009040 comp rx=0 tx=0).stop 2023-07-29T01:59:51.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.438+0000 7f9a2302f700 1 -- 172.21.15.42:0/4149430927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a0c005200 msgr2=0x7f9a1c1e28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:51.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.438+0000 7f9a2302f700 1 --2- 172.21.15.42:0/4149430927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a0c005200 0x7f9a1c1e28e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9a100072f0 tx=0x7f9a10007600 comp rx=0 tx=0).stop 2023-07-29T01:59:51.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.438+0000 7f9a2302f700 1 -- 172.21.15.42:0/4149430927 shutdown_connections 2023-07-29T01:59:51.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.438+0000 7f9a2302f700 1 --2- 172.21.15.42:0/4149430927 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a0006a5d0 0x7f9a0006ca80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:51.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.438+0000 7f9a2302f700 1 --2- 172.21.15.42:0/4149430927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a1c1e3440 0x7f9a1c1e38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:51.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.438+0000 7f9a2302f700 1 --2- 172.21.15.42:0/4149430927 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a0c005200 0x7f9a1c1e28e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:51.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.438+0000 7f9a2302f700 1 --2- 172.21.15.42:0/4149430927 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a1c148810 0x7f9a1c1578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:51.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.438+0000 7f9a2302f700 1 -- 172.21.15.42:0/4149430927 >> 172.21.15.42:0/4149430927 conn(0x7f9a1c0cbf10 msgr2=0x7f9a1c0738a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:51.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.438+0000 7f9a2302f700 1 -- 172.21.15.42:0/4149430927 shutdown_connections 2023-07-29T01:59:51.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.438+0000 7f9a2302f700 1 -- 172.21.15.42:0/4149430927 wait complete. 2023-07-29T01:59:51.428 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'rbd' created 2023-07-29T01:59:51.441 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-29T01:59:51.574 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.585+0000 7fd65cddd700 1 Processor -- start 2023-07-29T01:59:51.574 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.585+0000 7fd65cddd700 1 -- start start 2023-07-29T01:59:51.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.586+0000 7fd65cddd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd658156c90 0x7fd6580c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:51.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.586+0000 7fd65cddd700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd658071240 con 0x7fd658150280 2023-07-29T01:59:51.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.586+0000 7fd65cddd700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6580717c0 con 0x7fd6580727b0 2023-07-29T01:59:51.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.586+0000 7fd65cddd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd658156160 con 0x7fd658156c90 2023-07-29T01:59:51.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd65659c700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd658150280 0x7fd65806cd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49168/0 (socket says 172.21.15.42:49168) 2023-07-29T01:59:51.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd65659c700 1 -- 172.21.15.42:0/506848401 learned_addr learned my addr 172.21.15.42:0/506848401 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T01:59:51.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd65559a700 1 -- 172.21.15.42:0/506848401 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924646645 0 0) 0x7fd658071240 con 0x7fd658150280 2023-07-29T01:59:51.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd656d9d700 1 --2- 172.21.15.42:0/506848401 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd658156c90 0x7fd6580c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:51.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd65559a700 1 -- 172.21.15.42:0/506848401 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6440035b0 con 0x7fd658150280 2023-07-29T01:59:51.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd65559a700 1 -- 172.21.15.42:0/506848401 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3154959882 0 0) 0x7fd6440035b0 con 0x7fd658150280 2023-07-29T01:59:51.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd65559a700 1 -- 172.21.15.42:0/506848401 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd658156c90 msgr2=0x7fd6580c2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:51.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd65559a700 1 --2- 172.21.15.42:0/506848401 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd658156c90 0x7fd6580c2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:51.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd65559a700 1 -- 172.21.15.42:0/506848401 >> v1:172.21.15.144:6789/0 conn(0x7fd6580727b0 legacy=0x7fd658156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:51.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd65559a700 1 -- 172.21.15.42:0/506848401 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6580714e0 con 0x7fd658150280 2023-07-29T01:59:51.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd65559a700 1 -- 172.21.15.42:0/506848401 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7fd648001670 con 0x7fd658150280 2023-07-29T01:59:51.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd65559a700 1 -- 172.21.15.42:0/506848401 >> v1:172.21.15.42:6789/0 conn(0x7fd658150280 legacy=0x7fd65806cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:51.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd65559a700 1 --2- 172.21.15.42:0/506848401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd644003a30 0x7fd644003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:51.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd65559a700 1 --2- 172.21.15.42:0/506848401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd644004850 0x7fd644004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:51.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd65559a700 1 --2- 172.21.15.42:0/506848401 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd658156c90 0x7fd644005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:51.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd65559a700 1 -- 172.21.15.42:0/506848401 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd658156160 con 0x7fd644004850 2023-07-29T01:59:51.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd65559a700 1 -- 172.21.15.42:0/506848401 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64400bac0 con 0x7fd644003a30 2023-07-29T01:59:51.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd65559a700 1 -- 172.21.15.42:0/506848401 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64400bc50 con 0x7fd658156c90 2023-07-29T01:59:51.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd655d9b700 1 --2- 172.21.15.42:0/506848401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd644004850 0x7fd644004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:51.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd65659c700 1 --2- 172.21.15.42:0/506848401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd644003a30 0x7fd644003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:51.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.587+0000 7fd656d9d700 1 --2- 172.21.15.42:0/506848401 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd658156c90 0x7fd644005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:51.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.588+0000 7fd655d9b700 1 -- 172.21.15.42:0/506848401 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd658156c90 msgr2=0x7fd644005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:51.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.588+0000 7fd655d9b700 1 --2- 172.21.15.42:0/506848401 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd658156c90 0x7fd644005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:51.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.588+0000 7fd655d9b700 1 -- 172.21.15.42:0/506848401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd644003a30 msgr2=0x7fd644003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:51.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.588+0000 7fd655d9b700 1 --2- 172.21.15.42:0/506848401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd644003a30 0x7fd644003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:51.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.588+0000 7fd655d9b700 1 -- 172.21.15.42:0/506848401 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6440035b0 con 0x7fd644004850 2023-07-29T01:59:51.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.588+0000 7fd655d9b700 1 --2- 172.21.15.42:0/506848401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd644004850 0x7fd644004cc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd6400017c0 tx=0x7fd644005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c93c3305f99a314 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:51.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.588+0000 7fd65559a700 1 -- 172.21.15.42:0/506848401 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6400052d0 con 0x7fd644004850 2023-07-29T01:59:51.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.588+0000 7fd65559a700 1 -- 172.21.15.42:0/506848401 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd640005430 con 0x7fd644004850 2023-07-29T01:59:51.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.588+0000 7fd65559a700 1 -- 172.21.15.42:0/506848401 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6400038c0 con 0x7fd644004850 2023-07-29T01:59:51.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.588+0000 7fd65cddd700 1 -- 172.21.15.42:0/506848401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd644004850 msgr2=0x7fd644004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:51.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.588+0000 7fd65cddd700 1 --2- 172.21.15.42:0/506848401 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd644004850 0x7fd644004cc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd6400017c0 tx=0x7fd644005880 comp rx=0 tx=0).stop 2023-07-29T01:59:51.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.588+0000 7fd656d9d700 1 -- 172.21.15.42:0/506848401 reap_dead start 2023-07-29T01:59:51.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.588+0000 7fd65cddd700 1 -- 172.21.15.42:0/506848401 shutdown_connections 2023-07-29T01:59:51.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.588+0000 7fd65cddd700 1 -- 172.21.15.42:0/506848401 >> 172.21.15.42:0/506848401 conn(0x7fd6580c8980 msgr2=0x7fd6580c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:51.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.589+0000 7fd65cddd700 1 -- 172.21.15.42:0/506848401 shutdown_connections 2023-07-29T01:59:51.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.589+0000 7fd65cddd700 1 -- 172.21.15.42:0/506848401 wait complete. 2023-07-29T01:59:51.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.590+0000 7fd65cddd700 1 Processor -- start 2023-07-29T01:59:51.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.590+0000 7fd65cddd700 1 -- start start 2023-07-29T01:59:51.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd65cddd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd644004850 0x7fd658164720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:51.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd65cddd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6580c75f0 0x7fd6580c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:51.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd65cddd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6580cab50 0x7fd658139810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:51.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd65cddd700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd658163d40 con 0x7fd644004850 2023-07-29T01:59:51.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd65cddd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6581393f0 con 0x7fd6580cab50 2023-07-29T01:59:51.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd65cddd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6581efb10 con 0x7fd6580c75f0 2023-07-29T01:59:51.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd65659c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd644004850 0x7fd658164720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:51.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd65659c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd644004850 0x7fd658164720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55376/0 (socket says 172.21.15.42:55376) 2023-07-29T01:59:51.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd65659c700 1 -- 172.21.15.42:0/3357839347 learned_addr learned my addr 172.21.15.42:0/3357839347 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:51.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd656d9d700 1 --2- 172.21.15.42:0/3357839347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6580cab50 0x7fd658139810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:51.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd655d9b700 1 --2- 172.21.15.42:0/3357839347 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6580c75f0 0x7fd6580c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:51.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd65659c700 1 -- 172.21.15.42:0/3357839347 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6580c75f0 msgr2=0x7fd6580c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:51.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd65659c700 1 --2- 172.21.15.42:0/3357839347 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6580c75f0 0x7fd6580c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:51.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd65659c700 1 -- 172.21.15.42:0/3357839347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6580cab50 msgr2=0x7fd658139810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:51.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd65659c700 1 --2- 172.21.15.42:0/3357839347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6580cab50 0x7fd658139810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:51.598 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd65659c700 1 -- 172.21.15.42:0/3357839347 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6581eef90 con 0x7fd644004850 2023-07-29T01:59:51.598 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd65659c700 1 --2- 172.21.15.42:0/3357839347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd644004850 0x7fd658164720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd6480072c0 tx=0x7fd6480075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:51.598 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd64effd700 1 -- 172.21.15.42:0/3357839347 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648011580 con 0x7fd644004850 2023-07-29T01:59:51.599 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd64effd700 1 -- 172.21.15.42:0/3357839347 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd648011700 con 0x7fd644004850 2023-07-29T01:59:51.599 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd65cddd700 1 -- 172.21.15.42:0/3357839347 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6581ef270 con 0x7fd644004850 2023-07-29T01:59:51.599 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd64effd700 1 -- 172.21.15.42:0/3357839347 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd648011ab0 con 0x7fd644004850 2023-07-29T01:59:51.599 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.591+0000 7fd65cddd700 1 -- 172.21.15.42:0/3357839347 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6581ef830 con 0x7fd644004850 2023-07-29T01:59:51.600 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.592+0000 7fd65cddd700 1 -- 172.21.15.42:0/3357839347 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65804ea50 con 0x7fd644004850 2023-07-29T01:59:51.600 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.593+0000 7fd64effd700 1 -- 172.21.15.42:0/3357839347 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 88153+0+0 (secure 0 0 0) 0x7fd648011c10 con 0x7fd644004850 2023-07-29T01:59:51.600 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.593+0000 7fd64effd700 1 --2- 172.21.15.42:0/3357839347 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fd63806a5d0 0x7fd63806ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:51.600 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.593+0000 7fd64effd700 1 -- 172.21.15.42:0/3357839347 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5188+0+0 (secure 0 0 0) 0x7fd6480886d0 con 0x7fd644004850 2023-07-29T01:59:51.601 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.594+0000 7fd655d9b700 1 --2- 172.21.15.42:0/3357839347 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fd63806a5d0 0x7fd63806ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:51.601 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.594+0000 7fd655d9b700 1 --2- 172.21.15.42:0/3357839347 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fd63806a5d0 0x7fd63806ca80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd640000ff0 tx=0x7fd640009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:51.602 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.598+0000 7fd64effd700 1 -- 172.21.15.42:0/3357839347 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fd648053e80 con 0x7fd644004850 2023-07-29T01:59:51.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:51.798+0000 7fd65cddd700 1 -- 172.21.15.42:0/3357839347 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd658139150 con 0x7fd644004850 2023-07-29T01:59:52.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.442+0000 7fd64effd700 1 -- 172.21.15.42:0/3357839347 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd6480574a0 con 0x7fd644004850 2023-07-29T01:59:52.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.446+0000 7fd65cddd700 1 -- 172.21.15.42:0/3357839347 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fd63806a5d0 msgr2=0x7fd63806ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:52.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.446+0000 7fd65cddd700 1 --2- 172.21.15.42:0/3357839347 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fd63806a5d0 0x7fd63806ca80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd640000ff0 tx=0x7fd640009030 comp rx=0 tx=0).stop 2023-07-29T01:59:52.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.446+0000 7fd65cddd700 1 -- 172.21.15.42:0/3357839347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd644004850 msgr2=0x7fd658164720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:52.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.446+0000 7fd65cddd700 1 --2- 172.21.15.42:0/3357839347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd644004850 0x7fd658164720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd6480072c0 tx=0x7fd6480075d0 comp rx=0 tx=0).stop 2023-07-29T01:59:52.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.446+0000 7fd65cddd700 1 -- 172.21.15.42:0/3357839347 shutdown_connections 2023-07-29T01:59:52.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.446+0000 7fd65cddd700 1 --2- 172.21.15.42:0/3357839347 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fd63806a5d0 0x7fd63806ca80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:52.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.446+0000 7fd65cddd700 1 --2- 172.21.15.42:0/3357839347 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6580cab50 0x7fd658139810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:52.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.446+0000 7fd65cddd700 1 --2- 172.21.15.42:0/3357839347 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd644004850 0x7fd658164720 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:52.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.446+0000 7fd65cddd700 1 --2- 172.21.15.42:0/3357839347 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd6580c75f0 0x7fd6580c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:52.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.446+0000 7fd65cddd700 1 -- 172.21.15.42:0/3357839347 >> 172.21.15.42:0/3357839347 conn(0x7fd6580c8980 msgr2=0x7fd6580cb520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:52.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.446+0000 7fd65cddd700 1 -- 172.21.15.42:0/3357839347 shutdown_connections 2023-07-29T01:59:52.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.446+0000 7fd65cddd700 1 -- 172.21.15.42:0/3357839347 wait complete. 2023-07-29T01:59:52.436 INFO:teuthology.orchestra.run.smithi042.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-29T01:59:52.450 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-29T01:59:52.450 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-29T01:59:52.451 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-29T01:59:52.453 INFO:tasks.ceph.mds.a:Started 2023-07-29T01:59:52.453 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-29T01:59:52.453 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-29T01:59:52.455 INFO:tasks.ceph.mds.c:Started 2023-07-29T01:59:52.455 INFO:tasks.ceph.mds.e:Restarting daemon 2023-07-29T01:59:52.456 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2023-07-29T01:59:52.457 INFO:tasks.ceph.mds.e:Started 2023-07-29T01:59:52.458 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-29T01:59:52.458 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-29T01:59:52.460 INFO:tasks.ceph.mds.b:Started 2023-07-29T01:59:52.460 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-29T01:59:52.461 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-29T01:59:52.462 INFO:tasks.ceph.mds.d:Started 2023-07-29T01:59:52.463 INFO:tasks.ceph.mds.f:Restarting daemon 2023-07-29T01:59:52.463 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2023-07-29T01:59:52.465 INFO:tasks.ceph.mds.f:Started 2023-07-29T01:59:52.466 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-29T01:59:52.466 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T01:59:52.555 INFO:tasks.ceph.mds.c.smithi042.stdout:starting mds.c at 2023-07-29T01:59:52.559 INFO:tasks.ceph.mds.a.smithi042.stdout:starting mds.a at 2023-07-29T01:59:52.560 INFO:tasks.ceph.mds.f.smithi144.stdout:starting mds.f at 2023-07-29T01:59:52.560 INFO:tasks.ceph.mds.b.smithi144.stdout:starting mds.b at 2023-07-29T01:59:52.561 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-07-29T01:59:52.562 INFO:tasks.ceph.mds.e.smithi042.stdout:starting mds.e at 2023-07-29T01:59:52.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.631+0000 7faea9686700 1 Processor -- start 2023-07-29T01:59:52.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.631+0000 7faea9686700 1 -- start start 2023-07-29T01:59:52.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.632+0000 7faea9686700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faea4153210 0x7faea40c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:52.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.632+0000 7faea9686700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7faea40cc820 0x7faea415c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:52.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.632+0000 7faea9686700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faea40c6980 0x7faea415cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:52.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.632+0000 7faea9686700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea40c7b00 con 0x7faea40cc820 2023-07-29T01:59:52.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.632+0000 7faea9686700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea4159be0 con 0x7faea4153210 2023-07-29T01:59:52.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.632+0000 7faea9686700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea4159ec0 con 0x7faea40c6980 2023-07-29T01:59:52.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.632+0000 7faea27fc700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7faea40cc820 0x7faea415c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:52.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.632+0000 7faea27fc700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7faea40cc820 0x7faea415c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55440/0 (socket says 172.21.15.42:55440) 2023-07-29T01:59:52.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.632+0000 7faea27fc700 1 -- 172.21.15.42:0/3318479959 learned_addr learned my addr 172.21.15.42:0/3318479959 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:52.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.632+0000 7faea2ffd700 1 --2- 172.21.15.42:0/3318479959 >> v2:172.21.15.144:3300/0 conn(0x7faea4153210 0x7faea40c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:52.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.632+0000 7faea37fe700 1 --2- 172.21.15.42:0/3318479959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faea40c6980 0x7faea415cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:52.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.632+0000 7faea27fc700 1 -- 172.21.15.42:0/3318479959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faea40c6980 msgr2=0x7faea415cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:52.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.632+0000 7faea27fc700 1 --2- 172.21.15.42:0/3318479959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faea40c6980 0x7faea415cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:52.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.632+0000 7faea27fc700 1 -- 172.21.15.42:0/3318479959 >> v2:172.21.15.144:3300/0 conn(0x7faea4153210 msgr2=0x7faea40c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:52.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.632+0000 7faea27fc700 1 --2- 172.21.15.42:0/3318479959 >> v2:172.21.15.144:3300/0 conn(0x7faea4153210 0x7faea40c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:52.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.632+0000 7faea27fc700 1 -- 172.21.15.42:0/3318479959 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea40c71d0 con 0x7faea40cc820 2023-07-29T01:59:52.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.632+0000 7faea37fe700 1 --2- 172.21.15.42:0/3318479959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faea40c6980 0x7faea415cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T01:59:52.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.632+0000 7faea27fc700 1 --2- 172.21.15.42:0/3318479959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faea40cc820 0x7faea415c5d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faea4070ac0 tx=0x7fae8c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf1735f63d55e005 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:52.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.633+0000 7faea1ffb700 1 -- 172.21.15.42:0/3318479959 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c011830 con 0x7faea40cc820 2023-07-29T01:59:52.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.633+0000 7faea1ffb700 1 -- 172.21.15.42:0/3318479959 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8c011990 con 0x7faea40cc820 2023-07-29T01:59:52.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.633+0000 7faea1ffb700 1 -- 172.21.15.42:0/3318479959 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8c011d20 con 0x7faea40cc820 2023-07-29T01:59:52.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.633+0000 7faea9686700 1 -- 172.21.15.42:0/3318479959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faea40cc820 msgr2=0x7faea415c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:52.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.633+0000 7faea9686700 1 --2- 172.21.15.42:0/3318479959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faea40cc820 0x7faea415c5d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faea4070ac0 tx=0x7fae8c009bd0 comp rx=0 tx=0).stop 2023-07-29T01:59:52.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.633+0000 7faea9686700 1 -- 172.21.15.42:0/3318479959 shutdown_connections 2023-07-29T01:59:52.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.633+0000 7faea9686700 1 --2- 172.21.15.42:0/3318479959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faea40c6980 0x7faea415cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:52.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.633+0000 7faea9686700 1 --2- 172.21.15.42:0/3318479959 >> v2:172.21.15.144:3300/0 conn(0x7faea4153210 0x7faea40c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:52.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.633+0000 7faea9686700 1 --2- 172.21.15.42:0/3318479959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faea40cc820 0x7faea415c5d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:52.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.633+0000 7faea9686700 1 -- 172.21.15.42:0/3318479959 >> 172.21.15.42:0/3318479959 conn(0x7faea406f850 msgr2=0x7faea40cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:52.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.633+0000 7faea9686700 1 -- 172.21.15.42:0/3318479959 shutdown_connections 2023-07-29T01:59:52.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.633+0000 7faea9686700 1 -- 172.21.15.42:0/3318479959 wait complete. 2023-07-29T01:59:52.627 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.635+0000 7faea9686700 1 Processor -- start 2023-07-29T01:59:52.627 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.635+0000 7faea9686700 1 -- start start 2023-07-29T01:59:52.628 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.635+0000 7faea9686700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faea40c6980 0x7faea40c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:52.628 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.635+0000 7faea9686700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faea4153210 0x7faea414e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:52.628 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.635+0000 7faea9686700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faea4147770 0x7faea4147c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:52.628 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.635+0000 7faea9686700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea40ca3a0 con 0x7faea4147770 2023-07-29T01:59:52.628 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.635+0000 7faea9686700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea41e38c0 con 0x7faea4153210 2023-07-29T01:59:52.628 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.635+0000 7faea9686700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea40ca880 con 0x7faea40c6980 2023-07-29T01:59:52.629 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.635+0000 7faea37fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faea4147770 0x7faea4147c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:52.629 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.635+0000 7faea37fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faea4147770 0x7faea4147c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55448/0 (socket says 172.21.15.42:55448) 2023-07-29T01:59:52.629 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.636+0000 7faea37fe700 1 -- 172.21.15.42:0/3521449676 learned_addr learned my addr 172.21.15.42:0/3521449676 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:52.629 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.636+0000 7faea27fc700 1 --2- 172.21.15.42:0/3521449676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faea4153210 0x7faea414e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:52.629 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.636+0000 7faea2ffd700 1 --2- 172.21.15.42:0/3521449676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faea40c6980 0x7faea40c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:52.629 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.636+0000 7faea37fe700 1 -- 172.21.15.42:0/3521449676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faea40c6980 msgr2=0x7faea40c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:52.629 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.636+0000 7faea37fe700 1 --2- 172.21.15.42:0/3521449676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faea40c6980 0x7faea40c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:52.630 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.636+0000 7faea37fe700 1 -- 172.21.15.42:0/3521449676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faea4153210 msgr2=0x7faea414e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:52.630 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.636+0000 7faea37fe700 1 --2- 172.21.15.42:0/3521449676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faea4153210 0x7faea414e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:52.630 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.636+0000 7faea37fe700 1 -- 172.21.15.42:0/3521449676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c009550 con 0x7faea4147770 2023-07-29T01:59:52.630 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.636+0000 7faea37fe700 1 --2- 172.21.15.42:0/3521449676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faea4147770 0x7faea4147c10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fae9400d800 tx=0x7fae9400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:52.630 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.636+0000 7fae9b7fe700 1 -- 172.21.15.42:0/3521449676 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94004030 con 0x7faea4147770 2023-07-29T01:59:52.630 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.636+0000 7fae9b7fe700 1 -- 172.21.15.42:0/3521449676 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae94004190 con 0x7faea4147770 2023-07-29T01:59:52.630 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.636+0000 7faea9686700 1 -- 172.21.15.42:0/3521449676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea4148150 con 0x7faea4147770 2023-07-29T01:59:52.630 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.636+0000 7fae9b7fe700 1 -- 172.21.15.42:0/3521449676 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae94004520 con 0x7faea4147770 2023-07-29T01:59:52.631 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.636+0000 7faea9686700 1 -- 172.21.15.42:0/3521449676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea41e2540 con 0x7faea4147770 2023-07-29T01:59:52.631 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.637+0000 7faea9686700 1 -- 172.21.15.42:0/3521449676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea404ea50 con 0x7faea4147770 2023-07-29T01:59:52.631 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.638+0000 7fae9b7fe700 1 -- 172.21.15.42:0/3521449676 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 88153+0+0 (secure 0 0 0) 0x7fae940036a0 con 0x7faea4147770 2023-07-29T01:59:52.631 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.638+0000 7fae9b7fe700 1 --2- 172.21.15.42:0/3521449676 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fae8406a5d0 0x7fae8406ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:52.631 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.638+0000 7fae9b7fe700 1 -- 172.21.15.42:0/3521449676 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fae94087ef0 con 0x7faea4147770 2023-07-29T01:59:52.631 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.638+0000 7faea2ffd700 1 --2- 172.21.15.42:0/3521449676 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fae8406a5d0 0x7fae8406ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:52.631 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.638+0000 7faea2ffd700 1 --2- 172.21.15.42:0/3521449676 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fae8406a5d0 0x7fae8406ca80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fae9c011340 tx=0x7fae9c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:52.632 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.642+0000 7fae9b7fe700 1 -- 172.21.15.42:0/3521449676 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fae940537b0 con 0x7faea4147770 2023-07-29T01:59:52.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.851+0000 7faea9686700 1 -- 172.21.15.42:0/3521449676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faea406e070 con 0x7faea4147770 2023-07-29T01:59:52.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.853+0000 7fae9b7fe700 1 -- 172.21.15.42:0/3521449676 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+14233 (secure 0 0 0) 0x7fae94019090 con 0x7faea4147770 2023-07-29T01:59:52.841 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:52.841 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":16,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T01:59:52.435004+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T01:59:52.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.855+0000 7faea9686700 1 -- 172.21.15.42:0/3521449676 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fae8406a5d0 msgr2=0x7fae8406ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:52.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.855+0000 7faea9686700 1 --2- 172.21.15.42:0/3521449676 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fae8406a5d0 0x7fae8406ca80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fae9c011340 tx=0x7fae9c00b040 comp rx=0 tx=0).stop 2023-07-29T01:59:52.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.855+0000 7faea9686700 1 -- 172.21.15.42:0/3521449676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faea4147770 msgr2=0x7faea4147c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:52.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.855+0000 7faea9686700 1 --2- 172.21.15.42:0/3521449676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faea4147770 0x7faea4147c10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fae9400d800 tx=0x7fae9400db10 comp rx=0 tx=0).stop 2023-07-29T01:59:52.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.855+0000 7faea9686700 1 -- 172.21.15.42:0/3521449676 shutdown_connections 2023-07-29T01:59:52.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.855+0000 7faea9686700 1 --2- 172.21.15.42:0/3521449676 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fae8406a5d0 0x7fae8406ca80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:52.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.855+0000 7faea9686700 1 --2- 172.21.15.42:0/3521449676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faea4147770 0x7faea4147c10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:52.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.855+0000 7faea9686700 1 --2- 172.21.15.42:0/3521449676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faea40c6980 0x7faea40c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:52.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.855+0000 7faea9686700 1 --2- 172.21.15.42:0/3521449676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faea4153210 0x7faea414e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:52.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.855+0000 7faea9686700 1 -- 172.21.15.42:0/3521449676 >> 172.21.15.42:0/3521449676 conn(0x7faea406f850 msgr2=0x7faea4152130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:52.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.855+0000 7faea9686700 1 -- 172.21.15.42:0/3521449676 shutdown_connections 2023-07-29T01:59:52.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.855+0000 7faea9686700 1 -- 172.21.15.42:0/3521449676 wait complete. 2023-07-29T01:59:52.855 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-29T01:59:50.906228+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-29T01:59:51.290583+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-29T01:59:52.856 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-29T01:59:52.985 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.997+0000 7f8a74a99700 1 Processor -- start 2023-07-29T01:59:52.986 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.997+0000 7f8a74a99700 1 -- start start 2023-07-29T01:59:52.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.998+0000 7f8a74a99700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8a7006eda0 0x7f8a70155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:52.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.998+0000 7f8a74a99700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a7006cb10 con 0x7f8a70150030 2023-07-29T01:59:52.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.998+0000 7f8a74a99700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a70156280 con 0x7f8a7006cfa0 2023-07-29T01:59:52.990 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.998+0000 7f8a74a99700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a70156560 con 0x7f8a7006eda0 2023-07-29T01:59:52.990 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.998+0000 7f8a6ed9d700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f8a70150030 0x7f8a7006f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49262/0 (socket says 172.21.15.42:49262) 2023-07-29T01:59:52.990 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.998+0000 7f8a6ed9d700 1 -- 172.21.15.42:0/1729765914 learned_addr learned my addr 172.21.15.42:0/1729765914 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T01:59:52.990 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.999+0000 7f8a6e59c700 1 --2- 172.21.15.42:0/1729765914 >> v2:172.21.15.144:3300/0 conn(0x7f8a7006eda0 0x7f8a70155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:52.991 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.999+0000 7f8a6d59a700 1 -- 172.21.15.42:0/1729765914 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4070617487 0 0) 0x7f8a7006cb10 con 0x7f8a70150030 2023-07-29T01:59:52.991 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.999+0000 7f8a6d59a700 1 -- 172.21.15.42:0/1729765914 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a580035b0 con 0x7f8a70150030 2023-07-29T01:59:52.991 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.999+0000 7f8a6e59c700 1 -- 172.21.15.42:0/1729765914 >> v1:172.21.15.144:6789/0 conn(0x7f8a7006cfa0 legacy=0x7f8a7014f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:52.992 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.999+0000 7f8a6d59a700 1 -- 172.21.15.42:0/1729765914 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849141586 0 0) 0x7f8a70156280 con 0x7f8a7006cfa0 2023-07-29T01:59:52.992 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.999+0000 7f8a6e59c700 1 -- 172.21.15.42:0/1729765914 >> v1:172.21.15.42:6789/0 conn(0x7f8a70150030 legacy=0x7f8a7006f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:52.992 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.999+0000 7f8a6e59c700 1 -- 172.21.15.42:0/1729765914 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a70156840 con 0x7f8a7006eda0 2023-07-29T01:59:52.992 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.999+0000 7f8a6e59c700 1 --2- 172.21.15.42:0/1729765914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a7006eda0 0x7f8a70155bd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009840 tx=0x7f8a60009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=456e04c0de3d2ef5 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:52.993 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.999+0000 7f8a6d59a700 1 -- 172.21.15.42:0/1729765914 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68001970 con 0x7f8a7006eda0 2023-07-29T01:59:52.993 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.999+0000 7f8a6d59a700 1 -- 172.21.15.42:0/1729765914 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a60004030 con 0x7f8a7006eda0 2023-07-29T01:59:52.993 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:52.999+0000 7f8a6d59a700 1 -- 172.21.15.42:0/1729765914 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a600043c0 con 0x7f8a7006eda0 2023-07-29T01:59:52.993 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.000+0000 7f8a74a99700 1 -- 172.21.15.42:0/1729765914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a7006eda0 msgr2=0x7f8a70155bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:52.994 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.000+0000 7f8a74a99700 1 --2- 172.21.15.42:0/1729765914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a7006eda0 0x7f8a70155bd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009840 tx=0x7f8a60009b50 comp rx=0 tx=0).stop 2023-07-29T01:59:52.994 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.000+0000 7f8a74a99700 1 -- 172.21.15.42:0/1729765914 shutdown_connections 2023-07-29T01:59:52.994 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.000+0000 7f8a74a99700 1 --2- 172.21.15.42:0/1729765914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a7006eda0 0x7f8a70155bd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:52.994 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.000+0000 7f8a74a99700 1 -- 172.21.15.42:0/1729765914 >> 172.21.15.42:0/1729765914 conn(0x7f8a700cbf10 msgr2=0x7f8a700cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:52.995 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.000+0000 7f8a74a99700 1 -- 172.21.15.42:0/1729765914 shutdown_connections 2023-07-29T01:59:52.995 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.000+0000 7f8a74a99700 1 -- 172.21.15.42:0/1729765914 wait complete. 2023-07-29T01:59:52.998 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.002+0000 7f8a74a99700 1 Processor -- start 2023-07-29T01:59:52.998 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.002+0000 7f8a74a99700 1 -- start start 2023-07-29T01:59:52.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.002+0000 7f8a74a99700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8a7006cfa0 0x7f8a7006f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:52.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.002+0000 7f8a74a99700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a7006eda0 0x7f8a7014d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:52.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.002+0000 7f8a74a99700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a70150030 0x7f8a701464b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:53.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.002+0000 7f8a74a99700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7014c8c0 con 0x7f8a70150030 2023-07-29T01:59:53.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.002+0000 7f8a74a99700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7014e0a0 con 0x7f8a7006eda0 2023-07-29T01:59:53.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.002+0000 7f8a74a99700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a70153330 con 0x7f8a7006cfa0 2023-07-29T01:59:53.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.003+0000 7f8a6ed9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a70150030 0x7f8a701464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:53.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.003+0000 7f8a6ed9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a70150030 0x7f8a701464b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55464/0 (socket says 172.21.15.42:55464) 2023-07-29T01:59:53.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.003+0000 7f8a6ed9d700 1 -- 172.21.15.42:0/936037241 learned_addr learned my addr 172.21.15.42:0/936037241 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:53.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.003+0000 7f8a6dd9b700 1 --2- 172.21.15.42:0/936037241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a7006eda0 0x7f8a7014d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:53.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.003+0000 7f8a6e59c700 1 --2- 172.21.15.42:0/936037241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8a7006cfa0 0x7f8a7006f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:53.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.003+0000 7f8a6ed9d700 1 -- 172.21.15.42:0/936037241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8a7006cfa0 msgr2=0x7f8a7006f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:53.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.003+0000 7f8a6ed9d700 1 --2- 172.21.15.42:0/936037241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8a7006cfa0 0x7f8a7006f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:53.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.003+0000 7f8a6ed9d700 1 -- 172.21.15.42:0/936037241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a7006eda0 msgr2=0x7f8a7014d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:53.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.003+0000 7f8a6ed9d700 1 --2- 172.21.15.42:0/936037241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a7006eda0 0x7f8a7014d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:53.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.003+0000 7f8a6ed9d700 1 -- 172.21.15.42:0/936037241 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a600094a0 con 0x7f8a70150030 2023-07-29T01:59:53.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.003+0000 7f8a6ed9d700 1 --2- 172.21.15.42:0/936037241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a70150030 0x7f8a701464b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800ccd0 tx=0x7f8a6800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:53.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.003+0000 7f8a5effd700 1 -- 172.21.15.42:0/936037241 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6800ab30 con 0x7f8a70150030 2023-07-29T01:59:53.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.003+0000 7f8a5effd700 1 -- 172.21.15.42:0/936037241 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6800acb0 con 0x7f8a70150030 2023-07-29T01:59:53.004 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.003+0000 7f8a74a99700 1 -- 172.21.15.42:0/936037241 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a7014d060 con 0x7f8a70150030 2023-07-29T01:59:53.004 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.003+0000 7f8a5effd700 1 -- 172.21.15.42:0/936037241 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68007310 con 0x7f8a70150030 2023-07-29T01:59:53.004 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.003+0000 7f8a74a99700 1 -- 172.21.15.42:0/936037241 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a70152a00 con 0x7f8a70150030 2023-07-29T01:59:53.004 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.004+0000 7f8a74a99700 1 -- 172.21.15.42:0/936037241 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a7004ea50 con 0x7f8a70150030 2023-07-29T01:59:53.004 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.005+0000 7f8a5effd700 1 -- 172.21.15.42:0/936037241 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 88153+0+0 (secure 0 0 0) 0x7f8a68007470 con 0x7f8a70150030 2023-07-29T01:59:53.005 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.006+0000 7f8a5effd700 1 --2- 172.21.15.42:0/936037241 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8a5006a5d0 0x7f8a5006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:53.005 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.006+0000 7f8a5effd700 1 -- 172.21.15.42:0/936037241 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8a68088740 con 0x7f8a70150030 2023-07-29T01:59:53.005 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.006+0000 7f8a6e59c700 1 --2- 172.21.15.42:0/936037241 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8a5006a5d0 0x7f8a5006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:53.005 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.006+0000 7f8a6e59c700 1 --2- 172.21.15.42:0/936037241 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8a5006a5d0 0x7f8a5006ca80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009b90 tx=0x7f8a60008000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:53.006 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.011+0000 7f8a5effd700 1 -- 172.21.15.42:0/936037241 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f8a680540e0 con 0x7f8a70150030 2023-07-29T01:59:53.201 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.213+0000 7f8a74a99700 1 -- 172.21.15.42:0/936037241 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8a70155db0 con 0x7f8a70150030 2023-07-29T01:59:53.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.213+0000 7f8a5effd700 1 -- 172.21.15.42:0/936037241 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8a680180a0 con 0x7f8a70150030 2023-07-29T01:59:53.202 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 8 2023-07-29T01:59:53.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.215+0000 7f8a74a99700 1 -- 172.21.15.42:0/936037241 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8a5006a5d0 msgr2=0x7f8a5006ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:53.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.215+0000 7f8a74a99700 1 --2- 172.21.15.42:0/936037241 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8a5006a5d0 0x7f8a5006ca80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8a60009b90 tx=0x7f8a60008000 comp rx=0 tx=0).stop 2023-07-29T01:59:53.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.215+0000 7f8a74a99700 1 -- 172.21.15.42:0/936037241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a70150030 msgr2=0x7f8a701464b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:53.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.215+0000 7f8a74a99700 1 --2- 172.21.15.42:0/936037241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a70150030 0x7f8a701464b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800ccd0 tx=0x7f8a6800a060 comp rx=0 tx=0).stop 2023-07-29T01:59:53.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.216+0000 7f8a74a99700 1 -- 172.21.15.42:0/936037241 shutdown_connections 2023-07-29T01:59:53.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.216+0000 7f8a74a99700 1 --2- 172.21.15.42:0/936037241 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8a5006a5d0 0x7f8a5006ca80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:53.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.216+0000 7f8a74a99700 1 --2- 172.21.15.42:0/936037241 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8a70150030 0x7f8a701464b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:53.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.216+0000 7f8a74a99700 1 --2- 172.21.15.42:0/936037241 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8a7006cfa0 0x7f8a7006f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:53.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.216+0000 7f8a74a99700 1 --2- 172.21.15.42:0/936037241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a7006eda0 0x7f8a7014d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:53.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.216+0000 7f8a74a99700 1 -- 172.21.15.42:0/936037241 >> 172.21.15.42:0/936037241 conn(0x7f8a700cbf10 msgr2=0x7f8a700723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:53.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.216+0000 7f8a74a99700 1 -- 172.21.15.42:0/936037241 shutdown_connections 2023-07-29T01:59:53.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.216+0000 7f8a74a99700 1 -- 172.21.15.42:0/936037241 wait complete. 2023-07-29T01:59:53.215 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-29T01:59:53.343 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.355+0000 7f6e333bb700 1 Processor -- start 2023-07-29T01:59:53.344 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.355+0000 7f6e333bb700 1 -- start start 2023-07-29T01:59:53.350 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.356+0000 7f6e333bb700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6e2c06ce70 0x7f6e2c15c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:53.350 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.357+0000 7f6e333bb700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6e2c0c8000 0x7f6e2c163ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:53.351 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.357+0000 7f6e333bb700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2c070bc0 con 0x7f6e2c15cc80 2023-07-29T01:59:53.351 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.357+0000 7f6e333bb700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e2c153660 con 0x7f6e2c0c8000 2023-07-29T01:59:53.351 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.357+0000 7f6e333bb700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e2c159c20 con 0x7f6e2c06ce70 2023-07-29T01:59:53.351 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.357+0000 7f6e31157700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6e2c06ce70 0x7f6e2c15c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:53.351 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.357+0000 7f6e30956700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f6e2c15cc80 0x7f6e2c06fbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.42:51764/0 (socket says 172.21.15.42:51764) 2023-07-29T01:59:53.351 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.357+0000 7f6e30956700 1 -- 172.21.15.42:0/2213325220 learned_addr learned my addr 172.21.15.42:0/2213325220 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T01:59:53.351 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.357+0000 7f6e31958700 1 --2- 172.21.15.42:0/2213325220 >> v2:172.21.15.42:3300/0 conn(0x7f6e2c0c8000 0x7f6e2c163ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:53.351 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.357+0000 7f6e31157700 1 -- 172.21.15.42:0/2213325220 >> v2:172.21.15.42:3300/0 conn(0x7f6e2c0c8000 msgr2=0x7f6e2c163ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:53.352 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.357+0000 7f6e31157700 1 --2- 172.21.15.42:0/2213325220 >> v2:172.21.15.42:3300/0 conn(0x7f6e2c0c8000 0x7f6e2c163ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:53.352 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.357+0000 7f6e31157700 1 -- 172.21.15.42:0/2213325220 >> v1:172.21.15.144:6789/0 conn(0x7f6e2c15cc80 legacy=0x7f6e2c06fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:53.352 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.357+0000 7f6e23fff700 1 -- 172.21.15.42:0/2213325220 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2393909589 0 0) 0x7f6e2c070bc0 con 0x7f6e2c15cc80 2023-07-29T01:59:53.352 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.357+0000 7f6e31157700 1 -- 172.21.15.42:0/2213325220 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c06d240 con 0x7f6e2c06ce70 2023-07-29T01:59:53.352 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.357+0000 7f6e31157700 1 --2- 172.21.15.42:0/2213325220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e2c06ce70 0x7f6e2c15c740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c06df20 tx=0x7f6e28009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaf0161444b55a4f server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:53.352 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.358+0000 7f6e23fff700 1 -- 172.21.15.42:0/2213325220 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28011830 con 0x7f6e2c06ce70 2023-07-29T01:59:53.353 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.358+0000 7f6e23fff700 1 -- 172.21.15.42:0/2213325220 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e28011990 con 0x7f6e2c06ce70 2023-07-29T01:59:53.353 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.358+0000 7f6e23fff700 1 -- 172.21.15.42:0/2213325220 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28011d20 con 0x7f6e2c06ce70 2023-07-29T01:59:53.353 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.358+0000 7f6e333bb700 1 -- 172.21.15.42:0/2213325220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e2c06ce70 msgr2=0x7f6e2c15c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:53.353 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.358+0000 7f6e333bb700 1 --2- 172.21.15.42:0/2213325220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e2c06ce70 0x7f6e2c15c740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c06df20 tx=0x7f6e28009b20 comp rx=0 tx=0).stop 2023-07-29T01:59:53.353 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.358+0000 7f6e333bb700 1 -- 172.21.15.42:0/2213325220 shutdown_connections 2023-07-29T01:59:53.353 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.358+0000 7f6e333bb700 1 --2- 172.21.15.42:0/2213325220 >> v2:172.21.15.42:3300/0 conn(0x7f6e2c0c8000 0x7f6e2c163ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:53.353 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.358+0000 7f6e333bb700 1 --2- 172.21.15.42:0/2213325220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e2c06ce70 0x7f6e2c15c740 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:53.353 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.358+0000 7f6e333bb700 1 -- 172.21.15.42:0/2213325220 >> 172.21.15.42:0/2213325220 conn(0x7f6e2c0721c0 msgr2=0x7f6e2c0725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.358+0000 7f6e333bb700 1 -- 172.21.15.42:0/2213325220 shutdown_connections 2023-07-29T01:59:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.358+0000 7f6e333bb700 1 -- 172.21.15.42:0/2213325220 wait complete. 2023-07-29T01:59:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.360+0000 7f6e333bb700 1 Processor -- start 2023-07-29T01:59:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.360+0000 7f6e333bb700 1 -- start start 2023-07-29T01:59:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.361+0000 7f6e333bb700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e2c06ce70 0x7f6e2c0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.361+0000 7f6e333bb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e2c0c8000 0x7f6e2c14ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.361+0000 7f6e333bb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e2c15cc80 0x7f6e2c1f1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:53.354 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.361+0000 7f6e333bb700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c0cdac0 con 0x7f6e2c06ce70 2023-07-29T01:59:53.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.361+0000 7f6e333bb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c14b750 con 0x7f6e2c0c8000 2023-07-29T01:59:53.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.361+0000 7f6e333bb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e2c14b470 con 0x7f6e2c15cc80 2023-07-29T01:59:53.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.361+0000 7f6e31157700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e2c06ce70 0x7f6e2c0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:53.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.361+0000 7f6e31157700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e2c06ce70 0x7f6e2c0c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55474/0 (socket says 172.21.15.42:55474) 2023-07-29T01:59:53.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.361+0000 7f6e31157700 1 -- 172.21.15.42:0/863327709 learned_addr learned my addr 172.21.15.42:0/863327709 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:53.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.361+0000 7f6e30956700 1 --2- 172.21.15.42:0/863327709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e2c0c8000 0x7f6e2c14ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:53.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.361+0000 7f6e31958700 1 --2- 172.21.15.42:0/863327709 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e2c15cc80 0x7f6e2c1f1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:53.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.361+0000 7f6e31157700 1 -- 172.21.15.42:0/863327709 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e2c15cc80 msgr2=0x7f6e2c1f1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:53.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.361+0000 7f6e31157700 1 --2- 172.21.15.42:0/863327709 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e2c15cc80 0x7f6e2c1f1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:53.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.361+0000 7f6e31157700 1 -- 172.21.15.42:0/863327709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e2c0c8000 msgr2=0x7f6e2c14ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:53.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.361+0000 7f6e31157700 1 --2- 172.21.15.42:0/863327709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e2c0c8000 0x7f6e2c14ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:53.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.361+0000 7f6e31157700 1 -- 172.21.15.42:0/863327709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e280094a0 con 0x7f6e2c06ce70 2023-07-29T01:59:53.357 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.361+0000 7f6e30956700 1 --2- 172.21.15.42:0/863327709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e2c0c8000 0x7f6e2c14ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T01:59:53.357 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.361+0000 7f6e31157700 1 --2- 172.21.15.42:0/863327709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e2c06ce70 0x7f6e2c0c96a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6e280090b0 tx=0x7f6e28004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:53.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.435+0000 7f6e21ffb700 1 -- 172.21.15.42:0/863327709 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e280038a0 con 0x7f6e2c06ce70 2023-07-29T01:59:53.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.435+0000 7f6e21ffb700 1 -- 172.21.15.42:0/863327709 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2801f070 con 0x7f6e2c06ce70 2023-07-29T01:59:53.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.435+0000 7f6e333bb700 1 -- 172.21.15.42:0/863327709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e2c0cd120 con 0x7f6e2c06ce70 2023-07-29T01:59:53.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.436+0000 7f6e21ffb700 1 -- 172.21.15.42:0/863327709 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28003c20 con 0x7f6e2c06ce70 2023-07-29T01:59:53.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.436+0000 7f6e333bb700 1 -- 172.21.15.42:0/863327709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e2c0cd6e0 con 0x7f6e2c06ce70 2023-07-29T01:59:53.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.437+0000 7f6e333bb700 1 -- 172.21.15.42:0/863327709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e2c15a090 con 0x7f6e2c06ce70 2023-07-29T01:59:53.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.437+0000 7f6e21ffb700 1 -- 172.21.15.42:0/863327709 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 88153+0+0 (secure 0 0 0) 0x7f6e2801a430 con 0x7f6e2c06ce70 2023-07-29T01:59:53.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.438+0000 7f6e21ffb700 1 --2- 172.21.15.42:0/863327709 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6e1006a5d0 0x7f6e1006ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:53.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.438+0000 7f6e21ffb700 1 -- 172.21.15.42:0/863327709 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6e28021070 con 0x7f6e2c06ce70 2023-07-29T01:59:53.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.438+0000 7f6e30956700 1 --2- 172.21.15.42:0/863327709 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6e1006a5d0 0x7f6e1006ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:53.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.438+0000 7f6e30956700 1 --2- 172.21.15.42:0/863327709 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6e1006a5d0 0x7f6e1006ca80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c1e9260 tx=0x7f6e1c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:53.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.442+0000 7f6e21ffb700 1 -- 172.21.15.42:0/863327709 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f6e2c15a090 con 0x7f6e2c06ce70 2023-07-29T01:59:53.635 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.647+0000 7f6e333bb700 1 -- 172.21.15.42:0/863327709 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e2c15a090 con 0x7f6e2c06ce70 2023-07-29T01:59:53.635 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.647+0000 7f6e21ffb700 1 -- 172.21.15.42:0/863327709 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e2c15a090 con 0x7f6e2c06ce70 2023-07-29T01:59:53.636 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2023-07-29T01:59:53.637 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.649+0000 7f6e333bb700 1 -- 172.21.15.42:0/863327709 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6e1006a5d0 msgr2=0x7f6e1006ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:53.638 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.649+0000 7f6e333bb700 1 --2- 172.21.15.42:0/863327709 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6e1006a5d0 0x7f6e1006ca80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c1e9260 tx=0x7f6e1c007d30 comp rx=0 tx=0).stop 2023-07-29T01:59:53.638 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.649+0000 7f6e333bb700 1 -- 172.21.15.42:0/863327709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e2c06ce70 msgr2=0x7f6e2c0c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:53.638 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.649+0000 7f6e333bb700 1 --2- 172.21.15.42:0/863327709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e2c06ce70 0x7f6e2c0c96a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6e280090b0 tx=0x7f6e28004750 comp rx=0 tx=0).stop 2023-07-29T01:59:53.638 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.649+0000 7f6e333bb700 1 -- 172.21.15.42:0/863327709 shutdown_connections 2023-07-29T01:59:53.638 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.649+0000 7f6e333bb700 1 --2- 172.21.15.42:0/863327709 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6e1006a5d0 0x7f6e1006ca80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:53.638 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.649+0000 7f6e333bb700 1 --2- 172.21.15.42:0/863327709 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e2c15cc80 0x7f6e2c1f1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:53.638 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.649+0000 7f6e333bb700 1 --2- 172.21.15.42:0/863327709 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e2c06ce70 0x7f6e2c0c96a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:53.639 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.649+0000 7f6e333bb700 1 --2- 172.21.15.42:0/863327709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e2c0c8000 0x7f6e2c14ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:53.639 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.649+0000 7f6e333bb700 1 -- 172.21.15.42:0/863327709 >> 172.21.15.42:0/863327709 conn(0x7f6e2c0721c0 msgr2=0x7f6e2c158b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:53.639 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.649+0000 7f6e333bb700 1 -- 172.21.15.42:0/863327709 shutdown_connections 2023-07-29T01:59:53.639 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.649+0000 7f6e333bb700 1 -- 172.21.15.42:0/863327709 wait complete. 2023-07-29T01:59:53.649 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T01:59:53.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.785+0000 7f2c22d0e700 1 Processor -- start 2023-07-29T01:59:53.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.785+0000 7f2c22d0e700 1 -- start start 2023-07-29T01:59:53.779 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.786+0000 7f2c22d0e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c14ca00 0x7f2c1c06c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:53.779 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.786+0000 7f2c22d0e700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1c06ce40 con 0x7f2c1c0c7270 2023-07-29T01:59:53.779 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.786+0000 7f2c22d0e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1c155d50 con 0x7f2c1c14c630 2023-07-29T01:59:53.779 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.786+0000 7f2c22d0e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c156010 con 0x7f2c1c14ca00 2023-07-29T01:59:53.779 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.786+0000 7f2c212ab700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f2c1c0c7270 0x7f2c1c06d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49296/0 (socket says 172.21.15.42:49296) 2023-07-29T01:59:53.780 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.786+0000 7f2c212ab700 1 -- 172.21.15.42:0/767668590 learned_addr learned my addr 172.21.15.42:0/767668590 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T01:59:53.780 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.786+0000 7f2c1bfff700 1 --2- 172.21.15.42:0/767668590 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c14ca00 0x7f2c1c06c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:53.780 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.787+0000 7f2c1b7fe700 1 -- 172.21.15.42:0/767668590 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240543387 0 0) 0x7f2c1c06ce40 con 0x7f2c1c0c7270 2023-07-29T01:59:53.780 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.787+0000 7f2c1b7fe700 1 -- 172.21.15.42:0/767668590 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c0c0035b0 con 0x7f2c1c0c7270 2023-07-29T01:59:53.780 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.787+0000 7f2c1b7fe700 1 -- 172.21.15.42:0/767668590 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600388991 0 0) 0x7f2c1c155d50 con 0x7f2c1c14c630 2023-07-29T01:59:53.780 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.787+0000 7f2c1b7fe700 1 -- 172.21.15.42:0/767668590 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c1c06ce40 con 0x7f2c1c14c630 2023-07-29T01:59:53.780 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.787+0000 7f2c1bfff700 1 -- 172.21.15.42:0/767668590 >> v1:172.21.15.144:6789/0 conn(0x7f2c1c14c630 legacy=0x7f2c1c0c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:53.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.787+0000 7f2c1bfff700 1 -- 172.21.15.42:0/767668590 >> v1:172.21.15.42:6789/0 conn(0x7f2c1c0c7270 legacy=0x7f2c1c06d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:53.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.787+0000 7f2c1bfff700 1 -- 172.21.15.42:0/767668590 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c1562f0 con 0x7f2c1c14ca00 2023-07-29T01:59:53.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.787+0000 7f2c1bfff700 1 --2- 172.21.15.42:0/767668590 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c14ca00 0x7f2c1c06c270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009870 tx=0x7f2c08009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af33735ef8ebb75d server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:53.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.787+0000 7f2c1b7fe700 1 -- 172.21.15.42:0/767668590 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08011830 con 0x7f2c1c14ca00 2023-07-29T01:59:53.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.787+0000 7f2c1b7fe700 1 -- 172.21.15.42:0/767668590 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c08011990 con 0x7f2c1c14ca00 2023-07-29T01:59:53.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.787+0000 7f2c1b7fe700 1 -- 172.21.15.42:0/767668590 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08011d00 con 0x7f2c1c14ca00 2023-07-29T01:59:53.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.788+0000 7f2c22d0e700 1 -- 172.21.15.42:0/767668590 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c14ca00 msgr2=0x7f2c1c06c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:53.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.788+0000 7f2c22d0e700 1 --2- 172.21.15.42:0/767668590 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c14ca00 0x7f2c1c06c270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009870 tx=0x7f2c08009b80 comp rx=0 tx=0).stop 2023-07-29T01:59:53.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.788+0000 7f2c22d0e700 1 -- 172.21.15.42:0/767668590 shutdown_connections 2023-07-29T01:59:53.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.788+0000 7f2c22d0e700 1 --2- 172.21.15.42:0/767668590 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c14ca00 0x7f2c1c06c270 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:53.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.788+0000 7f2c22d0e700 1 -- 172.21.15.42:0/767668590 >> 172.21.15.42:0/767668590 conn(0x7f2c1c0c8970 msgr2=0x7f2c1c0c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:53.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.788+0000 7f2c22d0e700 1 -- 172.21.15.42:0/767668590 shutdown_connections 2023-07-29T01:59:53.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.788+0000 7f2c22d0e700 1 -- 172.21.15.42:0/767668590 wait complete. 2023-07-29T01:59:53.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.789+0000 7f2c22d0e700 1 Processor -- start 2023-07-29T01:59:53.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.789+0000 7f2c22d0e700 1 -- start start 2023-07-29T01:59:53.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c22d0e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c1c0c7270 0x7f2c1c151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:53.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c22d0e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c1c14c630 0x7f2c1c0c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:53.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c22d0e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c14b4e0 0x7f2c1c1eebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:53.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c22d0e700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c1ee790 con 0x7f2c1c14c630 2023-07-29T01:59:53.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c22d0e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c155cf0 con 0x7f2c1c0c7270 2023-07-29T01:59:53.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c22d0e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c154260 con 0x7f2c1c14b4e0 2023-07-29T01:59:53.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c1bfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c1c14c630 0x7f2c1c0c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:53.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c1bfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c1c14c630 0x7f2c1c0c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55496/0 (socket says 172.21.15.42:55496) 2023-07-29T01:59:53.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c1bfff700 1 -- 172.21.15.42:0/1090771920 learned_addr learned my addr 172.21.15.42:0/1090771920 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:53.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c20aaa700 1 --2- 172.21.15.42:0/1090771920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c1c0c7270 0x7f2c1c151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:53.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c212ab700 1 --2- 172.21.15.42:0/1090771920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c14b4e0 0x7f2c1c1eebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:53.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c1bfff700 1 -- 172.21.15.42:0/1090771920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c14b4e0 msgr2=0x7f2c1c1eebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:53.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c1bfff700 1 --2- 172.21.15.42:0/1090771920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c14b4e0 0x7f2c1c1eebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:53.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c1bfff700 1 -- 172.21.15.42:0/1090771920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c1c0c7270 msgr2=0x7f2c1c151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:53.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c1bfff700 1 --2- 172.21.15.42:0/1090771920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c1c0c7270 0x7f2c1c151390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c1bfff700 1 -- 172.21.15.42:0/1090771920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c080094a0 con 0x7f2c1c14c630 2023-07-29T01:59:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c212ab700 1 --2- 172.21.15.42:0/1090771920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c14b4e0 0x7f2c1c1eebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T01:59:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c1bfff700 1 --2- 172.21.15.42:0/1090771920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c1c14c630 0x7f2c1c0c8fb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2c080097c0 tx=0x7f2c08004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c197fa700 1 -- 172.21.15.42:0/1090771920 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08004550 con 0x7f2c1c14c630 2023-07-29T01:59:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c197fa700 1 -- 172.21.15.42:0/1090771920 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0801e070 con 0x7f2c1c14c630 2023-07-29T01:59:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c22d0e700 1 -- 172.21.15.42:0/1090771920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1c154520 con 0x7f2c1c14c630 2023-07-29T01:59:53.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.790+0000 7f2c197fa700 1 -- 172.21.15.42:0/1090771920 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c080038e0 con 0x7f2c1c14c630 2023-07-29T01:59:53.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.791+0000 7f2c22d0e700 1 -- 172.21.15.42:0/1090771920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1c155a10 con 0x7f2c1c14c630 2023-07-29T01:59:53.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.791+0000 7f2c22d0e700 1 -- 172.21.15.42:0/1090771920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c1c074740 con 0x7f2c1c14c630 2023-07-29T01:59:53.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.792+0000 7f2c197fa700 1 -- 172.21.15.42:0/1090771920 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 4) v1 ==== 88153+0+0 (secure 0 0 0) 0x7f2c08003a40 con 0x7f2c1c14c630 2023-07-29T01:59:53.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.792+0000 7f2c197fa700 1 --2- 172.21.15.42:0/1090771920 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2c0006a600 0x7f2c0006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:53.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.792+0000 7f2c197fa700 1 -- 172.21.15.42:0/1090771920 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2c080895a0 con 0x7f2c1c14c630 2023-07-29T01:59:53.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.792+0000 7f2c20aaa700 1 --2- 172.21.15.42:0/1090771920 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2c0006a600 0x7f2c0006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:53.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.793+0000 7f2c20aaa700 1 --2- 172.21.15.42:0/1090771920 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2c0006a600 0x7f2c0006cab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2c10001830 tx=0x7f2c10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:53.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:53.797+0000 7f2c197fa700 1 -- 172.21.15.42:0/1090771920 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f2c08054e60 con 0x7f2c1c14c630 2023-07-29T01:59:54.026 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.038+0000 7f2c22d0e700 1 -- 172.21.15.42:0/1090771920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c1c1ee8d0 con 0x7f2c1c14c630 2023-07-29T01:59:54.027 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.039+0000 7f2c197fa700 1 -- 172.21.15.42:0/1090771920 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5042 (secure 0 0 0) 0x7f2c08003cf0 con 0x7f2c1c14c630 2023-07-29T01:59:54.027 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:54.027 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4300,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/1851767861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1851767861},{"type":"v1","addr":"172.21.15.42:6837","nonce":1851767861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-29T01:59:54.029 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.041+0000 7f2c22d0e700 1 -- 172.21.15.42:0/1090771920 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2c0006a600 msgr2=0x7f2c0006cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:54.029 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.041+0000 7f2c22d0e700 1 --2- 172.21.15.42:0/1090771920 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2c0006a600 0x7f2c0006cab0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2c10001830 tx=0x7f2c10009040 comp rx=0 tx=0).stop 2023-07-29T01:59:54.029 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.041+0000 7f2c22d0e700 1 -- 172.21.15.42:0/1090771920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c1c14c630 msgr2=0x7f2c1c0c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:54.030 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.041+0000 7f2c22d0e700 1 --2- 172.21.15.42:0/1090771920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c1c14c630 0x7f2c1c0c8fb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2c080097c0 tx=0x7f2c08004750 comp rx=0 tx=0).stop 2023-07-29T01:59:54.030 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.041+0000 7f2c22d0e700 1 -- 172.21.15.42:0/1090771920 shutdown_connections 2023-07-29T01:59:54.030 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.041+0000 7f2c22d0e700 1 --2- 172.21.15.42:0/1090771920 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2c0006a600 0x7f2c0006cab0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.030 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.041+0000 7f2c22d0e700 1 --2- 172.21.15.42:0/1090771920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2c1c14b4e0 0x7f2c1c1eebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.030 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.041+0000 7f2c22d0e700 1 --2- 172.21.15.42:0/1090771920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2c1c0c7270 0x7f2c1c151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.031 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.041+0000 7f2c22d0e700 1 --2- 172.21.15.42:0/1090771920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2c1c14c630 0x7f2c1c0c8fb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.031 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.041+0000 7f2c22d0e700 1 -- 172.21.15.42:0/1090771920 >> 172.21.15.42:0/1090771920 conn(0x7f2c1c0c8970 msgr2=0x7f2c1c14a660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:54.031 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.041+0000 7f2c22d0e700 1 -- 172.21.15.42:0/1090771920 shutdown_connections 2023-07-29T01:59:54.031 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.041+0000 7f2c22d0e700 1 -- 172.21.15.42:0/1090771920 wait complete. 2023-07-29T01:59:54.032 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 3 2023-07-29T01:59:54.042 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T01:59:54.169 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.181+0000 7fbb9c31f700 1 Processor -- start 2023-07-29T01:59:54.170 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.181+0000 7fbb9c31f700 1 -- start start 2023-07-29T01:59:54.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.182+0000 7fbb9c31f700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbb941567d0 0x7fbb94159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:54.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.182+0000 7fbb9c31f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbb94159e90 0x7fbb94163a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:54.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.182+0000 7fbb9c31f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb940c7700 con 0x7fbb940c7210 2023-07-29T01:59:54.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.182+0000 7fbb9c31f700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb9406b160 con 0x7fbb941567d0 2023-07-29T01:59:54.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.182+0000 7fbb9c31f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb94159170 con 0x7fbb94159e90 2023-07-29T01:59:54.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.183+0000 7fbb9a0bb700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbb941567d0 0x7fbb94159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:54.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.183+0000 7fbb9a0bb700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbb941567d0 0x7fbb94159950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55502/0 (socket says 172.21.15.42:55502) 2023-07-29T01:59:54.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.183+0000 7fbb9a0bb700 1 -- 172.21.15.42:0/326448550 learned_addr learned my addr 172.21.15.42:0/326448550 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:54.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.183+0000 7fbb9a8bc700 1 --2- 172.21.15.42:0/326448550 >> v2:172.21.15.144:3300/0 conn(0x7fbb94159e90 0x7fbb94163a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:54.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.183+0000 7fbb9a0bb700 1 -- 172.21.15.42:0/326448550 >> v2:172.21.15.144:3300/0 conn(0x7fbb94159e90 msgr2=0x7fbb94163a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:54.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.183+0000 7fbb9a0bb700 1 --2- 172.21.15.42:0/326448550 >> v2:172.21.15.144:3300/0 conn(0x7fbb94159e90 0x7fbb94163a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.183+0000 7fbb9a0bb700 1 -- 172.21.15.42:0/326448550 >> v1:172.21.15.144:6789/0 conn(0x7fbb940c7210 legacy=0x7fbb9406cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:54.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.183+0000 7fbb9a0bb700 1 -- 172.21.15.42:0/326448550 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb94156ba0 con 0x7fbb941567d0 2023-07-29T01:59:54.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.183+0000 7fbb9a8bc700 1 --2- 172.21.15.42:0/326448550 >> v2:172.21.15.144:3300/0 conn(0x7fbb94159e90 0x7fbb94163a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T01:59:54.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.183+0000 7fbb9a0bb700 1 --2- 172.21.15.42:0/326448550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb941567d0 0x7fbb94159950 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbb9406e5b0 tx=0x7fbb88009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0476c2c21029b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:54.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.183+0000 7fbb990b9700 1 -- 172.21.15.42:0/326448550 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88004230 con 0x7fbb941567d0 2023-07-29T01:59:54.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.183+0000 7fbb990b9700 1 -- 172.21.15.42:0/326448550 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb88004390 con 0x7fbb941567d0 2023-07-29T01:59:54.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.183+0000 7fbb990b9700 1 -- 172.21.15.42:0/326448550 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880036a0 con 0x7fbb941567d0 2023-07-29T01:59:54.179 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.184+0000 7fbb9c31f700 1 -- 172.21.15.42:0/326448550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb941567d0 msgr2=0x7fbb94159950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:54.179 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.184+0000 7fbb9c31f700 1 --2- 172.21.15.42:0/326448550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb941567d0 0x7fbb94159950 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbb9406e5b0 tx=0x7fbb88009bd0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.179 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.184+0000 7fbb9c31f700 1 -- 172.21.15.42:0/326448550 shutdown_connections 2023-07-29T01:59:54.179 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.184+0000 7fbb9c31f700 1 --2- 172.21.15.42:0/326448550 >> v2:172.21.15.144:3300/0 conn(0x7fbb94159e90 0x7fbb94163a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.179 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.184+0000 7fbb9c31f700 1 --2- 172.21.15.42:0/326448550 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb941567d0 0x7fbb94159950 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.179 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.184+0000 7fbb9c31f700 1 -- 172.21.15.42:0/326448550 >> 172.21.15.42:0/326448550 conn(0x7fbb940c8970 msgr2=0x7fbb940c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:54.179 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.184+0000 7fbb9c31f700 1 -- 172.21.15.42:0/326448550 shutdown_connections 2023-07-29T01:59:54.180 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.184+0000 7fbb9c31f700 1 -- 172.21.15.42:0/326448550 wait complete. 2023-07-29T01:59:54.180 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.185+0000 7fbb9c31f700 1 Processor -- start 2023-07-29T01:59:54.180 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.185+0000 7fbb9c31f700 1 -- start start 2023-07-29T01:59:54.180 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb9c31f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb940c7210 0x7fbb941512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:54.180 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb9c31f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb941567d0 0x7fbb940cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:54.180 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb9c31f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb94159e90 0x7fbb941ef560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:54.181 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb9c31f700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94155ca0 con 0x7fbb941567d0 2023-07-29T01:59:54.181 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb9c31f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94153d00 con 0x7fbb940c7210 2023-07-29T01:59:54.181 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb9c31f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940cae00 con 0x7fbb94159e90 2023-07-29T01:59:54.181 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb998ba700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb941567d0 0x7fbb940cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:54.181 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb998ba700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb941567d0 0x7fbb940cb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55510/0 (socket says 172.21.15.42:55510) 2023-07-29T01:59:54.181 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb998ba700 1 -- 172.21.15.42:0/2027449990 learned_addr learned my addr 172.21.15.42:0/2027449990 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:54.181 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb9a0bb700 1 --2- 172.21.15.42:0/2027449990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb940c7210 0x7fbb941512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:54.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb9a8bc700 1 --2- 172.21.15.42:0/2027449990 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb94159e90 0x7fbb941ef560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:54.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb998ba700 1 -- 172.21.15.42:0/2027449990 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb94159e90 msgr2=0x7fbb941ef560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:54.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb998ba700 1 --2- 172.21.15.42:0/2027449990 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb94159e90 0x7fbb941ef560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb998ba700 1 -- 172.21.15.42:0/2027449990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb940c7210 msgr2=0x7fbb941512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:54.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb998ba700 1 --2- 172.21.15.42:0/2027449990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb940c7210 0x7fbb941512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb998ba700 1 -- 172.21.15.42:0/2027449990 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb88009550 con 0x7fbb941567d0 2023-07-29T01:59:54.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb998ba700 1 --2- 172.21.15.42:0/2027449990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb941567d0 0x7fbb940cb570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000c4d0 tx=0x7fbb9000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:54.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb86ffd700 1 -- 172.21.15.42:0/2027449990 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90011790 con 0x7fbb941567d0 2023-07-29T01:59:54.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb86ffd700 1 -- 172.21.15.42:0/2027449990 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb900118f0 con 0x7fbb941567d0 2023-07-29T01:59:54.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb9c31f700 1 -- 172.21.15.42:0/2027449990 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb941f31f0 con 0x7fbb941567d0 2023-07-29T01:59:54.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb86ffd700 1 -- 172.21.15.42:0/2027449990 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90011ca0 con 0x7fbb941567d0 2023-07-29T01:59:54.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.186+0000 7fbb9c31f700 1 -- 172.21.15.42:0/2027449990 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb94154230 con 0x7fbb941567d0 2023-07-29T01:59:54.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.187+0000 7fbb9c31f700 1 -- 172.21.15.42:0/2027449990 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb94074740 con 0x7fbb941567d0 2023-07-29T01:59:54.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.188+0000 7fbb86ffd700 1 -- 172.21.15.42:0/2027449990 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fbb9001c460 con 0x7fbb941567d0 2023-07-29T01:59:54.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.188+0000 7fbb86ffd700 1 --2- 172.21.15.42:0/2027449990 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbb7806a660 0x7fbb7806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:54.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.188+0000 7fbb86ffd700 1 -- 172.21.15.42:0/2027449990 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbb900884a0 con 0x7fbb941567d0 2023-07-29T01:59:54.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.188+0000 7fbb9a0bb700 1 --2- 172.21.15.42:0/2027449990 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbb7806a660 0x7fbb7806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:54.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.189+0000 7fbb9a0bb700 1 --2- 172.21.15.42:0/2027449990 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbb7806a660 0x7fbb7806cb10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009130 tx=0x7fbb88008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:54.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.193+0000 7fbb86ffd700 1 -- 172.21.15.42:0/2027449990 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fbb90053bf0 con 0x7fbb941567d0 2023-07-29T01:59:54.379 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.391+0000 7fbb9c31f700 1 -- 172.21.15.42:0/2027449990 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb9404ea50 con 0x7fbb941567d0 2023-07-29T01:59:54.380 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.392+0000 7fbb86ffd700 1 -- 172.21.15.42:0/2027449990 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+14207 (secure 0 0 0) 0x7fbb90057210 con 0x7fbb941567d0 2023-07-29T01:59:54.380 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:54.381 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":17,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T01:59:53.443443+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T01:59:54.382 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.394+0000 7fbb9c31f700 1 -- 172.21.15.42:0/2027449990 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbb7806a660 msgr2=0x7fbb7806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:54.383 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.394+0000 7fbb9c31f700 1 --2- 172.21.15.42:0/2027449990 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbb7806a660 0x7fbb7806cb10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009130 tx=0x7fbb88008030 comp rx=0 tx=0).stop 2023-07-29T01:59:54.383 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.394+0000 7fbb9c31f700 1 -- 172.21.15.42:0/2027449990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb941567d0 msgr2=0x7fbb940cb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:54.383 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.394+0000 7fbb9c31f700 1 --2- 172.21.15.42:0/2027449990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb941567d0 0x7fbb940cb570 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000c4d0 tx=0x7fbb9000c7e0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.383 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.394+0000 7fbb9c31f700 1 -- 172.21.15.42:0/2027449990 shutdown_connections 2023-07-29T01:59:54.383 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.394+0000 7fbb9c31f700 1 --2- 172.21.15.42:0/2027449990 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbb7806a660 0x7fbb7806cb10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.383 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.394+0000 7fbb9c31f700 1 --2- 172.21.15.42:0/2027449990 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb94159e90 0x7fbb941ef560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.394+0000 7fbb9c31f700 1 --2- 172.21.15.42:0/2027449990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb940c7210 0x7fbb941512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.394+0000 7fbb9c31f700 1 --2- 172.21.15.42:0/2027449990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb941567d0 0x7fbb940cb570 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.394+0000 7fbb9c31f700 1 -- 172.21.15.42:0/2027449990 >> 172.21.15.42:0/2027449990 conn(0x7fbb940c8970 msgr2=0x7fbb940c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:54.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.394+0000 7fbb9c31f700 1 -- 172.21.15.42:0/2027449990 shutdown_connections 2023-07-29T01:59:54.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.394+0000 7fbb9c31f700 1 -- 172.21.15.42:0/2027449990 wait complete. 2023-07-29T01:59:54.395 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-29T01:59:50.906228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-29T01:59:51.290583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-29T01:59:54.395 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-29T01:59:54.523 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.535+0000 7ff841174700 1 Processor -- start 2023-07-29T01:59:54.524 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.535+0000 7ff841174700 1 -- start start 2023-07-29T01:59:54.526 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.536+0000 7ff841174700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff83c0c8580 0x7ff83c06f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:54.526 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.536+0000 7ff841174700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83c06c870 con 0x7ff83c1531a0 2023-07-29T01:59:54.526 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.536+0000 7ff841174700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83c06fa50 con 0x7ff83c071840 2023-07-29T01:59:54.526 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.536+0000 7ff841174700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff83c0c74a0 con 0x7ff83c0c8580 2023-07-29T01:59:54.527 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.536+0000 7ff83a59c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff83c0c8580 0x7ff83c06f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:54.527 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.536+0000 7ff83ad9d700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff83c1531a0 0x7ff83c15c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49320/0 (socket says 172.21.15.42:49320) 2023-07-29T01:59:54.527 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.536+0000 7ff83ad9d700 1 -- 172.21.15.42:0/337152457 learned_addr learned my addr 172.21.15.42:0/337152457 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T01:59:54.527 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.536+0000 7ff83a59c700 1 -- 172.21.15.42:0/337152457 >> v1:172.21.15.144:6789/0 conn(0x7ff83c071840 legacy=0x7ff83c06a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:54.527 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.536+0000 7ff83a59c700 1 -- 172.21.15.42:0/337152457 >> v1:172.21.15.42:6789/0 conn(0x7ff83c1531a0 legacy=0x7ff83c15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:54.527 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.536+0000 7ff83a59c700 1 -- 172.21.15.42:0/337152457 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c06d450 con 0x7ff83c0c8580 2023-07-29T01:59:54.528 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.537+0000 7ff83a59c700 1 --2- 172.21.15.42:0/337152457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff83c0c8580 0x7ff83c06f510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff83c06dbd0 tx=0x7ff82c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3845f33e123fb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:54.528 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.537+0000 7ff839d9b700 1 -- 172.21.15.42:0/337152457 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c011830 con 0x7ff83c0c8580 2023-07-29T01:59:54.528 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.537+0000 7ff839d9b700 1 -- 172.21.15.42:0/337152457 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c011990 con 0x7ff83c0c8580 2023-07-29T01:59:54.528 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.537+0000 7ff839d9b700 1 -- 172.21.15.42:0/337152457 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c011d20 con 0x7ff83c0c8580 2023-07-29T01:59:54.528 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.537+0000 7ff841174700 1 -- 172.21.15.42:0/337152457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff83c0c8580 msgr2=0x7ff83c06f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:54.528 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.537+0000 7ff841174700 1 --2- 172.21.15.42:0/337152457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff83c0c8580 0x7ff83c06f510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff83c06dbd0 tx=0x7ff82c009b20 comp rx=0 tx=0).stop 2023-07-29T01:59:54.528 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.537+0000 7ff841174700 1 -- 172.21.15.42:0/337152457 shutdown_connections 2023-07-29T01:59:54.529 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.537+0000 7ff841174700 1 --2- 172.21.15.42:0/337152457 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff83c0c8580 0x7ff83c06f510 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.529 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.537+0000 7ff841174700 1 -- 172.21.15.42:0/337152457 >> 172.21.15.42:0/337152457 conn(0x7ff83c0cbf10 msgr2=0x7ff83c0cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:54.529 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.537+0000 7ff841174700 1 -- 172.21.15.42:0/337152457 shutdown_connections 2023-07-29T01:59:54.529 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.537+0000 7ff841174700 1 -- 172.21.15.42:0/337152457 wait complete. 2023-07-29T01:59:54.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.539+0000 7ff841174700 1 Processor -- start 2023-07-29T01:59:54.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.539+0000 7ff841174700 1 -- start start 2023-07-29T01:59:54.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff841174700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff83c071840 0x7ff83c145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:54.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff841174700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff83c0c8580 0x7ff83c1e53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:54.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff841174700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff83c1531a0 0x7ff83c1e58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:54.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff841174700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c159d50 con 0x7ff83c0c8580 2023-07-29T01:59:54.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff841174700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c1ef4b0 con 0x7ff83c1531a0 2023-07-29T01:59:54.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff841174700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c14d410 con 0x7ff83c071840 2023-07-29T01:59:54.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff83a59c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff83c0c8580 0x7ff83c1e53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:54.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff83a59c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff83c0c8580 0x7ff83c1e53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55524/0 (socket says 172.21.15.42:55524) 2023-07-29T01:59:54.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff83a59c700 1 -- 172.21.15.42:0/2313833966 learned_addr learned my addr 172.21.15.42:0/2313833966 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:54.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff83b59e700 1 --2- 172.21.15.42:0/2313833966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff83c1531a0 0x7ff83c1e58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:54.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff83ad9d700 1 --2- 172.21.15.42:0/2313833966 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff83c071840 0x7ff83c145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:54.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff83a59c700 1 -- 172.21.15.42:0/2313833966 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff83c071840 msgr2=0x7ff83c145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:54.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff83a59c700 1 --2- 172.21.15.42:0/2313833966 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff83c071840 0x7ff83c145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff83a59c700 1 -- 172.21.15.42:0/2313833966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff83c1531a0 msgr2=0x7ff83c1e58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:54.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff83a59c700 1 --2- 172.21.15.42:0/2313833966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff83c1531a0 0x7ff83c1e58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff83a59c700 1 -- 172.21.15.42:0/2313833966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c0094a0 con 0x7ff83c0c8580 2023-07-29T01:59:54.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff83b59e700 1 --2- 172.21.15.42:0/2313833966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff83c1531a0 0x7ff83c1e58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T01:59:54.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff83a59c700 1 --2- 172.21.15.42:0/2313833966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff83c0c8580 0x7ff83c1e53b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0090b0 tx=0x7ff82c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:54.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff8237fe700 1 -- 172.21.15.42:0/2313833966 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c0038a0 con 0x7ff83c0c8580 2023-07-29T01:59:54.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff8237fe700 1 -- 172.21.15.42:0/2313833966 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c01e070 con 0x7ff83c0c8580 2023-07-29T01:59:54.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff8237fe700 1 -- 172.21.15.42:0/2313833966 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c003c60 con 0x7ff83c0c8580 2023-07-29T01:59:54.538 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff841174700 1 -- 172.21.15.42:0/2313833966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83c159f40 con 0x7ff83c0c8580 2023-07-29T01:59:54.538 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.540+0000 7ff841174700 1 -- 172.21.15.42:0/2313833966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83c1ef6e0 con 0x7ff83c0c8580 2023-07-29T01:59:54.538 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.541+0000 7ff841174700 1 -- 172.21.15.42:0/2313833966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83c1ef870 con 0x7ff83c0c8580 2023-07-29T01:59:54.538 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.542+0000 7ff8237fe700 1 -- 172.21.15.42:0/2313833966 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7ff82c02d450 con 0x7ff83c0c8580 2023-07-29T01:59:54.538 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.542+0000 7ff8237fe700 1 --2- 172.21.15.42:0/2313833966 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff82806a660 0x7ff82806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:54.538 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.542+0000 7ff8237fe700 1 -- 172.21.15.42:0/2313833966 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff82c089a10 con 0x7ff83c0c8580 2023-07-29T01:59:54.539 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.542+0000 7ff83ad9d700 1 --2- 172.21.15.42:0/2313833966 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff82806a660 0x7ff82806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:54.539 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.543+0000 7ff83ad9d700 1 --2- 172.21.15.42:0/2313833966 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff82806a660 0x7ff82806cb10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff830005910 tx=0x7ff830009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:54.539 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.547+0000 7ff8237fe700 1 -- 172.21.15.42:0/2313833966 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7ff82c0550c0 con 0x7ff83c0c8580 2023-07-29T01:59:54.730 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.742+0000 7ff841174700 1 -- 172.21.15.42:0/2313833966 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff83c04ea50 con 0x7ff83c0c8580 2023-07-29T01:59:54.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.743+0000 7ff8237fe700 1 -- 172.21.15.42:0/2313833966 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff82c0200a0 con 0x7ff83c0c8580 2023-07-29T01:59:54.731 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 8 2023-07-29T01:59:54.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.745+0000 7ff841174700 1 -- 172.21.15.42:0/2313833966 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff82806a660 msgr2=0x7ff82806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:54.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.745+0000 7ff841174700 1 --2- 172.21.15.42:0/2313833966 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff82806a660 0x7ff82806cb10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff830005910 tx=0x7ff830009040 comp rx=0 tx=0).stop 2023-07-29T01:59:54.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.745+0000 7ff841174700 1 -- 172.21.15.42:0/2313833966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff83c0c8580 msgr2=0x7ff83c1e53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:54.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.745+0000 7ff841174700 1 --2- 172.21.15.42:0/2313833966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff83c0c8580 0x7ff83c1e53b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0090b0 tx=0x7ff82c004750 comp rx=0 tx=0).stop 2023-07-29T01:59:54.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.745+0000 7ff841174700 1 -- 172.21.15.42:0/2313833966 shutdown_connections 2023-07-29T01:59:54.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.745+0000 7ff841174700 1 --2- 172.21.15.42:0/2313833966 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff82806a660 0x7ff82806cb10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.745+0000 7ff841174700 1 --2- 172.21.15.42:0/2313833966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff83c1531a0 0x7ff83c1e58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.745+0000 7ff841174700 1 --2- 172.21.15.42:0/2313833966 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff83c071840 0x7ff83c145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.745+0000 7ff841174700 1 --2- 172.21.15.42:0/2313833966 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff83c0c8580 0x7ff83c1e53b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.745+0000 7ff841174700 1 -- 172.21.15.42:0/2313833966 >> 172.21.15.42:0/2313833966 conn(0x7ff83c0cbf10 msgr2=0x7ff83c150890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:54.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.745+0000 7ff841174700 1 -- 172.21.15.42:0/2313833966 shutdown_connections 2023-07-29T01:59:54.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.745+0000 7ff841174700 1 -- 172.21.15.42:0/2313833966 wait complete. 2023-07-29T01:59:54.745 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-29T01:59:54.872 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.884+0000 7f502c843700 1 Processor -- start 2023-07-29T01:59:54.872 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.884+0000 7f502c843700 1 -- start start 2023-07-29T01:59:54.873 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.885+0000 7f502c843700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f50281531a0 0x7f502806f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:54.874 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.885+0000 7f502c843700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5028071840 0x7f502806a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:54.874 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.885+0000 7f502c843700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502806c870 con 0x7f50280c8580 2023-07-29T01:59:54.874 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.885+0000 7f502c843700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50280c74a0 con 0x7f50281531a0 2023-07-29T01:59:54.874 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.885+0000 7f502c843700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502806fa50 con 0x7f5028071840 2023-07-29T01:59:54.874 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.885+0000 7f5025d9b700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f50280c8580 0x7f502815c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49334/0 (socket says 172.21.15.42:49334) 2023-07-29T01:59:54.874 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.885+0000 7f5025d9b700 1 -- 172.21.15.42:0/3068264440 learned_addr learned my addr 172.21.15.42:0/3068264440 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T01:59:54.875 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.885+0000 7f502659c700 1 --2- 172.21.15.42:0/3068264440 >> v2:172.21.15.144:3300/0 conn(0x7f50281531a0 0x7f502806f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:54.875 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.885+0000 7f5026d9d700 1 --2- 172.21.15.42:0/3068264440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5028071840 0x7f502806a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:54.875 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.885+0000 7f502559a700 1 -- 172.21.15.42:0/3068264440 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278483778 0 0) 0x7f502806c870 con 0x7f50280c8580 2023-07-29T01:59:54.875 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.885+0000 7f502559a700 1 -- 172.21.15.42:0/3068264440 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50100035b0 con 0x7f50280c8580 2023-07-29T01:59:54.875 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.885+0000 7f502659c700 1 -- 172.21.15.42:0/3068264440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5028071840 msgr2=0x7f502806a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:54.875 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.885+0000 7f502659c700 1 --2- 172.21.15.42:0/3068264440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5028071840 0x7f502806a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.875 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.885+0000 7f502659c700 1 -- 172.21.15.42:0/3068264440 >> v1:172.21.15.42:6789/0 conn(0x7f50280c8580 legacy=0x7f502815c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:54.875 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.885+0000 7f502559a700 1 -- 172.21.15.42:0/3068264440 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3916648426 0 0) 0x7f50100035b0 con 0x7f50280c8580 2023-07-29T01:59:54.876 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.885+0000 7f502659c700 1 -- 172.21.15.42:0/3068264440 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f502806d450 con 0x7f50281531a0 2023-07-29T01:59:54.876 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.885+0000 7f5026d9d700 1 --2- 172.21.15.42:0/3068264440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5028071840 0x7f502806a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T01:59:54.876 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.886+0000 7f502659c700 1 --2- 172.21.15.42:0/3068264440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50281531a0 0x7f502806f510 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5018009840 tx=0x7f5018009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dcdee139e5c8503 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:54.876 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.886+0000 7f502559a700 1 -- 172.21.15.42:0/3068264440 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c001670 con 0x7f50281531a0 2023-07-29T01:59:54.876 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.886+0000 7f502559a700 1 -- 172.21.15.42:0/3068264440 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5018004030 con 0x7f50281531a0 2023-07-29T01:59:54.876 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.886+0000 7f502559a700 1 -- 172.21.15.42:0/3068264440 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180043c0 con 0x7f50281531a0 2023-07-29T01:59:54.879 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.886+0000 7f502c843700 1 -- 172.21.15.42:0/3068264440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50281531a0 msgr2=0x7f502806f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:54.879 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.886+0000 7f502c843700 1 --2- 172.21.15.42:0/3068264440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50281531a0 0x7f502806f510 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5018009840 tx=0x7f5018009b50 comp rx=0 tx=0).stop 2023-07-29T01:59:54.879 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.886+0000 7f502c843700 1 -- 172.21.15.42:0/3068264440 shutdown_connections 2023-07-29T01:59:54.879 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.886+0000 7f502c843700 1 --2- 172.21.15.42:0/3068264440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5028071840 0x7f502806a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.879 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.886+0000 7f502c843700 1 --2- 172.21.15.42:0/3068264440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50281531a0 0x7f502806f510 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.879 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.886+0000 7f502c843700 1 -- 172.21.15.42:0/3068264440 >> 172.21.15.42:0/3068264440 conn(0x7f50280cbf10 msgr2=0x7f50280cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:54.880 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.886+0000 7f502c843700 1 -- 172.21.15.42:0/3068264440 shutdown_connections 2023-07-29T01:59:54.880 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.887+0000 7f502c843700 1 -- 172.21.15.42:0/3068264440 wait complete. 2023-07-29T01:59:54.880 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.888+0000 7f502c843700 1 Processor -- start 2023-07-29T01:59:54.880 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.888+0000 7f502c843700 1 -- start start 2023-07-29T01:59:54.880 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f502c843700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5028071840 0x7f502814d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:54.880 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f502c843700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50280c8580 0x7f50281ef060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:54.880 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f502c843700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f50281531a0 0x7f50281ef5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:54.881 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f502c843700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50281eebd0 con 0x7f50280c8580 2023-07-29T01:59:54.881 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f502c843700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50281e4d30 con 0x7f5028071840 2023-07-29T01:59:54.881 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f502c843700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50281e47b0 con 0x7f50281531a0 2023-07-29T01:59:54.881 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f5025d9b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50280c8580 0x7f50281ef060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:54.881 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f5025d9b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50280c8580 0x7f50281ef060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55538/0 (socket says 172.21.15.42:55538) 2023-07-29T01:59:54.881 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f5025d9b700 1 -- 172.21.15.42:0/4199596676 learned_addr learned my addr 172.21.15.42:0/4199596676 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:54.881 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f502659c700 1 --2- 172.21.15.42:0/4199596676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5028071840 0x7f502814d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:54.881 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f5026d9d700 1 --2- 172.21.15.42:0/4199596676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f50281531a0 0x7f50281ef5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:54.882 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f5025d9b700 1 -- 172.21.15.42:0/4199596676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f50281531a0 msgr2=0x7f50281ef5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:54.882 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f5025d9b700 1 --2- 172.21.15.42:0/4199596676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f50281531a0 0x7f50281ef5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.882 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f5025d9b700 1 -- 172.21.15.42:0/4199596676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5028071840 msgr2=0x7f502814d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:54.882 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f5025d9b700 1 --2- 172.21.15.42:0/4199596676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5028071840 0x7f502814d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:54.882 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f5025d9b700 1 -- 172.21.15.42:0/4199596676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5020009a70 con 0x7f50280c8580 2023-07-29T01:59:54.882 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f5026d9d700 1 --2- 172.21.15.42:0/4199596676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f50281531a0 0x7f50281ef5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T01:59:54.882 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f5025d9b700 1 --2- 172.21.15.42:0/4199596676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50280c8580 0x7f50281ef060 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f501c00c7b0 tx=0x7f501c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:54.882 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f5016ffd700 1 -- 172.21.15.42:0/4199596676 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c004c80 con 0x7f50280c8580 2023-07-29T01:59:54.883 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f5016ffd700 1 -- 172.21.15.42:0/4199596676 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501c004de0 con 0x7f50280c8580 2023-07-29T01:59:54.883 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f502c843700 1 -- 172.21.15.42:0/4199596676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50180094a0 con 0x7f50280c8580 2023-07-29T01:59:54.883 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f5016ffd700 1 -- 172.21.15.42:0/4199596676 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c0072f0 con 0x7f50280c8580 2023-07-29T01:59:54.883 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.889+0000 7f502c843700 1 -- 172.21.15.42:0/4199596676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50281e4a50 con 0x7f50280c8580 2023-07-29T01:59:54.883 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.890+0000 7f502c843700 1 -- 172.21.15.42:0/4199596676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50281ee9c0 con 0x7f50280c8580 2023-07-29T01:59:54.883 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.891+0000 7f5016ffd700 1 -- 172.21.15.42:0/4199596676 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f501c007450 con 0x7f50280c8580 2023-07-29T01:59:54.884 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.891+0000 7f5016ffd700 1 --2- 172.21.15.42:0/4199596676 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f500806a660 0x7f500806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:54.884 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.891+0000 7f5016ffd700 1 -- 172.21.15.42:0/4199596676 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f501c087c90 con 0x7f50280c8580 2023-07-29T01:59:54.884 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.891+0000 7f502659c700 1 --2- 172.21.15.42:0/4199596676 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f500806a660 0x7f500806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:54.884 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.892+0000 7f502659c700 1 --2- 172.21.15.42:0/4199596676 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f500806a660 0x7f500806cb10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f501800a010 tx=0x7f5018008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:54.885 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:54.895+0000 7f5016ffd700 1 -- 172.21.15.42:0/4199596676 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f501c053350 con 0x7f50280c8580 2023-07-29T01:59:55.082 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.095+0000 7f502c843700 1 -- 172.21.15.42:0/4199596676 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f502804ea50 con 0x7f50280c8580 2023-07-29T01:59:55.083 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.095+0000 7f5016ffd700 1 -- 172.21.15.42:0/4199596676 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f501c018070 con 0x7f50280c8580 2023-07-29T01:59:55.083 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2023-07-29T01:59:55.085 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.097+0000 7f502c843700 1 -- 172.21.15.42:0/4199596676 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f500806a660 msgr2=0x7f500806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:55.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.097+0000 7f502c843700 1 --2- 172.21.15.42:0/4199596676 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f500806a660 0x7f500806cb10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f501800a010 tx=0x7f5018008030 comp rx=0 tx=0).stop 2023-07-29T01:59:55.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.097+0000 7f502c843700 1 -- 172.21.15.42:0/4199596676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50280c8580 msgr2=0x7f50281ef060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:55.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.097+0000 7f502c843700 1 --2- 172.21.15.42:0/4199596676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50280c8580 0x7f50281ef060 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f501c00c7b0 tx=0x7f501c00cac0 comp rx=0 tx=0).stop 2023-07-29T01:59:55.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.097+0000 7f502c843700 1 -- 172.21.15.42:0/4199596676 shutdown_connections 2023-07-29T01:59:55.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.097+0000 7f502c843700 1 --2- 172.21.15.42:0/4199596676 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f500806a660 0x7f500806cb10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:55.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.097+0000 7f502c843700 1 --2- 172.21.15.42:0/4199596676 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f50281531a0 0x7f50281ef5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:55.087 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.097+0000 7f502c843700 1 --2- 172.21.15.42:0/4199596676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5028071840 0x7f502814d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:55.087 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.097+0000 7f502c843700 1 --2- 172.21.15.42:0/4199596676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f50280c8580 0x7f50281ef060 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:55.087 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.097+0000 7f502c843700 1 -- 172.21.15.42:0/4199596676 >> 172.21.15.42:0/4199596676 conn(0x7f50280cbf10 msgr2=0x7f50280c89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:55.087 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.097+0000 7f502c843700 1 -- 172.21.15.42:0/4199596676 shutdown_connections 2023-07-29T01:59:55.087 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.097+0000 7f502c843700 1 -- 172.21.15.42:0/4199596676 wait complete. 2023-07-29T01:59:55.097 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-29T01:59:55.221 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.234+0000 7f369a814700 1 Processor -- start 2023-07-29T01:59:55.222 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.234+0000 7f369a814700 1 -- start start 2023-07-29T01:59:55.223 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.234+0000 7f369a814700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36940c7f40 0x7f3694157490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:55.223 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.234+0000 7f369a814700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f369406e950 0x7f36941579d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:55.223 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.234+0000 7f369a814700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36940cd140 con 0x7f3694151500 2023-07-29T01:59:55.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.234+0000 7f369a814700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36940c2370 con 0x7f369406e950 2023-07-29T01:59:55.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.234+0000 7f369a814700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3694156f90 con 0x7f36940c7f40 2023-07-29T01:59:55.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.235+0000 7f36937fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36940c7f40 0x7f3694157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:55.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.235+0000 7f3698db1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f369406e950 0x7f36941579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:55.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.235+0000 7f3698db1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f369406e950 0x7f36941579d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:38926/0 (socket says 172.21.15.42:38926) 2023-07-29T01:59:55.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.235+0000 7f3698db1700 1 -- 172.21.15.42:0/893891611 learned_addr learned my addr 172.21.15.42:0/893891611 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:55.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.235+0000 7f3693fff700 1 --1- 172.21.15.42:0/893891611 >> v1:172.21.15.144:6789/0 conn(0x7f3694151500 0x7f369406dc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.42:51840/0 (socket says 172.21.15.42:51840) 2023-07-29T01:59:55.225 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.235+0000 7f3698db1700 1 -- 172.21.15.42:0/893891611 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36940c7f40 msgr2=0x7f3694157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:55.225 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.235+0000 7f3698db1700 1 --2- 172.21.15.42:0/893891611 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36940c7f40 0x7f3694157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:55.225 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.235+0000 7f3698db1700 1 -- 172.21.15.42:0/893891611 >> v1:172.21.15.144:6789/0 conn(0x7f3694151500 legacy=0x7f369406dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:55.225 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.235+0000 7f3698db1700 1 -- 172.21.15.42:0/893891611 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36940cd390 con 0x7f369406e950 2023-07-29T01:59:55.225 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.235+0000 7f36937fe700 1 --2- 172.21.15.42:0/893891611 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36940c7f40 0x7f3694157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T01:59:55.225 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.235+0000 7f3698db1700 1 --2- 172.21.15.42:0/893891611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f369406e950 0x7f36941579d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f368c009e50 tx=0x7f368c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4543ea29c6763a24 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:55.225 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.235+0000 7f3692ffd700 1 -- 172.21.15.42:0/893891611 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c00e070 con 0x7f369406e950 2023-07-29T01:59:55.226 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.235+0000 7f3692ffd700 1 -- 172.21.15.42:0/893891611 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368c00b910 con 0x7f369406e950 2023-07-29T01:59:55.226 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.235+0000 7f3692ffd700 1 -- 172.21.15.42:0/893891611 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c00bcc0 con 0x7f369406e950 2023-07-29T01:59:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.236+0000 7f369a814700 1 -- 172.21.15.42:0/893891611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f369406e950 msgr2=0x7f36941579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.236+0000 7f369a814700 1 --2- 172.21.15.42:0/893891611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f369406e950 0x7f36941579d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f368c009e50 tx=0x7f368c00b330 comp rx=0 tx=0).stop 2023-07-29T01:59:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.236+0000 7f369a814700 1 -- 172.21.15.42:0/893891611 shutdown_connections 2023-07-29T01:59:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.236+0000 7f369a814700 1 --2- 172.21.15.42:0/893891611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f369406e950 0x7f36941579d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.236+0000 7f369a814700 1 --2- 172.21.15.42:0/893891611 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36940c7f40 0x7f3694157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:55.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.236+0000 7f369a814700 1 -- 172.21.15.42:0/893891611 >> 172.21.15.42:0/893891611 conn(0x7f3694061190 msgr2=0x7f3694061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:55.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.236+0000 7f369a814700 1 -- 172.21.15.42:0/893891611 shutdown_connections 2023-07-29T01:59:55.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.236+0000 7f369a814700 1 -- 172.21.15.42:0/893891611 wait complete. 2023-07-29T01:59:55.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.237+0000 7f369a814700 1 Processor -- start 2023-07-29T01:59:55.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.237+0000 7f369a814700 1 -- start start 2023-07-29T01:59:55.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.238+0000 7f369a814700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f369406e950 0x7f36940c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:55.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.238+0000 7f369a814700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36940c7f40 0x7f3694159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:55.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.238+0000 7f369a814700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3694151500 0x7f3694159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:55.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.238+0000 7f369a814700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36940c4a40 con 0x7f369406e950 2023-07-29T01:59:55.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.238+0000 7f369a814700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3694155ce0 con 0x7f3694151500 2023-07-29T01:59:55.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.238+0000 7f369a814700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36941ecb80 con 0x7f36940c7f40 2023-07-29T01:59:55.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.238+0000 7f3693fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f369406e950 0x7f36940c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:55.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.238+0000 7f3693fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f369406e950 0x7f36940c3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55550/0 (socket says 172.21.15.42:55550) 2023-07-29T01:59:55.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.238+0000 7f3693fff700 1 -- 172.21.15.42:0/2488112786 learned_addr learned my addr 172.21.15.42:0/2488112786 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:55.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.238+0000 7f3698db1700 1 --2- 172.21.15.42:0/2488112786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3694151500 0x7f3694159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:55.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.239+0000 7f36937fe700 1 --2- 172.21.15.42:0/2488112786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36940c7f40 0x7f3694159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:55.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.239+0000 7f3693fff700 1 -- 172.21.15.42:0/2488112786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36940c7f40 msgr2=0x7f3694159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:55.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.239+0000 7f3693fff700 1 --2- 172.21.15.42:0/2488112786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36940c7f40 0x7f3694159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:55.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.239+0000 7f3693fff700 1 -- 172.21.15.42:0/2488112786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3694151500 msgr2=0x7f3694159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:55.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.239+0000 7f3693fff700 1 --2- 172.21.15.42:0/2488112786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3694151500 0x7f3694159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:55.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.239+0000 7f3693fff700 1 -- 172.21.15.42:0/2488112786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36880094a0 con 0x7f369406e950 2023-07-29T01:59:55.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.239+0000 7f3698db1700 1 --2- 172.21.15.42:0/2488112786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3694151500 0x7f3694159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T01:59:55.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.239+0000 7f3693fff700 1 --2- 172.21.15.42:0/2488112786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f369406e950 0x7f36940c3c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f368400c520 tx=0x7f368400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:55.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.239+0000 7f3690ff9700 1 -- 172.21.15.42:0/2488112786 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684005cb0 con 0x7f369406e950 2023-07-29T01:59:55.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.239+0000 7f369a814700 1 -- 172.21.15.42:0/2488112786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f368c009b30 con 0x7f369406e950 2023-07-29T01:59:55.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.239+0000 7f3690ff9700 1 -- 172.21.15.42:0/2488112786 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3684005e10 con 0x7f369406e950 2023-07-29T01:59:55.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.239+0000 7f3690ff9700 1 -- 172.21.15.42:0/2488112786 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36840072d0 con 0x7f369406e950 2023-07-29T01:59:55.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.239+0000 7f369a814700 1 -- 172.21.15.42:0/2488112786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36941ed120 con 0x7f369406e950 2023-07-29T01:59:55.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.240+0000 7f369a814700 1 -- 172.21.15.42:0/2488112786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3694070e20 con 0x7f369406e950 2023-07-29T01:59:55.233 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.241+0000 7f3690ff9700 1 -- 172.21.15.42:0/2488112786 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f3684007430 con 0x7f369406e950 2023-07-29T01:59:55.233 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.241+0000 7f3690ff9700 1 --2- 172.21.15.42:0/2488112786 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f368006a660 0x7f368006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:55.233 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.241+0000 7f3690ff9700 1 -- 172.21.15.42:0/2488112786 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f36840880c0 con 0x7f369406e950 2023-07-29T01:59:55.233 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.241+0000 7f36937fe700 1 --2- 172.21.15.42:0/2488112786 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f368006a660 0x7f368006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:55.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.242+0000 7f36937fe700 1 --2- 172.21.15.42:0/2488112786 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f368006a660 0x7f368006cb10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f369414f670 tx=0x7f3688008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:55.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.245+0000 7f3690ff9700 1 -- 172.21.15.42:0/2488112786 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f36840538c0 con 0x7f369406e950 2023-07-29T01:59:55.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.444+0000 7f369a814700 1 -- 172.21.15.42:0/2488112786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f36940cdc00 con 0x7f369406e950 2023-07-29T01:59:55.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.445+0000 7f3690ff9700 1 -- 172.21.15.42:0/2488112786 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7f3684017090 con 0x7f369406e950 2023-07-29T01:59:55.433 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T01:59:55.433 INFO:teuthology.orchestra.run.smithi042.stdout:[ 2023-07-29T01:59:55.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2023-07-29T01:59:55.434 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 1, 2023-07-29T01:59:55.434 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": "rbd" 2023-07-29T01:59:55.434 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2023-07-29T01:59:55.434 INFO:teuthology.orchestra.run.smithi042.stdout: { 2023-07-29T01:59:55.434 INFO:teuthology.orchestra.run.smithi042.stdout: "poolnum": 2, 2023-07-29T01:59:55.434 INFO:teuthology.orchestra.run.smithi042.stdout: "poolname": ".mgr" 2023-07-29T01:59:55.434 INFO:teuthology.orchestra.run.smithi042.stdout: } 2023-07-29T01:59:55.435 INFO:teuthology.orchestra.run.smithi042.stdout:] 2023-07-29T01:59:55.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.447+0000 7f369a814700 1 -- 172.21.15.42:0/2488112786 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f368006a660 msgr2=0x7f368006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:55.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.447+0000 7f369a814700 1 --2- 172.21.15.42:0/2488112786 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f368006a660 0x7f368006cb10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f369414f670 tx=0x7f3688008040 comp rx=0 tx=0).stop 2023-07-29T01:59:55.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.447+0000 7f369a814700 1 -- 172.21.15.42:0/2488112786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f369406e950 msgr2=0x7f36940c3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:55.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.447+0000 7f369a814700 1 --2- 172.21.15.42:0/2488112786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f369406e950 0x7f36940c3c50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f368400c520 tx=0x7f368400c8e0 comp rx=0 tx=0).stop 2023-07-29T01:59:55.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.447+0000 7f369a814700 1 -- 172.21.15.42:0/2488112786 shutdown_connections 2023-07-29T01:59:55.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.447+0000 7f369a814700 1 --2- 172.21.15.42:0/2488112786 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f368006a660 0x7f368006cb10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:55.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.447+0000 7f369a814700 1 --2- 172.21.15.42:0/2488112786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3694151500 0x7f3694159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:55.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.447+0000 7f369a814700 1 --2- 172.21.15.42:0/2488112786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f369406e950 0x7f36940c3c50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:55.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.447+0000 7f369a814700 1 --2- 172.21.15.42:0/2488112786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36940c7f40 0x7f3694159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:55.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.447+0000 7f369a814700 1 -- 172.21.15.42:0/2488112786 >> 172.21.15.42:0/2488112786 conn(0x7f3694061190 msgr2=0x7f36940ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:55.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.447+0000 7f369a814700 1 -- 172.21.15.42:0/2488112786 shutdown_connections 2023-07-29T01:59:55.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.447+0000 7f369a814700 1 -- 172.21.15.42:0/2488112786 wait complete. 2023-07-29T01:59:55.447 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-29T01:59:55.447 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-29T01:59:55.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.588+0000 7fad8d1a8700 1 Processor -- start 2023-07-29T01:59:55.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.589+0000 7fad8d1a8700 1 -- start start 2023-07-29T01:59:55.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.589+0000 7fad8d1a8700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fad881534d0 0x7fad88072930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:55.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.589+0000 7fad8d1a8700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad8815d190 con 0x7fad8806ce60 2023-07-29T01:59:55.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.589+0000 7fad8d1a8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad881538a0 con 0x7fad880c8390 2023-07-29T01:59:55.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.589+0000 7fad8d1a8700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8815d6c0 con 0x7fad881534d0 2023-07-29T01:59:55.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.589+0000 7fad86d9d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fad881534d0 0x7fad88072930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:55.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.589+0000 7fad8759e700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fad8806ce60 0x7fad8806d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49366/0 (socket says 172.21.15.42:49366) 2023-07-29T01:59:55.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.589+0000 7fad8759e700 1 -- 172.21.15.42:0/477201835 learned_addr learned my addr 172.21.15.42:0/477201835 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T01:59:55.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.590+0000 7fad86d9d700 1 -- 172.21.15.42:0/477201835 >> v1:172.21.15.144:6789/0 conn(0x7fad880c8390 legacy=0x7fad880c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:55.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.590+0000 7fad86d9d700 1 -- 172.21.15.42:0/477201835 >> v1:172.21.15.42:6789/0 conn(0x7fad8806ce60 legacy=0x7fad8806d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:55.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.590+0000 7fad86d9d700 1 -- 172.21.15.42:0/477201835 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8815a0f0 con 0x7fad881534d0 2023-07-29T01:59:55.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.590+0000 7fad85d9b700 1 -- 172.21.15.42:0/477201835 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048301526 0 0) 0x7fad8815d190 con 0x7fad8806ce60 2023-07-29T01:59:55.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.590+0000 7fad86d9d700 1 --2- 172.21.15.42:0/477201835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad881534d0 0x7fad88072930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad78009840 tx=0x7fad78009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d26d5a1ac8dc183 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:55.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.590+0000 7fad85d9b700 1 -- 172.21.15.42:0/477201835 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad78004230 con 0x7fad881534d0 2023-07-29T01:59:55.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.590+0000 7fad85d9b700 1 -- 172.21.15.42:0/477201835 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad78004390 con 0x7fad881534d0 2023-07-29T01:59:55.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.590+0000 7fad85d9b700 1 -- 172.21.15.42:0/477201835 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad780036a0 con 0x7fad881534d0 2023-07-29T01:59:55.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.591+0000 7fad8d1a8700 1 -- 172.21.15.42:0/477201835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad881534d0 msgr2=0x7fad88072930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:55.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.591+0000 7fad8d1a8700 1 --2- 172.21.15.42:0/477201835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad881534d0 0x7fad88072930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fad78009840 tx=0x7fad78009b50 comp rx=0 tx=0).stop 2023-07-29T01:59:55.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.591+0000 7fad8d1a8700 1 -- 172.21.15.42:0/477201835 shutdown_connections 2023-07-29T01:59:55.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.591+0000 7fad8d1a8700 1 --2- 172.21.15.42:0/477201835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad881534d0 0x7fad88072930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:55.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.591+0000 7fad8d1a8700 1 -- 172.21.15.42:0/477201835 >> 172.21.15.42:0/477201835 conn(0x7fad880c8980 msgr2=0x7fad880c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:55.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.591+0000 7fad8d1a8700 1 -- 172.21.15.42:0/477201835 shutdown_connections 2023-07-29T01:59:55.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.591+0000 7fad8d1a8700 1 -- 172.21.15.42:0/477201835 wait complete. 2023-07-29T01:59:55.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.592+0000 7fad8d1a8700 1 Processor -- start 2023-07-29T01:59:55.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.592+0000 7fad8d1a8700 1 -- start start 2023-07-29T01:59:55.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.593+0000 7fad8d1a8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad8806ce60 0x7fad880c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:55.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.593+0000 7fad8d1a8700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad880c8390 0x7fad880c3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:55.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.593+0000 7fad8d1a8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad881534d0 0x7fad8806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:55.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.593+0000 7fad8d1a8700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad881ee7e0 con 0x7fad880c8390 2023-07-29T01:59:55.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.593+0000 7fad8d1a8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad881eea80 con 0x7fad881534d0 2023-07-29T01:59:55.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.593+0000 7fad8d1a8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad88156e70 con 0x7fad8806ce60 2023-07-29T01:59:55.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.593+0000 7fad8659c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad880c8390 0x7fad880c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:55.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.593+0000 7fad8659c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad880c8390 0x7fad880c3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55564/0 (socket says 172.21.15.42:55564) 2023-07-29T01:59:55.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.593+0000 7fad8659c700 1 -- 172.21.15.42:0/1141668373 learned_addr learned my addr 172.21.15.42:0/1141668373 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:55.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.593+0000 7fad8759e700 1 --2- 172.21.15.42:0/1141668373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad881534d0 0x7fad8806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:55.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.593+0000 7fad86d9d700 1 --2- 172.21.15.42:0/1141668373 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad8806ce60 0x7fad880c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:55.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.593+0000 7fad8659c700 1 -- 172.21.15.42:0/1141668373 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad8806ce60 msgr2=0x7fad880c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:55.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.593+0000 7fad8659c700 1 --2- 172.21.15.42:0/1141668373 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad8806ce60 0x7fad880c4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:55.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.593+0000 7fad8659c700 1 -- 172.21.15.42:0/1141668373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad881534d0 msgr2=0x7fad8806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:55.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.593+0000 7fad8659c700 1 --2- 172.21.15.42:0/1141668373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad881534d0 0x7fad8806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:55.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.593+0000 7fad8659c700 1 -- 172.21.15.42:0/1141668373 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad780094a0 con 0x7fad880c8390 2023-07-29T01:59:55.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.593+0000 7fad8759e700 1 --2- 172.21.15.42:0/1141668373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad881534d0 0x7fad8806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T01:59:55.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.593+0000 7fad8659c700 1 --2- 172.21.15.42:0/1141668373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad880c8390 0x7fad880c3890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fad7000c4d0 tx=0x7fad7000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:55.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.593+0000 7fad7f7fe700 1 -- 172.21.15.42:0/1141668373 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70011790 con 0x7fad880c8390 2023-07-29T01:59:55.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.594+0000 7fad7f7fe700 1 -- 172.21.15.42:0/1141668373 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad700118f0 con 0x7fad880c8390 2023-07-29T01:59:55.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.594+0000 7fad8d1a8700 1 -- 172.21.15.42:0/1141668373 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad88157150 con 0x7fad880c8390 2023-07-29T01:59:55.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.594+0000 7fad7f7fe700 1 -- 172.21.15.42:0/1141668373 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad70011ca0 con 0x7fad880c8390 2023-07-29T01:59:55.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.594+0000 7fad8d1a8700 1 -- 172.21.15.42:0/1141668373 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad88157710 con 0x7fad880c8390 2023-07-29T01:59:55.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.594+0000 7fad8d1a8700 1 -- 172.21.15.42:0/1141668373 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad8804ea50 con 0x7fad880c8390 2023-07-29T01:59:55.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.595+0000 7fad7f7fe700 1 -- 172.21.15.42:0/1141668373 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fad7001c460 con 0x7fad880c8390 2023-07-29T01:59:55.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.595+0000 7fad7f7fe700 1 --2- 172.21.15.42:0/1141668373 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fad6806a630 0x7fad6806cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:55.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.595+0000 7fad7f7fe700 1 -- 172.21.15.42:0/1141668373 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fad70088580 con 0x7fad880c8390 2023-07-29T01:59:55.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.596+0000 7fad86d9d700 1 --2- 172.21.15.42:0/1141668373 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fad6806a630 0x7fad6806cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:55.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.596+0000 7fad86d9d700 1 --2- 172.21.15.42:0/1141668373 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fad6806a630 0x7fad6806cae0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fad78009b90 tx=0x7fad78013040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:55.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.600+0000 7fad7f7fe700 1 -- 172.21.15.42:0/1141668373 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fad70053d60 con 0x7fad880c8390 2023-07-29T01:59:55.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:55.796+0000 7fad8d1a8700 1 -- 172.21.15.42:0/1141668373 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fad8815cb60 con 0x7fad880c8390 2023-07-29T01:59:56.509 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.521+0000 7fad7f7fe700 1 -- 172.21.15.42:0/1141668373 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fad70057380 con 0x7fad880c8390 2023-07-29T01:59:56.513 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.526+0000 7fad8d1a8700 1 -- 172.21.15.42:0/1141668373 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fad6806a630 msgr2=0x7fad6806cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:56.514 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.526+0000 7fad8d1a8700 1 --2- 172.21.15.42:0/1141668373 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fad6806a630 0x7fad6806cae0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fad78009b90 tx=0x7fad78013040 comp rx=0 tx=0).stop 2023-07-29T01:59:56.514 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.526+0000 7fad8d1a8700 1 -- 172.21.15.42:0/1141668373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad880c8390 msgr2=0x7fad880c3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:56.514 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.526+0000 7fad8d1a8700 1 --2- 172.21.15.42:0/1141668373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad880c8390 0x7fad880c3890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fad7000c4d0 tx=0x7fad7000c890 comp rx=0 tx=0).stop 2023-07-29T01:59:56.515 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.526+0000 7fad8d1a8700 1 -- 172.21.15.42:0/1141668373 shutdown_connections 2023-07-29T01:59:56.515 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.526+0000 7fad8d1a8700 1 --2- 172.21.15.42:0/1141668373 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fad6806a630 0x7fad6806cae0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:56.515 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.526+0000 7fad8d1a8700 1 --2- 172.21.15.42:0/1141668373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad881534d0 0x7fad8806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:56.515 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.526+0000 7fad8d1a8700 1 --2- 172.21.15.42:0/1141668373 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fad8806ce60 0x7fad880c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:56.515 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.526+0000 7fad8d1a8700 1 --2- 172.21.15.42:0/1141668373 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fad880c8390 0x7fad880c3890 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:56.515 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.526+0000 7fad8d1a8700 1 -- 172.21.15.42:0/1141668373 >> 172.21.15.42:0/1141668373 conn(0x7fad880c8980 msgr2=0x7fad880c7640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:56.515 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.527+0000 7fad8d1a8700 1 -- 172.21.15.42:0/1141668373 shutdown_connections 2023-07-29T01:59:56.516 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.527+0000 7fad8d1a8700 1 -- 172.21.15.42:0/1141668373 wait complete. 2023-07-29T01:59:56.517 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' created 2023-07-29T01:59:56.532 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-07-29T01:59:56.670 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.682+0000 7f7f78498700 1 Processor -- start 2023-07-29T01:59:56.671 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.682+0000 7f7f78498700 1 -- start start 2023-07-29T01:59:56.672 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.683+0000 7f7f78498700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7f70153380 0x7f7f7015ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:56.672 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.683+0000 7f7f78498700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7f700c81f0 0x7f7f700c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:56.672 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.683+0000 7f7f78498700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f70159110 con 0x7f7f700c7d90 2023-07-29T01:59:56.672 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.683+0000 7f7f78498700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f70153750 con 0x7f7f700c81f0 2023-07-29T01:59:56.672 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.683+0000 7f7f78498700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f70158f20 con 0x7f7f70153380 2023-07-29T01:59:56.672 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.683+0000 7f7f76a35700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7f700c81f0 0x7f7f700c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:56.673 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.683+0000 7f7f76a35700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7f700c81f0 0x7f7f700c20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55572/0 (socket says 172.21.15.42:55572) 2023-07-29T01:59:56.673 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.683+0000 7f7f76a35700 1 -- 172.21.15.42:0/1896276364 learned_addr learned my addr 172.21.15.42:0/1896276364 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:56.673 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.684+0000 7f7f76234700 1 --2- 172.21.15.42:0/1896276364 >> v2:172.21.15.144:3300/0 conn(0x7f7f70153380 0x7f7f7015ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:56.673 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.684+0000 7f7f76a35700 1 -- 172.21.15.42:0/1896276364 >> v2:172.21.15.144:3300/0 conn(0x7f7f70153380 msgr2=0x7f7f7015ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:56.673 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.684+0000 7f7f76a35700 1 --2- 172.21.15.42:0/1896276364 >> v2:172.21.15.144:3300/0 conn(0x7f7f70153380 0x7f7f7015ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:56.673 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.684+0000 7f7f76a35700 1 -- 172.21.15.42:0/1896276364 >> v1:172.21.15.144:6789/0 conn(0x7f7f700c7d90 legacy=0x7f7f700ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:56.673 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.684+0000 7f7f76a35700 1 -- 172.21.15.42:0/1896276364 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f701593d0 con 0x7f7f700c81f0 2023-07-29T01:59:56.674 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.684+0000 7f7f76a35700 1 --2- 172.21.15.42:0/1896276364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f700c81f0 0x7f7f700c20f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7f70068a40 tx=0x7f7f6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3087cbcf85680f server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:56.674 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.684+0000 7f7f75232700 1 -- 172.21.15.42:0/1896276364 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6800e070 con 0x7f7f700c81f0 2023-07-29T01:59:56.674 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.684+0000 7f7f75232700 1 -- 172.21.15.42:0/1896276364 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f68003a20 con 0x7f7f700c81f0 2023-07-29T01:59:56.674 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.684+0000 7f7f75232700 1 -- 172.21.15.42:0/1896276364 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68003dd0 con 0x7f7f700c81f0 2023-07-29T01:59:56.676 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.685+0000 7f7f78498700 1 -- 172.21.15.42:0/1896276364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f700c81f0 msgr2=0x7f7f700c20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:56.676 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.685+0000 7f7f78498700 1 --2- 172.21.15.42:0/1896276364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f700c81f0 0x7f7f700c20f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7f70068a40 tx=0x7f7f6800b330 comp rx=0 tx=0).stop 2023-07-29T01:59:56.676 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.685+0000 7f7f78498700 1 -- 172.21.15.42:0/1896276364 shutdown_connections 2023-07-29T01:59:56.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.685+0000 7f7f78498700 1 --2- 172.21.15.42:0/1896276364 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f700c81f0 0x7f7f700c20f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:56.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.685+0000 7f7f78498700 1 --2- 172.21.15.42:0/1896276364 >> v2:172.21.15.144:3300/0 conn(0x7f7f70153380 0x7f7f7015ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:56.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.685+0000 7f7f78498700 1 -- 172.21.15.42:0/1896276364 >> 172.21.15.42:0/1896276364 conn(0x7f7f70061190 msgr2=0x7f7f70061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:56.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.685+0000 7f7f78498700 1 -- 172.21.15.42:0/1896276364 shutdown_connections 2023-07-29T01:59:56.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.685+0000 7f7f78498700 1 -- 172.21.15.42:0/1896276364 wait complete. 2023-07-29T01:59:56.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.686+0000 7f7f78498700 1 Processor -- start 2023-07-29T01:59:56.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.686+0000 7f7f78498700 1 -- start start 2023-07-29T01:59:56.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.687+0000 7f7f78498700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f700c7d90 0x7f7f701f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:56.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.687+0000 7f7f78498700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f700c81f0 0x7f7f700cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:56.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.687+0000 7f7f78498700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f70153380 0x7f7f7015b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:56.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.687+0000 7f7f78498700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f701f3170 con 0x7f7f70153380 2023-07-29T01:59:56.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.687+0000 7f7f78498700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f700c6b30 con 0x7f7f700c7d90 2023-07-29T01:59:56.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.687+0000 7f7f78498700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f701eecb0 con 0x7f7f700c81f0 2023-07-29T01:59:56.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.687+0000 7f7f76a35700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f70153380 0x7f7f7015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:56.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.687+0000 7f7f76a35700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f70153380 0x7f7f7015b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55578/0 (socket says 172.21.15.42:55578) 2023-07-29T01:59:56.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.687+0000 7f7f76a35700 1 -- 172.21.15.42:0/1410824333 learned_addr learned my addr 172.21.15.42:0/1410824333 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:56.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.687+0000 7f7f76234700 1 --2- 172.21.15.42:0/1410824333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f700c7d90 0x7f7f701f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:56.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.687+0000 7f7f75a33700 1 --2- 172.21.15.42:0/1410824333 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f700c81f0 0x7f7f700cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:56.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.687+0000 7f7f76a35700 1 -- 172.21.15.42:0/1410824333 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f700c81f0 msgr2=0x7f7f700cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:56.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.687+0000 7f7f76a35700 1 --2- 172.21.15.42:0/1410824333 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f700c81f0 0x7f7f700cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:56.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.687+0000 7f7f76a35700 1 -- 172.21.15.42:0/1410824333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f700c7d90 msgr2=0x7f7f701f2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:56.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.687+0000 7f7f76a35700 1 --2- 172.21.15.42:0/1410824333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f700c7d90 0x7f7f701f2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:56.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.687+0000 7f7f76a35700 1 -- 172.21.15.42:0/1410824333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f68009b30 con 0x7f7f70153380 2023-07-29T01:59:56.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.687+0000 7f7f76a35700 1 --2- 172.21.15.42:0/1410824333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f70153380 0x7f7f7015b410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800b370 tx=0x7f7f68004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:56.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.687+0000 7f7f62ffd700 1 -- 172.21.15.42:0/1410824333 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68004440 con 0x7f7f70153380 2023-07-29T01:59:56.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.687+0000 7f7f62ffd700 1 -- 172.21.15.42:0/1410824333 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f680092e0 con 0x7f7f70153380 2023-07-29T01:59:56.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.688+0000 7f7f78498700 1 -- 172.21.15.42:0/1410824333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f700c6d80 con 0x7f7f70153380 2023-07-29T01:59:56.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.688+0000 7f7f62ffd700 1 -- 172.21.15.42:0/1410824333 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f68004800 con 0x7f7f70153380 2023-07-29T01:59:56.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.688+0000 7f7f78498700 1 -- 172.21.15.42:0/1410824333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f701eef70 con 0x7f7f70153380 2023-07-29T01:59:56.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.688+0000 7f7f78498700 1 -- 172.21.15.42:0/1410824333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f700c4ab0 con 0x7f7f70153380 2023-07-29T01:59:56.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.689+0000 7f7f62ffd700 1 -- 172.21.15.42:0/1410824333 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f7f68012430 con 0x7f7f70153380 2023-07-29T01:59:56.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.689+0000 7f7f62ffd700 1 --2- 172.21.15.42:0/1410824333 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7f5406a660 0x7f7f5406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:56.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.689+0000 7f7f62ffd700 1 -- 172.21.15.42:0/1410824333 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f7f68089c40 con 0x7f7f70153380 2023-07-29T01:59:56.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.690+0000 7f7f76234700 1 --2- 172.21.15.42:0/1410824333 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7f5406a660 0x7f7f5406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:56.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.690+0000 7f7f76234700 1 --2- 172.21.15.42:0/1410824333 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7f5406a660 0x7f7f5406cb10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f64006fd0 tx=0x7f7f64008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:56.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.694+0000 7f7f62ffd700 1 -- 172.21.15.42:0/1410824333 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f7f68055220 con 0x7f7f70153380 2023-07-29T01:59:56.881 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:56.893+0000 7f7f78498700 1 -- 172.21.15.42:0/1410824333 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f7f7004ea50 con 0x7f7f70153380 2023-07-29T01:59:57.512 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.524+0000 7f7f62ffd700 1 -- 172.21.15.42:0/1410824333 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f7f680170d0 con 0x7f7f70153380 2023-07-29T01:59:57.517 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.529+0000 7f7f78498700 1 -- 172.21.15.42:0/1410824333 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7f5406a660 msgr2=0x7f7f5406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:57.517 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.529+0000 7f7f78498700 1 --2- 172.21.15.42:0/1410824333 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7f5406a660 0x7f7f5406cb10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7f64006fd0 tx=0x7f7f64008040 comp rx=0 tx=0).stop 2023-07-29T01:59:57.517 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.529+0000 7f7f78498700 1 -- 172.21.15.42:0/1410824333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f70153380 msgr2=0x7f7f7015b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:57.517 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.529+0000 7f7f78498700 1 --2- 172.21.15.42:0/1410824333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f70153380 0x7f7f7015b410 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7f6800b370 tx=0x7f7f68004ad0 comp rx=0 tx=0).stop 2023-07-29T01:59:57.518 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.529+0000 7f7f78498700 1 -- 172.21.15.42:0/1410824333 shutdown_connections 2023-07-29T01:59:57.518 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.529+0000 7f7f78498700 1 --2- 172.21.15.42:0/1410824333 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7f5406a660 0x7f7f5406cb10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:57.518 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.529+0000 7f7f78498700 1 --2- 172.21.15.42:0/1410824333 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7f70153380 0x7f7f7015b410 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:57.518 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.529+0000 7f7f78498700 1 --2- 172.21.15.42:0/1410824333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7f700c7d90 0x7f7f701f2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:57.519 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.529+0000 7f7f78498700 1 --2- 172.21.15.42:0/1410824333 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7f700c81f0 0x7f7f700cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:57.519 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.529+0000 7f7f78498700 1 -- 172.21.15.42:0/1410824333 >> 172.21.15.42:0/1410824333 conn(0x7f7f70061190 msgr2=0x7f7f7014d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:57.519 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.530+0000 7f7f78498700 1 -- 172.21.15.42:0/1410824333 shutdown_connections 2023-07-29T01:59:57.519 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.530+0000 7f7f78498700 1 -- 172.21.15.42:0/1410824333 wait complete. 2023-07-29T01:59:57.522 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' created 2023-07-29T01:59:57.543 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-29T01:59:57.676 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.688+0000 7fc08bc0c700 1 Processor -- start 2023-07-29T01:59:57.676 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.688+0000 7fc08bc0c700 1 -- start start 2023-07-29T01:59:57.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.689+0000 7fc08bc0c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc084061520 0x7fc0840c5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:57.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.689+0000 7fc08bc0c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc0840c2b90 0x7fc0840c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:57.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.689+0000 7fc08bc0c700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc084157710 con 0x7fc0841512f0 2023-07-29T01:59:57.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.689+0000 7fc08bc0c700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0840c34d0 con 0x7fc084061520 2023-07-29T01:59:57.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.689+0000 7fc08bc0c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0840c8e20 con 0x7fc0840c2b90 2023-07-29T01:59:57.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.689+0000 7fc0891a7700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc084061520 0x7fc0840c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:57.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.689+0000 7fc0899a8700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc0841512f0 0x7fc0840c67e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49386/0 (socket says 172.21.15.42:49386) 2023-07-29T01:59:57.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.689+0000 7fc0899a8700 1 -- 172.21.15.42:0/2122375957 learned_addr learned my addr 172.21.15.42:0/2122375957 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T01:59:57.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.690+0000 7fc08a1a9700 1 --2- 172.21.15.42:0/2122375957 >> v2:172.21.15.144:3300/0 conn(0x7fc0840c2b90 0x7fc0840c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:57.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.690+0000 7fc0891a7700 1 -- 172.21.15.42:0/2122375957 >> v2:172.21.15.144:3300/0 conn(0x7fc0840c2b90 msgr2=0x7fc0840c2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:57.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.690+0000 7fc0891a7700 1 --2- 172.21.15.42:0/2122375957 >> v2:172.21.15.144:3300/0 conn(0x7fc0840c2b90 0x7fc0840c2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:57.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.690+0000 7fc0891a7700 1 -- 172.21.15.42:0/2122375957 >> v1:172.21.15.42:6789/0 conn(0x7fc0841512f0 legacy=0x7fc0840c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:57.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.690+0000 7fc0891a7700 1 -- 172.21.15.42:0/2122375957 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc084156e00 con 0x7fc084061520 2023-07-29T01:59:57.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.690+0000 7fc0889a6700 1 -- 172.21.15.42:0/2122375957 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161381275 0 0) 0x7fc084157710 con 0x7fc0841512f0 2023-07-29T01:59:57.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.690+0000 7fc0891a7700 1 --2- 172.21.15.42:0/2122375957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc084061520 0x7fc0840c5510 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc08415b410 tx=0x7fc080009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362526eaa9a83bc5 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:57.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.690+0000 7fc0889a6700 1 -- 172.21.15.42:0/2122375957 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080011830 con 0x7fc084061520 2023-07-29T01:59:57.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.690+0000 7fc0889a6700 1 -- 172.21.15.42:0/2122375957 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc080011990 con 0x7fc084061520 2023-07-29T01:59:57.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.690+0000 7fc0889a6700 1 -- 172.21.15.42:0/2122375957 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080011d20 con 0x7fc084061520 2023-07-29T01:59:57.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.690+0000 7fc08bc0c700 1 -- 172.21.15.42:0/2122375957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc084061520 msgr2=0x7fc0840c5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:57.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.690+0000 7fc08bc0c700 1 --2- 172.21.15.42:0/2122375957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc084061520 0x7fc0840c5510 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc08415b410 tx=0x7fc080009b20 comp rx=0 tx=0).stop 2023-07-29T01:59:57.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.690+0000 7fc08bc0c700 1 -- 172.21.15.42:0/2122375957 shutdown_connections 2023-07-29T01:59:57.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.690+0000 7fc08bc0c700 1 --2- 172.21.15.42:0/2122375957 >> v2:172.21.15.144:3300/0 conn(0x7fc0840c2b90 0x7fc0840c2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:57.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.690+0000 7fc08bc0c700 1 --2- 172.21.15.42:0/2122375957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc084061520 0x7fc0840c5510 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:57.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.690+0000 7fc08bc0c700 1 -- 172.21.15.42:0/2122375957 >> 172.21.15.42:0/2122375957 conn(0x7fc0840cc420 msgr2=0x7fc0840c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:57.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.691+0000 7fc08bc0c700 1 -- 172.21.15.42:0/2122375957 shutdown_connections 2023-07-29T01:59:57.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.691+0000 7fc08bc0c700 1 -- 172.21.15.42:0/2122375957 wait complete. 2023-07-29T01:59:57.684 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.692+0000 7fc08bc0c700 1 Processor -- start 2023-07-29T01:59:57.684 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.692+0000 7fc08bc0c700 1 -- start start 2023-07-29T01:59:57.684 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc08bc0c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc084061520 0x7fc08414b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:57.684 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc08bc0c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0840c2b90 0x7fc0841494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:57.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc08bc0c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0841512f0 0x7fc084149a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:57.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc08bc0c700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0841ef7a0 con 0x7fc0841512f0 2023-07-29T01:59:57.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc08bc0c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0840ca880 con 0x7fc0840c2b90 2023-07-29T01:59:57.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc08bc0c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0841efc90 con 0x7fc084061520 2023-07-29T01:59:57.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc08a1a9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0841512f0 0x7fc084149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:57.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc08a1a9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0841512f0 0x7fc084149a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55592/0 (socket says 172.21.15.42:55592) 2023-07-29T01:59:57.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc08a1a9700 1 -- 172.21.15.42:0/3213319388 learned_addr learned my addr 172.21.15.42:0/3213319388 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:57.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc0891a7700 1 --2- 172.21.15.42:0/3213319388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0840c2b90 0x7fc0841494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:57.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc0899a8700 1 --2- 172.21.15.42:0/3213319388 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc084061520 0x7fc08414b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:57.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc08a1a9700 1 -- 172.21.15.42:0/3213319388 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc084061520 msgr2=0x7fc08414b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:57.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc08a1a9700 1 --2- 172.21.15.42:0/3213319388 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc084061520 0x7fc08414b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:57.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc08a1a9700 1 -- 172.21.15.42:0/3213319388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0840c2b90 msgr2=0x7fc0841494e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:57.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc08a1a9700 1 --2- 172.21.15.42:0/3213319388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0840c2b90 0x7fc0841494e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:57.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc08a1a9700 1 -- 172.21.15.42:0/3213319388 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0800094a0 con 0x7fc0841512f0 2023-07-29T01:59:57.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc0899a8700 1 --2- 172.21.15.42:0/3213319388 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc084061520 0x7fc08414b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T01:59:57.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc08a1a9700 1 --2- 172.21.15.42:0/3213319388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0841512f0 0x7fc084149a20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc07c007e40 tx=0x7fc07c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:57.687 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc07a7fc700 1 -- 172.21.15.42:0/3213319388 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c00eea0 con 0x7fc0841512f0 2023-07-29T01:59:57.687 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc07a7fc700 1 -- 172.21.15.42:0/3213319388 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c014420 con 0x7fc0841512f0 2023-07-29T01:59:57.687 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc08bc0c700 1 -- 172.21.15.42:0/3213319388 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0840ca270 con 0x7fc0841512f0 2023-07-29T01:59:57.687 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc07a7fc700 1 -- 172.21.15.42:0/3213319388 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c0147b0 con 0x7fc0841512f0 2023-07-29T01:59:57.687 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.693+0000 7fc08bc0c700 1 -- 172.21.15.42:0/3213319388 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0840ca510 con 0x7fc0841512f0 2023-07-29T01:59:57.688 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.694+0000 7fc08bc0c700 1 -- 172.21.15.42:0/3213319388 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0840c63a0 con 0x7fc0841512f0 2023-07-29T01:59:57.688 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.695+0000 7fc07a7fc700 1 -- 172.21.15.42:0/3213319388 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fc07c014910 con 0x7fc0841512f0 2023-07-29T01:59:57.688 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.695+0000 7fc07a7fc700 1 --2- 172.21.15.42:0/3213319388 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc06806a660 0x7fc06806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:57.688 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.695+0000 7fc07a7fc700 1 -- 172.21.15.42:0/3213319388 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fc07c089200 con 0x7fc0841512f0 2023-07-29T01:59:57.688 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.695+0000 7fc0899a8700 1 --2- 172.21.15.42:0/3213319388 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc06806a660 0x7fc06806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:57.688 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.696+0000 7fc0899a8700 1 --2- 172.21.15.42:0/3213319388 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc06806a660 0x7fc06806cb10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc074007fd0 tx=0x7fc074009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:57.689 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.700+0000 7fc07a7fc700 1 -- 172.21.15.42:0/3213319388 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fc07c0546f0 con 0x7fc0841512f0 2023-07-29T01:59:57.933 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.945+0000 7fc08bc0c700 1 -- 172.21.15.42:0/3213319388 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc08404ea50 con 0x7fc0841512f0 2023-07-29T01:59:57.939 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.951+0000 7fc07a7fc700 1 -- 172.21.15.42:0/3213319388 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc07c057d10 con 0x7fc0841512f0 2023-07-29T01:59:57.943 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.954+0000 7fc08bc0c700 1 -- 172.21.15.42:0/3213319388 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc06806a660 msgr2=0x7fc06806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:57.943 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.955+0000 7fc08bc0c700 1 --2- 172.21.15.42:0/3213319388 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc06806a660 0x7fc06806cb10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc074007fd0 tx=0x7fc074009040 comp rx=0 tx=0).stop 2023-07-29T01:59:57.943 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.955+0000 7fc08bc0c700 1 -- 172.21.15.42:0/3213319388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0841512f0 msgr2=0x7fc084149a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:57.943 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.955+0000 7fc08bc0c700 1 --2- 172.21.15.42:0/3213319388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0841512f0 0x7fc084149a20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc07c007e40 tx=0x7fc07c00e3c0 comp rx=0 tx=0).stop 2023-07-29T01:59:57.944 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.955+0000 7fc08bc0c700 1 -- 172.21.15.42:0/3213319388 shutdown_connections 2023-07-29T01:59:57.944 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.955+0000 7fc08bc0c700 1 --2- 172.21.15.42:0/3213319388 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc06806a660 0x7fc06806cb10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:57.944 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.955+0000 7fc08bc0c700 1 --2- 172.21.15.42:0/3213319388 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0841512f0 0x7fc084149a20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:57.944 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.955+0000 7fc08bc0c700 1 --2- 172.21.15.42:0/3213319388 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc084061520 0x7fc08414b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:57.944 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.955+0000 7fc08bc0c700 1 --2- 172.21.15.42:0/3213319388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc0840c2b90 0x7fc0841494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:57.944 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.955+0000 7fc08bc0c700 1 -- 172.21.15.42:0/3213319388 >> 172.21.15.42:0/3213319388 conn(0x7fc0840cc420 msgr2=0x7fc084154bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:57.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.956+0000 7fc08bc0c700 1 -- 172.21.15.42:0/3213319388 shutdown_connections 2023-07-29T01:59:57.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:57.957+0000 7fc08bc0c700 1 -- 172.21.15.42:0/3213319388 wait complete. 2023-07-29T01:59:57.953 INFO:teuthology.orchestra.run.smithi042.stderr:new fs with metadata pool 3 and data pool 4 2023-07-29T01:59:57.967 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-07-29T01:59:57.967 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-07-29T01:59:58.097 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.109+0000 7fa98ac81700 1 Processor -- start 2023-07-29T01:59:58.098 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.109+0000 7fa98ac81700 1 -- start start 2023-07-29T01:59:58.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.110+0000 7fa98ac81700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa9841512e0 0x7fa98415a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:58.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.110+0000 7fa98ac81700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa9840c3e30 0x7fa9840c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:58.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.110+0000 7fa98ac81700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9840c7f70 con 0x7fa98406f420 2023-07-29T01:59:58.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.110+0000 7fa98ac81700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9840c31e0 con 0x7fa9840c3e30 2023-07-29T01:59:58.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.110+0000 7fa98ac81700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9840c2580 con 0x7fa9841512e0 2023-07-29T01:59:58.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.110+0000 7fa983fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa98406f420 0x7fa9840cd000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49400/0 (socket says 172.21.15.42:49400) 2023-07-29T01:59:58.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.110+0000 7fa983fff700 1 -- 172.21.15.42:0/3651018125 learned_addr learned my addr 172.21.15.42:0/3651018125 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T01:59:58.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.110+0000 7fa98921e700 1 --2- 172.21.15.42:0/3651018125 >> v2:172.21.15.42:3300/0 conn(0x7fa9840c3e30 0x7fa9840c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:58.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.111+0000 7fa988a1d700 1 --2- 172.21.15.42:0/3651018125 >> v2:172.21.15.144:3300/0 conn(0x7fa9841512e0 0x7fa98415a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:58.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.111+0000 7fa9837fe700 1 -- 172.21.15.42:0/3651018125 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026611164 0 0) 0x7fa9840c7f70 con 0x7fa98406f420 2023-07-29T01:59:58.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.111+0000 7fa9837fe700 1 -- 172.21.15.42:0/3651018125 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9740035b0 con 0x7fa98406f420 2023-07-29T01:59:58.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.111+0000 7fa98921e700 1 -- 172.21.15.42:0/3651018125 >> v2:172.21.15.144:3300/0 conn(0x7fa9841512e0 msgr2=0x7fa98415a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:58.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.111+0000 7fa98921e700 1 --2- 172.21.15.42:0/3651018125 >> v2:172.21.15.144:3300/0 conn(0x7fa9841512e0 0x7fa98415a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:58.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.111+0000 7fa98921e700 1 -- 172.21.15.42:0/3651018125 >> v1:172.21.15.42:6789/0 conn(0x7fa98406f420 legacy=0x7fa9840cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:58.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.111+0000 7fa98921e700 1 -- 172.21.15.42:0/3651018125 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa984157cd0 con 0x7fa9840c3e30 2023-07-29T01:59:58.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.111+0000 7fa98921e700 1 --2- 172.21.15.42:0/3651018125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9840c3e30 0x7fa9840c7a30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa9840ce060 tx=0x7fa97c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c014d720301ee4c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:58.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.111+0000 7fa9837fe700 1 -- 172.21.15.42:0/3651018125 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c00e070 con 0x7fa9840c3e30 2023-07-29T01:59:58.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.111+0000 7fa9837fe700 1 -- 172.21.15.42:0/3651018125 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c00bb20 con 0x7fa9840c3e30 2023-07-29T01:59:58.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.111+0000 7fa9837fe700 1 -- 172.21.15.42:0/3651018125 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c00be90 con 0x7fa9840c3e30 2023-07-29T01:59:58.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.112+0000 7fa98ac81700 1 -- 172.21.15.42:0/3651018125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9840c3e30 msgr2=0x7fa9840c7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:58.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.112+0000 7fa98ac81700 1 --2- 172.21.15.42:0/3651018125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9840c3e30 0x7fa9840c7a30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa9840ce060 tx=0x7fa97c00b330 comp rx=0 tx=0).stop 2023-07-29T01:59:58.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.112+0000 7fa98ac81700 1 -- 172.21.15.42:0/3651018125 shutdown_connections 2023-07-29T01:59:58.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.112+0000 7fa98ac81700 1 --2- 172.21.15.42:0/3651018125 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9840c3e30 0x7fa9840c7a30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:58.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.112+0000 7fa98ac81700 1 --2- 172.21.15.42:0/3651018125 >> v2:172.21.15.144:3300/0 conn(0x7fa9841512e0 0x7fa98415a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:58.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.112+0000 7fa98ac81700 1 -- 172.21.15.42:0/3651018125 >> 172.21.15.42:0/3651018125 conn(0x7fa984061190 msgr2=0x7fa984061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:58.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.112+0000 7fa98ac81700 1 -- 172.21.15.42:0/3651018125 shutdown_connections 2023-07-29T01:59:58.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.112+0000 7fa98ac81700 1 -- 172.21.15.42:0/3651018125 wait complete. 2023-07-29T01:59:58.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.113+0000 7fa98ac81700 1 Processor -- start 2023-07-29T01:59:58.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.113+0000 7fa98ac81700 1 -- start start 2023-07-29T01:59:58.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.114+0000 7fa98ac81700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa98406f420 0x7fa9840c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:58.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.114+0000 7fa98ac81700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9840c3e30 0x7fa9841f0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:58.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.114+0000 7fa98ac81700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa9841512e0 0x7fa9841519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:58.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.114+0000 7fa98ac81700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9841ec940 con 0x7fa9840c3e30 2023-07-29T01:59:58.106 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.114+0000 7fa98ac81700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9841f0dd0 con 0x7fa98406f420 2023-07-29T01:59:58.106 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.114+0000 7fa98ac81700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9840ccfd0 con 0x7fa9841512e0 2023-07-29T01:59:58.106 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.114+0000 7fa983fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9840c3e30 0x7fa9841f0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:58.106 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.114+0000 7fa983fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9840c3e30 0x7fa9841f0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55604/0 (socket says 172.21.15.42:55604) 2023-07-29T01:59:58.106 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.114+0000 7fa983fff700 1 -- 172.21.15.42:0/888446483 learned_addr learned my addr 172.21.15.42:0/888446483 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:58.106 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.114+0000 7fa988a1d700 1 --2- 172.21.15.42:0/888446483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa98406f420 0x7fa9840c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:58.106 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.114+0000 7fa98921e700 1 --2- 172.21.15.42:0/888446483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa9841512e0 0x7fa9841519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:58.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.114+0000 7fa983fff700 1 -- 172.21.15.42:0/888446483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa9841512e0 msgr2=0x7fa9841519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:58.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.114+0000 7fa983fff700 1 --2- 172.21.15.42:0/888446483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa9841512e0 0x7fa9841519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:58.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.114+0000 7fa983fff700 1 -- 172.21.15.42:0/888446483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa98406f420 msgr2=0x7fa9840c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:58.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.114+0000 7fa983fff700 1 --2- 172.21.15.42:0/888446483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa98406f420 0x7fa9840c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:58.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.114+0000 7fa983fff700 1 -- 172.21.15.42:0/888446483 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97c009a70 con 0x7fa9840c3e30 2023-07-29T01:59:58.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.114+0000 7fa983fff700 1 --2- 172.21.15.42:0/888446483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9840c3e30 0x7fa9841f0890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa97000c4d0 tx=0x7fa97000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:58.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.115+0000 7fa9817fa700 1 -- 172.21.15.42:0/888446483 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970005d70 con 0x7fa9840c3e30 2023-07-29T01:59:58.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.115+0000 7fa9817fa700 1 -- 172.21.15.42:0/888446483 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9700070d0 con 0x7fa9840c3e30 2023-07-29T01:59:58.108 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.115+0000 7fa98ac81700 1 -- 172.21.15.42:0/888446483 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9840cd2b0 con 0x7fa9840c3e30 2023-07-29T01:59:58.108 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.115+0000 7fa9817fa700 1 -- 172.21.15.42:0/888446483 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970007440 con 0x7fa9840c3e30 2023-07-29T01:59:58.108 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.115+0000 7fa98ac81700 1 -- 172.21.15.42:0/888446483 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9841ece30 con 0x7fa9840c3e30 2023-07-29T01:59:58.108 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.116+0000 7fa98ac81700 1 -- 172.21.15.42:0/888446483 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98404ea50 con 0x7fa9840c3e30 2023-07-29T01:59:58.108 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.116+0000 7fa9817fa700 1 -- 172.21.15.42:0/888446483 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fa9700075a0 con 0x7fa9840c3e30 2023-07-29T01:59:58.109 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.116+0000 7fa9817fa700 1 --2- 172.21.15.42:0/888446483 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa96806a660 0x7fa96806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:58.109 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.116+0000 7fa9817fa700 1 -- 172.21.15.42:0/888446483 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa970087d10 con 0x7fa9840c3e30 2023-07-29T01:59:58.109 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.117+0000 7fa988a1d700 1 --2- 172.21.15.42:0/888446483 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa96806a660 0x7fa96806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:58.109 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.117+0000 7fa988a1d700 1 --2- 172.21.15.42:0/888446483 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa96806a660 0x7fa96806cb10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa978009b40 tx=0x7fa978009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:58.109 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.121+0000 7fa9817fa700 1 -- 172.21.15.42:0/888446483 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fa97004c2c0 con 0x7fa9840c3e30 2023-07-29T01:59:58.318 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.330+0000 7fa98ac81700 1 -- 172.21.15.42:0/888446483 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fa9840c8de0 con 0x7fa9840c3e30 2023-07-29T01:59:58.939 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.950+0000 7fa9817fa700 1 -- 172.21.15.42:0/888446483 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7fa970017020 con 0x7fa9840c3e30 2023-07-29T01:59:58.942 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.953+0000 7fa98ac81700 1 -- 172.21.15.42:0/888446483 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa96806a660 msgr2=0x7fa96806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:58.942 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.953+0000 7fa98ac81700 1 --2- 172.21.15.42:0/888446483 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa96806a660 0x7fa96806cb10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa978009b40 tx=0x7fa978009210 comp rx=0 tx=0).stop 2023-07-29T01:59:58.942 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.953+0000 7fa98ac81700 1 -- 172.21.15.42:0/888446483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9840c3e30 msgr2=0x7fa9841f0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:58.942 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.953+0000 7fa98ac81700 1 --2- 172.21.15.42:0/888446483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9840c3e30 0x7fa9841f0890 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa97000c4d0 tx=0x7fa97000c7e0 comp rx=0 tx=0).stop 2023-07-29T01:59:58.942 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.954+0000 7fa98ac81700 1 -- 172.21.15.42:0/888446483 shutdown_connections 2023-07-29T01:59:58.943 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.954+0000 7fa98ac81700 1 --2- 172.21.15.42:0/888446483 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa96806a660 0x7fa96806cb10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:58.943 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.954+0000 7fa98ac81700 1 --2- 172.21.15.42:0/888446483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa9841512e0 0x7fa9841519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:58.943 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.954+0000 7fa98ac81700 1 --2- 172.21.15.42:0/888446483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa98406f420 0x7fa9840c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:58.943 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.954+0000 7fa98ac81700 1 --2- 172.21.15.42:0/888446483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa9840c3e30 0x7fa9841f0890 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:58.943 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.954+0000 7fa98ac81700 1 -- 172.21.15.42:0/888446483 >> 172.21.15.42:0/888446483 conn(0x7fa984061190 msgr2=0x7fa98406fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:58.943 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.954+0000 7fa98ac81700 1 -- 172.21.15.42:0/888446483 shutdown_connections 2023-07-29T01:59:58.943 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:58.954+0000 7fa98ac81700 1 -- 172.21.15.42:0/888446483 wait complete. 2023-07-29T01:59:58.956 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-07-29T01:59:59.096 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.108+0000 7fdd542ed700 1 Processor -- start 2023-07-29T01:59:59.097 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.108+0000 7fdd542ed700 1 -- start start 2023-07-29T01:59:59.098 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.109+0000 7fdd542ed700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdd4c06e9e0 0x7fdd4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:59.098 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.109+0000 7fdd542ed700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd4c156b50 0x7fdd4c0c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:59.098 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.109+0000 7fdd542ed700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd4c06aa30 con 0x7fdd4c072a90 2023-07-29T01:59:59.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.109+0000 7fdd542ed700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd4c06b650 con 0x7fdd4c06e9e0 2023-07-29T01:59:59.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.109+0000 7fdd542ed700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c0c6f70 con 0x7fdd4c156b50 2023-07-29T01:59:59.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.110+0000 7fdd5288a700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fdd4c072a90 0x7fdd4c15a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49418/0 (socket says 172.21.15.42:49418) 2023-07-29T01:59:59.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.110+0000 7fdd5288a700 1 -- 172.21.15.42:0/745671710 learned_addr learned my addr 172.21.15.42:0/745671710 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T01:59:59.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.110+0000 7fdd51888700 1 --2- 172.21.15.42:0/745671710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd4c156b50 0x7fdd4c0c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:59.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.110+0000 7fdd52089700 1 --2- 172.21.15.42:0/745671710 >> v2:172.21.15.144:3300/0 conn(0x7fdd4c06e9e0 0x7fdd4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:59.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.110+0000 7fdd51087700 1 -- 172.21.15.42:0/745671710 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4241549663 0 0) 0x7fdd4c06aa30 con 0x7fdd4c072a90 2023-07-29T01:59:59.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.110+0000 7fdd51087700 1 -- 172.21.15.42:0/745671710 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd380035b0 con 0x7fdd4c072a90 2023-07-29T01:59:59.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.110+0000 7fdd51888700 1 -- 172.21.15.42:0/745671710 >> v2:172.21.15.144:3300/0 conn(0x7fdd4c06e9e0 msgr2=0x7fdd4c06edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T01:59:59.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.110+0000 7fdd51888700 1 --2- 172.21.15.42:0/745671710 >> v2:172.21.15.144:3300/0 conn(0x7fdd4c06e9e0 0x7fdd4c06edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:59.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.110+0000 7fdd51888700 1 -- 172.21.15.42:0/745671710 >> v1:172.21.15.42:6789/0 conn(0x7fdd4c072a90 legacy=0x7fdd4c15a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:59.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.110+0000 7fdd51087700 1 -- 172.21.15.42:0/745671710 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3378824447 0 0) 0x7fdd380035b0 con 0x7fdd4c072a90 2023-07-29T01:59:59.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.110+0000 7fdd51888700 1 -- 172.21.15.42:0/745671710 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c0c7500 con 0x7fdd4c156b50 2023-07-29T01:59:59.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.110+0000 7fdd51888700 1 --2- 172.21.15.42:0/745671710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd4c156b50 0x7fdd4c0c80b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009820 tx=0x7fdd3c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85e75fd41aed842d server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:59.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.110+0000 7fdd51087700 1 -- 172.21.15.42:0/745671710 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd440019f0 con 0x7fdd4c156b50 2023-07-29T01:59:59.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.111+0000 7fdd51087700 1 -- 172.21.15.42:0/745671710 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c005c30 con 0x7fdd4c156b50 2023-07-29T01:59:59.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.111+0000 7fdd51087700 1 -- 172.21.15.42:0/745671710 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c004030 con 0x7fdd4c156b50 2023-07-29T01:59:59.103 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.111+0000 7fdd542ed700 1 -- 172.21.15.42:0/745671710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd4c156b50 msgr2=0x7fdd4c0c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:59.103 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.111+0000 7fdd542ed700 1 --2- 172.21.15.42:0/745671710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd4c156b50 0x7fdd4c0c80b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009820 tx=0x7fdd3c009b30 comp rx=0 tx=0).stop 2023-07-29T01:59:59.103 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.111+0000 7fdd542ed700 1 -- 172.21.15.42:0/745671710 shutdown_connections 2023-07-29T01:59:59.103 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.111+0000 7fdd542ed700 1 --2- 172.21.15.42:0/745671710 >> v2:172.21.15.144:3300/0 conn(0x7fdd4c06e9e0 0x7fdd4c06edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.111+0000 7fdd542ed700 1 --2- 172.21.15.42:0/745671710 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd4c156b50 0x7fdd4c0c80b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.111+0000 7fdd542ed700 1 -- 172.21.15.42:0/745671710 >> 172.21.15.42:0/745671710 conn(0x7fdd4c0cbf10 msgr2=0x7fdd4c0cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T01:59:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.111+0000 7fdd542ed700 1 -- 172.21.15.42:0/745671710 shutdown_connections 2023-07-29T01:59:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.111+0000 7fdd542ed700 1 -- 172.21.15.42:0/745671710 wait complete. 2023-07-29T01:59:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.112+0000 7fdd542ed700 1 Processor -- start 2023-07-29T01:59:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.112+0000 7fdd542ed700 1 -- start start 2023-07-29T01:59:59.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.113+0000 7fdd542ed700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd4c06e9e0 0x7fdd4c0c0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:59.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.113+0000 7fdd542ed700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd4c072a90 0x7fdd4c14a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:59.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.113+0000 7fdd542ed700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd4c156b50 0x7fdd4c1f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:59.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.113+0000 7fdd542ed700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c143150 con 0x7fdd4c156b50 2023-07-29T01:59:59.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.113+0000 7fdd542ed700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c14c0a0 con 0x7fdd4c06e9e0 2023-07-29T01:59:59.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.113+0000 7fdd542ed700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c1478f0 con 0x7fdd4c072a90 2023-07-29T01:59:59.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.113+0000 7fdd5288a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd4c156b50 0x7fdd4c1f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:59.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.113+0000 7fdd5288a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd4c156b50 0x7fdd4c1f2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55620/0 (socket says 172.21.15.42:55620) 2023-07-29T01:59:59.106 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.113+0000 7fdd5288a700 1 -- 172.21.15.42:0/2378975664 learned_addr learned my addr 172.21.15.42:0/2378975664 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T01:59:59.106 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.113+0000 7fdd51888700 1 --2- 172.21.15.42:0/2378975664 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd4c072a90 0x7fdd4c14a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:59.106 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.113+0000 7fdd52089700 1 --2- 172.21.15.42:0/2378975664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd4c06e9e0 0x7fdd4c0c0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:59.106 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.113+0000 7fdd5288a700 1 -- 172.21.15.42:0/2378975664 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd4c072a90 msgr2=0x7fdd4c14a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:59.106 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.113+0000 7fdd5288a700 1 --2- 172.21.15.42:0/2378975664 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd4c072a90 0x7fdd4c14a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:59.106 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.113+0000 7fdd5288a700 1 -- 172.21.15.42:0/2378975664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd4c06e9e0 msgr2=0x7fdd4c0c0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T01:59:59.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.113+0000 7fdd5288a700 1 --2- 172.21.15.42:0/2378975664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd4c06e9e0 0x7fdd4c0c0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T01:59:59.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.113+0000 7fdd5288a700 1 -- 172.21.15.42:0/2378975664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3c009430 con 0x7fdd4c156b50 2023-07-29T01:59:59.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.113+0000 7fdd51888700 1 --2- 172.21.15.42:0/2378975664 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd4c072a90 0x7fdd4c14a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T01:59:59.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.113+0000 7fdd52089700 1 --2- 172.21.15.42:0/2378975664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd4c06e9e0 0x7fdd4c0c0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T01:59:59.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.114+0000 7fdd5288a700 1 --2- 172.21.15.42:0/2378975664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd4c156b50 0x7fdd4c1f2370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdd4400cc70 tx=0x7fdd4400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:59.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.114+0000 7fdd42ffd700 1 -- 172.21.15.42:0/2378975664 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4400ada0 con 0x7fdd4c156b50 2023-07-29T01:59:59.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.114+0000 7fdd42ffd700 1 -- 172.21.15.42:0/2378975664 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4400ce70 con 0x7fdd4c156b50 2023-07-29T01:59:59.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.114+0000 7fdd542ed700 1 -- 172.21.15.42:0/2378975664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd4c14c2f0 con 0x7fdd4c156b50 2023-07-29T01:59:59.108 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.114+0000 7fdd42ffd700 1 -- 172.21.15.42:0/2378975664 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd440072f0 con 0x7fdd4c156b50 2023-07-29T01:59:59.108 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.114+0000 7fdd542ed700 1 -- 172.21.15.42:0/2378975664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4c148600 con 0x7fdd4c156b50 2023-07-29T01:59:59.108 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.115+0000 7fdd542ed700 1 -- 172.21.15.42:0/2378975664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4c04ea50 con 0x7fdd4c156b50 2023-07-29T01:59:59.108 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.115+0000 7fdd42ffd700 1 -- 172.21.15.42:0/2378975664 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fdd44007450 con 0x7fdd4c156b50 2023-07-29T01:59:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.116+0000 7fdd42ffd700 1 --2- 172.21.15.42:0/2378975664 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fdd3006a660 0x7fdd3006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T01:59:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.116+0000 7fdd42ffd700 1 -- 172.21.15.42:0/2378975664 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6288+0+0 (secure 0 0 0) 0x7fdd44088c90 con 0x7fdd4c156b50 2023-07-29T01:59:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.116+0000 7fdd52089700 1 --2- 172.21.15.42:0/2378975664 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fdd3006a660 0x7fdd3006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T01:59:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.116+0000 7fdd52089700 1 --2- 172.21.15.42:0/2378975664 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fdd3006a660 0x7fdd3006cb10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009b60 tx=0x7fdd48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T01:59:59.109 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.120+0000 7fdd42ffd700 1 -- 172.21.15.42:0/2378975664 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fdd44053ea0 con 0x7fdd4c156b50 2023-07-29T01:59:59.305 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T01:59:59.317+0000 7fdd542ed700 1 -- 172.21.15.42:0/2378975664 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdd4c147a30 con 0x7fdd4c156b50 2023-07-29T02:00:00.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:00.965+0000 7fdd42ffd700 1 -- 172.21.15.42:0/2378975664 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7fdd44018070 con 0x7fdd4c156b50 2023-07-29T02:00:00.961 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:00.972+0000 7fdd542ed700 1 -- 172.21.15.42:0/2378975664 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fdd3006a660 msgr2=0x7fdd3006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:00.961 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:00.972+0000 7fdd542ed700 1 --2- 172.21.15.42:0/2378975664 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fdd3006a660 0x7fdd3006cb10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009b60 tx=0x7fdd48008040 comp rx=0 tx=0).stop 2023-07-29T02:00:00.961 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:00.972+0000 7fdd542ed700 1 -- 172.21.15.42:0/2378975664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd4c156b50 msgr2=0x7fdd4c1f2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:00.961 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:00.972+0000 7fdd542ed700 1 --2- 172.21.15.42:0/2378975664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd4c156b50 0x7fdd4c1f2370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdd4400cc70 tx=0x7fdd4400a340 comp rx=0 tx=0).stop 2023-07-29T02:00:00.962 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:00.973+0000 7fdd542ed700 1 -- 172.21.15.42:0/2378975664 shutdown_connections 2023-07-29T02:00:00.962 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:00.973+0000 7fdd542ed700 1 --2- 172.21.15.42:0/2378975664 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fdd3006a660 0x7fdd3006cb10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:00.962 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:00.973+0000 7fdd542ed700 1 --2- 172.21.15.42:0/2378975664 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdd4c156b50 0x7fdd4c1f2370 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:00.962 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:00.973+0000 7fdd542ed700 1 --2- 172.21.15.42:0/2378975664 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd4c06e9e0 0x7fdd4c0c0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:00.962 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:00.973+0000 7fdd542ed700 1 --2- 172.21.15.42:0/2378975664 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdd4c072a90 0x7fdd4c14a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:00.962 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:00.973+0000 7fdd542ed700 1 -- 172.21.15.42:0/2378975664 >> 172.21.15.42:0/2378975664 conn(0x7fdd4c0cbf10 msgr2=0x7fdd4c071590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:00.963 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:00.973+0000 7fdd542ed700 1 -- 172.21.15.42:0/2378975664 shutdown_connections 2023-07-29T02:00:00.963 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:00.973+0000 7fdd542ed700 1 -- 172.21.15.42:0/2378975664 wait complete. 2023-07-29T02:00:00.966 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data_ec' created 2023-07-29T02:00:00.980 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-07-29T02:00:01.115 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.127+0000 7f8c82e70700 1 Processor -- start 2023-07-29T02:00:01.116 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.127+0000 7f8c82e70700 1 -- start start 2023-07-29T02:00:01.117 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.128+0000 7f8c82e70700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8c7c159570 0x7f8c7c155440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:01.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.128+0000 7f8c82e70700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7c0c0210 con 0x7f8c7c14f560 2023-07-29T02:00:01.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.128+0000 7f8c82e70700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7c1590e0 con 0x7f8c7c0bfe40 2023-07-29T02:00:01.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.128+0000 7f8c82e70700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7c0cb570 con 0x7f8c7c159570 2023-07-29T02:00:01.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.128+0000 7f8c7bfff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8c7c159570 0x7f8c7c155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:01.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.128+0000 7f8c7bfff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8c7c159570 0x7f8c7c155440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55626/0 (socket says 172.21.15.42:55626) 2023-07-29T02:00:01.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.128+0000 7f8c8140d700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f8c7c14f560 0x7f8c7c0cae60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49432/0 (socket says 172.21.15.42:49432) 2023-07-29T02:00:01.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.128+0000 7f8c7bfff700 1 -- 172.21.15.42:0/3411292524 learned_addr learned my addr 172.21.15.42:0/3411292524 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:01.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.129+0000 7f8c7bfff700 1 -- 172.21.15.42:0/3411292524 >> v1:172.21.15.144:6789/0 conn(0x7f8c7c0bfe40 legacy=0x7f8c7c0c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:01.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.129+0000 7f8c7bfff700 1 -- 172.21.15.42:0/3411292524 >> v1:172.21.15.42:6789/0 conn(0x7f8c7c14f560 legacy=0x7f8c7c0cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:01.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.129+0000 7f8c7b7fe700 1 -- 172.21.15.42:0/3411292524 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492685714 0 0) 0x7f8c74001490 con 0x7f8c7c14f560 2023-07-29T02:00:01.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.129+0000 7f8c7bfff700 1 -- 172.21.15.42:0/3411292524 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c1599a0 con 0x7f8c7c159570 2023-07-29T02:00:01.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.129+0000 7f8c7bfff700 1 --2- 172.21.15.42:0/3411292524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c7c159570 0x7f8c7c155440 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8c680098f0 tx=0x7f8c68009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78aac17c42606782 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:01.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.129+0000 7f8c7b7fe700 1 -- 172.21.15.42:0/3411292524 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800b8a0 con 0x7f8c7c159570 2023-07-29T02:00:01.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.129+0000 7f8c7b7fe700 1 -- 172.21.15.42:0/3411292524 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6800ba00 con 0x7f8c7c159570 2023-07-29T02:00:01.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.129+0000 7f8c7b7fe700 1 -- 172.21.15.42:0/3411292524 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800bd90 con 0x7f8c7c159570 2023-07-29T02:00:01.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.129+0000 7f8c82e70700 1 -- 172.21.15.42:0/3411292524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c7c159570 msgr2=0x7f8c7c155440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:01.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.129+0000 7f8c82e70700 1 --2- 172.21.15.42:0/3411292524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c7c159570 0x7f8c7c155440 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8c680098f0 tx=0x7f8c68009c00 comp rx=0 tx=0).stop 2023-07-29T02:00:01.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.130+0000 7f8c82e70700 1 -- 172.21.15.42:0/3411292524 shutdown_connections 2023-07-29T02:00:01.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.130+0000 7f8c82e70700 1 --2- 172.21.15.42:0/3411292524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c7c159570 0x7f8c7c155440 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:01.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.130+0000 7f8c82e70700 1 -- 172.21.15.42:0/3411292524 >> 172.21.15.42:0/3411292524 conn(0x7f8c7c0618f0 msgr2=0x7f8c7c06a750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:01.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.130+0000 7f8c82e70700 1 -- 172.21.15.42:0/3411292524 shutdown_connections 2023-07-29T02:00:01.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.130+0000 7f8c82e70700 1 -- 172.21.15.42:0/3411292524 wait complete. 2023-07-29T02:00:01.122 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.131+0000 7f8c82e70700 1 Processor -- start 2023-07-29T02:00:01.123 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.131+0000 7f8c82e70700 1 -- start start 2023-07-29T02:00:01.123 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c82e70700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c7c0bfe40 0x7f8c7c154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:01.123 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c82e70700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c7c14f560 0x7f8c7c154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:01.123 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c82e70700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c7c159570 0x7f8c7c0710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:01.123 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c82e70700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c0afe00 con 0x7f8c7c14f560 2023-07-29T02:00:01.123 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c82e70700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c0cab00 con 0x7f8c7c0bfe40 2023-07-29T02:00:01.123 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c82e70700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c0cade0 con 0x7f8c7c159570 2023-07-29T02:00:01.124 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c7bfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c7c14f560 0x7f8c7c154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:01.124 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c7bfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c7c14f560 0x7f8c7c154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55632/0 (socket says 172.21.15.42:55632) 2023-07-29T02:00:01.124 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c7bfff700 1 -- 172.21.15.42:0/616102981 learned_addr learned my addr 172.21.15.42:0/616102981 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:01.124 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c80c0c700 1 --2- 172.21.15.42:0/616102981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c7c0bfe40 0x7f8c7c154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:01.124 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c8140d700 1 --2- 172.21.15.42:0/616102981 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c7c159570 0x7f8c7c0710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:01.124 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c7bfff700 1 -- 172.21.15.42:0/616102981 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c7c159570 msgr2=0x7f8c7c0710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:01.124 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c7bfff700 1 --2- 172.21.15.42:0/616102981 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c7c159570 0x7f8c7c0710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:01.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c7bfff700 1 -- 172.21.15.42:0/616102981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c7c0bfe40 msgr2=0x7f8c7c154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:01.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c7bfff700 1 --2- 172.21.15.42:0/616102981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c7c0bfe40 0x7f8c7c154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:01.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c7bfff700 1 -- 172.21.15.42:0/616102981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c68009550 con 0x7f8c7c14f560 2023-07-29T02:00:01.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c8140d700 1 --2- 172.21.15.42:0/616102981 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c7c159570 0x7f8c7c0710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:01.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c7bfff700 1 --2- 172.21.15.42:0/616102981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c7c14f560 0x7f8c7c154bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8c68014040 tx=0x7f8c68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:01.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c797fa700 1 -- 172.21.15.42:0/616102981 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68011970 con 0x7f8c7c14f560 2023-07-29T02:00:01.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c797fa700 1 -- 172.21.15.42:0/616102981 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6801f070 con 0x7f8c7c14f560 2023-07-29T02:00:01.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c82e70700 1 -- 172.21.15.42:0/616102981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7c0b0050 con 0x7f8c7c14f560 2023-07-29T02:00:01.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.132+0000 7f8c797fa700 1 -- 172.21.15.42:0/616102981 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c68011cd0 con 0x7f8c7c14f560 2023-07-29T02:00:01.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.133+0000 7f8c82e70700 1 -- 172.21.15.42:0/616102981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7c0c8c60 con 0x7f8c7c14f560 2023-07-29T02:00:01.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.134+0000 7f8c82e70700 1 -- 172.21.15.42:0/616102981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7c04ea50 con 0x7f8c7c14f560 2023-07-29T02:00:01.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.134+0000 7f8c797fa700 1 -- 172.21.15.42:0/616102981 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f8c6801a430 con 0x7f8c7c14f560 2023-07-29T02:00:01.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.134+0000 7f8c797fa700 1 --2- 172.21.15.42:0/616102981 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c6006a660 0x7f8c6006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:01.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.135+0000 7f8c797fa700 1 -- 172.21.15.42:0/616102981 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f8c68021070 con 0x7f8c7c14f560 2023-07-29T02:00:01.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.135+0000 7f8c80c0c700 1 --2- 172.21.15.42:0/616102981 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c6006a660 0x7f8c6006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:01.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.135+0000 7f8c80c0c700 1 --2- 172.21.15.42:0/616102981 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c6006a660 0x7f8c6006cb10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c70007fd0 tx=0x7f8c70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:01.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.139+0000 7f8c797fa700 1 -- 172.21.15.42:0/616102981 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f8c680552e0 con 0x7f8c7c14f560 2023-07-29T02:00:01.325 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.337+0000 7f8c82e70700 1 -- 172.21.15.42:0/616102981 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f8c7c152e60 con 0x7f8c7c14f560 2023-07-29T02:00:01.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.967+0000 7f8c797fa700 1 -- 172.21.15.42:0/616102981 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8c680150c0 con 0x7f8c7c14f560 2023-07-29T02:00:01.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.977+0000 7f8c82e70700 1 -- 172.21.15.42:0/616102981 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c6006a660 msgr2=0x7f8c6006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:01.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.977+0000 7f8c82e70700 1 --2- 172.21.15.42:0/616102981 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c6006a660 0x7f8c6006cb10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c70007fd0 tx=0x7f8c70009040 comp rx=0 tx=0).stop 2023-07-29T02:00:01.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.977+0000 7f8c82e70700 1 -- 172.21.15.42:0/616102981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c7c14f560 msgr2=0x7f8c7c154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:01.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.977+0000 7f8c82e70700 1 --2- 172.21.15.42:0/616102981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c7c14f560 0x7f8c7c154bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8c68014040 tx=0x7f8c68004750 comp rx=0 tx=0).stop 2023-07-29T02:00:01.967 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.980+0000 7f8c82e70700 1 -- 172.21.15.42:0/616102981 shutdown_connections 2023-07-29T02:00:01.968 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.980+0000 7f8c82e70700 1 --2- 172.21.15.42:0/616102981 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c6006a660 0x7f8c6006cb10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:01.968 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.980+0000 7f8c82e70700 1 --2- 172.21.15.42:0/616102981 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c7c159570 0x7f8c7c0710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:01.968 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.980+0000 7f8c82e70700 1 --2- 172.21.15.42:0/616102981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c7c0bfe40 0x7f8c7c154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:01.968 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.980+0000 7f8c82e70700 1 --2- 172.21.15.42:0/616102981 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c7c14f560 0x7f8c7c154bf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:01.968 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.980+0000 7f8c82e70700 1 -- 172.21.15.42:0/616102981 >> 172.21.15.42:0/616102981 conn(0x7f8c7c0618f0 msgr2=0x7f8c7c14ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:01.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.980+0000 7f8c82e70700 1 -- 172.21.15.42:0/616102981 shutdown_connections 2023-07-29T02:00:01.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:01.980+0000 7f8c82e70700 1 -- 172.21.15.42:0/616102981 wait complete. 2023-07-29T02:00:01.971 INFO:teuthology.orchestra.run.smithi042.stderr:set pool 5 allow_ec_overwrites to true 2023-07-29T02:00:01.993 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-07-29T02:00:02.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.138+0000 7fb1a07cc700 1 Processor -- start 2023-07-29T02:00:02.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.138+0000 7fb1a07cc700 1 -- start start 2023-07-29T02:00:02.129 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb1a07cc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb19814fff0 0x7fb198070b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:02.129 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb1a07cc700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1980c91b0 con 0x7fb19806b860 2023-07-29T02:00:02.129 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb1a07cc700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1981592f0 con 0x7fb19814fc20 2023-07-29T02:00:02.129 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb1a07cc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1981595d0 con 0x7fb19814fff0 2023-07-29T02:00:02.130 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19ed69700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb19806b860 0x7fb198155cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49446/0 (socket says 172.21.15.42:49446) 2023-07-29T02:00:02.130 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19ed69700 1 -- 172.21.15.42:0/173409482 learned_addr learned my addr 172.21.15.42:0/173409482 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:02.130 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19d566700 1 -- 172.21.15.42:0/173409482 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599490874 0 0) 0x7fb1980c91b0 con 0x7fb19806b860 2023-07-29T02:00:02.130 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19dd67700 1 --2- 172.21.15.42:0/173409482 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb19814fff0 0x7fb198070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:02.130 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19d566700 1 -- 172.21.15.42:0/173409482 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1840035b0 con 0x7fb19806b860 2023-07-29T02:00:02.130 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19d566700 1 -- 172.21.15.42:0/173409482 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1237394481 0 0) 0x7fb1840035b0 con 0x7fb19806b860 2023-07-29T02:00:02.130 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19d566700 1 -- 172.21.15.42:0/173409482 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb19814fff0 msgr2=0x7fb198070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:02.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19d566700 1 --2- 172.21.15.42:0/173409482 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb19814fff0 0x7fb198070b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19d566700 1 -- 172.21.15.42:0/173409482 >> v1:172.21.15.144:6789/0 conn(0x7fb19814fc20 legacy=0x7fb1980c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:02.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19d566700 1 -- 172.21.15.42:0/173409482 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1981598b0 con 0x7fb19806b860 2023-07-29T02:00:02.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19d566700 1 -- 172.21.15.42:0/173409482 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7fb1900019f0 con 0x7fb19806b860 2023-07-29T02:00:02.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19d566700 1 -- 172.21.15.42:0/173409482 >> v1:172.21.15.42:6789/0 conn(0x7fb19806b860 legacy=0x7fb198155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:02.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19d566700 1 --2- 172.21.15.42:0/173409482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb184003a30 0x7fb184003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:02.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19d566700 1 --2- 172.21.15.42:0/173409482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1840043d0 0x7fb184004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:02.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19d566700 1 --2- 172.21.15.42:0/173409482 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb19814fff0 0x7fb1840050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:02.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19d566700 1 -- 172.21.15.42:0/173409482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1981595d0 con 0x7fb184003a30 2023-07-29T02:00:02.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19d566700 1 -- 172.21.15.42:0/173409482 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18400dc20 con 0x7fb1840043d0 2023-07-29T02:00:02.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19d566700 1 -- 172.21.15.42:0/173409482 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18400dde0 con 0x7fb19814fff0 2023-07-29T02:00:02.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19e568700 1 --2- 172.21.15.42:0/173409482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb184003a30 0x7fb184003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:02.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19dd67700 1 --2- 172.21.15.42:0/173409482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1840043d0 0x7fb184004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:02.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.139+0000 7fb19ed69700 1 --2- 172.21.15.42:0/173409482 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb19814fff0 0x7fb1840050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:02.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.140+0000 7fb19e568700 1 -- 172.21.15.42:0/173409482 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb19814fff0 msgr2=0x7fb1840050f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:02.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.140+0000 7fb19e568700 1 --2- 172.21.15.42:0/173409482 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb19814fff0 0x7fb1840050f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.140+0000 7fb19e568700 1 -- 172.21.15.42:0/173409482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1840043d0 msgr2=0x7fb184004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:02.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.140+0000 7fb19e568700 1 --2- 172.21.15.42:0/173409482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1840043d0 0x7fb184004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.140+0000 7fb19e568700 1 -- 172.21.15.42:0/173409482 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1840035b0 con 0x7fb184003a30 2023-07-29T02:00:02.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.140+0000 7fb19e568700 1 --2- 172.21.15.42:0/173409482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb184003a30 0x7fb184003e00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb1940018d0 tx=0x7fb184005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9815357dd08357f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:02.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.140+0000 7fb19d566700 1 -- 172.21.15.42:0/173409482 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19400c690 con 0x7fb184003a30 2023-07-29T02:00:02.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.140+0000 7fb19d566700 1 -- 172.21.15.42:0/173409482 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19400c810 con 0x7fb184003a30 2023-07-29T02:00:02.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.140+0000 7fb19d566700 1 -- 172.21.15.42:0/173409482 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19400cbc0 con 0x7fb184003a30 2023-07-29T02:00:02.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.140+0000 7fb1a07cc700 1 -- 172.21.15.42:0/173409482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb184003a30 msgr2=0x7fb184003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:02.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.140+0000 7fb1a07cc700 1 --2- 172.21.15.42:0/173409482 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb184003a30 0x7fb184003e00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb1940018d0 tx=0x7fb184005880 comp rx=0 tx=0).stop 2023-07-29T02:00:02.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.140+0000 7fb19ed69700 1 -- 172.21.15.42:0/173409482 reap_dead start 2023-07-29T02:00:02.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.141+0000 7fb1a07cc700 1 -- 172.21.15.42:0/173409482 shutdown_connections 2023-07-29T02:00:02.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.141+0000 7fb1a07cc700 1 -- 172.21.15.42:0/173409482 >> 172.21.15.42:0/173409482 conn(0x7fb1980cc420 msgr2=0x7fb1980c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:02.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.141+0000 7fb1a07cc700 1 -- 172.21.15.42:0/173409482 shutdown_connections 2023-07-29T02:00:02.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.141+0000 7fb1a07cc700 1 -- 172.21.15.42:0/173409482 wait complete. 2023-07-29T02:00:02.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.142+0000 7fb1a07cc700 1 Processor -- start 2023-07-29T02:00:02.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.142+0000 7fb1a07cc700 1 -- start start 2023-07-29T02:00:02.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.142+0000 7fb1a07cc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb184003a30 0x7fb1981f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:02.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.142+0000 7fb1a07cc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1980c46f0 0x7fb1981513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:02.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.142+0000 7fb1a07cc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb19806e2e0 0x7fb1981ee2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:02.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.142+0000 7fb1a07cc700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1981f2040 con 0x7fb184003a30 2023-07-29T02:00:02.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.142+0000 7fb1a07cc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1981518f0 con 0x7fb19806e2e0 2023-07-29T02:00:02.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.142+0000 7fb1a07cc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1981ef210 con 0x7fb1980c46f0 2023-07-29T02:00:02.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.143+0000 7fb19e568700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb184003a30 0x7fb1981f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:02.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.143+0000 7fb19e568700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb184003a30 0x7fb1981f2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55650/0 (socket says 172.21.15.42:55650) 2023-07-29T02:00:02.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.143+0000 7fb19e568700 1 -- 172.21.15.42:0/1589655878 learned_addr learned my addr 172.21.15.42:0/1589655878 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:02.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.143+0000 7fb19dd67700 1 --2- 172.21.15.42:0/1589655878 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1980c46f0 0x7fb1981513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:02.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.143+0000 7fb19ed69700 1 --2- 172.21.15.42:0/1589655878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb19806e2e0 0x7fb1981ee2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:02.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.143+0000 7fb19e568700 1 -- 172.21.15.42:0/1589655878 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1980c46f0 msgr2=0x7fb1981513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:02.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.143+0000 7fb19e568700 1 --2- 172.21.15.42:0/1589655878 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1980c46f0 0x7fb1981513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.143+0000 7fb19e568700 1 -- 172.21.15.42:0/1589655878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb19806e2e0 msgr2=0x7fb1981ee2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:02.139 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.143+0000 7fb19e568700 1 --2- 172.21.15.42:0/1589655878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb19806e2e0 0x7fb1981ee2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.139 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.143+0000 7fb19e568700 1 -- 172.21.15.42:0/1589655878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1981eec50 con 0x7fb184003a30 2023-07-29T02:00:02.139 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.143+0000 7fb19e568700 1 --2- 172.21.15.42:0/1589655878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb184003a30 0x7fb1981f2460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb19400c0e0 tx=0x7fb194001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:02.139 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.143+0000 7fb18effd700 1 -- 172.21.15.42:0/1589655878 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19400cb80 con 0x7fb184003a30 2023-07-29T02:00:02.139 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.143+0000 7fb18effd700 1 -- 172.21.15.42:0/1589655878 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb194021070 con 0x7fb184003a30 2023-07-29T02:00:02.139 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.143+0000 7fb1a07cc700 1 -- 172.21.15.42:0/1589655878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1981eef30 con 0x7fb184003a30 2023-07-29T02:00:02.139 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.143+0000 7fb18effd700 1 -- 172.21.15.42:0/1589655878 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19400cee0 con 0x7fb184003a30 2023-07-29T02:00:02.139 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.143+0000 7fb1a07cc700 1 -- 172.21.15.42:0/1589655878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1981f1c60 con 0x7fb184003a30 2023-07-29T02:00:02.140 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.144+0000 7fb1a07cc700 1 -- 172.21.15.42:0/1589655878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1981f1e20 con 0x7fb184003a30 2023-07-29T02:00:02.140 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.145+0000 7fb18effd700 1 -- 172.21.15.42:0/1589655878 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fb194023030 con 0x7fb184003a30 2023-07-29T02:00:02.140 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.145+0000 7fb18effd700 1 --2- 172.21.15.42:0/1589655878 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb17c06a690 0x7fb17c06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:02.140 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.145+0000 7fb18effd700 1 -- 172.21.15.42:0/1589655878 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fb194089cd0 con 0x7fb184003a30 2023-07-29T02:00:02.140 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.145+0000 7fb19dd67700 1 --2- 172.21.15.42:0/1589655878 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb17c06a690 0x7fb17c06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:02.140 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.146+0000 7fb19dd67700 1 --2- 172.21.15.42:0/1589655878 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb17c06a690 0x7fb17c06cb40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb198155cc0 tx=0x7fb188009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:02.141 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.149+0000 7fb18effd700 1 -- 172.21.15.42:0/1589655878 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fb194054e90 con 0x7fb184003a30 2023-07-29T02:00:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.393+0000 7fb1a07cc700 1 -- 172.21.15.42:0/1589655878 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fb1981f22b0 con 0x7fb184003a30 2023-07-29T02:00:02.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.397+0000 7fb18effd700 1 -- 172.21.15.42:0/1589655878 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v5) v1 ==== 137+0+0 (secure 0 0 0) 0x7fb19402b020 con 0x7fb184003a30 2023-07-29T02:00:02.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.399+0000 7fb1a07cc700 1 -- 172.21.15.42:0/1589655878 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb17c06a690 msgr2=0x7fb17c06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:02.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.399+0000 7fb1a07cc700 1 --2- 172.21.15.42:0/1589655878 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb17c06a690 0x7fb17c06cb40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb198155cc0 tx=0x7fb188009210 comp rx=0 tx=0).stop 2023-07-29T02:00:02.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.399+0000 7fb1a07cc700 1 -- 172.21.15.42:0/1589655878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb184003a30 msgr2=0x7fb1981f2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:02.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.399+0000 7fb1a07cc700 1 --2- 172.21.15.42:0/1589655878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb184003a30 0x7fb1981f2460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb19400c0e0 tx=0x7fb194001230 comp rx=0 tx=0).stop 2023-07-29T02:00:02.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.399+0000 7fb1a07cc700 1 -- 172.21.15.42:0/1589655878 shutdown_connections 2023-07-29T02:00:02.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.399+0000 7fb1a07cc700 1 --2- 172.21.15.42:0/1589655878 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb17c06a690 0x7fb17c06cb40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.399+0000 7fb1a07cc700 1 --2- 172.21.15.42:0/1589655878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb19806e2e0 0x7fb1981ee2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.399+0000 7fb1a07cc700 1 --2- 172.21.15.42:0/1589655878 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb184003a30 0x7fb1981f2460 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.399+0000 7fb1a07cc700 1 --2- 172.21.15.42:0/1589655878 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1980c46f0 0x7fb1981513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.399+0000 7fb1a07cc700 1 -- 172.21.15.42:0/1589655878 >> 172.21.15.42:0/1589655878 conn(0x7fb1980cc420 msgr2=0x7fb1980c2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:02.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.399+0000 7fb1a07cc700 1 -- 172.21.15.42:0/1589655878 shutdown_connections 2023-07-29T02:00:02.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.399+0000 7fb1a07cc700 1 -- 172.21.15.42:0/1589655878 wait complete. 2023-07-29T02:00:02.389 INFO:teuthology.orchestra.run.smithi042.stderr:added data pool 5 to fsmap 2023-07-29T02:00:02.399 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:00:02.526 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.538+0000 7f268df6f700 1 Processor -- start 2023-07-29T02:00:02.526 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.538+0000 7f268df6f700 1 -- start start 2023-07-29T02:00:02.528 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.539+0000 7f268df6f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f26881567d0 0x7f2688159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:02.528 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.539+0000 7f268df6f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26880c7210 0x7f268806cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:02.528 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.539+0000 7f268df6f700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26880c7700 con 0x7f2688159e90 2023-07-29T02:00:02.529 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.539+0000 7f268df6f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f268806b160 con 0x7f26881567d0 2023-07-29T02:00:02.529 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.539+0000 7f268df6f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2688159170 con 0x7f26880c7210 2023-07-29T02:00:02.529 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.539+0000 7f2687fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f2688159e90 0x7f268815c6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49466/0 (socket says 172.21.15.42:49466) 2023-07-29T02:00:02.529 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.539+0000 7f2687fff700 1 -- 172.21.15.42:0/875159834 learned_addr learned my addr 172.21.15.42:0/875159834 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:02.529 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.539+0000 7f26877fe700 1 --2- 172.21.15.42:0/875159834 >> v2:172.21.15.144:3300/0 conn(0x7f26881567d0 0x7f2688159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:02.529 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.539+0000 7f2686ffd700 1 --2- 172.21.15.42:0/875159834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26880c7210 0x7f268806cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:02.529 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.539+0000 7f26867fc700 1 -- 172.21.15.42:0/875159834 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338401607 0 0) 0x7f26880c7700 con 0x7f2688159e90 2023-07-29T02:00:02.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.539+0000 7f26867fc700 1 -- 172.21.15.42:0/875159834 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26740035b0 con 0x7f2688159e90 2023-07-29T02:00:02.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.540+0000 7f26877fe700 1 -- 172.21.15.42:0/875159834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26880c7210 msgr2=0x7f268806cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:02.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.540+0000 7f26877fe700 1 --2- 172.21.15.42:0/875159834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26880c7210 0x7f268806cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.540+0000 7f26867fc700 1 -- 172.21.15.42:0/875159834 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1003006936 0 0) 0x7f26740035b0 con 0x7f2688159e90 2023-07-29T02:00:02.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.540+0000 7f26877fe700 1 -- 172.21.15.42:0/875159834 >> v1:172.21.15.42:6789/0 conn(0x7f2688159e90 legacy=0x7f268815c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:02.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.540+0000 7f26877fe700 1 -- 172.21.15.42:0/875159834 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2688156ba0 con 0x7f26881567d0 2023-07-29T02:00:02.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.540+0000 7f2686ffd700 1 --2- 172.21.15.42:0/875159834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26880c7210 0x7f268806cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:00:02.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.540+0000 7f26877fe700 1 --2- 172.21.15.42:0/875159834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26881567d0 0x7f2688159950 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2678009840 tx=0x7f2678009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d488283e9bf7080f server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:02.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.540+0000 7f26867fc700 1 -- 172.21.15.42:0/875159834 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26800019f0 con 0x7f26881567d0 2023-07-29T02:00:02.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.540+0000 7f26867fc700 1 -- 172.21.15.42:0/875159834 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2678004030 con 0x7f26881567d0 2023-07-29T02:00:02.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.540+0000 7f26867fc700 1 -- 172.21.15.42:0/875159834 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26780043c0 con 0x7f26881567d0 2023-07-29T02:00:02.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.541+0000 7f268df6f700 1 -- 172.21.15.42:0/875159834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26881567d0 msgr2=0x7f2688159950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:02.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.541+0000 7f268df6f700 1 --2- 172.21.15.42:0/875159834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26881567d0 0x7f2688159950 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2678009840 tx=0x7f2678009b50 comp rx=0 tx=0).stop 2023-07-29T02:00:02.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.541+0000 7f268df6f700 1 -- 172.21.15.42:0/875159834 shutdown_connections 2023-07-29T02:00:02.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.541+0000 7f268df6f700 1 --2- 172.21.15.42:0/875159834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26881567d0 0x7f2688159950 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.541+0000 7f268df6f700 1 --2- 172.21.15.42:0/875159834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f26880c7210 0x7f268806cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.541+0000 7f268df6f700 1 -- 172.21.15.42:0/875159834 >> 172.21.15.42:0/875159834 conn(0x7f26880c8970 msgr2=0x7f26880c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:02.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.541+0000 7f268df6f700 1 -- 172.21.15.42:0/875159834 shutdown_connections 2023-07-29T02:00:02.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.541+0000 7f268df6f700 1 -- 172.21.15.42:0/875159834 wait complete. 2023-07-29T02:00:02.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.542+0000 7f268df6f700 1 Processor -- start 2023-07-29T02:00:02.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.542+0000 7f268df6f700 1 -- start start 2023-07-29T02:00:02.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.543+0000 7f268df6f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26880c7210 0x7f26881eec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:02.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.543+0000 7f268df6f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26881567d0 0x7f26880adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:02.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.543+0000 7f268df6f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2688159e90 0x7f26880af020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:02.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.543+0000 7f268df6f700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26881ef170 con 0x7f26880c7210 2023-07-29T02:00:02.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.543+0000 7f268df6f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26880aeb90 con 0x7f26881567d0 2023-07-29T02:00:02.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.543+0000 7f268df6f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26881ef620 con 0x7f2688159e90 2023-07-29T02:00:02.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.543+0000 7f26877fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26880c7210 0x7f26881eec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:02.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.543+0000 7f26877fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26880c7210 0x7f26881eec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55664/0 (socket says 172.21.15.42:55664) 2023-07-29T02:00:02.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.543+0000 7f26877fe700 1 -- 172.21.15.42:0/3834694062 learned_addr learned my addr 172.21.15.42:0/3834694062 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:02.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.543+0000 7f2686ffd700 1 --2- 172.21.15.42:0/3834694062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26881567d0 0x7f26880adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:02.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.543+0000 7f2687fff700 1 --2- 172.21.15.42:0/3834694062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2688159e90 0x7f26880af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:02.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.543+0000 7f26877fe700 1 -- 172.21.15.42:0/3834694062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2688159e90 msgr2=0x7f26880af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:02.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.543+0000 7f26877fe700 1 --2- 172.21.15.42:0/3834694062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2688159e90 0x7f26880af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.543+0000 7f26877fe700 1 -- 172.21.15.42:0/3834694062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26881567d0 msgr2=0x7f26880adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.543+0000 7f26877fe700 1 --2- 172.21.15.42:0/3834694062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26881567d0 0x7f26880adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.543+0000 7f26877fe700 1 -- 172.21.15.42:0/3834694062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26700094a0 con 0x7f26880c7210 2023-07-29T02:00:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.543+0000 7f26877fe700 1 --2- 172.21.15.42:0/3834694062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26880c7210 0x7f26881eec30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f267800a010 tx=0x7f2678004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.544+0000 7f267ffff700 1 -- 172.21.15.42:0/3834694062 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2678003cf0 con 0x7f26880c7210 2023-07-29T02:00:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.544+0000 7f267ffff700 1 -- 172.21.15.42:0/3834694062 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267801f070 con 0x7f26880c7210 2023-07-29T02:00:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.544+0000 7f268df6f700 1 -- 172.21.15.42:0/3834694062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26780094a0 con 0x7f26880c7210 2023-07-29T02:00:02.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.544+0000 7f267ffff700 1 -- 172.21.15.42:0/3834694062 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2678011870 con 0x7f26880c7210 2023-07-29T02:00:02.538 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.544+0000 7f268df6f700 1 -- 172.21.15.42:0/3834694062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26880c6040 con 0x7f26880c7210 2023-07-29T02:00:02.538 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.544+0000 7f268df6f700 1 -- 172.21.15.42:0/3834694062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2688074740 con 0x7f26880c7210 2023-07-29T02:00:02.538 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.545+0000 7f267ffff700 1 -- 172.21.15.42:0/3834694062 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f26780119d0 con 0x7f26880c7210 2023-07-29T02:00:02.539 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.546+0000 7f267ffff700 1 --2- 172.21.15.42:0/3834694062 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f266806a660 0x7f266806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:02.539 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.546+0000 7f267ffff700 1 -- 172.21.15.42:0/3834694062 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2678021070 con 0x7f26880c7210 2023-07-29T02:00:02.539 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.546+0000 7f2686ffd700 1 --2- 172.21.15.42:0/3834694062 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f266806a660 0x7f266806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:02.539 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.546+0000 7f2686ffd700 1 --2- 172.21.15.42:0/3834694062 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f266806a660 0x7f266806cb10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f26880714b0 tx=0x7f2670009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:02.539 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.550+0000 7f267ffff700 1 -- 172.21.15.42:0/3834694062 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f2678055b80 con 0x7f26880c7210 2023-07-29T02:00:02.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.795+0000 7f268df6f700 1 -- 172.21.15.42:0/3834694062 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26880aee70 con 0x7f26880c7210 2023-07-29T02:00:02.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.796+0000 7f267ffff700 1 -- 172.21.15.42:0/3834694062 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+6164 (secure 0 0 0) 0x7f26780591a0 con 0x7f26880c7210 2023-07-29T02:00:02.784 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:02.784 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:00:02.394674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"e","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.42:6837/1851767861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1851767861},{"type":"v1","addr":"172.21.15.42:6837","nonce":1851767861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:00:02.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.798+0000 7f268df6f700 1 -- 172.21.15.42:0/3834694062 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f266806a660 msgr2=0x7f266806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:02.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.798+0000 7f268df6f700 1 --2- 172.21.15.42:0/3834694062 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f266806a660 0x7f266806cb10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f26880714b0 tx=0x7f2670009210 comp rx=0 tx=0).stop 2023-07-29T02:00:02.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.798+0000 7f268df6f700 1 -- 172.21.15.42:0/3834694062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26880c7210 msgr2=0x7f26881eec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:02.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.798+0000 7f268df6f700 1 --2- 172.21.15.42:0/3834694062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26880c7210 0x7f26881eec30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f267800a010 tx=0x7f2678004750 comp rx=0 tx=0).stop 2023-07-29T02:00:02.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.798+0000 7f268df6f700 1 -- 172.21.15.42:0/3834694062 shutdown_connections 2023-07-29T02:00:02.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.798+0000 7f268df6f700 1 --2- 172.21.15.42:0/3834694062 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f266806a660 0x7f266806cb10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.798+0000 7f268df6f700 1 --2- 172.21.15.42:0/3834694062 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2688159e90 0x7f26880af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.798+0000 7f268df6f700 1 --2- 172.21.15.42:0/3834694062 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f26880c7210 0x7f26881eec30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.798+0000 7f268df6f700 1 --2- 172.21.15.42:0/3834694062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26881567d0 0x7f26880adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.798+0000 7f268df6f700 1 -- 172.21.15.42:0/3834694062 >> 172.21.15.42:0/3834694062 conn(0x7f26880c8970 msgr2=0x7f26881581c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:02.788 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.798+0000 7f268df6f700 1 -- 172.21.15.42:0/3834694062 shutdown_connections 2023-07-29T02:00:02.788 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.798+0000 7f268df6f700 1 -- 172.21.15.42:0/3834694062 wait complete. 2023-07-29T02:00:02.788 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 5 2023-07-29T02:00:02.798 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T02:00:02.923 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.935+0000 7f041ab66700 1 Processor -- start 2023-07-29T02:00:02.923 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.935+0000 7f041ab66700 1 -- start start 2023-07-29T02:00:02.925 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.936+0000 7f041ab66700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f041414c630 0x7f041406c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:02.925 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.936+0000 7f041ab66700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f041414ca00 0x7f04140c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:02.925 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.936+0000 7f041ab66700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041406ce40 con 0x7f04140c7270 2023-07-29T02:00:02.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.936+0000 7f041ab66700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0414155d50 con 0x7f041414c630 2023-07-29T02:00:02.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.936+0000 7f041ab66700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0414156010 con 0x7f041414ca00 2023-07-29T02:00:02.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.936+0000 7f0418902700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f041414c630 0x7f041406c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:02.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.936+0000 7f0419103700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f04140c7270 0x7f041406d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49478/0 (socket says 172.21.15.42:49478) 2023-07-29T02:00:02.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.936+0000 7f0419103700 1 -- 172.21.15.42:0/3767634148 learned_addr learned my addr 172.21.15.42:0/3767634148 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:02.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.936+0000 7f0413fff700 1 --2- 172.21.15.42:0/3767634148 >> v2:172.21.15.144:3300/0 conn(0x7f041414ca00 0x7f04140c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:02.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.936+0000 7f0418902700 1 -- 172.21.15.42:0/3767634148 >> v2:172.21.15.144:3300/0 conn(0x7f041414ca00 msgr2=0x7f04140c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:02.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.936+0000 7f0418902700 1 --2- 172.21.15.42:0/3767634148 >> v2:172.21.15.144:3300/0 conn(0x7f041414ca00 0x7f04140c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.936+0000 7f0418902700 1 -- 172.21.15.42:0/3767634148 >> v1:172.21.15.42:6789/0 conn(0x7f04140c7270 legacy=0x7f041406d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:02.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.936+0000 7f0418902700 1 -- 172.21.15.42:0/3767634148 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04141562f0 con 0x7f041414c630 2023-07-29T02:00:02.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.936+0000 7f0418902700 1 --2- 172.21.15.42:0/3767634148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f041414c630 0x7f041406c270 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f04140c3200 tx=0x7f0408009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e919cba994b05cbc server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:02.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.937+0000 7f04137fe700 1 -- 172.21.15.42:0/3767634148 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0408011830 con 0x7f041414c630 2023-07-29T02:00:02.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.937+0000 7f04137fe700 1 -- 172.21.15.42:0/3767634148 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0408011990 con 0x7f041414c630 2023-07-29T02:00:02.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.937+0000 7f04137fe700 1 -- 172.21.15.42:0/3767634148 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0408011d20 con 0x7f041414c630 2023-07-29T02:00:02.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.937+0000 7f041ab66700 1 -- 172.21.15.42:0/3767634148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f041414c630 msgr2=0x7f041406c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:02.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.937+0000 7f041ab66700 1 --2- 172.21.15.42:0/3767634148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f041414c630 0x7f041406c270 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f04140c3200 tx=0x7f0408009b20 comp rx=0 tx=0).stop 2023-07-29T02:00:02.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.937+0000 7f041ab66700 1 -- 172.21.15.42:0/3767634148 shutdown_connections 2023-07-29T02:00:02.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.937+0000 7f041ab66700 1 --2- 172.21.15.42:0/3767634148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f041414c630 0x7f041406c270 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.937+0000 7f041ab66700 1 --2- 172.21.15.42:0/3767634148 >> v2:172.21.15.144:3300/0 conn(0x7f041414ca00 0x7f04140c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.937+0000 7f041ab66700 1 -- 172.21.15.42:0/3767634148 >> 172.21.15.42:0/3767634148 conn(0x7f04140c8970 msgr2=0x7f04140c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:02.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.937+0000 7f041ab66700 1 -- 172.21.15.42:0/3767634148 shutdown_connections 2023-07-29T02:00:02.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.937+0000 7f041ab66700 1 -- 172.21.15.42:0/3767634148 wait complete. 2023-07-29T02:00:02.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.938+0000 7f041ab66700 1 Processor -- start 2023-07-29T02:00:02.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.938+0000 7f041ab66700 1 -- start start 2023-07-29T02:00:02.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.939+0000 7f041ab66700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04140c7270 0x7f041414b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:02.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.939+0000 7f041ab66700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f041414c630 0x7f04140c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:02.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.939+0000 7f041ab66700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04140cb0d0 0x7f04141edbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:02.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.939+0000 7f041ab66700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04141f0320 con 0x7f04140cb0d0 2023-07-29T02:00:02.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.939+0000 7f041ab66700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04140cbb20 con 0x7f04140c7270 2023-07-29T02:00:02.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.939+0000 7f041ab66700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041414a800 con 0x7f041414c630 2023-07-29T02:00:02.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.939+0000 7f0419103700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04140cb0d0 0x7f04141edbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:02.933 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.939+0000 7f0419103700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04140cb0d0 0x7f04141edbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55680/0 (socket says 172.21.15.42:55680) 2023-07-29T02:00:02.933 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.939+0000 7f0419103700 1 -- 172.21.15.42:0/2674230547 learned_addr learned my addr 172.21.15.42:0/2674230547 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:02.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.939+0000 7f0418902700 1 --2- 172.21.15.42:0/2674230547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04140c7270 0x7f041414b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:02.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.939+0000 7f0413fff700 1 --2- 172.21.15.42:0/2674230547 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f041414c630 0x7f04140c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:02.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.940+0000 7f0419103700 1 -- 172.21.15.42:0/2674230547 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f041414c630 msgr2=0x7f04140c1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:02.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.940+0000 7f0419103700 1 --2- 172.21.15.42:0/2674230547 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f041414c630 0x7f04140c1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.940+0000 7f0419103700 1 -- 172.21.15.42:0/2674230547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04140c7270 msgr2=0x7f041414b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:02.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.940+0000 7f0419103700 1 --2- 172.21.15.42:0/2674230547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04140c7270 0x7f041414b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:02.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.940+0000 7f0419103700 1 -- 172.21.15.42:0/2674230547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04080094a0 con 0x7f04140cb0d0 2023-07-29T02:00:02.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.940+0000 7f0419103700 1 --2- 172.21.15.42:0/2674230547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04140cb0d0 0x7f04141edbb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f040c00cbc0 tx=0x7f040c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:02.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.940+0000 7f04117fa700 1 -- 172.21.15.42:0/2674230547 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c00a9e0 con 0x7f04140cb0d0 2023-07-29T02:00:02.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.940+0000 7f04117fa700 1 -- 172.21.15.42:0/2674230547 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c00ab40 con 0x7f04140cb0d0 2023-07-29T02:00:02.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.940+0000 7f04117fa700 1 -- 172.21.15.42:0/2674230547 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c012400 con 0x7f04140cb0d0 2023-07-29T02:00:02.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.940+0000 7f041ab66700 1 -- 172.21.15.42:0/2674230547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041414aae0 con 0x7f04140cb0d0 2023-07-29T02:00:02.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.940+0000 7f041ab66700 1 -- 172.21.15.42:0/2674230547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04140cb7c0 con 0x7f04140cb0d0 2023-07-29T02:00:02.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.941+0000 7f041ab66700 1 -- 172.21.15.42:0/2674230547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0414074740 con 0x7f04140cb0d0 2023-07-29T02:00:02.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.942+0000 7f04117fa700 1 -- 172.21.15.42:0/2674230547 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f040c01b3b0 con 0x7f04140cb0d0 2023-07-29T02:00:02.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.942+0000 7f04117fa700 1 --2- 172.21.15.42:0/2674230547 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f03f806a690 0x7f03f806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:02.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.942+0000 7f04117fa700 1 -- 172.21.15.42:0/2674230547 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f040c088830 con 0x7f04140cb0d0 2023-07-29T02:00:02.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.942+0000 7f0418902700 1 --2- 172.21.15.42:0/2674230547 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f03f806a690 0x7f03f806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:02.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.943+0000 7f0418902700 1 --2- 172.21.15.42:0/2674230547 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f03f806a690 0x7f03f806cb40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f04080090b0 tx=0x7f0408008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:02.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:02.946+0000 7f04117fa700 1 -- 172.21.15.42:0/2674230547 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f040c04c2c0 con 0x7f04140cb0d0 2023-07-29T02:00:03.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.157+0000 7f041ab66700 1 -- 172.21.15.42:0/2674230547 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04141ed8d0 con 0x7f04140cb0d0 2023-07-29T02:00:03.146 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.158+0000 7f04117fa700 1 -- 172.21.15.42:0/2674230547 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19690 (secure 0 0 0) 0x7f04141ed8d0 con 0x7f04140cb0d0 2023-07-29T02:00:03.146 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:03.147 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T02:00:02.394460+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T01:59:55.827461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T01:59:56.924040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-29T01:59:59.996470+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T02:00:03.148 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.160+0000 7f041ab66700 1 -- 172.21.15.42:0/2674230547 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f03f806a690 msgr2=0x7f03f806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:03.149 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.160+0000 7f041ab66700 1 --2- 172.21.15.42:0/2674230547 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f03f806a690 0x7f03f806cb40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f04080090b0 tx=0x7f0408008030 comp rx=0 tx=0).stop 2023-07-29T02:00:03.149 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.160+0000 7f041ab66700 1 -- 172.21.15.42:0/2674230547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04140cb0d0 msgr2=0x7f04141edbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:03.149 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.160+0000 7f041ab66700 1 --2- 172.21.15.42:0/2674230547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04140cb0d0 0x7f04141edbb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f040c00cbc0 tx=0x7f040c00ced0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.149 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.160+0000 7f041ab66700 1 -- 172.21.15.42:0/2674230547 shutdown_connections 2023-07-29T02:00:03.149 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.160+0000 7f041ab66700 1 --2- 172.21.15.42:0/2674230547 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f03f806a690 0x7f03f806cb40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.149 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.160+0000 7f041ab66700 1 --2- 172.21.15.42:0/2674230547 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f04140cb0d0 0x7f04141edbb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.149 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.160+0000 7f041ab66700 1 --2- 172.21.15.42:0/2674230547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04140c7270 0x7f041414b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.150 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.160+0000 7f041ab66700 1 --2- 172.21.15.42:0/2674230547 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f041414c630 0x7f04140c1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.150 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.160+0000 7f041ab66700 1 -- 172.21.15.42:0/2674230547 >> 172.21.15.42:0/2674230547 conn(0x7f04140c8970 msgr2=0x7f041406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:03.150 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.161+0000 7f041ab66700 1 -- 172.21.15.42:0/2674230547 shutdown_connections 2023-07-29T02:00:03.150 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.161+0000 7f041ab66700 1 -- 172.21.15.42:0/2674230547 wait complete. 2023-07-29T02:00:03.161 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T02:00:03.285 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.297+0000 7fa58e164700 1 Processor -- start 2023-07-29T02:00:03.286 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.297+0000 7fa58e164700 1 -- start start 2023-07-29T02:00:03.288 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.298+0000 7fa58e164700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa588151500 0x7fa58806dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:03.288 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.298+0000 7fa58e164700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa588157ba0 0x7fa58806e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:03.288 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.298+0000 7fa58e164700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5880cd140 con 0x7fa5880c7f40 2023-07-29T02:00:03.288 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.298+0000 7fa58e164700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5880c2370 con 0x7fa588157ba0 2023-07-29T02:00:03.288 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.298+0000 7fa58e164700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa588156f90 con 0x7fa588151500 2023-07-29T02:00:03.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.298+0000 7fa587fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa588157ba0 0x7fa58806e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:03.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.298+0000 7fa587fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa588157ba0 0x7fa58806e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55700/0 (socket says 172.21.15.42:55700) 2023-07-29T02:00:03.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.298+0000 7fa587fff700 1 -- 172.21.15.42:0/2533961931 learned_addr learned my addr 172.21.15.42:0/2533961931 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:03.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.299+0000 7fa5877fe700 1 --2- 172.21.15.42:0/2533961931 >> v2:172.21.15.144:3300/0 conn(0x7fa588151500 0x7fa58806dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:03.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.299+0000 7fa587fff700 1 -- 172.21.15.42:0/2533961931 >> v2:172.21.15.144:3300/0 conn(0x7fa588151500 msgr2=0x7fa58806dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:03.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.299+0000 7fa587fff700 1 --2- 172.21.15.42:0/2533961931 >> v2:172.21.15.144:3300/0 conn(0x7fa588151500 0x7fa58806dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.299+0000 7fa587fff700 1 -- 172.21.15.42:0/2533961931 >> v1:172.21.15.144:6789/0 conn(0x7fa5880c7f40 legacy=0x7fa588157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:03.290 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.299+0000 7fa587fff700 1 -- 172.21.15.42:0/2533961931 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5880cd390 con 0x7fa588157ba0 2023-07-29T02:00:03.290 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.299+0000 7fa587fff700 1 --2- 172.21.15.42:0/2533961931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa588157ba0 0x7fa58806e1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa588072280 tx=0x7fa58000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600d14e37579dd62 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:03.290 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.299+0000 7fa5867fc700 1 -- 172.21.15.42:0/2533961931 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58000e070 con 0x7fa588157ba0 2023-07-29T02:00:03.290 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.299+0000 7fa5867fc700 1 -- 172.21.15.42:0/2533961931 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa580003a20 con 0x7fa588157ba0 2023-07-29T02:00:03.290 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.299+0000 7fa5867fc700 1 -- 172.21.15.42:0/2533961931 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa580003dd0 con 0x7fa588157ba0 2023-07-29T02:00:03.290 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.300+0000 7fa58e164700 1 -- 172.21.15.42:0/2533961931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa588157ba0 msgr2=0x7fa58806e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:03.290 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.300+0000 7fa58e164700 1 --2- 172.21.15.42:0/2533961931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa588157ba0 0x7fa58806e1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa588072280 tx=0x7fa58000b330 comp rx=0 tx=0).stop 2023-07-29T02:00:03.291 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.300+0000 7fa58e164700 1 -- 172.21.15.42:0/2533961931 shutdown_connections 2023-07-29T02:00:03.291 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.300+0000 7fa58e164700 1 --2- 172.21.15.42:0/2533961931 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa588157ba0 0x7fa58806e1a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.291 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.300+0000 7fa58e164700 1 --2- 172.21.15.42:0/2533961931 >> v2:172.21.15.144:3300/0 conn(0x7fa588151500 0x7fa58806dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.291 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.300+0000 7fa58e164700 1 -- 172.21.15.42:0/2533961931 >> 172.21.15.42:0/2533961931 conn(0x7fa588061190 msgr2=0x7fa588061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:03.291 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.300+0000 7fa58e164700 1 -- 172.21.15.42:0/2533961931 shutdown_connections 2023-07-29T02:00:03.291 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.300+0000 7fa58e164700 1 -- 172.21.15.42:0/2533961931 wait complete. 2023-07-29T02:00:03.294 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.301+0000 7fa58e164700 1 Processor -- start 2023-07-29T02:00:03.294 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.301+0000 7fa58e164700 1 -- start start 2023-07-29T02:00:03.294 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa58e164700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5880c7f40 0x7fa58815a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:03.294 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa58e164700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa588151500 0x7fa5881465d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:03.294 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa58e164700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa588157ba0 0x7fa58806c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:03.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa58e164700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa588159040 con 0x7fa588151500 2023-07-29T02:00:03.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa58e164700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa588159270 con 0x7fa588157ba0 2023-07-29T02:00:03.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa58e164700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa588159530 con 0x7fa5880c7f40 2023-07-29T02:00:03.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa586ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa588151500 0x7fa5881465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:03.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa586ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa588151500 0x7fa5881465d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55704/0 (socket says 172.21.15.42:55704) 2023-07-29T02:00:03.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa586ffd700 1 -- 172.21.15.42:0/506676637 learned_addr learned my addr 172.21.15.42:0/506676637 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:03.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa5877fe700 1 --2- 172.21.15.42:0/506676637 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5880c7f40 0x7fa58815a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:03.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa587fff700 1 --2- 172.21.15.42:0/506676637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa588157ba0 0x7fa58806c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:03.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa586ffd700 1 -- 172.21.15.42:0/506676637 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5880c7f40 msgr2=0x7fa58815a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:03.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa586ffd700 1 --2- 172.21.15.42:0/506676637 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5880c7f40 0x7fa58815a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa586ffd700 1 -- 172.21.15.42:0/506676637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa588157ba0 msgr2=0x7fa58806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:03.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa586ffd700 1 --2- 172.21.15.42:0/506676637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa588157ba0 0x7fa58806c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa586ffd700 1 -- 172.21.15.42:0/506676637 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa580009b30 con 0x7fa588151500 2023-07-29T02:00:03.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa587fff700 1 --2- 172.21.15.42:0/506676637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa588157ba0 0x7fa58806c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:03.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa586ffd700 1 --2- 172.21.15.42:0/506676637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa588151500 0x7fa5881465d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa57000b4a0 tx=0x7fa57000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:03.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa57ffff700 1 -- 172.21.15.42:0/506676637 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa570011830 con 0x7fa588151500 2023-07-29T02:00:03.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa57ffff700 1 -- 172.21.15.42:0/506676637 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa570011990 con 0x7fa588151500 2023-07-29T02:00:03.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa57ffff700 1 -- 172.21.15.42:0/506676637 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa570011d40 con 0x7fa588151500 2023-07-29T02:00:03.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.302+0000 7fa58e164700 1 -- 172.21.15.42:0/506676637 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa588159810 con 0x7fa588151500 2023-07-29T02:00:03.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.303+0000 7fa58e164700 1 -- 172.21.15.42:0/506676637 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58806bc70 con 0x7fa588151500 2023-07-29T02:00:03.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.303+0000 7fa58e164700 1 -- 172.21.15.42:0/506676637 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa58806be90 con 0x7fa588151500 2023-07-29T02:00:03.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.304+0000 7fa57ffff700 1 -- 172.21.15.42:0/506676637 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fa570004020 con 0x7fa588151500 2023-07-29T02:00:03.298 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.305+0000 7fa57ffff700 1 --2- 172.21.15.42:0/506676637 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa56806a660 0x7fa56806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:03.298 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.305+0000 7fa57ffff700 1 -- 172.21.15.42:0/506676637 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa570088e70 con 0x7fa588151500 2023-07-29T02:00:03.298 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.305+0000 7fa5877fe700 1 --2- 172.21.15.42:0/506676637 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa56806a660 0x7fa56806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:03.298 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.305+0000 7fa5877fe700 1 --2- 172.21.15.42:0/506676637 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa56806a660 0x7fa56806cb10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa57800ab60 tx=0x7fa578008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:03.298 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.309+0000 7fa57ffff700 1 -- 172.21.15.42:0/506676637 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fa570054060 con 0x7fa588151500 2023-07-29T02:00:03.499 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.511+0000 7fa58e164700 1 -- 172.21.15.42:0/506676637 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5880cd920 con 0x7fa588151500 2023-07-29T02:00:03.500 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.512+0000 7fa57ffff700 1 -- 172.21.15.42:0/506676637 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19690 (secure 0 0 0) 0x7fa570086d00 con 0x7fa588151500 2023-07-29T02:00:03.501 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:03.501 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T02:00:02.394460+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T01:59:55.827461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T01:59:56.924040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-29T01:59:59.996470+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T02:00:03.502 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.514+0000 7fa58e164700 1 -- 172.21.15.42:0/506676637 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa56806a660 msgr2=0x7fa56806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:03.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.514+0000 7fa58e164700 1 --2- 172.21.15.42:0/506676637 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa56806a660 0x7fa56806cb10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa57800ab60 tx=0x7fa578008040 comp rx=0 tx=0).stop 2023-07-29T02:00:03.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.514+0000 7fa58e164700 1 -- 172.21.15.42:0/506676637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa588151500 msgr2=0x7fa5881465d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:03.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.514+0000 7fa58e164700 1 --2- 172.21.15.42:0/506676637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa588151500 0x7fa5881465d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa57000b4a0 tx=0x7fa57000b7b0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.514+0000 7fa58e164700 1 -- 172.21.15.42:0/506676637 shutdown_connections 2023-07-29T02:00:03.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.514+0000 7fa58e164700 1 --2- 172.21.15.42:0/506676637 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa56806a660 0x7fa56806cb10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.504 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.514+0000 7fa58e164700 1 --2- 172.21.15.42:0/506676637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa588157ba0 0x7fa58806c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.504 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.514+0000 7fa58e164700 1 --2- 172.21.15.42:0/506676637 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa5880c7f40 0x7fa58815a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.504 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.514+0000 7fa58e164700 1 --2- 172.21.15.42:0/506676637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa588151500 0x7fa5881465d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.504 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.514+0000 7fa58e164700 1 -- 172.21.15.42:0/506676637 >> 172.21.15.42:0/506676637 conn(0x7fa588061190 msgr2=0x7fa5880ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:03.505 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.515+0000 7fa58e164700 1 -- 172.21.15.42:0/506676637 shutdown_connections 2023-07-29T02:00:03.505 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.515+0000 7fa58e164700 1 -- 172.21.15.42:0/506676637 wait complete. 2023-07-29T02:00:03.532 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:00:03.659 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.671+0000 7f4ecf69f700 1 Processor -- start 2023-07-29T02:00:03.660 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.672+0000 7f4ecf69f700 1 -- start start 2023-07-29T02:00:03.660 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.672+0000 7f4ecf69f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4ec80710b0 0x7f4ec8159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:03.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.672+0000 7f4ecf69f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec80c8140 0x7f4ec80c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:03.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.672+0000 7f4ecf69f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec80c9900 con 0x7f4ec8156740 2023-07-29T02:00:03.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.672+0000 7f4ecf69f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec815a210 con 0x7f4ec80710b0 2023-07-29T02:00:03.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.672+0000 7f4ecf69f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec80c46f0 con 0x7f4ec80c8140 2023-07-29T02:00:03.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.673+0000 7f4eccc3a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4ec80710b0 0x7f4ec8159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:03.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.673+0000 7f4ecdc3c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec80c8140 0x7f4ec80c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:03.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.673+0000 7f4ecd43b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4ec8156740 0x7f4ec80c4b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.42:52006/0 (socket says 172.21.15.42:52006) 2023-07-29T02:00:03.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.673+0000 7f4ecd43b700 1 -- 172.21.15.42:0/1358615455 learned_addr learned my addr 172.21.15.42:0/1358615455 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:03.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.673+0000 7f4ecdc3c700 1 -- 172.21.15.42:0/1358615455 >> v2:172.21.15.144:3300/0 conn(0x7f4ec80710b0 msgr2=0x7f4ec8159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:03.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.673+0000 7f4ecdc3c700 1 --2- 172.21.15.42:0/1358615455 >> v2:172.21.15.144:3300/0 conn(0x7f4ec80710b0 0x7f4ec8159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.673+0000 7f4ecdc3c700 1 -- 172.21.15.42:0/1358615455 >> v1:172.21.15.144:6789/0 conn(0x7f4ec8156740 legacy=0x7f4ec80c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:03.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.673+0000 7f4ecdc3c700 1 -- 172.21.15.42:0/1358615455 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec80c3460 con 0x7f4ec80c8140 2023-07-29T02:00:03.664 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.673+0000 7f4eccc3a700 1 --2- 172.21.15.42:0/1358615455 >> v2:172.21.15.144:3300/0 conn(0x7f4ec80710b0 0x7f4ec8159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:00:03.664 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.673+0000 7f4ecdc3c700 1 --2- 172.21.15.42:0/1358615455 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec80c8140 0x7f4ec80c6e70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0009d90 tx=0x7f4ec000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d2721a65389435e server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:03.664 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.674+0000 7f4ebbfff700 1 -- 172.21.15.42:0/1358615455 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec000e070 con 0x7f4ec80c8140 2023-07-29T02:00:03.664 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.674+0000 7f4ebbfff700 1 -- 172.21.15.42:0/1358615455 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec0003a20 con 0x7f4ec80c8140 2023-07-29T02:00:03.664 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.674+0000 7f4ebbfff700 1 -- 172.21.15.42:0/1358615455 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec0003dd0 con 0x7f4ec80c8140 2023-07-29T02:00:03.664 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.674+0000 7f4ecf69f700 1 -- 172.21.15.42:0/1358615455 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec80c8140 msgr2=0x7f4ec80c6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:03.664 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.674+0000 7f4ecf69f700 1 --2- 172.21.15.42:0/1358615455 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec80c8140 0x7f4ec80c6e70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0009d90 tx=0x7f4ec000b330 comp rx=0 tx=0).stop 2023-07-29T02:00:03.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.674+0000 7f4ecf69f700 1 -- 172.21.15.42:0/1358615455 shutdown_connections 2023-07-29T02:00:03.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.674+0000 7f4ecf69f700 1 --2- 172.21.15.42:0/1358615455 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec80c8140 0x7f4ec80c6e70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.674+0000 7f4ecf69f700 1 --2- 172.21.15.42:0/1358615455 >> v2:172.21.15.144:3300/0 conn(0x7f4ec80710b0 0x7f4ec8159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.674+0000 7f4ecf69f700 1 -- 172.21.15.42:0/1358615455 >> 172.21.15.42:0/1358615455 conn(0x7f4ec80c8970 msgr2=0x7f4ec80c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:03.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.674+0000 7f4ecf69f700 1 -- 172.21.15.42:0/1358615455 shutdown_connections 2023-07-29T02:00:03.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.674+0000 7f4ecf69f700 1 -- 172.21.15.42:0/1358615455 wait complete. 2023-07-29T02:00:03.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.675+0000 7f4ecf69f700 1 Processor -- start 2023-07-29T02:00:03.666 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.675+0000 7f4ecf69f700 1 -- start start 2023-07-29T02:00:03.667 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.676+0000 7f4ecf69f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ec80710b0 0x7f4ec8152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:03.667 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.676+0000 7f4ecf69f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec80c8140 0x7f4ec806cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:03.668 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.676+0000 7f4ecf69f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ec8156740 0x7f4ec81f2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:03.668 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.676+0000 7f4ecf69f700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec806c6c0 con 0x7f4ec80710b0 2023-07-29T02:00:03.668 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.676+0000 7f4ecf69f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec8152a00 con 0x7f4ec8156740 2023-07-29T02:00:03.668 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.676+0000 7f4ecf69f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec81f2ac0 con 0x7f4ec80c8140 2023-07-29T02:00:03.668 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.676+0000 7f4ecd43b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ec80710b0 0x7f4ec8152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:03.668 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.676+0000 7f4ecd43b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ec80710b0 0x7f4ec8152320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55714/0 (socket says 172.21.15.42:55714) 2023-07-29T02:00:03.668 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.676+0000 7f4ecd43b700 1 -- 172.21.15.42:0/444713772 learned_addr learned my addr 172.21.15.42:0/444713772 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:03.669 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.676+0000 7f4eccc3a700 1 --2- 172.21.15.42:0/444713772 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec80c8140 0x7f4ec806cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:03.669 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.676+0000 7f4ecdc3c700 1 --2- 172.21.15.42:0/444713772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ec8156740 0x7f4ec81f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:03.669 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.677+0000 7f4ecd43b700 1 -- 172.21.15.42:0/444713772 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec80c8140 msgr2=0x7f4ec806cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:03.669 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.677+0000 7f4ecd43b700 1 --2- 172.21.15.42:0/444713772 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec80c8140 0x7f4ec806cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.669 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.677+0000 7f4ecd43b700 1 -- 172.21.15.42:0/444713772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ec8156740 msgr2=0x7f4ec81f2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:03.669 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.677+0000 7f4ecd43b700 1 --2- 172.21.15.42:0/444713772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ec8156740 0x7f4ec81f2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.669 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.677+0000 7f4ecd43b700 1 -- 172.21.15.42:0/444713772 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ebc0094a0 con 0x7f4ec80710b0 2023-07-29T02:00:03.670 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.677+0000 7f4ecd43b700 1 --2- 172.21.15.42:0/444713772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ec80710b0 0x7f4ec8152320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400c750 tx=0x7f4ec400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:03.670 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.677+0000 7f4eb9ffb700 1 -- 172.21.15.42:0/444713772 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4004cd0 con 0x7f4ec80710b0 2023-07-29T02:00:03.670 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.677+0000 7f4eb9ffb700 1 -- 172.21.15.42:0/444713772 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec4004e30 con 0x7f4ec80710b0 2023-07-29T02:00:03.670 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.677+0000 7f4ecf69f700 1 -- 172.21.15.42:0/444713772 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec0009a70 con 0x7f4ec80710b0 2023-07-29T02:00:03.670 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.677+0000 7f4eb9ffb700 1 -- 172.21.15.42:0/444713772 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec40072f0 con 0x7f4ec80710b0 2023-07-29T02:00:03.670 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.677+0000 7f4ecf69f700 1 -- 172.21.15.42:0/444713772 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec806d5d0 con 0x7f4ec80710b0 2023-07-29T02:00:03.670 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.678+0000 7f4ecf69f700 1 -- 172.21.15.42:0/444713772 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec806c1b0 con 0x7f4ec80710b0 2023-07-29T02:00:03.670 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.678+0000 7f4eb9ffb700 1 -- 172.21.15.42:0/444713772 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f4ec4007450 con 0x7f4ec80710b0 2023-07-29T02:00:03.671 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.679+0000 7f4eb9ffb700 1 --2- 172.21.15.42:0/444713772 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4eac06a690 0x7f4eac06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:03.671 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.679+0000 7f4eb9ffb700 1 -- 172.21.15.42:0/444713772 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4ec4088a30 con 0x7f4ec80710b0 2023-07-29T02:00:03.671 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.679+0000 7f4eccc3a700 1 --2- 172.21.15.42:0/444713772 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4eac06a690 0x7f4eac06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:03.671 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.679+0000 7f4eccc3a700 1 --2- 172.21.15.42:0/444713772 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4eac06a690 0x7f4eac06cb40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80c5d10 tx=0x7f4ebc009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:03.671 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.683+0000 7f4eb9ffb700 1 -- 172.21.15.42:0/444713772 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f4ec806c1b0 con 0x7f4ec80710b0 2023-07-29T02:00:03.916 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.928+0000 7f4ecf69f700 1 -- 172.21.15.42:0/444713772 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ec806c1b0 con 0x7f4ec80710b0 2023-07-29T02:00:03.917 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.929+0000 7f4eb9ffb700 1 -- 172.21.15.42:0/444713772 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6162 (secure 0 0 0) 0x7f4ec806c1b0 con 0x7f4ec80710b0 2023-07-29T02:00:03.917 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:03.917 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:00:03.395899+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6837/1851767861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1851767861},{"type":"v1","addr":"172.21.15.42:6837","nonce":1851767861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-29T02:00:03.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.931+0000 7f4ecf69f700 1 -- 172.21.15.42:0/444713772 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4eac06a690 msgr2=0x7f4eac06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:03.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.931+0000 7f4ecf69f700 1 --2- 172.21.15.42:0/444713772 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4eac06a690 0x7f4eac06cb40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80c5d10 tx=0x7f4ebc009210 comp rx=0 tx=0).stop 2023-07-29T02:00:03.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.931+0000 7f4ecf69f700 1 -- 172.21.15.42:0/444713772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ec80710b0 msgr2=0x7f4ec8152320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:03.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.931+0000 7f4ecf69f700 1 --2- 172.21.15.42:0/444713772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ec80710b0 0x7f4ec8152320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400c750 tx=0x7f4ec400ca60 comp rx=0 tx=0).stop 2023-07-29T02:00:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.931+0000 7f4ecf69f700 1 -- 172.21.15.42:0/444713772 shutdown_connections 2023-07-29T02:00:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.931+0000 7f4ecf69f700 1 --2- 172.21.15.42:0/444713772 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4eac06a690 0x7f4eac06cb40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.931+0000 7f4ecf69f700 1 --2- 172.21.15.42:0/444713772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4ec8156740 0x7f4ec81f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.931+0000 7f4ecf69f700 1 --2- 172.21.15.42:0/444713772 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4ec80710b0 0x7f4ec8152320 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.931+0000 7f4ecf69f700 1 --2- 172.21.15.42:0/444713772 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4ec80c8140 0x7f4ec806cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.931+0000 7f4ecf69f700 1 -- 172.21.15.42:0/444713772 >> 172.21.15.42:0/444713772 conn(0x7f4ec80c8970 msgr2=0x7f4ec81590d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:03.920 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.931+0000 7f4ecf69f700 1 -- 172.21.15.42:0/444713772 shutdown_connections 2023-07-29T02:00:03.921 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:03.931+0000 7f4ecf69f700 1 -- 172.21.15.42:0/444713772 wait complete. 2023-07-29T02:00:03.921 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 7 2023-07-29T02:00:03.931 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T02:00:04.056 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.068+0000 7fe3aaa1c700 1 Processor -- start 2023-07-29T02:00:04.056 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.068+0000 7fe3aaa1c700 1 -- start start 2023-07-29T02:00:04.058 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.069+0000 7fe3aaa1c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3a41567d0 0x7fe3a4159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:04.058 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.069+0000 7fe3aaa1c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe3a40c7210 0x7fe3a406cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:04.058 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.069+0000 7fe3aaa1c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a40c7700 con 0x7fe3a4159e90 2023-07-29T02:00:04.058 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.069+0000 7fe3aaa1c700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a406b160 con 0x7fe3a40c7210 2023-07-29T02:00:04.058 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.069+0000 7fe3aaa1c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a4159170 con 0x7fe3a41567d0 2023-07-29T02:00:04.058 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.069+0000 7fe3a37fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe3a40c7210 0x7fe3a406cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:04.059 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.069+0000 7fe3a37fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe3a40c7210 0x7fe3a406cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55722/0 (socket says 172.21.15.42:55722) 2023-07-29T02:00:04.059 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.069+0000 7fe3a37fe700 1 -- 172.21.15.42:0/3304042769 learned_addr learned my addr 172.21.15.42:0/3304042769 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:04.059 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.069+0000 7fe3a37fe700 1 -- 172.21.15.42:0/3304042769 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3a41567d0 msgr2=0x7fe3a4159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:04.059 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.069+0000 7fe3a37fe700 1 --2- 172.21.15.42:0/3304042769 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3a41567d0 0x7fe3a4159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:04.059 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.069+0000 7fe3a37fe700 1 -- 172.21.15.42:0/3304042769 >> v1:172.21.15.144:6789/0 conn(0x7fe3a4159e90 legacy=0x7fe3a415c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:04.059 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.069+0000 7fe3a37fe700 1 -- 172.21.15.42:0/3304042769 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a4156ba0 con 0x7fe3a40c7210 2023-07-29T02:00:04.059 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.069+0000 7fe3a37fe700 1 --2- 172.21.15.42:0/3304042769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3a40c7210 0x7fe3a406cd10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe3940098f0 tx=0x7fe394009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755a6ea2b2c324bd server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.069+0000 7fe3a2ffd700 1 -- 172.21.15.42:0/3304042769 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe394004230 con 0x7fe3a40c7210 2023-07-29T02:00:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.069+0000 7fe3a2ffd700 1 -- 172.21.15.42:0/3304042769 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe394004390 con 0x7fe3a40c7210 2023-07-29T02:00:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.069+0000 7fe3a2ffd700 1 -- 172.21.15.42:0/3304042769 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3940036a0 con 0x7fe3a40c7210 2023-07-29T02:00:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.070+0000 7fe3aaa1c700 1 -- 172.21.15.42:0/3304042769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3a40c7210 msgr2=0x7fe3a406cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.070+0000 7fe3aaa1c700 1 --2- 172.21.15.42:0/3304042769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3a40c7210 0x7fe3a406cd10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe3940098f0 tx=0x7fe394009c00 comp rx=0 tx=0).stop 2023-07-29T02:00:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.070+0000 7fe3aaa1c700 1 -- 172.21.15.42:0/3304042769 shutdown_connections 2023-07-29T02:00:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.070+0000 7fe3aaa1c700 1 --2- 172.21.15.42:0/3304042769 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3a41567d0 0x7fe3a4159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:04.060 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.070+0000 7fe3aaa1c700 1 --2- 172.21.15.42:0/3304042769 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3a40c7210 0x7fe3a406cd10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:04.061 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.070+0000 7fe3aaa1c700 1 -- 172.21.15.42:0/3304042769 >> 172.21.15.42:0/3304042769 conn(0x7fe3a40c8970 msgr2=0x7fe3a40c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:04.061 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.070+0000 7fe3aaa1c700 1 -- 172.21.15.42:0/3304042769 shutdown_connections 2023-07-29T02:00:04.061 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.070+0000 7fe3aaa1c700 1 -- 172.21.15.42:0/3304042769 wait complete. 2023-07-29T02:00:04.063 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.071+0000 7fe3aaa1c700 1 Processor -- start 2023-07-29T02:00:04.063 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.071+0000 7fe3aaa1c700 1 -- start start 2023-07-29T02:00:04.063 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.072+0000 7fe3aaa1c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3a40c7210 0x7fe3a415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:04.063 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.072+0000 7fe3aaa1c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3a41567d0 0x7fe3a41f2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:04.064 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.072+0000 7fe3aaa1c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3a4159e90 0x7fe3a40ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:04.064 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.072+0000 7fe3aaa1c700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a40ae400 con 0x7fe3a4159e90 2023-07-29T02:00:04.064 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.072+0000 7fe3aaa1c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a40adda0 con 0x7fe3a40c7210 2023-07-29T02:00:04.064 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.072+0000 7fe3aaa1c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a415aed0 con 0x7fe3a41567d0 2023-07-29T02:00:04.064 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.072+0000 7fe3a8fb9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3a4159e90 0x7fe3a40ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:04.064 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.072+0000 7fe3a8fb9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3a4159e90 0x7fe3a40ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55732/0 (socket says 172.21.15.42:55732) 2023-07-29T02:00:04.064 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.072+0000 7fe3a8fb9700 1 -- 172.21.15.42:0/940469486 learned_addr learned my addr 172.21.15.42:0/940469486 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:04.064 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.072+0000 7fe3a37fe700 1 --2- 172.21.15.42:0/940469486 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3a41567d0 0x7fe3a41f2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:04.065 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.072+0000 7fe3a3fff700 1 --2- 172.21.15.42:0/940469486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3a40c7210 0x7fe3a415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:04.065 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.072+0000 7fe3a8fb9700 1 -- 172.21.15.42:0/940469486 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3a41567d0 msgr2=0x7fe3a41f2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:04.065 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.072+0000 7fe3a8fb9700 1 --2- 172.21.15.42:0/940469486 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3a41567d0 0x7fe3a41f2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:04.065 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.072+0000 7fe3a8fb9700 1 -- 172.21.15.42:0/940469486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3a40c7210 msgr2=0x7fe3a415d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:04.065 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.072+0000 7fe3a8fb9700 1 --2- 172.21.15.42:0/940469486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3a40c7210 0x7fe3a415d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:04.065 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.072+0000 7fe3a8fb9700 1 -- 172.21.15.42:0/940469486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe394009550 con 0x7fe3a4159e90 2023-07-29T02:00:04.065 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.072+0000 7fe3a3fff700 1 --2- 172.21.15.42:0/940469486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3a40c7210 0x7fe3a415d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:04.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.073+0000 7fe3a8fb9700 1 --2- 172.21.15.42:0/940469486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3a4159e90 0x7fe3a40ad860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00bec0 tx=0x7fe39c009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:04.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.073+0000 7fe3a0ff9700 1 -- 172.21.15.42:0/940469486 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00cd00 con 0x7fe3a4159e90 2023-07-29T02:00:04.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.073+0000 7fe3a0ff9700 1 -- 172.21.15.42:0/940469486 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c014440 con 0x7fe3a4159e90 2023-07-29T02:00:04.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.073+0000 7fe3a0ff9700 1 -- 172.21.15.42:0/940469486 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c00cea0 con 0x7fe3a4159e90 2023-07-29T02:00:04.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.073+0000 7fe3aaa1c700 1 -- 172.21.15.42:0/940469486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a415cd10 con 0x7fe3a4159e90 2023-07-29T02:00:04.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.073+0000 7fe3aaa1c700 1 -- 172.21.15.42:0/940469486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a415a910 con 0x7fe3a4159e90 2023-07-29T02:00:04.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.074+0000 7fe3aaa1c700 1 -- 172.21.15.42:0/940469486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a4074740 con 0x7fe3a4159e90 2023-07-29T02:00:04.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.074+0000 7fe3a0ff9700 1 -- 172.21.15.42:0/940469486 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fe39c0147f0 con 0x7fe3a4159e90 2023-07-29T02:00:04.067 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.074+0000 7fe3a0ff9700 1 --2- 172.21.15.42:0/940469486 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe39006a660 0x7fe39006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:04.067 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.075+0000 7fe3a0ff9700 1 -- 172.21.15.42:0/940469486 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe39c088bc0 con 0x7fe3a4159e90 2023-07-29T02:00:04.067 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.075+0000 7fe3a3fff700 1 --2- 172.21.15.42:0/940469486 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe39006a660 0x7fe39006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:04.067 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.075+0000 7fe3a3fff700 1 --2- 172.21.15.42:0/940469486 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe39006a660 0x7fe39006cb10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe398007900 tx=0x7fe398008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:04.067 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.079+0000 7fe3a0ff9700 1 -- 172.21.15.42:0/940469486 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fe39c04e2c0 con 0x7fe3a4159e90 2023-07-29T02:00:04.265 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.277+0000 7fe3aaa1c700 1 -- 172.21.15.42:0/940469486 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3a415cea0 con 0x7fe3a4159e90 2023-07-29T02:00:04.266 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.278+0000 7fe3a0ff9700 1 -- 172.21.15.42:0/940469486 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19690 (secure 0 0 0) 0x7fe39c019090 con 0x7fe3a4159e90 2023-07-29T02:00:04.266 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:04.267 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T02:00:02.394460+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T01:59:55.827461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T01:59:56.924040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-29T01:59:59.996470+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T02:00:04.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.280+0000 7fe3aaa1c700 1 -- 172.21.15.42:0/940469486 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe39006a660 msgr2=0x7fe39006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:04.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.280+0000 7fe3aaa1c700 1 --2- 172.21.15.42:0/940469486 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe39006a660 0x7fe39006cb10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe398007900 tx=0x7fe398008040 comp rx=0 tx=0).stop 2023-07-29T02:00:04.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.280+0000 7fe3aaa1c700 1 -- 172.21.15.42:0/940469486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3a4159e90 msgr2=0x7fe3a40ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.280+0000 7fe3aaa1c700 1 --2- 172.21.15.42:0/940469486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3a4159e90 0x7fe3a40ad860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00bec0 tx=0x7fe39c009f30 comp rx=0 tx=0).stop 2023-07-29T02:00:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.280+0000 7fe3aaa1c700 1 -- 172.21.15.42:0/940469486 shutdown_connections 2023-07-29T02:00:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.280+0000 7fe3aaa1c700 1 --2- 172.21.15.42:0/940469486 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe39006a660 0x7fe39006cb10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.280+0000 7fe3aaa1c700 1 --2- 172.21.15.42:0/940469486 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe3a4159e90 0x7fe3a40ad860 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.280+0000 7fe3aaa1c700 1 --2- 172.21.15.42:0/940469486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe3a40c7210 0x7fe3a415d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.280+0000 7fe3aaa1c700 1 --2- 172.21.15.42:0/940469486 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe3a41567d0 0x7fe3a41f2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:04.270 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.280+0000 7fe3aaa1c700 1 -- 172.21.15.42:0/940469486 >> 172.21.15.42:0/940469486 conn(0x7fe3a40c8970 msgr2=0x7fe3a41527b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:04.271 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.280+0000 7fe3aaa1c700 1 -- 172.21.15.42:0/940469486 shutdown_connections 2023-07-29T02:00:04.271 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:04.280+0000 7fe3aaa1c700 1 -- 172.21.15.42:0/940469486 wait complete. 2023-07-29T02:00:04.885 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-29T01:59:57.946839+0000', 'modified': '2023-07-29T02:00:03.395899+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4300': {'gid': 4300, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.42:6837/1851767861', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6836', 'nonce': 1851767861}, {'type': 'v1', 'addr': '172.21.15.42:6837', 'nonce': 1851767861}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-07-29T02:00:04.885 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-29T02:00:04.886 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-07-29T02:00:05.023 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.035+0000 7f88066f4700 1 Processor -- start 2023-07-29T02:00:05.023 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.035+0000 7f88066f4700 1 -- start start 2023-07-29T02:00:05.025 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.036+0000 7f88066f4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f880006ce70 0x7f880015c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:05.025 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.036+0000 7f88066f4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f880015cc80 0x7f880006fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:05.025 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.036+0000 7f88066f4700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f88000c8000 0x7f88000700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:05.026 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.036+0000 7f88066f4700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8800070bc0 con 0x7f88000c8000 2023-07-29T02:00:05.026 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.036+0000 7f88066f4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8800153660 con 0x7f880006ce70 2023-07-29T02:00:05.026 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.036+0000 7f88066f4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8800159c20 con 0x7f880015cc80 2023-07-29T02:00:05.026 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.036+0000 7f8804c91700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f88000c8000 0x7f88000700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:05.026 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.036+0000 7f8804c91700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f88000c8000 0x7f88000700f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55740/0 (socket says 172.21.15.42:55740) 2023-07-29T02:00:05.026 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.036+0000 7f8804c91700 1 -- 172.21.15.42:0/3314505863 learned_addr learned my addr 172.21.15.42:0/3314505863 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:05.026 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.036+0000 7f87fffff700 1 --2- 172.21.15.42:0/3314505863 >> v2:172.21.15.144:3300/0 conn(0x7f880006ce70 0x7f880015c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:05.027 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.036+0000 7f87ff7fe700 1 --2- 172.21.15.42:0/3314505863 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f880015cc80 0x7f880006fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:05.027 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.036+0000 7f8804c91700 1 -- 172.21.15.42:0/3314505863 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f880015cc80 msgr2=0x7f880006fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:05.027 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.036+0000 7f8804c91700 1 --2- 172.21.15.42:0/3314505863 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f880015cc80 0x7f880006fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:05.027 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.036+0000 7f8804c91700 1 -- 172.21.15.42:0/3314505863 >> v2:172.21.15.144:3300/0 conn(0x7f880006ce70 msgr2=0x7f880015c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:05.027 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.036+0000 7f8804c91700 1 --2- 172.21.15.42:0/3314505863 >> v2:172.21.15.144:3300/0 conn(0x7f880006ce70 0x7f880015c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:05.027 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.036+0000 7f8804c91700 1 -- 172.21.15.42:0/3314505863 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880006d240 con 0x7f88000c8000 2023-07-29T02:00:05.027 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.036+0000 7f87ff7fe700 1 --2- 172.21.15.42:0/3314505863 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f880015cc80 0x7f880006fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:05.028 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.036+0000 7f8804c91700 1 --2- 172.21.15.42:0/3314505863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88000c8000 0x7f88000700f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f880006df20 tx=0x7f87f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1321a93441511bf4 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:05.028 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.037+0000 7f87feffd700 1 -- 172.21.15.42:0/3314505863 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f800e070 con 0x7f88000c8000 2023-07-29T02:00:05.028 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.037+0000 7f87feffd700 1 -- 172.21.15.42:0/3314505863 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f800b9c0 con 0x7f88000c8000 2023-07-29T02:00:05.028 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.037+0000 7f87feffd700 1 -- 172.21.15.42:0/3314505863 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f800bd70 con 0x7f88000c8000 2023-07-29T02:00:05.028 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.037+0000 7f88066f4700 1 -- 172.21.15.42:0/3314505863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88000c8000 msgr2=0x7f88000700f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:05.028 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.037+0000 7f88066f4700 1 --2- 172.21.15.42:0/3314505863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88000c8000 0x7f88000700f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f880006df20 tx=0x7f87f800b330 comp rx=0 tx=0).stop 2023-07-29T02:00:05.028 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.037+0000 7f88066f4700 1 -- 172.21.15.42:0/3314505863 shutdown_connections 2023-07-29T02:00:05.029 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.037+0000 7f88066f4700 1 --2- 172.21.15.42:0/3314505863 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88000c8000 0x7f88000700f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:05.029 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.037+0000 7f88066f4700 1 --2- 172.21.15.42:0/3314505863 >> v2:172.21.15.144:3300/0 conn(0x7f880006ce70 0x7f880015c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:05.029 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.037+0000 7f88066f4700 1 --2- 172.21.15.42:0/3314505863 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f880015cc80 0x7f880006fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:05.029 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.037+0000 7f88066f4700 1 -- 172.21.15.42:0/3314505863 >> 172.21.15.42:0/3314505863 conn(0x7f88000721c0 msgr2=0x7f88000725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:05.029 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.037+0000 7f88066f4700 1 -- 172.21.15.42:0/3314505863 shutdown_connections 2023-07-29T02:00:05.029 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.037+0000 7f88066f4700 1 -- 172.21.15.42:0/3314505863 wait complete. 2023-07-29T02:00:05.031 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.038+0000 7f88066f4700 1 Processor -- start 2023-07-29T02:00:05.031 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.039+0000 7f88066f4700 1 -- start start 2023-07-29T02:00:05.031 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.039+0000 7f88066f4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f880006ce70 0x7f880015c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:05.032 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.039+0000 7f88066f4700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88000c8000 0x7f88001f28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:05.032 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.039+0000 7f88066f4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f880015cc80 0x7f880014c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:05.032 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.039+0000 7f88066f4700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880014f590 con 0x7f88000c8000 2023-07-29T02:00:05.032 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.039+0000 7f88066f4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880014f040 con 0x7f880015cc80 2023-07-29T02:00:05.032 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.039+0000 7f88066f4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880014ccb0 con 0x7f880006ce70 2023-07-29T02:00:05.032 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.039+0000 7f87ff7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88000c8000 0x7f88001f28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:05.032 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.039+0000 7f87ff7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88000c8000 0x7f88001f28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55744/0 (socket says 172.21.15.42:55744) 2023-07-29T02:00:05.032 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.039+0000 7f87ff7fe700 1 -- 172.21.15.42:0/3236301620 learned_addr learned my addr 172.21.15.42:0/3236301620 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:05.033 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.040+0000 7f87fffff700 1 --2- 172.21.15.42:0/3236301620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f880006ce70 0x7f880015c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:05.033 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.040+0000 7f8804c91700 1 --2- 172.21.15.42:0/3236301620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f880015cc80 0x7f880014c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:05.033 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.040+0000 7f87ff7fe700 1 -- 172.21.15.42:0/3236301620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f880006ce70 msgr2=0x7f880015c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:05.033 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.040+0000 7f87ff7fe700 1 --2- 172.21.15.42:0/3236301620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f880006ce70 0x7f880015c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:05.033 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.040+0000 7f87ff7fe700 1 -- 172.21.15.42:0/3236301620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f880015cc80 msgr2=0x7f880014c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:05.033 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.040+0000 7f87ff7fe700 1 --2- 172.21.15.42:0/3236301620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f880015cc80 0x7f880014c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:05.033 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.040+0000 7f87ff7fe700 1 -- 172.21.15.42:0/3236301620 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f8009b30 con 0x7f88000c8000 2023-07-29T02:00:05.034 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.040+0000 7f8804c91700 1 --2- 172.21.15.42:0/3236301620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f880015cc80 0x7f880014c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:05.034 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.040+0000 7f87ff7fe700 1 --2- 172.21.15.42:0/3236301620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88000c8000 0x7f88001f28a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f87e800c820 tx=0x7f87e800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:05.034 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.040+0000 7f87fcff9700 1 -- 172.21.15.42:0/3236301620 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8011800 con 0x7f88000c8000 2023-07-29T02:00:05.034 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.040+0000 7f87fcff9700 1 -- 172.21.15.42:0/3236301620 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e8011960 con 0x7f88000c8000 2023-07-29T02:00:05.034 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.040+0000 7f87fcff9700 1 -- 172.21.15.42:0/3236301620 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8011d10 con 0x7f88000c8000 2023-07-29T02:00:05.034 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.040+0000 7f88066f4700 1 -- 172.21.15.42:0/3236301620 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8800070810 con 0x7f88000c8000 2023-07-29T02:00:05.034 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.040+0000 7f88066f4700 1 -- 172.21.15.42:0/3236301620 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88001eeaf0 con 0x7f88000c8000 2023-07-29T02:00:05.034 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.042+0000 7f87fcff9700 1 -- 172.21.15.42:0/3236301620 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f87e8018360 con 0x7f88000c8000 2023-07-29T02:00:05.035 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.042+0000 7f87fcff9700 1 --2- 172.21.15.42:0/3236301620 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f87e006a660 0x7f87e006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:05.035 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.042+0000 7f87fcff9700 1 -- 172.21.15.42:0/3236301620 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f87e8088dc0 con 0x7f88000c8000 2023-07-29T02:00:05.035 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.042+0000 7f87fffff700 1 --2- 172.21.15.42:0/3236301620 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f87e006a660 0x7f87e006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:05.035 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.043+0000 7f87fffff700 1 --2- 172.21.15.42:0/3236301620 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f87e006a660 0x7f87e006cb10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f87f000c900 tx=0x7f87f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:05.039 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.044+0000 7f8812881b80 1 Processor -- start 2023-07-29T02:00:05.039 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.044+0000 7f8812881b80 1 -- start start 2023-07-29T02:00:05.039 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.045+0000 7f8812881b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b986115180 0x55b98611a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:05.039 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.045+0000 7f8812881b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b9860d7990 0x55b98611f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:05.039 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.045+0000 7f8812881b80 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115550 0x55b98611fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:05.039 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.045+0000 7f8812881b80 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b98602d9c0 con 0x55b986115550 2023-07-29T02:00:05.039 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.045+0000 7f8812881b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b98602b380 con 0x55b986115180 2023-07-29T02:00:05.040 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.045+0000 7f8812881b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b986026c70 con 0x55b9860d7990 2023-07-29T02:00:05.040 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.045+0000 7f8804c91700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115550 0x55b98611fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:05.040 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.045+0000 7f8804c91700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115550 0x55b98611fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55754/0 (socket says 172.21.15.42:55754) 2023-07-29T02:00:05.040 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.045+0000 7f8804c91700 1 -- 172.21.15.42:0/118628380 learned_addr learned my addr 172.21.15.42:0/118628380 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:05.040 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.045+0000 7f87fffff700 1 --2- 172.21.15.42:0/118628380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b986115180 0x55b98611a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:05.040 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.045+0000 7f87ff7fe700 1 --2- 172.21.15.42:0/118628380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b9860d7990 0x55b98611f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:05.040 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.045+0000 7f8804c91700 1 -- 172.21.15.42:0/118628380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b9860d7990 msgr2=0x55b98611f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:05.041 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.045+0000 7f8804c91700 1 --2- 172.21.15.42:0/118628380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b9860d7990 0x55b98611f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:05.041 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.045+0000 7f8804c91700 1 -- 172.21.15.42:0/118628380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b986115180 msgr2=0x55b98611a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:05.041 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.045+0000 7f8804c91700 1 --2- 172.21.15.42:0/118628380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b986115180 0x55b98611a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:05.041 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.045+0000 7f8804c91700 1 -- 172.21.15.42:0/118628380 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b985e54d90 con 0x55b986115550 2023-07-29T02:00:05.041 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.045+0000 7f8804c91700 1 --2- 172.21.15.42:0/118628380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115550 0x55b98611fa30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f87f800b730 tx=0x7f87f8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d1b6b1ab1c4bd9 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:05.041 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.045+0000 7f87f5ffb700 1 -- 172.21.15.42:0/118628380 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8003c20 con 0x55b986115550 2023-07-29T02:00:05.041 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.045+0000 7f87f5ffb700 1 -- 172.21.15.42:0/118628380 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f8003d80 con 0x55b986115550 2023-07-29T02:00:05.041 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.045+0000 7f87f5ffb700 1 -- 172.21.15.42:0/118628380 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f8004260 con 0x55b986115550 2023-07-29T02:00:05.042 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.046+0000 7f8812881b80 1 -- 172.21.15.42:0/118628380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115550 msgr2=0x55b98611fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:05.042 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.046+0000 7f8812881b80 1 --2- 172.21.15.42:0/118628380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115550 0x55b98611fa30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f87f800b730 tx=0x7f87f8010000 comp rx=0 tx=0).stop 2023-07-29T02:00:05.042 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.046+0000 7f8812881b80 1 -- 172.21.15.42:0/118628380 shutdown_connections 2023-07-29T02:00:05.042 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.046+0000 7f8812881b80 1 --2- 172.21.15.42:0/118628380 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115550 0x55b98611fa30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:05.042 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.046+0000 7f8812881b80 1 --2- 172.21.15.42:0/118628380 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b986115180 0x55b98611a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:05.042 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.046+0000 7f8812881b80 1 --2- 172.21.15.42:0/118628380 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b9860d7990 0x55b98611f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:05.042 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.046+0000 7f8812881b80 1 -- 172.21.15.42:0/118628380 >> 172.21.15.42:0/118628380 conn(0x55b9860d2630 msgr2=0x55b9860d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:05.042 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.046+0000 7f8812881b80 1 -- 172.21.15.42:0/118628380 shutdown_connections 2023-07-29T02:00:05.043 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.046+0000 7f8812881b80 1 -- 172.21.15.42:0/118628380 wait complete. 2023-07-29T02:00:05.043 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.046+0000 7f8812881b80 1 -- start start 2023-07-29T02:00:05.043 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.047+0000 7f8812881b80 1 Processor -- start 2023-07-29T02:00:05.043 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.047+0000 7f8812881b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b9860d7990 0x55b986129a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:05.043 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.047+0000 7f8812881b80 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115180 0x55b9860fb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:05.043 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.047+0000 7f8812881b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b986115550 0x55b9860fcb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:05.043 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.047+0000 7f8812881b80 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b985fc34c0 con 0x55b986115180 2023-07-29T02:00:05.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.047+0000 7f8812881b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b985fc3160 con 0x55b9860d7990 2023-07-29T02:00:05.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.047+0000 7f8812881b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b985eaa8d0 con 0x55b986115550 2023-07-29T02:00:05.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.048+0000 7f8812881b80 10 client.0 _ll_register_callbacks cb 0x55b985fcc5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-29T02:00:05.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.048+0000 7f87ff7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115180 0x55b9860fb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:05.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.048+0000 7f87ff7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115180 0x55b9860fb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55758/0 (socket says 172.21.15.42:55758) 2023-07-29T02:00:05.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.048+0000 7f87ff7fe700 1 -- 172.21.15.42:0/3153591865 learned_addr learned my addr 172.21.15.42:0/3153591865 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:05.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.048+0000 7f8804c91700 1 --2- 172.21.15.42:0/3153591865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b986115550 0x55b9860fcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:05.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.048+0000 7f87fffff700 1 --2- 172.21.15.42:0/3153591865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b9860d7990 0x55b986129a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:05.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.048+0000 7f87ff7fe700 1 -- 172.21.15.42:0/3153591865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b986115550 msgr2=0x55b9860fcb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:05.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.048+0000 7f87ff7fe700 1 --2- 172.21.15.42:0/3153591865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b986115550 0x55b9860fcb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:05.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.048+0000 7f87ff7fe700 1 -- 172.21.15.42:0/3153591865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b9860d7990 msgr2=0x55b986129a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:05.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.048+0000 7f87ff7fe700 1 --2- 172.21.15.42:0/3153591865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b9860d7990 0x55b986129a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:05.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.048+0000 7f87ff7fe700 1 -- 172.21.15.42:0/3153591865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880006d240 con 0x55b986115180 2023-07-29T02:00:05.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.048+0000 7f87ff7fe700 1 --2- 172.21.15.42:0/3153591865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115180 0x55b9860fb9f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f87e80578a0 tx=0x7f87e8057370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282469af3c9bc60f server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:05.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.048+0000 7f87deffd700 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2023-07-29T02:00:05.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.048+0000 7f87deffd700 1 -- 172.21.15.42:0/3153591865 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e806f170 con 0x55b986115180 2023-07-29T02:00:05.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.048+0000 7f87deffd700 1 -- 172.21.15.42:0/3153591865 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f87e806f2d0 con 0x55b986115180 2023-07-29T02:00:05.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.048+0000 7f8812881b80 1 -- 172.21.15.42:0/3153591865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b98609b290 con 0x55b986115180 2023-07-29T02:00:05.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.048+0000 7f87deffd700 1 -- 172.21.15.42:0/3153591865 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87e8056b00 con 0x55b986115180 2023-07-29T02:00:05.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.048+0000 7f8812881b80 10 client.4425 fetch_fsmap learned FSMap version 7 2023-07-29T02:00:05.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.048+0000 7f8812881b80 1 -- 172.21.15.42:0/3153591865 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55b985e3dc10 con 0x55b986115180 2023-07-29T02:00:05.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.048+0000 7f87deffd700 1 -- 172.21.15.42:0/3153591865 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e8061080 con 0x55b986115180 2023-07-29T02:00:05.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.049+0000 7f87deffd700 1 -- 172.21.15.42:0/3153591865 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 7) v1 ==== 4204+0+0 (secure 0 0 0) 0x7f87e8056c60 con 0x55b986115180 2023-07-29T02:00:05.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.049+0000 7f8812881b80 10 client.4425 fetch_fsmap finished waiting for FSMap version 7 2023-07-29T02:00:05.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.049+0000 7f8812881b80 10 client.4425 resolve_mds: resolved name 'e' to daemon mds.e 2023-07-29T02:00:05.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.049+0000 7f8812881b80 20 client.4425 populate_metadata read hostname 'smithi042' 2023-07-29T02:00:05.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.049+0000 7f8812881b80 1 --2- 172.21.15.42:0/3153591865 >> [v2:172.21.15.42:6836/1851767861,v1:172.21.15.42:6837/1851767861] conn(0x55b9860f3e00 0x55b9860f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:05.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.049+0000 7f8812881b80 4 client.4425 mds_command: new command op to 4300 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-29T02:00:05.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.049+0000 7f8812881b80 1 -- 172.21.15.42:0/3153591865 --> [v2:172.21.15.42:6836/1851767861,v1:172.21.15.42:6837/1851767861] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b98601fcf0 con 0x55b9860f3e00 2023-07-29T02:00:05.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.049+0000 7f87fffff700 1 --2- 172.21.15.42:0/3153591865 >> [v2:172.21.15.42:6836/1851767861,v1:172.21.15.42:6837/1851767861] conn(0x55b9860f3e00 0x55b9860f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:05.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.049+0000 7f87deffd700 10 client.4425 ms_handle_connect on v2:172.21.15.42:6836/1851767861 2023-07-29T02:00:05.048 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:05.049+0000 7f87fffff700 1 --2- 172.21.15.42:0/3153591865 >> [v2:172.21.15.42:6836/1851767861,v1:172.21.15.42:6837/1851767861] conn(0x55b9860f3e00 0x55b9860f41d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4acf5115b66cc40c server_cookie=2fc28d2b5c7ac55d in_seq=0 out_seq=0 2023-07-29T02:00:05.120 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:00:05.123 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:00:08.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.399+0000 7f87deffd700 1 -- 172.21.15.42:0/3153591865 <== mds.0 v2:172.21.15.42:6836/1851767861 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x55b98601fcf0 con 0x55b9860f3e00 2023-07-29T02:00:08.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.399+0000 7f87deffd700 10 client.4425 handle_command_reply: tid=0 2023-07-29T02:00:08.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.399+0000 7f8812881b80 1 client.4425 shutdown 2023-07-29T02:00:08.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.399+0000 7f8812881b80 1 -- 172.21.15.42:0/3153591865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115180 msgr2=0x55b9860fb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:08.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.399+0000 7f8812881b80 1 --2- 172.21.15.42:0/3153591865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115180 0x55b9860fb9f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f87e80578a0 tx=0x7f87e8057370 comp rx=0 tx=0).stop 2023-07-29T02:00:08.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.399+0000 7f8812881b80 1 -- 172.21.15.42:0/3153591865 shutdown_connections 2023-07-29T02:00:08.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.399+0000 7f8812881b80 1 --2- 172.21.15.42:0/3153591865 >> [v2:172.21.15.42:6836/1851767861,v1:172.21.15.42:6837/1851767861] conn(0x55b9860f3e00 0x55b9860f41d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.399+0000 7f8812881b80 1 --2- 172.21.15.42:0/3153591865 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b986115550 0x55b9860fcb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.399+0000 7f8812881b80 1 --2- 172.21.15.42:0/3153591865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b9860d7990 0x55b986129a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.399+0000 7f87deffd700 0 client.4425 ms_handle_reset on v2:172.21.15.42:6836/1851767861 2023-07-29T02:00:08.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.399+0000 7f8812881b80 1 --2- 172.21.15.42:0/3153591865 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115180 0x55b9860fb9f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.399+0000 7f8812881b80 1 -- 172.21.15.42:0/3153591865 >> 172.21.15.42:0/3153591865 conn(0x55b9860d2630 msgr2=0x55b9860c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:08.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.399+0000 7f8812881b80 1 -- 172.21.15.42:0/3153591865 shutdown_connections 2023-07-29T02:00:08.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.399+0000 7f8812881b80 1 -- 172.21.15.42:0/3153591865 wait complete. 2023-07-29T02:00:08.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.399+0000 7f8812881b80 20 client.4425 trim_cache size 0 max 16384 2023-07-29T02:00:08.406 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.418+0000 7f8812881b80 1 Processor -- start 2023-07-29T02:00:08.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.418+0000 7f8812881b80 1 -- start start 2023-07-29T02:00:08.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.419+0000 7f8812881b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b9860d7990 0x55b9860d5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:08.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.419+0000 7f8812881b80 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115180 0x55b9860d60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:08.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.420+0000 7f8812881b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b986115550 0x55b9860f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:08.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.420+0000 7f8812881b80 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9860cc390 con 0x55b986115180 2023-07-29T02:00:08.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.420+0000 7f8812881b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9860d68a0 con 0x55b9860d7990 2023-07-29T02:00:08.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.420+0000 7f8812881b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b986129020 con 0x55b986115550 2023-07-29T02:00:08.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.420+0000 7f87ff7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115180 0x55b9860d60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:08.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.420+0000 7f87ff7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115180 0x55b9860d60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55764/0 (socket says 172.21.15.42:55764) 2023-07-29T02:00:08.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.420+0000 7f87ff7fe700 1 -- 172.21.15.42:0/1532766644 learned_addr learned my addr 172.21.15.42:0/1532766644 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:08.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.420+0000 7f87fffff700 1 --2- 172.21.15.42:0/1532766644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b9860d7990 0x55b9860d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:08.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.420+0000 7f8804c91700 1 --2- 172.21.15.42:0/1532766644 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b986115550 0x55b9860f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:08.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.420+0000 7f87ff7fe700 1 -- 172.21.15.42:0/1532766644 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b986115550 msgr2=0x55b9860f41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:08.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.420+0000 7f87ff7fe700 1 --2- 172.21.15.42:0/1532766644 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b986115550 0x55b9860f41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.420+0000 7f87ff7fe700 1 -- 172.21.15.42:0/1532766644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b9860d7990 msgr2=0x55b9860d5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:08.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.420+0000 7f87ff7fe700 1 --2- 172.21.15.42:0/1532766644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b9860d7990 0x55b9860d5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.420+0000 7f87ff7fe700 1 -- 172.21.15.42:0/1532766644 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b985e7b200 con 0x55b986115180 2023-07-29T02:00:08.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.420+0000 7f87ff7fe700 1 --2- 172.21.15.42:0/1532766644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115180 0x55b9860d60d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f87e806f4e0 tx=0x7f87e805a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=218857e8f6660866 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:08.415 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.420+0000 7f87f67fc700 1 -- 172.21.15.42:0/1532766644 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e80576e0 con 0x55b986115180 2023-07-29T02:00:08.415 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.421+0000 7f87f67fc700 1 -- 172.21.15.42:0/1532766644 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e8084030 con 0x55b986115180 2023-07-29T02:00:08.415 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.421+0000 7f87f67fc700 1 -- 172.21.15.42:0/1532766644 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e806f170 con 0x55b986115180 2023-07-29T02:00:08.415 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.421+0000 7f8812881b80 1 -- 172.21.15.42:0/1532766644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115180 msgr2=0x55b9860d60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:08.416 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.421+0000 7f8812881b80 1 --2- 172.21.15.42:0/1532766644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115180 0x55b9860d60d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f87e806f4e0 tx=0x7f87e805a070 comp rx=0 tx=0).stop 2023-07-29T02:00:08.416 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.421+0000 7f8812881b80 1 -- 172.21.15.42:0/1532766644 shutdown_connections 2023-07-29T02:00:08.416 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.421+0000 7f8812881b80 1 --2- 172.21.15.42:0/1532766644 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b986115550 0x55b9860f41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.417 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.421+0000 7f8812881b80 1 --2- 172.21.15.42:0/1532766644 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b9860d7990 0x55b9860d5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.417 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.421+0000 7f8812881b80 1 --2- 172.21.15.42:0/1532766644 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115180 0x55b9860d60d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.417 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.421+0000 7f8812881b80 1 -- 172.21.15.42:0/1532766644 >> 172.21.15.42:0/1532766644 conn(0x55b9860d2630 msgr2=0x55b9860fc950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:08.417 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.421+0000 7f8812881b80 1 -- 172.21.15.42:0/1532766644 shutdown_connections 2023-07-29T02:00:08.418 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.421+0000 7f8812881b80 1 -- 172.21.15.42:0/1532766644 wait complete. 2023-07-29T02:00:08.418 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.422+0000 7f8812881b80 1 -- start start 2023-07-29T02:00:08.418 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.422+0000 7f8812881b80 1 Processor -- start 2023-07-29T02:00:08.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.423+0000 7f8812881b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b9860d7990 0x55b9860fcad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:08.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.423+0000 7f8812881b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b986115180 0x55b986113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:08.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.423+0000 7f8812881b80 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115550 0x55b986175c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:08.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.423+0000 7f8812881b80 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9860fd010 con 0x55b986115550 2023-07-29T02:00:08.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.423+0000 7f8812881b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b986113ff0 con 0x55b9860d7990 2023-07-29T02:00:08.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.423+0000 7f8812881b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9860f4550 con 0x55b986115180 2023-07-29T02:00:08.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.423+0000 7f8812881b80 10 client.0 _ll_register_callbacks cb 0x7f87e805bc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-29T02:00:08.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.423+0000 7f8804c91700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115550 0x55b986175c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:08.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.423+0000 7f8804c91700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115550 0x55b986175c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55774/0 (socket says 172.21.15.42:55774) 2023-07-29T02:00:08.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.423+0000 7f8804c91700 1 -- 172.21.15.42:0/2863382918 learned_addr learned my addr 172.21.15.42:0/2863382918 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:08.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.424+0000 7f87fffff700 1 --2- 172.21.15.42:0/2863382918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b9860d7990 0x55b9860fcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:08.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.424+0000 7f87ff7fe700 1 --2- 172.21.15.42:0/2863382918 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b986115180 0x55b986113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:08.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.424+0000 7f8804c91700 1 -- 172.21.15.42:0/2863382918 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b986115180 msgr2=0x55b986113ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:08.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.424+0000 7f8804c91700 1 --2- 172.21.15.42:0/2863382918 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b986115180 0x55b986113ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.424+0000 7f8804c91700 1 -- 172.21.15.42:0/2863382918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b9860d7990 msgr2=0x55b9860fcad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:08.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.424+0000 7f8804c91700 1 --2- 172.21.15.42:0/2863382918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b9860d7990 0x55b9860fcad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.424+0000 7f8804c91700 1 -- 172.21.15.42:0/2863382918 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b985e3dc10 con 0x55b986115550 2023-07-29T02:00:08.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.424+0000 7f8804c91700 1 --2- 172.21.15.42:0/2863382918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115550 0x55b986175c20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f87f8000f80 tx=0x7f87f800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d3b7f6dc57f002 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:08.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.424+0000 7f87deffd700 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2023-07-29T02:00:08.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.424+0000 7f87deffd700 1 -- 172.21.15.42:0/2863382918 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f802b050 con 0x55b986115550 2023-07-29T02:00:08.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.424+0000 7f87deffd700 1 -- 172.21.15.42:0/2863382918 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f87f8004730 con 0x55b986115550 2023-07-29T02:00:08.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.424+0000 7f8812881b80 1 -- 172.21.15.42:0/2863382918 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f87f8003d80 con 0x55b986115550 2023-07-29T02:00:08.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.424+0000 7f87deffd700 1 -- 172.21.15.42:0/2863382918 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87f80048f0 con 0x55b986115550 2023-07-29T02:00:08.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.425+0000 7f8812881b80 10 client.4431 fetch_fsmap learned FSMap version 7 2023-07-29T02:00:08.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.425+0000 7f8812881b80 1 -- 172.21.15.42:0/2863382918 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55b985e53260 con 0x55b986115550 2023-07-29T02:00:08.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.425+0000 7f87deffd700 1 -- 172.21.15.42:0/2863382918 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f8003d80 con 0x55b986115550 2023-07-29T02:00:08.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.425+0000 7f87deffd700 1 -- 172.21.15.42:0/2863382918 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 7) v1 ==== 4204+0+0 (secure 0 0 0) 0x7f87f8019030 con 0x55b986115550 2023-07-29T02:00:08.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.425+0000 7f8812881b80 10 client.4431 fetch_fsmap finished waiting for FSMap version 7 2023-07-29T02:00:08.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.425+0000 7f8812881b80 10 client.4431 resolve_mds: resolved name 'e' to daemon mds.e 2023-07-29T02:00:08.431 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.425+0000 7f8812881b80 20 client.4431 populate_metadata read hostname 'smithi042' 2023-07-29T02:00:08.431 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.425+0000 7f8812881b80 1 --2- 172.21.15.42:0/2863382918 >> [v2:172.21.15.42:6836/1851767861,v1:172.21.15.42:6837/1851767861] conn(0x55b98617bdc0 0x55b98617c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:08.431 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.425+0000 7f8812881b80 4 client.4431 mds_command: new command op to 4300 tid=0[{"prefix": "status"}] 2023-07-29T02:00:08.431 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.425+0000 7f8812881b80 1 -- 172.21.15.42:0/2863382918 --> [v2:172.21.15.42:6836/1851767861,v1:172.21.15.42:6837/1851767861] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b98601fa10 con 0x55b98617bdc0 2023-07-29T02:00:08.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.425+0000 7f87fffff700 1 --2- 172.21.15.42:0/2863382918 >> [v2:172.21.15.42:6836/1851767861,v1:172.21.15.42:6837/1851767861] conn(0x55b98617bdc0 0x55b98617c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:08.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.425+0000 7f87fffff700 1 --2- 172.21.15.42:0/2863382918 >> [v2:172.21.15.42:6836/1851767861,v1:172.21.15.42:6837/1851767861] conn(0x55b98617bdc0 0x55b98617c190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5457550711ee1e6 server_cookie=b1a983391928dce7 in_seq=0 out_seq=0 2023-07-29T02:00:08.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.425+0000 7f87deffd700 10 client.4431 ms_handle_connect on v2:172.21.15.42:6836/1851767861 2023-07-29T02:00:08.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.426+0000 7f87deffd700 1 -- 172.21.15.42:0/2863382918 <== mds.0 v2:172.21.15.42:6836/1851767861 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55b98601fa10 con 0x55b98617bdc0 2023-07-29T02:00:08.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.426+0000 7f87deffd700 10 client.4431 handle_command_reply: tid=0 2023-07-29T02:00:08.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.426+0000 7f8812881b80 1 client.4431 shutdown 2023-07-29T02:00:08.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.426+0000 7f8812881b80 1 -- 172.21.15.42:0/2863382918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115550 msgr2=0x55b986175c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:08.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.426+0000 7f8812881b80 1 --2- 172.21.15.42:0/2863382918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115550 0x55b986175c20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f87f8000f80 tx=0x7f87f800e000 comp rx=0 tx=0).stop 2023-07-29T02:00:08.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.426+0000 7f8812881b80 1 -- 172.21.15.42:0/2863382918 shutdown_connections 2023-07-29T02:00:08.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.426+0000 7f8812881b80 1 --2- 172.21.15.42:0/2863382918 >> [v2:172.21.15.42:6836/1851767861,v1:172.21.15.42:6837/1851767861] conn(0x55b98617bdc0 0x55b98617c190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.426+0000 7f8812881b80 1 --2- 172.21.15.42:0/2863382918 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x55b986115550 0x55b986175c20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.426+0000 7f8812881b80 1 --2- 172.21.15.42:0/2863382918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b9860d7990 0x55b9860fcad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.426+0000 7f8812881b80 1 --2- 172.21.15.42:0/2863382918 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x55b986115180 0x55b986113ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.426+0000 7f8812881b80 1 -- 172.21.15.42:0/2863382918 >> 172.21.15.42:0/2863382918 conn(0x55b9860d2630 msgr2=0x55b9860d5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:08.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.426+0000 7f87deffd700 0 client.4431 ms_handle_reset on v2:172.21.15.42:6836/1851767861 2023-07-29T02:00:08.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.426+0000 7f8812881b80 1 -- 172.21.15.42:0/2863382918 shutdown_connections 2023-07-29T02:00:08.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.426+0000 7f8812881b80 1 -- 172.21.15.42:0/2863382918 wait complete. 2023-07-29T02:00:08.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.426+0000 7f8812881b80 20 client.4431 trim_cache size 0 max 16384 2023-07-29T02:00:08.437 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2023-07-29T02:00:08.437 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "f97a53ee-a392-4212-b8f0-a81cb72fe6f6", 2023-07-29T02:00:08.437 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2023-07-29T02:00:08.437 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4300, 2023-07-29T02:00:08.437 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2023-07-29T02:00:08.437 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2023-07-29T02:00:08.438 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2023-07-29T02:00:08.438 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 10.477981442999999, 2023-07-29T02:00:08.438 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 6, 2023-07-29T02:00:08.438 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 25, 2023-07-29T02:00:08.438 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 25, 2023-07-29T02:00:08.438 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 15.849617247999999 2023-07-29T02:00:08.438 INFO:teuthology.orchestra.run.smithi042.stdout:} 2023-07-29T02:00:08.439 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.427+0000 7f88066f4700 1 -- 172.21.15.42:0/3236301620 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f87e006a660 msgr2=0x7f87e006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:08.440 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.427+0000 7f88066f4700 1 --2- 172.21.15.42:0/3236301620 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f87e006a660 0x7f87e006cb10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f87f000c900 tx=0x7f87f0008040 comp rx=0 tx=0).stop 2023-07-29T02:00:08.440 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.427+0000 7f88066f4700 1 -- 172.21.15.42:0/3236301620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88000c8000 msgr2=0x7f88001f28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:08.440 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.427+0000 7f88066f4700 1 --2- 172.21.15.42:0/3236301620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88000c8000 0x7f88001f28a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f87e800c820 tx=0x7f87e800cbe0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.440 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.427+0000 7f88066f4700 1 -- 172.21.15.42:0/3236301620 shutdown_connections 2023-07-29T02:00:08.440 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.427+0000 7f88066f4700 1 --2- 172.21.15.42:0/3236301620 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f87e006a660 0x7f87e006cb10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.440 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.427+0000 7f88066f4700 1 --2- 172.21.15.42:0/3236301620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f880015cc80 0x7f880014c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.440 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.427+0000 7f88066f4700 1 --2- 172.21.15.42:0/3236301620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f880006ce70 0x7f880015c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.441 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.427+0000 7f88066f4700 1 --2- 172.21.15.42:0/3236301620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f88000c8000 0x7f88001f28a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.441 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.427+0000 7f88066f4700 1 -- 172.21.15.42:0/3236301620 >> 172.21.15.42:0/3236301620 conn(0x7f88000721c0 msgr2=0x7f8800152090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:08.441 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.427+0000 7f88066f4700 1 -- 172.21.15.42:0/3236301620 shutdown_connections 2023-07-29T02:00:08.441 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.427+0000 7f88066f4700 1 -- 172.21.15.42:0/3236301620 wait complete. 2023-07-29T02:00:08.441 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-29T02:00:08.442 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-29T02:00:08.442 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-29T02:00:08.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.588+0000 7f1a2b17f700 1 Processor -- start 2023-07-29T02:00:08.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.588+0000 7f1a2b17f700 1 -- start start 2023-07-29T02:00:08.576 INFO:tasks.ceph.mds.e.smithi042.stderr:2023-07-29T02:00:08.588+0000 7fa80adcd700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-29T02:00:08.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.589+0000 7f1a2b17f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a2414c630 0x7f1a2406c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:08.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.589+0000 7f1a2b17f700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2406ce40 con 0x7f1a2414ca00 2023-07-29T02:00:08.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.589+0000 7f1a2b17f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a24155d50 con 0x7f1a240c7270 2023-07-29T02:00:08.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.589+0000 7f1a2b17f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a24156010 con 0x7f1a2414c630 2023-07-29T02:00:08.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.589+0000 7f1a23fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f1a2414ca00 0x7f1a240c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49582/0 (socket says 172.21.15.42:49582) 2023-07-29T02:00:08.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.589+0000 7f1a23fff700 1 -- 172.21.15.42:0/4242638148 learned_addr learned my addr 172.21.15.42:0/4242638148 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:08.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.589+0000 7f1a237fe700 1 -- 172.21.15.42:0/4242638148 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886062094 0 0) 0x7f1a2406ce40 con 0x7f1a2414ca00 2023-07-29T02:00:08.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.589+0000 7f1a237fe700 1 -- 172.21.15.42:0/4242638148 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a140035b0 con 0x7f1a2414ca00 2023-07-29T02:00:08.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.589+0000 7f1a28f1b700 1 --2- 172.21.15.42:0/4242638148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a2414c630 0x7f1a2406c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:08.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a237fe700 1 -- 172.21.15.42:0/4242638148 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2356281436 0 0) 0x7f1a140035b0 con 0x7f1a2414ca00 2023-07-29T02:00:08.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a237fe700 1 -- 172.21.15.42:0/4242638148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a2414c630 msgr2=0x7f1a2406c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:08.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a237fe700 1 --2- 172.21.15.42:0/4242638148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a2414c630 0x7f1a2406c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a237fe700 1 -- 172.21.15.42:0/4242638148 >> v1:172.21.15.144:6789/0 conn(0x7f1a240c7270 legacy=0x7f1a2406d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:08.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a237fe700 1 -- 172.21.15.42:0/4242638148 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a241562f0 con 0x7f1a2414ca00 2023-07-29T02:00:08.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a237fe700 1 -- 172.21.15.42:0/4242638148 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7f1a10001670 con 0x7f1a2414ca00 2023-07-29T02:00:08.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a237fe700 1 -- 172.21.15.42:0/4242638148 >> v1:172.21.15.42:6789/0 conn(0x7f1a2414ca00 legacy=0x7f1a240c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:08.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a237fe700 1 --2- 172.21.15.42:0/4242638148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a14003a30 0x7f1a14003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:08.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a237fe700 1 --2- 172.21.15.42:0/4242638148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a2414c630 0x7f1a14004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:08.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a237fe700 1 --2- 172.21.15.42:0/4242638148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a14004d90 0x7f1a14005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:08.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a237fe700 1 -- 172.21.15.42:0/4242638148 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a24156010 con 0x7f1a14004d90 2023-07-29T02:00:08.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a237fe700 1 -- 172.21.15.42:0/4242638148 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1400ba10 con 0x7f1a14003a30 2023-07-29T02:00:08.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a237fe700 1 -- 172.21.15.42:0/4242638148 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1400ddb0 con 0x7f1a2414c630 2023-07-29T02:00:08.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a28f1b700 1 --2- 172.21.15.42:0/4242638148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a14003a30 0x7f1a14003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:08.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a2971c700 1 --2- 172.21.15.42:0/4242638148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a14004d90 0x7f1a14005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:08.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a23fff700 1 --2- 172.21.15.42:0/4242638148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a2414c630 0x7f1a14004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:08.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a2971c700 1 -- 172.21.15.42:0/4242638148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a2414c630 msgr2=0x7f1a14004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:08.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a2971c700 1 --2- 172.21.15.42:0/4242638148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a2414c630 0x7f1a14004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a2971c700 1 -- 172.21.15.42:0/4242638148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a14003a30 msgr2=0x7f1a14003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:08.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a2971c700 1 --2- 172.21.15.42:0/4242638148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a14003a30 0x7f1a14003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a2971c700 1 -- 172.21.15.42:0/4242638148 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a140035b0 con 0x7f1a14004d90 2023-07-29T02:00:08.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a2971c700 1 --2- 172.21.15.42:0/4242638148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a14004d90 0x7f1a14005200 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00c260 tx=0x7f1a14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277c61668fcc46ee server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:08.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a237fe700 1 -- 172.21.15.42:0/4242638148 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c001e70 con 0x7f1a14004d90 2023-07-29T02:00:08.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a237fe700 1 -- 172.21.15.42:0/4242638148 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c00ce20 con 0x7f1a14004d90 2023-07-29T02:00:08.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.590+0000 7f1a237fe700 1 -- 172.21.15.42:0/4242638148 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c012660 con 0x7f1a14004d90 2023-07-29T02:00:08.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.591+0000 7f1a2b17f700 1 -- 172.21.15.42:0/4242638148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a14004d90 msgr2=0x7f1a14005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:08.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.591+0000 7f1a2b17f700 1 --2- 172.21.15.42:0/4242638148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a14004d90 0x7f1a14005200 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00c260 tx=0x7f1a14005880 comp rx=0 tx=0).stop 2023-07-29T02:00:08.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.591+0000 7f1a2971c700 1 -- 172.21.15.42:0/4242638148 reap_dead start 2023-07-29T02:00:08.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.591+0000 7f1a2b17f700 1 -- 172.21.15.42:0/4242638148 shutdown_connections 2023-07-29T02:00:08.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.591+0000 7f1a2b17f700 1 -- 172.21.15.42:0/4242638148 >> 172.21.15.42:0/4242638148 conn(0x7f1a240c8970 msgr2=0x7f1a240c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:08.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.591+0000 7f1a2b17f700 1 -- 172.21.15.42:0/4242638148 shutdown_connections 2023-07-29T02:00:08.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.591+0000 7f1a2b17f700 1 -- 172.21.15.42:0/4242638148 wait complete. 2023-07-29T02:00:08.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.592+0000 7f1a2b17f700 1 Processor -- start 2023-07-29T02:00:08.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.592+0000 7f1a2b17f700 1 -- start start 2023-07-29T02:00:08.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.593+0000 7f1a2b17f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a14004d90 0x7f1a241530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:08.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.593+0000 7f1a2b17f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a24153b30 0x7f1a241548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:08.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.593+0000 7f1a2b17f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a24150ac0 0x7f1a24143ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:08.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.593+0000 7f1a2b17f700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a241544a0 con 0x7f1a24150ac0 2023-07-29T02:00:08.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.593+0000 7f1a2b17f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a24152540 con 0x7f1a14004d90 2023-07-29T02:00:08.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.593+0000 7f1a2b17f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a24155d00 con 0x7f1a24153b30 2023-07-29T02:00:08.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.593+0000 7f1a2971c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a24150ac0 0x7f1a24143ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:08.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.593+0000 7f1a2971c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a24150ac0 0x7f1a24143ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55794/0 (socket says 172.21.15.42:55794) 2023-07-29T02:00:08.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.593+0000 7f1a2971c700 1 -- 172.21.15.42:0/1571177405 learned_addr learned my addr 172.21.15.42:0/1571177405 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:08.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.593+0000 7f1a28f1b700 1 --2- 172.21.15.42:0/1571177405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a14004d90 0x7f1a241530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:08.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.593+0000 7f1a23fff700 1 --2- 172.21.15.42:0/1571177405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a24153b30 0x7f1a241548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:08.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.594+0000 7f1a2971c700 1 -- 172.21.15.42:0/1571177405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a24153b30 msgr2=0x7f1a241548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:08.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.594+0000 7f1a2971c700 1 --2- 172.21.15.42:0/1571177405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a24153b30 0x7f1a241548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.594+0000 7f1a2971c700 1 -- 172.21.15.42:0/1571177405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a14004d90 msgr2=0x7f1a241530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:08.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.594+0000 7f1a2971c700 1 --2- 172.21.15.42:0/1571177405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a14004d90 0x7f1a241530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.594+0000 7f1a2971c700 1 -- 172.21.15.42:0/1571177405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a24153fa0 con 0x7f1a24150ac0 2023-07-29T02:00:08.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.594+0000 7f1a23fff700 1 --2- 172.21.15.42:0/1571177405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a24153b30 0x7f1a241548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:08.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.594+0000 7f1a2971c700 1 --2- 172.21.15.42:0/1571177405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a24150ac0 0x7f1a24143ff0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c013000 tx=0x7f1a1c0015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:08.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.594+0000 7f1a217fa700 1 -- 172.21.15.42:0/1571177405 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c003e90 con 0x7f1a24150ac0 2023-07-29T02:00:08.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.594+0000 7f1a217fa700 1 -- 172.21.15.42:0/1571177405 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c005070 con 0x7f1a24150ac0 2023-07-29T02:00:08.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.594+0000 7f1a2b17f700 1 -- 172.21.15.42:0/1571177405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a241557a0 con 0x7f1a24150ac0 2023-07-29T02:00:08.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.594+0000 7f1a217fa700 1 -- 172.21.15.42:0/1571177405 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c005400 con 0x7f1a24150ac0 2023-07-29T02:00:08.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.594+0000 7f1a2b17f700 1 -- 172.21.15.42:0/1571177405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a24151480 con 0x7f1a24150ac0 2023-07-29T02:00:08.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.595+0000 7f1a2b17f700 1 -- 172.21.15.42:0/1571177405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a24074740 con 0x7f1a24150ac0 2023-07-29T02:00:08.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.595+0000 7f1a217fa700 1 -- 172.21.15.42:0/1571177405 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f1a1c023020 con 0x7f1a24150ac0 2023-07-29T02:00:08.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.596+0000 7f1a217fa700 1 --2- 172.21.15.42:0/1571177405 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f1a0806a660 0x7f1a0806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:08.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.596+0000 7f1a217fa700 1 -- 172.21.15.42:0/1571177405 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1a1c08a1b0 con 0x7f1a24150ac0 2023-07-29T02:00:08.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.596+0000 7f1a28f1b700 1 --2- 172.21.15.42:0/1571177405 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f1a0806a660 0x7f1a0806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:08.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.597+0000 7f1a28f1b700 1 --2- 172.21.15.42:0/1571177405 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f1a0806a660 0x7f1a0806cb10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1a18009c60 tx=0x7f1a18009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:08.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.600+0000 7f1a217fa700 1 -- 172.21.15.42:0/1571177405 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f1a1c055350 con 0x7f1a24150ac0 2023-07-29T02:00:08.832 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.844+0000 7f1a2b17f700 1 -- 172.21.15.42:0/1571177405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1a241545e0 con 0x7f1a24150ac0 2023-07-29T02:00:08.832 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.844+0000 7f1a217fa700 1 -- 172.21.15.42:0/1571177405 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1a241545e0 con 0x7f1a24150ac0 2023-07-29T02:00:08.832 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-29T02:00:08.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.846+0000 7f1a2b17f700 1 -- 172.21.15.42:0/1571177405 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f1a0806a660 msgr2=0x7f1a0806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:08.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.846+0000 7f1a2b17f700 1 --2- 172.21.15.42:0/1571177405 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f1a0806a660 0x7f1a0806cb10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1a18009c60 tx=0x7f1a18009210 comp rx=0 tx=0).stop 2023-07-29T02:00:08.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.846+0000 7f1a2b17f700 1 -- 172.21.15.42:0/1571177405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a24150ac0 msgr2=0x7f1a24143ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:08.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.846+0000 7f1a2b17f700 1 --2- 172.21.15.42:0/1571177405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a24150ac0 0x7f1a24143ff0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c013000 tx=0x7f1a1c0015b0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.846+0000 7f1a2b17f700 1 -- 172.21.15.42:0/1571177405 shutdown_connections 2023-07-29T02:00:08.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.846+0000 7f1a2b17f700 1 --2- 172.21.15.42:0/1571177405 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f1a0806a660 0x7f1a0806cb10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.846+0000 7f1a2b17f700 1 --2- 172.21.15.42:0/1571177405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a24150ac0 0x7f1a24143ff0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.846+0000 7f1a2b17f700 1 --2- 172.21.15.42:0/1571177405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a14004d90 0x7f1a241530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.846+0000 7f1a2b17f700 1 --2- 172.21.15.42:0/1571177405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a24153b30 0x7f1a241548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:08.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.847+0000 7f1a2b17f700 1 -- 172.21.15.42:0/1571177405 >> 172.21.15.42:0/1571177405 conn(0x7f1a240c8970 msgr2=0x7f1a2414b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:08.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.847+0000 7f1a2b17f700 1 -- 172.21.15.42:0/1571177405 shutdown_connections 2023-07-29T02:00:08.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:08.847+0000 7f1a2b17f700 1 -- 172.21.15.42:0/1571177405 wait complete. 2023-07-29T02:00:08.846 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-29T02:00:08.846 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-29T02:00:08.847 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2023-07-29T02:00:08.847 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-07-29T02:00:08.847 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-29T02:00:08.847 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-29T02:00:08.848 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-29T02:00:08.848 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-29T02:00:08.848 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-07-29T02:00:08.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:08.849 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2023-07-29T02:00:08.866 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-29T02:00:08.866 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-29T02:00:08.866 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2023-07-29T02:00:08.866 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2023-07-29T02:00:08.867 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2023-07-29T02:00:08.867 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2023-07-29T02:00:08.867 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-29T02:00:08.867 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2023-07-29T02:00:08.867 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-29T02:00:08.867 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2023-07-29T02:00:08.867 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-29T02:00:08.868 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2023-07-29T02:00:08.868 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-29T02:00:08.868 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 41942sec preferred_lft 41942sec 2023-07-29T02:00:08.868 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2023-07-29T02:00:08.868 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2023-07-29T02:00:08.868 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-29T02:00:08.869 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2023-07-29T02:00:08.869 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-29T02:00:08.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:08.870 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2023-07-29T02:00:08.870 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2023-07-29T02:00:08.870 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add name ceph-brx type bridge 2023-07-29T02:00:08.871 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr flush dev ceph-brx 2023-07-29T02:00:08.871 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set ceph-brx up 2023-07-29T02:00:08.871 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-29T02:00:08.872 DEBUG:teuthology.orchestra.run.smithi042:> ') 2023-07-29T02:00:09.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:09.050 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-29T02:00:09.078 INFO:teuthology.orchestra.run.smithi042.stdout:1 2023-07-29T02:00:09.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:09.079 DEBUG:teuthology.orchestra.run.smithi042:> route 2023-07-29T02:00:09.148 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2023-07-29T02:00:09.148 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-29T02:00:09.149 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-29T02:00:09.149 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-29T02:00:09.149 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-29T02:00:09.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:09.151 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2023-07-29T02:00:09.151 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2023-07-29T02:00:09.152 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-29T02:00:09.153 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-29T02:00:09.153 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-29T02:00:09.154 DEBUG:teuthology.orchestra.run.smithi042:> ') 2023-07-29T02:00:09.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:09.408 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2023-07-29T02:00:09.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:09.425 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list-id 2023-07-29T02:00:09.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:09.481 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2023-07-29T02:00:09.482 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2023-07-29T02:00:09.482 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-29T02:00:09.483 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-07-29T02:00:09.483 DEBUG:teuthology.orchestra.run.smithi042:> ') 2023-07-29T02:00:09.577 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-07-29T02:00:09.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:09.578 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2023-07-29T02:00:09.579 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2023-07-29T02:00:09.579 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-07-29T02:00:09.579 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-29T02:00:09.580 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-07-29T02:00:09.580 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-07-29T02:00:09.580 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-07-29T02:00:09.581 DEBUG:teuthology.orchestra.run.smithi042:> ') 2023-07-29T02:00:09.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:09.809 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2023-07-29T02:00:09.810 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2023-07-29T02:00:09.810 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2023-07-29T02:00:09.810 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set dev brx.0 master ceph-brx 2023-07-29T02:00:09.811 DEBUG:teuthology.orchestra.run.smithi042:> ') 2023-07-29T02:00:09.918 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-07-29T02:00:09.919 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-29T02:00:09.920 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-07-29T02:00:09.939 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-07-29T02:00:09.940 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-29T02:00:09.940 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-07-29T02:00:09.997 DEBUG:teuthology.orchestra.run.smithi042:> sudo modprobe fuse 2023-07-29T02:00:10.065 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-29T02:00:10.065 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-29T02:00:10.131 INFO:teuthology.orchestra.run.smithi042.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-29T02:00:10.132 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-29T02:00:10.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:10.133 DEBUG:teuthology.orchestra.run.smithi042:> ls /sys/fs/fuse/connections 2023-07-29T02:00:10.189 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-29T02:00:10.190 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-07-29T02:00:10.232 DEBUG:teuthology.orchestra.run.smithi042:> sudo modprobe fuse 2023-07-29T02:00:10.260 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-29T02:00:10.260 DEBUG:teuthology.orchestra.run.smithi042:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-29T02:00:10.327 INFO:teuthology.orchestra.run.smithi042.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-29T02:00:10.328 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-29T02:00:10.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:10.329 DEBUG:teuthology.orchestra.run.smithi042:> ls /sys/fs/fuse/connections 2023-07-29T02:00:10.350 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi042.stderr:2023-07-29T02:00:10.362+0000 7f3954a255c0 -1 init, newargv = 0x55796f695930 newargc=15 2023-07-29T02:00:10.351 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi042.stderr:ceph-fuse[137306]: starting ceph client 2023-07-29T02:00:10.356 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi042.stderr:ceph-fuse[137306]: starting fuse 2023-07-29T02:00:10.368 INFO:teuthology.orchestra.run.smithi042.stdout:47 2023-07-29T02:00:10.368 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-07-29T02:00:10.369 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-29T02:00:10.369 DEBUG:teuthology.orchestra.run.smithi042:> import glob 2023-07-29T02:00:10.370 DEBUG:teuthology.orchestra.run.smithi042:> import re 2023-07-29T02:00:10.370 DEBUG:teuthology.orchestra.run.smithi042:> import os 2023-07-29T02:00:10.370 DEBUG:teuthology.orchestra.run.smithi042:> import subprocess 2023-07-29T02:00:10.371 DEBUG:teuthology.orchestra.run.smithi042:> 2023-07-29T02:00:10.371 DEBUG:teuthology.orchestra.run.smithi042:> def _find_admin_socket(client_name): 2023-07-29T02:00:10.371 DEBUG:teuthology.orchestra.run.smithi042:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-07-29T02:00:10.372 DEBUG:teuthology.orchestra.run.smithi042:> files = glob.glob(asok_path) 2023-07-29T02:00:10.372 DEBUG:teuthology.orchestra.run.smithi042:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-07-29T02:00:10.372 DEBUG:teuthology.orchestra.run.smithi042:> 2023-07-29T02:00:10.373 DEBUG:teuthology.orchestra.run.smithi042:> # Given a non-glob path, it better be there 2023-07-29T02:00:10.373 DEBUG:teuthology.orchestra.run.smithi042:> if "*" not in asok_path: 2023-07-29T02:00:10.373 DEBUG:teuthology.orchestra.run.smithi042:> assert(len(files) == 1) 2023-07-29T02:00:10.374 DEBUG:teuthology.orchestra.run.smithi042:> return files[0] 2023-07-29T02:00:10.374 DEBUG:teuthology.orchestra.run.smithi042:> 2023-07-29T02:00:10.374 DEBUG:teuthology.orchestra.run.smithi042:> for f in files: 2023-07-29T02:00:10.374 DEBUG:teuthology.orchestra.run.smithi042:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-29T02:00:10.375 DEBUG:teuthology.orchestra.run.smithi042:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-29T02:00:10.375 DEBUG:teuthology.orchestra.run.smithi042:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-29T02:00:10.375 DEBUG:teuthology.orchestra.run.smithi042:> contents = proc_f.read() 2023-07-29T02:00:10.376 DEBUG:teuthology.orchestra.run.smithi042:> if mountpoint in contents: 2023-07-29T02:00:10.376 DEBUG:teuthology.orchestra.run.smithi042:> return f 2023-07-29T02:00:10.376 DEBUG:teuthology.orchestra.run.smithi042:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-29T02:00:10.376 DEBUG:teuthology.orchestra.run.smithi042:> 2023-07-29T02:00:10.377 DEBUG:teuthology.orchestra.run.smithi042:> print(_find_admin_socket("client.admin")) 2023-07-29T02:00:10.377 DEBUG:teuthology.orchestra.run.smithi042:> ' 2023-07-29T02:00:10.493 INFO:teuthology.orchestra.run.smithi042.stdout:/var/run/ceph/ceph-client.admin.137306.asok 2023-07-29T02:00:10.675 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.137306.asok 2023-07-29T02:00:10.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:10.676 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.137306.asok status 2023-07-29T02:00:10.837 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2023-07-29T02:00:10.837 INFO:teuthology.orchestra.run.smithi042.stdout: "metadata": { 2023-07-29T02:00:10.837 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_sha1": "0484097b0572e96f42cf6402cbe0ac8dcb046577", 2023-07-29T02:00:10.837 INFO:teuthology.orchestra.run.smithi042.stdout: "ceph_version": "ceph version 18.1.3-11-g0484097b (0484097b0572e96f42cf6402cbe0ac8dcb046577) reef (rc)", 2023-07-29T02:00:10.837 INFO:teuthology.orchestra.run.smithi042.stdout: "entity_id": "admin", 2023-07-29T02:00:10.838 INFO:teuthology.orchestra.run.smithi042.stdout: "hostname": "smithi042", 2023-07-29T02:00:10.838 INFO:teuthology.orchestra.run.smithi042.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-07-29T02:00:10.838 INFO:teuthology.orchestra.run.smithi042.stdout: "pid": "137306", 2023-07-29T02:00:10.838 INFO:teuthology.orchestra.run.smithi042.stdout: "root": "/" 2023-07-29T02:00:10.838 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2023-07-29T02:00:10.838 INFO:teuthology.orchestra.run.smithi042.stdout: "dentry_count": 0, 2023-07-29T02:00:10.838 INFO:teuthology.orchestra.run.smithi042.stdout: "dentry_pinned_count": 0, 2023-07-29T02:00:10.839 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4443, 2023-07-29T02:00:10.839 INFO:teuthology.orchestra.run.smithi042.stdout: "inst": { 2023-07-29T02:00:10.839 INFO:teuthology.orchestra.run.smithi042.stdout: "name": { 2023-07-29T02:00:10.839 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "client", 2023-07-29T02:00:10.839 INFO:teuthology.orchestra.run.smithi042.stdout: "num": 4443 2023-07-29T02:00:10.839 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2023-07-29T02:00:10.839 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": { 2023-07-29T02:00:10.839 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2023-07-29T02:00:10.840 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "192.168.0.1:0", 2023-07-29T02:00:10.840 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2732073233 2023-07-29T02:00:10.840 INFO:teuthology.orchestra.run.smithi042.stdout: } 2023-07-29T02:00:10.840 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2023-07-29T02:00:10.840 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": { 2023-07-29T02:00:10.841 INFO:teuthology.orchestra.run.smithi042.stdout: "type": "v1", 2023-07-29T02:00:10.841 INFO:teuthology.orchestra.run.smithi042.stdout: "addr": "192.168.0.1:0", 2023-07-29T02:00:10.841 INFO:teuthology.orchestra.run.smithi042.stdout: "nonce": 2732073233 2023-07-29T02:00:10.842 INFO:teuthology.orchestra.run.smithi042.stdout: }, 2023-07-29T02:00:10.843 INFO:teuthology.orchestra.run.smithi042.stdout: "inst_str": "client.4443 192.168.0.1:0/2732073233", 2023-07-29T02:00:10.843 INFO:teuthology.orchestra.run.smithi042.stdout: "addr_str": "192.168.0.1:0/2732073233", 2023-07-29T02:00:10.843 INFO:teuthology.orchestra.run.smithi042.stdout: "inode_count": 1, 2023-07-29T02:00:10.843 INFO:teuthology.orchestra.run.smithi042.stdout: "mds_epoch": 6, 2023-07-29T02:00:10.843 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_epoch": 25, 2023-07-29T02:00:10.843 INFO:teuthology.orchestra.run.smithi042.stdout: "osd_epoch_barrier": 0, 2023-07-29T02:00:10.843 INFO:teuthology.orchestra.run.smithi042.stdout: "blocklisted": false, 2023-07-29T02:00:10.844 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs" 2023-07-29T02:00:10.844 INFO:teuthology.orchestra.run.smithi042.stdout:} 2023-07-29T02:00:10.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:10.847 DEBUG:teuthology.orchestra.run.smithi042:> stat --file-system '--printf=%T 2023-07-29T02:00:10.847 DEBUG:teuthology.orchestra.run.smithi042:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-07-29T02:00:10.865 INFO:teuthology.orchestra.run.smithi042.stdout:fuseblk 2023-07-29T02:00:10.865 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-07-29T02:00:10.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:10.865 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-07-29T02:00:10.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:10.933 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-07-29T02:00:11.041 INFO:teuthology.orchestra.run.smithi042.stdout:# file: . 2023-07-29T02:00:11.041 INFO:teuthology.orchestra.run.smithi042.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-07-29T02:00:11.041 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:11.041 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T02:00:11.042 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-29T02:00:11.060 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T02:00:11.225 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.237+0000 7f05b9c26700 1 Processor -- start 2023-07-29T02:00:11.225 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.237+0000 7f05b9c26700 1 -- start start 2023-07-29T02:00:11.227 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.238+0000 7f05b9c26700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05b4151500 0x7f05b406dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.227 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.238+0000 7f05b9c26700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f05b40c7f40 0x7f05b406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.238+0000 7f05b9c26700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f05b406e950 0x7f05b4157490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.238+0000 7f05b9c26700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b40cd140 con 0x7f05b406e950 2023-07-29T02:00:11.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.238+0000 7f05b9c26700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b40c2370 con 0x7f05b40c7f40 2023-07-29T02:00:11.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.238+0000 7f05b9c26700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b4156f90 con 0x7f05b4151500 2023-07-29T02:00:11.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.238+0000 7f05b3fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f05b406e950 0x7f05b4157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.238+0000 7f05b3fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f05b406e950 0x7f05b4157490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55826/0 (socket says 172.21.15.42:55826) 2023-07-29T02:00:11.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.238+0000 7f05b3fff700 1 -- 172.21.15.42:0/3195875831 learned_addr learned my addr 172.21.15.42:0/3195875831 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:11.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.238+0000 7f05b37fe700 1 --2- 172.21.15.42:0/3195875831 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05b4151500 0x7f05b406dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.239+0000 7f05b2ffd700 1 --2- 172.21.15.42:0/3195875831 >> v2:172.21.15.144:3300/0 conn(0x7f05b40c7f40 0x7f05b406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.239+0000 7f05b3fff700 1 -- 172.21.15.42:0/3195875831 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05b4151500 msgr2=0x7f05b406dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:11.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.239+0000 7f05b3fff700 1 --2- 172.21.15.42:0/3195875831 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05b4151500 0x7f05b406dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.239+0000 7f05b3fff700 1 -- 172.21.15.42:0/3195875831 >> v2:172.21.15.144:3300/0 conn(0x7f05b40c7f40 msgr2=0x7f05b406e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:11.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.239+0000 7f05b3fff700 1 --2- 172.21.15.42:0/3195875831 >> v2:172.21.15.144:3300/0 conn(0x7f05b40c7f40 0x7f05b406e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.239+0000 7f05b3fff700 1 -- 172.21.15.42:0/3195875831 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b40cd390 con 0x7f05b406e950 2023-07-29T02:00:11.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.239+0000 7f05b3fff700 1 --2- 172.21.15.42:0/3195875831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b406e950 0x7f05b4157490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f05b40cad10 tx=0x7f05ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5fd884fd840aa6 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:11.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.239+0000 7f05b27fc700 1 -- 172.21.15.42:0/3195875831 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac00e070 con 0x7f05b406e950 2023-07-29T02:00:11.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.239+0000 7f05b27fc700 1 -- 172.21.15.42:0/3195875831 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac00b9c0 con 0x7f05b406e950 2023-07-29T02:00:11.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.239+0000 7f05b27fc700 1 -- 172.21.15.42:0/3195875831 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac00bd70 con 0x7f05b406e950 2023-07-29T02:00:11.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.239+0000 7f05b9c26700 1 -- 172.21.15.42:0/3195875831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b406e950 msgr2=0x7f05b4157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:11.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.239+0000 7f05b9c26700 1 --2- 172.21.15.42:0/3195875831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b406e950 0x7f05b4157490 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f05b40cad10 tx=0x7f05ac00b330 comp rx=0 tx=0).stop 2023-07-29T02:00:11.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.240+0000 7f05b9c26700 1 -- 172.21.15.42:0/3195875831 shutdown_connections 2023-07-29T02:00:11.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.240+0000 7f05b9c26700 1 --2- 172.21.15.42:0/3195875831 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05b4151500 0x7f05b406dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.240+0000 7f05b9c26700 1 --2- 172.21.15.42:0/3195875831 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b406e950 0x7f05b4157490 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.240+0000 7f05b9c26700 1 --2- 172.21.15.42:0/3195875831 >> v2:172.21.15.144:3300/0 conn(0x7f05b40c7f40 0x7f05b406e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.240+0000 7f05b9c26700 1 -- 172.21.15.42:0/3195875831 >> 172.21.15.42:0/3195875831 conn(0x7f05b4061190 msgr2=0x7f05b4061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:11.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.240+0000 7f05b9c26700 1 -- 172.21.15.42:0/3195875831 shutdown_connections 2023-07-29T02:00:11.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.240+0000 7f05b9c26700 1 -- 172.21.15.42:0/3195875831 wait complete. 2023-07-29T02:00:11.233 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.241+0000 7f05b9c26700 1 Processor -- start 2023-07-29T02:00:11.233 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.241+0000 7f05b9c26700 1 -- start start 2023-07-29T02:00:11.233 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.242+0000 7f05b9c26700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05b406e950 0x7f05b41f25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.242+0000 7f05b9c26700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05b40c7f40 0x7f05b41f2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.242+0000 7f05b9c26700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b4151500 0x7f05b41eedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.242+0000 7f05b9c26700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b40c4620 con 0x7f05b4151500 2023-07-29T02:00:11.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.242+0000 7f05b9c26700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b414e230 con 0x7f05b406e950 2023-07-29T02:00:11.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.242+0000 7f05b9c26700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b414d0a0 con 0x7f05b40c7f40 2023-07-29T02:00:11.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.242+0000 7f05b3fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b4151500 0x7f05b41eedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.242+0000 7f05b3fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b4151500 0x7f05b41eedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55832/0 (socket says 172.21.15.42:55832) 2023-07-29T02:00:11.235 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.242+0000 7f05b3fff700 1 -- 172.21.15.42:0/1575718245 learned_addr learned my addr 172.21.15.42:0/1575718245 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:11.235 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.242+0000 7f05b37fe700 1 --2- 172.21.15.42:0/1575718245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05b406e950 0x7f05b41f25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.235 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.242+0000 7f05b2ffd700 1 --2- 172.21.15.42:0/1575718245 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05b40c7f40 0x7f05b41f2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.235 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.242+0000 7f05b3fff700 1 -- 172.21.15.42:0/1575718245 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05b40c7f40 msgr2=0x7f05b41f2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:11.235 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.242+0000 7f05b3fff700 1 --2- 172.21.15.42:0/1575718245 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05b40c7f40 0x7f05b41f2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.235 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.242+0000 7f05b3fff700 1 -- 172.21.15.42:0/1575718245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05b406e950 msgr2=0x7f05b41f25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:11.235 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.242+0000 7f05b3fff700 1 --2- 172.21.15.42:0/1575718245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05b406e950 0x7f05b41f25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.235 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.242+0000 7f05b3fff700 1 -- 172.21.15.42:0/1575718245 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac009b30 con 0x7f05b4151500 2023-07-29T02:00:11.236 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.242+0000 7f05b3fff700 1 --2- 172.21.15.42:0/1575718245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b4151500 0x7f05b41eedf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f05b40cad90 tx=0x7f05ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:11.236 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.242+0000 7f05abfff700 1 -- 172.21.15.42:0/1575718245 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac0099b0 con 0x7f05b4151500 2023-07-29T02:00:11.236 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.243+0000 7f05abfff700 1 -- 172.21.15.42:0/1575718245 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac004250 con 0x7f05b4151500 2023-07-29T02:00:11.236 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.243+0000 7f05b9c26700 1 -- 172.21.15.42:0/1575718245 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b414d340 con 0x7f05b4151500 2023-07-29T02:00:11.236 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.243+0000 7f05abfff700 1 -- 172.21.15.42:0/1575718245 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac0045e0 con 0x7f05b4151500 2023-07-29T02:00:11.236 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.243+0000 7f05b9c26700 1 -- 172.21.15.42:0/1575718245 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b414d900 con 0x7f05b4151500 2023-07-29T02:00:11.236 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.243+0000 7f05b9c26700 1 -- 172.21.15.42:0/1575718245 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b414e3e0 con 0x7f05b4151500 2023-07-29T02:00:11.237 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.244+0000 7f05abfff700 1 -- 172.21.15.42:0/1575718245 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f05ac004740 con 0x7f05b4151500 2023-07-29T02:00:11.237 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.244+0000 7f05abfff700 1 --2- 172.21.15.42:0/1575718245 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f059406a660 0x7f059406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.237 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.244+0000 7f05abfff700 1 -- 172.21.15.42:0/1575718245 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f05ac089da0 con 0x7f05b4151500 2023-07-29T02:00:11.237 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.245+0000 7f05b37fe700 1 --2- 172.21.15.42:0/1575718245 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f059406a660 0x7f059406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.237 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.245+0000 7f05b37fe700 1 --2- 172.21.15.42:0/1575718245 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f059406a660 0x7f059406cb10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f05a4006b20 tx=0x7f05a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:11.237 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.249+0000 7f05abfff700 1 -- 172.21.15.42:0/1575718245 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f05ac054e20 con 0x7f05b4151500 2023-07-29T02:00:11.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.450+0000 7f05b9c26700 1 -- 172.21.15.42:0/1575718245 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05b40cd920 con 0x7f05b4151500 2023-07-29T02:00:11.439 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.452+0000 7f05abfff700 1 -- 172.21.15.42:0/1575718245 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19690 (secure 0 0 0) 0x7f05ac01f070 con 0x7f05b4151500 2023-07-29T02:00:11.440 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:11.440 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T02:00:02.394460+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T01:59:55.827461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T01:59:56.924040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-29T01:59:59.996470+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T02:00:11.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.454+0000 7f05b9c26700 1 -- 172.21.15.42:0/1575718245 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f059406a660 msgr2=0x7f059406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:11.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.454+0000 7f05b9c26700 1 --2- 172.21.15.42:0/1575718245 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f059406a660 0x7f059406cb10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f05a4006b20 tx=0x7f05a4008040 comp rx=0 tx=0).stop 2023-07-29T02:00:11.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.454+0000 7f05b9c26700 1 -- 172.21.15.42:0/1575718245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b4151500 msgr2=0x7f05b41eedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:11.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.454+0000 7f05b9c26700 1 --2- 172.21.15.42:0/1575718245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b4151500 0x7f05b41eedf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f05b40cad90 tx=0x7f05ac004ad0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.454+0000 7f05b9c26700 1 -- 172.21.15.42:0/1575718245 shutdown_connections 2023-07-29T02:00:11.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.454+0000 7f05b9c26700 1 --2- 172.21.15.42:0/1575718245 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f059406a660 0x7f059406cb10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.443 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.454+0000 7f05b9c26700 1 --2- 172.21.15.42:0/1575718245 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f05b4151500 0x7f05b41eedf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.443 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.454+0000 7f05b9c26700 1 --2- 172.21.15.42:0/1575718245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05b406e950 0x7f05b41f25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.443 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.454+0000 7f05b9c26700 1 --2- 172.21.15.42:0/1575718245 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f05b40c7f40 0x7f05b41f2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.443 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.454+0000 7f05b9c26700 1 -- 172.21.15.42:0/1575718245 >> 172.21.15.42:0/1575718245 conn(0x7f05b4061190 msgr2=0x7f05b40c3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:11.443 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.454+0000 7f05b9c26700 1 -- 172.21.15.42:0/1575718245 shutdown_connections 2023-07-29T02:00:11.443 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.454+0000 7f05b9c26700 1 -- 172.21.15.42:0/1575718245 wait complete. 2023-07-29T02:00:11.454 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-29T01:59:50.906228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-29T01:59:51.290583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T01:59:55.827461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T01:59:56.924040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-29T01:59:59.996470+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-29T02:00:11.454 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-29T02:00:11.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.595+0000 7fc400a6c700 1 Processor -- start 2023-07-29T02:00:11.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.595+0000 7fc400a6c700 1 -- start start 2023-07-29T02:00:11.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc400a6c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc3fc0c8580 0x7fc3fc06f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc400a6c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3fc071840 0x7fc3fc06a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc400a6c700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3fc06c870 con 0x7fc3fc1531a0 2023-07-29T02:00:11.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc400a6c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3fc0c74a0 con 0x7fc3fc0c8580 2023-07-29T02:00:11.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc400a6c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc06fa50 con 0x7fc3fc071840 2023-07-29T02:00:11.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc3fa59c700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc3fc1531a0 0x7fc3fc15c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49644/0 (socket says 172.21.15.42:49644) 2023-07-29T02:00:11.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc3fa59c700 1 -- 172.21.15.42:0/3661587057 learned_addr learned my addr 172.21.15.42:0/3661587057 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:11.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc3fad9d700 1 --2- 172.21.15.42:0/3661587057 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3fc071840 0x7fc3fc06a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc3f9d9b700 1 --2- 172.21.15.42:0/3661587057 >> v2:172.21.15.144:3300/0 conn(0x7fc3fc0c8580 0x7fc3fc06f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc3f959a700 1 -- 172.21.15.42:0/3661587057 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559977228 0 0) 0x7fc3fc06c870 con 0x7fc3fc1531a0 2023-07-29T02:00:11.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc3f959a700 1 -- 172.21.15.42:0/3661587057 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3e40035b0 con 0x7fc3fc1531a0 2023-07-29T02:00:11.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc3f959a700 1 -- 172.21.15.42:0/3661587057 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3901466806 0 0) 0x7fc3e40035b0 con 0x7fc3fc1531a0 2023-07-29T02:00:11.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc3f959a700 1 -- 172.21.15.42:0/3661587057 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3fc071840 msgr2=0x7fc3fc06a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:11.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc3f959a700 1 --2- 172.21.15.42:0/3661587057 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3fc071840 0x7fc3fc06a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc3f959a700 1 -- 172.21.15.42:0/3661587057 >> v2:172.21.15.144:3300/0 conn(0x7fc3fc0c8580 msgr2=0x7fc3fc06f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:11.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc3f959a700 1 --2- 172.21.15.42:0/3661587057 >> v2:172.21.15.144:3300/0 conn(0x7fc3fc0c8580 0x7fc3fc06f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc3f959a700 1 -- 172.21.15.42:0/3661587057 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc06d450 con 0x7fc3fc1531a0 2023-07-29T02:00:11.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc3fad9d700 1 --2- 172.21.15.42:0/3661587057 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3fc071840 0x7fc3fc06a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:00:11.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc3f959a700 1 -- 172.21.15.42:0/3661587057 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7fc3ec001670 con 0x7fc3fc1531a0 2023-07-29T02:00:11.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc3f959a700 1 -- 172.21.15.42:0/3661587057 >> v1:172.21.15.42:6789/0 conn(0x7fc3fc1531a0 legacy=0x7fc3fc15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:11.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc3f959a700 1 --2- 172.21.15.42:0/3661587057 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3fc071840 0x7fc3e4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.596+0000 7fc3f959a700 1 --2- 172.21.15.42:0/3661587057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3e4003f40 0x7fc3e4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.597+0000 7fc3f959a700 1 --2- 172.21.15.42:0/3661587057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3e4004d90 0x7fc3e4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.597+0000 7fc3f959a700 1 -- 172.21.15.42:0/3661587057 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc06fa50 con 0x7fc3e4003f40 2023-07-29T02:00:11.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.597+0000 7fc3f959a700 1 -- 172.21.15.42:0/3661587057 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40046c0 con 0x7fc3e4004d90 2023-07-29T02:00:11.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.597+0000 7fc3f959a700 1 -- 172.21.15.42:0/3661587057 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e400ba90 con 0x7fc3fc071840 2023-07-29T02:00:11.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.597+0000 7fc3f9d9b700 1 --2- 172.21.15.42:0/3661587057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3e4003f40 0x7fc3e4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.597+0000 7fc3fa59c700 1 --2- 172.21.15.42:0/3661587057 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3fc071840 0x7fc3e4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.597+0000 7fc3f9d9b700 1 -- 172.21.15.42:0/3661587057 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3fc071840 msgr2=0x7fc3e4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:11.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.597+0000 7fc3f9d9b700 1 --2- 172.21.15.42:0/3661587057 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3fc071840 0x7fc3e4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.597+0000 7fc3f9d9b700 1 -- 172.21.15.42:0/3661587057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3e4004d90 msgr2=0x7fc3e4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:11.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.597+0000 7fc3f9d9b700 1 --2- 172.21.15.42:0/3661587057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3e4004d90 0x7fc3e4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.597+0000 7fc3f9d9b700 1 -- 172.21.15.42:0/3661587057 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f4009a70 con 0x7fc3e4003f40 2023-07-29T02:00:11.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.597+0000 7fc3f9d9b700 1 --2- 172.21.15.42:0/3661587057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3e4003f40 0x7fc3e4004850 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0009b60 tx=0x7fc3e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bffccd1cdc0bf381 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:11.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.597+0000 7fc3f959a700 1 -- 172.21.15.42:0/3661587057 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f000e6c0 con 0x7fc3e4003f40 2023-07-29T02:00:11.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.597+0000 7fc3f959a700 1 -- 172.21.15.42:0/3661587057 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f000e820 con 0x7fc3e4003f40 2023-07-29T02:00:11.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.597+0000 7fc3f959a700 1 -- 172.21.15.42:0/3661587057 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f000eb90 con 0x7fc3e4003f40 2023-07-29T02:00:11.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.598+0000 7fc400a6c700 1 -- 172.21.15.42:0/3661587057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3e4003f40 msgr2=0x7fc3e4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:11.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.598+0000 7fc400a6c700 1 --2- 172.21.15.42:0/3661587057 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3e4003f40 0x7fc3e4004850 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0009b60 tx=0x7fc3e4005880 comp rx=0 tx=0).stop 2023-07-29T02:00:11.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.598+0000 7fc3fad9d700 1 -- 172.21.15.42:0/3661587057 reap_dead start 2023-07-29T02:00:11.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.598+0000 7fc400a6c700 1 -- 172.21.15.42:0/3661587057 shutdown_connections 2023-07-29T02:00:11.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.598+0000 7fc400a6c700 1 -- 172.21.15.42:0/3661587057 >> 172.21.15.42:0/3661587057 conn(0x7fc3fc0cbf10 msgr2=0x7fc3fc0cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:11.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.598+0000 7fc400a6c700 1 -- 172.21.15.42:0/3661587057 shutdown_connections 2023-07-29T02:00:11.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.598+0000 7fc400a6c700 1 -- 172.21.15.42:0/3661587057 wait complete. 2023-07-29T02:00:11.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.599+0000 7fc400a6c700 1 Processor -- start 2023-07-29T02:00:11.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.599+0000 7fc400a6c700 1 -- start start 2023-07-29T02:00:11.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.600+0000 7fc400a6c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3e4003f40 0x7fc3fc1e4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.600+0000 7fc400a6c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3fc1e5200 0x7fc3fc1e5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.600+0000 7fc400a6c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3fc1e3da0 0x7fc3fc1488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.600+0000 7fc400a6c700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc151330 con 0x7fc3e4003f40 2023-07-29T02:00:11.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.600+0000 7fc400a6c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc1e3980 con 0x7fc3fc1e3da0 2023-07-29T02:00:11.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.600+0000 7fc400a6c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3fc150e20 con 0x7fc3fc1e5200 2023-07-29T02:00:11.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.600+0000 7fc3fa59c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3e4003f40 0x7fc3fc1e4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.600+0000 7fc3fa59c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3e4003f40 0x7fc3fc1e4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55848/0 (socket says 172.21.15.42:55848) 2023-07-29T02:00:11.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.600+0000 7fc3fa59c700 1 -- 172.21.15.42:0/1514924237 learned_addr learned my addr 172.21.15.42:0/1514924237 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:11.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.600+0000 7fc3f9d9b700 1 --2- 172.21.15.42:0/1514924237 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3fc1e5200 0x7fc3fc1e5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.600+0000 7fc3fad9d700 1 --2- 172.21.15.42:0/1514924237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3fc1e3da0 0x7fc3fc1488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.600+0000 7fc3fa59c700 1 -- 172.21.15.42:0/1514924237 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3fc1e5200 msgr2=0x7fc3fc1e5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:11.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.600+0000 7fc3fa59c700 1 --2- 172.21.15.42:0/1514924237 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3fc1e5200 0x7fc3fc1e5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.600+0000 7fc3fa59c700 1 -- 172.21.15.42:0/1514924237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3fc1e3da0 msgr2=0x7fc3fc1488b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:11.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.600+0000 7fc3fa59c700 1 --2- 172.21.15.42:0/1514924237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3fc1e3da0 0x7fc3fc1488b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.600+0000 7fc3fa59c700 1 -- 172.21.15.42:0/1514924237 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc1e35e0 con 0x7fc3e4003f40 2023-07-29T02:00:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.600+0000 7fc3fa59c700 1 --2- 172.21.15.42:0/1514924237 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3e4003f40 0x7fc3fc1e4800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0073a0 tx=0x7fc3ec0076b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.601+0000 7fc3eaffd700 1 -- 172.21.15.42:0/1514924237 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec00f6c0 con 0x7fc3e4003f40 2023-07-29T02:00:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.601+0000 7fc3eaffd700 1 -- 172.21.15.42:0/1514924237 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ec00f820 con 0x7fc3e4003f40 2023-07-29T02:00:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.601+0000 7fc400a6c700 1 -- 172.21.15.42:0/1514924237 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3fc151050 con 0x7fc3e4003f40 2023-07-29T02:00:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.601+0000 7fc3eaffd700 1 -- 172.21.15.42:0/1514924237 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec00fbd0 con 0x7fc3e4003f40 2023-07-29T02:00:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.601+0000 7fc400a6c700 1 -- 172.21.15.42:0/1514924237 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3fc1ef9c0 con 0x7fc3e4003f40 2023-07-29T02:00:11.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.602+0000 7fc400a6c700 1 -- 172.21.15.42:0/1514924237 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3fc0c68e0 con 0x7fc3e4003f40 2023-07-29T02:00:11.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.602+0000 7fc3eaffd700 1 -- 172.21.15.42:0/1514924237 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fc3ec00fd30 con 0x7fc3e4003f40 2023-07-29T02:00:11.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.602+0000 7fc3eaffd700 1 --2- 172.21.15.42:0/1514924237 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc3dc06a660 0x7fc3dc06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.603+0000 7fc3eaffd700 1 -- 172.21.15.42:0/1514924237 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc3ec088720 con 0x7fc3e4003f40 2023-07-29T02:00:11.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.603+0000 7fc3f9d9b700 1 --2- 172.21.15.42:0/1514924237 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc3dc06a660 0x7fc3dc06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.603+0000 7fc3f9d9b700 1 --2- 172.21.15.42:0/1514924237 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc3dc06a660 0x7fc3dc06cb10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00090b0 tx=0x7fc3f0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:11.598 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.607+0000 7fc3eaffd700 1 -- 172.21.15.42:0/1514924237 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fc3ec0538c0 con 0x7fc3e4003f40 2023-07-29T02:00:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.805+0000 7fc400a6c700 1 -- 172.21.15.42:0/1514924237 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc3fc06ca90 con 0x7fc3e4003f40 2023-07-29T02:00:11.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.805+0000 7fc3eaffd700 1 -- 172.21.15.42:0/1514924237 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc3ec056ee0 con 0x7fc3e4003f40 2023-07-29T02:00:11.794 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 8 2023-07-29T02:00:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.808+0000 7fc400a6c700 1 -- 172.21.15.42:0/1514924237 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc3dc06a660 msgr2=0x7fc3dc06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.808+0000 7fc400a6c700 1 --2- 172.21.15.42:0/1514924237 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc3dc06a660 0x7fc3dc06cb10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00090b0 tx=0x7fc3f0008030 comp rx=0 tx=0).stop 2023-07-29T02:00:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.808+0000 7fc400a6c700 1 -- 172.21.15.42:0/1514924237 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3e4003f40 msgr2=0x7fc3fc1e4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.808+0000 7fc400a6c700 1 --2- 172.21.15.42:0/1514924237 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3e4003f40 0x7fc3fc1e4800 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec0073a0 tx=0x7fc3ec0076b0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.808+0000 7fc400a6c700 1 -- 172.21.15.42:0/1514924237 shutdown_connections 2023-07-29T02:00:11.796 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.808+0000 7fc400a6c700 1 --2- 172.21.15.42:0/1514924237 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc3dc06a660 0x7fc3dc06cb10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.808+0000 7fc400a6c700 1 --2- 172.21.15.42:0/1514924237 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3fc1e3da0 0x7fc3fc1488b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.808+0000 7fc400a6c700 1 --2- 172.21.15.42:0/1514924237 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3e4003f40 0x7fc3fc1e4800 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.808+0000 7fc400a6c700 1 --2- 172.21.15.42:0/1514924237 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3fc1e5200 0x7fc3fc1e5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.808+0000 7fc400a6c700 1 -- 172.21.15.42:0/1514924237 >> 172.21.15.42:0/1514924237 conn(0x7fc3fc0cbf10 msgr2=0x7fc3fc151700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.808+0000 7fc400a6c700 1 -- 172.21.15.42:0/1514924237 shutdown_connections 2023-07-29T02:00:11.797 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.808+0000 7fc400a6c700 1 -- 172.21.15.42:0/1514924237 wait complete. 2023-07-29T02:00:11.808 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-29T02:00:11.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.948+0000 7fb2028a2700 1 Processor -- start 2023-07-29T02:00:11.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.948+0000 7fb2028a2700 1 -- start start 2023-07-29T02:00:11.944 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb2028a2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb1fc14fff0 0x7fb1fc070b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.944 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb2028a2700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1fc0c91b0 con 0x7fb1fc14fc20 2023-07-29T02:00:11.944 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb2028a2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1fc1592f0 con 0x7fb1fc06b860 2023-07-29T02:00:11.944 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb2028a2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1fc1595d0 con 0x7fb1fc14fff0 2023-07-29T02:00:11.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb1fbfff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb1fc14fc20 0x7fb1fc0c8920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49660/0 (socket says 172.21.15.42:49660) 2023-07-29T02:00:11.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb1fbfff700 1 -- 172.21.15.42:0/1884027976 learned_addr learned my addr 172.21.15.42:0/1884027976 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:11.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb1fb7fe700 1 --2- 172.21.15.42:0/1884027976 >> v2:172.21.15.144:3300/0 conn(0x7fb1fc14fff0 0x7fb1fc070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb1faffd700 1 -- 172.21.15.42:0/1884027976 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691245333 0 0) 0x7fb1fc0c91b0 con 0x7fb1fc14fc20 2023-07-29T02:00:11.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb1faffd700 1 -- 172.21.15.42:0/1884027976 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1e40035b0 con 0x7fb1fc14fc20 2023-07-29T02:00:11.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb1faffd700 1 -- 172.21.15.42:0/1884027976 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 227486021 0 0) 0x7fb1e40035b0 con 0x7fb1fc14fc20 2023-07-29T02:00:11.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb1faffd700 1 -- 172.21.15.42:0/1884027976 >> v2:172.21.15.144:3300/0 conn(0x7fb1fc14fff0 msgr2=0x7fb1fc070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb1faffd700 1 --2- 172.21.15.42:0/1884027976 >> v2:172.21.15.144:3300/0 conn(0x7fb1fc14fff0 0x7fb1fc070b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb1faffd700 1 -- 172.21.15.42:0/1884027976 >> v1:172.21.15.144:6789/0 conn(0x7fb1fc06b860 legacy=0x7fb1fc155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb1faffd700 1 -- 172.21.15.42:0/1884027976 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc1598b0 con 0x7fb1fc14fc20 2023-07-29T02:00:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb1faffd700 1 -- 172.21.15.42:0/1884027976 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7fb1ec001670 con 0x7fb1fc14fc20 2023-07-29T02:00:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb1faffd700 1 -- 172.21.15.42:0/1884027976 >> v1:172.21.15.42:6789/0 conn(0x7fb1fc14fc20 legacy=0x7fb1fc0c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb1faffd700 1 --2- 172.21.15.42:0/1884027976 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1e4003a30 0x7fb1e4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb1faffd700 1 --2- 172.21.15.42:0/1884027976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1e4004850 0x7fb1e4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb1faffd700 1 --2- 172.21.15.42:0/1884027976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e4005200 0x7fb1e400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb1faffd700 1 -- 172.21.15.42:0/1884027976 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc1595d0 con 0x7fb1e4004850 2023-07-29T02:00:11.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb1faffd700 1 -- 172.21.15.42:0/1884027976 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e400c0e0 con 0x7fb1e4005200 2023-07-29T02:00:11.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.949+0000 7fb1faffd700 1 -- 172.21.15.42:0/1884027976 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e400c270 con 0x7fb1e4003a30 2023-07-29T02:00:11.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.950+0000 7fb1fb7fe700 1 --2- 172.21.15.42:0/1884027976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1e4004850 0x7fb1e4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.950+0000 7fb1fbfff700 1 --2- 172.21.15.42:0/1884027976 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1e4003a30 0x7fb1e4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.950+0000 7fb200e3f700 1 --2- 172.21.15.42:0/1884027976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e4005200 0x7fb1e400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.950+0000 7fb1fb7fe700 1 -- 172.21.15.42:0/1884027976 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1e4003a30 msgr2=0x7fb1e4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:11.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.950+0000 7fb1fb7fe700 1 --2- 172.21.15.42:0/1884027976 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1e4003a30 0x7fb1e4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.950+0000 7fb1fb7fe700 1 -- 172.21.15.42:0/1884027976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e4005200 msgr2=0x7fb1e400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:11.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.950+0000 7fb1fb7fe700 1 --2- 172.21.15.42:0/1884027976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e4005200 0x7fb1e400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.950+0000 7fb1fb7fe700 1 -- 172.21.15.42:0/1884027976 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e40035b0 con 0x7fb1e4004850 2023-07-29T02:00:11.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.950+0000 7fb200e3f700 1 --2- 172.21.15.42:0/1884027976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1e4005200 0x7fb1e400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:11.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.950+0000 7fb200e3f700 1 -- 172.21.15.42:0/1884027976 reap_dead start 2023-07-29T02:00:11.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.950+0000 7fb1fb7fe700 1 --2- 172.21.15.42:0/1884027976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1e4004850 0x7fb1e4004cc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009b30 tx=0x7fb1e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b74d857baa84c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:11.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.950+0000 7fb1faffd700 1 -- 172.21.15.42:0/1884027976 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f000e6c0 con 0x7fb1e4004850 2023-07-29T02:00:11.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.950+0000 7fb1faffd700 1 -- 172.21.15.42:0/1884027976 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f000e820 con 0x7fb1e4004850 2023-07-29T02:00:11.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.950+0000 7fb1faffd700 1 -- 172.21.15.42:0/1884027976 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f000eb90 con 0x7fb1e4004850 2023-07-29T02:00:11.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.951+0000 7fb2028a2700 1 -- 172.21.15.42:0/1884027976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1e4004850 msgr2=0x7fb1e4004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:11.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.951+0000 7fb2028a2700 1 --2- 172.21.15.42:0/1884027976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1e4004850 0x7fb1e4004cc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009b30 tx=0x7fb1e4005880 comp rx=0 tx=0).stop 2023-07-29T02:00:11.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.951+0000 7fb2028a2700 1 -- 172.21.15.42:0/1884027976 shutdown_connections 2023-07-29T02:00:11.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.951+0000 7fb2028a2700 1 --2- 172.21.15.42:0/1884027976 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1e4004850 0x7fb1e4004cc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.951+0000 7fb2028a2700 1 -- 172.21.15.42:0/1884027976 >> 172.21.15.42:0/1884027976 conn(0x7fb1fc0cc420 msgr2=0x7fb1fc0c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:11.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.951+0000 7fb2028a2700 1 -- 172.21.15.42:0/1884027976 shutdown_connections 2023-07-29T02:00:11.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.951+0000 7fb2028a2700 1 -- 172.21.15.42:0/1884027976 wait complete. 2023-07-29T02:00:11.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.952+0000 7fb2028a2700 1 Processor -- start 2023-07-29T02:00:11.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.952+0000 7fb2028a2700 1 -- start start 2023-07-29T02:00:11.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb2028a2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1e4004850 0x7fb1fc06b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb2028a2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1fc1e21b0 0x7fb1fc14b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb2028a2700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1fc1eeb10 0x7fb1fc06e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb2028a2700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc06b670 con 0x7fb1fc1eeb10 2023-07-29T02:00:11.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb2028a2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0cb100 con 0x7fb1fc1e21b0 2023-07-29T02:00:11.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb2028a2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0cb3e0 con 0x7fb1e4004850 2023-07-29T02:00:11.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb200e3f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1fc1eeb10 0x7fb1fc06e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb200e3f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1fc1eeb10 0x7fb1fc06e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55870/0 (socket says 172.21.15.42:55870) 2023-07-29T02:00:11.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb200e3f700 1 -- 172.21.15.42:0/2831941852 learned_addr learned my addr 172.21.15.42:0/2831941852 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:11.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb1fbfff700 1 --2- 172.21.15.42:0/2831941852 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1e4004850 0x7fb1fc06b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb1fb7fe700 1 --2- 172.21.15.42:0/2831941852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1fc1e21b0 0x7fb1fc14b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb200e3f700 1 -- 172.21.15.42:0/2831941852 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1e4004850 msgr2=0x7fb1fc06b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:11.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb200e3f700 1 --2- 172.21.15.42:0/2831941852 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1e4004850 0x7fb1fc06b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb200e3f700 1 -- 172.21.15.42:0/2831941852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1fc1e21b0 msgr2=0x7fb1fc14b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:11.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb200e3f700 1 --2- 172.21.15.42:0/2831941852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1fc1e21b0 0x7fb1fc14b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:11.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb200e3f700 1 -- 172.21.15.42:0/2831941852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc1f2080 con 0x7fb1fc1eeb10 2023-07-29T02:00:11.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb200e3f700 1 --2- 172.21.15.42:0/2831941852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1fc1eeb10 0x7fb1fc06e070 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0c5830 tx=0x7fb1f400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:11.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb1f8ff9700 1 -- 172.21.15.42:0/2831941852 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f400eee0 con 0x7fb1fc1eeb10 2023-07-29T02:00:11.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb1f8ff9700 1 -- 172.21.15.42:0/2831941852 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f4003c10 con 0x7fb1fc1eeb10 2023-07-29T02:00:11.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb1f8ff9700 1 -- 172.21.15.42:0/2831941852 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f40050d0 con 0x7fb1fc1eeb10 2023-07-29T02:00:11.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.953+0000 7fb2028a2700 1 -- 172.21.15.42:0/2831941852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1fc1f2360 con 0x7fb1fc1eeb10 2023-07-29T02:00:11.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.954+0000 7fb2028a2700 1 -- 172.21.15.42:0/2831941852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1fc1f2920 con 0x7fb1fc1eeb10 2023-07-29T02:00:11.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.954+0000 7fb2028a2700 1 -- 172.21.15.42:0/2831941852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1fc06c070 con 0x7fb1fc1eeb10 2023-07-29T02:00:11.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.955+0000 7fb1f8ff9700 1 -- 172.21.15.42:0/2831941852 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fb1f4005230 con 0x7fb1fc1eeb10 2023-07-29T02:00:11.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.955+0000 7fb1f8ff9700 1 --2- 172.21.15.42:0/2831941852 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb1e806a690 0x7fb1e806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:11.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.955+0000 7fb1f8ff9700 1 -- 172.21.15.42:0/2831941852 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb1f4088d10 con 0x7fb1fc1eeb10 2023-07-29T02:00:11.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.955+0000 7fb1fbfff700 1 --2- 172.21.15.42:0/2831941852 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb1e806a690 0x7fb1e806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:11.954 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.956+0000 7fb1fbfff700 1 --2- 172.21.15.42:0/2831941852 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb1e806a690 0x7fb1e806cb40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec001050 tx=0x7fb1ec000f80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:11.954 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:11.960+0000 7fb1f8ff9700 1 -- 172.21.15.42:0/2831941852 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fb1f4057810 con 0x7fb1fc1eeb10 2023-07-29T02:00:12.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.157+0000 7fb2028a2700 1 -- 172.21.15.42:0/2831941852 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb1fc04ea50 con 0x7fb1fc1eeb10 2023-07-29T02:00:12.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.157+0000 7fb1f8ff9700 1 -- 172.21.15.42:0/2831941852 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb1f4088030 con 0x7fb1fc1eeb10 2023-07-29T02:00:12.145 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2023-07-29T02:00:12.147 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.159+0000 7fb2028a2700 1 -- 172.21.15.42:0/2831941852 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb1e806a690 msgr2=0x7fb1e806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:12.147 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.159+0000 7fb2028a2700 1 --2- 172.21.15.42:0/2831941852 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb1e806a690 0x7fb1e806cb40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec001050 tx=0x7fb1ec000f80 comp rx=0 tx=0).stop 2023-07-29T02:00:12.147 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.159+0000 7fb2028a2700 1 -- 172.21.15.42:0/2831941852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1fc1eeb10 msgr2=0x7fb1fc06e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:12.147 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.159+0000 7fb2028a2700 1 --2- 172.21.15.42:0/2831941852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1fc1eeb10 0x7fb1fc06e070 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc0c5830 tx=0x7fb1f400ed50 comp rx=0 tx=0).stop 2023-07-29T02:00:12.147 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.159+0000 7fb2028a2700 1 -- 172.21.15.42:0/2831941852 shutdown_connections 2023-07-29T02:00:12.148 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.159+0000 7fb2028a2700 1 --2- 172.21.15.42:0/2831941852 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb1e806a690 0x7fb1e806cb40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.148 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.159+0000 7fb2028a2700 1 --2- 172.21.15.42:0/2831941852 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb1fc1eeb10 0x7fb1fc06e070 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.148 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.159+0000 7fb2028a2700 1 --2- 172.21.15.42:0/2831941852 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb1e4004850 0x7fb1fc06b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.148 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.159+0000 7fb2028a2700 1 --2- 172.21.15.42:0/2831941852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1fc1e21b0 0x7fb1fc14b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.148 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.159+0000 7fb2028a2700 1 -- 172.21.15.42:0/2831941852 >> 172.21.15.42:0/2831941852 conn(0x7fb1fc0cc420 msgr2=0x7fb1fc0c8960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:12.148 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.159+0000 7fb2028a2700 1 -- 172.21.15.42:0/2831941852 shutdown_connections 2023-07-29T02:00:12.148 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.159+0000 7fb2028a2700 1 -- 172.21.15.42:0/2831941852 wait complete. 2023-07-29T02:00:12.159 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-29T02:00:12.287 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.299+0000 7fcf02333700 1 Processor -- start 2023-07-29T02:00:12.287 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.299+0000 7fcf02333700 1 -- start start 2023-07-29T02:00:12.288 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.300+0000 7fcf02333700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcefc1531a0 0x7fcefc06f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:12.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.300+0000 7fcf02333700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcefc0c8580 0x7fcefc15c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:12.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.300+0000 7fcf02333700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcefc06c870 con 0x7fcefc071840 2023-07-29T02:00:12.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.300+0000 7fcf02333700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcefc0c74a0 con 0x7fcefc1531a0 2023-07-29T02:00:12.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.300+0000 7fcf02333700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcefc06fa50 con 0x7fcefc0c8580 2023-07-29T02:00:12.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.300+0000 7fcefbfff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcefc1531a0 0x7fcefc06f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:12.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.300+0000 7fcefbfff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcefc1531a0 0x7fcefc06f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55874/0 (socket says 172.21.15.42:55874) 2023-07-29T02:00:12.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.300+0000 7fcefbfff700 1 -- 172.21.15.42:0/3257312914 learned_addr learned my addr 172.21.15.42:0/3257312914 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.300+0000 7fcefb7fe700 1 --2- 172.21.15.42:0/3257312914 >> v2:172.21.15.144:3300/0 conn(0x7fcefc0c8580 0x7fcefc15c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.300+0000 7fcefbfff700 1 -- 172.21.15.42:0/3257312914 >> v2:172.21.15.144:3300/0 conn(0x7fcefc0c8580 msgr2=0x7fcefc15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.300+0000 7fcefbfff700 1 --2- 172.21.15.42:0/3257312914 >> v2:172.21.15.144:3300/0 conn(0x7fcefc0c8580 0x7fcefc15c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.300+0000 7fcefbfff700 1 -- 172.21.15.42:0/3257312914 >> v1:172.21.15.144:6789/0 conn(0x7fcefc071840 legacy=0x7fcefc06a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.300+0000 7fcefbfff700 1 -- 172.21.15.42:0/3257312914 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc15ca00 con 0x7fcefc1531a0 2023-07-29T02:00:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.301+0000 7fcefbfff700 1 --2- 172.21.15.42:0/3257312914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcefc1531a0 0x7fcefc06f510 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcefc0707c0 tx=0x7fcee4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b20f1d22344995a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.301+0000 7fcefaffd700 1 -- 172.21.15.42:0/3257312914 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4011830 con 0x7fcefc1531a0 2023-07-29T02:00:12.290 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.301+0000 7fcefaffd700 1 -- 172.21.15.42:0/3257312914 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee4011990 con 0x7fcefc1531a0 2023-07-29T02:00:12.291 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.301+0000 7fcefaffd700 1 -- 172.21.15.42:0/3257312914 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4011d20 con 0x7fcefc1531a0 2023-07-29T02:00:12.293 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.301+0000 7fcf02333700 1 -- 172.21.15.42:0/3257312914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcefc1531a0 msgr2=0x7fcefc06f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:12.293 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.301+0000 7fcf02333700 1 --2- 172.21.15.42:0/3257312914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcefc1531a0 0x7fcefc06f510 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcefc0707c0 tx=0x7fcee4009bd0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.293 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.301+0000 7fcf02333700 1 -- 172.21.15.42:0/3257312914 shutdown_connections 2023-07-29T02:00:12.293 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.301+0000 7fcf02333700 1 --2- 172.21.15.42:0/3257312914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcefc1531a0 0x7fcefc06f510 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.293 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.301+0000 7fcf02333700 1 --2- 172.21.15.42:0/3257312914 >> v2:172.21.15.144:3300/0 conn(0x7fcefc0c8580 0x7fcefc15c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.294 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.301+0000 7fcf02333700 1 -- 172.21.15.42:0/3257312914 >> 172.21.15.42:0/3257312914 conn(0x7fcefc0cbf10 msgr2=0x7fcefc0cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:12.294 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.301+0000 7fcf02333700 1 -- 172.21.15.42:0/3257312914 shutdown_connections 2023-07-29T02:00:12.294 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.301+0000 7fcf02333700 1 -- 172.21.15.42:0/3257312914 wait complete. 2023-07-29T02:00:12.294 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.302+0000 7fcf02333700 1 Processor -- start 2023-07-29T02:00:12.294 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.303+0000 7fcf02333700 1 -- start start 2023-07-29T02:00:12.294 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.303+0000 7fcf02333700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcefc071840 0x7fcefc0c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:12.294 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.303+0000 7fcf02333700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcefc0c8580 0x7fcefc14a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:12.294 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.303+0000 7fcf02333700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcefc1531a0 0x7fcefc14aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.303+0000 7fcf02333700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc156180 con 0x7fcefc0c8580 2023-07-29T02:00:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.303+0000 7fcf02333700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc15a780 con 0x7fcefc1531a0 2023-07-29T02:00:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.303+0000 7fcf02333700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc1563d0 con 0x7fcefc071840 2023-07-29T02:00:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.304+0000 7fcefb7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcefc0c8580 0x7fcefc14a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.304+0000 7fcefb7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcefc0c8580 0x7fcefc14a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55880/0 (socket says 172.21.15.42:55880) 2023-07-29T02:00:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.304+0000 7fcefb7fe700 1 -- 172.21.15.42:0/3877815796 learned_addr learned my addr 172.21.15.42:0/3877815796 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.304+0000 7fcefbfff700 1 --2- 172.21.15.42:0/3877815796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcefc071840 0x7fcefc0c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:12.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.304+0000 7fcf008d0700 1 --2- 172.21.15.42:0/3877815796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcefc1531a0 0x7fcefc14aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:12.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.304+0000 7fcefb7fe700 1 -- 172.21.15.42:0/3877815796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcefc071840 msgr2=0x7fcefc0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:12.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.304+0000 7fcefb7fe700 1 --2- 172.21.15.42:0/3877815796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcefc071840 0x7fcefc0c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.304+0000 7fcefb7fe700 1 -- 172.21.15.42:0/3877815796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcefc1531a0 msgr2=0x7fcefc14aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:12.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.304+0000 7fcefb7fe700 1 --2- 172.21.15.42:0/3877815796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcefc1531a0 0x7fcefc14aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.304+0000 7fcefb7fe700 1 -- 172.21.15.42:0/3877815796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee4009550 con 0x7fcefc0c8580 2023-07-29T02:00:12.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.304+0000 7fcefbfff700 1 --2- 172.21.15.42:0/3877815796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcefc071840 0x7fcefc0c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:12.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.304+0000 7fcefb7fe700 1 --2- 172.21.15.42:0/3877815796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcefc0c8580 0x7fcefc14a960 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fceec00e9e0 tx=0x7fceec00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:12.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.304+0000 7fcef8ff9700 1 -- 172.21.15.42:0/3877815796 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec009710 con 0x7fcefc0c8580 2023-07-29T02:00:12.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.304+0000 7fcef8ff9700 1 -- 172.21.15.42:0/3877815796 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec00c850 con 0x7fcefc0c8580 2023-07-29T02:00:12.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.304+0000 7fcf02333700 1 -- 172.21.15.42:0/3877815796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcefc1566b0 con 0x7fcefc0c8580 2023-07-29T02:00:12.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.304+0000 7fcef8ff9700 1 -- 172.21.15.42:0/3877815796 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec00cbc0 con 0x7fcefc0c8580 2023-07-29T02:00:12.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.304+0000 7fcf02333700 1 -- 172.21.15.42:0/3877815796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcefc15a410 con 0x7fcefc0c8580 2023-07-29T02:00:12.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.305+0000 7fcf02333700 1 -- 172.21.15.42:0/3877815796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcefc15a8c0 con 0x7fcefc0c8580 2023-07-29T02:00:12.298 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.306+0000 7fcef8ff9700 1 -- 172.21.15.42:0/3877815796 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fceec00cd20 con 0x7fcefc0c8580 2023-07-29T02:00:12.298 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.306+0000 7fcef8ff9700 1 --2- 172.21.15.42:0/3877815796 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcedc06a660 0x7fcedc06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:12.298 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.306+0000 7fcef8ff9700 1 -- 172.21.15.42:0/3877815796 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fceec089260 con 0x7fcefc0c8580 2023-07-29T02:00:12.298 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.306+0000 7fcefbfff700 1 --2- 172.21.15.42:0/3877815796 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcedc06a660 0x7fcedc06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:12.299 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.307+0000 7fcefbfff700 1 --2- 172.21.15.42:0/3877815796 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcedc06a660 0x7fcedc06cb10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcee4014040 tx=0x7fcee4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:12.299 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.310+0000 7fcef8ff9700 1 -- 172.21.15.42:0/3877815796 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fcefc15a8c0 con 0x7fcefc0c8580 2023-07-29T02:00:12.496 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.508+0000 7fcf02333700 1 -- 172.21.15.42:0/3877815796 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcefc15a8c0 con 0x7fcefc0c8580 2023-07-29T02:00:12.496 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.508+0000 7fcef8ff9700 1 -- 172.21.15.42:0/3877815796 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcefc15a8c0 con 0x7fcefc0c8580 2023-07-29T02:00:12.496 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2023-07-29T02:00:12.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.510+0000 7fcf02333700 1 -- 172.21.15.42:0/3877815796 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcedc06a660 msgr2=0x7fcedc06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:12.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.510+0000 7fcf02333700 1 --2- 172.21.15.42:0/3877815796 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcedc06a660 0x7fcedc06cb10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcee4014040 tx=0x7fcee4008030 comp rx=0 tx=0).stop 2023-07-29T02:00:12.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.510+0000 7fcf02333700 1 -- 172.21.15.42:0/3877815796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcefc0c8580 msgr2=0x7fcefc14a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:12.499 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.510+0000 7fcf02333700 1 --2- 172.21.15.42:0/3877815796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcefc0c8580 0x7fcefc14a960 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fceec00e9e0 tx=0x7fceec00eda0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.499 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.510+0000 7fcf02333700 1 -- 172.21.15.42:0/3877815796 shutdown_connections 2023-07-29T02:00:12.500 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.510+0000 7fcf02333700 1 --2- 172.21.15.42:0/3877815796 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcedc06a660 0x7fcedc06cb10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.500 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.510+0000 7fcf02333700 1 --2- 172.21.15.42:0/3877815796 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcefc1531a0 0x7fcefc14aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.500 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.510+0000 7fcf02333700 1 --2- 172.21.15.42:0/3877815796 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcefc071840 0x7fcefc0c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.500 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.510+0000 7fcf02333700 1 --2- 172.21.15.42:0/3877815796 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcefc0c8580 0x7fcefc14a960 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.500 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.510+0000 7fcf02333700 1 -- 172.21.15.42:0/3877815796 >> 172.21.15.42:0/3877815796 conn(0x7fcefc0cbf10 msgr2=0x7fcefc150fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:12.500 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.510+0000 7fcf02333700 1 -- 172.21.15.42:0/3877815796 shutdown_connections 2023-07-29T02:00:12.501 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.510+0000 7fcf02333700 1 -- 172.21.15.42:0/3877815796 wait complete. 2023-07-29T02:00:12.510 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-29T02:00:12.637 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.650+0000 7f85388f5700 1 Processor -- start 2023-07-29T02:00:12.638 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.650+0000 7f85388f5700 1 -- start start 2023-07-29T02:00:12.639 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.651+0000 7f85388f5700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f85341510f0 0x7f853406c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:12.639 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.651+0000 7f85388f5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f853406f670 0x7f85341615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:12.639 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.651+0000 7f85388f5700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853406f1e0 con 0x7f853415a250 2023-07-29T02:00:12.639 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.651+0000 7f85388f5700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85340c7280 con 0x7f85341510f0 2023-07-29T02:00:12.640 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.651+0000 7f85388f5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853415a6b0 con 0x7f853406f670 2023-07-29T02:00:12.640 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.651+0000 7f853259c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f85341510f0 0x7f853406c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:12.640 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.651+0000 7f8531d9b700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f853415a250 0x7f853406a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49692/0 (socket says 172.21.15.42:49692) 2023-07-29T02:00:12.640 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.651+0000 7f8531d9b700 1 -- 172.21.15.42:0/39612514 learned_addr learned my addr 172.21.15.42:0/39612514 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:12.640 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.651+0000 7f8532d9d700 1 --2- 172.21.15.42:0/39612514 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f853406f670 0x7f85341615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:12.640 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.651+0000 7f853259c700 1 -- 172.21.15.42:0/39612514 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f853406f670 msgr2=0x7f85341615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:12.640 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.651+0000 7f853259c700 1 --2- 172.21.15.42:0/39612514 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f853406f670 0x7f85341615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.641 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.651+0000 7f853259c700 1 -- 172.21.15.42:0/39612514 >> v1:172.21.15.42:6789/0 conn(0x7f853415a250 legacy=0x7f853406a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:12.641 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.651+0000 7f853259c700 1 -- 172.21.15.42:0/39612514 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853406ebd0 con 0x7f85341510f0 2023-07-29T02:00:12.641 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.651+0000 7f853259c700 1 --2- 172.21.15.42:0/39612514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85341510f0 0x7f853406c760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8524009840 tx=0x7f8524009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3fbbf46d9a96555 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:12.641 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.651+0000 7f853159a700 1 -- 172.21.15.42:0/39612514 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8524011830 con 0x7f85341510f0 2023-07-29T02:00:12.641 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.652+0000 7f853159a700 1 -- 172.21.15.42:0/39612514 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8524011990 con 0x7f85341510f0 2023-07-29T02:00:12.641 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.652+0000 7f853159a700 1 -- 172.21.15.42:0/39612514 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8524011d20 con 0x7f85341510f0 2023-07-29T02:00:12.643 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.652+0000 7f85388f5700 1 -- 172.21.15.42:0/39612514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85341510f0 msgr2=0x7f853406c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:12.643 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.652+0000 7f85388f5700 1 --2- 172.21.15.42:0/39612514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85341510f0 0x7f853406c760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8524009840 tx=0x7f8524009b50 comp rx=0 tx=0).stop 2023-07-29T02:00:12.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.652+0000 7f85388f5700 1 -- 172.21.15.42:0/39612514 shutdown_connections 2023-07-29T02:00:12.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.652+0000 7f85388f5700 1 --2- 172.21.15.42:0/39612514 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f853406f670 0x7f85341615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.652+0000 7f85388f5700 1 --2- 172.21.15.42:0/39612514 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85341510f0 0x7f853406c760 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.652+0000 7f85388f5700 1 -- 172.21.15.42:0/39612514 >> 172.21.15.42:0/39612514 conn(0x7f85340cbf10 msgr2=0x7f85340cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:12.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.652+0000 7f85388f5700 1 -- 172.21.15.42:0/39612514 shutdown_connections 2023-07-29T02:00:12.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.652+0000 7f85388f5700 1 -- 172.21.15.42:0/39612514 wait complete. 2023-07-29T02:00:12.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.654+0000 7f85388f5700 1 Processor -- start 2023-07-29T02:00:12.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.654+0000 7f85388f5700 1 -- start start 2023-07-29T02:00:12.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.655+0000 7f85388f5700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f853406f670 0x7f85341f0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:12.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.655+0000 7f85388f5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85341510f0 0x7f85340cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:12.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.655+0000 7f85388f5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f853415a250 0x7f85341edf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:12.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.655+0000 7f85388f5700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85341f0ac0 con 0x7f853406f670 2023-07-29T02:00:12.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.655+0000 7f85388f5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8534159880 con 0x7f85341510f0 2023-07-29T02:00:12.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.655+0000 7f85388f5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85341eda70 con 0x7f853415a250 2023-07-29T02:00:12.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.655+0000 7f853259c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f853406f670 0x7f85341f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:12.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.655+0000 7f853259c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f853406f670 0x7f85341f0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55894/0 (socket says 172.21.15.42:55894) 2023-07-29T02:00:12.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.655+0000 7f853259c700 1 -- 172.21.15.42:0/2119340223 learned_addr learned my addr 172.21.15.42:0/2119340223 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:12.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.655+0000 7f8532d9d700 1 --2- 172.21.15.42:0/2119340223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f853415a250 0x7f85341edf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:12.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.655+0000 7f8531d9b700 1 --2- 172.21.15.42:0/2119340223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85341510f0 0x7f85340cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:12.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.655+0000 7f853259c700 1 -- 172.21.15.42:0/2119340223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f853415a250 msgr2=0x7f85341edf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:12.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.655+0000 7f853259c700 1 --2- 172.21.15.42:0/2119340223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f853415a250 0x7f85341edf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.655+0000 7f853259c700 1 -- 172.21.15.42:0/2119340223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85341510f0 msgr2=0x7f85340cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:12.647 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.655+0000 7f853259c700 1 --2- 172.21.15.42:0/2119340223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85341510f0 0x7f85340cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.647 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.655+0000 7f853259c700 1 -- 172.21.15.42:0/2119340223 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85240094a0 con 0x7f853406f670 2023-07-29T02:00:12.647 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.655+0000 7f8532d9d700 1 --2- 172.21.15.42:0/2119340223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f853415a250 0x7f85341edf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:12.647 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.655+0000 7f853259c700 1 --2- 172.21.15.42:0/2119340223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f853406f670 0x7f85341f0580 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f85240090b0 tx=0x7f8524004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:12.647 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.656+0000 7f8522ffd700 1 -- 172.21.15.42:0/2119340223 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85240036a0 con 0x7f853406f670 2023-07-29T02:00:12.647 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.656+0000 7f8522ffd700 1 -- 172.21.15.42:0/2119340223 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852401f070 con 0x7f853406f670 2023-07-29T02:00:12.647 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.656+0000 7f85388f5700 1 -- 172.21.15.42:0/2119340223 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8534159030 con 0x7f853406f670 2023-07-29T02:00:12.648 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.656+0000 7f8522ffd700 1 -- 172.21.15.42:0/2119340223 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8524003a40 con 0x7f853406f670 2023-07-29T02:00:12.648 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.656+0000 7f85388f5700 1 -- 172.21.15.42:0/2119340223 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8534159ad0 con 0x7f853406f670 2023-07-29T02:00:12.648 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.657+0000 7f85388f5700 1 -- 172.21.15.42:0/2119340223 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85341edd50 con 0x7f853406f670 2023-07-29T02:00:12.649 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.657+0000 7f8522ffd700 1 -- 172.21.15.42:0/2119340223 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f8524003ba0 con 0x7f853406f670 2023-07-29T02:00:12.649 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.657+0000 7f8522ffd700 1 --2- 172.21.15.42:0/2119340223 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f851406a660 0x7f851406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:12.649 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.657+0000 7f8522ffd700 1 -- 172.21.15.42:0/2119340223 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8524021070 con 0x7f853406f670 2023-07-29T02:00:12.649 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.658+0000 7f8531d9b700 1 --2- 172.21.15.42:0/2119340223 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f851406a660 0x7f851406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:12.649 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.658+0000 7f8531d9b700 1 --2- 172.21.15.42:0/2119340223 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f851406a660 0x7f851406cb10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f853414dc50 tx=0x7f8528009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:12.650 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.662+0000 7f8522ffd700 1 -- 172.21.15.42:0/2119340223 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f8524055950 con 0x7f853406f670 2023-07-29T02:00:12.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.861+0000 7f85388f5700 1 -- 172.21.15.42:0/2119340223 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f853404ea50 con 0x7f853406f670 2023-07-29T02:00:12.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.862+0000 7f8522ffd700 1 -- 172.21.15.42:0/2119340223 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8524058f70 con 0x7f853406f670 2023-07-29T02:00:12.850 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2023-07-29T02:00:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.864+0000 7f85388f5700 1 -- 172.21.15.42:0/2119340223 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f851406a660 msgr2=0x7f851406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.864+0000 7f85388f5700 1 --2- 172.21.15.42:0/2119340223 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f851406a660 0x7f851406cb10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f853414dc50 tx=0x7f8528009040 comp rx=0 tx=0).stop 2023-07-29T02:00:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.864+0000 7f85388f5700 1 -- 172.21.15.42:0/2119340223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f853406f670 msgr2=0x7f85341f0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.864+0000 7f85388f5700 1 --2- 172.21.15.42:0/2119340223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f853406f670 0x7f85341f0580 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f85240090b0 tx=0x7f8524004750 comp rx=0 tx=0).stop 2023-07-29T02:00:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.864+0000 7f85388f5700 1 -- 172.21.15.42:0/2119340223 shutdown_connections 2023-07-29T02:00:12.852 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.864+0000 7f85388f5700 1 --2- 172.21.15.42:0/2119340223 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f851406a660 0x7f851406cb10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.864+0000 7f85388f5700 1 --2- 172.21.15.42:0/2119340223 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f853415a250 0x7f85341edf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.864+0000 7f85388f5700 1 --2- 172.21.15.42:0/2119340223 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f853406f670 0x7f85341f0580 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.864+0000 7f85388f5700 1 --2- 172.21.15.42:0/2119340223 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85341510f0 0x7f85340cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.864+0000 7f85388f5700 1 -- 172.21.15.42:0/2119340223 >> 172.21.15.42:0/2119340223 conn(0x7f85340cbf10 msgr2=0x7f853414dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:12.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.864+0000 7f85388f5700 1 -- 172.21.15.42:0/2119340223 shutdown_connections 2023-07-29T02:00:12.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:12.864+0000 7f85388f5700 1 -- 172.21.15.42:0/2119340223 wait complete. 2023-07-29T02:00:12.863 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-29T02:00:12.990 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.002+0000 7fd76fbef700 1 Processor -- start 2023-07-29T02:00:12.991 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.003+0000 7fd76fbef700 1 -- start start 2023-07-29T02:00:12.992 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.003+0000 7fd76fbef700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd768155bd0 0x7fd76814f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:12.992 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.003+0000 7fd76fbef700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76806cb10 con 0x7fd76806eda0 2023-07-29T02:00:12.992 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.003+0000 7fd76fbef700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd768156000 con 0x7fd76814fe60 2023-07-29T02:00:12.992 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.003+0000 7fd76fbef700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7681502e0 con 0x7fd768155bd0 2023-07-29T02:00:12.993 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.004+0000 7fd76d98b700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fd76806eda0 0x7fd76806cfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49706/0 (socket says 172.21.15.42:49706) 2023-07-29T02:00:12.993 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.004+0000 7fd76d98b700 1 -- 172.21.15.42:0/454958812 learned_addr learned my addr 172.21.15.42:0/454958812 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:12.993 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.004+0000 7fd76d18a700 1 --2- 172.21.15.42:0/454958812 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd768155bd0 0x7fd76814f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:12.993 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.004+0000 7fd76c989700 1 -- 172.21.15.42:0/454958812 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730064205 0 0) 0x7fd76806cb10 con 0x7fd76806eda0 2023-07-29T02:00:12.993 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.004+0000 7fd76c989700 1 -- 172.21.15.42:0/454958812 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7540035b0 con 0x7fd76806eda0 2023-07-29T02:00:12.993 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.004+0000 7fd76c989700 1 -- 172.21.15.42:0/454958812 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3468227532 0 0) 0x7fd768156000 con 0x7fd76814fe60 2023-07-29T02:00:12.993 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.004+0000 7fd76c989700 1 -- 172.21.15.42:0/454958812 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd76806cb10 con 0x7fd76814fe60 2023-07-29T02:00:12.994 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.004+0000 7fd76d18a700 1 -- 172.21.15.42:0/454958812 >> v1:172.21.15.144:6789/0 conn(0x7fd76814fe60 legacy=0x7fd76806f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:12.994 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.004+0000 7fd76c989700 1 -- 172.21.15.42:0/454958812 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 360702198 0 0) 0x7fd7540035b0 con 0x7fd76806eda0 2023-07-29T02:00:12.994 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.004+0000 7fd76d18a700 1 -- 172.21.15.42:0/454958812 >> v1:172.21.15.42:6789/0 conn(0x7fd76806eda0 legacy=0x7fd76806cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:12.994 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.004+0000 7fd76d18a700 1 -- 172.21.15.42:0/454958812 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd768156280 con 0x7fd768155bd0 2023-07-29T02:00:12.994 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.004+0000 7fd76d18a700 1 --2- 172.21.15.42:0/454958812 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd768155bd0 0x7fd76814f920 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009870 tx=0x7fd75c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b8e2bdc978cddee server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:12.994 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.005+0000 7fd76c989700 1 -- 172.21.15.42:0/454958812 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd764001670 con 0x7fd768155bd0 2023-07-29T02:00:12.994 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.005+0000 7fd76c989700 1 -- 172.21.15.42:0/454958812 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c004030 con 0x7fd768155bd0 2023-07-29T02:00:12.994 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.005+0000 7fd76c989700 1 -- 172.21.15.42:0/454958812 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c0043c0 con 0x7fd768155bd0 2023-07-29T02:00:12.996 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.005+0000 7fd76fbef700 1 -- 172.21.15.42:0/454958812 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd768155bd0 msgr2=0x7fd76814f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:12.997 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.005+0000 7fd76fbef700 1 --2- 172.21.15.42:0/454958812 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd768155bd0 0x7fd76814f920 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd75c009870 tx=0x7fd75c009b80 comp rx=0 tx=0).stop 2023-07-29T02:00:12.997 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.005+0000 7fd76fbef700 1 -- 172.21.15.42:0/454958812 shutdown_connections 2023-07-29T02:00:12.997 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.005+0000 7fd76fbef700 1 --2- 172.21.15.42:0/454958812 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd768155bd0 0x7fd76814f920 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.997 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.005+0000 7fd76fbef700 1 -- 172.21.15.42:0/454958812 >> 172.21.15.42:0/454958812 conn(0x7fd7680cbf10 msgr2=0x7fd7680cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:12.997 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.005+0000 7fd76fbef700 1 -- 172.21.15.42:0/454958812 shutdown_connections 2023-07-29T02:00:12.997 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.005+0000 7fd76fbef700 1 -- 172.21.15.42:0/454958812 wait complete. 2023-07-29T02:00:12.998 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.006+0000 7fd76fbef700 1 Processor -- start 2023-07-29T02:00:12.998 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.006+0000 7fd76fbef700 1 -- start start 2023-07-29T02:00:12.998 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.007+0000 7fd76fbef700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd76806eda0 0x7fd768152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:12.998 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.007+0000 7fd76fbef700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd76814fe60 0x7fd76806a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:12.998 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.007+0000 7fd76fbef700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd768155bd0 0x7fd7680cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:12.998 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.007+0000 7fd76fbef700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7681532d0 con 0x7fd76806eda0 2023-07-29T02:00:12.998 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.007+0000 7fd76fbef700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7681ec8b0 con 0x7fd768155bd0 2023-07-29T02:00:12.998 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.007+0000 7fd76fbef700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7680c9db0 con 0x7fd76814fe60 2023-07-29T02:00:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.007+0000 7fd76d98b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd76806eda0 0x7fd768152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.007+0000 7fd76d98b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd76806eda0 0x7fd768152d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55908/0 (socket says 172.21.15.42:55908) 2023-07-29T02:00:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.007+0000 7fd76d98b700 1 -- 172.21.15.42:0/318375280 learned_addr learned my addr 172.21.15.42:0/318375280 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.007+0000 7fd76d18a700 1 --2- 172.21.15.42:0/318375280 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd76814fe60 0x7fd76806a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.007+0000 7fd76e18c700 1 --2- 172.21.15.42:0/318375280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd768155bd0 0x7fd7680cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.007+0000 7fd76d98b700 1 -- 172.21.15.42:0/318375280 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd76814fe60 msgr2=0x7fd76806a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.007+0000 7fd76d98b700 1 --2- 172.21.15.42:0/318375280 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd76814fe60 0x7fd76806a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:12.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.007+0000 7fd76d98b700 1 -- 172.21.15.42:0/318375280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd768155bd0 msgr2=0x7fd7680cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:13.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.007+0000 7fd76d98b700 1 --2- 172.21.15.42:0/318375280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd768155bd0 0x7fd7680cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.007+0000 7fd76d98b700 1 -- 172.21.15.42:0/318375280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c0094a0 con 0x7fd76806eda0 2023-07-29T02:00:13.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.008+0000 7fd76e18c700 1 --2- 172.21.15.42:0/318375280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd768155bd0 0x7fd7680cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:13.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.008+0000 7fd76d98b700 1 --2- 172.21.15.42:0/318375280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd76806eda0 0x7fd768152d90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd76400c770 tx=0x7fd76400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:13.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.008+0000 7fd75a7fc700 1 -- 172.21.15.42:0/318375280 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd764007560 con 0x7fd76806eda0 2023-07-29T02:00:13.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.008+0000 7fd75a7fc700 1 -- 172.21.15.42:0/318375280 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7640076c0 con 0x7fd76806eda0 2023-07-29T02:00:13.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.008+0000 7fd76fbef700 1 -- 172.21.15.42:0/318375280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7680ca090 con 0x7fd76806eda0 2023-07-29T02:00:13.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.008+0000 7fd75a7fc700 1 -- 172.21.15.42:0/318375280 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd764004a70 con 0x7fd76806eda0 2023-07-29T02:00:13.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.008+0000 7fd76fbef700 1 -- 172.21.15.42:0/318375280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7680ca650 con 0x7fd76806eda0 2023-07-29T02:00:13.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.009+0000 7fd76fbef700 1 -- 172.21.15.42:0/318375280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd76804ea50 con 0x7fd76806eda0 2023-07-29T02:00:13.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.009+0000 7fd75a7fc700 1 -- 172.21.15.42:0/318375280 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fd764004bd0 con 0x7fd76806eda0 2023-07-29T02:00:13.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.010+0000 7fd75a7fc700 1 --2- 172.21.15.42:0/318375280 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fd74c06a660 0x7fd74c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:13.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.010+0000 7fd75a7fc700 1 -- 172.21.15.42:0/318375280 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd764088490 con 0x7fd76806eda0 2023-07-29T02:00:13.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.010+0000 7fd76d18a700 1 --2- 172.21.15.42:0/318375280 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fd74c06a660 0x7fd74c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:13.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.010+0000 7fd76d18a700 1 --2- 172.21.15.42:0/318375280 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fd74c06a660 0x7fd74c06cb10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0097c0 tx=0x7fd75c013040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:13.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.014+0000 7fd75a7fc700 1 -- 172.21.15.42:0/318375280 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fd764053630 con 0x7fd76806eda0 2023-07-29T02:00:13.201 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.213+0000 7fd76fbef700 1 -- 172.21.15.42:0/318375280 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd7681535f0 con 0x7fd76806eda0 2023-07-29T02:00:13.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.214+0000 7fd75a7fc700 1 -- 172.21.15.42:0/318375280 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd764056c50 con 0x7fd76806eda0 2023-07-29T02:00:13.202 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2023-07-29T02:00:13.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.216+0000 7fd76fbef700 1 -- 172.21.15.42:0/318375280 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fd74c06a660 msgr2=0x7fd74c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:13.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.216+0000 7fd76fbef700 1 --2- 172.21.15.42:0/318375280 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fd74c06a660 0x7fd74c06cb10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0097c0 tx=0x7fd75c013040 comp rx=0 tx=0).stop 2023-07-29T02:00:13.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.216+0000 7fd76fbef700 1 -- 172.21.15.42:0/318375280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd76806eda0 msgr2=0x7fd768152d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:13.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.216+0000 7fd76fbef700 1 --2- 172.21.15.42:0/318375280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd76806eda0 0x7fd768152d90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd76400c770 tx=0x7fd76400cb30 comp rx=0 tx=0).stop 2023-07-29T02:00:13.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.216+0000 7fd76fbef700 1 -- 172.21.15.42:0/318375280 shutdown_connections 2023-07-29T02:00:13.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.216+0000 7fd76fbef700 1 --2- 172.21.15.42:0/318375280 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fd74c06a660 0x7fd74c06cb10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.216+0000 7fd76fbef700 1 --2- 172.21.15.42:0/318375280 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd768155bd0 0x7fd7680cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.216+0000 7fd76fbef700 1 --2- 172.21.15.42:0/318375280 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fd76806eda0 0x7fd768152d90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.216+0000 7fd76fbef700 1 --2- 172.21.15.42:0/318375280 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fd76814fe60 0x7fd76806a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.216+0000 7fd76fbef700 1 -- 172.21.15.42:0/318375280 >> 172.21.15.42:0/318375280 conn(0x7fd7680cbf10 msgr2=0x7fd7680c7110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:13.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.216+0000 7fd76fbef700 1 -- 172.21.15.42:0/318375280 shutdown_connections 2023-07-29T02:00:13.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.216+0000 7fd76fbef700 1 -- 172.21.15.42:0/318375280 wait complete. 2023-07-29T02:00:13.216 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-29T02:00:13.341 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.353+0000 7faee536a700 1 Processor -- start 2023-07-29T02:00:13.341 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.353+0000 7faee536a700 1 -- start start 2023-07-29T02:00:13.343 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.354+0000 7faee536a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7faee006c760 0x7faee015a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:13.343 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.354+0000 7faee536a700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7faee006f670 0x7faee01615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:13.343 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.354+0000 7faee536a700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee006f1e0 con 0x7faee01510f0 2023-07-29T02:00:13.343 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.354+0000 7faee536a700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee00c7280 con 0x7faee006f670 2023-07-29T02:00:13.343 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.354+0000 7faee536a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee006fab0 con 0x7faee006c760 2023-07-29T02:00:13.344 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.354+0000 7faedf7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7faee006f670 0x7faee01615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:13.344 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.354+0000 7faedf7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7faee006f670 0x7faee01615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55920/0 (socket says 172.21.15.42:55920) 2023-07-29T02:00:13.344 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.354+0000 7faedf7fe700 1 -- 172.21.15.42:0/713008415 learned_addr learned my addr 172.21.15.42:0/713008415 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:13.344 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.354+0000 7faedeffd700 1 --1- 172.21.15.42:0/713008415 >> v1:172.21.15.42:6789/0 conn(0x7faee01510f0 0x7faee006a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49720/0 (socket says 172.21.15.42:49720) 2023-07-29T02:00:13.344 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.355+0000 7faede7fc700 1 --2- 172.21.15.42:0/713008415 >> v2:172.21.15.144:3300/0 conn(0x7faee006c760 0x7faee015a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:13.344 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.355+0000 7faedf7fe700 1 -- 172.21.15.42:0/713008415 >> v2:172.21.15.144:3300/0 conn(0x7faee006c760 msgr2=0x7faee015a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:13.344 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.355+0000 7faedf7fe700 1 --2- 172.21.15.42:0/713008415 >> v2:172.21.15.144:3300/0 conn(0x7faee006c760 0x7faee015a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.345 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.355+0000 7faedf7fe700 1 -- 172.21.15.42:0/713008415 >> v1:172.21.15.42:6789/0 conn(0x7faee01510f0 legacy=0x7faee006a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:13.345 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.355+0000 7faedf7fe700 1 -- 172.21.15.42:0/713008415 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee006ebd0 con 0x7faee006f670 2023-07-29T02:00:13.345 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.355+0000 7faedf7fe700 1 --2- 172.21.15.42:0/713008415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faee006f670 0x7faee01615e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faee0070d70 tx=0x7faed800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a36c89c1c7e6f48 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:13.345 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.355+0000 7faeddffb700 1 -- 172.21.15.42:0/713008415 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed800e070 con 0x7faee006f670 2023-07-29T02:00:13.345 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.355+0000 7faeddffb700 1 -- 172.21.15.42:0/713008415 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed800b9c0 con 0x7faee006f670 2023-07-29T02:00:13.345 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.355+0000 7faeddffb700 1 -- 172.21.15.42:0/713008415 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed800bd70 con 0x7faee006f670 2023-07-29T02:00:13.347 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.356+0000 7faee536a700 1 -- 172.21.15.42:0/713008415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faee006f670 msgr2=0x7faee01615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:13.348 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.356+0000 7faee536a700 1 --2- 172.21.15.42:0/713008415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faee006f670 0x7faee01615e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faee0070d70 tx=0x7faed800b330 comp rx=0 tx=0).stop 2023-07-29T02:00:13.348 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.356+0000 7faee536a700 1 -- 172.21.15.42:0/713008415 shutdown_connections 2023-07-29T02:00:13.348 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.356+0000 7faee536a700 1 --2- 172.21.15.42:0/713008415 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faee006f670 0x7faee01615e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.348 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.356+0000 7faee536a700 1 --2- 172.21.15.42:0/713008415 >> v2:172.21.15.144:3300/0 conn(0x7faee006c760 0x7faee015a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.348 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.356+0000 7faee536a700 1 -- 172.21.15.42:0/713008415 >> 172.21.15.42:0/713008415 conn(0x7faee00cbf10 msgr2=0x7faee00cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:13.348 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.356+0000 7faee536a700 1 -- 172.21.15.42:0/713008415 shutdown_connections 2023-07-29T02:00:13.349 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.356+0000 7faee536a700 1 -- 172.21.15.42:0/713008415 wait complete. 2023-07-29T02:00:13.349 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.357+0000 7faee536a700 1 Processor -- start 2023-07-29T02:00:13.349 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.357+0000 7faee536a700 1 -- start start 2023-07-29T02:00:13.349 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.358+0000 7faee536a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faee006c760 0x7faee00cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:13.349 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.358+0000 7faee536a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee006f670 0x7faee01f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:13.349 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.358+0000 7faee536a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faee01510f0 0x7faee00cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:13.349 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.358+0000 7faee536a700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee01f10b0 con 0x7faee006c760 2023-07-29T02:00:13.349 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.358+0000 7faee536a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee01498c0 con 0x7faee006f670 2023-07-29T02:00:13.350 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.358+0000 7faee536a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee014a6e0 con 0x7faee01510f0 2023-07-29T02:00:13.350 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.358+0000 7faedeffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faee006c760 0x7faee00cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:13.350 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.358+0000 7faedeffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faee006c760 0x7faee00cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55922/0 (socket says 172.21.15.42:55922) 2023-07-29T02:00:13.350 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.358+0000 7faedeffd700 1 -- 172.21.15.42:0/4107873724 learned_addr learned my addr 172.21.15.42:0/4107873724 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:13.350 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.358+0000 7faede7fc700 1 --2- 172.21.15.42:0/4107873724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee006f670 0x7faee01f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:13.350 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.358+0000 7faedf7fe700 1 --2- 172.21.15.42:0/4107873724 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faee01510f0 0x7faee00cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:13.350 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.358+0000 7faedeffd700 1 -- 172.21.15.42:0/4107873724 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faee01510f0 msgr2=0x7faee00cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:13.350 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.358+0000 7faedeffd700 1 --2- 172.21.15.42:0/4107873724 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faee01510f0 0x7faee00cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.351 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.358+0000 7faedeffd700 1 -- 172.21.15.42:0/4107873724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee006f670 msgr2=0x7faee01f0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:13.351 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.358+0000 7faedeffd700 1 --2- 172.21.15.42:0/4107873724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee006f670 0x7faee01f0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.351 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.358+0000 7faedeffd700 1 -- 172.21.15.42:0/4107873724 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed8009b30 con 0x7faee006c760 2023-07-29T02:00:13.351 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.358+0000 7faedf7fe700 1 --2- 172.21.15.42:0/4107873724 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faee01510f0 0x7faee00cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:13.351 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.358+0000 7faedeffd700 1 --2- 172.21.15.42:0/4107873724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faee006c760 0x7faee00cb940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faed400c500 tx=0x7faed400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:13.351 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.358+0000 7faec77fe700 1 -- 172.21.15.42:0/4107873724 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed4005cb0 con 0x7faee006c760 2023-07-29T02:00:13.351 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.358+0000 7faec77fe700 1 -- 172.21.15.42:0/4107873724 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed4005e10 con 0x7faee006c760 2023-07-29T02:00:13.352 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.359+0000 7faee536a700 1 -- 172.21.15.42:0/4107873724 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee0149b60 con 0x7faee006c760 2023-07-29T02:00:13.352 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.359+0000 7faec77fe700 1 -- 172.21.15.42:0/4107873724 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed40072d0 con 0x7faee006c760 2023-07-29T02:00:13.352 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.359+0000 7faee536a700 1 -- 172.21.15.42:0/4107873724 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee014a120 con 0x7faee006c760 2023-07-29T02:00:13.352 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.360+0000 7faee536a700 1 -- 172.21.15.42:0/4107873724 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee004ea50 con 0x7faee006c760 2023-07-29T02:00:13.352 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.360+0000 7faec77fe700 1 -- 172.21.15.42:0/4107873724 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7faed4007430 con 0x7faee006c760 2023-07-29T02:00:13.353 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.360+0000 7faec77fe700 1 --2- 172.21.15.42:0/4107873724 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7faecc06a660 0x7faecc06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:13.353 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.360+0000 7faec77fe700 1 -- 172.21.15.42:0/4107873724 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faed4088200 con 0x7faee006c760 2023-07-29T02:00:13.353 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.361+0000 7faede7fc700 1 --2- 172.21.15.42:0/4107873724 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7faecc06a660 0x7faecc06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:13.353 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.361+0000 7faede7fc700 1 --2- 172.21.15.42:0/4107873724 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7faecc06a660 0x7faecc06cb10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faee00cbe80 tx=0x7faed0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:13.353 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.365+0000 7faec77fe700 1 -- 172.21.15.42:0/4107873724 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7faed404c2c0 con 0x7faee006c760 2023-07-29T02:00:13.568 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.581+0000 7faee536a700 1 -- 172.21.15.42:0/4107873724 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7faee00ca3a0 con 0x7faee006c760 2023-07-29T02:00:13.569 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.581+0000 7faec77fe700 1 -- 172.21.15.42:0/4107873724 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7faed4017080 con 0x7faee006c760 2023-07-29T02:00:13.571 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.583+0000 7faee536a700 1 -- 172.21.15.42:0/4107873724 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7faecc06a660 msgr2=0x7faecc06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:13.571 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.583+0000 7faee536a700 1 --2- 172.21.15.42:0/4107873724 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7faecc06a660 0x7faecc06cb10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faee00cbe80 tx=0x7faed0008040 comp rx=0 tx=0).stop 2023-07-29T02:00:13.571 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.583+0000 7faee536a700 1 -- 172.21.15.42:0/4107873724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faee006c760 msgr2=0x7faee00cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:13.571 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.583+0000 7faee536a700 1 --2- 172.21.15.42:0/4107873724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faee006c760 0x7faee00cb940 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7faed400c500 tx=0x7faed400c8c0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.572 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.583+0000 7faee536a700 1 -- 172.21.15.42:0/4107873724 shutdown_connections 2023-07-29T02:00:13.572 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.583+0000 7faee536a700 1 --2- 172.21.15.42:0/4107873724 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7faecc06a660 0x7faecc06cb10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.572 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.583+0000 7faee536a700 1 --2- 172.21.15.42:0/4107873724 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7faee01510f0 0x7faee00cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.572 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.583+0000 7faee536a700 1 --2- 172.21.15.42:0/4107873724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7faee006c760 0x7faee00cb940 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.572 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.583+0000 7faee536a700 1 --2- 172.21.15.42:0/4107873724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee006f670 0x7faee01f0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.572 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.583+0000 7faee536a700 1 -- 172.21.15.42:0/4107873724 >> 172.21.15.42:0/4107873724 conn(0x7faee00cbf10 msgr2=0x7faee014e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:13.572 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.583+0000 7faee536a700 1 -- 172.21.15.42:0/4107873724 shutdown_connections 2023-07-29T02:00:13.573 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.583+0000 7faee536a700 1 -- 172.21.15.42:0/4107873724 wait complete. 2023-07-29T02:00:13.573 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2023-07-29T02:00:13.583 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T02:00:13.583 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-29T02:00:13.600 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T02:00:13.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.778+0000 7f2b36b50700 1 Processor -- start 2023-07-29T02:00:13.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.778+0000 7f2b36b50700 1 -- start start 2023-07-29T02:00:13.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.778+0000 7f2b36b50700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2b30153660 0x7f2b3006d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:13.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.778+0000 7f2b36b50700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2b3006b860 0x7f2b3015a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:13.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.778+0000 7f2b36b50700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3006ed10 con 0x7f2b30159d90 2023-07-29T02:00:13.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.778+0000 7f2b36b50700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b300b28b0 con 0x7f2b30153660 2023-07-29T02:00:13.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.778+0000 7f2b36b50700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b300b2b90 con 0x7f2b3006b860 2023-07-29T02:00:13.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.779+0000 7f2b348ec700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2b30153660 0x7f2b3006d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:13.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.779+0000 7f2b350ed700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f2b30159d90 0x7f2b300cd140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49738/0 (socket says 172.21.15.42:49738) 2023-07-29T02:00:13.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.779+0000 7f2b350ed700 1 -- 172.21.15.42:0/2104300433 learned_addr learned my addr 172.21.15.42:0/2104300433 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:13.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.779+0000 7f2b2ffff700 1 --2- 172.21.15.42:0/2104300433 >> v2:172.21.15.144:3300/0 conn(0x7f2b3006b860 0x7f2b3015a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:13.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.779+0000 7f2b348ec700 1 -- 172.21.15.42:0/2104300433 >> v2:172.21.15.144:3300/0 conn(0x7f2b3006b860 msgr2=0x7f2b3015a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:13.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.779+0000 7f2b348ec700 1 --2- 172.21.15.42:0/2104300433 >> v2:172.21.15.144:3300/0 conn(0x7f2b3006b860 0x7f2b3015a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.779+0000 7f2b348ec700 1 -- 172.21.15.42:0/2104300433 >> v1:172.21.15.42:6789/0 conn(0x7f2b30159d90 legacy=0x7f2b300cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:13.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.779+0000 7f2b2f7fe700 1 -- 172.21.15.42:0/2104300433 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825294263 0 0) 0x7f2b3006ed10 con 0x7f2b30159d90 2023-07-29T02:00:13.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.779+0000 7f2b348ec700 1 -- 172.21.15.42:0/2104300433 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3006de90 con 0x7f2b30153660 2023-07-29T02:00:13.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.779+0000 7f2b348ec700 1 --2- 172.21.15.42:0/2104300433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b30153660 0x7f2b3006d590 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2b3006fc10 tx=0x7f2b24009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc22b0e8c2b399e server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:13.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.779+0000 7f2b2f7fe700 1 -- 172.21.15.42:0/2104300433 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24011830 con 0x7f2b30153660 2023-07-29T02:00:13.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.779+0000 7f2b2f7fe700 1 -- 172.21.15.42:0/2104300433 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b24011990 con 0x7f2b30153660 2023-07-29T02:00:13.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.779+0000 7f2b2f7fe700 1 -- 172.21.15.42:0/2104300433 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24011d20 con 0x7f2b30153660 2023-07-29T02:00:13.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.780+0000 7f2b36b50700 1 -- 172.21.15.42:0/2104300433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b30153660 msgr2=0x7f2b3006d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.780+0000 7f2b36b50700 1 --2- 172.21.15.42:0/2104300433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b30153660 0x7f2b3006d590 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2b3006fc10 tx=0x7f2b24009b20 comp rx=0 tx=0).stop 2023-07-29T02:00:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.780+0000 7f2b36b50700 1 -- 172.21.15.42:0/2104300433 shutdown_connections 2023-07-29T02:00:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.780+0000 7f2b36b50700 1 --2- 172.21.15.42:0/2104300433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b30153660 0x7f2b3006d590 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2b3006fc10 tx=0x7f2b24009b20 comp rx=0 tx=0).stop 2023-07-29T02:00:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.780+0000 7f2b36b50700 1 --2- 172.21.15.42:0/2104300433 >> v2:172.21.15.144:3300/0 conn(0x7f2b3006b860 0x7f2b3015a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.780+0000 7f2b36b50700 1 -- 172.21.15.42:0/2104300433 >> 172.21.15.42:0/2104300433 conn(0x7f2b30061190 msgr2=0x7f2b30061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:13.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.780+0000 7f2b36b50700 1 -- 172.21.15.42:0/2104300433 shutdown_connections 2023-07-29T02:00:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.780+0000 7f2b36b50700 1 -- 172.21.15.42:0/2104300433 wait complete. 2023-07-29T02:00:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.781+0000 7f2b36b50700 1 Processor -- start 2023-07-29T02:00:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.781+0000 7f2b36b50700 1 -- start start 2023-07-29T02:00:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.782+0000 7f2b36b50700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b3006b860 0x7f2b301f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.782+0000 7f2b36b50700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b30159d90 0x7f2b30153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.782+0000 7f2b36b50700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b300cbb50 0x7f2b301f0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.782+0000 7f2b36b50700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b301f2a10 con 0x7f2b30159d90 2023-07-29T02:00:13.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.782+0000 7f2b36b50700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b300b1c90 con 0x7f2b3006b860 2023-07-29T02:00:13.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.782+0000 7f2b36b50700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b300b1f30 con 0x7f2b300cbb50 2023-07-29T02:00:13.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.782+0000 7f2b2ffff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b30159d90 0x7f2b30153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:13.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.782+0000 7f2b2ffff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b30159d90 0x7f2b30153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55938/0 (socket says 172.21.15.42:55938) 2023-07-29T02:00:13.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.782+0000 7f2b2ffff700 1 -- 172.21.15.42:0/2969702914 learned_addr learned my addr 172.21.15.42:0/2969702914 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:13.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.782+0000 7f2b350ed700 1 --2- 172.21.15.42:0/2969702914 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b300cbb50 0x7f2b301f0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:13.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.782+0000 7f2b2ffff700 1 -- 172.21.15.42:0/2969702914 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b300cbb50 msgr2=0x7f2b301f0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:13.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.782+0000 7f2b2ffff700 1 --2- 172.21.15.42:0/2969702914 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b300cbb50 0x7f2b301f0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.782+0000 7f2b348ec700 1 --2- 172.21.15.42:0/2969702914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b3006b860 0x7f2b301f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:13.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.782+0000 7f2b2ffff700 1 -- 172.21.15.42:0/2969702914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b3006b860 msgr2=0x7f2b301f24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:13.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.782+0000 7f2b2ffff700 1 --2- 172.21.15.42:0/2969702914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b3006b860 0x7f2b301f24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.782+0000 7f2b2ffff700 1 -- 172.21.15.42:0/2969702914 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b240094a0 con 0x7f2b30159d90 2023-07-29T02:00:13.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.782+0000 7f2b350ed700 1 --2- 172.21.15.42:0/2969702914 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b300cbb50 0x7f2b301f0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:13.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.783+0000 7f2b2ffff700 1 --2- 172.21.15.42:0/2969702914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b30159d90 0x7f2b30153e40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00e9b0 tx=0x7f2b1c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:13.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.783+0000 7f2b2d7fa700 1 -- 172.21.15.42:0/2969702914 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c009710 con 0x7f2b30159d90 2023-07-29T02:00:13.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.783+0000 7f2b2d7fa700 1 -- 172.21.15.42:0/2969702914 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1c00c850 con 0x7f2b30159d90 2023-07-29T02:00:13.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.783+0000 7f2b36b50700 1 -- 172.21.15.42:0/2969702914 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b300b2210 con 0x7f2b30159d90 2023-07-29T02:00:13.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.783+0000 7f2b2d7fa700 1 -- 172.21.15.42:0/2969702914 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c00cbc0 con 0x7f2b30159d90 2023-07-29T02:00:13.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.783+0000 7f2b36b50700 1 -- 172.21.15.42:0/2969702914 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b301efa30 con 0x7f2b30159d90 2023-07-29T02:00:13.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.784+0000 7f2b36b50700 1 -- 172.21.15.42:0/2969702914 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3004ea50 con 0x7f2b30159d90 2023-07-29T02:00:13.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.784+0000 7f2b2d7fa700 1 -- 172.21.15.42:0/2969702914 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f2b1c00cd20 con 0x7f2b30159d90 2023-07-29T02:00:13.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.784+0000 7f2b2d7fa700 1 --2- 172.21.15.42:0/2969702914 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2b1406a660 0x7f2b1406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:13.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.785+0000 7f2b2d7fa700 1 -- 172.21.15.42:0/2969702914 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2b1c088f40 con 0x7f2b30159d90 2023-07-29T02:00:13.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.785+0000 7f2b348ec700 1 --2- 172.21.15.42:0/2969702914 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2b1406a660 0x7f2b1406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:13.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.785+0000 7f2b348ec700 1 --2- 172.21.15.42:0/2969702914 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2b1406a660 0x7f2b1406cb10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2b30071000 tx=0x7f2b24008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:13.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.789+0000 7f2b2d7fa700 1 -- 172.21.15.42:0/2969702914 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f2b1c057a50 con 0x7f2b30159d90 2023-07-29T02:00:13.980 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.992+0000 7f2b36b50700 1 -- 172.21.15.42:0/2969702914 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b30159660 con 0x7f2b30159d90 2023-07-29T02:00:13.981 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.993+0000 7f2b2d7fa700 1 -- 172.21.15.42:0/2969702914 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19690 (secure 0 0 0) 0x7f2b1c021090 con 0x7f2b30159d90 2023-07-29T02:00:13.982 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:13.982 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T02:00:02.394460+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T01:59:55.827461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T01:59:56.924040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-29T01:59:59.996470+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T02:00:13.983 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.996+0000 7f2b36b50700 1 -- 172.21.15.42:0/2969702914 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2b1406a660 msgr2=0x7f2b1406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:13.984 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.996+0000 7f2b36b50700 1 --2- 172.21.15.42:0/2969702914 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2b1406a660 0x7f2b1406cb10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2b30071000 tx=0x7f2b24008030 comp rx=0 tx=0).stop 2023-07-29T02:00:13.984 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.996+0000 7f2b36b50700 1 -- 172.21.15.42:0/2969702914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b30159d90 msgr2=0x7f2b30153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:13.984 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.996+0000 7f2b36b50700 1 --2- 172.21.15.42:0/2969702914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b30159d90 0x7f2b30153e40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00e9b0 tx=0x7f2b1c00ed70 comp rx=0 tx=0).stop 2023-07-29T02:00:13.984 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.996+0000 7f2b36b50700 1 -- 172.21.15.42:0/2969702914 shutdown_connections 2023-07-29T02:00:13.984 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.996+0000 7f2b36b50700 1 --2- 172.21.15.42:0/2969702914 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2b1406a660 0x7f2b1406cb10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.984 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.996+0000 7f2b36b50700 1 --2- 172.21.15.42:0/2969702914 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2b300cbb50 0x7f2b301f0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.985 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.996+0000 7f2b36b50700 1 --2- 172.21.15.42:0/2969702914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b3006b860 0x7f2b301f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.985 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.996+0000 7f2b36b50700 1 --2- 172.21.15.42:0/2969702914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2b30159d90 0x7f2b30153e40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:13.985 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.996+0000 7f2b36b50700 1 -- 172.21.15.42:0/2969702914 >> 172.21.15.42:0/2969702914 conn(0x7f2b30061190 msgr2=0x7f2b300cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:13.985 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.996+0000 7f2b36b50700 1 -- 172.21.15.42:0/2969702914 shutdown_connections 2023-07-29T02:00:13.985 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:13.996+0000 7f2b36b50700 1 -- 172.21.15.42:0/2969702914 wait complete. 2023-07-29T02:00:13.996 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-29T01:59:50.906228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-29T01:59:51.290583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T01:59:55.827461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T01:59:56.924040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-29T01:59:59.996470+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-29T02:00:13.996 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-29T02:00:14.124 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.136+0000 7f31c84d8700 1 Processor -- start 2023-07-29T02:00:14.124 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.136+0000 7f31c84d8700 1 -- start start 2023-07-29T02:00:14.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.137+0000 7f31c84d8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f31c00c8580 0x7f31c006f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:14.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.137+0000 7f31c84d8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c0071840 0x7f31c006a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:14.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.137+0000 7f31c84d8700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c006c870 con 0x7f31c01531a0 2023-07-29T02:00:14.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.137+0000 7f31c84d8700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c00c74a0 con 0x7f31c00c8580 2023-07-29T02:00:14.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.137+0000 7f31c84d8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c006fa50 con 0x7f31c0071840 2023-07-29T02:00:14.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.137+0000 7f31c6274700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f31c01531a0 0x7f31c015c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49748/0 (socket says 172.21.15.42:49748) 2023-07-29T02:00:14.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.137+0000 7f31c6274700 1 -- 172.21.15.42:0/2244218624 learned_addr learned my addr 172.21.15.42:0/2244218624 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:14.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.137+0000 7f31c6a75700 1 --2- 172.21.15.42:0/2244218624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c0071840 0x7f31c006a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:14.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.137+0000 7f31c5a73700 1 --2- 172.21.15.42:0/2244218624 >> v2:172.21.15.144:3300/0 conn(0x7f31c00c8580 0x7f31c006f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:14.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.138+0000 7f31c5272700 1 -- 172.21.15.42:0/2244218624 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393236526 0 0) 0x7f31c006c870 con 0x7f31c01531a0 2023-07-29T02:00:14.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.138+0000 7f31c5272700 1 -- 172.21.15.42:0/2244218624 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31ac0035b0 con 0x7f31c01531a0 2023-07-29T02:00:14.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.138+0000 7f31c6a75700 1 -- 172.21.15.42:0/2244218624 >> v2:172.21.15.144:3300/0 conn(0x7f31c00c8580 msgr2=0x7f31c006f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:14.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.138+0000 7f31c6a75700 1 --2- 172.21.15.42:0/2244218624 >> v2:172.21.15.144:3300/0 conn(0x7f31c00c8580 0x7f31c006f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.138+0000 7f31c5272700 1 -- 172.21.15.42:0/2244218624 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3124496488 0 0) 0x7f31ac0035b0 con 0x7f31c01531a0 2023-07-29T02:00:14.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.138+0000 7f31c6a75700 1 -- 172.21.15.42:0/2244218624 >> v1:172.21.15.42:6789/0 conn(0x7f31c01531a0 legacy=0x7f31c015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:14.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.138+0000 7f31c6a75700 1 -- 172.21.15.42:0/2244218624 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c006d450 con 0x7f31c0071840 2023-07-29T02:00:14.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.138+0000 7f31c5a73700 1 --2- 172.21.15.42:0/2244218624 >> v2:172.21.15.144:3300/0 conn(0x7f31c00c8580 0x7f31c006f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:00:14.129 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.138+0000 7f31c6a75700 1 --2- 172.21.15.42:0/2244218624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c0071840 0x7f31c006a750 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009d90 tx=0x7f31b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3061da678f0ccd58 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:14.129 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.138+0000 7f31c5272700 1 -- 172.21.15.42:0/2244218624 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b800e070 con 0x7f31c0071840 2023-07-29T02:00:14.129 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.138+0000 7f31c5272700 1 -- 172.21.15.42:0/2244218624 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b8003a20 con 0x7f31c0071840 2023-07-29T02:00:14.129 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.138+0000 7f31c5272700 1 -- 172.21.15.42:0/2244218624 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b0001670 con 0x7f31c0071840 2023-07-29T02:00:14.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.139+0000 7f31c84d8700 1 -- 172.21.15.42:0/2244218624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c0071840 msgr2=0x7f31c006a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:14.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.139+0000 7f31c84d8700 1 --2- 172.21.15.42:0/2244218624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c0071840 0x7f31c006a750 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009d90 tx=0x7f31b800b330 comp rx=0 tx=0).stop 2023-07-29T02:00:14.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.139+0000 7f31c84d8700 1 -- 172.21.15.42:0/2244218624 shutdown_connections 2023-07-29T02:00:14.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.139+0000 7f31c84d8700 1 --2- 172.21.15.42:0/2244218624 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c0071840 0x7f31c006a750 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.139+0000 7f31c84d8700 1 --2- 172.21.15.42:0/2244218624 >> v2:172.21.15.144:3300/0 conn(0x7f31c00c8580 0x7f31c006f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.139+0000 7f31c84d8700 1 -- 172.21.15.42:0/2244218624 >> 172.21.15.42:0/2244218624 conn(0x7f31c00cbf10 msgr2=0x7f31c00cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:14.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.139+0000 7f31c84d8700 1 -- 172.21.15.42:0/2244218624 shutdown_connections 2023-07-29T02:00:14.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.139+0000 7f31c84d8700 1 -- 172.21.15.42:0/2244218624 wait complete. 2023-07-29T02:00:14.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.140+0000 7f31c84d8700 1 Processor -- start 2023-07-29T02:00:14.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.140+0000 7f31c84d8700 1 -- start start 2023-07-29T02:00:14.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.141+0000 7f31c84d8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c0071840 0x7f31c006a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:14.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.141+0000 7f31c84d8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31c00c8580 0x7f31c0153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:14.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.141+0000 7f31c84d8700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31c01531a0 0x7f31c01f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:14.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.141+0000 7f31c84d8700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c0151cf0 con 0x7f31c01531a0 2023-07-29T02:00:14.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.141+0000 7f31c84d8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c014c390 con 0x7f31c00c8580 2023-07-29T02:00:14.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.141+0000 7f31c84d8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c014baf0 con 0x7f31c0071840 2023-07-29T02:00:14.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.141+0000 7f31c6a75700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31c01531a0 0x7f31c01f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:14.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.141+0000 7f31c6a75700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31c01531a0 0x7f31c01f2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55954/0 (socket says 172.21.15.42:55954) 2023-07-29T02:00:14.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.141+0000 7f31c6a75700 1 -- 172.21.15.42:0/374471493 learned_addr learned my addr 172.21.15.42:0/374471493 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:14.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.141+0000 7f31c6274700 1 --2- 172.21.15.42:0/374471493 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c0071840 0x7f31c006a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:14.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.141+0000 7f31c5a73700 1 --2- 172.21.15.42:0/374471493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31c00c8580 0x7f31c0153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:14.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.141+0000 7f31c6a75700 1 -- 172.21.15.42:0/374471493 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c0071840 msgr2=0x7f31c006a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:14.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.141+0000 7f31c6a75700 1 --2- 172.21.15.42:0/374471493 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c0071840 0x7f31c006a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.141+0000 7f31c6a75700 1 -- 172.21.15.42:0/374471493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31c00c8580 msgr2=0x7f31c0153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:14.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.141+0000 7f31c6a75700 1 --2- 172.21.15.42:0/374471493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31c00c8580 0x7f31c0153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.135 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.141+0000 7f31c6a75700 1 -- 172.21.15.42:0/374471493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31bc0094a0 con 0x7f31c01531a0 2023-07-29T02:00:14.135 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.141+0000 7f31c6a75700 1 --2- 172.21.15.42:0/374471493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31c01531a0 0x7f31c01f2190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f31c006fb90 tx=0x7f31b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:14.135 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.142+0000 7f31b6ffd700 1 -- 172.21.15.42:0/374471493 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8009410 con 0x7f31c01531a0 2023-07-29T02:00:14.135 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.142+0000 7f31b6ffd700 1 -- 172.21.15.42:0/374471493 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b8004460 con 0x7f31c01531a0 2023-07-29T02:00:14.135 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.142+0000 7f31c84d8700 1 -- 172.21.15.42:0/374471493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b8009a70 con 0x7f31c01531a0 2023-07-29T02:00:14.135 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.142+0000 7f31b6ffd700 1 -- 172.21.15.42:0/374471493 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8004810 con 0x7f31c01531a0 2023-07-29T02:00:14.135 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.142+0000 7f31c84d8700 1 -- 172.21.15.42:0/374471493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c014c0b0 con 0x7f31c01531a0 2023-07-29T02:00:14.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.143+0000 7f31c84d8700 1 -- 172.21.15.42:0/374471493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c004ea50 con 0x7f31c01531a0 2023-07-29T02:00:14.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.143+0000 7f31b6ffd700 1 -- 172.21.15.42:0/374471493 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f31b8012430 con 0x7f31c01531a0 2023-07-29T02:00:14.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.144+0000 7f31b6ffd700 1 --2- 172.21.15.42:0/374471493 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f31a406a690 0x7f31a406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:14.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.144+0000 7f31b6ffd700 1 -- 172.21.15.42:0/374471493 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f31b808a8a0 con 0x7f31c01531a0 2023-07-29T02:00:14.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.144+0000 7f31c6274700 1 --2- 172.21.15.42:0/374471493 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f31a406a690 0x7f31a406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:14.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.144+0000 7f31c6274700 1 --2- 172.21.15.42:0/374471493 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f31a406a690 0x7f31a406cb40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f31b0000f60 tx=0x7f31b0001e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:14.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.148+0000 7f31b6ffd700 1 -- 172.21.15.42:0/374471493 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f31b8055930 con 0x7f31c01531a0 2023-07-29T02:00:14.333 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.345+0000 7f31c84d8700 1 -- 172.21.15.42:0/374471493 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f31c01568f0 con 0x7f31c01531a0 2023-07-29T02:00:14.334 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.346+0000 7f31b6ffd700 1 -- 172.21.15.42:0/374471493 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f31b8058f50 con 0x7f31c01531a0 2023-07-29T02:00:14.334 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 8 2023-07-29T02:00:14.336 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.348+0000 7f31c84d8700 1 -- 172.21.15.42:0/374471493 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f31a406a690 msgr2=0x7f31a406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:14.336 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.348+0000 7f31c84d8700 1 --2- 172.21.15.42:0/374471493 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f31a406a690 0x7f31a406cb40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f31b0000f60 tx=0x7f31b0001e00 comp rx=0 tx=0).stop 2023-07-29T02:00:14.337 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.348+0000 7f31c84d8700 1 -- 172.21.15.42:0/374471493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31c01531a0 msgr2=0x7f31c01f2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:14.337 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.348+0000 7f31c84d8700 1 --2- 172.21.15.42:0/374471493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31c01531a0 0x7f31c01f2190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f31c006fb90 tx=0x7f31b8004ad0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.337 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.348+0000 7f31c84d8700 1 -- 172.21.15.42:0/374471493 shutdown_connections 2023-07-29T02:00:14.337 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.348+0000 7f31c84d8700 1 --2- 172.21.15.42:0/374471493 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f31a406a690 0x7f31a406cb40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.338 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.348+0000 7f31c84d8700 1 --2- 172.21.15.42:0/374471493 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31c01531a0 0x7f31c01f2190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.338 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.348+0000 7f31c84d8700 1 --2- 172.21.15.42:0/374471493 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31c0071840 0x7f31c006a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.338 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.348+0000 7f31c84d8700 1 --2- 172.21.15.42:0/374471493 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31c00c8580 0x7f31c0153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.338 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.348+0000 7f31c84d8700 1 -- 172.21.15.42:0/374471493 >> 172.21.15.42:0/374471493 conn(0x7f31c00cbf10 msgr2=0x7f31c00c93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:14.338 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.348+0000 7f31c84d8700 1 -- 172.21.15.42:0/374471493 shutdown_connections 2023-07-29T02:00:14.338 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.348+0000 7f31c84d8700 1 -- 172.21.15.42:0/374471493 wait complete. 2023-07-29T02:00:14.347 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-29T02:00:14.475 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.488+0000 7f29f631b700 1 Processor -- start 2023-07-29T02:00:14.476 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.488+0000 7f29f631b700 1 -- start start 2023-07-29T02:00:14.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.488+0000 7f29f631b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29f01512f0 0x7f29f00c5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:14.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.489+0000 7f29f631b700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f0157710 con 0x7f29f0061520 2023-07-29T02:00:14.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.489+0000 7f29f631b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f00c8e20 con 0x7f29f00c2b90 2023-07-29T02:00:14.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.489+0000 7f29f631b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f0156e00 con 0x7f29f01512f0 2023-07-29T02:00:14.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.489+0000 7f29ef7fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f29f0061520 0x7f29f00c67e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49762/0 (socket says 172.21.15.42:49762) 2023-07-29T02:00:14.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.489+0000 7f29ef7fe700 1 -- 172.21.15.42:0/507651712 learned_addr learned my addr 172.21.15.42:0/507651712 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:14.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.489+0000 7f29effff700 1 --2- 172.21.15.42:0/507651712 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29f01512f0 0x7f29f00c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:14.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.489+0000 7f29eeffd700 1 -- 172.21.15.42:0/507651712 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 713033713 0 0) 0x7f29f0157710 con 0x7f29f0061520 2023-07-29T02:00:14.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.489+0000 7f29eeffd700 1 -- 172.21.15.42:0/507651712 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29d80035b0 con 0x7f29f0061520 2023-07-29T02:00:14.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.489+0000 7f29eeffd700 1 -- 172.21.15.42:0/507651712 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931344334 0 0) 0x7f29f00c8e20 con 0x7f29f00c2b90 2023-07-29T02:00:14.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.489+0000 7f29eeffd700 1 -- 172.21.15.42:0/507651712 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29f0157710 con 0x7f29f00c2b90 2023-07-29T02:00:14.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.489+0000 7f29eeffd700 1 -- 172.21.15.42:0/507651712 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3871885855 0 0) 0x7f29d80035b0 con 0x7f29f0061520 2023-07-29T02:00:14.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.489+0000 7f29effff700 1 -- 172.21.15.42:0/507651712 >> v1:172.21.15.144:6789/0 conn(0x7f29f00c2b90 legacy=0x7f29f01616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:14.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.489+0000 7f29effff700 1 -- 172.21.15.42:0/507651712 >> v1:172.21.15.42:6789/0 conn(0x7f29f0061520 legacy=0x7f29f00c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:14.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.489+0000 7f29effff700 1 -- 172.21.15.42:0/507651712 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f00c7bb0 con 0x7f29f01512f0 2023-07-29T02:00:14.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.489+0000 7f29effff700 1 --2- 172.21.15.42:0/507651712 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29f01512f0 0x7f29f00c5510 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f29e0009870 tx=0x7f29e0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=231f88e5ca2baa2a server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:14.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.490+0000 7f29eeffd700 1 -- 172.21.15.42:0/507651712 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4001670 con 0x7f29f01512f0 2023-07-29T02:00:14.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.490+0000 7f29eeffd700 1 -- 172.21.15.42:0/507651712 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e0004030 con 0x7f29f01512f0 2023-07-29T02:00:14.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.490+0000 7f29eeffd700 1 -- 172.21.15.42:0/507651712 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e00043c0 con 0x7f29f01512f0 2023-07-29T02:00:14.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.490+0000 7f29f631b700 1 -- 172.21.15.42:0/507651712 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29f01512f0 msgr2=0x7f29f00c5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:14.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.490+0000 7f29f631b700 1 --2- 172.21.15.42:0/507651712 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29f01512f0 0x7f29f00c5510 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f29e0009870 tx=0x7f29e0009b80 comp rx=0 tx=0).stop 2023-07-29T02:00:14.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.490+0000 7f29f631b700 1 -- 172.21.15.42:0/507651712 shutdown_connections 2023-07-29T02:00:14.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.490+0000 7f29f631b700 1 --2- 172.21.15.42:0/507651712 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29f01512f0 0x7f29f00c5510 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.490+0000 7f29f631b700 1 -- 172.21.15.42:0/507651712 >> 172.21.15.42:0/507651712 conn(0x7f29f00cc420 msgr2=0x7f29f00c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:14.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.490+0000 7f29f631b700 1 -- 172.21.15.42:0/507651712 shutdown_connections 2023-07-29T02:00:14.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.490+0000 7f29f631b700 1 -- 172.21.15.42:0/507651712 wait complete. 2023-07-29T02:00:14.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.491+0000 7f29f631b700 1 Processor -- start 2023-07-29T02:00:14.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.492+0000 7f29f631b700 1 -- start start 2023-07-29T02:00:14.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.492+0000 7f29f631b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29f0061520 0x7f29f01e0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:14.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.492+0000 7f29f631b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f00c2b90 0x7f29f014d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:14.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.492+0000 7f29f631b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29f01512f0 0x7f29f01ee540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:14.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.492+0000 7f29f631b700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f014e230 con 0x7f29f00c2b90 2023-07-29T02:00:14.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.492+0000 7f29f631b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f00ca960 con 0x7f29f01512f0 2023-07-29T02:00:14.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.492+0000 7f29f631b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f00cabb0 con 0x7f29f0061520 2023-07-29T02:00:14.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.492+0000 7f29ef7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f00c2b90 0x7f29f014d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:14.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.493+0000 7f29ef7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f00c2b90 0x7f29f014d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55966/0 (socket says 172.21.15.42:55966) 2023-07-29T02:00:14.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.493+0000 7f29ef7fe700 1 -- 172.21.15.42:0/160074258 learned_addr learned my addr 172.21.15.42:0/160074258 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:14.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.493+0000 7f29effff700 1 --2- 172.21.15.42:0/160074258 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29f0061520 0x7f29f01e0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:14.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.493+0000 7f29f48b8700 1 --2- 172.21.15.42:0/160074258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29f01512f0 0x7f29f01ee540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:14.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.493+0000 7f29ef7fe700 1 -- 172.21.15.42:0/160074258 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29f0061520 msgr2=0x7f29f01e0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:14.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.493+0000 7f29ef7fe700 1 --2- 172.21.15.42:0/160074258 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29f0061520 0x7f29f01e0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.493+0000 7f29ef7fe700 1 -- 172.21.15.42:0/160074258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29f01512f0 msgr2=0x7f29f01ee540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:14.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.493+0000 7f29ef7fe700 1 --2- 172.21.15.42:0/160074258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29f01512f0 0x7f29f01ee540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.493+0000 7f29ef7fe700 1 -- 172.21.15.42:0/160074258 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e00094a0 con 0x7f29f00c2b90 2023-07-29T02:00:14.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.493+0000 7f29f48b8700 1 --2- 172.21.15.42:0/160074258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29f01512f0 0x7f29f01ee540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:14.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.493+0000 7f29ef7fe700 1 --2- 172.21.15.42:0/160074258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f00c2b90 0x7f29f014d870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f29e400c730 tx=0x7f29e400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:14.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.493+0000 7f29ecff9700 1 -- 172.21.15.42:0/160074258 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4004c80 con 0x7f29f00c2b90 2023-07-29T02:00:14.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.493+0000 7f29ecff9700 1 -- 172.21.15.42:0/160074258 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e4004e00 con 0x7f29f00c2b90 2023-07-29T02:00:14.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.493+0000 7f29f631b700 1 -- 172.21.15.42:0/160074258 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f014df50 con 0x7f29f00c2b90 2023-07-29T02:00:14.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.493+0000 7f29ecff9700 1 -- 172.21.15.42:0/160074258 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e4007310 con 0x7f29f00c2b90 2023-07-29T02:00:14.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.493+0000 7f29f631b700 1 -- 172.21.15.42:0/160074258 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f006e840 con 0x7f29f00c2b90 2023-07-29T02:00:14.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.494+0000 7f29f631b700 1 -- 172.21.15.42:0/160074258 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f01593d0 con 0x7f29f00c2b90 2023-07-29T02:00:14.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.495+0000 7f29ecff9700 1 -- 172.21.15.42:0/160074258 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f29e4007470 con 0x7f29f00c2b90 2023-07-29T02:00:14.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.495+0000 7f29ecff9700 1 --2- 172.21.15.42:0/160074258 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f29dc06a660 0x7f29dc06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:14.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.495+0000 7f29ecff9700 1 -- 172.21.15.42:0/160074258 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f29e4088b20 con 0x7f29f00c2b90 2023-07-29T02:00:14.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.495+0000 7f29effff700 1 --2- 172.21.15.42:0/160074258 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f29dc06a660 0x7f29dc06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:14.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.496+0000 7f29effff700 1 --2- 172.21.15.42:0/160074258 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f29dc06a660 0x7f29dc06cb10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f29e00090b0 tx=0x7f29e0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:14.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.499+0000 7f29ecff9700 1 -- 172.21.15.42:0/160074258 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f29f01593d0 con 0x7f29f00c2b90 2023-07-29T02:00:14.683 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.695+0000 7f29f631b700 1 -- 172.21.15.42:0/160074258 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29f01593d0 con 0x7f29f00c2b90 2023-07-29T02:00:14.683 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.695+0000 7f29ecff9700 1 -- 172.21.15.42:0/160074258 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29f01593d0 con 0x7f29f00c2b90 2023-07-29T02:00:14.683 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2023-07-29T02:00:14.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.697+0000 7f29f631b700 1 -- 172.21.15.42:0/160074258 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f29dc06a660 msgr2=0x7f29dc06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:14.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.697+0000 7f29f631b700 1 --2- 172.21.15.42:0/160074258 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f29dc06a660 0x7f29dc06cb10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f29e00090b0 tx=0x7f29e0008030 comp rx=0 tx=0).stop 2023-07-29T02:00:14.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.697+0000 7f29f631b700 1 -- 172.21.15.42:0/160074258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f00c2b90 msgr2=0x7f29f014d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:14.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.697+0000 7f29f631b700 1 --2- 172.21.15.42:0/160074258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f00c2b90 0x7f29f014d870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f29e400c730 tx=0x7f29e400ca40 comp rx=0 tx=0).stop 2023-07-29T02:00:14.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.697+0000 7f29f631b700 1 -- 172.21.15.42:0/160074258 shutdown_connections 2023-07-29T02:00:14.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.697+0000 7f29f631b700 1 --2- 172.21.15.42:0/160074258 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f29dc06a660 0x7f29dc06cb10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.697+0000 7f29f631b700 1 --2- 172.21.15.42:0/160074258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29f01512f0 0x7f29f01ee540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.697+0000 7f29f631b700 1 --2- 172.21.15.42:0/160074258 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f29f0061520 0x7f29f01e0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.697+0000 7f29f631b700 1 --2- 172.21.15.42:0/160074258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f29f00c2b90 0x7f29f014d870 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.697+0000 7f29f631b700 1 -- 172.21.15.42:0/160074258 >> 172.21.15.42:0/160074258 conn(0x7f29f00cc420 msgr2=0x7f29f0150580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:14.687 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.697+0000 7f29f631b700 1 -- 172.21.15.42:0/160074258 shutdown_connections 2023-07-29T02:00:14.687 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.697+0000 7f29f631b700 1 -- 172.21.15.42:0/160074258 wait complete. 2023-07-29T02:00:14.697 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-29T02:00:14.825 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.837+0000 7f3caa7ce700 1 Processor -- start 2023-07-29T02:00:14.825 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.837+0000 7f3caa7ce700 1 -- start start 2023-07-29T02:00:14.827 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.838+0000 7f3caa7ce700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3ca4061520 0x7f3ca40c5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:14.827 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.838+0000 7f3caa7ce700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3ca40c2b90 0x7f3ca40c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:14.827 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.838+0000 7f3caa7ce700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ca4157710 con 0x7f3ca41512f0 2023-07-29T02:00:14.827 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.838+0000 7f3caa7ce700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca40c34d0 con 0x7f3ca40c2b90 2023-07-29T02:00:14.828 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.838+0000 7f3caa7ce700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca40c8e20 con 0x7f3ca4061520 2023-07-29T02:00:14.828 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.838+0000 7f3ca8d6b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3ca40c2b90 0x7f3ca40c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:14.828 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.838+0000 7f3ca3fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f3ca41512f0 0x7f3ca40c67e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49776/0 (socket says 172.21.15.42:49776) 2023-07-29T02:00:14.828 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.838+0000 7f3ca8d6b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3ca40c2b90 0x7f3ca40c2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55976/0 (socket says 172.21.15.42:55976) 2023-07-29T02:00:14.828 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.838+0000 7f3ca3fff700 1 -- 172.21.15.42:0/1118177155 learned_addr learned my addr 172.21.15.42:0/1118177155 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:14.828 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.838+0000 7f3ca37fe700 1 --2- 172.21.15.42:0/1118177155 >> v2:172.21.15.144:3300/0 conn(0x7f3ca4061520 0x7f3ca40c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:14.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.838+0000 7f3ca8d6b700 1 -- 172.21.15.42:0/1118177155 >> v2:172.21.15.144:3300/0 conn(0x7f3ca4061520 msgr2=0x7f3ca40c5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:14.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.838+0000 7f3ca8d6b700 1 --2- 172.21.15.42:0/1118177155 >> v2:172.21.15.144:3300/0 conn(0x7f3ca4061520 0x7f3ca40c5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.838+0000 7f3ca8d6b700 1 -- 172.21.15.42:0/1118177155 >> v1:172.21.15.42:6789/0 conn(0x7f3ca41512f0 legacy=0x7f3ca40c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:14.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.838+0000 7f3ca8d6b700 1 -- 172.21.15.42:0/1118177155 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca4156e00 con 0x7f3ca40c2b90 2023-07-29T02:00:14.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.838+0000 7f3ca2ffd700 1 -- 172.21.15.42:0/1118177155 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207929761 0 0) 0x7f3ca4157710 con 0x7f3ca41512f0 2023-07-29T02:00:14.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.838+0000 7f3ca37fe700 1 --2- 172.21.15.42:0/1118177155 >> v2:172.21.15.144:3300/0 conn(0x7f3ca4061520 0x7f3ca40c5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:14.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.838+0000 7f3ca8d6b700 1 --2- 172.21.15.42:0/1118177155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ca40c2b90 0x7f3ca40c2f90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4070280 tx=0x7f3c9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad48e1d062c55be server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:14.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.838+0000 7f3ca2ffd700 1 -- 172.21.15.42:0/1118177155 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c00e070 con 0x7f3ca40c2b90 2023-07-29T02:00:14.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.839+0000 7f3ca2ffd700 1 -- 172.21.15.42:0/1118177155 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c00bbd0 con 0x7f3ca40c2b90 2023-07-29T02:00:14.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.839+0000 7f3ca2ffd700 1 -- 172.21.15.42:0/1118177155 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c012430 con 0x7f3ca40c2b90 2023-07-29T02:00:14.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.839+0000 7f3caa7ce700 1 -- 172.21.15.42:0/1118177155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ca40c2b90 msgr2=0x7f3ca40c2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:14.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.839+0000 7f3caa7ce700 1 --2- 172.21.15.42:0/1118177155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ca40c2b90 0x7f3ca40c2f90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4070280 tx=0x7f3c9c00b330 comp rx=0 tx=0).stop 2023-07-29T02:00:14.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.839+0000 7f3caa7ce700 1 -- 172.21.15.42:0/1118177155 shutdown_connections 2023-07-29T02:00:14.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.839+0000 7f3caa7ce700 1 --2- 172.21.15.42:0/1118177155 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ca40c2b90 0x7f3ca40c2f90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.839+0000 7f3caa7ce700 1 --2- 172.21.15.42:0/1118177155 >> v2:172.21.15.144:3300/0 conn(0x7f3ca4061520 0x7f3ca40c5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.839+0000 7f3caa7ce700 1 -- 172.21.15.42:0/1118177155 >> 172.21.15.42:0/1118177155 conn(0x7f3ca40cc420 msgr2=0x7f3ca40c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:14.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.839+0000 7f3caa7ce700 1 -- 172.21.15.42:0/1118177155 shutdown_connections 2023-07-29T02:00:14.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.839+0000 7f3caa7ce700 1 -- 172.21.15.42:0/1118177155 wait complete. 2023-07-29T02:00:14.833 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.840+0000 7f3caa7ce700 1 Processor -- start 2023-07-29T02:00:14.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.841+0000 7f3caa7ce700 1 -- start start 2023-07-29T02:00:14.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.841+0000 7f3caa7ce700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ca4061520 0x7f3ca41e0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:14.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.841+0000 7f3caa7ce700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ca40c2b90 0x7f3ca41ecce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:14.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.841+0000 7f3caa7ce700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ca41512f0 0x7f3ca40c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:14.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.841+0000 7f3caa7ce700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca41e0070 con 0x7f3ca41512f0 2023-07-29T02:00:14.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.841+0000 7f3caa7ce700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca41ec2d0 con 0x7f3ca40c2b90 2023-07-29T02:00:14.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.841+0000 7f3caa7ce700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca41f0740 con 0x7f3ca4061520 2023-07-29T02:00:14.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.841+0000 7f3ca8d6b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ca41512f0 0x7f3ca40c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:14.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.841+0000 7f3ca8d6b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ca41512f0 0x7f3ca40c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55982/0 (socket says 172.21.15.42:55982) 2023-07-29T02:00:14.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.841+0000 7f3ca8d6b700 1 -- 172.21.15.42:0/2894824318 learned_addr learned my addr 172.21.15.42:0/2894824318 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:14.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.841+0000 7f3ca37fe700 1 --2- 172.21.15.42:0/2894824318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ca40c2b90 0x7f3ca41ecce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:14.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.841+0000 7f3ca3fff700 1 --2- 172.21.15.42:0/2894824318 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ca4061520 0x7f3ca41e0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:14.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.842+0000 7f3ca8d6b700 1 -- 172.21.15.42:0/2894824318 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ca4061520 msgr2=0x7f3ca41e0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:14.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.842+0000 7f3ca8d6b700 1 --2- 172.21.15.42:0/2894824318 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ca4061520 0x7f3ca41e0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.842+0000 7f3ca8d6b700 1 -- 172.21.15.42:0/2894824318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ca40c2b90 msgr2=0x7f3ca41ecce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:14.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.842+0000 7f3ca8d6b700 1 --2- 172.21.15.42:0/2894824318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ca40c2b90 0x7f3ca41ecce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:14.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.842+0000 7f3ca8d6b700 1 -- 172.21.15.42:0/2894824318 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c009a70 con 0x7f3ca41512f0 2023-07-29T02:00:14.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.842+0000 7f3ca3fff700 1 --2- 172.21.15.42:0/2894824318 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ca4061520 0x7f3ca41e0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:14.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.842+0000 7f3ca8d6b700 1 --2- 172.21.15.42:0/2894824318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ca41512f0 0x7f3ca40c8280 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4068000 tx=0x7f3c9c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:14.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.842+0000 7f3ca0ff9700 1 -- 172.21.15.42:0/2894824318 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c012430 con 0x7f3ca41512f0 2023-07-29T02:00:14.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.842+0000 7f3ca0ff9700 1 -- 172.21.15.42:0/2894824318 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9c020070 con 0x7f3ca41512f0 2023-07-29T02:00:14.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.842+0000 7f3caa7ce700 1 -- 172.21.15.42:0/2894824318 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca41543e0 con 0x7f3ca41512f0 2023-07-29T02:00:14.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.842+0000 7f3ca0ff9700 1 -- 172.21.15.42:0/2894824318 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c004280 con 0x7f3ca41512f0 2023-07-29T02:00:14.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.842+0000 7f3caa7ce700 1 -- 172.21.15.42:0/2894824318 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca4154680 con 0x7f3ca41512f0 2023-07-29T02:00:14.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.843+0000 7f3caa7ce700 1 -- 172.21.15.42:0/2894824318 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca404ea50 con 0x7f3ca41512f0 2023-07-29T02:00:14.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.843+0000 7f3ca0ff9700 1 -- 172.21.15.42:0/2894824318 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f3c9c0043e0 con 0x7f3ca41512f0 2023-07-29T02:00:14.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.844+0000 7f3ca0ff9700 1 --2- 172.21.15.42:0/2894824318 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3c9006a690 0x7f3c9006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:14.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.844+0000 7f3ca0ff9700 1 -- 172.21.15.42:0/2894824318 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3c9c022070 con 0x7f3ca41512f0 2023-07-29T02:00:14.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.844+0000 7f3ca3fff700 1 --2- 172.21.15.42:0/2894824318 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3c9006a690 0x7f3c9006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:14.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.844+0000 7f3ca3fff700 1 --2- 172.21.15.42:0/2894824318 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3c9006a690 0x7f3c9006cb40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3c94000f60 tx=0x7f3c94007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:14.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:14.848+0000 7f3ca0ff9700 1 -- 172.21.15.42:0/2894824318 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f3c9c055dd0 con 0x7f3ca41512f0 2023-07-29T02:00:15.033 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.046+0000 7f3caa7ce700 1 -- 172.21.15.42:0/2894824318 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3ca40c4490 con 0x7f3ca41512f0 2023-07-29T02:00:15.034 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.046+0000 7f3ca0ff9700 1 -- 172.21.15.42:0/2894824318 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3c9c0593f0 con 0x7f3ca41512f0 2023-07-29T02:00:15.034 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2023-07-29T02:00:15.036 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.048+0000 7f3caa7ce700 1 -- 172.21.15.42:0/2894824318 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3c9006a690 msgr2=0x7f3c9006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:15.036 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.048+0000 7f3caa7ce700 1 --2- 172.21.15.42:0/2894824318 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3c9006a690 0x7f3c9006cb40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3c94000f60 tx=0x7f3c94007d30 comp rx=0 tx=0).stop 2023-07-29T02:00:15.036 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.048+0000 7f3caa7ce700 1 -- 172.21.15.42:0/2894824318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ca41512f0 msgr2=0x7f3ca40c8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:15.036 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.048+0000 7f3caa7ce700 1 --2- 172.21.15.42:0/2894824318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ca41512f0 0x7f3ca40c8280 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4068000 tx=0x7f3c9c004ad0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.036 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.048+0000 7f3caa7ce700 1 -- 172.21.15.42:0/2894824318 shutdown_connections 2023-07-29T02:00:15.036 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.048+0000 7f3caa7ce700 1 --2- 172.21.15.42:0/2894824318 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3c9006a690 0x7f3c9006cb40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.036 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.048+0000 7f3caa7ce700 1 --2- 172.21.15.42:0/2894824318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3ca41512f0 0x7f3ca40c8280 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.037 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.048+0000 7f3caa7ce700 1 --2- 172.21.15.42:0/2894824318 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3ca4061520 0x7f3ca41e0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.037 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.048+0000 7f3caa7ce700 1 --2- 172.21.15.42:0/2894824318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ca40c2b90 0x7f3ca41ecce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.037 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.048+0000 7f3caa7ce700 1 -- 172.21.15.42:0/2894824318 >> 172.21.15.42:0/2894824318 conn(0x7f3ca40cc420 msgr2=0x7f3ca4155b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:15.037 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.048+0000 7f3caa7ce700 1 -- 172.21.15.42:0/2894824318 shutdown_connections 2023-07-29T02:00:15.037 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.048+0000 7f3caa7ce700 1 -- 172.21.15.42:0/2894824318 wait complete. 2023-07-29T02:00:15.048 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-29T02:00:15.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.188+0000 7febfd0db700 1 Processor -- start 2023-07-29T02:00:15.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.188+0000 7febfd0db700 1 -- start start 2023-07-29T02:00:15.181 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.189+0000 7febfd0db700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7febf8070f80 0x7febf80c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:15.181 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.189+0000 7febfd0db700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7febf8152c50 0x7febf81530b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:15.181 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.189+0000 7febfd0db700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf80c6c80 con 0x7febf8070bb0 2023-07-29T02:00:15.181 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.189+0000 7febfd0db700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf80c7520 con 0x7febf8152c50 2023-07-29T02:00:15.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.189+0000 7febfd0db700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf81535f0 con 0x7febf8070f80 2023-07-29T02:00:15.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.189+0000 7febf759e700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7febf8152c50 0x7febf81530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:15.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.189+0000 7febf759e700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7febf8152c50 0x7febf81530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55990/0 (socket says 172.21.15.42:55990) 2023-07-29T02:00:15.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.189+0000 7febf759e700 1 -- 172.21.15.42:0/3161378152 learned_addr learned my addr 172.21.15.42:0/3161378152 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:15.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.189+0000 7febf659c700 1 --2- 172.21.15.42:0/3161378152 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7febf8070f80 0x7febf80c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:15.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.189+0000 7febf759e700 1 -- 172.21.15.42:0/3161378152 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7febf8070f80 msgr2=0x7febf80c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:15.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.189+0000 7febf759e700 1 --2- 172.21.15.42:0/3161378152 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7febf8070f80 0x7febf80c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.189+0000 7febf759e700 1 -- 172.21.15.42:0/3161378152 >> v1:172.21.15.144:6789/0 conn(0x7febf8070bb0 legacy=0x7febf8159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:15.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.189+0000 7febf759e700 1 -- 172.21.15.42:0/3161378152 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf80723f0 con 0x7febf8152c50 2023-07-29T02:00:15.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.189+0000 7febf759e700 1 --2- 172.21.15.42:0/3161378152 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf8152c50 0x7febf81530b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7febf0009e50 tx=0x7febf000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273b655d3c0a8f6c server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:15.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.189+0000 7febf5d9b700 1 -- 172.21.15.42:0/3161378152 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf000e070 con 0x7febf8152c50 2023-07-29T02:00:15.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.189+0000 7febf5d9b700 1 -- 172.21.15.42:0/3161378152 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf000b910 con 0x7febf8152c50 2023-07-29T02:00:15.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.189+0000 7febf5d9b700 1 -- 172.21.15.42:0/3161378152 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf000bcc0 con 0x7febf8152c50 2023-07-29T02:00:15.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.190+0000 7febfd0db700 1 -- 172.21.15.42:0/3161378152 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf8152c50 msgr2=0x7febf81530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:15.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.190+0000 7febfd0db700 1 --2- 172.21.15.42:0/3161378152 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf8152c50 0x7febf81530b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7febf0009e50 tx=0x7febf000b330 comp rx=0 tx=0).stop 2023-07-29T02:00:15.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.190+0000 7febfd0db700 1 -- 172.21.15.42:0/3161378152 shutdown_connections 2023-07-29T02:00:15.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.190+0000 7febfd0db700 1 --2- 172.21.15.42:0/3161378152 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf8152c50 0x7febf81530b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.190+0000 7febfd0db700 1 --2- 172.21.15.42:0/3161378152 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7febf8070f80 0x7febf80c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.190+0000 7febfd0db700 1 -- 172.21.15.42:0/3161378152 >> 172.21.15.42:0/3161378152 conn(0x7febf80cc420 msgr2=0x7febf80c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:15.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.190+0000 7febfd0db700 1 -- 172.21.15.42:0/3161378152 shutdown_connections 2023-07-29T02:00:15.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.190+0000 7febfd0db700 1 -- 172.21.15.42:0/3161378152 wait complete. 2023-07-29T02:00:15.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.191+0000 7febfd0db700 1 Processor -- start 2023-07-29T02:00:15.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.192+0000 7febfd0db700 1 -- start start 2023-07-29T02:00:15.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.192+0000 7febfd0db700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febf8070bb0 0x7febf81498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:15.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.192+0000 7febfd0db700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf8070f80 0x7febf81efbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:15.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.192+0000 7febfd0db700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7febf8152c50 0x7febf8153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:15.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.192+0000 7febfd0db700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf80bf560 con 0x7febf8070f80 2023-07-29T02:00:15.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.192+0000 7febfd0db700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf81ef200 con 0x7febf8070bb0 2023-07-29T02:00:15.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.192+0000 7febfd0db700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf81ef6f0 con 0x7febf8152c50 2023-07-29T02:00:15.186 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.192+0000 7febf659c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf8070f80 0x7febf81efbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:15.186 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.192+0000 7febf659c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf8070f80 0x7febf81efbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:55994/0 (socket says 172.21.15.42:55994) 2023-07-29T02:00:15.186 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.192+0000 7febf659c700 1 -- 172.21.15.42:0/2499739999 learned_addr learned my addr 172.21.15.42:0/2499739999 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:15.186 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.192+0000 7febf759e700 1 --2- 172.21.15.42:0/2499739999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7febf8152c50 0x7febf8153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:15.186 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.193+0000 7febf6d9d700 1 --2- 172.21.15.42:0/2499739999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febf8070bb0 0x7febf81498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:15.186 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.193+0000 7febf659c700 1 -- 172.21.15.42:0/2499739999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7febf8152c50 msgr2=0x7febf8153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:15.186 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.193+0000 7febf659c700 1 --2- 172.21.15.42:0/2499739999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7febf8152c50 0x7febf8153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.186 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.193+0000 7febf659c700 1 -- 172.21.15.42:0/2499739999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febf8070bb0 msgr2=0x7febf81498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:15.187 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.193+0000 7febf659c700 1 --2- 172.21.15.42:0/2499739999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febf8070bb0 0x7febf81498c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.187 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.193+0000 7febf659c700 1 -- 172.21.15.42:0/2499739999 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf0009b30 con 0x7febf8070f80 2023-07-29T02:00:15.187 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.193+0000 7febf659c700 1 --2- 172.21.15.42:0/2499739999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf8070f80 0x7febf81efbf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7febec00e9b0 tx=0x7febec00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:15.187 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.193+0000 7febdf7fe700 1 -- 172.21.15.42:0/2499739999 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec009710 con 0x7febf8070f80 2023-07-29T02:00:15.187 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.193+0000 7febdf7fe700 1 -- 172.21.15.42:0/2499739999 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febec00c850 con 0x7febf8070f80 2023-07-29T02:00:15.187 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.193+0000 7febfd0db700 1 -- 172.21.15.42:0/2499739999 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf8154dd0 con 0x7febf8070f80 2023-07-29T02:00:15.187 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.193+0000 7febdf7fe700 1 -- 172.21.15.42:0/2499739999 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febec00cbc0 con 0x7febf8070f80 2023-07-29T02:00:15.187 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.193+0000 7febfd0db700 1 -- 172.21.15.42:0/2499739999 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf8155070 con 0x7febf8070f80 2023-07-29T02:00:15.188 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.194+0000 7febfd0db700 1 -- 172.21.15.42:0/2499739999 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf804ea50 con 0x7febf8070f80 2023-07-29T02:00:15.189 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.194+0000 7febdf7fe700 1 -- 172.21.15.42:0/2499739999 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7febec00cd20 con 0x7febf8070f80 2023-07-29T02:00:15.189 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.195+0000 7febdf7fe700 1 --2- 172.21.15.42:0/2499739999 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7febe406a690 0x7febe406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:15.189 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.195+0000 7febdf7fe700 1 -- 172.21.15.42:0/2499739999 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7febec089230 con 0x7febf8070f80 2023-07-29T02:00:15.189 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.195+0000 7febf6d9d700 1 --2- 172.21.15.42:0/2499739999 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7febe406a690 0x7febe406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:15.189 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.195+0000 7febf6d9d700 1 --2- 172.21.15.42:0/2499739999 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7febe406a690 0x7febe406cb40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7febe8000f60 tx=0x7febe8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:15.189 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.199+0000 7febdf7fe700 1 -- 172.21.15.42:0/2499739999 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7febec057dd0 con 0x7febf8070f80 2023-07-29T02:00:15.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.399+0000 7febfd0db700 1 -- 172.21.15.42:0/2499739999 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7febf80717b0 con 0x7febf8070f80 2023-07-29T02:00:15.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.399+0000 7febdf7fe700 1 -- 172.21.15.42:0/2499739999 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7febec057960 con 0x7febf8070f80 2023-07-29T02:00:15.388 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2023-07-29T02:00:15.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.402+0000 7febfd0db700 1 -- 172.21.15.42:0/2499739999 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7febe406a690 msgr2=0x7febe406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:15.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.402+0000 7febfd0db700 1 --2- 172.21.15.42:0/2499739999 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7febe406a690 0x7febe406cb40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7febe8000f60 tx=0x7febe8009040 comp rx=0 tx=0).stop 2023-07-29T02:00:15.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.402+0000 7febfd0db700 1 -- 172.21.15.42:0/2499739999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf8070f80 msgr2=0x7febf81efbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:15.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.402+0000 7febfd0db700 1 --2- 172.21.15.42:0/2499739999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf8070f80 0x7febf81efbf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7febec00e9b0 tx=0x7febec00ed70 comp rx=0 tx=0).stop 2023-07-29T02:00:15.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.402+0000 7febfd0db700 1 -- 172.21.15.42:0/2499739999 shutdown_connections 2023-07-29T02:00:15.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.402+0000 7febfd0db700 1 --2- 172.21.15.42:0/2499739999 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7febe406a690 0x7febe406cb40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.402+0000 7febfd0db700 1 --2- 172.21.15.42:0/2499739999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7febf8152c50 0x7febf8153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.391 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.402+0000 7febfd0db700 1 --2- 172.21.15.42:0/2499739999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febf8070bb0 0x7febf81498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.391 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.402+0000 7febfd0db700 1 --2- 172.21.15.42:0/2499739999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febf8070f80 0x7febf81efbf0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.391 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.402+0000 7febfd0db700 1 -- 172.21.15.42:0/2499739999 >> 172.21.15.42:0/2499739999 conn(0x7febf80cc420 msgr2=0x7febf8152310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:15.391 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.402+0000 7febfd0db700 1 -- 172.21.15.42:0/2499739999 shutdown_connections 2023-07-29T02:00:15.391 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.402+0000 7febfd0db700 1 -- 172.21.15.42:0/2499739999 wait complete. 2023-07-29T02:00:15.402 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-29T02:00:15.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.542+0000 7fc8355e9700 1 Processor -- start 2023-07-29T02:00:15.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.542+0000 7fc8355e9700 1 -- start start 2023-07-29T02:00:15.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.543+0000 7fc8355e9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc8300b4250 0x7fc83006b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:15.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.543+0000 7fc8355e9700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc830159d30 0x7fc83015c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:15.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.543+0000 7fc8355e9700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8301598a0 con 0x7fc8300c6190 2023-07-29T02:00:15.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.543+0000 7fc8355e9700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83006c680 con 0x7fc830159d30 2023-07-29T02:00:15.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.543+0000 7fc8355e9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc830153850 con 0x7fc8300b4250 2023-07-29T02:00:15.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.543+0000 7fc82f7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc830159d30 0x7fc83015c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:15.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.543+0000 7fc82f7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc830159d30 0x7fc83015c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56004/0 (socket says 172.21.15.42:56004) 2023-07-29T02:00:15.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.543+0000 7fc82e7fc700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc8300c6190 0x7fc8300c4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49804/0 (socket says 172.21.15.42:49804) 2023-07-29T02:00:15.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.543+0000 7fc82f7fe700 1 -- 172.21.15.42:0/574808285 learned_addr learned my addr 172.21.15.42:0/574808285 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:15.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.543+0000 7fc82effd700 1 --2- 172.21.15.42:0/574808285 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc8300b4250 0x7fc83006b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:15.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.543+0000 7fc82f7fe700 1 -- 172.21.15.42:0/574808285 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc8300b4250 msgr2=0x7fc83006b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:15.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.543+0000 7fc82f7fe700 1 --2- 172.21.15.42:0/574808285 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc8300b4250 0x7fc83006b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.543+0000 7fc82f7fe700 1 -- 172.21.15.42:0/574808285 >> v1:172.21.15.42:6789/0 conn(0x7fc8300c6190 legacy=0x7fc8300c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:15.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.543+0000 7fc82f7fe700 1 -- 172.21.15.42:0/574808285 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83015cb50 con 0x7fc830159d30 2023-07-29T02:00:15.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.543+0000 7fc82dffb700 1 -- 172.21.15.42:0/574808285 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2089763264 0 0) 0x7fc8301598a0 con 0x7fc8300c6190 2023-07-29T02:00:15.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.544+0000 7fc82f7fe700 1 --2- 172.21.15.42:0/574808285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc830159d30 0x7fc83015c610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc828009e50 tx=0x7fc82800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f1ad2703786107 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:15.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.544+0000 7fc82dffb700 1 -- 172.21.15.42:0/574808285 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82800e070 con 0x7fc830159d30 2023-07-29T02:00:15.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.544+0000 7fc82dffb700 1 -- 172.21.15.42:0/574808285 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82800b9c0 con 0x7fc830159d30 2023-07-29T02:00:15.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.544+0000 7fc82dffb700 1 -- 172.21.15.42:0/574808285 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82800bd70 con 0x7fc830159d30 2023-07-29T02:00:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.544+0000 7fc8355e9700 1 -- 172.21.15.42:0/574808285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc830159d30 msgr2=0x7fc83015c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.544+0000 7fc8355e9700 1 --2- 172.21.15.42:0/574808285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc830159d30 0x7fc83015c610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc828009e50 tx=0x7fc82800b330 comp rx=0 tx=0).stop 2023-07-29T02:00:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.544+0000 7fc8355e9700 1 -- 172.21.15.42:0/574808285 shutdown_connections 2023-07-29T02:00:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.544+0000 7fc8355e9700 1 --2- 172.21.15.42:0/574808285 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc830159d30 0x7fc83015c610 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.544+0000 7fc8355e9700 1 --2- 172.21.15.42:0/574808285 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc8300b4250 0x7fc83006b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.544+0000 7fc8355e9700 1 -- 172.21.15.42:0/574808285 >> 172.21.15.42:0/574808285 conn(0x7fc83006ca30 msgr2=0x7fc83006ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.544+0000 7fc8355e9700 1 -- 172.21.15.42:0/574808285 shutdown_connections 2023-07-29T02:00:15.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.544+0000 7fc8355e9700 1 -- 172.21.15.42:0/574808285 wait complete. 2023-07-29T02:00:15.538 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.546+0000 7fc8355e9700 1 Processor -- start 2023-07-29T02:00:15.538 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.546+0000 7fc8355e9700 1 -- start start 2023-07-29T02:00:15.538 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.547+0000 7fc8355e9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8300b4250 0x7fc8301539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:15.539 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.547+0000 7fc8355e9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8300c6190 0x7fc83015b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:15.539 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.547+0000 7fc8355e9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc830159d30 0x7fc83015a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:15.539 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.547+0000 7fc8355e9700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8301553f0 con 0x7fc8300b4250 2023-07-29T02:00:15.539 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.547+0000 7fc8355e9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc830153ef0 con 0x7fc8300c6190 2023-07-29T02:00:15.539 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.547+0000 7fc8355e9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8301546d0 con 0x7fc830159d30 2023-07-29T02:00:15.539 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.547+0000 7fc82effd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8300b4250 0x7fc8301539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:15.540 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.547+0000 7fc82effd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8300b4250 0x7fc8301539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56006/0 (socket says 172.21.15.42:56006) 2023-07-29T02:00:15.540 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.547+0000 7fc82effd700 1 -- 172.21.15.42:0/1309477281 learned_addr learned my addr 172.21.15.42:0/1309477281 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:15.540 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.547+0000 7fc82f7fe700 1 --2- 172.21.15.42:0/1309477281 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc830159d30 0x7fc83015a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:15.540 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.547+0000 7fc82e7fc700 1 --2- 172.21.15.42:0/1309477281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8300c6190 0x7fc83015b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:15.541 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.547+0000 7fc82effd700 1 -- 172.21.15.42:0/1309477281 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc830159d30 msgr2=0x7fc83015a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:15.541 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.547+0000 7fc82effd700 1 --2- 172.21.15.42:0/1309477281 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc830159d30 0x7fc83015a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.541 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.547+0000 7fc82effd700 1 -- 172.21.15.42:0/1309477281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8300c6190 msgr2=0x7fc83015b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:15.541 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.547+0000 7fc82effd700 1 --2- 172.21.15.42:0/1309477281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8300c6190 0x7fc83015b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.541 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.547+0000 7fc82effd700 1 -- 172.21.15.42:0/1309477281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc828009b30 con 0x7fc8300b4250 2023-07-29T02:00:15.541 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.548+0000 7fc82effd700 1 --2- 172.21.15.42:0/1309477281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8300b4250 0x7fc8301539b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc82400e810 tx=0x7fc82400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:15.542 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.548+0000 7fc8177fe700 1 -- 172.21.15.42:0/1309477281 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc824013610 con 0x7fc8300b4250 2023-07-29T02:00:15.542 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.548+0000 7fc8177fe700 1 -- 172.21.15.42:0/1309477281 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc824013770 con 0x7fc8300b4250 2023-07-29T02:00:15.542 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.548+0000 7fc8177fe700 1 -- 172.21.15.42:0/1309477281 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc824013b20 con 0x7fc8300b4250 2023-07-29T02:00:15.542 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.548+0000 7fc8355e9700 1 -- 172.21.15.42:0/1309477281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83015b750 con 0x7fc8300b4250 2023-07-29T02:00:15.542 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.548+0000 7fc8355e9700 1 -- 172.21.15.42:0/1309477281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8301543f0 con 0x7fc8300b4250 2023-07-29T02:00:15.542 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.549+0000 7fc8355e9700 1 -- 172.21.15.42:0/1309477281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83004ea50 con 0x7fc8300b4250 2023-07-29T02:00:15.542 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.549+0000 7fc8177fe700 1 -- 172.21.15.42:0/1309477281 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fc824013c80 con 0x7fc8300b4250 2023-07-29T02:00:15.543 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.550+0000 7fc8177fe700 1 --2- 172.21.15.42:0/1309477281 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc81c06a660 0x7fc81c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:15.543 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.550+0000 7fc8177fe700 1 -- 172.21.15.42:0/1309477281 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc824088ca0 con 0x7fc8300b4250 2023-07-29T02:00:15.543 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.550+0000 7fc82e7fc700 1 --2- 172.21.15.42:0/1309477281 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc81c06a660 0x7fc81c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:15.543 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.550+0000 7fc82e7fc700 1 --2- 172.21.15.42:0/1309477281 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc81c06a660 0x7fc81c06cb10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc830157a90 tx=0x7fc820007be0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:15.543 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.554+0000 7fc8177fe700 1 -- 172.21.15.42:0/1309477281 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fc824053c90 con 0x7fc8300b4250 2023-07-29T02:00:15.743 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.755+0000 7fc8355e9700 1 -- 172.21.15.42:0/1309477281 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc8300c9b70 con 0x7fc8300b4250 2023-07-29T02:00:15.743 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.756+0000 7fc8177fe700 1 -- 172.21.15.42:0/1309477281 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc8240572b0 con 0x7fc8300b4250 2023-07-29T02:00:15.744 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2023-07-29T02:00:15.745 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.758+0000 7fc8355e9700 1 -- 172.21.15.42:0/1309477281 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc81c06a660 msgr2=0x7fc81c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:15.746 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.758+0000 7fc8355e9700 1 --2- 172.21.15.42:0/1309477281 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc81c06a660 0x7fc81c06cb10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc830157a90 tx=0x7fc820007be0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.746 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.758+0000 7fc8355e9700 1 -- 172.21.15.42:0/1309477281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8300b4250 msgr2=0x7fc8301539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:15.746 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.758+0000 7fc8355e9700 1 --2- 172.21.15.42:0/1309477281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8300b4250 0x7fc8301539b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc82400e810 tx=0x7fc82400ebd0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.746 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.758+0000 7fc8355e9700 1 -- 172.21.15.42:0/1309477281 shutdown_connections 2023-07-29T02:00:15.746 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.758+0000 7fc8355e9700 1 --2- 172.21.15.42:0/1309477281 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc81c06a660 0x7fc81c06cb10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.746 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.758+0000 7fc8355e9700 1 --2- 172.21.15.42:0/1309477281 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc830159d30 0x7fc83015a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.746 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.758+0000 7fc8355e9700 1 --2- 172.21.15.42:0/1309477281 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8300b4250 0x7fc8301539b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.746 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.758+0000 7fc8355e9700 1 --2- 172.21.15.42:0/1309477281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc8300c6190 0x7fc83015b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.747 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.758+0000 7fc8355e9700 1 -- 172.21.15.42:0/1309477281 >> 172.21.15.42:0/1309477281 conn(0x7fc83006ca30 msgr2=0x7fc83014f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:15.747 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.758+0000 7fc8355e9700 1 -- 172.21.15.42:0/1309477281 shutdown_connections 2023-07-29T02:00:15.747 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.758+0000 7fc8355e9700 1 -- 172.21.15.42:0/1309477281 wait complete. 2023-07-29T02:00:15.757 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-29T02:00:15.882 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.895+0000 7fe961c37700 1 Processor -- start 2023-07-29T02:00:15.883 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.895+0000 7fe961c37700 1 -- start start 2023-07-29T02:00:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.895+0000 7fe961c37700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe95c06c760 0x7fe95c15a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.895+0000 7fe961c37700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95c06f1e0 con 0x7fe95c1510f0 2023-07-29T02:00:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe961c37700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95c06ebd0 con 0x7fe95c06f670 2023-07-29T02:00:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe961c37700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c0c7280 con 0x7fe95c06c760 2023-07-29T02:00:15.885 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe95b7fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe95c1510f0 0x7fe95c06a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49818/0 (socket says 172.21.15.42:49818) 2023-07-29T02:00:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe95b7fe700 1 -- 172.21.15.42:0/4268261854 learned_addr learned my addr 172.21.15.42:0/4268261854 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe95affd700 1 --2- 172.21.15.42:0/4268261854 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe95c06c760 0x7fe95c15a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe95a7fc700 1 -- 172.21.15.42:0/4268261854 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192147675 0 0) 0x7fe95c06f1e0 con 0x7fe95c1510f0 2023-07-29T02:00:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe95a7fc700 1 -- 172.21.15.42:0/4268261854 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9440035b0 con 0x7fe95c1510f0 2023-07-29T02:00:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe95a7fc700 1 -- 172.21.15.42:0/4268261854 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4138860883 0 0) 0x7fe9440035b0 con 0x7fe95c1510f0 2023-07-29T02:00:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe95a7fc700 1 -- 172.21.15.42:0/4268261854 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe95c06c760 msgr2=0x7fe95c15a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:15.886 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe95a7fc700 1 --2- 172.21.15.42:0/4268261854 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe95c06c760 0x7fe95c15a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.887 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe95a7fc700 1 -- 172.21.15.42:0/4268261854 >> v1:172.21.15.144:6789/0 conn(0x7fe95c06f670 legacy=0x7fe95c1615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:15.887 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe95a7fc700 1 -- 172.21.15.42:0/4268261854 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c0715b0 con 0x7fe95c1510f0 2023-07-29T02:00:15.887 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe95a7fc700 1 -- 172.21.15.42:0/4268261854 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7fe94c001670 con 0x7fe95c1510f0 2023-07-29T02:00:15.887 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe95a7fc700 1 -- 172.21.15.42:0/4268261854 >> v1:172.21.15.42:6789/0 conn(0x7fe95c1510f0 legacy=0x7fe95c06a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:15.887 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe95a7fc700 1 --2- 172.21.15.42:0/4268261854 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe95c06c760 0x7fe944003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:15.887 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe95a7fc700 1 --2- 172.21.15.42:0/4268261854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe944003fb0 0x7fe944004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:15.887 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe95a7fc700 1 --2- 172.21.15.42:0/4268261854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe944004d90 0x7fe944005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:15.887 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe95a7fc700 1 -- 172.21.15.42:0/4268261854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c0c7280 con 0x7fe944003fb0 2023-07-29T02:00:15.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe95a7fc700 1 -- 172.21.15.42:0/4268261854 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94400bba0 con 0x7fe944004d90 2023-07-29T02:00:15.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe95a7fc700 1 -- 172.21.15.42:0/4268261854 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94400bd60 con 0x7fe95c06c760 2023-07-29T02:00:15.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe95affd700 1 --2- 172.21.15.42:0/4268261854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe944003fb0 0x7fe944004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:15.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.896+0000 7fe95b7fe700 1 --2- 172.21.15.42:0/4268261854 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe95c06c760 0x7fe944003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:15.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.897+0000 7fe95bfff700 1 --2- 172.21.15.42:0/4268261854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe944004d90 0x7fe944005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:15.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.897+0000 7fe95affd700 1 -- 172.21.15.42:0/4268261854 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe95c06c760 msgr2=0x7fe944003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:15.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.897+0000 7fe95affd700 1 --2- 172.21.15.42:0/4268261854 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe95c06c760 0x7fe944003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.897+0000 7fe95affd700 1 -- 172.21.15.42:0/4268261854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe944004d90 msgr2=0x7fe944005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.897+0000 7fe95affd700 1 --2- 172.21.15.42:0/4268261854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe944004d90 0x7fe944005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.897+0000 7fe95affd700 1 -- 172.21.15.42:0/4268261854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9440035b0 con 0x7fe944003fb0 2023-07-29T02:00:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.897+0000 7fe95affd700 1 --2- 172.21.15.42:0/4268261854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe944003fb0 0x7fe944004850 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe950009b30 tx=0x7fe944005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e2240083cb4fb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.897+0000 7fe95a7fc700 1 -- 172.21.15.42:0/4268261854 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95000e6c0 con 0x7fe944003fb0 2023-07-29T02:00:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.897+0000 7fe95a7fc700 1 -- 172.21.15.42:0/4268261854 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95000e820 con 0x7fe944003fb0 2023-07-29T02:00:15.889 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.897+0000 7fe95a7fc700 1 -- 172.21.15.42:0/4268261854 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95000eb90 con 0x7fe944003fb0 2023-07-29T02:00:15.891 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.898+0000 7fe961c37700 1 -- 172.21.15.42:0/4268261854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe944003fb0 msgr2=0x7fe944004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:15.892 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.898+0000 7fe961c37700 1 --2- 172.21.15.42:0/4268261854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe944003fb0 0x7fe944004850 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe950009b30 tx=0x7fe944005880 comp rx=0 tx=0).stop 2023-07-29T02:00:15.892 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.898+0000 7fe95bfff700 1 -- 172.21.15.42:0/4268261854 reap_dead start 2023-07-29T02:00:15.892 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.898+0000 7fe961c37700 1 -- 172.21.15.42:0/4268261854 shutdown_connections 2023-07-29T02:00:15.892 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.898+0000 7fe961c37700 1 -- 172.21.15.42:0/4268261854 >> 172.21.15.42:0/4268261854 conn(0x7fe95c0cbf10 msgr2=0x7fe95c0cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:15.892 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.898+0000 7fe961c37700 1 -- 172.21.15.42:0/4268261854 shutdown_connections 2023-07-29T02:00:15.892 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.898+0000 7fe961c37700 1 -- 172.21.15.42:0/4268261854 wait complete. 2023-07-29T02:00:15.893 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.899+0000 7fe961c37700 1 Processor -- start 2023-07-29T02:00:15.893 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.899+0000 7fe961c37700 1 -- start start 2023-07-29T02:00:15.893 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.900+0000 7fe961c37700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe944003fb0 0x7fe95c0c2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:15.893 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.900+0000 7fe961c37700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe95c0c18f0 0x7fe95c14f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:15.893 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.900+0000 7fe961c37700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe95c1e1f70 0x7fe95c1e23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:15.893 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.900+0000 7fe961c37700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c1e2920 con 0x7fe95c0c18f0 2023-07-29T02:00:15.893 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.900+0000 7fe961c37700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c0c2cd0 con 0x7fe95c1e1f70 2023-07-29T02:00:15.893 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.900+0000 7fe961c37700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c1e12f0 con 0x7fe944003fb0 2023-07-29T02:00:15.894 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.900+0000 7fe95affd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe95c0c18f0 0x7fe95c14f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:15.894 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.900+0000 7fe95affd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe95c0c18f0 0x7fe95c14f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56028/0 (socket says 172.21.15.42:56028) 2023-07-29T02:00:15.894 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.900+0000 7fe95affd700 1 -- 172.21.15.42:0/724079964 learned_addr learned my addr 172.21.15.42:0/724079964 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:15.894 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.900+0000 7fe95b7fe700 1 --2- 172.21.15.42:0/724079964 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe944003fb0 0x7fe95c0c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:15.894 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.900+0000 7fe95bfff700 1 --2- 172.21.15.42:0/724079964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe95c1e1f70 0x7fe95c1e23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:15.894 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.900+0000 7fe95affd700 1 -- 172.21.15.42:0/724079964 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe944003fb0 msgr2=0x7fe95c0c2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:15.895 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.900+0000 7fe95affd700 1 --2- 172.21.15.42:0/724079964 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe944003fb0 0x7fe95c0c2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.895 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.900+0000 7fe95affd700 1 -- 172.21.15.42:0/724079964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe95c1e1f70 msgr2=0x7fe95c1e23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:15.895 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.900+0000 7fe95affd700 1 --2- 172.21.15.42:0/724079964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe95c1e1f70 0x7fe95c1e23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:15.895 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.900+0000 7fe95affd700 1 -- 172.21.15.42:0/724079964 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c1e1ae0 con 0x7fe95c0c18f0 2023-07-29T02:00:15.895 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.900+0000 7fe95affd700 1 --2- 172.21.15.42:0/724079964 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe95c0c18f0 0x7fe95c14f750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe95000e4b0 tx=0x7fe9500047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:15.895 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.900+0000 7fe943fff700 1 -- 172.21.15.42:0/724079964 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95000e6c0 con 0x7fe95c0c18f0 2023-07-29T02:00:15.895 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.901+0000 7fe943fff700 1 -- 172.21.15.42:0/724079964 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe950003ad0 con 0x7fe95c0c18f0 2023-07-29T02:00:15.895 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.901+0000 7fe961c37700 1 -- 172.21.15.42:0/724079964 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95c0c1e80 con 0x7fe95c0c18f0 2023-07-29T02:00:15.896 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.901+0000 7fe961c37700 1 -- 172.21.15.42:0/724079964 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95c0c29f0 con 0x7fe95c0c18f0 2023-07-29T02:00:15.896 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.901+0000 7fe943fff700 1 -- 172.21.15.42:0/724079964 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe950003e80 con 0x7fe95c0c18f0 2023-07-29T02:00:15.896 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.902+0000 7fe961c37700 1 -- 172.21.15.42:0/724079964 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95c04ea50 con 0x7fe95c0c18f0 2023-07-29T02:00:15.896 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.902+0000 7fe943fff700 1 -- 172.21.15.42:0/724079964 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fe950013470 con 0x7fe95c0c18f0 2023-07-29T02:00:15.896 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.902+0000 7fe943fff700 1 --2- 172.21.15.42:0/724079964 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe94806a660 0x7fe94806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:15.896 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.903+0000 7fe943fff700 1 -- 172.21.15.42:0/724079964 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe95008a770 con 0x7fe95c0c18f0 2023-07-29T02:00:15.896 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.903+0000 7fe95b7fe700 1 --2- 172.21.15.42:0/724079964 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe94806a660 0x7fe94806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:15.897 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.903+0000 7fe95b7fe700 1 --2- 172.21.15.42:0/724079964 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe94806a660 0x7fe94806cb10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe94c001050 tx=0x7fe94c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:15.897 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:15.907+0000 7fe943fff700 1 -- 172.21.15.42:0/724079964 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fe950055910 con 0x7fe95c0c18f0 2023-07-29T02:00:16.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:16.119+0000 7fe961c37700 1 -- 172.21.15.42:0/724079964 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe95c154680 con 0x7fe95c0c18f0 2023-07-29T02:00:16.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:16.119+0000 7fe943fff700 1 -- 172.21.15.42:0/724079964 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe950058f30 con 0x7fe95c0c18f0 2023-07-29T02:00:16.109 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:16.121+0000 7fe961c37700 1 -- 172.21.15.42:0/724079964 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe94806a660 msgr2=0x7fe94806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:16.109 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:16.121+0000 7fe961c37700 1 --2- 172.21.15.42:0/724079964 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe94806a660 0x7fe94806cb10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe94c001050 tx=0x7fe94c009040 comp rx=0 tx=0).stop 2023-07-29T02:00:16.110 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:16.121+0000 7fe961c37700 1 -- 172.21.15.42:0/724079964 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe95c0c18f0 msgr2=0x7fe95c14f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:16.110 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:16.121+0000 7fe961c37700 1 --2- 172.21.15.42:0/724079964 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe95c0c18f0 0x7fe95c14f750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe95000e4b0 tx=0x7fe9500047c0 comp rx=0 tx=0).stop 2023-07-29T02:00:16.110 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:16.121+0000 7fe961c37700 1 -- 172.21.15.42:0/724079964 shutdown_connections 2023-07-29T02:00:16.110 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:16.121+0000 7fe961c37700 1 --2- 172.21.15.42:0/724079964 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe94806a660 0x7fe94806cb10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:16.110 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:16.121+0000 7fe961c37700 1 --2- 172.21.15.42:0/724079964 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe95c1e1f70 0x7fe95c1e23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:16.111 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:16.121+0000 7fe961c37700 1 --2- 172.21.15.42:0/724079964 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe944003fb0 0x7fe95c0c2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:16.111 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:16.121+0000 7fe961c37700 1 --2- 172.21.15.42:0/724079964 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe95c0c18f0 0x7fe95c14f750 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:16.111 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:16.121+0000 7fe961c37700 1 -- 172.21.15.42:0/724079964 >> 172.21.15.42:0/724079964 conn(0x7fe95c0cbf10 msgr2=0x7fe95c072390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:16.111 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:16.122+0000 7fe961c37700 1 -- 172.21.15.42:0/724079964 shutdown_connections 2023-07-29T02:00:16.111 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:16.122+0000 7fe961c37700 1 -- 172.21.15.42:0/724079964 wait complete. 2023-07-29T02:00:16.111 INFO:teuthology.orchestra.run.smithi042.stderr:listed 0 entries 2023-07-29T02:00:16.121 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi042.front.sepia.ceph.com... 2023-07-29T02:00:16.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:16.122 DEBUG:teuthology.orchestra.run.smithi042:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-07-29T02:00:16.165 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi042.stderr:ceph-fuse[137306]: fuse finished with error 0 and tester_r 0 2023-07-29T02:00:16.167 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:00:22.268 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2023-07-29T02:00:22.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:22.269 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-07-29T02:00:22.302 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T02:00:22.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.492+0000 7fa7f07d3700 1 Processor -- start 2023-07-29T02:00:22.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.492+0000 7fa7f07d3700 1 -- start start 2023-07-29T02:00:22.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.493+0000 7fa7f07d3700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa7e8151500 0x7fa7e806dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:22.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.493+0000 7fa7f07d3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7e80c7f40 0x7fa7e806e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:22.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.493+0000 7fa7f07d3700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e80cd140 con 0x7fa7e806e950 2023-07-29T02:00:22.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.493+0000 7fa7f07d3700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e80c2370 con 0x7fa7e8151500 2023-07-29T02:00:22.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.493+0000 7fa7f07d3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e8156f90 con 0x7fa7e80c7f40 2023-07-29T02:00:22.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.493+0000 7fa7ee56f700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa7e8151500 0x7fa7e806dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:22.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.493+0000 7fa7ee56f700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa7e8151500 0x7fa7e806dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56034/0 (socket says 172.21.15.42:56034) 2023-07-29T02:00:22.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.493+0000 7fa7ee56f700 1 -- 172.21.15.42:0/1168284456 learned_addr learned my addr 172.21.15.42:0/1168284456 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:22.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.493+0000 7fa7edd6e700 1 --2- 172.21.15.42:0/1168284456 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7e80c7f40 0x7fa7e806e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:22.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.493+0000 7fa7ee56f700 1 -- 172.21.15.42:0/1168284456 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7e80c7f40 msgr2=0x7fa7e806e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:22.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.493+0000 7fa7ee56f700 1 --2- 172.21.15.42:0/1168284456 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7e80c7f40 0x7fa7e806e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:22.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.493+0000 7fa7ee56f700 1 -- 172.21.15.42:0/1168284456 >> v1:172.21.15.144:6789/0 conn(0x7fa7e806e950 legacy=0x7fa7e8157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:22.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.493+0000 7fa7ee56f700 1 -- 172.21.15.42:0/1168284456 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e80cd390 con 0x7fa7e8151500 2023-07-29T02:00:22.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.493+0000 7fa7edd6e700 1 --2- 172.21.15.42:0/1168284456 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7e80c7f40 0x7fa7e806e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:22.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.493+0000 7fa7ee56f700 1 --2- 172.21.15.42:0/1168284456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7e8151500 0x7fa7e806dc60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40098f0 tx=0x7fa7e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828ce9b358547832 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:22.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.494+0000 7fa7ed56d700 1 -- 172.21.15.42:0/1168284456 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4004230 con 0x7fa7e8151500 2023-07-29T02:00:22.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.494+0000 7fa7ed56d700 1 -- 172.21.15.42:0/1168284456 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e4004390 con 0x7fa7e8151500 2023-07-29T02:00:22.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.494+0000 7fa7ed56d700 1 -- 172.21.15.42:0/1168284456 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e40036a0 con 0x7fa7e8151500 2023-07-29T02:00:22.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.494+0000 7fa7f07d3700 1 -- 172.21.15.42:0/1168284456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7e8151500 msgr2=0x7fa7e806dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:22.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.494+0000 7fa7f07d3700 1 --2- 172.21.15.42:0/1168284456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7e8151500 0x7fa7e806dc60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40098f0 tx=0x7fa7e4009c00 comp rx=0 tx=0).stop 2023-07-29T02:00:22.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.494+0000 7fa7f07d3700 1 -- 172.21.15.42:0/1168284456 shutdown_connections 2023-07-29T02:00:22.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.494+0000 7fa7f07d3700 1 --2- 172.21.15.42:0/1168284456 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7e8151500 0x7fa7e806dc60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:22.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.494+0000 7fa7f07d3700 1 --2- 172.21.15.42:0/1168284456 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7e80c7f40 0x7fa7e806e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:22.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.494+0000 7fa7f07d3700 1 -- 172.21.15.42:0/1168284456 >> 172.21.15.42:0/1168284456 conn(0x7fa7e8061190 msgr2=0x7fa7e8061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:22.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.494+0000 7fa7f07d3700 1 -- 172.21.15.42:0/1168284456 shutdown_connections 2023-07-29T02:00:22.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.494+0000 7fa7f07d3700 1 -- 172.21.15.42:0/1168284456 wait complete. 2023-07-29T02:00:22.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.496+0000 7fa7f07d3700 1 Processor -- start 2023-07-29T02:00:22.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.496+0000 7fa7f07d3700 1 -- start start 2023-07-29T02:00:22.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.497+0000 7fa7f07d3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7e806e950 0x7fa7e814d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:22.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.497+0000 7fa7f07d3700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7e80c7f40 0x7fa7e814e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:22.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.497+0000 7fa7f07d3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7e8151500 0x7fa7e8146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:22.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.497+0000 7fa7f07d3700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e81ec950 con 0x7fa7e80c7f40 2023-07-29T02:00:22.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.497+0000 7fa7f07d3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e81ecc30 con 0x7fa7e8151500 2023-07-29T02:00:22.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.497+0000 7fa7f07d3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e81ecf10 con 0x7fa7e806e950 2023-07-29T02:00:22.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.497+0000 7fa7edd6e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7e80c7f40 0x7fa7e814e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:22.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.497+0000 7fa7edd6e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7e80c7f40 0x7fa7e814e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56042/0 (socket says 172.21.15.42:56042) 2023-07-29T02:00:22.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.497+0000 7fa7edd6e700 1 -- 172.21.15.42:0/3129419024 learned_addr learned my addr 172.21.15.42:0/3129419024 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:22.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.497+0000 7fa7ee56f700 1 --2- 172.21.15.42:0/3129419024 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7e806e950 0x7fa7e814d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:22.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.497+0000 7fa7eed70700 1 --2- 172.21.15.42:0/3129419024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7e8151500 0x7fa7e8146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:22.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.497+0000 7fa7edd6e700 1 -- 172.21.15.42:0/3129419024 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7e806e950 msgr2=0x7fa7e814d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:22.489 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.497+0000 7fa7edd6e700 1 --2- 172.21.15.42:0/3129419024 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7e806e950 0x7fa7e814d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:22.489 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.497+0000 7fa7edd6e700 1 -- 172.21.15.42:0/3129419024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7e8151500 msgr2=0x7fa7e8146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:22.489 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.497+0000 7fa7edd6e700 1 --2- 172.21.15.42:0/3129419024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7e8151500 0x7fa7e8146320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:22.489 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.497+0000 7fa7edd6e700 1 -- 172.21.15.42:0/3129419024 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e4009550 con 0x7fa7e80c7f40 2023-07-29T02:00:22.489 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.498+0000 7fa7edd6e700 1 --2- 172.21.15.42:0/3129419024 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7e80c7f40 0x7fa7e814e0b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800c750 tx=0x7fa7d800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:22.489 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.498+0000 7fa7deffd700 1 -- 172.21.15.42:0/3129419024 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8011800 con 0x7fa7e80c7f40 2023-07-29T02:00:22.489 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.498+0000 7fa7deffd700 1 -- 172.21.15.42:0/3129419024 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d8011960 con 0x7fa7e80c7f40 2023-07-29T02:00:22.490 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.498+0000 7fa7f07d3700 1 -- 172.21.15.42:0/3129419024 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e81ed1f0 con 0x7fa7e80c7f40 2023-07-29T02:00:22.490 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.498+0000 7fa7deffd700 1 -- 172.21.15.42:0/3129419024 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8011cd0 con 0x7fa7e80c7f40 2023-07-29T02:00:22.490 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.498+0000 7fa7f07d3700 1 -- 172.21.15.42:0/3129419024 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e814b840 con 0x7fa7e80c7f40 2023-07-29T02:00:22.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.499+0000 7fa7f07d3700 1 -- 172.21.15.42:0/3129419024 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e814ba60 con 0x7fa7e80c7f40 2023-07-29T02:00:22.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.499+0000 7fa7deffd700 1 -- 172.21.15.42:0/3129419024 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fa7d8021350 con 0x7fa7e80c7f40 2023-07-29T02:00:22.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.500+0000 7fa7deffd700 1 --2- 172.21.15.42:0/3129419024 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa7cc06a690 0x7fa7cc06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:22.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.500+0000 7fa7deffd700 1 -- 172.21.15.42:0/3129419024 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa7d8088bd0 con 0x7fa7e80c7f40 2023-07-29T02:00:22.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.500+0000 7fa7ee56f700 1 --2- 172.21.15.42:0/3129419024 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa7cc06a690 0x7fa7cc06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:22.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.500+0000 7fa7ee56f700 1 --2- 172.21.15.42:0/3129419024 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa7cc06a690 0x7fa7cc06cb40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009130 tx=0x7fa7e4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:22.492 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.504+0000 7fa7deffd700 1 -- 172.21.15.42:0/3129419024 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fa7d8057770 con 0x7fa7e80c7f40 2023-07-29T02:00:22.696 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.709+0000 7fa7f07d3700 1 -- 172.21.15.42:0/3129419024 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7e80cc500 con 0x7fa7e80c7f40 2023-07-29T02:00:22.697 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.710+0000 7fa7deffd700 1 -- 172.21.15.42:0/3129419024 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19690 (secure 0 0 0) 0x7fa7d8057300 con 0x7fa7e80c7f40 2023-07-29T02:00:22.698 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:22.698 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T02:00:02.394460+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T01:59:55.827461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T01:59:56.924040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-29T01:59:59.996470+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T02:00:22.700 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.712+0000 7fa7f07d3700 1 -- 172.21.15.42:0/3129419024 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa7cc06a690 msgr2=0x7fa7cc06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:22.700 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.712+0000 7fa7f07d3700 1 --2- 172.21.15.42:0/3129419024 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa7cc06a690 0x7fa7cc06cb40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4009130 tx=0x7fa7e4008030 comp rx=0 tx=0).stop 2023-07-29T02:00:22.700 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.712+0000 7fa7f07d3700 1 -- 172.21.15.42:0/3129419024 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7e80c7f40 msgr2=0x7fa7e814e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:22.700 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.712+0000 7fa7f07d3700 1 --2- 172.21.15.42:0/3129419024 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7e80c7f40 0x7fa7e814e0b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa7d800c750 tx=0x7fa7d800ca60 comp rx=0 tx=0).stop 2023-07-29T02:00:22.701 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.712+0000 7fa7f07d3700 1 -- 172.21.15.42:0/3129419024 shutdown_connections 2023-07-29T02:00:22.701 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.712+0000 7fa7f07d3700 1 --2- 172.21.15.42:0/3129419024 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa7cc06a690 0x7fa7cc06cb40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:22.701 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.712+0000 7fa7f07d3700 1 --2- 172.21.15.42:0/3129419024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa7e8151500 0x7fa7e8146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:22.701 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.712+0000 7fa7f07d3700 1 --2- 172.21.15.42:0/3129419024 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa7e806e950 0x7fa7e814d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:22.701 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.712+0000 7fa7f07d3700 1 --2- 172.21.15.42:0/3129419024 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa7e80c7f40 0x7fa7e814e0b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:22.701 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.712+0000 7fa7f07d3700 1 -- 172.21.15.42:0/3129419024 >> 172.21.15.42:0/3129419024 conn(0x7fa7e8061190 msgr2=0x7fa7e80ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:22.701 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.712+0000 7fa7f07d3700 1 -- 172.21.15.42:0/3129419024 shutdown_connections 2023-07-29T02:00:22.702 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.712+0000 7fa7f07d3700 1 -- 172.21.15.42:0/3129419024 wait complete. 2023-07-29T02:00:22.712 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T02:00:22.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.850+0000 7fe622c6b700 1 Processor -- start 2023-07-29T02:00:22.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.850+0000 7fe622c6b700 1 -- start start 2023-07-29T02:00:22.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.851+0000 7fe622c6b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe61c1532d0 0x7fe61c0729d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:22.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.851+0000 7fe622c6b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe61c071f10 0x7fe61c06d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:22.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.851+0000 7fe622c6b700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61c1536a0 con 0x7fe61c06dfe0 2023-07-29T02:00:22.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.851+0000 7fe622c6b700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe61c071820 con 0x7fe61c1532d0 2023-07-29T02:00:22.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.851+0000 7fe622c6b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c0712a0 con 0x7fe61c071f10 2023-07-29T02:00:22.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.851+0000 7fe620a07700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe61c1532d0 0x7fe61c0729d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:22.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.851+0000 7fe620a07700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe61c1532d0 0x7fe61c0729d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56048/0 (socket says 172.21.15.42:56048) 2023-07-29T02:00:22.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.851+0000 7fe620a07700 1 -- 172.21.15.42:0/1423587228 learned_addr learned my addr 172.21.15.42:0/1423587228 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:22.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.851+0000 7fe621208700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe61c06dfe0 0x7fe61c06a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49856/0 (socket says 172.21.15.42:49856) 2023-07-29T02:00:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.852+0000 7fe61bfff700 1 --2- 172.21.15.42:0/1423587228 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe61c071f10 0x7fe61c06d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.852+0000 7fe620a07700 1 -- 172.21.15.42:0/1423587228 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe61c071f10 msgr2=0x7fe61c06d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.852+0000 7fe620a07700 1 --2- 172.21.15.42:0/1423587228 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe61c071f10 0x7fe61c06d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.852+0000 7fe620a07700 1 -- 172.21.15.42:0/1423587228 >> v1:172.21.15.42:6789/0 conn(0x7fe61c06dfe0 legacy=0x7fe61c06a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.852+0000 7fe620a07700 1 -- 172.21.15.42:0/1423587228 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c0c69d0 con 0x7fe61c1532d0 2023-07-29T02:00:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.852+0000 7fe620a07700 1 --2- 172.21.15.42:0/1423587228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe61c1532d0 0x7fe61c0729d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe6100098f0 tx=0x7fe610009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70630cebac3ffa19 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.852+0000 7fe61b7fe700 1 -- 172.21.15.42:0/1423587228 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61000b8a0 con 0x7fe61c1532d0 2023-07-29T02:00:22.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.852+0000 7fe61b7fe700 1 -- 172.21.15.42:0/1423587228 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61000ba00 con 0x7fe61c1532d0 2023-07-29T02:00:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.852+0000 7fe61b7fe700 1 -- 172.21.15.42:0/1423587228 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61000bd90 con 0x7fe61c1532d0 2023-07-29T02:00:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.853+0000 7fe622c6b700 1 -- 172.21.15.42:0/1423587228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe61c1532d0 msgr2=0x7fe61c0729d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.853+0000 7fe622c6b700 1 --2- 172.21.15.42:0/1423587228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe61c1532d0 0x7fe61c0729d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe6100098f0 tx=0x7fe610009c00 comp rx=0 tx=0).stop 2023-07-29T02:00:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.853+0000 7fe622c6b700 1 -- 172.21.15.42:0/1423587228 shutdown_connections 2023-07-29T02:00:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.853+0000 7fe622c6b700 1 --2- 172.21.15.42:0/1423587228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe61c1532d0 0x7fe61c0729d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.853+0000 7fe622c6b700 1 --2- 172.21.15.42:0/1423587228 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe61c071f10 0x7fe61c06d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.853+0000 7fe622c6b700 1 -- 172.21.15.42:0/1423587228 >> 172.21.15.42:0/1423587228 conn(0x7fe61c0c8930 msgr2=0x7fe61c0c8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:22.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.853+0000 7fe622c6b700 1 -- 172.21.15.42:0/1423587228 shutdown_connections 2023-07-29T02:00:22.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.853+0000 7fe622c6b700 1 -- 172.21.15.42:0/1423587228 wait complete. 2023-07-29T02:00:22.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.854+0000 7fe622c6b700 1 Processor -- start 2023-07-29T02:00:22.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.854+0000 7fe622c6b700 1 -- start start 2023-07-29T02:00:22.847 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.855+0000 7fe622c6b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe61c06dfe0 0x7fe61c148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:22.847 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.855+0000 7fe622c6b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe61c071f10 0x7fe61c0c2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:22.847 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.855+0000 7fe622c6b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe61c1532d0 0x7fe61c0c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:22.847 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.855+0000 7fe622c6b700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c1474c0 con 0x7fe61c071f10 2023-07-29T02:00:22.847 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.855+0000 7fe622c6b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c1ef8c0 con 0x7fe61c06dfe0 2023-07-29T02:00:22.847 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.855+0000 7fe622c6b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c1485a0 con 0x7fe61c1532d0 2023-07-29T02:00:22.847 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.855+0000 7fe61bfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe61c071f10 0x7fe61c0c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:22.848 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.855+0000 7fe61bfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe61c071f10 0x7fe61c0c2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56056/0 (socket says 172.21.15.42:56056) 2023-07-29T02:00:22.848 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.855+0000 7fe61bfff700 1 -- 172.21.15.42:0/1662186033 learned_addr learned my addr 172.21.15.42:0/1662186033 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:22.848 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.856+0000 7fe620a07700 1 --2- 172.21.15.42:0/1662186033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe61c06dfe0 0x7fe61c148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:22.848 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.856+0000 7fe621208700 1 --2- 172.21.15.42:0/1662186033 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe61c1532d0 0x7fe61c0c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:22.848 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.856+0000 7fe61bfff700 1 -- 172.21.15.42:0/1662186033 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe61c1532d0 msgr2=0x7fe61c0c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:22.848 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.856+0000 7fe61bfff700 1 --2- 172.21.15.42:0/1662186033 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe61c1532d0 0x7fe61c0c4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:22.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.856+0000 7fe61bfff700 1 -- 172.21.15.42:0/1662186033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe61c06dfe0 msgr2=0x7fe61c148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:22.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.856+0000 7fe61bfff700 1 --2- 172.21.15.42:0/1662186033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe61c06dfe0 0x7fe61c148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:22.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.856+0000 7fe61bfff700 1 -- 172.21.15.42:0/1662186033 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe610009550 con 0x7fe61c071f10 2023-07-29T02:00:22.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.856+0000 7fe621208700 1 --2- 172.21.15.42:0/1662186033 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe61c1532d0 0x7fe61c0c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:22.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.856+0000 7fe61bfff700 1 --2- 172.21.15.42:0/1662186033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe61c071f10 0x7fe61c0c2110 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe60800e870 tx=0x7fe60800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:22.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.856+0000 7fe6197fa700 1 -- 172.21.15.42:0/1662186033 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608013610 con 0x7fe61c071f10 2023-07-29T02:00:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.856+0000 7fe6197fa700 1 -- 172.21.15.42:0/1662186033 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe608013770 con 0x7fe61c071f10 2023-07-29T02:00:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.856+0000 7fe6197fa700 1 -- 172.21.15.42:0/1662186033 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608013b20 con 0x7fe61c071f10 2023-07-29T02:00:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.856+0000 7fe622c6b700 1 -- 172.21.15.42:0/1662186033 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61c1478e0 con 0x7fe61c071f10 2023-07-29T02:00:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.856+0000 7fe622c6b700 1 -- 172.21.15.42:0/1662186033 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61c1ef600 con 0x7fe61c071f10 2023-07-29T02:00:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.857+0000 7fe622c6b700 1 -- 172.21.15.42:0/1662186033 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61c147600 con 0x7fe61c071f10 2023-07-29T02:00:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.858+0000 7fe6197fa700 1 -- 172.21.15.42:0/1662186033 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fe608013c80 con 0x7fe61c071f10 2023-07-29T02:00:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.858+0000 7fe6197fa700 1 --2- 172.21.15.42:0/1662186033 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe60006a660 0x7fe60006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:22.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.858+0000 7fe6197fa700 1 -- 172.21.15.42:0/1662186033 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe608088b30 con 0x7fe61c071f10 2023-07-29T02:00:22.851 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.858+0000 7fe620a07700 1 --2- 172.21.15.42:0/1662186033 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe60006a660 0x7fe60006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:22.851 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.859+0000 7fe620a07700 1 --2- 172.21.15.42:0/1662186033 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe60006a660 0x7fe60006cb10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe610009c40 tx=0x7fe610008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:22.851 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:22.862+0000 7fe6197fa700 1 -- 172.21.15.42:0/1662186033 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fe61c147600 con 0x7fe61c071f10 2023-07-29T02:00:23.053 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.065+0000 7fe622c6b700 1 -- 172.21.15.42:0/1662186033 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe61c147600 con 0x7fe61c071f10 2023-07-29T02:00:23.054 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.067+0000 7fe6197fa700 1 -- 172.21.15.42:0/1662186033 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19690 (secure 0 0 0) 0x7fe61c147600 con 0x7fe61c071f10 2023-07-29T02:00:23.055 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:23.055 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T02:00:02.394460+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T01:59:55.827461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T01:59:56.924040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-29T01:59:59.996470+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T02:00:23.056 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.068+0000 7fe622c6b700 1 -- 172.21.15.42:0/1662186033 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe60006a660 msgr2=0x7fe60006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:23.056 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.068+0000 7fe622c6b700 1 --2- 172.21.15.42:0/1662186033 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe60006a660 0x7fe60006cb10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe610009c40 tx=0x7fe610008030 comp rx=0 tx=0).stop 2023-07-29T02:00:23.061 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.068+0000 7fe622c6b700 1 -- 172.21.15.42:0/1662186033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe61c071f10 msgr2=0x7fe61c0c2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:23.061 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.068+0000 7fe622c6b700 1 --2- 172.21.15.42:0/1662186033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe61c071f10 0x7fe61c0c2110 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe60800e870 tx=0x7fe60800eb80 comp rx=0 tx=0).stop 2023-07-29T02:00:23.061 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.069+0000 7fe622c6b700 1 -- 172.21.15.42:0/1662186033 shutdown_connections 2023-07-29T02:00:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.069+0000 7fe622c6b700 1 --2- 172.21.15.42:0/1662186033 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe60006a660 0x7fe60006cb10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.069+0000 7fe622c6b700 1 --2- 172.21.15.42:0/1662186033 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe61c1532d0 0x7fe61c0c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.069+0000 7fe622c6b700 1 --2- 172.21.15.42:0/1662186033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe61c06dfe0 0x7fe61c148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.069+0000 7fe622c6b700 1 --2- 172.21.15.42:0/1662186033 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe61c071f10 0x7fe61c0c2110 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.069+0000 7fe622c6b700 1 -- 172.21.15.42:0/1662186033 >> 172.21.15.42:0/1662186033 conn(0x7fe61c0c8930 msgr2=0x7fe61c06a750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.069+0000 7fe622c6b700 1 -- 172.21.15.42:0/1662186033 shutdown_connections 2023-07-29T02:00:23.062 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.069+0000 7fe622c6b700 1 -- 172.21.15.42:0/1662186033 wait complete. 2023-07-29T02:00:23.069 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-29T02:00:23.196 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.208+0000 7f115b01e700 1 Processor -- start 2023-07-29T02:00:23.196 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.208+0000 7f115b01e700 1 -- start start 2023-07-29T02:00:23.197 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.209+0000 7f115b01e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f115413ed20 0x7f1154156650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:23.198 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.209+0000 7f115b01e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1154071120 0x7f11540c6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:23.198 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.209+0000 7f115b01e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1154071d10 con 0x7f11540c6ec0 2023-07-29T02:00:23.198 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.209+0000 7f115b01e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1154072dc0 con 0x7f115413ed20 2023-07-29T02:00:23.198 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.209+0000 7f115b01e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11540c83c0 con 0x7f1154071120 2023-07-29T02:00:23.198 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.210+0000 7f1158dba700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f115413ed20 0x7f1154156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:23.198 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.210+0000 7f1153fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1154071120 0x7f11540c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:23.198 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.210+0000 7f1153fff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1154071120 0x7f11540c6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:56576/0 (socket says 172.21.15.42:56576) 2023-07-29T02:00:23.199 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.210+0000 7f1158dba700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f115413ed20 0x7f1154156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:39440/0 (socket says 172.21.15.42:39440) 2023-07-29T02:00:23.199 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.210+0000 7f1153fff700 1 -- 172.21.15.42:0/2732974746 learned_addr learned my addr 172.21.15.42:0/2732974746 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:23.199 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.210+0000 7f1158dba700 1 -- 172.21.15.42:0/2732974746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1154071120 msgr2=0x7f11540c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:23.199 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.210+0000 7f1158dba700 1 --2- 172.21.15.42:0/2732974746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1154071120 0x7f11540c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:23.199 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.210+0000 7f1158dba700 1 -- 172.21.15.42:0/2732974746 >> v1:172.21.15.144:6789/0 conn(0x7f11540c6ec0 legacy=0x7f11541574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:23.199 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.210+0000 7f1158dba700 1 -- 172.21.15.42:0/2732974746 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1154156b90 con 0x7f115413ed20 2023-07-29T02:00:23.199 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.210+0000 7f1153fff700 1 --2- 172.21.15.42:0/2732974746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1154071120 0x7f11540c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:00:23.201 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.210+0000 7f1158dba700 1 --2- 172.21.15.42:0/2732974746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f115413ed20 0x7f1154156650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f114800dc90 tx=0x7f114800f050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=439314564bed2ec5 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:23.201 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.210+0000 7f11537fe700 1 -- 172.21.15.42:0/2732974746 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1148012070 con 0x7f115413ed20 2023-07-29T02:00:23.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.211+0000 7f11537fe700 1 -- 172.21.15.42:0/2732974746 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114800d2e0 con 0x7f115413ed20 2023-07-29T02:00:23.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.211+0000 7f11537fe700 1 -- 172.21.15.42:0/2732974746 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114800f8b0 con 0x7f115413ed20 2023-07-29T02:00:23.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.211+0000 7f115b01e700 1 -- 172.21.15.42:0/2732974746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f115413ed20 msgr2=0x7f1154156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:23.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.211+0000 7f115b01e700 1 --2- 172.21.15.42:0/2732974746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f115413ed20 0x7f1154156650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f114800dc90 tx=0x7f114800f050 comp rx=0 tx=0).stop 2023-07-29T02:00:23.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.211+0000 7f115b01e700 1 -- 172.21.15.42:0/2732974746 shutdown_connections 2023-07-29T02:00:23.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.211+0000 7f115b01e700 1 --2- 172.21.15.42:0/2732974746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f115413ed20 0x7f1154156650 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:23.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.211+0000 7f115b01e700 1 --2- 172.21.15.42:0/2732974746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1154071120 0x7f11540c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:23.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.211+0000 7f115b01e700 1 -- 172.21.15.42:0/2732974746 >> 172.21.15.42:0/2732974746 conn(0x7f11540ccc50 msgr2=0x7f115406ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:23.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.211+0000 7f115b01e700 1 -- 172.21.15.42:0/2732974746 shutdown_connections 2023-07-29T02:00:23.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.211+0000 7f115b01e700 1 -- 172.21.15.42:0/2732974746 wait complete. 2023-07-29T02:00:23.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.212+0000 7f115b01e700 1 Processor -- start 2023-07-29T02:00:23.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.212+0000 7f115b01e700 1 -- start start 2023-07-29T02:00:23.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.213+0000 7f115b01e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1154071120 0x7f1154137ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:23.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.213+0000 7f115b01e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11540c6ec0 0x7f1154139b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:23.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.213+0000 7f115b01e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f115413ed20 0x7f11541e83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:23.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.213+0000 7f115b01e700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11541ea410 con 0x7f115413ed20 2023-07-29T02:00:23.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.213+0000 7f115b01e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11541eac50 con 0x7f11540c6ec0 2023-07-29T02:00:23.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.213+0000 7f115b01e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11541e8930 con 0x7f1154071120 2023-07-29T02:00:23.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.213+0000 7f11595bb700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f115413ed20 0x7f11541e83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:23.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.213+0000 7f11595bb700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f115413ed20 0x7f11541e83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56072/0 (socket says 172.21.15.42:56072) 2023-07-29T02:00:23.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.213+0000 7f11595bb700 1 -- 172.21.15.42:0/756206985 learned_addr learned my addr 172.21.15.42:0/756206985 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:23.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.214+0000 7f1158dba700 1 --2- 172.21.15.42:0/756206985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1154071120 0x7f1154137ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:23.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.214+0000 7f1153fff700 1 --2- 172.21.15.42:0/756206985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11540c6ec0 0x7f1154139b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:23.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.214+0000 7f11595bb700 1 -- 172.21.15.42:0/756206985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1154071120 msgr2=0x7f1154137ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:23.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.214+0000 7f11595bb700 1 --2- 172.21.15.42:0/756206985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1154071120 0x7f1154137ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:23.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.214+0000 7f11595bb700 1 -- 172.21.15.42:0/756206985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11540c6ec0 msgr2=0x7f1154139b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:23.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.214+0000 7f11595bb700 1 --2- 172.21.15.42:0/756206985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11540c6ec0 0x7f1154139b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:23.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.214+0000 7f11595bb700 1 -- 172.21.15.42:0/756206985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114000b600 con 0x7f115413ed20 2023-07-29T02:00:23.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.214+0000 7f11595bb700 1 --2- 172.21.15.42:0/756206985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f115413ed20 0x7f11541e83f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f114c00ccb0 tx=0x7f114c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:23.206 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.214+0000 7f11517fa700 1 -- 172.21.15.42:0/756206985 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c003c00 con 0x7f115413ed20 2023-07-29T02:00:23.207 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.214+0000 7f11517fa700 1 -- 172.21.15.42:0/756206985 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114c003d60 con 0x7f115413ed20 2023-07-29T02:00:23.207 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.214+0000 7f115b01e700 1 -- 172.21.15.42:0/756206985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114800d940 con 0x7f115413ed20 2023-07-29T02:00:23.207 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.214+0000 7f11517fa700 1 -- 172.21.15.42:0/756206985 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c00aad0 con 0x7f115413ed20 2023-07-29T02:00:23.207 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.214+0000 7f115b01e700 1 -- 172.21.15.42:0/756206985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115413b580 con 0x7f115413ed20 2023-07-29T02:00:23.207 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.215+0000 7f115b01e700 1 -- 172.21.15.42:0/756206985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f115404ea50 con 0x7f115413ed20 2023-07-29T02:00:23.207 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.216+0000 7f11517fa700 1 -- 172.21.15.42:0/756206985 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f114c00ac30 con 0x7f115413ed20 2023-07-29T02:00:23.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.216+0000 7f11517fa700 1 --2- 172.21.15.42:0/756206985 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f113806a690 0x7f113806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:23.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.216+0000 7f11517fa700 1 -- 172.21.15.42:0/756206985 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f114c088d70 con 0x7f115413ed20 2023-07-29T02:00:23.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.216+0000 7f1158dba700 1 --2- 172.21.15.42:0/756206985 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f113806a690 0x7f113806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:23.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.217+0000 7f1158dba700 1 --2- 172.21.15.42:0/756206985 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f113806a690 0x7f113806cb40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f114800dc60 tx=0x7f114800d000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:23.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.220+0000 7f11517fa700 1 -- 172.21.15.42:0/756206985 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f114c053df0 con 0x7f115413ed20 2023-07-29T02:00:23.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:23.468+0000 7f115b01e700 1 -- 172.21.15.42:0/756206985 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f11541ead90 con 0x7f115413ed20 2023-07-29T02:00:24.415 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.427+0000 7f11517fa700 1 -- 172.21.15.42:0/756206985 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f114c057410 con 0x7f115413ed20 2023-07-29T02:00:24.418 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.430+0000 7f115b01e700 1 -- 172.21.15.42:0/756206985 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f113806a690 msgr2=0x7f113806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:24.418 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.430+0000 7f115b01e700 1 --2- 172.21.15.42:0/756206985 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f113806a690 0x7f113806cb40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f114800dc60 tx=0x7f114800d000 comp rx=0 tx=0).stop 2023-07-29T02:00:24.418 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.430+0000 7f115b01e700 1 -- 172.21.15.42:0/756206985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f115413ed20 msgr2=0x7f11541e83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:24.418 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.430+0000 7f115b01e700 1 --2- 172.21.15.42:0/756206985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f115413ed20 0x7f11541e83f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f114c00ccb0 tx=0x7f114c00a060 comp rx=0 tx=0).stop 2023-07-29T02:00:24.418 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.430+0000 7f115b01e700 1 -- 172.21.15.42:0/756206985 shutdown_connections 2023-07-29T02:00:24.418 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.430+0000 7f115b01e700 1 --2- 172.21.15.42:0/756206985 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f113806a690 0x7f113806cb40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:24.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.430+0000 7f115b01e700 1 --2- 172.21.15.42:0/756206985 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f115413ed20 0x7f11541e83f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:24.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.430+0000 7f115b01e700 1 --2- 172.21.15.42:0/756206985 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1154071120 0x7f1154137ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:24.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.430+0000 7f115b01e700 1 --2- 172.21.15.42:0/756206985 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11540c6ec0 0x7f1154139b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:24.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.430+0000 7f115b01e700 1 -- 172.21.15.42:0/756206985 >> 172.21.15.42:0/756206985 conn(0x7f11540ccc50 msgr2=0x7f11540cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:24.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.430+0000 7f115b01e700 1 -- 172.21.15.42:0/756206985 shutdown_connections 2023-07-29T02:00:24.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.430+0000 7f115b01e700 1 -- 172.21.15.42:0/756206985 wait complete. 2023-07-29T02:00:24.432 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300} 2023-07-29T02:00:24.433 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-29T02:00:24.568 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.580+0000 7fccbdc68700 1 Processor -- start 2023-07-29T02:00:24.569 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.580+0000 7fccbdc68700 1 -- start start 2023-07-29T02:00:24.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.581+0000 7fccbdc68700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fccb806eda0 0x7fccb8155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:24.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.581+0000 7fccbdc68700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fccb806cfa0 0x7fccb806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:24.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.581+0000 7fccbdc68700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccb814f920 0x7fccb814fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:24.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.581+0000 7fccbdc68700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb806d910 con 0x7fccb806eda0 2023-07-29T02:00:24.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.581+0000 7fccbdc68700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb806cb10 con 0x7fccb806cfa0 2023-07-29T02:00:24.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.581+0000 7fccbdc68700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb81502e0 con 0x7fccb814f920 2023-07-29T02:00:24.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.581+0000 7fccb77fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fccb806eda0 0x7fccb8155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:24.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.581+0000 7fccb77fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fccb806eda0 0x7fccb8155bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56076/0 (socket says 172.21.15.42:56076) 2023-07-29T02:00:24.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.581+0000 7fccb77fe700 1 -- 172.21.15.42:0/375190959 learned_addr learned my addr 172.21.15.42:0/375190959 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:24.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.581+0000 7fccb7fff700 1 --2- 172.21.15.42:0/375190959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccb814f920 0x7fccb814fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:24.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.581+0000 7fccb6ffd700 1 --2- 172.21.15.42:0/375190959 >> v2:172.21.15.144:3300/0 conn(0x7fccb806cfa0 0x7fccb806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:24.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.581+0000 7fccb77fe700 1 -- 172.21.15.42:0/375190959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccb814f920 msgr2=0x7fccb814fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:24.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.581+0000 7fccb77fe700 1 --2- 172.21.15.42:0/375190959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccb814f920 0x7fccb814fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:24.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.581+0000 7fccb77fe700 1 -- 172.21.15.42:0/375190959 >> v2:172.21.15.144:3300/0 conn(0x7fccb806cfa0 msgr2=0x7fccb806d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:24.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.581+0000 7fccb77fe700 1 --2- 172.21.15.42:0/375190959 >> v2:172.21.15.144:3300/0 conn(0x7fccb806cfa0 0x7fccb806d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:24.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.581+0000 7fccb77fe700 1 -- 172.21.15.42:0/375190959 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb8156280 con 0x7fccb806eda0 2023-07-29T02:00:24.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.582+0000 7fccb77fe700 1 --2- 172.21.15.42:0/375190959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccb806eda0 0x7fccb8155bd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fccb80c32e0 tx=0x7fcca800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aaa960880182226 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:24.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.582+0000 7fccb67fc700 1 -- 172.21.15.42:0/375190959 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca800dd30 con 0x7fccb806eda0 2023-07-29T02:00:24.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.582+0000 7fccb67fc700 1 -- 172.21.15.42:0/375190959 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca800de90 con 0x7fccb806eda0 2023-07-29T02:00:24.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.582+0000 7fccb67fc700 1 -- 172.21.15.42:0/375190959 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca8010690 con 0x7fccb806eda0 2023-07-29T02:00:24.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.582+0000 7fccbdc68700 1 -- 172.21.15.42:0/375190959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccb806eda0 msgr2=0x7fccb8155bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:24.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.582+0000 7fccbdc68700 1 --2- 172.21.15.42:0/375190959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccb806eda0 0x7fccb8155bd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fccb80c32e0 tx=0x7fcca800be70 comp rx=0 tx=0).stop 2023-07-29T02:00:24.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.582+0000 7fccbdc68700 1 -- 172.21.15.42:0/375190959 shutdown_connections 2023-07-29T02:00:24.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.582+0000 7fccbdc68700 1 --2- 172.21.15.42:0/375190959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccb814f920 0x7fccb814fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:24.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.582+0000 7fccbdc68700 1 --2- 172.21.15.42:0/375190959 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccb806eda0 0x7fccb8155bd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:24.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.582+0000 7fccbdc68700 1 --2- 172.21.15.42:0/375190959 >> v2:172.21.15.144:3300/0 conn(0x7fccb806cfa0 0x7fccb806d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:24.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.582+0000 7fccbdc68700 1 -- 172.21.15.42:0/375190959 >> 172.21.15.42:0/375190959 conn(0x7fccb80cbf10 msgr2=0x7fccb80cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:24.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.582+0000 7fccbdc68700 1 -- 172.21.15.42:0/375190959 shutdown_connections 2023-07-29T02:00:24.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.582+0000 7fccbdc68700 1 -- 172.21.15.42:0/375190959 wait complete. 2023-07-29T02:00:24.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.583+0000 7fccbdc68700 1 Processor -- start 2023-07-29T02:00:24.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.584+0000 7fccbdc68700 1 -- start start 2023-07-29T02:00:24.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.584+0000 7fccbdc68700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccb806cfa0 0x7fccb81f1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:24.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.584+0000 7fccbdc68700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccb806eda0 0x7fccb81527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:24.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.584+0000 7fccbdc68700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccb814f920 0x7fccb8152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:24.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.584+0000 7fccbdc68700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb81523a0 con 0x7fccb806cfa0 2023-07-29T02:00:24.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.584+0000 7fccbdc68700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb81514d0 con 0x7fccb814f920 2023-07-29T02:00:24.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.584+0000 7fccbdc68700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb814e4b0 con 0x7fccb806eda0 2023-07-29T02:00:24.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.584+0000 7fccb77fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccb806cfa0 0x7fccb81f1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:24.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.584+0000 7fccb77fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccb806cfa0 0x7fccb81f1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56082/0 (socket says 172.21.15.42:56082) 2023-07-29T02:00:24.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.584+0000 7fccb77fe700 1 -- 172.21.15.42:0/1367924140 learned_addr learned my addr 172.21.15.42:0/1367924140 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:24.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.585+0000 7fccb6ffd700 1 --2- 172.21.15.42:0/1367924140 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccb806eda0 0x7fccb81527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:24.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.585+0000 7fccb7fff700 1 --2- 172.21.15.42:0/1367924140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccb814f920 0x7fccb8152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:24.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.585+0000 7fccb77fe700 1 -- 172.21.15.42:0/1367924140 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccb806eda0 msgr2=0x7fccb81527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:24.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.585+0000 7fccb77fe700 1 --2- 172.21.15.42:0/1367924140 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccb806eda0 0x7fccb81527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:24.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.585+0000 7fccb77fe700 1 -- 172.21.15.42:0/1367924140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccb814f920 msgr2=0x7fccb8152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:24.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.585+0000 7fccb77fe700 1 --2- 172.21.15.42:0/1367924140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccb814f920 0x7fccb8152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:24.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.585+0000 7fccb77fe700 1 -- 172.21.15.42:0/1367924140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca800b7f0 con 0x7fccb806cfa0 2023-07-29T02:00:24.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.585+0000 7fccb77fe700 1 --2- 172.21.15.42:0/1367924140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccb806cfa0 0x7fccb81f1f70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcca800beb0 tx=0x7fcca8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:24.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.585+0000 7fcc9ffff700 1 -- 172.21.15.42:0/1367924140 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca8003da0 con 0x7fccb806cfa0 2023-07-29T02:00:24.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.585+0000 7fcc9ffff700 1 -- 172.21.15.42:0/1367924140 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca8010470 con 0x7fccb806cfa0 2023-07-29T02:00:24.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.585+0000 7fccbdc68700 1 -- 172.21.15.42:0/1367924140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb8151790 con 0x7fccb806cfa0 2023-07-29T02:00:24.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.585+0000 7fcc9ffff700 1 -- 172.21.15.42:0/1367924140 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca8010820 con 0x7fccb806cfa0 2023-07-29T02:00:24.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.585+0000 7fccbdc68700 1 -- 172.21.15.42:0/1367924140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb8151a00 con 0x7fccb806cfa0 2023-07-29T02:00:24.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.586+0000 7fccbdc68700 1 -- 172.21.15.42:0/1367924140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb81524e0 con 0x7fccb806cfa0 2023-07-29T02:00:24.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.587+0000 7fcc9ffff700 1 -- 172.21.15.42:0/1367924140 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fcca8019400 con 0x7fccb806cfa0 2023-07-29T02:00:24.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.587+0000 7fcc9ffff700 1 --2- 172.21.15.42:0/1367924140 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcca406a660 0x7fcca406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:24.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.587+0000 7fcc9ffff700 1 -- 172.21.15.42:0/1367924140 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcca808a220 con 0x7fccb806cfa0 2023-07-29T02:00:24.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.587+0000 7fccb6ffd700 1 --2- 172.21.15.42:0/1367924140 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcca406a660 0x7fcca406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:24.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.588+0000 7fccb6ffd700 1 --2- 172.21.15.42:0/1367924140 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcca406a660 0x7fcca406cb10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fccb81e9060 tx=0x7fccac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:24.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.591+0000 7fcc9ffff700 1 -- 172.21.15.42:0/1367924140 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fccb81524e0 con 0x7fccb806cfa0 2023-07-29T02:00:24.823 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:24.835+0000 7fccbdc68700 1 -- 172.21.15.42:0/1367924140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fccb81524e0 con 0x7fccb806cfa0 2023-07-29T02:00:25.420 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.433+0000 7fcc9ffff700 1 -- 172.21.15.42:0/1367924140 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fccb81524e0 con 0x7fccb806cfa0 2023-07-29T02:00:25.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.435+0000 7fccbdc68700 1 -- 172.21.15.42:0/1367924140 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcca406a660 msgr2=0x7fcca406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:25.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.435+0000 7fccbdc68700 1 --2- 172.21.15.42:0/1367924140 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcca406a660 0x7fcca406cb10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fccb81e9060 tx=0x7fccac008040 comp rx=0 tx=0).stop 2023-07-29T02:00:25.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.435+0000 7fccbdc68700 1 -- 172.21.15.42:0/1367924140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccb806cfa0 msgr2=0x7fccb81f1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:25.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.435+0000 7fccbdc68700 1 --2- 172.21.15.42:0/1367924140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccb806cfa0 0x7fccb81f1f70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcca800beb0 tx=0x7fcca8004750 comp rx=0 tx=0).stop 2023-07-29T02:00:25.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.435+0000 7fccbdc68700 1 -- 172.21.15.42:0/1367924140 shutdown_connections 2023-07-29T02:00:25.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.435+0000 7fccbdc68700 1 --2- 172.21.15.42:0/1367924140 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcca406a660 0x7fcca406cb10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:25.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.435+0000 7fccbdc68700 1 --2- 172.21.15.42:0/1367924140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccb814f920 0x7fccb8152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:25.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.435+0000 7fccbdc68700 1 --2- 172.21.15.42:0/1367924140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fccb806cfa0 0x7fccb81f1f70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:25.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.435+0000 7fccbdc68700 1 --2- 172.21.15.42:0/1367924140 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fccb806eda0 0x7fccb81527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:25.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.435+0000 7fccbdc68700 1 -- 172.21.15.42:0/1367924140 >> 172.21.15.42:0/1367924140 conn(0x7fccb80cbf10 msgr2=0x7fccb80c1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:25.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.435+0000 7fccbdc68700 1 -- 172.21.15.42:0/1367924140 shutdown_connections 2023-07-29T02:00:25.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.435+0000 7fccbdc68700 1 -- 172.21.15.42:0/1367924140 wait complete. 2023-07-29T02:00:25.437 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-07-29T02:00:25.570 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.582+0000 7fae0a97d700 1 Processor -- start 2023-07-29T02:00:25.570 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.582+0000 7fae0a97d700 1 -- start start 2023-07-29T02:00:25.573 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.583+0000 7fae0a97d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fae04155bd0 0x7fae0414f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:25.573 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.583+0000 7fae0a97d700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0406cb10 con 0x7fae0414fe60 2023-07-29T02:00:25.573 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.583+0000 7fae0a97d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae04156000 con 0x7fae0406eda0 2023-07-29T02:00:25.573 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.583+0000 7fae0a97d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae041502a0 con 0x7fae04155bd0 2023-07-29T02:00:25.574 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.583+0000 7fae08f1a700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fae0414fe60 0x7fae0406f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49898/0 (socket says 172.21.15.42:49898) 2023-07-29T02:00:25.574 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.583+0000 7fae08f1a700 1 -- 172.21.15.42:0/2573305685 learned_addr learned my addr 172.21.15.42:0/2573305685 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:25.574 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae037fe700 1 --2- 172.21.15.42:0/2573305685 >> v2:172.21.15.144:3300/0 conn(0x7fae04155bd0 0x7fae0414f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:25.574 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae02ffd700 1 -- 172.21.15.42:0/2573305685 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388771531 0 0) 0x7fae0406cb10 con 0x7fae0414fe60 2023-07-29T02:00:25.574 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae02ffd700 1 -- 172.21.15.42:0/2573305685 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadf00035b0 con 0x7fae0414fe60 2023-07-29T02:00:25.574 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae02ffd700 1 -- 172.21.15.42:0/2573305685 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 745058694 0 0) 0x7fadf00035b0 con 0x7fae0414fe60 2023-07-29T02:00:25.574 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae02ffd700 1 -- 172.21.15.42:0/2573305685 >> v2:172.21.15.144:3300/0 conn(0x7fae04155bd0 msgr2=0x7fae0414f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:25.575 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae02ffd700 1 --2- 172.21.15.42:0/2573305685 >> v2:172.21.15.144:3300/0 conn(0x7fae04155bd0 0x7fae0414f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:25.575 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae02ffd700 1 -- 172.21.15.42:0/2573305685 >> v1:172.21.15.144:6789/0 conn(0x7fae0406eda0 legacy=0x7fae0406cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:25.575 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae02ffd700 1 -- 172.21.15.42:0/2573305685 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae04156280 con 0x7fae0414fe60 2023-07-29T02:00:25.575 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae02ffd700 1 -- 172.21.15.42:0/2573305685 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7fadfc0019f0 con 0x7fae0414fe60 2023-07-29T02:00:25.575 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae02ffd700 1 -- 172.21.15.42:0/2573305685 >> v1:172.21.15.42:6789/0 conn(0x7fae0414fe60 legacy=0x7fae0406f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:25.575 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae02ffd700 1 --2- 172.21.15.42:0/2573305685 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadf0003a00 0x7fadf0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:25.575 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae02ffd700 1 --2- 172.21.15.42:0/2573305685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadf0004850 0x7fadf0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:25.575 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae02ffd700 1 --2- 172.21.15.42:0/2573305685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf0005200 0x7fadf000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:25.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae02ffd700 1 -- 172.21.15.42:0/2573305685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae041502a0 con 0x7fadf0005200 2023-07-29T02:00:25.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae02ffd700 1 -- 172.21.15.42:0/2573305685 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf000c060 con 0x7fadf0004850 2023-07-29T02:00:25.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae02ffd700 1 -- 172.21.15.42:0/2573305685 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf000c220 con 0x7fadf0003a00 2023-07-29T02:00:25.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae08f1a700 1 --2- 172.21.15.42:0/2573305685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf0005200 0x7fadf000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:25.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae037fe700 1 --2- 172.21.15.42:0/2573305685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadf0004850 0x7fadf0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:25.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae03fff700 1 --2- 172.21.15.42:0/2573305685 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadf0003a00 0x7fadf0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:25.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae08f1a700 1 -- 172.21.15.42:0/2573305685 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadf0003a00 msgr2=0x7fadf0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:25.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae08f1a700 1 --2- 172.21.15.42:0/2573305685 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fadf0003a00 0x7fadf0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:25.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae08f1a700 1 -- 172.21.15.42:0/2573305685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadf0004850 msgr2=0x7fadf0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:25.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae08f1a700 1 --2- 172.21.15.42:0/2573305685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fadf0004850 0x7fadf0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:25.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.584+0000 7fae08f1a700 1 -- 172.21.15.42:0/2573305685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf00035b0 con 0x7fadf0005200 2023-07-29T02:00:25.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.585+0000 7fae08f1a700 1 -- 172.21.15.42:0/2573305685 reap_dead start 2023-07-29T02:00:25.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.585+0000 7fae08f1a700 1 --2- 172.21.15.42:0/2573305685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf0005200 0x7fadf000ba10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00a830 tx=0x7fadf0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01a3eb855b3184 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:25.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.585+0000 7fae02ffd700 1 -- 172.21.15.42:0/2573305685 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc00a2f0 con 0x7fadf0005200 2023-07-29T02:00:25.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.585+0000 7fae02ffd700 1 -- 172.21.15.42:0/2573305685 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc012620 con 0x7fadf0005200 2023-07-29T02:00:25.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.585+0000 7fae02ffd700 1 -- 172.21.15.42:0/2573305685 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0129d0 con 0x7fadf0005200 2023-07-29T02:00:25.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.585+0000 7fae0a97d700 1 -- 172.21.15.42:0/2573305685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf0005200 msgr2=0x7fadf000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:25.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.585+0000 7fae0a97d700 1 --2- 172.21.15.42:0/2573305685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf0005200 0x7fadf000ba10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00a830 tx=0x7fadf0005880 comp rx=0 tx=0).stop 2023-07-29T02:00:25.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.585+0000 7fae0a97d700 1 -- 172.21.15.42:0/2573305685 shutdown_connections 2023-07-29T02:00:25.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.585+0000 7fae0a97d700 1 --2- 172.21.15.42:0/2573305685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf0005200 0x7fadf000ba10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:25.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.585+0000 7fae0a97d700 1 -- 172.21.15.42:0/2573305685 >> 172.21.15.42:0/2573305685 conn(0x7fae040cbf10 msgr2=0x7fae040cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:25.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.585+0000 7fae0a97d700 1 -- 172.21.15.42:0/2573305685 shutdown_connections 2023-07-29T02:00:25.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.585+0000 7fae0a97d700 1 -- 172.21.15.42:0/2573305685 wait complete. 2023-07-29T02:00:25.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.586+0000 7fae0a97d700 1 Processor -- start 2023-07-29T02:00:25.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.587+0000 7fae0a97d700 1 -- start start 2023-07-29T02:00:25.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.587+0000 7fae0a97d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf0005200 0x7fae0406a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:25.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.587+0000 7fae0a97d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae040ca7b0 0x7fae041545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:25.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.587+0000 7fae0a97d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae040c6550 0x7fae04154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:25.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.587+0000 7fae0a97d700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae040cbb00 con 0x7fadf0005200 2023-07-29T02:00:25.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.587+0000 7fae0a97d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae04154160 con 0x7fae040c6550 2023-07-29T02:00:25.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.587+0000 7fae0a97d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae040caca0 con 0x7fae040ca7b0 2023-07-29T02:00:25.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.587+0000 7fae03fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf0005200 0x7fae0406a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:25.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.587+0000 7fae03fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf0005200 0x7fae0406a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56102/0 (socket says 172.21.15.42:56102) 2023-07-29T02:00:25.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.588+0000 7fae03fff700 1 -- 172.21.15.42:0/354768307 learned_addr learned my addr 172.21.15.42:0/354768307 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:25.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.588+0000 7fae037fe700 1 --2- 172.21.15.42:0/354768307 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae040ca7b0 0x7fae041545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:25.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.588+0000 7fae08f1a700 1 --2- 172.21.15.42:0/354768307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae040c6550 0x7fae04154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:25.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.588+0000 7fae03fff700 1 -- 172.21.15.42:0/354768307 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae040ca7b0 msgr2=0x7fae041545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:25.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.588+0000 7fae03fff700 1 --2- 172.21.15.42:0/354768307 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae040ca7b0 0x7fae041545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:25.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.588+0000 7fae03fff700 1 -- 172.21.15.42:0/354768307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae040c6550 msgr2=0x7fae04154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:25.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.588+0000 7fae03fff700 1 --2- 172.21.15.42:0/354768307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae040c6550 0x7fae04154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:25.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.588+0000 7fae03fff700 1 -- 172.21.15.42:0/354768307 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae040caf80 con 0x7fadf0005200 2023-07-29T02:00:25.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.588+0000 7fae037fe700 1 --2- 172.21.15.42:0/354768307 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae040ca7b0 0x7fae041545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:25.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.588+0000 7fae08f1a700 1 --2- 172.21.15.42:0/354768307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae040c6550 0x7fae04154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:25.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.588+0000 7fae03fff700 1 --2- 172.21.15.42:0/354768307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf0005200 0x7fae0406a9c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fadf400f7f0 tx=0x7fadf400fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:25.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.588+0000 7fae00ff9700 1 -- 172.21.15.42:0/354768307 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf4005320 con 0x7fadf0005200 2023-07-29T02:00:25.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.588+0000 7fae00ff9700 1 -- 172.21.15.42:0/354768307 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf4005480 con 0x7fadf0005200 2023-07-29T02:00:25.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.588+0000 7fae00ff9700 1 -- 172.21.15.42:0/354768307 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf4006aa0 con 0x7fadf0005200 2023-07-29T02:00:25.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.588+0000 7fae0a97d700 1 -- 172.21.15.42:0/354768307 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae040cb260 con 0x7fadf0005200 2023-07-29T02:00:25.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.588+0000 7fae0a97d700 1 -- 172.21.15.42:0/354768307 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae04153df0 con 0x7fadf0005200 2023-07-29T02:00:25.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.589+0000 7fae0a97d700 1 -- 172.21.15.42:0/354768307 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae04153fb0 con 0x7fadf0005200 2023-07-29T02:00:25.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.590+0000 7fae00ff9700 1 -- 172.21.15.42:0/354768307 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fadf4006c00 con 0x7fadf0005200 2023-07-29T02:00:25.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.590+0000 7fae00ff9700 1 --2- 172.21.15.42:0/354768307 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fade406a660 0x7fade406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:25.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.590+0000 7fae00ff9700 1 -- 172.21.15.42:0/354768307 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fadf40882d0 con 0x7fadf0005200 2023-07-29T02:00:25.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.590+0000 7fae037fe700 1 --2- 172.21.15.42:0/354768307 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fade406a660 0x7fade406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:25.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.591+0000 7fae037fe700 1 --2- 172.21.15.42:0/354768307 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fade406a660 0x7fade406cb10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fae0415a2a0 tx=0x7fadec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:25.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.595+0000 7fae00ff9700 1 -- 172.21.15.42:0/354768307 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fadf40533e0 con 0x7fadf0005200 2023-07-29T02:00:25.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:25.842+0000 7fae0a97d700 1 -- 172.21.15.42:0/354768307 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fae0404ea50 con 0x7fadf0005200 2023-07-29T02:00:26.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.442+0000 7fae00ff9700 1 -- 172.21.15.42:0/354768307 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v10) v1 ==== 115+0+0 (secure 0 0 0) 0x7fadf4056a00 con 0x7fadf0005200 2023-07-29T02:00:26.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.445+0000 7fae0a97d700 1 -- 172.21.15.42:0/354768307 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fade406a660 msgr2=0x7fade406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:26.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.445+0000 7fae0a97d700 1 --2- 172.21.15.42:0/354768307 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fade406a660 0x7fade406cb10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fae0415a2a0 tx=0x7fadec008040 comp rx=0 tx=0).stop 2023-07-29T02:00:26.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.445+0000 7fae0a97d700 1 -- 172.21.15.42:0/354768307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf0005200 msgr2=0x7fae0406a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:26.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.445+0000 7fae0a97d700 1 --2- 172.21.15.42:0/354768307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf0005200 0x7fae0406a9c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fadf400f7f0 tx=0x7fadf400fbb0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.445+0000 7fae0a97d700 1 -- 172.21.15.42:0/354768307 shutdown_connections 2023-07-29T02:00:26.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.445+0000 7fae0a97d700 1 --2- 172.21.15.42:0/354768307 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fade406a660 0x7fade406cb10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.445+0000 7fae0a97d700 1 --2- 172.21.15.42:0/354768307 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fae040c6550 0x7fae04154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.445+0000 7fae0a97d700 1 --2- 172.21.15.42:0/354768307 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fadf0005200 0x7fae0406a9c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.445+0000 7fae0a97d700 1 --2- 172.21.15.42:0/354768307 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fae040ca7b0 0x7fae041545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.445+0000 7fae0a97d700 1 -- 172.21.15.42:0/354768307 >> 172.21.15.42:0/354768307 conn(0x7fae040cbf10 msgr2=0x7fae04071c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:26.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.445+0000 7fae0a97d700 1 -- 172.21.15.42:0/354768307 shutdown_connections 2023-07-29T02:00:26.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.445+0000 7fae0a97d700 1 -- 172.21.15.42:0/354768307 wait complete. 2023-07-29T02:00:26.446 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-29T02:00:26.447 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:00:26.575 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.588+0000 7f3bce2e5700 1 Processor -- start 2023-07-29T02:00:26.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.588+0000 7f3bce2e5700 1 -- start start 2023-07-29T02:00:26.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.589+0000 7f3bce2e5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3bc80c25c0 0x7f3bc806cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.589+0000 7f3bce2e5700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3bc8071020 0x7f3bc80c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.589+0000 7f3bce2e5700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc81591a0 con 0x7f3bc80c8fc0 2023-07-29T02:00:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.589+0000 7f3bce2e5700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc8158fb0 con 0x7f3bc8071020 2023-07-29T02:00:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.589+0000 7f3bce2e5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc8159460 con 0x7f3bc80c25c0 2023-07-29T02:00:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.589+0000 7f3bc77fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3bc8071020 0x7f3bc80c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.589+0000 7f3bcc882700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f3bc80c8fc0 0x7f3bc815c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49918/0 (socket says 172.21.15.42:49918) 2023-07-29T02:00:26.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.589+0000 7f3bcc882700 1 -- 172.21.15.42:0/3943560621 learned_addr learned my addr 172.21.15.42:0/3943560621 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.589+0000 7f3bc7fff700 1 --2- 172.21.15.42:0/3943560621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3bc80c25c0 0x7f3bc806cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.589+0000 7f3bc77fe700 1 -- 172.21.15.42:0/3943560621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3bc80c25c0 msgr2=0x7f3bc806cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.589+0000 7f3bc77fe700 1 --2- 172.21.15.42:0/3943560621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3bc80c25c0 0x7f3bc806cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.589+0000 7f3bc77fe700 1 -- 172.21.15.42:0/3943560621 >> v1:172.21.15.42:6789/0 conn(0x7f3bc80c8fc0 legacy=0x7f3bc815c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.589+0000 7f3bc77fe700 1 -- 172.21.15.42:0/3943560621 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc8159740 con 0x7f3bc8071020 2023-07-29T02:00:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.589+0000 7f3bc6ffd700 1 -- 172.21.15.42:0/3943560621 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165948817 0 0) 0x7f3bc81591a0 con 0x7f3bc80c8fc0 2023-07-29T02:00:26.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.589+0000 7f3bc7fff700 1 --2- 172.21.15.42:0/3943560621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3bc80c25c0 0x7f3bc806cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.589+0000 7f3bc77fe700 1 --2- 172.21.15.42:0/3943560621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bc8071020 0x7f3bc80c8a80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8009840 tx=0x7f3bb8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1622361deb99eb server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.589+0000 7f3bc6ffd700 1 -- 172.21.15.42:0/3943560621 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8011830 con 0x7f3bc8071020 2023-07-29T02:00:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.590+0000 7f3bc6ffd700 1 -- 172.21.15.42:0/3943560621 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb8011990 con 0x7f3bc8071020 2023-07-29T02:00:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.590+0000 7f3bc6ffd700 1 -- 172.21.15.42:0/3943560621 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8011d20 con 0x7f3bc8071020 2023-07-29T02:00:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.590+0000 7f3bce2e5700 1 -- 172.21.15.42:0/3943560621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bc8071020 msgr2=0x7f3bc80c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.590+0000 7f3bce2e5700 1 --2- 172.21.15.42:0/3943560621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bc8071020 0x7f3bc80c8a80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8009840 tx=0x7f3bb8009b50 comp rx=0 tx=0).stop 2023-07-29T02:00:26.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.590+0000 7f3bce2e5700 1 -- 172.21.15.42:0/3943560621 shutdown_connections 2023-07-29T02:00:26.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.590+0000 7f3bce2e5700 1 --2- 172.21.15.42:0/3943560621 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3bc80c25c0 0x7f3bc806cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.590+0000 7f3bce2e5700 1 --2- 172.21.15.42:0/3943560621 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bc8071020 0x7f3bc80c8a80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.590+0000 7f3bce2e5700 1 -- 172.21.15.42:0/3943560621 >> 172.21.15.42:0/3943560621 conn(0x7f3bc806ecc0 msgr2=0x7f3bc806f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:26.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.590+0000 7f3bce2e5700 1 -- 172.21.15.42:0/3943560621 shutdown_connections 2023-07-29T02:00:26.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.590+0000 7f3bce2e5700 1 -- 172.21.15.42:0/3943560621 wait complete. 2023-07-29T02:00:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.591+0000 7f3bce2e5700 1 Processor -- start 2023-07-29T02:00:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.591+0000 7f3bce2e5700 1 -- start start 2023-07-29T02:00:26.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.592+0000 7f3bce2e5700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bc8071020 0x7f3bc8150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:26.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.592+0000 7f3bce2e5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3bc80c25c0 0x7f3bc80717e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:26.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.592+0000 7f3bce2e5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3bc80c8fc0 0x7f3bc8071d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:26.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.592+0000 7f3bce2e5700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80cc850 con 0x7f3bc8071020 2023-07-29T02:00:26.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.592+0000 7f3bce2e5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc81ee390 con 0x7f3bc80c8fc0 2023-07-29T02:00:26.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.592+0000 7f3bce2e5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc81512a0 con 0x7f3bc80c25c0 2023-07-29T02:00:26.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.592+0000 7f3bc7fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bc8071020 0x7f3bc8150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:26.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.592+0000 7f3bc7fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bc8071020 0x7f3bc8150d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56116/0 (socket says 172.21.15.42:56116) 2023-07-29T02:00:26.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.592+0000 7f3bc7fff700 1 -- 172.21.15.42:0/627646097 learned_addr learned my addr 172.21.15.42:0/627646097 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:26.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.592+0000 7f3bc77fe700 1 --2- 172.21.15.42:0/627646097 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3bc80c25c0 0x7f3bc80717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:26.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.592+0000 7f3bcc882700 1 --2- 172.21.15.42:0/627646097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3bc80c8fc0 0x7f3bc8071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:26.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.593+0000 7f3bc7fff700 1 -- 172.21.15.42:0/627646097 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3bc80c25c0 msgr2=0x7f3bc80717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:26.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.593+0000 7f3bc7fff700 1 --2- 172.21.15.42:0/627646097 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3bc80c25c0 0x7f3bc80717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.593+0000 7f3bc7fff700 1 -- 172.21.15.42:0/627646097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3bc80c8fc0 msgr2=0x7f3bc8071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:26.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.593+0000 7f3bc7fff700 1 --2- 172.21.15.42:0/627646097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3bc80c8fc0 0x7f3bc8071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.593+0000 7f3bc7fff700 1 -- 172.21.15.42:0/627646097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb80094a0 con 0x7f3bc8071020 2023-07-29T02:00:26.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.593+0000 7f3bc7fff700 1 --2- 172.21.15.42:0/627646097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bc8071020 0x7f3bc8150d60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc00c750 tx=0x7f3bbc00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:26.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.593+0000 7f3bc4ff9700 1 -- 172.21.15.42:0/627646097 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc011800 con 0x7f3bc8071020 2023-07-29T02:00:26.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.593+0000 7f3bc4ff9700 1 -- 172.21.15.42:0/627646097 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bbc011960 con 0x7f3bc8071020 2023-07-29T02:00:26.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.593+0000 7f3bce2e5700 1 -- 172.21.15.42:0/627646097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc80ccdd0 con 0x7f3bc8071020 2023-07-29T02:00:26.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.593+0000 7f3bc4ff9700 1 -- 172.21.15.42:0/627646097 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc011cd0 con 0x7f3bc8071020 2023-07-29T02:00:26.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.593+0000 7f3bce2e5700 1 -- 172.21.15.42:0/627646097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc80cbac0 con 0x7f3bc8071020 2023-07-29T02:00:26.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.594+0000 7f3bce2e5700 1 -- 172.21.15.42:0/627646097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc804ea50 con 0x7f3bc8071020 2023-07-29T02:00:26.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.594+0000 7f3bc4ff9700 1 -- 172.21.15.42:0/627646097 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f3bbc021350 con 0x7f3bc8071020 2023-07-29T02:00:26.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.595+0000 7f3bc4ff9700 1 --2- 172.21.15.42:0/627646097 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3bb406a660 0x7f3bb406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:26.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.595+0000 7f3bc4ff9700 1 -- 172.21.15.42:0/627646097 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3bbc088cf0 con 0x7f3bc8071020 2023-07-29T02:00:26.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.595+0000 7f3bc77fe700 1 --2- 172.21.15.42:0/627646097 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3bb406a660 0x7f3bb406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:26.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.595+0000 7f3bc77fe700 1 --2- 172.21.15.42:0/627646097 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3bb406a660 0x7f3bb406cb10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80090b0 tx=0x7f3bb8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:26.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.599+0000 7f3bc4ff9700 1 -- 172.21.15.42:0/627646097 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f3bbc08d070 con 0x7f3bc8071020 2023-07-29T02:00:26.827 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.839+0000 7f3bce2e5700 1 -- 172.21.15.42:0/627646097 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3bc80cb800 con 0x7f3bc8071020 2023-07-29T02:00:26.827 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.840+0000 7f3bc4ff9700 1 -- 172.21.15.42:0/627646097 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6165 (secure 0 0 0) 0x7f3bbc057920 con 0x7f3bc8071020 2023-07-29T02:00:26.828 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:26.828 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:00:26.432410+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6837/1851767861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1851767861},{"type":"v1","addr":"172.21.15.42:6837","nonce":1851767861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:00:26.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.842+0000 7f3bce2e5700 1 -- 172.21.15.42:0/627646097 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3bb406a660 msgr2=0x7f3bb406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:26.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.842+0000 7f3bce2e5700 1 --2- 172.21.15.42:0/627646097 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3bb406a660 0x7f3bb406cb10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80090b0 tx=0x7f3bb8008030 comp rx=0 tx=0).stop 2023-07-29T02:00:26.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.842+0000 7f3bce2e5700 1 -- 172.21.15.42:0/627646097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bc8071020 msgr2=0x7f3bc8150d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:26.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.842+0000 7f3bce2e5700 1 --2- 172.21.15.42:0/627646097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bc8071020 0x7f3bc8150d60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc00c750 tx=0x7f3bbc00cb10 comp rx=0 tx=0).stop 2023-07-29T02:00:26.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.842+0000 7f3bce2e5700 1 -- 172.21.15.42:0/627646097 shutdown_connections 2023-07-29T02:00:26.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.842+0000 7f3bce2e5700 1 --2- 172.21.15.42:0/627646097 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3bb406a660 0x7f3bb406cb10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.842+0000 7f3bce2e5700 1 --2- 172.21.15.42:0/627646097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3bc80c8fc0 0x7f3bc8071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.842+0000 7f3bce2e5700 1 --2- 172.21.15.42:0/627646097 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3bc8071020 0x7f3bc8150d60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.842+0000 7f3bce2e5700 1 --2- 172.21.15.42:0/627646097 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3bc80c25c0 0x7f3bc80717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.842+0000 7f3bce2e5700 1 -- 172.21.15.42:0/627646097 >> 172.21.15.42:0/627646097 conn(0x7f3bc806ecc0 msgr2=0x7f3bc8152d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:26.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.842+0000 7f3bce2e5700 1 -- 172.21.15.42:0/627646097 shutdown_connections 2023-07-29T02:00:26.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.842+0000 7f3bce2e5700 1 -- 172.21.15.42:0/627646097 wait complete. 2023-07-29T02:00:26.831 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 10 2023-07-29T02:00:26.842 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T02:00:26.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.978+0000 7f8c289cd700 1 Processor -- start 2023-07-29T02:00:26.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.979+0000 7f8c289cd700 1 -- start start 2023-07-29T02:00:26.968 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.979+0000 7f8c289cd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8c24151060 0x7f8c240c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:26.968 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.979+0000 7f8c289cd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c240c9520 0x7f8c240c8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:26.968 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.979+0000 7f8c289cd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8c240c8980 0x7f8c240c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:26.968 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.979+0000 7f8c289cd700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c240c8e00 con 0x7f8c24151060 2023-07-29T02:00:26.968 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.979+0000 7f8c289cd700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c240c4070 con 0x7f8c240c8980 2023-07-29T02:00:26.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.980+0000 7f8c289cd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c240c2230 con 0x7f8c240c9520 2023-07-29T02:00:26.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.980+0000 7f8c2259c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8c24151060 0x7f8c240c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:26.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.980+0000 7f8c2259c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8c24151060 0x7f8c240c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56124/0 (socket says 172.21.15.42:56124) 2023-07-29T02:00:26.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.980+0000 7f8c2259c700 1 -- 172.21.15.42:0/2950156871 learned_addr learned my addr 172.21.15.42:0/2950156871 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:26.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.980+0000 7f8c22d9d700 1 --2- 172.21.15.42:0/2950156871 >> v2:172.21.15.144:3300/0 conn(0x7f8c240c8980 0x7f8c240c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:26.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.980+0000 7f8c21d9b700 1 --2- 172.21.15.42:0/2950156871 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c240c9520 0x7f8c240c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:26.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.980+0000 7f8c2259c700 1 -- 172.21.15.42:0/2950156871 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c240c9520 msgr2=0x7f8c240c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:26.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.980+0000 7f8c2259c700 1 --2- 172.21.15.42:0/2950156871 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c240c9520 0x7f8c240c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.980+0000 7f8c2259c700 1 -- 172.21.15.42:0/2950156871 >> v2:172.21.15.144:3300/0 conn(0x7f8c240c8980 msgr2=0x7f8c240c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:26.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.980+0000 7f8c2259c700 1 --2- 172.21.15.42:0/2950156871 >> v2:172.21.15.144:3300/0 conn(0x7f8c240c8980 0x7f8c240c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.980+0000 7f8c2259c700 1 -- 172.21.15.42:0/2950156871 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c240c2510 con 0x7f8c24151060 2023-07-29T02:00:26.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.980+0000 7f8c2259c700 1 --2- 172.21.15.42:0/2950156871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c24151060 0x7f8c240c8fe0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8c240caac0 tx=0x7f8c14009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40cc35d9ba97266f server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:26.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.980+0000 7f8c2159a700 1 -- 172.21.15.42:0/2950156871 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1400b870 con 0x7f8c24151060 2023-07-29T02:00:26.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.980+0000 7f8c2159a700 1 -- 172.21.15.42:0/2950156871 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1400b9d0 con 0x7f8c24151060 2023-07-29T02:00:26.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.980+0000 7f8c2159a700 1 -- 172.21.15.42:0/2950156871 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1400bd60 con 0x7f8c24151060 2023-07-29T02:00:26.971 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.981+0000 7f8c289cd700 1 -- 172.21.15.42:0/2950156871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c24151060 msgr2=0x7f8c240c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:26.971 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.981+0000 7f8c289cd700 1 --2- 172.21.15.42:0/2950156871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c24151060 0x7f8c240c8fe0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8c240caac0 tx=0x7f8c14009bd0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.981+0000 7f8c289cd700 1 -- 172.21.15.42:0/2950156871 shutdown_connections 2023-07-29T02:00:26.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.981+0000 7f8c289cd700 1 --2- 172.21.15.42:0/2950156871 >> v2:172.21.15.144:3300/0 conn(0x7f8c240c8980 0x7f8c240c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.981+0000 7f8c289cd700 1 --2- 172.21.15.42:0/2950156871 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c24151060 0x7f8c240c8fe0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.981+0000 7f8c289cd700 1 --2- 172.21.15.42:0/2950156871 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c240c9520 0x7f8c240c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.981+0000 7f8c289cd700 1 -- 172.21.15.42:0/2950156871 >> 172.21.15.42:0/2950156871 conn(0x7f8c2406a750 msgr2=0x7f8c2406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:26.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.981+0000 7f8c289cd700 1 -- 172.21.15.42:0/2950156871 shutdown_connections 2023-07-29T02:00:26.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.981+0000 7f8c289cd700 1 -- 172.21.15.42:0/2950156871 wait complete. 2023-07-29T02:00:26.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.982+0000 7f8c289cd700 1 Processor -- start 2023-07-29T02:00:26.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.982+0000 7f8c289cd700 1 -- start start 2023-07-29T02:00:26.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.983+0000 7f8c289cd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c240c8980 0x7f8c241554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:26.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.983+0000 7f8c289cd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c240c9520 0x7f8c240c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:26.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.983+0000 7f8c289cd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c24151060 0x7f8c24157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:26.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.983+0000 7f8c289cd700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c24155a00 con 0x7f8c240c8980 2023-07-29T02:00:26.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.983+0000 7f8c289cd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c241ed220 con 0x7f8c240c9520 2023-07-29T02:00:26.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.983+0000 7f8c289cd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c241567b0 con 0x7f8c24151060 2023-07-29T02:00:26.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.983+0000 7f8c2259c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c240c8980 0x7f8c241554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:26.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.983+0000 7f8c2259c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c240c8980 0x7f8c241554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56132/0 (socket says 172.21.15.42:56132) 2023-07-29T02:00:26.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.983+0000 7f8c2259c700 1 -- 172.21.15.42:0/4279942440 learned_addr learned my addr 172.21.15.42:0/4279942440 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:26.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.983+0000 7f8c22d9d700 1 --2- 172.21.15.42:0/4279942440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c24151060 0x7f8c24157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:26.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.983+0000 7f8c21d9b700 1 --2- 172.21.15.42:0/4279942440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c240c9520 0x7f8c240c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:26.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.983+0000 7f8c2259c700 1 -- 172.21.15.42:0/4279942440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c24151060 msgr2=0x7f8c24157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:26.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.983+0000 7f8c2259c700 1 --2- 172.21.15.42:0/4279942440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c24151060 0x7f8c24157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.983+0000 7f8c2259c700 1 -- 172.21.15.42:0/4279942440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c240c9520 msgr2=0x7f8c240c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:26.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.983+0000 7f8c2259c700 1 --2- 172.21.15.42:0/4279942440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c240c9520 0x7f8c240c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:26.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.983+0000 7f8c2259c700 1 -- 172.21.15.42:0/4279942440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c14009550 con 0x7f8c240c8980 2023-07-29T02:00:26.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.983+0000 7f8c21d9b700 1 --2- 172.21.15.42:0/4279942440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c240c9520 0x7f8c240c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.983+0000 7f8c22d9d700 1 --2- 172.21.15.42:0/4279942440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c24151060 0x7f8c24157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.984+0000 7f8c2259c700 1 --2- 172.21.15.42:0/4279942440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c240c8980 0x7f8c241554c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8c14000c00 tx=0x7f8c14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.984+0000 7f8c12ffd700 1 -- 172.21.15.42:0/4279942440 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c14004520 con 0x7f8c240c8980 2023-07-29T02:00:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.984+0000 7f8c12ffd700 1 -- 172.21.15.42:0/4279942440 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1401e070 con 0x7f8c240c8980 2023-07-29T02:00:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.984+0000 7f8c12ffd700 1 -- 172.21.15.42:0/4279942440 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c140038c0 con 0x7f8c240c8980 2023-07-29T02:00:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.984+0000 7f8c289cd700 1 -- 172.21.15.42:0/4279942440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c241ec3c0 con 0x7f8c240c8980 2023-07-29T02:00:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.984+0000 7f8c289cd700 1 -- 172.21.15.42:0/4279942440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c241ec980 con 0x7f8c240c8980 2023-07-29T02:00:26.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.985+0000 7f8c289cd700 1 -- 172.21.15.42:0/4279942440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2404ea50 con 0x7f8c240c8980 2023-07-29T02:00:26.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.985+0000 7f8c12ffd700 1 -- 172.21.15.42:0/4279942440 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f8c14003a20 con 0x7f8c240c8980 2023-07-29T02:00:26.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.986+0000 7f8c12ffd700 1 --2- 172.21.15.42:0/4279942440 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c0406a660 0x7f8c0406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:26.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.986+0000 7f8c12ffd700 1 -- 172.21.15.42:0/4279942440 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8c14020070 con 0x7f8c240c8980 2023-07-29T02:00:26.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.986+0000 7f8c21d9b700 1 --2- 172.21.15.42:0/4279942440 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c0406a660 0x7f8c0406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:26.979 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.986+0000 7f8c21d9b700 1 --2- 172.21.15.42:0/4279942440 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c0406a660 0x7f8c0406cb10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8c2414d330 tx=0x7f8c18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:26.979 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:26.990+0000 7f8c12ffd700 1 -- 172.21.15.42:0/4279942440 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f8c140555b0 con 0x7f8c240c8980 2023-07-29T02:00:27.179 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.191+0000 7f8c289cd700 1 -- 172.21.15.42:0/4279942440 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c2406e1a0 con 0x7f8c240c8980 2023-07-29T02:00:27.180 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.192+0000 7f8c12ffd700 1 -- 172.21.15.42:0/4279942440 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19690 (secure 0 0 0) 0x7f8c14058bd0 con 0x7f8c240c8980 2023-07-29T02:00:27.180 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:27.181 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T02:00:02.394460+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T01:59:55.827461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T01:59:56.924040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-29T01:59:59.996470+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T02:00:27.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.195+0000 7f8c289cd700 1 -- 172.21.15.42:0/4279942440 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c0406a660 msgr2=0x7f8c0406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:27.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.195+0000 7f8c289cd700 1 --2- 172.21.15.42:0/4279942440 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c0406a660 0x7f8c0406cb10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8c2414d330 tx=0x7f8c18008040 comp rx=0 tx=0).stop 2023-07-29T02:00:27.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.195+0000 7f8c289cd700 1 -- 172.21.15.42:0/4279942440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c240c8980 msgr2=0x7f8c241554c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:27.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.195+0000 7f8c289cd700 1 --2- 172.21.15.42:0/4279942440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c240c8980 0x7f8c241554c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8c14000c00 tx=0x7f8c14004750 comp rx=0 tx=0).stop 2023-07-29T02:00:27.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.195+0000 7f8c289cd700 1 -- 172.21.15.42:0/4279942440 shutdown_connections 2023-07-29T02:00:27.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.195+0000 7f8c289cd700 1 --2- 172.21.15.42:0/4279942440 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c0406a660 0x7f8c0406cb10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.195+0000 7f8c289cd700 1 --2- 172.21.15.42:0/4279942440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c24151060 0x7f8c24157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.195+0000 7f8c289cd700 1 --2- 172.21.15.42:0/4279942440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c240c8980 0x7f8c241554c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.195+0000 7f8c289cd700 1 --2- 172.21.15.42:0/4279942440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c240c9520 0x7f8c240c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.195+0000 7f8c289cd700 1 -- 172.21.15.42:0/4279942440 >> 172.21.15.42:0/4279942440 conn(0x7f8c2406a750 msgr2=0x7f8c2406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:27.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.195+0000 7f8c289cd700 1 -- 172.21.15.42:0/4279942440 shutdown_connections 2023-07-29T02:00:27.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.195+0000 7f8c289cd700 1 -- 172.21.15.42:0/4279942440 wait complete. 2023-07-29T02:00:27.195 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-29T02:00:27.195 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T02:00:27.320 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.333+0000 7f1fe632b700 1 Processor -- start 2023-07-29T02:00:27.321 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.333+0000 7f1fe632b700 1 -- start start 2023-07-29T02:00:27.322 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.334+0000 7f1fe632b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1fe014fd20 0x7f1fe0071950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:27.322 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.334+0000 7f1fe632b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fe00c57a0 0x7f1fe0071e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:27.322 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.334+0000 7f1fe632b700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe006ef60 con 0x7f1fe006b380 2023-07-29T02:00:27.323 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.334+0000 7f1fe632b700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe0061740 con 0x7f1fe014fd20 2023-07-29T02:00:27.323 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.334+0000 7f1fe632b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe0155d10 con 0x7f1fe00c57a0 2023-07-29T02:00:27.323 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.334+0000 7f1fdffff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1fe014fd20 0x7f1fe0071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:27.323 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.334+0000 7f1fe48c8700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f1fe006b380 0x7f1fe006bce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49946/0 (socket says 172.21.15.42:49946) 2023-07-29T02:00:27.323 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.334+0000 7f1fe48c8700 1 -- 172.21.15.42:0/228665516 learned_addr learned my addr 172.21.15.42:0/228665516 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:27.323 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.334+0000 7f1fdf7fe700 1 --2- 172.21.15.42:0/228665516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fe00c57a0 0x7f1fe0071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:27.323 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.334+0000 7f1fdeffd700 1 -- 172.21.15.42:0/228665516 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264717689 0 0) 0x7f1fe006ef60 con 0x7f1fe006b380 2023-07-29T02:00:27.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.334+0000 7f1fdeffd700 1 -- 172.21.15.42:0/228665516 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fcc0035b0 con 0x7f1fe006b380 2023-07-29T02:00:27.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.334+0000 7f1fdffff700 1 -- 172.21.15.42:0/228665516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fe00c57a0 msgr2=0x7f1fe0071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:27.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.334+0000 7f1fdffff700 1 --2- 172.21.15.42:0/228665516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fe00c57a0 0x7f1fe0071e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.334+0000 7f1fdffff700 1 -- 172.21.15.42:0/228665516 >> v1:172.21.15.42:6789/0 conn(0x7f1fe006b380 legacy=0x7f1fe006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:27.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.334+0000 7f1fdffff700 1 -- 172.21.15.42:0/228665516 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe006b850 con 0x7f1fe014fd20 2023-07-29T02:00:27.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.335+0000 7f1fdffff700 1 --2- 172.21.15.42:0/228665516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fe014fd20 0x7f1fe0071950 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8009840 tx=0x7f1fc8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb062642b55e2566 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:27.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.335+0000 7f1fdeffd700 1 -- 172.21.15.42:0/228665516 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8011830 con 0x7f1fe014fd20 2023-07-29T02:00:27.325 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.335+0000 7f1fdeffd700 1 -- 172.21.15.42:0/228665516 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc8011990 con 0x7f1fe014fd20 2023-07-29T02:00:27.325 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.335+0000 7f1fdeffd700 1 -- 172.21.15.42:0/228665516 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8011d00 con 0x7f1fe014fd20 2023-07-29T02:00:27.327 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.335+0000 7f1fe632b700 1 -- 172.21.15.42:0/228665516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fe014fd20 msgr2=0x7f1fe0071950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:27.327 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.335+0000 7f1fe632b700 1 --2- 172.21.15.42:0/228665516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fe014fd20 0x7f1fe0071950 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8009840 tx=0x7f1fc8009b50 comp rx=0 tx=0).stop 2023-07-29T02:00:27.327 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.335+0000 7f1fe632b700 1 -- 172.21.15.42:0/228665516 shutdown_connections 2023-07-29T02:00:27.327 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.335+0000 7f1fe632b700 1 --2- 172.21.15.42:0/228665516 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fe014fd20 0x7f1fe0071950 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.327 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.335+0000 7f1fe632b700 1 --2- 172.21.15.42:0/228665516 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fe00c57a0 0x7f1fe0071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.327 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.335+0000 7f1fe632b700 1 -- 172.21.15.42:0/228665516 >> 172.21.15.42:0/228665516 conn(0x7f1fe00c80e0 msgr2=0x7f1fe00c84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:27.327 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.335+0000 7f1fe632b700 1 -- 172.21.15.42:0/228665516 shutdown_connections 2023-07-29T02:00:27.328 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.335+0000 7f1fe632b700 1 -- 172.21.15.42:0/228665516 wait complete. 2023-07-29T02:00:27.328 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.336+0000 7f1fe632b700 1 Processor -- start 2023-07-29T02:00:27.328 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.337+0000 7f1fe632b700 1 -- start start 2023-07-29T02:00:27.328 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.337+0000 7f1fe632b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fe006b380 0x7f1fe0135330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:27.328 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.337+0000 7f1fe632b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fe00c57a0 0x7f1fe00c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:27.328 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.337+0000 7f1fe632b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fe014fd20 0x7f1fe01498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:27.328 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.337+0000 7f1fe632b700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe012faa0 con 0x7f1fe00c57a0 2023-07-29T02:00:27.329 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.337+0000 7f1fe632b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe01efa10 con 0x7f1fe014fd20 2023-07-29T02:00:27.329 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.337+0000 7f1fe632b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe00c8770 con 0x7f1fe006b380 2023-07-29T02:00:27.329 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.337+0000 7f1fdf7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fe00c57a0 0x7f1fe00c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:27.329 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.337+0000 7f1fdf7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fe00c57a0 0x7f1fe00c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56146/0 (socket says 172.21.15.42:56146) 2023-07-29T02:00:27.329 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.337+0000 7f1fdf7fe700 1 -- 172.21.15.42:0/2917231111 learned_addr learned my addr 172.21.15.42:0/2917231111 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:27.329 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.338+0000 7f1fdffff700 1 --2- 172.21.15.42:0/2917231111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fe006b380 0x7f1fe0135330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:27.329 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.338+0000 7f1fe48c8700 1 --2- 172.21.15.42:0/2917231111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fe014fd20 0x7f1fe01498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:27.329 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.338+0000 7f1fdf7fe700 1 -- 172.21.15.42:0/2917231111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fe006b380 msgr2=0x7f1fe0135330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:27.330 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.338+0000 7f1fdf7fe700 1 --2- 172.21.15.42:0/2917231111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fe006b380 0x7f1fe0135330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.330 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.338+0000 7f1fdf7fe700 1 -- 172.21.15.42:0/2917231111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fe014fd20 msgr2=0x7f1fe01498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:27.330 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.338+0000 7f1fdf7fe700 1 --2- 172.21.15.42:0/2917231111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fe014fd20 0x7f1fe01498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.330 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.338+0000 7f1fdf7fe700 1 -- 172.21.15.42:0/2917231111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc80094a0 con 0x7f1fe00c57a0 2023-07-29T02:00:27.330 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.338+0000 7f1fe48c8700 1 --2- 172.21.15.42:0/2917231111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fe014fd20 0x7f1fe01498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:27.330 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.338+0000 7f1fdf7fe700 1 --2- 172.21.15.42:0/2917231111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fe00c57a0 0x7f1fe00c9ed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000e870 tx=0x7f1fd000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:27.330 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.338+0000 7f1fdcff9700 1 -- 172.21.15.42:0/2917231111 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0009590 con 0x7f1fe00c57a0 2023-07-29T02:00:27.331 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.338+0000 7f1fdcff9700 1 -- 172.21.15.42:0/2917231111 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd0013680 con 0x7f1fe00c57a0 2023-07-29T02:00:27.331 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.338+0000 7f1fe632b700 1 -- 172.21.15.42:0/2917231111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe01eebb0 con 0x7f1fe00c57a0 2023-07-29T02:00:27.331 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.338+0000 7f1fdcff9700 1 -- 172.21.15.42:0/2917231111 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0013a30 con 0x7f1fe00c57a0 2023-07-29T02:00:27.331 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.338+0000 7f1fe632b700 1 -- 172.21.15.42:0/2917231111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe01ef170 con 0x7f1fe00c57a0 2023-07-29T02:00:27.331 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.339+0000 7f1fe632b700 1 -- 172.21.15.42:0/2917231111 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe004ea50 con 0x7f1fe00c57a0 2023-07-29T02:00:27.332 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.340+0000 7f1fdcff9700 1 -- 172.21.15.42:0/2917231111 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f1fd0013b90 con 0x7f1fe00c57a0 2023-07-29T02:00:27.332 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.340+0000 7f1fdcff9700 1 --2- 172.21.15.42:0/2917231111 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f1fc006a660 0x7f1fc006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:27.332 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.340+0000 7f1fdcff9700 1 -- 172.21.15.42:0/2917231111 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1fd0088cc0 con 0x7f1fe00c57a0 2023-07-29T02:00:27.332 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.340+0000 7f1fdffff700 1 --2- 172.21.15.42:0/2917231111 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f1fc006a660 0x7f1fc006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:27.332 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.341+0000 7f1fdffff700 1 --2- 172.21.15.42:0/2917231111 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f1fc006a660 0x7f1fc006cb10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8000c00 tx=0x7f1fc801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:27.333 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.345+0000 7f1fdcff9700 1 -- 172.21.15.42:0/2917231111 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f1fd0053d40 con 0x7f1fe00c57a0 2023-07-29T02:00:27.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.543+0000 7f1fe632b700 1 -- 172.21.15.42:0/2917231111 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1fe01561c0 con 0x7f1fc006a660 2023-07-29T02:00:27.542 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.555+0000 7f1fdcff9700 1 -- 172.21.15.42:0/2917231111 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367614 (secure 0 0 0) 0x7f1fc8011630 con 0x7f1fc006a660 2023-07-29T02:00:27.546 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:27.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.558+0000 7f1fe632b700 1 -- 172.21.15.42:0/2917231111 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f1fc006a660 msgr2=0x7f1fc006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:27.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.558+0000 7f1fe632b700 1 --2- 172.21.15.42:0/2917231111 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f1fc006a660 0x7f1fc006cb10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8000c00 tx=0x7f1fc801c040 comp rx=0 tx=0).stop 2023-07-29T02:00:27.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.558+0000 7f1fe632b700 1 -- 172.21.15.42:0/2917231111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fe00c57a0 msgr2=0x7f1fe00c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:27.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.558+0000 7f1fe632b700 1 --2- 172.21.15.42:0/2917231111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fe00c57a0 0x7f1fe00c9ed0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000e870 tx=0x7f1fd000eb80 comp rx=0 tx=0).stop 2023-07-29T02:00:27.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.558+0000 7f1fe632b700 1 -- 172.21.15.42:0/2917231111 shutdown_connections 2023-07-29T02:00:27.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.558+0000 7f1fe632b700 1 --2- 172.21.15.42:0/2917231111 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f1fc006a660 0x7f1fc006cb10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.558+0000 7f1fe632b700 1 --2- 172.21.15.42:0/2917231111 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1fe014fd20 0x7f1fe01498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.558+0000 7f1fe632b700 1 --2- 172.21.15.42:0/2917231111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1fe006b380 0x7f1fe0135330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.558+0000 7f1fe632b700 1 --2- 172.21.15.42:0/2917231111 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1fe00c57a0 0x7f1fe00c9ed0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.558+0000 7f1fe632b700 1 -- 172.21.15.42:0/2917231111 >> 172.21.15.42:0/2917231111 conn(0x7f1fe00c80e0 msgr2=0x7f1fe0070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:27.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.558+0000 7f1fe632b700 1 -- 172.21.15.42:0/2917231111 shutdown_connections 2023-07-29T02:00:27.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.558+0000 7f1fe632b700 1 -- 172.21.15.42:0/2917231111 wait complete. 2023-07-29T02:00:27.550 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2023-07-29T02:00:27.558 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-07-29T02:00:27.238643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594957,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217884,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756836,"statfs":{"total":773094113280,"available":772871000064,"internally_reserved":0,"allocated":2322432,"data_stored":2064161,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003685"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972736+0000","last_change":"2023-07-29T01:59:57.958129+0000","last_active":"2023-07-29T02:00:01.972736+0000","last_peered":"2023-07-29T02:00:01.972736+0000","last_clean":"2023-07-29T02:00:01.972736+0000","last_became_active":"2023-07-29T01:59:57.957742+0000","last_became_peered":"2023-07-29T01:59:57.957742+0000","last_unstale":"2023-07-29T02:00:01.972736+0000","last_undegraded":"2023-07-29T02:00:01.972736+0000","last_fullsized":"2023-07-29T02:00:01.972736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:32.550358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975520+0000","last_change":"2023-07-29T01:59:57.974652+0000","last_active":"2023-07-29T02:00:01.975520+0000","last_peered":"2023-07-29T02:00:01.975520+0000","last_clean":"2023-07-29T02:00:01.975520+0000","last_became_active":"2023-07-29T01:59:57.974338+0000","last_became_peered":"2023-07-29T01:59:57.974338+0000","last_unstale":"2023-07-29T02:00:01.975520+0000","last_undegraded":"2023-07-29T02:00:01.975520+0000","last_fullsized":"2023-07-29T02:00:01.975520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978265+0000","last_change":"2023-07-29T01:59:57.973621+0000","last_active":"2023-07-29T02:00:01.978265+0000","last_peered":"2023-07-29T02:00:01.978265+0000","last_clean":"2023-07-29T02:00:01.978265+0000","last_became_active":"2023-07-29T01:59:57.973406+0000","last_became_peered":"2023-07-29T01:59:57.973406+0000","last_unstale":"2023-07-29T02:00:01.978265+0000","last_undegraded":"2023-07-29T02:00:01.978265+0000","last_fullsized":"2023-07-29T02:00:01.978265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:08:23.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968045+0000","last_change":"2023-07-29T01:59:57.965192+0000","last_active":"2023-07-29T02:00:01.968045+0000","last_peered":"2023-07-29T02:00:01.968045+0000","last_clean":"2023-07-29T02:00:01.968045+0000","last_became_active":"2023-07-29T01:59:57.964865+0000","last_became_peered":"2023-07-29T01:59:57.964865+0000","last_unstale":"2023-07-29T02:00:01.968045+0000","last_undegraded":"2023-07-29T02:00:01.968045+0000","last_fullsized":"2023-07-29T02:00:01.968045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:32.905717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967106+0000","last_change":"2023-07-29T01:59:57.971026+0000","last_active":"2023-07-29T02:00:01.967106+0000","last_peered":"2023-07-29T02:00:01.967106+0000","last_clean":"2023-07-29T02:00:01.967106+0000","last_became_active":"2023-07-29T01:59:57.970733+0000","last_became_peered":"2023-07-29T01:59:57.970733+0000","last_unstale":"2023-07-29T02:00:01.967106+0000","last_undegraded":"2023-07-29T02:00:01.967106+0000","last_fullsized":"2023-07-29T02:00:01.967106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971129+0000","last_change":"2023-07-29T01:59:57.965729+0000","last_active":"2023-07-29T02:00:01.971129+0000","last_peered":"2023-07-29T02:00:01.971129+0000","last_clean":"2023-07-29T02:00:01.971129+0000","last_became_active":"2023-07-29T01:59:57.964993+0000","last_became_peered":"2023-07-29T01:59:57.964993+0000","last_unstale":"2023-07-29T02:00:01.971129+0000","last_undegraded":"2023-07-29T02:00:01.971129+0000","last_fullsized":"2023-07-29T02:00:01.971129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974411+0000","last_change":"2023-07-29T01:59:57.970481+0000","last_active":"2023-07-29T02:00:01.974411+0000","last_peered":"2023-07-29T02:00:01.974411+0000","last_clean":"2023-07-29T02:00:01.974411+0000","last_became_active":"2023-07-29T01:59:57.970232+0000","last_became_peered":"2023-07-29T01:59:57.970232+0000","last_unstale":"2023-07-29T02:00:01.974411+0000","last_undegraded":"2023-07-29T02:00:01.974411+0000","last_fullsized":"2023-07-29T02:00:01.974411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974000+0000","last_change":"2023-07-29T01:59:57.963201+0000","last_active":"2023-07-29T02:00:01.974000+0000","last_peered":"2023-07-29T02:00:01.974000+0000","last_clean":"2023-07-29T02:00:01.974000+0000","last_became_active":"2023-07-29T01:59:57.962884+0000","last_became_peered":"2023-07-29T01:59:57.962884+0000","last_unstale":"2023-07-29T02:00:01.974000+0000","last_undegraded":"2023-07-29T02:00:01.974000+0000","last_fullsized":"2023-07-29T02:00:01.974000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967238+0000","last_change":"2023-07-29T01:59:57.971916+0000","last_active":"2023-07-29T02:00:01.967238+0000","last_peered":"2023-07-29T02:00:01.967238+0000","last_clean":"2023-07-29T02:00:01.967238+0000","last_became_active":"2023-07-29T01:59:57.971640+0000","last_became_peered":"2023-07-29T01:59:57.971640+0000","last_unstale":"2023-07-29T02:00:01.967238+0000","last_undegraded":"2023-07-29T02:00:01.967238+0000","last_fullsized":"2023-07-29T02:00:01.967238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975619+0000","last_change":"2023-07-29T01:59:57.963080+0000","last_active":"2023-07-29T02:00:01.975619+0000","last_peered":"2023-07-29T02:00:01.975619+0000","last_clean":"2023-07-29T02:00:01.975619+0000","last_became_active":"2023-07-29T01:59:57.962799+0000","last_became_peered":"2023-07-29T01:59:57.962799+0000","last_unstale":"2023-07-29T02:00:01.975619+0000","last_undegraded":"2023-07-29T02:00:01.975619+0000","last_fullsized":"2023-07-29T02:00:01.975619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978173+0000","last_change":"2023-07-29T01:59:57.970172+0000","last_active":"2023-07-29T02:00:01.978173+0000","last_peered":"2023-07-29T02:00:01.978173+0000","last_clean":"2023-07-29T02:00:01.978173+0000","last_became_active":"2023-07-29T01:59:57.969868+0000","last_became_peered":"2023-07-29T01:59:57.969868+0000","last_unstale":"2023-07-29T02:00:01.978173+0000","last_undegraded":"2023-07-29T02:00:01.978173+0000","last_fullsized":"2023-07-29T02:00:01.978173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972765+0000","last_change":"2023-07-29T01:59:57.964171+0000","last_active":"2023-07-29T02:00:01.972765+0000","last_peered":"2023-07-29T02:00:01.972765+0000","last_clean":"2023-07-29T02:00:01.972765+0000","last_became_active":"2023-07-29T01:59:57.963902+0000","last_became_peered":"2023-07-29T01:59:57.963902+0000","last_unstale":"2023-07-29T02:00:01.972765+0000","last_undegraded":"2023-07-29T02:00:01.972765+0000","last_fullsized":"2023-07-29T02:00:01.972765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:51.691001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972884+0000","last_change":"2023-07-29T01:59:57.963492+0000","last_active":"2023-07-29T02:00:01.972884+0000","last_peered":"2023-07-29T02:00:01.972884+0000","last_clean":"2023-07-29T02:00:01.972884+0000","last_became_active":"2023-07-29T01:59:57.963239+0000","last_became_peered":"2023-07-29T01:59:57.963239+0000","last_unstale":"2023-07-29T02:00:01.972884+0000","last_undegraded":"2023-07-29T02:00:01.972884+0000","last_fullsized":"2023-07-29T02:00:01.972884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:08.001986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974742+0000","last_change":"2023-07-29T01:59:57.961369+0000","last_active":"2023-07-29T02:00:01.974742+0000","last_peered":"2023-07-29T02:00:01.974742+0000","last_clean":"2023-07-29T02:00:01.974742+0000","last_became_active":"2023-07-29T01:59:57.960709+0000","last_became_peered":"2023-07-29T01:59:57.960709+0000","last_unstale":"2023-07-29T02:00:01.974742+0000","last_undegraded":"2023-07-29T02:00:01.974742+0000","last_fullsized":"2023-07-29T02:00:01.974742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974229+0000","last_change":"2023-07-29T01:59:57.970498+0000","last_active":"2023-07-29T02:00:01.974229+0000","last_peered":"2023-07-29T02:00:01.974229+0000","last_clean":"2023-07-29T02:00:01.974229+0000","last_became_active":"2023-07-29T01:59:57.970263+0000","last_became_peered":"2023-07-29T01:59:57.970263+0000","last_unstale":"2023-07-29T02:00:01.974229+0000","last_undegraded":"2023-07-29T02:00:01.974229+0000","last_fullsized":"2023-07-29T02:00:01.974229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975567+0000","last_change":"2023-07-29T01:59:57.965648+0000","last_active":"2023-07-29T02:00:01.975567+0000","last_peered":"2023-07-29T02:00:01.975567+0000","last_clean":"2023-07-29T02:00:01.975567+0000","last_became_active":"2023-07-29T01:59:57.964696+0000","last_became_peered":"2023-07-29T01:59:57.964696+0000","last_unstale":"2023-07-29T02:00:01.975567+0000","last_undegraded":"2023-07-29T02:00:01.975567+0000","last_fullsized":"2023-07-29T02:00:01.975567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:19:14.641252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967346+0000","last_change":"2023-07-29T01:59:57.969148+0000","last_active":"2023-07-29T02:00:01.967346+0000","last_peered":"2023-07-29T02:00:01.967346+0000","last_clean":"2023-07-29T02:00:01.967346+0000","last_became_active":"2023-07-29T01:59:57.968885+0000","last_became_peered":"2023-07-29T01:59:57.968885+0000","last_unstale":"2023-07-29T02:00:01.967346+0000","last_undegraded":"2023-07-29T02:00:01.967346+0000","last_fullsized":"2023-07-29T02:00:01.967346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977442+0000","last_change":"2023-07-29T01:59:57.963189+0000","last_active":"2023-07-29T02:00:01.977442+0000","last_peered":"2023-07-29T02:00:01.977442+0000","last_clean":"2023-07-29T02:00:01.977442+0000","last_became_active":"2023-07-29T01:59:57.962919+0000","last_became_peered":"2023-07-29T01:59:57.962919+0000","last_unstale":"2023-07-29T02:00:01.977442+0000","last_undegraded":"2023-07-29T02:00:01.977442+0000","last_fullsized":"2023-07-29T02:00:01.977442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:16:58.718803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973218+0000","last_change":"2023-07-29T01:59:57.960380+0000","last_active":"2023-07-29T02:00:01.973218+0000","last_peered":"2023-07-29T02:00:01.973218+0000","last_clean":"2023-07-29T02:00:01.973218+0000","last_became_active":"2023-07-29T01:59:57.960111+0000","last_became_peered":"2023-07-29T01:59:57.960111+0000","last_unstale":"2023-07-29T02:00:01.973218+0000","last_undegraded":"2023-07-29T02:00:01.973218+0000","last_fullsized":"2023-07-29T02:00:01.973218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:45.956813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977046+0000","last_change":"2023-07-29T01:59:57.961945+0000","last_active":"2023-07-29T02:00:01.977046+0000","last_peered":"2023-07-29T02:00:01.977046+0000","last_clean":"2023-07-29T02:00:01.977046+0000","last_became_active":"2023-07-29T01:59:57.961655+0000","last_became_peered":"2023-07-29T01:59:57.961655+0000","last_unstale":"2023-07-29T02:00:01.977046+0000","last_undegraded":"2023-07-29T02:00:01.977046+0000","last_fullsized":"2023-07-29T02:00:01.977046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.203628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974482+0000","last_change":"2023-07-29T01:59:57.971030+0000","last_active":"2023-07-29T02:00:01.974482+0000","last_peered":"2023-07-29T02:00:01.974482+0000","last_clean":"2023-07-29T02:00:01.974482+0000","last_became_active":"2023-07-29T01:59:57.970757+0000","last_became_peered":"2023-07-29T01:59:57.970757+0000","last_unstale":"2023-07-29T02:00:01.974482+0000","last_undegraded":"2023-07-29T02:00:01.974482+0000","last_fullsized":"2023-07-29T02:00:01.974482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966509+0000","last_change":"2023-07-29T01:59:57.974734+0000","last_active":"2023-07-29T02:00:01.966509+0000","last_peered":"2023-07-29T02:00:01.966509+0000","last_clean":"2023-07-29T02:00:01.966509+0000","last_became_active":"2023-07-29T01:59:57.974436+0000","last_became_peered":"2023-07-29T01:59:57.974436+0000","last_unstale":"2023-07-29T02:00:01.966509+0000","last_undegraded":"2023-07-29T02:00:01.966509+0000","last_fullsized":"2023-07-29T02:00:01.966509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979698+0000","last_change":"2023-07-29T01:59:57.967259+0000","last_active":"2023-07-29T02:00:01.979698+0000","last_peered":"2023-07-29T02:00:01.979698+0000","last_clean":"2023-07-29T02:00:01.979698+0000","last_became_active":"2023-07-29T01:59:57.966987+0000","last_became_peered":"2023-07-29T01:59:57.966987+0000","last_unstale":"2023-07-29T02:00:01.979698+0000","last_undegraded":"2023-07-29T02:00:01.979698+0000","last_fullsized":"2023-07-29T02:00:01.979698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973494+0000","last_change":"2023-07-29T01:59:57.971976+0000","last_active":"2023-07-29T02:00:01.973494+0000","last_peered":"2023-07-29T02:00:01.973494+0000","last_clean":"2023-07-29T02:00:01.973494+0000","last_became_active":"2023-07-29T01:59:57.971733+0000","last_became_peered":"2023-07-29T01:59:57.971733+0000","last_unstale":"2023-07-29T02:00:01.973494+0000","last_undegraded":"2023-07-29T02:00:01.973494+0000","last_fullsized":"2023-07-29T02:00:01.973494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972112+0000","last_change":"2023-07-29T01:59:57.973644+0000","last_active":"2023-07-29T02:00:01.972112+0000","last_peered":"2023-07-29T02:00:01.972112+0000","last_clean":"2023-07-29T02:00:01.972112+0000","last_became_active":"2023-07-29T01:59:57.969742+0000","last_became_peered":"2023-07-29T01:59:57.969742+0000","last_unstale":"2023-07-29T02:00:01.972112+0000","last_undegraded":"2023-07-29T02:00:01.972112+0000","last_fullsized":"2023-07-29T02:00:01.972112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975642+0000","last_change":"2023-07-29T01:59:57.969779+0000","last_active":"2023-07-29T02:00:01.975642+0000","last_peered":"2023-07-29T02:00:01.975642+0000","last_clean":"2023-07-29T02:00:01.975642+0000","last_became_active":"2023-07-29T01:59:57.969409+0000","last_became_peered":"2023-07-29T01:59:57.969409+0000","last_unstale":"2023-07-29T02:00:01.975642+0000","last_undegraded":"2023-07-29T02:00:01.975642+0000","last_fullsized":"2023-07-29T02:00:01.975642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977989+0000","last_change":"2023-07-29T01:59:57.965799+0000","last_active":"2023-07-29T02:00:01.977989+0000","last_peered":"2023-07-29T02:00:01.977989+0000","last_clean":"2023-07-29T02:00:01.977989+0000","last_became_active":"2023-07-29T01:59:57.963774+0000","last_became_peered":"2023-07-29T01:59:57.963774+0000","last_unstale":"2023-07-29T02:00:01.977989+0000","last_undegraded":"2023-07-29T02:00:01.977989+0000","last_fullsized":"2023-07-29T02:00:01.977989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399488+0000","last_change":"2023-07-29T02:00:01.994114+0000","last_active":"2023-07-29T02:00:02.399488+0000","last_peered":"2023-07-29T02:00:02.399488+0000","last_clean":"2023-07-29T02:00:02.399488+0000","last_became_active":"2023-07-29T02:00:01.993731+0000","last_became_peered":"2023-07-29T02:00:01.993731+0000","last_unstale":"2023-07-29T02:00:02.399488+0000","last_undegraded":"2023-07-29T02:00:02.399488+0000","last_fullsized":"2023-07-29T02:00:02.399488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:14:25.422754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399152+0000","last_change":"2023-07-29T01:59:57.552913+0000","last_active":"2023-07-29T02:00:02.399152+0000","last_peered":"2023-07-29T02:00:02.399152+0000","last_clean":"2023-07-29T02:00:02.399152+0000","last_became_active":"2023-07-29T01:59:57.552673+0000","last_became_peered":"2023-07-29T01:59:57.552673+0000","last_unstale":"2023-07-29T02:00:02.399152+0000","last_undegraded":"2023-07-29T02:00:02.399152+0000","last_fullsized":"2023-07-29T02:00:02.399152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:49:56.335019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978862+0000","last_change":"2023-07-29T01:59:57.970140+0000","last_active":"2023-07-29T02:00:01.978862+0000","last_peered":"2023-07-29T02:00:01.978862+0000","last_clean":"2023-07-29T02:00:01.978862+0000","last_became_active":"2023-07-29T01:59:57.969821+0000","last_became_peered":"2023-07-29T01:59:57.969821+0000","last_unstale":"2023-07-29T02:00:01.978862+0000","last_undegraded":"2023-07-29T02:00:01.978862+0000","last_fullsized":"2023-07-29T02:00:01.978862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439205+0000","last_change":"2023-07-29T02:00:01.992728+0000","last_active":"2023-07-29T02:00:02.439205+0000","last_peered":"2023-07-29T02:00:02.439205+0000","last_clean":"2023-07-29T02:00:02.439205+0000","last_became_active":"2023-07-29T02:00:01.992338+0000","last_became_peered":"2023-07-29T02:00:01.992338+0000","last_unstale":"2023-07-29T02:00:02.439205+0000","last_undegraded":"2023-07-29T02:00:02.439205+0000","last_fullsized":"2023-07-29T02:00:02.439205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:37.968145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972242+0000","last_change":"2023-07-29T01:59:57.547793+0000","last_active":"2023-07-29T02:00:01.972242+0000","last_peered":"2023-07-29T02:00:01.972242+0000","last_clean":"2023-07-29T02:00:01.972242+0000","last_became_active":"2023-07-29T01:59:57.547455+0000","last_became_peered":"2023-07-29T01:59:57.547455+0000","last_unstale":"2023-07-29T02:00:01.972242+0000","last_undegraded":"2023-07-29T02:00:01.972242+0000","last_fullsized":"2023-07-29T02:00:01.972242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967048+0000","last_change":"2023-07-29T01:59:57.964646+0000","last_active":"2023-07-29T02:00:01.967048+0000","last_peered":"2023-07-29T02:00:01.967048+0000","last_clean":"2023-07-29T02:00:01.967048+0000","last_became_active":"2023-07-29T01:59:57.964393+0000","last_became_peered":"2023-07-29T01:59:57.964393+0000","last_unstale":"2023-07-29T02:00:01.967048+0000","last_undegraded":"2023-07-29T02:00:01.967048+0000","last_fullsized":"2023-07-29T02:00:01.967048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440161+0000","last_change":"2023-07-29T02:00:01.982883+0000","last_active":"2023-07-29T02:00:02.440161+0000","last_peered":"2023-07-29T02:00:02.440161+0000","last_clean":"2023-07-29T02:00:02.440161+0000","last_became_active":"2023-07-29T02:00:01.982042+0000","last_became_peered":"2023-07-29T02:00:01.982042+0000","last_unstale":"2023-07-29T02:00:02.440161+0000","last_undegraded":"2023-07-29T02:00:02.440161+0000","last_fullsized":"2023-07-29T02:00:02.440161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977952+0000","last_change":"2023-07-29T01:59:57.535286+0000","last_active":"2023-07-29T02:00:01.977952+0000","last_peered":"2023-07-29T02:00:01.977952+0000","last_clean":"2023-07-29T02:00:01.977952+0000","last_became_active":"2023-07-29T01:59:57.533523+0000","last_became_peered":"2023-07-29T01:59:57.533523+0000","last_unstale":"2023-07-29T02:00:01.977952+0000","last_undegraded":"2023-07-29T02:00:01.977952+0000","last_fullsized":"2023-07-29T02:00:01.977952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968772+0000","last_change":"2023-07-29T01:59:57.963792+0000","last_active":"2023-07-29T02:00:01.968772+0000","last_peered":"2023-07-29T02:00:01.968772+0000","last_clean":"2023-07-29T02:00:01.968772+0000","last_became_active":"2023-07-29T01:59:57.963466+0000","last_became_peered":"2023-07-29T01:59:57.963466+0000","last_unstale":"2023-07-29T02:00:01.968772+0000","last_undegraded":"2023-07-29T02:00:01.968772+0000","last_fullsized":"2023-07-29T02:00:01.968772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:28.048947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.438720+0000","last_change":"2023-07-29T02:00:01.984458+0000","last_active":"2023-07-29T02:00:02.438720+0000","last_peered":"2023-07-29T02:00:02.438720+0000","last_clean":"2023-07-29T02:00:02.438720+0000","last_became_active":"2023-07-29T02:00:01.984000+0000","last_became_peered":"2023-07-29T02:00:01.984000+0000","last_unstale":"2023-07-29T02:00:02.438720+0000","last_undegraded":"2023-07-29T02:00:02.438720+0000","last_fullsized":"2023-07-29T02:00:02.438720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967445+0000","last_change":"2023-07-29T01:59:57.537082+0000","last_active":"2023-07-29T02:00:01.967445+0000","last_peered":"2023-07-29T02:00:01.967445+0000","last_clean":"2023-07-29T02:00:01.967445+0000","last_became_active":"2023-07-29T01:59:57.536732+0000","last_became_peered":"2023-07-29T01:59:57.536732+0000","last_unstale":"2023-07-29T02:00:01.967445+0000","last_undegraded":"2023-07-29T02:00:01.967445+0000","last_fullsized":"2023-07-29T02:00:01.967445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977852+0000","last_change":"2023-07-29T01:59:57.971203+0000","last_active":"2023-07-29T02:00:01.977852+0000","last_peered":"2023-07-29T02:00:01.977852+0000","last_clean":"2023-07-29T02:00:01.977852+0000","last_became_active":"2023-07-29T01:59:57.970902+0000","last_became_peered":"2023-07-29T01:59:57.970902+0000","last_unstale":"2023-07-29T02:00:01.977852+0000","last_undegraded":"2023-07-29T02:00:01.977852+0000","last_fullsized":"2023-07-29T02:00:01.977852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399530+0000","last_change":"2023-07-29T02:00:01.991435+0000","last_active":"2023-07-29T02:00:02.399530+0000","last_peered":"2023-07-29T02:00:02.399530+0000","last_clean":"2023-07-29T02:00:02.399530+0000","last_became_active":"2023-07-29T02:00:01.989456+0000","last_became_peered":"2023-07-29T02:00:01.989456+0000","last_unstale":"2023-07-29T02:00:02.399530+0000","last_undegraded":"2023-07-29T02:00:02.399530+0000","last_fullsized":"2023-07-29T02:00:02.399530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975677+0000","last_change":"2023-07-29T01:59:57.540572+0000","last_active":"2023-07-29T02:00:01.975677+0000","last_peered":"2023-07-29T02:00:01.975677+0000","last_clean":"2023-07-29T02:00:01.975677+0000","last_became_active":"2023-07-29T01:59:57.540113+0000","last_became_peered":"2023-07-29T01:59:57.540113+0000","last_unstale":"2023-07-29T02:00:01.975677+0000","last_undegraded":"2023-07-29T02:00:01.975677+0000","last_fullsized":"2023-07-29T02:00:01.975677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979625+0000","last_change":"2023-07-29T01:59:57.967343+0000","last_active":"2023-07-29T02:00:01.979625+0000","last_peered":"2023-07-29T02:00:01.979625+0000","last_clean":"2023-07-29T02:00:01.979625+0000","last_became_active":"2023-07-29T01:59:57.967083+0000","last_became_peered":"2023-07-29T01:59:57.967083+0000","last_unstale":"2023-07-29T02:00:01.979625+0000","last_undegraded":"2023-07-29T02:00:01.979625+0000","last_fullsized":"2023-07-29T02:00:01.979625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441217+0000","last_change":"2023-07-29T02:00:01.996761+0000","last_active":"2023-07-29T02:00:02.441217+0000","last_peered":"2023-07-29T02:00:02.441217+0000","last_clean":"2023-07-29T02:00:02.441217+0000","last_became_active":"2023-07-29T02:00:01.996035+0000","last_became_peered":"2023-07-29T02:00:01.996035+0000","last_unstale":"2023-07-29T02:00:02.441217+0000","last_undegraded":"2023-07-29T02:00:02.441217+0000","last_fullsized":"2023-07-29T02:00:02.441217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"25'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958140+0000","last_change":"2023-07-29T01:59:57.548665+0000","last_active":"2023-07-29T02:00:02.958140+0000","last_peered":"2023-07-29T02:00:02.958140+0000","last_clean":"2023-07-29T02:00:02.958140+0000","last_became_active":"2023-07-29T01:59:57.547803+0000","last_became_peered":"2023-07-29T01:59:57.547803+0000","last_unstale":"2023-07-29T02:00:02.958140+0000","last_undegraded":"2023-07-29T02:00:02.958140+0000","last_fullsized":"2023-07-29T02:00:02.958140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971561+0000","last_change":"2023-07-29T01:59:57.969319+0000","last_active":"2023-07-29T02:00:01.971561+0000","last_peered":"2023-07-29T02:00:01.971561+0000","last_clean":"2023-07-29T02:00:01.971561+0000","last_became_active":"2023-07-29T01:59:57.969006+0000","last_became_peered":"2023-07-29T01:59:57.969006+0000","last_unstale":"2023-07-29T02:00:01.971561+0000","last_undegraded":"2023-07-29T02:00:01.971561+0000","last_fullsized":"2023-07-29T02:00:01.971561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:30:28.393515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440217+0000","last_change":"2023-07-29T02:00:01.996124+0000","last_active":"2023-07-29T02:00:02.440217+0000","last_peered":"2023-07-29T02:00:02.440217+0000","last_clean":"2023-07-29T02:00:02.440217+0000","last_became_active":"2023-07-29T02:00:01.995757+0000","last_became_peered":"2023-07-29T02:00:01.995757+0000","last_unstale":"2023-07-29T02:00:02.440217+0000","last_undegraded":"2023-07-29T02:00:02.440217+0000","last_fullsized":"2023-07-29T02:00:02.440217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:24:03.881006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:11.051405+0000","last_change":"2023-07-29T01:59:57.541936+0000","last_active":"2023-07-29T02:00:11.051405+0000","last_peered":"2023-07-29T02:00:11.051405+0000","last_clean":"2023-07-29T02:00:11.051405+0000","last_became_active":"2023-07-29T01:59:57.541434+0000","last_became_peered":"2023-07-29T01:59:57.541434+0000","last_unstale":"2023-07-29T02:00:11.051405+0000","last_undegraded":"2023-07-29T02:00:11.051405+0000","last_fullsized":"2023-07-29T02:00:11.051405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3791,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976628+0000","last_change":"2023-07-29T01:59:57.962725+0000","last_active":"2023-07-29T02:00:01.976628+0000","last_peered":"2023-07-29T02:00:01.976628+0000","last_clean":"2023-07-29T02:00:01.976628+0000","last_became_active":"2023-07-29T01:59:57.962459+0000","last_became_peered":"2023-07-29T01:59:57.962459+0000","last_unstale":"2023-07-29T02:00:01.976628+0000","last_undegraded":"2023-07-29T02:00:01.976628+0000","last_fullsized":"2023-07-29T02:00:01.976628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401186+0000","last_change":"2023-07-29T02:00:01.996160+0000","last_active":"2023-07-29T02:00:02.401186+0000","last_peered":"2023-07-29T02:00:02.401186+0000","last_clean":"2023-07-29T02:00:02.401186+0000","last_became_active":"2023-07-29T02:00:01.995827+0000","last_became_peered":"2023-07-29T02:00:01.995827+0000","last_unstale":"2023-07-29T02:00:02.401186+0000","last_undegraded":"2023-07-29T02:00:02.401186+0000","last_fullsized":"2023-07-29T02:00:02.401186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958252+0000","last_change":"2023-07-29T01:59:57.545705+0000","last_active":"2023-07-29T02:00:02.958252+0000","last_peered":"2023-07-29T02:00:02.958252+0000","last_clean":"2023-07-29T02:00:02.958252+0000","last_became_active":"2023-07-29T01:59:57.545406+0000","last_became_peered":"2023-07-29T01:59:57.545406+0000","last_unstale":"2023-07-29T02:00:02.958252+0000","last_undegraded":"2023-07-29T02:00:02.958252+0000","last_fullsized":"2023-07-29T02:00:02.958252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:31.903601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.980027+0000","last_change":"2023-07-29T01:59:57.970072+0000","last_active":"2023-07-29T02:00:01.980027+0000","last_peered":"2023-07-29T02:00:01.980027+0000","last_clean":"2023-07-29T02:00:01.980027+0000","last_became_active":"2023-07-29T01:59:57.969809+0000","last_became_peered":"2023-07-29T01:59:57.969809+0000","last_unstale":"2023-07-29T02:00:01.980027+0000","last_undegraded":"2023-07-29T02:00:01.980027+0000","last_fullsized":"2023-07-29T02:00:01.980027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440272+0000","last_change":"2023-07-29T02:00:01.997402+0000","last_active":"2023-07-29T02:00:02.440272+0000","last_peered":"2023-07-29T02:00:02.440272+0000","last_clean":"2023-07-29T02:00:02.440272+0000","last_became_active":"2023-07-29T02:00:01.996969+0000","last_became_peered":"2023-07-29T02:00:01.996969+0000","last_unstale":"2023-07-29T02:00:02.440272+0000","last_undegraded":"2023-07-29T02:00:02.440272+0000","last_fullsized":"2023-07-29T02:00:02.440272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:46:37.088979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966653+0000","last_change":"2023-07-29T01:59:57.541115+0000","last_active":"2023-07-29T02:00:01.966653+0000","last_peered":"2023-07-29T02:00:01.966653+0000","last_clean":"2023-07-29T02:00:01.966653+0000","last_became_active":"2023-07-29T01:59:57.540800+0000","last_became_peered":"2023-07-29T01:59:57.540800+0000","last_unstale":"2023-07-29T02:00:01.966653+0000","last_undegraded":"2023-07-29T02:00:01.966653+0000","last_fullsized":"2023-07-29T02:00:01.966653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977902+0000","last_change":"2023-07-29T01:59:57.964198+0000","last_active":"2023-07-29T02:00:01.977902+0000","last_peered":"2023-07-29T02:00:01.977902+0000","last_clean":"2023-07-29T02:00:01.977902+0000","last_became_active":"2023-07-29T01:59:57.963510+0000","last_became_peered":"2023-07-29T01:59:57.963510+0000","last_unstale":"2023-07-29T02:00:01.977902+0000","last_undegraded":"2023-07-29T02:00:01.977902+0000","last_fullsized":"2023-07-29T02:00:01.977902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441378+0000","last_change":"2023-07-29T02:00:01.996496+0000","last_active":"2023-07-29T02:00:02.441378+0000","last_peered":"2023-07-29T02:00:02.441378+0000","last_clean":"2023-07-29T02:00:02.441378+0000","last_became_active":"2023-07-29T02:00:01.996084+0000","last_became_peered":"2023-07-29T02:00:01.996084+0000","last_unstale":"2023-07-29T02:00:02.441378+0000","last_undegraded":"2023-07-29T02:00:02.441378+0000","last_fullsized":"2023-07-29T02:00:02.441378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:59:57.581952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974316+0000","last_change":"2023-07-29T01:59:57.548464+0000","last_active":"2023-07-29T02:00:01.974316+0000","last_peered":"2023-07-29T02:00:01.974316+0000","last_clean":"2023-07-29T02:00:01.974316+0000","last_became_active":"2023-07-29T01:59:57.548109+0000","last_became_peered":"2023-07-29T01:59:57.548109+0000","last_unstale":"2023-07-29T02:00:01.974316+0000","last_undegraded":"2023-07-29T02:00:01.974316+0000","last_fullsized":"2023-07-29T02:00:01.974316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:13.433053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967896+0000","last_change":"2023-07-29T01:59:57.962096+0000","last_active":"2023-07-29T02:00:01.967896+0000","last_peered":"2023-07-29T02:00:01.967896+0000","last_clean":"2023-07-29T02:00:01.967896+0000","last_became_active":"2023-07-29T01:59:57.961759+0000","last_became_peered":"2023-07-29T01:59:57.961759+0000","last_unstale":"2023-07-29T02:00:01.967896+0000","last_undegraded":"2023-07-29T02:00:01.967896+0000","last_fullsized":"2023-07-29T02:00:01.967896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400737+0000","last_change":"2023-07-29T02:00:01.993066+0000","last_active":"2023-07-29T02:00:02.400737+0000","last_peered":"2023-07-29T02:00:02.400737+0000","last_clean":"2023-07-29T02:00:02.400737+0000","last_became_active":"2023-07-29T02:00:01.992592+0000","last_became_peered":"2023-07-29T02:00:01.992592+0000","last_unstale":"2023-07-29T02:00:02.400737+0000","last_undegraded":"2023-07-29T02:00:02.400737+0000","last_fullsized":"2023-07-29T02:00:02.400737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:14:06.353802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958759+0000","last_change":"2023-07-29T01:59:57.543707+0000","last_active":"2023-07-29T02:00:02.958759+0000","last_peered":"2023-07-29T02:00:02.958759+0000","last_clean":"2023-07-29T02:00:02.958759+0000","last_became_active":"2023-07-29T01:59:57.543398+0000","last_became_peered":"2023-07-29T01:59:57.543398+0000","last_unstale":"2023-07-29T02:00:02.958759+0000","last_undegraded":"2023-07-29T02:00:02.958759+0000","last_fullsized":"2023-07-29T02:00:02.958759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977853+0000","last_change":"2023-07-29T01:59:57.966269+0000","last_active":"2023-07-29T02:00:01.977853+0000","last_peered":"2023-07-29T02:00:01.977853+0000","last_clean":"2023-07-29T02:00:01.977853+0000","last_became_active":"2023-07-29T01:59:57.965962+0000","last_became_peered":"2023-07-29T01:59:57.965962+0000","last_unstale":"2023-07-29T02:00:01.977853+0000","last_undegraded":"2023-07-29T02:00:01.977853+0000","last_fullsized":"2023-07-29T02:00:01.977853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400336+0000","last_change":"2023-07-29T02:00:01.992987+0000","last_active":"2023-07-29T02:00:02.400336+0000","last_peered":"2023-07-29T02:00:02.400336+0000","last_clean":"2023-07-29T02:00:02.400336+0000","last_became_active":"2023-07-29T02:00:01.992384+0000","last_became_peered":"2023-07-29T02:00:01.992384+0000","last_unstale":"2023-07-29T02:00:02.400336+0000","last_undegraded":"2023-07-29T02:00:02.400336+0000","last_fullsized":"2023-07-29T02:00:02.400336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400080+0000","last_change":"2023-07-29T01:59:57.548392+0000","last_active":"2023-07-29T02:00:02.400080+0000","last_peered":"2023-07-29T02:00:02.400080+0000","last_clean":"2023-07-29T02:00:02.400080+0000","last_became_active":"2023-07-29T01:59:57.548084+0000","last_became_peered":"2023-07-29T01:59:57.548084+0000","last_unstale":"2023-07-29T02:00:02.400080+0000","last_undegraded":"2023-07-29T02:00:02.400080+0000","last_fullsized":"2023-07-29T02:00:02.400080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973873+0000","last_change":"2023-07-29T01:59:57.965613+0000","last_active":"2023-07-29T02:00:01.973873+0000","last_peered":"2023-07-29T02:00:01.973873+0000","last_clean":"2023-07-29T02:00:01.973873+0000","last_became_active":"2023-07-29T01:59:57.964626+0000","last_became_peered":"2023-07-29T01:59:57.964626+0000","last_unstale":"2023-07-29T02:00:01.973873+0000","last_undegraded":"2023-07-29T02:00:01.973873+0000","last_fullsized":"2023-07-29T02:00:01.973873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442405+0000","last_change":"2023-07-29T02:00:01.990978+0000","last_active":"2023-07-29T02:00:02.442405+0000","last_peered":"2023-07-29T02:00:02.442405+0000","last_clean":"2023-07-29T02:00:02.442405+0000","last_became_active":"2023-07-29T02:00:01.990579+0000","last_became_peered":"2023-07-29T02:00:01.990579+0000","last_unstale":"2023-07-29T02:00:02.442405+0000","last_undegraded":"2023-07-29T02:00:02.442405+0000","last_fullsized":"2023-07-29T02:00:02.442405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:11:53.398210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957642+0000","last_change":"2023-07-29T01:59:57.549270+0000","last_active":"2023-07-29T02:00:02.957642+0000","last_peered":"2023-07-29T02:00:02.957642+0000","last_clean":"2023-07-29T02:00:02.957642+0000","last_became_active":"2023-07-29T01:59:57.548981+0000","last_became_peered":"2023-07-29T01:59:57.548981+0000","last_unstale":"2023-07-29T02:00:02.957642+0000","last_undegraded":"2023-07-29T02:00:02.957642+0000","last_fullsized":"2023-07-29T02:00:02.957642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:05.783369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972647+0000","last_change":"2023-07-29T01:59:57.969851+0000","last_active":"2023-07-29T02:00:01.972647+0000","last_peered":"2023-07-29T02:00:01.972647+0000","last_clean":"2023-07-29T02:00:01.972647+0000","last_became_active":"2023-07-29T01:59:57.969501+0000","last_became_peered":"2023-07-29T01:59:57.969501+0000","last_unstale":"2023-07-29T02:00:01.972647+0000","last_undegraded":"2023-07-29T02:00:01.972647+0000","last_fullsized":"2023-07-29T02:00:01.972647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442608+0000","last_change":"2023-07-29T02:00:01.989766+0000","last_active":"2023-07-29T02:00:02.442608+0000","last_peered":"2023-07-29T02:00:02.442608+0000","last_clean":"2023-07-29T02:00:02.442608+0000","last_became_active":"2023-07-29T02:00:01.989364+0000","last_became_peered":"2023-07-29T02:00:01.989364+0000","last_unstale":"2023-07-29T02:00:02.442608+0000","last_undegraded":"2023-07-29T02:00:02.442608+0000","last_fullsized":"2023-07-29T02:00:02.442608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:01:14.849757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400580+0000","last_change":"2023-07-29T01:59:57.541329+0000","last_active":"2023-07-29T02:00:02.400580+0000","last_peered":"2023-07-29T02:00:02.400580+0000","last_clean":"2023-07-29T02:00:02.400580+0000","last_became_active":"2023-07-29T01:59:57.541056+0000","last_became_peered":"2023-07-29T01:59:57.541056+0000","last_unstale":"2023-07-29T02:00:02.400580+0000","last_undegraded":"2023-07-29T02:00:02.400580+0000","last_fullsized":"2023-07-29T02:00:02.400580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968261+0000","last_change":"2023-07-29T01:59:57.975244+0000","last_active":"2023-07-29T02:00:01.968261+0000","last_peered":"2023-07-29T02:00:01.968261+0000","last_clean":"2023-07-29T02:00:01.968261+0000","last_became_active":"2023-07-29T01:59:57.974998+0000","last_became_peered":"2023-07-29T01:59:57.974998+0000","last_unstale":"2023-07-29T02:00:01.968261+0000","last_undegraded":"2023-07-29T02:00:01.968261+0000","last_fullsized":"2023-07-29T02:00:01.968261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:14.435169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442656+0000","last_change":"2023-07-29T02:00:01.990823+0000","last_active":"2023-07-29T02:00:02.442656+0000","last_peered":"2023-07-29T02:00:02.442656+0000","last_clean":"2023-07-29T02:00:02.442656+0000","last_became_active":"2023-07-29T02:00:01.990276+0000","last_became_peered":"2023-07-29T02:00:01.990276+0000","last_unstale":"2023-07-29T02:00:02.442656+0000","last_undegraded":"2023-07-29T02:00:02.442656+0000","last_fullsized":"2023-07-29T02:00:02.442656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974632+0000","last_change":"2023-07-29T01:59:57.544524+0000","last_active":"2023-07-29T02:00:01.974632+0000","last_peered":"2023-07-29T02:00:01.974632+0000","last_clean":"2023-07-29T02:00:01.974632+0000","last_became_active":"2023-07-29T01:59:57.544231+0000","last_became_peered":"2023-07-29T01:59:57.544231+0000","last_unstale":"2023-07-29T02:00:01.974632+0000","last_undegraded":"2023-07-29T02:00:01.974632+0000","last_fullsized":"2023-07-29T02:00:01.974632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966682+0000","last_change":"2023-07-29T01:59:57.974773+0000","last_active":"2023-07-29T02:00:01.966682+0000","last_peered":"2023-07-29T02:00:01.966682+0000","last_clean":"2023-07-29T02:00:01.966682+0000","last_became_active":"2023-07-29T01:59:57.974525+0000","last_became_peered":"2023-07-29T01:59:57.974525+0000","last_unstale":"2023-07-29T02:00:01.966682+0000","last_undegraded":"2023-07-29T02:00:01.966682+0000","last_fullsized":"2023-07-29T02:00:01.966682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442650+0000","last_change":"2023-07-29T02:00:01.988872+0000","last_active":"2023-07-29T02:00:02.442650+0000","last_peered":"2023-07-29T02:00:02.442650+0000","last_clean":"2023-07-29T02:00:02.442650+0000","last_became_active":"2023-07-29T02:00:01.988486+0000","last_became_peered":"2023-07-29T02:00:01.988486+0000","last_unstale":"2023-07-29T02:00:02.442650+0000","last_undegraded":"2023-07-29T02:00:02.442650+0000","last_fullsized":"2023-07-29T02:00:02.442650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:07.842328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.954789+0000","last_change":"2023-07-29T01:59:57.535498+0000","last_active":"2023-07-29T02:00:02.954789+0000","last_peered":"2023-07-29T02:00:02.954789+0000","last_clean":"2023-07-29T02:00:02.954789+0000","last_became_active":"2023-07-29T01:59:57.534813+0000","last_became_peered":"2023-07-29T01:59:57.534813+0000","last_unstale":"2023-07-29T02:00:02.954789+0000","last_undegraded":"2023-07-29T02:00:02.954789+0000","last_fullsized":"2023-07-29T02:00:02.954789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976870+0000","last_change":"2023-07-29T01:59:57.962897+0000","last_active":"2023-07-29T02:00:01.976870+0000","last_peered":"2023-07-29T02:00:01.976870+0000","last_clean":"2023-07-29T02:00:01.976870+0000","last_became_active":"2023-07-29T01:59:57.962184+0000","last_became_peered":"2023-07-29T01:59:57.962184+0000","last_unstale":"2023-07-29T02:00:01.976870+0000","last_undegraded":"2023-07-29T02:00:01.976870+0000","last_fullsized":"2023-07-29T02:00:01.976870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440114+0000","last_change":"2023-07-29T02:00:01.989538+0000","last_active":"2023-07-29T02:00:02.440114+0000","last_peered":"2023-07-29T02:00:02.440114+0000","last_clean":"2023-07-29T02:00:02.440114+0000","last_became_active":"2023-07-29T02:00:01.989151+0000","last_became_peered":"2023-07-29T02:00:01.989151+0000","last_unstale":"2023-07-29T02:00:02.440114+0000","last_undegraded":"2023-07-29T02:00:02.440114+0000","last_fullsized":"2023-07-29T02:00:02.440114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:21:35.031304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968357+0000","last_change":"2023-07-29T01:59:57.544466+0000","last_active":"2023-07-29T02:00:01.968357+0000","last_peered":"2023-07-29T02:00:01.968357+0000","last_clean":"2023-07-29T02:00:01.968357+0000","last_became_active":"2023-07-29T01:59:57.544120+0000","last_became_peered":"2023-07-29T01:59:57.544120+0000","last_unstale":"2023-07-29T02:00:01.968357+0000","last_undegraded":"2023-07-29T02:00:01.968357+0000","last_fullsized":"2023-07-29T02:00:01.968357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977082+0000","last_change":"2023-07-29T01:59:57.962277+0000","last_active":"2023-07-29T02:00:01.977082+0000","last_peered":"2023-07-29T02:00:01.977082+0000","last_clean":"2023-07-29T02:00:01.977082+0000","last_became_active":"2023-07-29T01:59:57.961975+0000","last_became_peered":"2023-07-29T01:59:57.961975+0000","last_unstale":"2023-07-29T02:00:01.977082+0000","last_undegraded":"2023-07-29T02:00:01.977082+0000","last_fullsized":"2023-07-29T02:00:01.977082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:27:01.059953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400809+0000","last_change":"2023-07-29T02:00:01.988563+0000","last_active":"2023-07-29T02:00:02.400809+0000","last_peered":"2023-07-29T02:00:02.400809+0000","last_clean":"2023-07-29T02:00:02.400809+0000","last_became_active":"2023-07-29T02:00:01.988155+0000","last_became_peered":"2023-07-29T02:00:01.988155+0000","last_unstale":"2023-07-29T02:00:02.400809+0000","last_undegraded":"2023-07-29T02:00:02.400809+0000","last_fullsized":"2023-07-29T02:00:02.400809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972477+0000","last_change":"2023-07-29T01:59:57.549764+0000","last_active":"2023-07-29T02:00:01.972477+0000","last_peered":"2023-07-29T02:00:01.972477+0000","last_clean":"2023-07-29T02:00:01.972477+0000","last_became_active":"2023-07-29T01:59:57.549470+0000","last_became_peered":"2023-07-29T01:59:57.549470+0000","last_unstale":"2023-07-29T02:00:01.972477+0000","last_undegraded":"2023-07-29T02:00:01.972477+0000","last_fullsized":"2023-07-29T02:00:01.972477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976948+0000","last_change":"2023-07-29T01:59:57.962303+0000","last_active":"2023-07-29T02:00:01.976948+0000","last_peered":"2023-07-29T02:00:01.976948+0000","last_clean":"2023-07-29T02:00:01.976948+0000","last_became_active":"2023-07-29T01:59:57.962016+0000","last_became_peered":"2023-07-29T01:59:57.962016+0000","last_unstale":"2023-07-29T02:00:01.976948+0000","last_undegraded":"2023-07-29T02:00:01.976948+0000","last_fullsized":"2023-07-29T02:00:01.976948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:08.813083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399334+0000","last_change":"2023-07-29T02:00:01.992380+0000","last_active":"2023-07-29T02:00:02.399334+0000","last_peered":"2023-07-29T02:00:02.399334+0000","last_clean":"2023-07-29T02:00:02.399334+0000","last_became_active":"2023-07-29T02:00:01.992042+0000","last_became_peered":"2023-07-29T02:00:01.992042+0000","last_unstale":"2023-07-29T02:00:02.399334+0000","last_undegraded":"2023-07-29T02:00:02.399334+0000","last_fullsized":"2023-07-29T02:00:02.399334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:24:44.331640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977747+0000","last_change":"2023-07-29T01:59:57.537045+0000","last_active":"2023-07-29T02:00:01.977747+0000","last_peered":"2023-07-29T02:00:01.977747+0000","last_clean":"2023-07-29T02:00:01.977747+0000","last_became_active":"2023-07-29T01:59:57.535762+0000","last_became_peered":"2023-07-29T01:59:57.535762+0000","last_unstale":"2023-07-29T02:00:01.977747+0000","last_undegraded":"2023-07-29T02:00:01.977747+0000","last_fullsized":"2023-07-29T02:00:01.977747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972302+0000","last_change":"2023-07-29T01:59:57.975103+0000","last_active":"2023-07-29T02:00:01.972302+0000","last_peered":"2023-07-29T02:00:01.972302+0000","last_clean":"2023-07-29T02:00:01.972302+0000","last_became_active":"2023-07-29T01:59:57.974834+0000","last_became_peered":"2023-07-29T01:59:57.974834+0000","last_unstale":"2023-07-29T02:00:01.972302+0000","last_undegraded":"2023-07-29T02:00:01.972302+0000","last_fullsized":"2023-07-29T02:00:01.972302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401174+0000","last_change":"2023-07-29T02:00:01.990813+0000","last_active":"2023-07-29T02:00:02.401174+0000","last_peered":"2023-07-29T02:00:02.401174+0000","last_clean":"2023-07-29T02:00:02.401174+0000","last_became_active":"2023-07-29T02:00:01.990464+0000","last_became_peered":"2023-07-29T02:00:01.990464+0000","last_unstale":"2023-07-29T02:00:02.401174+0000","last_undegraded":"2023-07-29T02:00:02.401174+0000","last_fullsized":"2023-07-29T02:00:02.401174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:16:46.676860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958405+0000","last_change":"2023-07-29T01:59:57.540561+0000","last_active":"2023-07-29T02:00:02.958405+0000","last_peered":"2023-07-29T02:00:02.958405+0000","last_clean":"2023-07-29T02:00:02.958405+0000","last_became_active":"2023-07-29T01:59:57.540292+0000","last_became_peered":"2023-07-29T01:59:57.540292+0000","last_unstale":"2023-07-29T02:00:02.958405+0000","last_undegraded":"2023-07-29T02:00:02.958405+0000","last_fullsized":"2023-07-29T02:00:02.958405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978068+0000","last_change":"2023-07-29T01:59:52.448098+0000","last_active":"2023-07-29T02:00:01.978068+0000","last_peered":"2023-07-29T02:00:01.978068+0000","last_clean":"2023-07-29T02:00:01.978068+0000","last_became_active":"2023-07-29T01:59:52.447782+0000","last_became_peered":"2023-07-29T01:59:52.447782+0000","last_unstale":"2023-07-29T02:00:01.978068+0000","last_undegraded":"2023-07-29T02:00:01.978068+0000","last_fullsized":"2023-07-29T02:00:01.978068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:31.981804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977648+0000","last_change":"2023-07-29T01:59:57.967845+0000","last_active":"2023-07-29T02:00:01.977648+0000","last_peered":"2023-07-29T02:00:01.977648+0000","last_clean":"2023-07-29T02:00:01.977648+0000","last_became_active":"2023-07-29T01:59:57.966065+0000","last_became_peered":"2023-07-29T01:59:57.966065+0000","last_unstale":"2023-07-29T02:00:01.977648+0000","last_undegraded":"2023-07-29T02:00:01.977648+0000","last_fullsized":"2023-07-29T02:00:01.977648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439054+0000","last_change":"2023-07-29T02:00:01.996414+0000","last_active":"2023-07-29T02:00:02.439054+0000","last_peered":"2023-07-29T02:00:02.439054+0000","last_clean":"2023-07-29T02:00:02.439054+0000","last_became_active":"2023-07-29T02:00:01.995963+0000","last_became_peered":"2023-07-29T02:00:01.995963+0000","last_unstale":"2023-07-29T02:00:02.439054+0000","last_undegraded":"2023-07-29T02:00:02.439054+0000","last_fullsized":"2023-07-29T02:00:02.439054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:06:19.130853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.980059+0000","last_change":"2023-07-29T01:59:52.445649+0000","last_active":"2023-07-29T02:00:01.980059+0000","last_peered":"2023-07-29T02:00:01.980059+0000","last_clean":"2023-07-29T02:00:01.980059+0000","last_became_active":"2023-07-29T01:59:52.445337+0000","last_became_peered":"2023-07-29T01:59:52.445337+0000","last_unstale":"2023-07-29T02:00:01.980059+0000","last_undegraded":"2023-07-29T02:00:01.980059+0000","last_fullsized":"2023-07-29T02:00:01.980059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439989+0000","last_change":"2023-07-29T01:59:57.537863+0000","last_active":"2023-07-29T02:00:02.439989+0000","last_peered":"2023-07-29T02:00:02.439989+0000","last_clean":"2023-07-29T02:00:02.439989+0000","last_became_active":"2023-07-29T01:59:57.537581+0000","last_became_peered":"2023-07-29T01:59:57.537581+0000","last_unstale":"2023-07-29T02:00:02.439989+0000","last_undegraded":"2023-07-29T02:00:02.439989+0000","last_fullsized":"2023-07-29T02:00:02.439989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:02:57.137574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972545+0000","last_change":"2023-07-29T01:59:57.961598+0000","last_active":"2023-07-29T02:00:01.972545+0000","last_peered":"2023-07-29T02:00:01.972545+0000","last_clean":"2023-07-29T02:00:01.972545+0000","last_became_active":"2023-07-29T01:59:57.961298+0000","last_became_peered":"2023-07-29T01:59:57.961298+0000","last_unstale":"2023-07-29T02:00:01.972545+0000","last_undegraded":"2023-07-29T02:00:01.972545+0000","last_fullsized":"2023-07-29T02:00:01.972545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:11:49.956637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400459+0000","last_change":"2023-07-29T02:00:01.987452+0000","last_active":"2023-07-29T02:00:02.400459+0000","last_peered":"2023-07-29T02:00:02.400459+0000","last_clean":"2023-07-29T02:00:02.400459+0000","last_became_active":"2023-07-29T02:00:01.986915+0000","last_became_peered":"2023-07-29T02:00:01.986915+0000","last_unstale":"2023-07-29T02:00:02.400459+0000","last_undegraded":"2023-07-29T02:00:02.400459+0000","last_fullsized":"2023-07-29T02:00:02.400459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:35:48.256508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973327+0000","last_change":"2023-07-29T01:59:52.448423+0000","last_active":"2023-07-29T02:00:01.973327+0000","last_peered":"2023-07-29T02:00:01.973327+0000","last_clean":"2023-07-29T02:00:01.973327+0000","last_became_active":"2023-07-29T01:59:52.448052+0000","last_became_peered":"2023-07-29T01:59:52.448052+0000","last_unstale":"2023-07-29T02:00:01.973327+0000","last_undegraded":"2023-07-29T02:00:01.973327+0000","last_fullsized":"2023-07-29T02:00:01.973327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:31.981804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973579+0000","last_change":"2023-07-29T01:59:52.450730+0000","last_active":"2023-07-29T02:00:01.973579+0000","last_peered":"2023-07-29T02:00:01.973579+0000","last_clean":"2023-07-29T02:00:01.973579+0000","last_became_active":"2023-07-29T01:59:52.449582+0000","last_became_peered":"2023-07-29T01:59:52.449582+0000","last_unstale":"2023-07-29T02:00:01.973579+0000","last_undegraded":"2023-07-29T02:00:01.973579+0000","last_fullsized":"2023-07-29T02:00:01.973579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:01:27.099648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966496+0000","last_change":"2023-07-29T01:59:57.546474+0000","last_active":"2023-07-29T02:00:01.966496+0000","last_peered":"2023-07-29T02:00:01.966496+0000","last_clean":"2023-07-29T02:00:01.966496+0000","last_became_active":"2023-07-29T01:59:57.546179+0000","last_became_peered":"2023-07-29T01:59:57.546179+0000","last_unstale":"2023-07-29T02:00:01.966496+0000","last_undegraded":"2023-07-29T02:00:01.966496+0000","last_fullsized":"2023-07-29T02:00:01.966496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967788+0000","last_change":"2023-07-29T01:59:57.975316+0000","last_active":"2023-07-29T02:00:01.967788+0000","last_peered":"2023-07-29T02:00:01.967788+0000","last_clean":"2023-07-29T02:00:01.967788+0000","last_became_active":"2023-07-29T01:59:57.975078+0000","last_became_peered":"2023-07-29T01:59:57.975078+0000","last_unstale":"2023-07-29T02:00:01.967788+0000","last_undegraded":"2023-07-29T02:00:01.967788+0000","last_fullsized":"2023-07-29T02:00:01.967788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442819+0000","last_change":"2023-07-29T02:00:01.987385+0000","last_active":"2023-07-29T02:00:02.442819+0000","last_peered":"2023-07-29T02:00:02.442819+0000","last_clean":"2023-07-29T02:00:02.442819+0000","last_became_active":"2023-07-29T02:00:01.986937+0000","last_became_peered":"2023-07-29T02:00:01.986937+0000","last_unstale":"2023-07-29T02:00:02.442819+0000","last_undegraded":"2023-07-29T02:00:02.442819+0000","last_fullsized":"2023-07-29T02:00:02.442819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:53.580244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974915+0000","last_change":"2023-07-29T01:59:53.171806+0000","last_active":"2023-07-29T02:00:01.974915+0000","last_peered":"2023-07-29T02:00:01.974915+0000","last_clean":"2023-07-29T02:00:01.974915+0000","last_became_active":"2023-07-29T01:59:53.171467+0000","last_became_peered":"2023-07-29T01:59:53.171467+0000","last_unstale":"2023-07-29T02:00:01.974915+0000","last_undegraded":"2023-07-29T02:00:01.974915+0000","last_fullsized":"2023-07-29T02:00:01.974915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972796+0000","last_change":"2023-07-29T01:59:57.549442+0000","last_active":"2023-07-29T02:00:01.972796+0000","last_peered":"2023-07-29T02:00:01.972796+0000","last_clean":"2023-07-29T02:00:01.972796+0000","last_became_active":"2023-07-29T01:59:57.549151+0000","last_became_peered":"2023-07-29T01:59:57.549151+0000","last_unstale":"2023-07-29T02:00:01.972796+0000","last_undegraded":"2023-07-29T02:00:01.972796+0000","last_fullsized":"2023-07-29T02:00:01.972796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972211+0000","last_change":"2023-07-29T01:59:57.973471+0000","last_active":"2023-07-29T02:00:01.972211+0000","last_peered":"2023-07-29T02:00:01.972211+0000","last_clean":"2023-07-29T02:00:01.972211+0000","last_became_active":"2023-07-29T01:59:57.969273+0000","last_became_peered":"2023-07-29T01:59:57.969273+0000","last_unstale":"2023-07-29T02:00:01.972211+0000","last_undegraded":"2023-07-29T02:00:01.972211+0000","last_fullsized":"2023-07-29T02:00:01.972211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:56:07.949649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400121+0000","last_change":"2023-07-29T02:00:01.993242+0000","last_active":"2023-07-29T02:00:02.400121+0000","last_peered":"2023-07-29T02:00:02.400121+0000","last_clean":"2023-07-29T02:00:02.400121+0000","last_became_active":"2023-07-29T02:00:01.992406+0000","last_became_peered":"2023-07-29T02:00:01.992406+0000","last_unstale":"2023-07-29T02:00:02.400121+0000","last_undegraded":"2023-07-29T02:00:02.400121+0000","last_fullsized":"2023-07-29T02:00:02.400121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:12.254656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973406+0000","last_change":"2023-07-29T01:59:53.171746+0000","last_active":"2023-07-29T02:00:01.973406+0000","last_peered":"2023-07-29T02:00:01.973406+0000","last_clean":"2023-07-29T02:00:01.973406+0000","last_became_active":"2023-07-29T01:59:53.171440+0000","last_became_peered":"2023-07-29T01:59:53.171440+0000","last_unstale":"2023-07-29T02:00:01.973406+0000","last_undegraded":"2023-07-29T02:00:01.973406+0000","last_fullsized":"2023-07-29T02:00:01.973406+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:17:56.960611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976818+0000","last_change":"2023-07-29T01:59:57.537970+0000","last_active":"2023-07-29T02:00:01.976818+0000","last_peered":"2023-07-29T02:00:01.976818+0000","last_clean":"2023-07-29T02:00:01.976818+0000","last_became_active":"2023-07-29T01:59:57.537665+0000","last_became_peered":"2023-07-29T01:59:57.537665+0000","last_unstale":"2023-07-29T02:00:01.976818+0000","last_undegraded":"2023-07-29T02:00:01.976818+0000","last_fullsized":"2023-07-29T02:00:01.976818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968235+0000","last_change":"2023-07-29T01:59:57.968655+0000","last_active":"2023-07-29T02:00:01.968235+0000","last_peered":"2023-07-29T02:00:01.968235+0000","last_clean":"2023-07-29T02:00:01.968235+0000","last_became_active":"2023-07-29T01:59:57.968373+0000","last_became_peered":"2023-07-29T01:59:57.968373+0000","last_unstale":"2023-07-29T02:00:01.968235+0000","last_undegraded":"2023-07-29T02:00:01.968235+0000","last_fullsized":"2023-07-29T02:00:01.968235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:06.785485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439797+0000","last_change":"2023-07-29T02:00:01.984885+0000","last_active":"2023-07-29T02:00:02.439797+0000","last_peered":"2023-07-29T02:00:02.439797+0000","last_clean":"2023-07-29T02:00:02.439797+0000","last_became_active":"2023-07-29T02:00:01.984476+0000","last_became_peered":"2023-07-29T02:00:01.984476+0000","last_unstale":"2023-07-29T02:00:02.439797+0000","last_undegraded":"2023-07-29T02:00:02.439797+0000","last_fullsized":"2023-07-29T02:00:02.439797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973534+0000","last_change":"2023-07-29T01:59:53.172039+0000","last_active":"2023-07-29T02:00:01.973534+0000","last_peered":"2023-07-29T02:00:01.973534+0000","last_clean":"2023-07-29T02:00:01.973534+0000","last_became_active":"2023-07-29T01:59:53.171617+0000","last_became_peered":"2023-07-29T01:59:53.171617+0000","last_unstale":"2023-07-29T02:00:01.973534+0000","last_undegraded":"2023-07-29T02:00:01.973534+0000","last_fullsized":"2023-07-29T02:00:01.973534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976735+0000","last_change":"2023-07-29T01:59:57.540888+0000","last_active":"2023-07-29T02:00:01.976735+0000","last_peered":"2023-07-29T02:00:01.976735+0000","last_clean":"2023-07-29T02:00:01.976735+0000","last_became_active":"2023-07-29T01:59:57.540449+0000","last_became_peered":"2023-07-29T01:59:57.540449+0000","last_unstale":"2023-07-29T02:00:01.976735+0000","last_undegraded":"2023-07-29T02:00:01.976735+0000","last_fullsized":"2023-07-29T02:00:01.976735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974278+0000","last_change":"2023-07-29T01:59:57.968216+0000","last_active":"2023-07-29T02:00:01.974278+0000","last_peered":"2023-07-29T02:00:01.974278+0000","last_clean":"2023-07-29T02:00:01.974278+0000","last_became_active":"2023-07-29T01:59:57.967933+0000","last_became_peered":"2023-07-29T01:59:57.967933+0000","last_unstale":"2023-07-29T02:00:01.974278+0000","last_undegraded":"2023-07-29T02:00:01.974278+0000","last_fullsized":"2023-07-29T02:00:01.974278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439338+0000","last_change":"2023-07-29T02:00:01.985121+0000","last_active":"2023-07-29T02:00:02.439338+0000","last_peered":"2023-07-29T02:00:02.439338+0000","last_clean":"2023-07-29T02:00:02.439338+0000","last_became_active":"2023-07-29T02:00:01.984691+0000","last_became_peered":"2023-07-29T02:00:01.984691+0000","last_unstale":"2023-07-29T02:00:02.439338+0000","last_undegraded":"2023-07-29T02:00:02.439338+0000","last_fullsized":"2023-07-29T02:00:02.439338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:54.400954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967930+0000","last_change":"2023-07-29T01:59:53.171808+0000","last_active":"2023-07-29T02:00:01.967930+0000","last_peered":"2023-07-29T02:00:01.967930+0000","last_clean":"2023-07-29T02:00:01.967930+0000","last_became_active":"2023-07-29T01:59:53.171463+0000","last_became_peered":"2023-07-29T01:59:53.171463+0000","last_unstale":"2023-07-29T02:00:01.967930+0000","last_undegraded":"2023-07-29T02:00:01.967930+0000","last_fullsized":"2023-07-29T02:00:01.967930+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:07:59.559814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973914+0000","last_change":"2023-07-29T01:59:57.549468+0000","last_active":"2023-07-29T02:00:01.973914+0000","last_peered":"2023-07-29T02:00:01.973914+0000","last_clean":"2023-07-29T02:00:01.973914+0000","last_became_active":"2023-07-29T01:59:57.549181+0000","last_became_peered":"2023-07-29T01:59:57.549181+0000","last_unstale":"2023-07-29T02:00:01.973914+0000","last_undegraded":"2023-07-29T02:00:01.973914+0000","last_fullsized":"2023-07-29T02:00:01.973914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966982+0000","last_change":"2023-07-29T01:59:57.963908+0000","last_active":"2023-07-29T02:00:01.966982+0000","last_peered":"2023-07-29T02:00:01.966982+0000","last_clean":"2023-07-29T02:00:01.966982+0000","last_became_active":"2023-07-29T01:59:57.963659+0000","last_became_peered":"2023-07-29T01:59:57.963659+0000","last_unstale":"2023-07-29T02:00:01.966982+0000","last_undegraded":"2023-07-29T02:00:01.966982+0000","last_fullsized":"2023-07-29T02:00:01.966982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440428+0000","last_change":"2023-07-29T02:00:01.984197+0000","last_active":"2023-07-29T02:00:02.440428+0000","last_peered":"2023-07-29T02:00:02.440428+0000","last_clean":"2023-07-29T02:00:02.440428+0000","last_became_active":"2023-07-29T02:00:01.983744+0000","last_became_peered":"2023-07-29T02:00:01.983744+0000","last_unstale":"2023-07-29T02:00:02.440428+0000","last_undegraded":"2023-07-29T02:00:02.440428+0000","last_fullsized":"2023-07-29T02:00:02.440428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968731+0000","last_change":"2023-07-29T01:59:52.449102+0000","last_active":"2023-07-29T02:00:01.968731+0000","last_peered":"2023-07-29T02:00:01.968731+0000","last_clean":"2023-07-29T02:00:01.968731+0000","last_became_active":"2023-07-29T01:59:52.448814+0000","last_became_peered":"2023-07-29T01:59:52.448814+0000","last_unstale":"2023-07-29T02:00:01.968731+0000","last_undegraded":"2023-07-29T02:00:01.968731+0000","last_fullsized":"2023-07-29T02:00:01.968731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977814+0000","last_change":"2023-07-29T01:59:57.544590+0000","last_active":"2023-07-29T02:00:01.977814+0000","last_peered":"2023-07-29T02:00:01.977814+0000","last_clean":"2023-07-29T02:00:01.977814+0000","last_became_active":"2023-07-29T01:59:57.544317+0000","last_became_peered":"2023-07-29T01:59:57.544317+0000","last_unstale":"2023-07-29T02:00:01.977814+0000","last_undegraded":"2023-07-29T02:00:01.977814+0000","last_fullsized":"2023-07-29T02:00:01.977814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971685+0000","last_change":"2023-07-29T01:59:57.973912+0000","last_active":"2023-07-29T02:00:01.971685+0000","last_peered":"2023-07-29T02:00:01.971685+0000","last_clean":"2023-07-29T02:00:01.971685+0000","last_became_active":"2023-07-29T01:59:57.969642+0000","last_became_peered":"2023-07-29T01:59:57.969642+0000","last_unstale":"2023-07-29T02:00:01.971685+0000","last_undegraded":"2023-07-29T02:00:01.971685+0000","last_fullsized":"2023-07-29T02:00:01.971685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440741+0000","last_change":"2023-07-29T02:00:01.999117+0000","last_active":"2023-07-29T02:00:02.440741+0000","last_peered":"2023-07-29T02:00:02.440741+0000","last_clean":"2023-07-29T02:00:02.440741+0000","last_became_active":"2023-07-29T02:00:01.998715+0000","last_became_peered":"2023-07-29T02:00:01.998715+0000","last_unstale":"2023-07-29T02:00:02.440741+0000","last_undegraded":"2023-07-29T02:00:02.440741+0000","last_fullsized":"2023-07-29T02:00:02.440741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440569+0000","last_change":"2023-07-29T01:59:57.545933+0000","last_active":"2023-07-29T02:00:02.440569+0000","last_peered":"2023-07-29T02:00:02.440569+0000","last_clean":"2023-07-29T02:00:02.440569+0000","last_became_active":"2023-07-29T01:59:57.545744+0000","last_became_peered":"2023-07-29T01:59:57.545744+0000","last_unstale":"2023-07-29T02:00:02.440569+0000","last_undegraded":"2023-07-29T02:00:02.440569+0000","last_fullsized":"2023-07-29T02:00:02.440569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972541+0000","last_change":"2023-07-29T01:59:57.970577+0000","last_active":"2023-07-29T02:00:01.972541+0000","last_peered":"2023-07-29T02:00:01.972541+0000","last_clean":"2023-07-29T02:00:01.972541+0000","last_became_active":"2023-07-29T01:59:57.970252+0000","last_became_peered":"2023-07-29T01:59:57.970252+0000","last_unstale":"2023-07-29T02:00:01.972541+0000","last_undegraded":"2023-07-29T02:00:01.972541+0000","last_fullsized":"2023-07-29T02:00:01.972541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:09.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399784+0000","last_change":"2023-07-29T02:00:01.989885+0000","last_active":"2023-07-29T02:00:02.399784+0000","last_peered":"2023-07-29T02:00:02.399784+0000","last_clean":"2023-07-29T02:00:02.399784+0000","last_became_active":"2023-07-29T02:00:01.989481+0000","last_became_peered":"2023-07-29T02:00:01.989481+0000","last_unstale":"2023-07-29T02:00:02.399784+0000","last_undegraded":"2023-07-29T02:00:02.399784+0000","last_fullsized":"2023-07-29T02:00:02.399784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957691+0000","last_change":"2023-07-29T01:59:57.543782+0000","last_active":"2023-07-29T02:00:02.957691+0000","last_peered":"2023-07-29T02:00:02.957691+0000","last_clean":"2023-07-29T02:00:02.957691+0000","last_became_active":"2023-07-29T01:59:57.543445+0000","last_became_peered":"2023-07-29T01:59:57.543445+0000","last_unstale":"2023-07-29T02:00:02.957691+0000","last_undegraded":"2023-07-29T02:00:02.957691+0000","last_fullsized":"2023-07-29T02:00:02.957691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.970956+0000","last_change":"2023-07-29T01:59:57.965177+0000","last_active":"2023-07-29T02:00:01.970956+0000","last_peered":"2023-07-29T02:00:01.970956+0000","last_clean":"2023-07-29T02:00:01.970956+0000","last_became_active":"2023-07-29T01:59:57.964925+0000","last_became_peered":"2023-07-29T01:59:57.964925+0000","last_unstale":"2023-07-29T02:00:01.970956+0000","last_undegraded":"2023-07-29T02:00:01.970956+0000","last_fullsized":"2023-07-29T02:00:01.970956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401320+0000","last_change":"2023-07-29T02:00:01.985786+0000","last_active":"2023-07-29T02:00:02.401320+0000","last_peered":"2023-07-29T02:00:02.401320+0000","last_clean":"2023-07-29T02:00:02.401320+0000","last_became_active":"2023-07-29T02:00:01.985310+0000","last_became_peered":"2023-07-29T02:00:01.985310+0000","last_unstale":"2023-07-29T02:00:02.401320+0000","last_undegraded":"2023-07-29T02:00:02.401320+0000","last_fullsized":"2023-07-29T02:00:02.401320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957725+0000","last_change":"2023-07-29T01:59:57.541908+0000","last_active":"2023-07-29T02:00:02.957725+0000","last_peered":"2023-07-29T02:00:02.957725+0000","last_clean":"2023-07-29T02:00:02.957725+0000","last_became_active":"2023-07-29T01:59:57.541633+0000","last_became_peered":"2023-07-29T01:59:57.541633+0000","last_unstale":"2023-07-29T02:00:02.957725+0000","last_undegraded":"2023-07-29T02:00:02.957725+0000","last_fullsized":"2023-07-29T02:00:02.957725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.970785+0000","last_change":"2023-07-29T01:59:57.965915+0000","last_active":"2023-07-29T02:00:01.970785+0000","last_peered":"2023-07-29T02:00:01.970785+0000","last_clean":"2023-07-29T02:00:01.970785+0000","last_became_active":"2023-07-29T01:59:57.965383+0000","last_became_peered":"2023-07-29T01:59:57.965383+0000","last_unstale":"2023-07-29T02:00:01.970785+0000","last_undegraded":"2023-07-29T02:00:01.970785+0000","last_fullsized":"2023-07-29T02:00:01.970785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.398445+0000","last_change":"2023-07-29T02:00:01.994436+0000","last_active":"2023-07-29T02:00:02.398445+0000","last_peered":"2023-07-29T02:00:02.398445+0000","last_clean":"2023-07-29T02:00:02.398445+0000","last_became_active":"2023-07-29T02:00:01.993454+0000","last_became_peered":"2023-07-29T02:00:01.993454+0000","last_unstale":"2023-07-29T02:00:02.398445+0000","last_undegraded":"2023-07-29T02:00:02.398445+0000","last_fullsized":"2023-07-29T02:00:02.398445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:46.998657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441131+0000","last_change":"2023-07-29T01:59:57.539625+0000","last_active":"2023-07-29T02:00:02.441131+0000","last_peered":"2023-07-29T02:00:02.441131+0000","last_clean":"2023-07-29T02:00:02.441131+0000","last_became_active":"2023-07-29T01:59:57.539181+0000","last_became_peered":"2023-07-29T01:59:57.539181+0000","last_unstale":"2023-07-29T02:00:02.441131+0000","last_undegraded":"2023-07-29T02:00:02.441131+0000","last_fullsized":"2023-07-29T02:00:02.441131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:02:57.137574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979518+0000","last_change":"2023-07-29T01:59:57.966812+0000","last_active":"2023-07-29T02:00:01.979518+0000","last_peered":"2023-07-29T02:00:01.979518+0000","last_clean":"2023-07-29T02:00:01.979518+0000","last_became_active":"2023-07-29T01:59:57.966580+0000","last_became_peered":"2023-07-29T01:59:57.966580+0000","last_unstale":"2023-07-29T02:00:01.979518+0000","last_undegraded":"2023-07-29T02:00:01.979518+0000","last_fullsized":"2023-07-29T02:00:01.979518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.203628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439475+0000","last_change":"2023-07-29T02:00:01.985984+0000","last_active":"2023-07-29T02:00:02.439475+0000","last_peered":"2023-07-29T02:00:02.439475+0000","last_clean":"2023-07-29T02:00:02.439475+0000","last_became_active":"2023-07-29T02:00:01.985554+0000","last_became_peered":"2023-07-29T02:00:01.985554+0000","last_unstale":"2023-07-29T02:00:02.439475+0000","last_undegraded":"2023-07-29T02:00:02.439475+0000","last_fullsized":"2023-07-29T02:00:02.439475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:50:50.164635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957483+0000","last_change":"2023-07-29T01:59:57.537754+0000","last_active":"2023-07-29T02:00:02.957483+0000","last_peered":"2023-07-29T02:00:02.957483+0000","last_clean":"2023-07-29T02:00:02.957483+0000","last_became_active":"2023-07-29T01:59:57.537457+0000","last_became_peered":"2023-07-29T01:59:57.537457+0000","last_unstale":"2023-07-29T02:00:02.957483+0000","last_undegraded":"2023-07-29T02:00:02.957483+0000","last_fullsized":"2023-07-29T02:00:02.957483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975481+0000","last_change":"2023-07-29T01:59:57.960633+0000","last_active":"2023-07-29T02:00:01.975481+0000","last_peered":"2023-07-29T02:00:01.975481+0000","last_clean":"2023-07-29T02:00:01.975481+0000","last_became_active":"2023-07-29T01:59:57.960318+0000","last_became_peered":"2023-07-29T01:59:57.960318+0000","last_unstale":"2023-07-29T02:00:01.975481+0000","last_undegraded":"2023-07-29T02:00:01.975481+0000","last_fullsized":"2023-07-29T02:00:01.975481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:01:11.408184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967878+0000","last_change":"2023-07-29T01:59:57.960826+0000","last_active":"2023-07-29T02:00:01.967878+0000","last_peered":"2023-07-29T02:00:01.967878+0000","last_clean":"2023-07-29T02:00:01.967878+0000","last_became_active":"2023-07-29T01:59:57.959960+0000","last_became_peered":"2023-07-29T01:59:57.959960+0000","last_unstale":"2023-07-29T02:00:01.967878+0000","last_undegraded":"2023-07-29T02:00:01.967878+0000","last_fullsized":"2023-07-29T02:00:01.967878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979718+0000","last_change":"2023-07-29T01:59:57.976560+0000","last_active":"2023-07-29T02:00:01.979718+0000","last_peered":"2023-07-29T02:00:01.979718+0000","last_clean":"2023-07-29T02:00:01.979718+0000","last_became_active":"2023-07-29T01:59:57.975384+0000","last_became_peered":"2023-07-29T01:59:57.975384+0000","last_unstale":"2023-07-29T02:00:01.979718+0000","last_undegraded":"2023-07-29T02:00:01.979718+0000","last_fullsized":"2023-07-29T02:00:01.979718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971237+0000","last_change":"2023-07-29T01:59:57.967891+0000","last_active":"2023-07-29T02:00:01.971237+0000","last_peered":"2023-07-29T02:00:01.971237+0000","last_clean":"2023-07-29T02:00:01.971237+0000","last_became_active":"2023-07-29T01:59:57.967603+0000","last_became_peered":"2023-07-29T01:59:57.967603+0000","last_unstale":"2023-07-29T02:00:01.971237+0000","last_undegraded":"2023-07-29T02:00:01.971237+0000","last_fullsized":"2023-07-29T02:00:01.971237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:24:00.439433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978571+0000","last_change":"2023-07-29T01:59:57.966922+0000","last_active":"2023-07-29T02:00:01.978571+0000","last_peered":"2023-07-29T02:00:01.978571+0000","last_clean":"2023-07-29T02:00:01.978571+0000","last_became_active":"2023-07-29T01:59:57.966672+0000","last_became_peered":"2023-07-29T01:59:57.966672+0000","last_unstale":"2023-07-29T02:00:01.978571+0000","last_undegraded":"2023-07-29T02:00:01.978571+0000","last_fullsized":"2023-07-29T02:00:01.978571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972636+0000","last_change":"2023-07-29T01:59:57.968727+0000","last_active":"2023-07-29T02:00:01.972636+0000","last_peered":"2023-07-29T02:00:01.972636+0000","last_clean":"2023-07-29T02:00:01.972636+0000","last_became_active":"2023-07-29T01:59:57.968449+0000","last_became_peered":"2023-07-29T01:59:57.968449+0000","last_unstale":"2023-07-29T02:00:01.972636+0000","last_undegraded":"2023-07-29T02:00:01.972636+0000","last_fullsized":"2023-07-29T02:00:01.972636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4589,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":703776,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":331776,"data_stored":699769,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":109983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":108530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":113248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":110053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T02:00:27.568 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T02:00:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.736+0000 7f97ab5cd700 1 Processor -- start 2023-07-29T02:00:27.724 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.737+0000 7f97ab5cd700 1 -- start start 2023-07-29T02:00:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.737+0000 7f97ab5cd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97a4151280 0x7f97a4061190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.737+0000 7f97ab5cd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f97a406aff0 0x7f97a406b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.737+0000 7f97ab5cd700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a40c2ad0 con 0x7f97a40c8bb0 2023-07-29T02:00:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.737+0000 7f97ab5cd700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a4072c80 con 0x7f97a406aff0 2023-07-29T02:00:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.737+0000 7f97ab5cd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a406b990 con 0x7f97a4151280 2023-07-29T02:00:27.726 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.737+0000 7f97a8b68700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f97a40c8bb0 0x7f97a40c4630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49958/0 (socket says 172.21.15.42:49958) 2023-07-29T02:00:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.737+0000 7f97a8b68700 1 -- 172.21.15.42:0/2987089306 learned_addr learned my addr 172.21.15.42:0/2987089306 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.738+0000 7f97a9369700 1 --2- 172.21.15.42:0/2987089306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97a4151280 0x7f97a4061190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.738+0000 7f97a9b6a700 1 --2- 172.21.15.42:0/2987089306 >> v2:172.21.15.144:3300/0 conn(0x7f97a406aff0 0x7f97a406b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.738+0000 7f9797fff700 1 -- 172.21.15.42:0/2987089306 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489219168 0 0) 0x7f97a40c2ad0 con 0x7f97a40c8bb0 2023-07-29T02:00:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.738+0000 7f9797fff700 1 -- 172.21.15.42:0/2987089306 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97900035b0 con 0x7f97a40c8bb0 2023-07-29T02:00:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.738+0000 7f97a9b6a700 1 -- 172.21.15.42:0/2987089306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97a4151280 msgr2=0x7f97a4061190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:27.727 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.738+0000 7f97a9b6a700 1 --2- 172.21.15.42:0/2987089306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97a4151280 0x7f97a4061190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.738+0000 7f97a9b6a700 1 -- 172.21.15.42:0/2987089306 >> v1:172.21.15.42:6789/0 conn(0x7f97a40c8bb0 legacy=0x7f97a40c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.738+0000 7f97a9b6a700 1 -- 172.21.15.42:0/2987089306 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a4157d50 con 0x7f97a406aff0 2023-07-29T02:00:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.738+0000 7f97a9369700 1 --2- 172.21.15.42:0/2987089306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97a4151280 0x7f97a4061190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:00:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.738+0000 7f97a9b6a700 1 --2- 172.21.15.42:0/2987089306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97a406aff0 0x7f97a406b450 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f979c009d90 tx=0x7f979c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dc234c2fb247023 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.738+0000 7f9797fff700 1 -- 172.21.15.42:0/2987089306 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c00e070 con 0x7f97a406aff0 2023-07-29T02:00:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.738+0000 7f9797fff700 1 -- 172.21.15.42:0/2987089306 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c00bb20 con 0x7f97a406aff0 2023-07-29T02:00:27.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.738+0000 7f9797fff700 1 -- 172.21.15.42:0/2987089306 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c012430 con 0x7f97a406aff0 2023-07-29T02:00:27.730 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.739+0000 7f97ab5cd700 1 -- 172.21.15.42:0/2987089306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97a406aff0 msgr2=0x7f97a406b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.739+0000 7f97ab5cd700 1 --2- 172.21.15.42:0/2987089306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97a406aff0 0x7f97a406b450 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f979c009d90 tx=0x7f979c00b330 comp rx=0 tx=0).stop 2023-07-29T02:00:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.739+0000 7f97ab5cd700 1 -- 172.21.15.42:0/2987089306 shutdown_connections 2023-07-29T02:00:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.739+0000 7f97ab5cd700 1 --2- 172.21.15.42:0/2987089306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97a406aff0 0x7f97a406b450 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.739+0000 7f97ab5cd700 1 --2- 172.21.15.42:0/2987089306 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97a4151280 0x7f97a4061190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.739+0000 7f97ab5cd700 1 -- 172.21.15.42:0/2987089306 >> 172.21.15.42:0/2987089306 conn(0x7f97a40cc360 msgr2=0x7f97a40c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.739+0000 7f97ab5cd700 1 -- 172.21.15.42:0/2987089306 shutdown_connections 2023-07-29T02:00:27.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.739+0000 7f97ab5cd700 1 -- 172.21.15.42:0/2987089306 wait complete. 2023-07-29T02:00:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.740+0000 7f97ab5cd700 1 Processor -- start 2023-07-29T02:00:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.740+0000 7f97ab5cd700 1 -- start start 2023-07-29T02:00:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.741+0000 7f97ab5cd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97a406aff0 0x7f97a40cab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.741+0000 7f97ab5cd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97a40c8bb0 0x7f97a4154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.741+0000 7f97ab5cd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97a4151280 0x7f97a41ef120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.741+0000 7f97ab5cd700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a414c850 con 0x7f97a4151280 2023-07-29T02:00:27.732 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.741+0000 7f97ab5cd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a41557d0 con 0x7f97a406aff0 2023-07-29T02:00:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.741+0000 7f97ab5cd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a4156c80 con 0x7f97a40c8bb0 2023-07-29T02:00:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.741+0000 7f97a9b6a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97a4151280 0x7f97a41ef120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.741+0000 7f97a9b6a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97a4151280 0x7f97a41ef120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56162/0 (socket says 172.21.15.42:56162) 2023-07-29T02:00:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.741+0000 7f97a9b6a700 1 -- 172.21.15.42:0/325104055 learned_addr learned my addr 172.21.15.42:0/325104055 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.741+0000 7f97a9369700 1 --2- 172.21.15.42:0/325104055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97a406aff0 0x7f97a40cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.741+0000 7f97a8b68700 1 --2- 172.21.15.42:0/325104055 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97a40c8bb0 0x7f97a4154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.742+0000 7f97a9b6a700 1 -- 172.21.15.42:0/325104055 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97a40c8bb0 msgr2=0x7f97a4154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:27.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.742+0000 7f97a9b6a700 1 --2- 172.21.15.42:0/325104055 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97a40c8bb0 0x7f97a4154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.742+0000 7f97a9b6a700 1 -- 172.21.15.42:0/325104055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97a406aff0 msgr2=0x7f97a40cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:27.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.742+0000 7f97a9b6a700 1 --2- 172.21.15.42:0/325104055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97a406aff0 0x7f97a40cab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.742+0000 7f97a9b6a700 1 -- 172.21.15.42:0/325104055 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a00094a0 con 0x7f97a4151280 2023-07-29T02:00:27.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.742+0000 7f97a9b6a700 1 --2- 172.21.15.42:0/325104055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97a4151280 0x7f97a41ef120 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f97a4070400 tx=0x7f979c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:27.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.742+0000 7f9795ffb700 1 -- 172.21.15.42:0/325104055 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c012430 con 0x7f97a4151280 2023-07-29T02:00:27.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.742+0000 7f9795ffb700 1 -- 172.21.15.42:0/325104055 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c020070 con 0x7f97a4151280 2023-07-29T02:00:27.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.742+0000 7f97ab5cd700 1 -- 172.21.15.42:0/325104055 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979c009a70 con 0x7f97a4151280 2023-07-29T02:00:27.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.742+0000 7f9795ffb700 1 -- 172.21.15.42:0/325104055 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c0098f0 con 0x7f97a4151280 2023-07-29T02:00:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.742+0000 7f97ab5cd700 1 -- 172.21.15.42:0/325104055 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a41563e0 con 0x7f97a4151280 2023-07-29T02:00:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.743+0000 7f97ab5cd700 1 -- 172.21.15.42:0/325104055 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a41eeaa0 con 0x7f97a4151280 2023-07-29T02:00:27.735 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.743+0000 7f9795ffb700 1 -- 172.21.15.42:0/325104055 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f979c004040 con 0x7f97a4151280 2023-07-29T02:00:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.744+0000 7f9795ffb700 1 --2- 172.21.15.42:0/325104055 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f978806a660 0x7f978806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.744+0000 7f9795ffb700 1 -- 172.21.15.42:0/325104055 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f979c022070 con 0x7f97a4151280 2023-07-29T02:00:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.744+0000 7f97a9369700 1 --2- 172.21.15.42:0/325104055 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f978806a660 0x7f978806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.745+0000 7f97a9369700 1 --2- 172.21.15.42:0/325104055 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f978806a660 0x7f978806cb10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009cd0 tx=0x7f97a0009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:27.736 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.748+0000 7f9795ffb700 1 -- 172.21.15.42:0/325104055 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f97a41eeaa0 con 0x7f97a4151280 2023-07-29T02:00:27.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.945+0000 7f97ab5cd700 1 -- 172.21.15.42:0/325104055 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f97a406a7f0 con 0x7f978806a660 2023-07-29T02:00:27.942 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.955+0000 7f9795ffb700 1 -- 172.21.15.42:0/325104055 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367614 (secure 0 0 0) 0x7f97a0009e10 con 0x7f978806a660 2023-07-29T02:00:27.946 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:27.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.959+0000 7f97ab5cd700 1 -- 172.21.15.42:0/325104055 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f978806a660 msgr2=0x7f978806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:27.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.959+0000 7f97ab5cd700 1 --2- 172.21.15.42:0/325104055 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f978806a660 0x7f978806cb10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009cd0 tx=0x7f97a0009210 comp rx=0 tx=0).stop 2023-07-29T02:00:27.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.959+0000 7f97ab5cd700 1 -- 172.21.15.42:0/325104055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97a4151280 msgr2=0x7f97a41ef120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:27.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.959+0000 7f97ab5cd700 1 --2- 172.21.15.42:0/325104055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97a4151280 0x7f97a41ef120 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f97a4070400 tx=0x7f979c004ad0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.959+0000 7f97ab5cd700 1 -- 172.21.15.42:0/325104055 shutdown_connections 2023-07-29T02:00:27.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.959+0000 7f97ab5cd700 1 --2- 172.21.15.42:0/325104055 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f978806a660 0x7f978806cb10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.959+0000 7f97ab5cd700 1 --2- 172.21.15.42:0/325104055 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f97a4151280 0x7f97a41ef120 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.959+0000 7f97ab5cd700 1 --2- 172.21.15.42:0/325104055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f97a406aff0 0x7f97a40cab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.959+0000 7f97ab5cd700 1 --2- 172.21.15.42:0/325104055 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f97a40c8bb0 0x7f97a4154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:27.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.959+0000 7f97ab5cd700 1 -- 172.21.15.42:0/325104055 >> 172.21.15.42:0/325104055 conn(0x7f97a40cc360 msgr2=0x7f97a414fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:27.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.959+0000 7f97ab5cd700 1 -- 172.21.15.42:0/325104055 shutdown_connections 2023-07-29T02:00:27.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:27.959+0000 7f97ab5cd700 1 -- 172.21.15.42:0/325104055 wait complete. 2023-07-29T02:00:27.950 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2023-07-29T02:00:27.959 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-07-29T02:00:27.238643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594957,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217884,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756836,"statfs":{"total":773094113280,"available":772871000064,"internally_reserved":0,"allocated":2322432,"data_stored":2064161,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003685"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972736+0000","last_change":"2023-07-29T01:59:57.958129+0000","last_active":"2023-07-29T02:00:01.972736+0000","last_peered":"2023-07-29T02:00:01.972736+0000","last_clean":"2023-07-29T02:00:01.972736+0000","last_became_active":"2023-07-29T01:59:57.957742+0000","last_became_peered":"2023-07-29T01:59:57.957742+0000","last_unstale":"2023-07-29T02:00:01.972736+0000","last_undegraded":"2023-07-29T02:00:01.972736+0000","last_fullsized":"2023-07-29T02:00:01.972736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:32.550358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975520+0000","last_change":"2023-07-29T01:59:57.974652+0000","last_active":"2023-07-29T02:00:01.975520+0000","last_peered":"2023-07-29T02:00:01.975520+0000","last_clean":"2023-07-29T02:00:01.975520+0000","last_became_active":"2023-07-29T01:59:57.974338+0000","last_became_peered":"2023-07-29T01:59:57.974338+0000","last_unstale":"2023-07-29T02:00:01.975520+0000","last_undegraded":"2023-07-29T02:00:01.975520+0000","last_fullsized":"2023-07-29T02:00:01.975520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978265+0000","last_change":"2023-07-29T01:59:57.973621+0000","last_active":"2023-07-29T02:00:01.978265+0000","last_peered":"2023-07-29T02:00:01.978265+0000","last_clean":"2023-07-29T02:00:01.978265+0000","last_became_active":"2023-07-29T01:59:57.973406+0000","last_became_peered":"2023-07-29T01:59:57.973406+0000","last_unstale":"2023-07-29T02:00:01.978265+0000","last_undegraded":"2023-07-29T02:00:01.978265+0000","last_fullsized":"2023-07-29T02:00:01.978265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:08:23.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968045+0000","last_change":"2023-07-29T01:59:57.965192+0000","last_active":"2023-07-29T02:00:01.968045+0000","last_peered":"2023-07-29T02:00:01.968045+0000","last_clean":"2023-07-29T02:00:01.968045+0000","last_became_active":"2023-07-29T01:59:57.964865+0000","last_became_peered":"2023-07-29T01:59:57.964865+0000","last_unstale":"2023-07-29T02:00:01.968045+0000","last_undegraded":"2023-07-29T02:00:01.968045+0000","last_fullsized":"2023-07-29T02:00:01.968045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:32.905717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967106+0000","last_change":"2023-07-29T01:59:57.971026+0000","last_active":"2023-07-29T02:00:01.967106+0000","last_peered":"2023-07-29T02:00:01.967106+0000","last_clean":"2023-07-29T02:00:01.967106+0000","last_became_active":"2023-07-29T01:59:57.970733+0000","last_became_peered":"2023-07-29T01:59:57.970733+0000","last_unstale":"2023-07-29T02:00:01.967106+0000","last_undegraded":"2023-07-29T02:00:01.967106+0000","last_fullsized":"2023-07-29T02:00:01.967106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971129+0000","last_change":"2023-07-29T01:59:57.965729+0000","last_active":"2023-07-29T02:00:01.971129+0000","last_peered":"2023-07-29T02:00:01.971129+0000","last_clean":"2023-07-29T02:00:01.971129+0000","last_became_active":"2023-07-29T01:59:57.964993+0000","last_became_peered":"2023-07-29T01:59:57.964993+0000","last_unstale":"2023-07-29T02:00:01.971129+0000","last_undegraded":"2023-07-29T02:00:01.971129+0000","last_fullsized":"2023-07-29T02:00:01.971129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974411+0000","last_change":"2023-07-29T01:59:57.970481+0000","last_active":"2023-07-29T02:00:01.974411+0000","last_peered":"2023-07-29T02:00:01.974411+0000","last_clean":"2023-07-29T02:00:01.974411+0000","last_became_active":"2023-07-29T01:59:57.970232+0000","last_became_peered":"2023-07-29T01:59:57.970232+0000","last_unstale":"2023-07-29T02:00:01.974411+0000","last_undegraded":"2023-07-29T02:00:01.974411+0000","last_fullsized":"2023-07-29T02:00:01.974411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974000+0000","last_change":"2023-07-29T01:59:57.963201+0000","last_active":"2023-07-29T02:00:01.974000+0000","last_peered":"2023-07-29T02:00:01.974000+0000","last_clean":"2023-07-29T02:00:01.974000+0000","last_became_active":"2023-07-29T01:59:57.962884+0000","last_became_peered":"2023-07-29T01:59:57.962884+0000","last_unstale":"2023-07-29T02:00:01.974000+0000","last_undegraded":"2023-07-29T02:00:01.974000+0000","last_fullsized":"2023-07-29T02:00:01.974000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967238+0000","last_change":"2023-07-29T01:59:57.971916+0000","last_active":"2023-07-29T02:00:01.967238+0000","last_peered":"2023-07-29T02:00:01.967238+0000","last_clean":"2023-07-29T02:00:01.967238+0000","last_became_active":"2023-07-29T01:59:57.971640+0000","last_became_peered":"2023-07-29T01:59:57.971640+0000","last_unstale":"2023-07-29T02:00:01.967238+0000","last_undegraded":"2023-07-29T02:00:01.967238+0000","last_fullsized":"2023-07-29T02:00:01.967238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975619+0000","last_change":"2023-07-29T01:59:57.963080+0000","last_active":"2023-07-29T02:00:01.975619+0000","last_peered":"2023-07-29T02:00:01.975619+0000","last_clean":"2023-07-29T02:00:01.975619+0000","last_became_active":"2023-07-29T01:59:57.962799+0000","last_became_peered":"2023-07-29T01:59:57.962799+0000","last_unstale":"2023-07-29T02:00:01.975619+0000","last_undegraded":"2023-07-29T02:00:01.975619+0000","last_fullsized":"2023-07-29T02:00:01.975619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978173+0000","last_change":"2023-07-29T01:59:57.970172+0000","last_active":"2023-07-29T02:00:01.978173+0000","last_peered":"2023-07-29T02:00:01.978173+0000","last_clean":"2023-07-29T02:00:01.978173+0000","last_became_active":"2023-07-29T01:59:57.969868+0000","last_became_peered":"2023-07-29T01:59:57.969868+0000","last_unstale":"2023-07-29T02:00:01.978173+0000","last_undegraded":"2023-07-29T02:00:01.978173+0000","last_fullsized":"2023-07-29T02:00:01.978173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972765+0000","last_change":"2023-07-29T01:59:57.964171+0000","last_active":"2023-07-29T02:00:01.972765+0000","last_peered":"2023-07-29T02:00:01.972765+0000","last_clean":"2023-07-29T02:00:01.972765+0000","last_became_active":"2023-07-29T01:59:57.963902+0000","last_became_peered":"2023-07-29T01:59:57.963902+0000","last_unstale":"2023-07-29T02:00:01.972765+0000","last_undegraded":"2023-07-29T02:00:01.972765+0000","last_fullsized":"2023-07-29T02:00:01.972765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:51.691001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972884+0000","last_change":"2023-07-29T01:59:57.963492+0000","last_active":"2023-07-29T02:00:01.972884+0000","last_peered":"2023-07-29T02:00:01.972884+0000","last_clean":"2023-07-29T02:00:01.972884+0000","last_became_active":"2023-07-29T01:59:57.963239+0000","last_became_peered":"2023-07-29T01:59:57.963239+0000","last_unstale":"2023-07-29T02:00:01.972884+0000","last_undegraded":"2023-07-29T02:00:01.972884+0000","last_fullsized":"2023-07-29T02:00:01.972884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:08.001986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974742+0000","last_change":"2023-07-29T01:59:57.961369+0000","last_active":"2023-07-29T02:00:01.974742+0000","last_peered":"2023-07-29T02:00:01.974742+0000","last_clean":"2023-07-29T02:00:01.974742+0000","last_became_active":"2023-07-29T01:59:57.960709+0000","last_became_peered":"2023-07-29T01:59:57.960709+0000","last_unstale":"2023-07-29T02:00:01.974742+0000","last_undegraded":"2023-07-29T02:00:01.974742+0000","last_fullsized":"2023-07-29T02:00:01.974742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974229+0000","last_change":"2023-07-29T01:59:57.970498+0000","last_active":"2023-07-29T02:00:01.974229+0000","last_peered":"2023-07-29T02:00:01.974229+0000","last_clean":"2023-07-29T02:00:01.974229+0000","last_became_active":"2023-07-29T01:59:57.970263+0000","last_became_peered":"2023-07-29T01:59:57.970263+0000","last_unstale":"2023-07-29T02:00:01.974229+0000","last_undegraded":"2023-07-29T02:00:01.974229+0000","last_fullsized":"2023-07-29T02:00:01.974229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975567+0000","last_change":"2023-07-29T01:59:57.965648+0000","last_active":"2023-07-29T02:00:01.975567+0000","last_peered":"2023-07-29T02:00:01.975567+0000","last_clean":"2023-07-29T02:00:01.975567+0000","last_became_active":"2023-07-29T01:59:57.964696+0000","last_became_peered":"2023-07-29T01:59:57.964696+0000","last_unstale":"2023-07-29T02:00:01.975567+0000","last_undegraded":"2023-07-29T02:00:01.975567+0000","last_fullsized":"2023-07-29T02:00:01.975567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:19:14.641252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967346+0000","last_change":"2023-07-29T01:59:57.969148+0000","last_active":"2023-07-29T02:00:01.967346+0000","last_peered":"2023-07-29T02:00:01.967346+0000","last_clean":"2023-07-29T02:00:01.967346+0000","last_became_active":"2023-07-29T01:59:57.968885+0000","last_became_peered":"2023-07-29T01:59:57.968885+0000","last_unstale":"2023-07-29T02:00:01.967346+0000","last_undegraded":"2023-07-29T02:00:01.967346+0000","last_fullsized":"2023-07-29T02:00:01.967346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977442+0000","last_change":"2023-07-29T01:59:57.963189+0000","last_active":"2023-07-29T02:00:01.977442+0000","last_peered":"2023-07-29T02:00:01.977442+0000","last_clean":"2023-07-29T02:00:01.977442+0000","last_became_active":"2023-07-29T01:59:57.962919+0000","last_became_peered":"2023-07-29T01:59:57.962919+0000","last_unstale":"2023-07-29T02:00:01.977442+0000","last_undegraded":"2023-07-29T02:00:01.977442+0000","last_fullsized":"2023-07-29T02:00:01.977442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:16:58.718803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973218+0000","last_change":"2023-07-29T01:59:57.960380+0000","last_active":"2023-07-29T02:00:01.973218+0000","last_peered":"2023-07-29T02:00:01.973218+0000","last_clean":"2023-07-29T02:00:01.973218+0000","last_became_active":"2023-07-29T01:59:57.960111+0000","last_became_peered":"2023-07-29T01:59:57.960111+0000","last_unstale":"2023-07-29T02:00:01.973218+0000","last_undegraded":"2023-07-29T02:00:01.973218+0000","last_fullsized":"2023-07-29T02:00:01.973218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:45.956813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977046+0000","last_change":"2023-07-29T01:59:57.961945+0000","last_active":"2023-07-29T02:00:01.977046+0000","last_peered":"2023-07-29T02:00:01.977046+0000","last_clean":"2023-07-29T02:00:01.977046+0000","last_became_active":"2023-07-29T01:59:57.961655+0000","last_became_peered":"2023-07-29T01:59:57.961655+0000","last_unstale":"2023-07-29T02:00:01.977046+0000","last_undegraded":"2023-07-29T02:00:01.977046+0000","last_fullsized":"2023-07-29T02:00:01.977046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.203628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974482+0000","last_change":"2023-07-29T01:59:57.971030+0000","last_active":"2023-07-29T02:00:01.974482+0000","last_peered":"2023-07-29T02:00:01.974482+0000","last_clean":"2023-07-29T02:00:01.974482+0000","last_became_active":"2023-07-29T01:59:57.970757+0000","last_became_peered":"2023-07-29T01:59:57.970757+0000","last_unstale":"2023-07-29T02:00:01.974482+0000","last_undegraded":"2023-07-29T02:00:01.974482+0000","last_fullsized":"2023-07-29T02:00:01.974482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966509+0000","last_change":"2023-07-29T01:59:57.974734+0000","last_active":"2023-07-29T02:00:01.966509+0000","last_peered":"2023-07-29T02:00:01.966509+0000","last_clean":"2023-07-29T02:00:01.966509+0000","last_became_active":"2023-07-29T01:59:57.974436+0000","last_became_peered":"2023-07-29T01:59:57.974436+0000","last_unstale":"2023-07-29T02:00:01.966509+0000","last_undegraded":"2023-07-29T02:00:01.966509+0000","last_fullsized":"2023-07-29T02:00:01.966509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979698+0000","last_change":"2023-07-29T01:59:57.967259+0000","last_active":"2023-07-29T02:00:01.979698+0000","last_peered":"2023-07-29T02:00:01.979698+0000","last_clean":"2023-07-29T02:00:01.979698+0000","last_became_active":"2023-07-29T01:59:57.966987+0000","last_became_peered":"2023-07-29T01:59:57.966987+0000","last_unstale":"2023-07-29T02:00:01.979698+0000","last_undegraded":"2023-07-29T02:00:01.979698+0000","last_fullsized":"2023-07-29T02:00:01.979698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973494+0000","last_change":"2023-07-29T01:59:57.971976+0000","last_active":"2023-07-29T02:00:01.973494+0000","last_peered":"2023-07-29T02:00:01.973494+0000","last_clean":"2023-07-29T02:00:01.973494+0000","last_became_active":"2023-07-29T01:59:57.971733+0000","last_became_peered":"2023-07-29T01:59:57.971733+0000","last_unstale":"2023-07-29T02:00:01.973494+0000","last_undegraded":"2023-07-29T02:00:01.973494+0000","last_fullsized":"2023-07-29T02:00:01.973494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972112+0000","last_change":"2023-07-29T01:59:57.973644+0000","last_active":"2023-07-29T02:00:01.972112+0000","last_peered":"2023-07-29T02:00:01.972112+0000","last_clean":"2023-07-29T02:00:01.972112+0000","last_became_active":"2023-07-29T01:59:57.969742+0000","last_became_peered":"2023-07-29T01:59:57.969742+0000","last_unstale":"2023-07-29T02:00:01.972112+0000","last_undegraded":"2023-07-29T02:00:01.972112+0000","last_fullsized":"2023-07-29T02:00:01.972112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975642+0000","last_change":"2023-07-29T01:59:57.969779+0000","last_active":"2023-07-29T02:00:01.975642+0000","last_peered":"2023-07-29T02:00:01.975642+0000","last_clean":"2023-07-29T02:00:01.975642+0000","last_became_active":"2023-07-29T01:59:57.969409+0000","last_became_peered":"2023-07-29T01:59:57.969409+0000","last_unstale":"2023-07-29T02:00:01.975642+0000","last_undegraded":"2023-07-29T02:00:01.975642+0000","last_fullsized":"2023-07-29T02:00:01.975642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977989+0000","last_change":"2023-07-29T01:59:57.965799+0000","last_active":"2023-07-29T02:00:01.977989+0000","last_peered":"2023-07-29T02:00:01.977989+0000","last_clean":"2023-07-29T02:00:01.977989+0000","last_became_active":"2023-07-29T01:59:57.963774+0000","last_became_peered":"2023-07-29T01:59:57.963774+0000","last_unstale":"2023-07-29T02:00:01.977989+0000","last_undegraded":"2023-07-29T02:00:01.977989+0000","last_fullsized":"2023-07-29T02:00:01.977989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399488+0000","last_change":"2023-07-29T02:00:01.994114+0000","last_active":"2023-07-29T02:00:02.399488+0000","last_peered":"2023-07-29T02:00:02.399488+0000","last_clean":"2023-07-29T02:00:02.399488+0000","last_became_active":"2023-07-29T02:00:01.993731+0000","last_became_peered":"2023-07-29T02:00:01.993731+0000","last_unstale":"2023-07-29T02:00:02.399488+0000","last_undegraded":"2023-07-29T02:00:02.399488+0000","last_fullsized":"2023-07-29T02:00:02.399488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:14:25.422754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399152+0000","last_change":"2023-07-29T01:59:57.552913+0000","last_active":"2023-07-29T02:00:02.399152+0000","last_peered":"2023-07-29T02:00:02.399152+0000","last_clean":"2023-07-29T02:00:02.399152+0000","last_became_active":"2023-07-29T01:59:57.552673+0000","last_became_peered":"2023-07-29T01:59:57.552673+0000","last_unstale":"2023-07-29T02:00:02.399152+0000","last_undegraded":"2023-07-29T02:00:02.399152+0000","last_fullsized":"2023-07-29T02:00:02.399152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:49:56.335019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978862+0000","last_change":"2023-07-29T01:59:57.970140+0000","last_active":"2023-07-29T02:00:01.978862+0000","last_peered":"2023-07-29T02:00:01.978862+0000","last_clean":"2023-07-29T02:00:01.978862+0000","last_became_active":"2023-07-29T01:59:57.969821+0000","last_became_peered":"2023-07-29T01:59:57.969821+0000","last_unstale":"2023-07-29T02:00:01.978862+0000","last_undegraded":"2023-07-29T02:00:01.978862+0000","last_fullsized":"2023-07-29T02:00:01.978862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439205+0000","last_change":"2023-07-29T02:00:01.992728+0000","last_active":"2023-07-29T02:00:02.439205+0000","last_peered":"2023-07-29T02:00:02.439205+0000","last_clean":"2023-07-29T02:00:02.439205+0000","last_became_active":"2023-07-29T02:00:01.992338+0000","last_became_peered":"2023-07-29T02:00:01.992338+0000","last_unstale":"2023-07-29T02:00:02.439205+0000","last_undegraded":"2023-07-29T02:00:02.439205+0000","last_fullsized":"2023-07-29T02:00:02.439205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:37.968145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972242+0000","last_change":"2023-07-29T01:59:57.547793+0000","last_active":"2023-07-29T02:00:01.972242+0000","last_peered":"2023-07-29T02:00:01.972242+0000","last_clean":"2023-07-29T02:00:01.972242+0000","last_became_active":"2023-07-29T01:59:57.547455+0000","last_became_peered":"2023-07-29T01:59:57.547455+0000","last_unstale":"2023-07-29T02:00:01.972242+0000","last_undegraded":"2023-07-29T02:00:01.972242+0000","last_fullsized":"2023-07-29T02:00:01.972242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967048+0000","last_change":"2023-07-29T01:59:57.964646+0000","last_active":"2023-07-29T02:00:01.967048+0000","last_peered":"2023-07-29T02:00:01.967048+0000","last_clean":"2023-07-29T02:00:01.967048+0000","last_became_active":"2023-07-29T01:59:57.964393+0000","last_became_peered":"2023-07-29T01:59:57.964393+0000","last_unstale":"2023-07-29T02:00:01.967048+0000","last_undegraded":"2023-07-29T02:00:01.967048+0000","last_fullsized":"2023-07-29T02:00:01.967048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440161+0000","last_change":"2023-07-29T02:00:01.982883+0000","last_active":"2023-07-29T02:00:02.440161+0000","last_peered":"2023-07-29T02:00:02.440161+0000","last_clean":"2023-07-29T02:00:02.440161+0000","last_became_active":"2023-07-29T02:00:01.982042+0000","last_became_peered":"2023-07-29T02:00:01.982042+0000","last_unstale":"2023-07-29T02:00:02.440161+0000","last_undegraded":"2023-07-29T02:00:02.440161+0000","last_fullsized":"2023-07-29T02:00:02.440161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977952+0000","last_change":"2023-07-29T01:59:57.535286+0000","last_active":"2023-07-29T02:00:01.977952+0000","last_peered":"2023-07-29T02:00:01.977952+0000","last_clean":"2023-07-29T02:00:01.977952+0000","last_became_active":"2023-07-29T01:59:57.533523+0000","last_became_peered":"2023-07-29T01:59:57.533523+0000","last_unstale":"2023-07-29T02:00:01.977952+0000","last_undegraded":"2023-07-29T02:00:01.977952+0000","last_fullsized":"2023-07-29T02:00:01.977952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968772+0000","last_change":"2023-07-29T01:59:57.963792+0000","last_active":"2023-07-29T02:00:01.968772+0000","last_peered":"2023-07-29T02:00:01.968772+0000","last_clean":"2023-07-29T02:00:01.968772+0000","last_became_active":"2023-07-29T01:59:57.963466+0000","last_became_peered":"2023-07-29T01:59:57.963466+0000","last_unstale":"2023-07-29T02:00:01.968772+0000","last_undegraded":"2023-07-29T02:00:01.968772+0000","last_fullsized":"2023-07-29T02:00:01.968772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:28.048947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.438720+0000","last_change":"2023-07-29T02:00:01.984458+0000","last_active":"2023-07-29T02:00:02.438720+0000","last_peered":"2023-07-29T02:00:02.438720+0000","last_clean":"2023-07-29T02:00:02.438720+0000","last_became_active":"2023-07-29T02:00:01.984000+0000","last_became_peered":"2023-07-29T02:00:01.984000+0000","last_unstale":"2023-07-29T02:00:02.438720+0000","last_undegraded":"2023-07-29T02:00:02.438720+0000","last_fullsized":"2023-07-29T02:00:02.438720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967445+0000","last_change":"2023-07-29T01:59:57.537082+0000","last_active":"2023-07-29T02:00:01.967445+0000","last_peered":"2023-07-29T02:00:01.967445+0000","last_clean":"2023-07-29T02:00:01.967445+0000","last_became_active":"2023-07-29T01:59:57.536732+0000","last_became_peered":"2023-07-29T01:59:57.536732+0000","last_unstale":"2023-07-29T02:00:01.967445+0000","last_undegraded":"2023-07-29T02:00:01.967445+0000","last_fullsized":"2023-07-29T02:00:01.967445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977852+0000","last_change":"2023-07-29T01:59:57.971203+0000","last_active":"2023-07-29T02:00:01.977852+0000","last_peered":"2023-07-29T02:00:01.977852+0000","last_clean":"2023-07-29T02:00:01.977852+0000","last_became_active":"2023-07-29T01:59:57.970902+0000","last_became_peered":"2023-07-29T01:59:57.970902+0000","last_unstale":"2023-07-29T02:00:01.977852+0000","last_undegraded":"2023-07-29T02:00:01.977852+0000","last_fullsized":"2023-07-29T02:00:01.977852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399530+0000","last_change":"2023-07-29T02:00:01.991435+0000","last_active":"2023-07-29T02:00:02.399530+0000","last_peered":"2023-07-29T02:00:02.399530+0000","last_clean":"2023-07-29T02:00:02.399530+0000","last_became_active":"2023-07-29T02:00:01.989456+0000","last_became_peered":"2023-07-29T02:00:01.989456+0000","last_unstale":"2023-07-29T02:00:02.399530+0000","last_undegraded":"2023-07-29T02:00:02.399530+0000","last_fullsized":"2023-07-29T02:00:02.399530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975677+0000","last_change":"2023-07-29T01:59:57.540572+0000","last_active":"2023-07-29T02:00:01.975677+0000","last_peered":"2023-07-29T02:00:01.975677+0000","last_clean":"2023-07-29T02:00:01.975677+0000","last_became_active":"2023-07-29T01:59:57.540113+0000","last_became_peered":"2023-07-29T01:59:57.540113+0000","last_unstale":"2023-07-29T02:00:01.975677+0000","last_undegraded":"2023-07-29T02:00:01.975677+0000","last_fullsized":"2023-07-29T02:00:01.975677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979625+0000","last_change":"2023-07-29T01:59:57.967343+0000","last_active":"2023-07-29T02:00:01.979625+0000","last_peered":"2023-07-29T02:00:01.979625+0000","last_clean":"2023-07-29T02:00:01.979625+0000","last_became_active":"2023-07-29T01:59:57.967083+0000","last_became_peered":"2023-07-29T01:59:57.967083+0000","last_unstale":"2023-07-29T02:00:01.979625+0000","last_undegraded":"2023-07-29T02:00:01.979625+0000","last_fullsized":"2023-07-29T02:00:01.979625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441217+0000","last_change":"2023-07-29T02:00:01.996761+0000","last_active":"2023-07-29T02:00:02.441217+0000","last_peered":"2023-07-29T02:00:02.441217+0000","last_clean":"2023-07-29T02:00:02.441217+0000","last_became_active":"2023-07-29T02:00:01.996035+0000","last_became_peered":"2023-07-29T02:00:01.996035+0000","last_unstale":"2023-07-29T02:00:02.441217+0000","last_undegraded":"2023-07-29T02:00:02.441217+0000","last_fullsized":"2023-07-29T02:00:02.441217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"25'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958140+0000","last_change":"2023-07-29T01:59:57.548665+0000","last_active":"2023-07-29T02:00:02.958140+0000","last_peered":"2023-07-29T02:00:02.958140+0000","last_clean":"2023-07-29T02:00:02.958140+0000","last_became_active":"2023-07-29T01:59:57.547803+0000","last_became_peered":"2023-07-29T01:59:57.547803+0000","last_unstale":"2023-07-29T02:00:02.958140+0000","last_undegraded":"2023-07-29T02:00:02.958140+0000","last_fullsized":"2023-07-29T02:00:02.958140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971561+0000","last_change":"2023-07-29T01:59:57.969319+0000","last_active":"2023-07-29T02:00:01.971561+0000","last_peered":"2023-07-29T02:00:01.971561+0000","last_clean":"2023-07-29T02:00:01.971561+0000","last_became_active":"2023-07-29T01:59:57.969006+0000","last_became_peered":"2023-07-29T01:59:57.969006+0000","last_unstale":"2023-07-29T02:00:01.971561+0000","last_undegraded":"2023-07-29T02:00:01.971561+0000","last_fullsized":"2023-07-29T02:00:01.971561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:30:28.393515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440217+0000","last_change":"2023-07-29T02:00:01.996124+0000","last_active":"2023-07-29T02:00:02.440217+0000","last_peered":"2023-07-29T02:00:02.440217+0000","last_clean":"2023-07-29T02:00:02.440217+0000","last_became_active":"2023-07-29T02:00:01.995757+0000","last_became_peered":"2023-07-29T02:00:01.995757+0000","last_unstale":"2023-07-29T02:00:02.440217+0000","last_undegraded":"2023-07-29T02:00:02.440217+0000","last_fullsized":"2023-07-29T02:00:02.440217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:24:03.881006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:11.051405+0000","last_change":"2023-07-29T01:59:57.541936+0000","last_active":"2023-07-29T02:00:11.051405+0000","last_peered":"2023-07-29T02:00:11.051405+0000","last_clean":"2023-07-29T02:00:11.051405+0000","last_became_active":"2023-07-29T01:59:57.541434+0000","last_became_peered":"2023-07-29T01:59:57.541434+0000","last_unstale":"2023-07-29T02:00:11.051405+0000","last_undegraded":"2023-07-29T02:00:11.051405+0000","last_fullsized":"2023-07-29T02:00:11.051405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3791,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976628+0000","last_change":"2023-07-29T01:59:57.962725+0000","last_active":"2023-07-29T02:00:01.976628+0000","last_peered":"2023-07-29T02:00:01.976628+0000","last_clean":"2023-07-29T02:00:01.976628+0000","last_became_active":"2023-07-29T01:59:57.962459+0000","last_became_peered":"2023-07-29T01:59:57.962459+0000","last_unstale":"2023-07-29T02:00:01.976628+0000","last_undegraded":"2023-07-29T02:00:01.976628+0000","last_fullsized":"2023-07-29T02:00:01.976628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401186+0000","last_change":"2023-07-29T02:00:01.996160+0000","last_active":"2023-07-29T02:00:02.401186+0000","last_peered":"2023-07-29T02:00:02.401186+0000","last_clean":"2023-07-29T02:00:02.401186+0000","last_became_active":"2023-07-29T02:00:01.995827+0000","last_became_peered":"2023-07-29T02:00:01.995827+0000","last_unstale":"2023-07-29T02:00:02.401186+0000","last_undegraded":"2023-07-29T02:00:02.401186+0000","last_fullsized":"2023-07-29T02:00:02.401186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958252+0000","last_change":"2023-07-29T01:59:57.545705+0000","last_active":"2023-07-29T02:00:02.958252+0000","last_peered":"2023-07-29T02:00:02.958252+0000","last_clean":"2023-07-29T02:00:02.958252+0000","last_became_active":"2023-07-29T01:59:57.545406+0000","last_became_peered":"2023-07-29T01:59:57.545406+0000","last_unstale":"2023-07-29T02:00:02.958252+0000","last_undegraded":"2023-07-29T02:00:02.958252+0000","last_fullsized":"2023-07-29T02:00:02.958252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:31.903601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.980027+0000","last_change":"2023-07-29T01:59:57.970072+0000","last_active":"2023-07-29T02:00:01.980027+0000","last_peered":"2023-07-29T02:00:01.980027+0000","last_clean":"2023-07-29T02:00:01.980027+0000","last_became_active":"2023-07-29T01:59:57.969809+0000","last_became_peered":"2023-07-29T01:59:57.969809+0000","last_unstale":"2023-07-29T02:00:01.980027+0000","last_undegraded":"2023-07-29T02:00:01.980027+0000","last_fullsized":"2023-07-29T02:00:01.980027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440272+0000","last_change":"2023-07-29T02:00:01.997402+0000","last_active":"2023-07-29T02:00:02.440272+0000","last_peered":"2023-07-29T02:00:02.440272+0000","last_clean":"2023-07-29T02:00:02.440272+0000","last_became_active":"2023-07-29T02:00:01.996969+0000","last_became_peered":"2023-07-29T02:00:01.996969+0000","last_unstale":"2023-07-29T02:00:02.440272+0000","last_undegraded":"2023-07-29T02:00:02.440272+0000","last_fullsized":"2023-07-29T02:00:02.440272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:46:37.088979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966653+0000","last_change":"2023-07-29T01:59:57.541115+0000","last_active":"2023-07-29T02:00:01.966653+0000","last_peered":"2023-07-29T02:00:01.966653+0000","last_clean":"2023-07-29T02:00:01.966653+0000","last_became_active":"2023-07-29T01:59:57.540800+0000","last_became_peered":"2023-07-29T01:59:57.540800+0000","last_unstale":"2023-07-29T02:00:01.966653+0000","last_undegraded":"2023-07-29T02:00:01.966653+0000","last_fullsized":"2023-07-29T02:00:01.966653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977902+0000","last_change":"2023-07-29T01:59:57.964198+0000","last_active":"2023-07-29T02:00:01.977902+0000","last_peered":"2023-07-29T02:00:01.977902+0000","last_clean":"2023-07-29T02:00:01.977902+0000","last_became_active":"2023-07-29T01:59:57.963510+0000","last_became_peered":"2023-07-29T01:59:57.963510+0000","last_unstale":"2023-07-29T02:00:01.977902+0000","last_undegraded":"2023-07-29T02:00:01.977902+0000","last_fullsized":"2023-07-29T02:00:01.977902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441378+0000","last_change":"2023-07-29T02:00:01.996496+0000","last_active":"2023-07-29T02:00:02.441378+0000","last_peered":"2023-07-29T02:00:02.441378+0000","last_clean":"2023-07-29T02:00:02.441378+0000","last_became_active":"2023-07-29T02:00:01.996084+0000","last_became_peered":"2023-07-29T02:00:01.996084+0000","last_unstale":"2023-07-29T02:00:02.441378+0000","last_undegraded":"2023-07-29T02:00:02.441378+0000","last_fullsized":"2023-07-29T02:00:02.441378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:59:57.581952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974316+0000","last_change":"2023-07-29T01:59:57.548464+0000","last_active":"2023-07-29T02:00:01.974316+0000","last_peered":"2023-07-29T02:00:01.974316+0000","last_clean":"2023-07-29T02:00:01.974316+0000","last_became_active":"2023-07-29T01:59:57.548109+0000","last_became_peered":"2023-07-29T01:59:57.548109+0000","last_unstale":"2023-07-29T02:00:01.974316+0000","last_undegraded":"2023-07-29T02:00:01.974316+0000","last_fullsized":"2023-07-29T02:00:01.974316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:13.433053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967896+0000","last_change":"2023-07-29T01:59:57.962096+0000","last_active":"2023-07-29T02:00:01.967896+0000","last_peered":"2023-07-29T02:00:01.967896+0000","last_clean":"2023-07-29T02:00:01.967896+0000","last_became_active":"2023-07-29T01:59:57.961759+0000","last_became_peered":"2023-07-29T01:59:57.961759+0000","last_unstale":"2023-07-29T02:00:01.967896+0000","last_undegraded":"2023-07-29T02:00:01.967896+0000","last_fullsized":"2023-07-29T02:00:01.967896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400737+0000","last_change":"2023-07-29T02:00:01.993066+0000","last_active":"2023-07-29T02:00:02.400737+0000","last_peered":"2023-07-29T02:00:02.400737+0000","last_clean":"2023-07-29T02:00:02.400737+0000","last_became_active":"2023-07-29T02:00:01.992592+0000","last_became_peered":"2023-07-29T02:00:01.992592+0000","last_unstale":"2023-07-29T02:00:02.400737+0000","last_undegraded":"2023-07-29T02:00:02.400737+0000","last_fullsized":"2023-07-29T02:00:02.400737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:14:06.353802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958759+0000","last_change":"2023-07-29T01:59:57.543707+0000","last_active":"2023-07-29T02:00:02.958759+0000","last_peered":"2023-07-29T02:00:02.958759+0000","last_clean":"2023-07-29T02:00:02.958759+0000","last_became_active":"2023-07-29T01:59:57.543398+0000","last_became_peered":"2023-07-29T01:59:57.543398+0000","last_unstale":"2023-07-29T02:00:02.958759+0000","last_undegraded":"2023-07-29T02:00:02.958759+0000","last_fullsized":"2023-07-29T02:00:02.958759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977853+0000","last_change":"2023-07-29T01:59:57.966269+0000","last_active":"2023-07-29T02:00:01.977853+0000","last_peered":"2023-07-29T02:00:01.977853+0000","last_clean":"2023-07-29T02:00:01.977853+0000","last_became_active":"2023-07-29T01:59:57.965962+0000","last_became_peered":"2023-07-29T01:59:57.965962+0000","last_unstale":"2023-07-29T02:00:01.977853+0000","last_undegraded":"2023-07-29T02:00:01.977853+0000","last_fullsized":"2023-07-29T02:00:01.977853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400336+0000","last_change":"2023-07-29T02:00:01.992987+0000","last_active":"2023-07-29T02:00:02.400336+0000","last_peered":"2023-07-29T02:00:02.400336+0000","last_clean":"2023-07-29T02:00:02.400336+0000","last_became_active":"2023-07-29T02:00:01.992384+0000","last_became_peered":"2023-07-29T02:00:01.992384+0000","last_unstale":"2023-07-29T02:00:02.400336+0000","last_undegraded":"2023-07-29T02:00:02.400336+0000","last_fullsized":"2023-07-29T02:00:02.400336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400080+0000","last_change":"2023-07-29T01:59:57.548392+0000","last_active":"2023-07-29T02:00:02.400080+0000","last_peered":"2023-07-29T02:00:02.400080+0000","last_clean":"2023-07-29T02:00:02.400080+0000","last_became_active":"2023-07-29T01:59:57.548084+0000","last_became_peered":"2023-07-29T01:59:57.548084+0000","last_unstale":"2023-07-29T02:00:02.400080+0000","last_undegraded":"2023-07-29T02:00:02.400080+0000","last_fullsized":"2023-07-29T02:00:02.400080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973873+0000","last_change":"2023-07-29T01:59:57.965613+0000","last_active":"2023-07-29T02:00:01.973873+0000","last_peered":"2023-07-29T02:00:01.973873+0000","last_clean":"2023-07-29T02:00:01.973873+0000","last_became_active":"2023-07-29T01:59:57.964626+0000","last_became_peered":"2023-07-29T01:59:57.964626+0000","last_unstale":"2023-07-29T02:00:01.973873+0000","last_undegraded":"2023-07-29T02:00:01.973873+0000","last_fullsized":"2023-07-29T02:00:01.973873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442405+0000","last_change":"2023-07-29T02:00:01.990978+0000","last_active":"2023-07-29T02:00:02.442405+0000","last_peered":"2023-07-29T02:00:02.442405+0000","last_clean":"2023-07-29T02:00:02.442405+0000","last_became_active":"2023-07-29T02:00:01.990579+0000","last_became_peered":"2023-07-29T02:00:01.990579+0000","last_unstale":"2023-07-29T02:00:02.442405+0000","last_undegraded":"2023-07-29T02:00:02.442405+0000","last_fullsized":"2023-07-29T02:00:02.442405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:11:53.398210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957642+0000","last_change":"2023-07-29T01:59:57.549270+0000","last_active":"2023-07-29T02:00:02.957642+0000","last_peered":"2023-07-29T02:00:02.957642+0000","last_clean":"2023-07-29T02:00:02.957642+0000","last_became_active":"2023-07-29T01:59:57.548981+0000","last_became_peered":"2023-07-29T01:59:57.548981+0000","last_unstale":"2023-07-29T02:00:02.957642+0000","last_undegraded":"2023-07-29T02:00:02.957642+0000","last_fullsized":"2023-07-29T02:00:02.957642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:05.783369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972647+0000","last_change":"2023-07-29T01:59:57.969851+0000","last_active":"2023-07-29T02:00:01.972647+0000","last_peered":"2023-07-29T02:00:01.972647+0000","last_clean":"2023-07-29T02:00:01.972647+0000","last_became_active":"2023-07-29T01:59:57.969501+0000","last_became_peered":"2023-07-29T01:59:57.969501+0000","last_unstale":"2023-07-29T02:00:01.972647+0000","last_undegraded":"2023-07-29T02:00:01.972647+0000","last_fullsized":"2023-07-29T02:00:01.972647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442608+0000","last_change":"2023-07-29T02:00:01.989766+0000","last_active":"2023-07-29T02:00:02.442608+0000","last_peered":"2023-07-29T02:00:02.442608+0000","last_clean":"2023-07-29T02:00:02.442608+0000","last_became_active":"2023-07-29T02:00:01.989364+0000","last_became_peered":"2023-07-29T02:00:01.989364+0000","last_unstale":"2023-07-29T02:00:02.442608+0000","last_undegraded":"2023-07-29T02:00:02.442608+0000","last_fullsized":"2023-07-29T02:00:02.442608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:01:14.849757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400580+0000","last_change":"2023-07-29T01:59:57.541329+0000","last_active":"2023-07-29T02:00:02.400580+0000","last_peered":"2023-07-29T02:00:02.400580+0000","last_clean":"2023-07-29T02:00:02.400580+0000","last_became_active":"2023-07-29T01:59:57.541056+0000","last_became_peered":"2023-07-29T01:59:57.541056+0000","last_unstale":"2023-07-29T02:00:02.400580+0000","last_undegraded":"2023-07-29T02:00:02.400580+0000","last_fullsized":"2023-07-29T02:00:02.400580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968261+0000","last_change":"2023-07-29T01:59:57.975244+0000","last_active":"2023-07-29T02:00:01.968261+0000","last_peered":"2023-07-29T02:00:01.968261+0000","last_clean":"2023-07-29T02:00:01.968261+0000","last_became_active":"2023-07-29T01:59:57.974998+0000","last_became_peered":"2023-07-29T01:59:57.974998+0000","last_unstale":"2023-07-29T02:00:01.968261+0000","last_undegraded":"2023-07-29T02:00:01.968261+0000","last_fullsized":"2023-07-29T02:00:01.968261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:14.435169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442656+0000","last_change":"2023-07-29T02:00:01.990823+0000","last_active":"2023-07-29T02:00:02.442656+0000","last_peered":"2023-07-29T02:00:02.442656+0000","last_clean":"2023-07-29T02:00:02.442656+0000","last_became_active":"2023-07-29T02:00:01.990276+0000","last_became_peered":"2023-07-29T02:00:01.990276+0000","last_unstale":"2023-07-29T02:00:02.442656+0000","last_undegraded":"2023-07-29T02:00:02.442656+0000","last_fullsized":"2023-07-29T02:00:02.442656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974632+0000","last_change":"2023-07-29T01:59:57.544524+0000","last_active":"2023-07-29T02:00:01.974632+0000","last_peered":"2023-07-29T02:00:01.974632+0000","last_clean":"2023-07-29T02:00:01.974632+0000","last_became_active":"2023-07-29T01:59:57.544231+0000","last_became_peered":"2023-07-29T01:59:57.544231+0000","last_unstale":"2023-07-29T02:00:01.974632+0000","last_undegraded":"2023-07-29T02:00:01.974632+0000","last_fullsized":"2023-07-29T02:00:01.974632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966682+0000","last_change":"2023-07-29T01:59:57.974773+0000","last_active":"2023-07-29T02:00:01.966682+0000","last_peered":"2023-07-29T02:00:01.966682+0000","last_clean":"2023-07-29T02:00:01.966682+0000","last_became_active":"2023-07-29T01:59:57.974525+0000","last_became_peered":"2023-07-29T01:59:57.974525+0000","last_unstale":"2023-07-29T02:00:01.966682+0000","last_undegraded":"2023-07-29T02:00:01.966682+0000","last_fullsized":"2023-07-29T02:00:01.966682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442650+0000","last_change":"2023-07-29T02:00:01.988872+0000","last_active":"2023-07-29T02:00:02.442650+0000","last_peered":"2023-07-29T02:00:02.442650+0000","last_clean":"2023-07-29T02:00:02.442650+0000","last_became_active":"2023-07-29T02:00:01.988486+0000","last_became_peered":"2023-07-29T02:00:01.988486+0000","last_unstale":"2023-07-29T02:00:02.442650+0000","last_undegraded":"2023-07-29T02:00:02.442650+0000","last_fullsized":"2023-07-29T02:00:02.442650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:07.842328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.954789+0000","last_change":"2023-07-29T01:59:57.535498+0000","last_active":"2023-07-29T02:00:02.954789+0000","last_peered":"2023-07-29T02:00:02.954789+0000","last_clean":"2023-07-29T02:00:02.954789+0000","last_became_active":"2023-07-29T01:59:57.534813+0000","last_became_peered":"2023-07-29T01:59:57.534813+0000","last_unstale":"2023-07-29T02:00:02.954789+0000","last_undegraded":"2023-07-29T02:00:02.954789+0000","last_fullsized":"2023-07-29T02:00:02.954789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976870+0000","last_change":"2023-07-29T01:59:57.962897+0000","last_active":"2023-07-29T02:00:01.976870+0000","last_peered":"2023-07-29T02:00:01.976870+0000","last_clean":"2023-07-29T02:00:01.976870+0000","last_became_active":"2023-07-29T01:59:57.962184+0000","last_became_peered":"2023-07-29T01:59:57.962184+0000","last_unstale":"2023-07-29T02:00:01.976870+0000","last_undegraded":"2023-07-29T02:00:01.976870+0000","last_fullsized":"2023-07-29T02:00:01.976870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440114+0000","last_change":"2023-07-29T02:00:01.989538+0000","last_active":"2023-07-29T02:00:02.440114+0000","last_peered":"2023-07-29T02:00:02.440114+0000","last_clean":"2023-07-29T02:00:02.440114+0000","last_became_active":"2023-07-29T02:00:01.989151+0000","last_became_peered":"2023-07-29T02:00:01.989151+0000","last_unstale":"2023-07-29T02:00:02.440114+0000","last_undegraded":"2023-07-29T02:00:02.440114+0000","last_fullsized":"2023-07-29T02:00:02.440114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:21:35.031304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968357+0000","last_change":"2023-07-29T01:59:57.544466+0000","last_active":"2023-07-29T02:00:01.968357+0000","last_peered":"2023-07-29T02:00:01.968357+0000","last_clean":"2023-07-29T02:00:01.968357+0000","last_became_active":"2023-07-29T01:59:57.544120+0000","last_became_peered":"2023-07-29T01:59:57.544120+0000","last_unstale":"2023-07-29T02:00:01.968357+0000","last_undegraded":"2023-07-29T02:00:01.968357+0000","last_fullsized":"2023-07-29T02:00:01.968357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977082+0000","last_change":"2023-07-29T01:59:57.962277+0000","last_active":"2023-07-29T02:00:01.977082+0000","last_peered":"2023-07-29T02:00:01.977082+0000","last_clean":"2023-07-29T02:00:01.977082+0000","last_became_active":"2023-07-29T01:59:57.961975+0000","last_became_peered":"2023-07-29T01:59:57.961975+0000","last_unstale":"2023-07-29T02:00:01.977082+0000","last_undegraded":"2023-07-29T02:00:01.977082+0000","last_fullsized":"2023-07-29T02:00:01.977082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:27:01.059953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400809+0000","last_change":"2023-07-29T02:00:01.988563+0000","last_active":"2023-07-29T02:00:02.400809+0000","last_peered":"2023-07-29T02:00:02.400809+0000","last_clean":"2023-07-29T02:00:02.400809+0000","last_became_active":"2023-07-29T02:00:01.988155+0000","last_became_peered":"2023-07-29T02:00:01.988155+0000","last_unstale":"2023-07-29T02:00:02.400809+0000","last_undegraded":"2023-07-29T02:00:02.400809+0000","last_fullsized":"2023-07-29T02:00:02.400809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972477+0000","last_change":"2023-07-29T01:59:57.549764+0000","last_active":"2023-07-29T02:00:01.972477+0000","last_peered":"2023-07-29T02:00:01.972477+0000","last_clean":"2023-07-29T02:00:01.972477+0000","last_became_active":"2023-07-29T01:59:57.549470+0000","last_became_peered":"2023-07-29T01:59:57.549470+0000","last_unstale":"2023-07-29T02:00:01.972477+0000","last_undegraded":"2023-07-29T02:00:01.972477+0000","last_fullsized":"2023-07-29T02:00:01.972477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976948+0000","last_change":"2023-07-29T01:59:57.962303+0000","last_active":"2023-07-29T02:00:01.976948+0000","last_peered":"2023-07-29T02:00:01.976948+0000","last_clean":"2023-07-29T02:00:01.976948+0000","last_became_active":"2023-07-29T01:59:57.962016+0000","last_became_peered":"2023-07-29T01:59:57.962016+0000","last_unstale":"2023-07-29T02:00:01.976948+0000","last_undegraded":"2023-07-29T02:00:01.976948+0000","last_fullsized":"2023-07-29T02:00:01.976948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:08.813083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399334+0000","last_change":"2023-07-29T02:00:01.992380+0000","last_active":"2023-07-29T02:00:02.399334+0000","last_peered":"2023-07-29T02:00:02.399334+0000","last_clean":"2023-07-29T02:00:02.399334+0000","last_became_active":"2023-07-29T02:00:01.992042+0000","last_became_peered":"2023-07-29T02:00:01.992042+0000","last_unstale":"2023-07-29T02:00:02.399334+0000","last_undegraded":"2023-07-29T02:00:02.399334+0000","last_fullsized":"2023-07-29T02:00:02.399334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:24:44.331640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977747+0000","last_change":"2023-07-29T01:59:57.537045+0000","last_active":"2023-07-29T02:00:01.977747+0000","last_peered":"2023-07-29T02:00:01.977747+0000","last_clean":"2023-07-29T02:00:01.977747+0000","last_became_active":"2023-07-29T01:59:57.535762+0000","last_became_peered":"2023-07-29T01:59:57.535762+0000","last_unstale":"2023-07-29T02:00:01.977747+0000","last_undegraded":"2023-07-29T02:00:01.977747+0000","last_fullsized":"2023-07-29T02:00:01.977747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972302+0000","last_change":"2023-07-29T01:59:57.975103+0000","last_active":"2023-07-29T02:00:01.972302+0000","last_peered":"2023-07-29T02:00:01.972302+0000","last_clean":"2023-07-29T02:00:01.972302+0000","last_became_active":"2023-07-29T01:59:57.974834+0000","last_became_peered":"2023-07-29T01:59:57.974834+0000","last_unstale":"2023-07-29T02:00:01.972302+0000","last_undegraded":"2023-07-29T02:00:01.972302+0000","last_fullsized":"2023-07-29T02:00:01.972302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401174+0000","last_change":"2023-07-29T02:00:01.990813+0000","last_active":"2023-07-29T02:00:02.401174+0000","last_peered":"2023-07-29T02:00:02.401174+0000","last_clean":"2023-07-29T02:00:02.401174+0000","last_became_active":"2023-07-29T02:00:01.990464+0000","last_became_peered":"2023-07-29T02:00:01.990464+0000","last_unstale":"2023-07-29T02:00:02.401174+0000","last_undegraded":"2023-07-29T02:00:02.401174+0000","last_fullsized":"2023-07-29T02:00:02.401174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:16:46.676860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958405+0000","last_change":"2023-07-29T01:59:57.540561+0000","last_active":"2023-07-29T02:00:02.958405+0000","last_peered":"2023-07-29T02:00:02.958405+0000","last_clean":"2023-07-29T02:00:02.958405+0000","last_became_active":"2023-07-29T01:59:57.540292+0000","last_became_peered":"2023-07-29T01:59:57.540292+0000","last_unstale":"2023-07-29T02:00:02.958405+0000","last_undegraded":"2023-07-29T02:00:02.958405+0000","last_fullsized":"2023-07-29T02:00:02.958405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978068+0000","last_change":"2023-07-29T01:59:52.448098+0000","last_active":"2023-07-29T02:00:01.978068+0000","last_peered":"2023-07-29T02:00:01.978068+0000","last_clean":"2023-07-29T02:00:01.978068+0000","last_became_active":"2023-07-29T01:59:52.447782+0000","last_became_peered":"2023-07-29T01:59:52.447782+0000","last_unstale":"2023-07-29T02:00:01.978068+0000","last_undegraded":"2023-07-29T02:00:01.978068+0000","last_fullsized":"2023-07-29T02:00:01.978068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:31.981804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977648+0000","last_change":"2023-07-29T01:59:57.967845+0000","last_active":"2023-07-29T02:00:01.977648+0000","last_peered":"2023-07-29T02:00:01.977648+0000","last_clean":"2023-07-29T02:00:01.977648+0000","last_became_active":"2023-07-29T01:59:57.966065+0000","last_became_peered":"2023-07-29T01:59:57.966065+0000","last_unstale":"2023-07-29T02:00:01.977648+0000","last_undegraded":"2023-07-29T02:00:01.977648+0000","last_fullsized":"2023-07-29T02:00:01.977648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439054+0000","last_change":"2023-07-29T02:00:01.996414+0000","last_active":"2023-07-29T02:00:02.439054+0000","last_peered":"2023-07-29T02:00:02.439054+0000","last_clean":"2023-07-29T02:00:02.439054+0000","last_became_active":"2023-07-29T02:00:01.995963+0000","last_became_peered":"2023-07-29T02:00:01.995963+0000","last_unstale":"2023-07-29T02:00:02.439054+0000","last_undegraded":"2023-07-29T02:00:02.439054+0000","last_fullsized":"2023-07-29T02:00:02.439054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:06:19.130853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.980059+0000","last_change":"2023-07-29T01:59:52.445649+0000","last_active":"2023-07-29T02:00:01.980059+0000","last_peered":"2023-07-29T02:00:01.980059+0000","last_clean":"2023-07-29T02:00:01.980059+0000","last_became_active":"2023-07-29T01:59:52.445337+0000","last_became_peered":"2023-07-29T01:59:52.445337+0000","last_unstale":"2023-07-29T02:00:01.980059+0000","last_undegraded":"2023-07-29T02:00:01.980059+0000","last_fullsized":"2023-07-29T02:00:01.980059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439989+0000","last_change":"2023-07-29T01:59:57.537863+0000","last_active":"2023-07-29T02:00:02.439989+0000","last_peered":"2023-07-29T02:00:02.439989+0000","last_clean":"2023-07-29T02:00:02.439989+0000","last_became_active":"2023-07-29T01:59:57.537581+0000","last_became_peered":"2023-07-29T01:59:57.537581+0000","last_unstale":"2023-07-29T02:00:02.439989+0000","last_undegraded":"2023-07-29T02:00:02.439989+0000","last_fullsized":"2023-07-29T02:00:02.439989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:02:57.137574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972545+0000","last_change":"2023-07-29T01:59:57.961598+0000","last_active":"2023-07-29T02:00:01.972545+0000","last_peered":"2023-07-29T02:00:01.972545+0000","last_clean":"2023-07-29T02:00:01.972545+0000","last_became_active":"2023-07-29T01:59:57.961298+0000","last_became_peered":"2023-07-29T01:59:57.961298+0000","last_unstale":"2023-07-29T02:00:01.972545+0000","last_undegraded":"2023-07-29T02:00:01.972545+0000","last_fullsized":"2023-07-29T02:00:01.972545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:11:49.956637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400459+0000","last_change":"2023-07-29T02:00:01.987452+0000","last_active":"2023-07-29T02:00:02.400459+0000","last_peered":"2023-07-29T02:00:02.400459+0000","last_clean":"2023-07-29T02:00:02.400459+0000","last_became_active":"2023-07-29T02:00:01.986915+0000","last_became_peered":"2023-07-29T02:00:01.986915+0000","last_unstale":"2023-07-29T02:00:02.400459+0000","last_undegraded":"2023-07-29T02:00:02.400459+0000","last_fullsized":"2023-07-29T02:00:02.400459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:35:48.256508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973327+0000","last_change":"2023-07-29T01:59:52.448423+0000","last_active":"2023-07-29T02:00:01.973327+0000","last_peered":"2023-07-29T02:00:01.973327+0000","last_clean":"2023-07-29T02:00:01.973327+0000","last_became_active":"2023-07-29T01:59:52.448052+0000","last_became_peered":"2023-07-29T01:59:52.448052+0000","last_unstale":"2023-07-29T02:00:01.973327+0000","last_undegraded":"2023-07-29T02:00:01.973327+0000","last_fullsized":"2023-07-29T02:00:01.973327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:31.981804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973579+0000","last_change":"2023-07-29T01:59:52.450730+0000","last_active":"2023-07-29T02:00:01.973579+0000","last_peered":"2023-07-29T02:00:01.973579+0000","last_clean":"2023-07-29T02:00:01.973579+0000","last_became_active":"2023-07-29T01:59:52.449582+0000","last_became_peered":"2023-07-29T01:59:52.449582+0000","last_unstale":"2023-07-29T02:00:01.973579+0000","last_undegraded":"2023-07-29T02:00:01.973579+0000","last_fullsized":"2023-07-29T02:00:01.973579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:01:27.099648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966496+0000","last_change":"2023-07-29T01:59:57.546474+0000","last_active":"2023-07-29T02:00:01.966496+0000","last_peered":"2023-07-29T02:00:01.966496+0000","last_clean":"2023-07-29T02:00:01.966496+0000","last_became_active":"2023-07-29T01:59:57.546179+0000","last_became_peered":"2023-07-29T01:59:57.546179+0000","last_unstale":"2023-07-29T02:00:01.966496+0000","last_undegraded":"2023-07-29T02:00:01.966496+0000","last_fullsized":"2023-07-29T02:00:01.966496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967788+0000","last_change":"2023-07-29T01:59:57.975316+0000","last_active":"2023-07-29T02:00:01.967788+0000","last_peered":"2023-07-29T02:00:01.967788+0000","last_clean":"2023-07-29T02:00:01.967788+0000","last_became_active":"2023-07-29T01:59:57.975078+0000","last_became_peered":"2023-07-29T01:59:57.975078+0000","last_unstale":"2023-07-29T02:00:01.967788+0000","last_undegraded":"2023-07-29T02:00:01.967788+0000","last_fullsized":"2023-07-29T02:00:01.967788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442819+0000","last_change":"2023-07-29T02:00:01.987385+0000","last_active":"2023-07-29T02:00:02.442819+0000","last_peered":"2023-07-29T02:00:02.442819+0000","last_clean":"2023-07-29T02:00:02.442819+0000","last_became_active":"2023-07-29T02:00:01.986937+0000","last_became_peered":"2023-07-29T02:00:01.986937+0000","last_unstale":"2023-07-29T02:00:02.442819+0000","last_undegraded":"2023-07-29T02:00:02.442819+0000","last_fullsized":"2023-07-29T02:00:02.442819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:53.580244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974915+0000","last_change":"2023-07-29T01:59:53.171806+0000","last_active":"2023-07-29T02:00:01.974915+0000","last_peered":"2023-07-29T02:00:01.974915+0000","last_clean":"2023-07-29T02:00:01.974915+0000","last_became_active":"2023-07-29T01:59:53.171467+0000","last_became_peered":"2023-07-29T01:59:53.171467+0000","last_unstale":"2023-07-29T02:00:01.974915+0000","last_undegraded":"2023-07-29T02:00:01.974915+0000","last_fullsized":"2023-07-29T02:00:01.974915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972796+0000","last_change":"2023-07-29T01:59:57.549442+0000","last_active":"2023-07-29T02:00:01.972796+0000","last_peered":"2023-07-29T02:00:01.972796+0000","last_clean":"2023-07-29T02:00:01.972796+0000","last_became_active":"2023-07-29T01:59:57.549151+0000","last_became_peered":"2023-07-29T01:59:57.549151+0000","last_unstale":"2023-07-29T02:00:01.972796+0000","last_undegraded":"2023-07-29T02:00:01.972796+0000","last_fullsized":"2023-07-29T02:00:01.972796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972211+0000","last_change":"2023-07-29T01:59:57.973471+0000","last_active":"2023-07-29T02:00:01.972211+0000","last_peered":"2023-07-29T02:00:01.972211+0000","last_clean":"2023-07-29T02:00:01.972211+0000","last_became_active":"2023-07-29T01:59:57.969273+0000","last_became_peered":"2023-07-29T01:59:57.969273+0000","last_unstale":"2023-07-29T02:00:01.972211+0000","last_undegraded":"2023-07-29T02:00:01.972211+0000","last_fullsized":"2023-07-29T02:00:01.972211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:56:07.949649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400121+0000","last_change":"2023-07-29T02:00:01.993242+0000","last_active":"2023-07-29T02:00:02.400121+0000","last_peered":"2023-07-29T02:00:02.400121+0000","last_clean":"2023-07-29T02:00:02.400121+0000","last_became_active":"2023-07-29T02:00:01.992406+0000","last_became_peered":"2023-07-29T02:00:01.992406+0000","last_unstale":"2023-07-29T02:00:02.400121+0000","last_undegraded":"2023-07-29T02:00:02.400121+0000","last_fullsized":"2023-07-29T02:00:02.400121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:12.254656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973406+0000","last_change":"2023-07-29T01:59:53.171746+0000","last_active":"2023-07-29T02:00:01.973406+0000","last_peered":"2023-07-29T02:00:01.973406+0000","last_clean":"2023-07-29T02:00:01.973406+0000","last_became_active":"2023-07-29T01:59:53.171440+0000","last_became_peered":"2023-07-29T01:59:53.171440+0000","last_unstale":"2023-07-29T02:00:01.973406+0000","last_undegraded":"2023-07-29T02:00:01.973406+0000","last_fullsized":"2023-07-29T02:00:01.973406+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:17:56.960611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976818+0000","last_change":"2023-07-29T01:59:57.537970+0000","last_active":"2023-07-29T02:00:01.976818+0000","last_peered":"2023-07-29T02:00:01.976818+0000","last_clean":"2023-07-29T02:00:01.976818+0000","last_became_active":"2023-07-29T01:59:57.537665+0000","last_became_peered":"2023-07-29T01:59:57.537665+0000","last_unstale":"2023-07-29T02:00:01.976818+0000","last_undegraded":"2023-07-29T02:00:01.976818+0000","last_fullsized":"2023-07-29T02:00:01.976818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968235+0000","last_change":"2023-07-29T01:59:57.968655+0000","last_active":"2023-07-29T02:00:01.968235+0000","last_peered":"2023-07-29T02:00:01.968235+0000","last_clean":"2023-07-29T02:00:01.968235+0000","last_became_active":"2023-07-29T01:59:57.968373+0000","last_became_peered":"2023-07-29T01:59:57.968373+0000","last_unstale":"2023-07-29T02:00:01.968235+0000","last_undegraded":"2023-07-29T02:00:01.968235+0000","last_fullsized":"2023-07-29T02:00:01.968235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:06.785485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439797+0000","last_change":"2023-07-29T02:00:01.984885+0000","last_active":"2023-07-29T02:00:02.439797+0000","last_peered":"2023-07-29T02:00:02.439797+0000","last_clean":"2023-07-29T02:00:02.439797+0000","last_became_active":"2023-07-29T02:00:01.984476+0000","last_became_peered":"2023-07-29T02:00:01.984476+0000","last_unstale":"2023-07-29T02:00:02.439797+0000","last_undegraded":"2023-07-29T02:00:02.439797+0000","last_fullsized":"2023-07-29T02:00:02.439797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973534+0000","last_change":"2023-07-29T01:59:53.172039+0000","last_active":"2023-07-29T02:00:01.973534+0000","last_peered":"2023-07-29T02:00:01.973534+0000","last_clean":"2023-07-29T02:00:01.973534+0000","last_became_active":"2023-07-29T01:59:53.171617+0000","last_became_peered":"2023-07-29T01:59:53.171617+0000","last_unstale":"2023-07-29T02:00:01.973534+0000","last_undegraded":"2023-07-29T02:00:01.973534+0000","last_fullsized":"2023-07-29T02:00:01.973534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976735+0000","last_change":"2023-07-29T01:59:57.540888+0000","last_active":"2023-07-29T02:00:01.976735+0000","last_peered":"2023-07-29T02:00:01.976735+0000","last_clean":"2023-07-29T02:00:01.976735+0000","last_became_active":"2023-07-29T01:59:57.540449+0000","last_became_peered":"2023-07-29T01:59:57.540449+0000","last_unstale":"2023-07-29T02:00:01.976735+0000","last_undegraded":"2023-07-29T02:00:01.976735+0000","last_fullsized":"2023-07-29T02:00:01.976735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974278+0000","last_change":"2023-07-29T01:59:57.968216+0000","last_active":"2023-07-29T02:00:01.974278+0000","last_peered":"2023-07-29T02:00:01.974278+0000","last_clean":"2023-07-29T02:00:01.974278+0000","last_became_active":"2023-07-29T01:59:57.967933+0000","last_became_peered":"2023-07-29T01:59:57.967933+0000","last_unstale":"2023-07-29T02:00:01.974278+0000","last_undegraded":"2023-07-29T02:00:01.974278+0000","last_fullsized":"2023-07-29T02:00:01.974278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439338+0000","last_change":"2023-07-29T02:00:01.985121+0000","last_active":"2023-07-29T02:00:02.439338+0000","last_peered":"2023-07-29T02:00:02.439338+0000","last_clean":"2023-07-29T02:00:02.439338+0000","last_became_active":"2023-07-29T02:00:01.984691+0000","last_became_peered":"2023-07-29T02:00:01.984691+0000","last_unstale":"2023-07-29T02:00:02.439338+0000","last_undegraded":"2023-07-29T02:00:02.439338+0000","last_fullsized":"2023-07-29T02:00:02.439338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:54.400954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967930+0000","last_change":"2023-07-29T01:59:53.171808+0000","last_active":"2023-07-29T02:00:01.967930+0000","last_peered":"2023-07-29T02:00:01.967930+0000","last_clean":"2023-07-29T02:00:01.967930+0000","last_became_active":"2023-07-29T01:59:53.171463+0000","last_became_peered":"2023-07-29T01:59:53.171463+0000","last_unstale":"2023-07-29T02:00:01.967930+0000","last_undegraded":"2023-07-29T02:00:01.967930+0000","last_fullsized":"2023-07-29T02:00:01.967930+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:07:59.559814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973914+0000","last_change":"2023-07-29T01:59:57.549468+0000","last_active":"2023-07-29T02:00:01.973914+0000","last_peered":"2023-07-29T02:00:01.973914+0000","last_clean":"2023-07-29T02:00:01.973914+0000","last_became_active":"2023-07-29T01:59:57.549181+0000","last_became_peered":"2023-07-29T01:59:57.549181+0000","last_unstale":"2023-07-29T02:00:01.973914+0000","last_undegraded":"2023-07-29T02:00:01.973914+0000","last_fullsized":"2023-07-29T02:00:01.973914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966982+0000","last_change":"2023-07-29T01:59:57.963908+0000","last_active":"2023-07-29T02:00:01.966982+0000","last_peered":"2023-07-29T02:00:01.966982+0000","last_clean":"2023-07-29T02:00:01.966982+0000","last_became_active":"2023-07-29T01:59:57.963659+0000","last_became_peered":"2023-07-29T01:59:57.963659+0000","last_unstale":"2023-07-29T02:00:01.966982+0000","last_undegraded":"2023-07-29T02:00:01.966982+0000","last_fullsized":"2023-07-29T02:00:01.966982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440428+0000","last_change":"2023-07-29T02:00:01.984197+0000","last_active":"2023-07-29T02:00:02.440428+0000","last_peered":"2023-07-29T02:00:02.440428+0000","last_clean":"2023-07-29T02:00:02.440428+0000","last_became_active":"2023-07-29T02:00:01.983744+0000","last_became_peered":"2023-07-29T02:00:01.983744+0000","last_unstale":"2023-07-29T02:00:02.440428+0000","last_undegraded":"2023-07-29T02:00:02.440428+0000","last_fullsized":"2023-07-29T02:00:02.440428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968731+0000","last_change":"2023-07-29T01:59:52.449102+0000","last_active":"2023-07-29T02:00:01.968731+0000","last_peered":"2023-07-29T02:00:01.968731+0000","last_clean":"2023-07-29T02:00:01.968731+0000","last_became_active":"2023-07-29T01:59:52.448814+0000","last_became_peered":"2023-07-29T01:59:52.448814+0000","last_unstale":"2023-07-29T02:00:01.968731+0000","last_undegraded":"2023-07-29T02:00:01.968731+0000","last_fullsized":"2023-07-29T02:00:01.968731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977814+0000","last_change":"2023-07-29T01:59:57.544590+0000","last_active":"2023-07-29T02:00:01.977814+0000","last_peered":"2023-07-29T02:00:01.977814+0000","last_clean":"2023-07-29T02:00:01.977814+0000","last_became_active":"2023-07-29T01:59:57.544317+0000","last_became_peered":"2023-07-29T01:59:57.544317+0000","last_unstale":"2023-07-29T02:00:01.977814+0000","last_undegraded":"2023-07-29T02:00:01.977814+0000","last_fullsized":"2023-07-29T02:00:01.977814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971685+0000","last_change":"2023-07-29T01:59:57.973912+0000","last_active":"2023-07-29T02:00:01.971685+0000","last_peered":"2023-07-29T02:00:01.971685+0000","last_clean":"2023-07-29T02:00:01.971685+0000","last_became_active":"2023-07-29T01:59:57.969642+0000","last_became_peered":"2023-07-29T01:59:57.969642+0000","last_unstale":"2023-07-29T02:00:01.971685+0000","last_undegraded":"2023-07-29T02:00:01.971685+0000","last_fullsized":"2023-07-29T02:00:01.971685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440741+0000","last_change":"2023-07-29T02:00:01.999117+0000","last_active":"2023-07-29T02:00:02.440741+0000","last_peered":"2023-07-29T02:00:02.440741+0000","last_clean":"2023-07-29T02:00:02.440741+0000","last_became_active":"2023-07-29T02:00:01.998715+0000","last_became_peered":"2023-07-29T02:00:01.998715+0000","last_unstale":"2023-07-29T02:00:02.440741+0000","last_undegraded":"2023-07-29T02:00:02.440741+0000","last_fullsized":"2023-07-29T02:00:02.440741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440569+0000","last_change":"2023-07-29T01:59:57.545933+0000","last_active":"2023-07-29T02:00:02.440569+0000","last_peered":"2023-07-29T02:00:02.440569+0000","last_clean":"2023-07-29T02:00:02.440569+0000","last_became_active":"2023-07-29T01:59:57.545744+0000","last_became_peered":"2023-07-29T01:59:57.545744+0000","last_unstale":"2023-07-29T02:00:02.440569+0000","last_undegraded":"2023-07-29T02:00:02.440569+0000","last_fullsized":"2023-07-29T02:00:02.440569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972541+0000","last_change":"2023-07-29T01:59:57.970577+0000","last_active":"2023-07-29T02:00:01.972541+0000","last_peered":"2023-07-29T02:00:01.972541+0000","last_clean":"2023-07-29T02:00:01.972541+0000","last_became_active":"2023-07-29T01:59:57.970252+0000","last_became_peered":"2023-07-29T01:59:57.970252+0000","last_unstale":"2023-07-29T02:00:01.972541+0000","last_undegraded":"2023-07-29T02:00:01.972541+0000","last_fullsized":"2023-07-29T02:00:01.972541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:09.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399784+0000","last_change":"2023-07-29T02:00:01.989885+0000","last_active":"2023-07-29T02:00:02.399784+0000","last_peered":"2023-07-29T02:00:02.399784+0000","last_clean":"2023-07-29T02:00:02.399784+0000","last_became_active":"2023-07-29T02:00:01.989481+0000","last_became_peered":"2023-07-29T02:00:01.989481+0000","last_unstale":"2023-07-29T02:00:02.399784+0000","last_undegraded":"2023-07-29T02:00:02.399784+0000","last_fullsized":"2023-07-29T02:00:02.399784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957691+0000","last_change":"2023-07-29T01:59:57.543782+0000","last_active":"2023-07-29T02:00:02.957691+0000","last_peered":"2023-07-29T02:00:02.957691+0000","last_clean":"2023-07-29T02:00:02.957691+0000","last_became_active":"2023-07-29T01:59:57.543445+0000","last_became_peered":"2023-07-29T01:59:57.543445+0000","last_unstale":"2023-07-29T02:00:02.957691+0000","last_undegraded":"2023-07-29T02:00:02.957691+0000","last_fullsized":"2023-07-29T02:00:02.957691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.970956+0000","last_change":"2023-07-29T01:59:57.965177+0000","last_active":"2023-07-29T02:00:01.970956+0000","last_peered":"2023-07-29T02:00:01.970956+0000","last_clean":"2023-07-29T02:00:01.970956+0000","last_became_active":"2023-07-29T01:59:57.964925+0000","last_became_peered":"2023-07-29T01:59:57.964925+0000","last_unstale":"2023-07-29T02:00:01.970956+0000","last_undegraded":"2023-07-29T02:00:01.970956+0000","last_fullsized":"2023-07-29T02:00:01.970956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401320+0000","last_change":"2023-07-29T02:00:01.985786+0000","last_active":"2023-07-29T02:00:02.401320+0000","last_peered":"2023-07-29T02:00:02.401320+0000","last_clean":"2023-07-29T02:00:02.401320+0000","last_became_active":"2023-07-29T02:00:01.985310+0000","last_became_peered":"2023-07-29T02:00:01.985310+0000","last_unstale":"2023-07-29T02:00:02.401320+0000","last_undegraded":"2023-07-29T02:00:02.401320+0000","last_fullsized":"2023-07-29T02:00:02.401320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957725+0000","last_change":"2023-07-29T01:59:57.541908+0000","last_active":"2023-07-29T02:00:02.957725+0000","last_peered":"2023-07-29T02:00:02.957725+0000","last_clean":"2023-07-29T02:00:02.957725+0000","last_became_active":"2023-07-29T01:59:57.541633+0000","last_became_peered":"2023-07-29T01:59:57.541633+0000","last_unstale":"2023-07-29T02:00:02.957725+0000","last_undegraded":"2023-07-29T02:00:02.957725+0000","last_fullsized":"2023-07-29T02:00:02.957725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.970785+0000","last_change":"2023-07-29T01:59:57.965915+0000","last_active":"2023-07-29T02:00:01.970785+0000","last_peered":"2023-07-29T02:00:01.970785+0000","last_clean":"2023-07-29T02:00:01.970785+0000","last_became_active":"2023-07-29T01:59:57.965383+0000","last_became_peered":"2023-07-29T01:59:57.965383+0000","last_unstale":"2023-07-29T02:00:01.970785+0000","last_undegraded":"2023-07-29T02:00:01.970785+0000","last_fullsized":"2023-07-29T02:00:01.970785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.398445+0000","last_change":"2023-07-29T02:00:01.994436+0000","last_active":"2023-07-29T02:00:02.398445+0000","last_peered":"2023-07-29T02:00:02.398445+0000","last_clean":"2023-07-29T02:00:02.398445+0000","last_became_active":"2023-07-29T02:00:01.993454+0000","last_became_peered":"2023-07-29T02:00:01.993454+0000","last_unstale":"2023-07-29T02:00:02.398445+0000","last_undegraded":"2023-07-29T02:00:02.398445+0000","last_fullsized":"2023-07-29T02:00:02.398445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:46.998657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441131+0000","last_change":"2023-07-29T01:59:57.539625+0000","last_active":"2023-07-29T02:00:02.441131+0000","last_peered":"2023-07-29T02:00:02.441131+0000","last_clean":"2023-07-29T02:00:02.441131+0000","last_became_active":"2023-07-29T01:59:57.539181+0000","last_became_peered":"2023-07-29T01:59:57.539181+0000","last_unstale":"2023-07-29T02:00:02.441131+0000","last_undegraded":"2023-07-29T02:00:02.441131+0000","last_fullsized":"2023-07-29T02:00:02.441131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:02:57.137574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979518+0000","last_change":"2023-07-29T01:59:57.966812+0000","last_active":"2023-07-29T02:00:01.979518+0000","last_peered":"2023-07-29T02:00:01.979518+0000","last_clean":"2023-07-29T02:00:01.979518+0000","last_became_active":"2023-07-29T01:59:57.966580+0000","last_became_peered":"2023-07-29T01:59:57.966580+0000","last_unstale":"2023-07-29T02:00:01.979518+0000","last_undegraded":"2023-07-29T02:00:01.979518+0000","last_fullsized":"2023-07-29T02:00:01.979518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.203628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439475+0000","last_change":"2023-07-29T02:00:01.985984+0000","last_active":"2023-07-29T02:00:02.439475+0000","last_peered":"2023-07-29T02:00:02.439475+0000","last_clean":"2023-07-29T02:00:02.439475+0000","last_became_active":"2023-07-29T02:00:01.985554+0000","last_became_peered":"2023-07-29T02:00:01.985554+0000","last_unstale":"2023-07-29T02:00:02.439475+0000","last_undegraded":"2023-07-29T02:00:02.439475+0000","last_fullsized":"2023-07-29T02:00:02.439475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:50:50.164635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957483+0000","last_change":"2023-07-29T01:59:57.537754+0000","last_active":"2023-07-29T02:00:02.957483+0000","last_peered":"2023-07-29T02:00:02.957483+0000","last_clean":"2023-07-29T02:00:02.957483+0000","last_became_active":"2023-07-29T01:59:57.537457+0000","last_became_peered":"2023-07-29T01:59:57.537457+0000","last_unstale":"2023-07-29T02:00:02.957483+0000","last_undegraded":"2023-07-29T02:00:02.957483+0000","last_fullsized":"2023-07-29T02:00:02.957483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975481+0000","last_change":"2023-07-29T01:59:57.960633+0000","last_active":"2023-07-29T02:00:01.975481+0000","last_peered":"2023-07-29T02:00:01.975481+0000","last_clean":"2023-07-29T02:00:01.975481+0000","last_became_active":"2023-07-29T01:59:57.960318+0000","last_became_peered":"2023-07-29T01:59:57.960318+0000","last_unstale":"2023-07-29T02:00:01.975481+0000","last_undegraded":"2023-07-29T02:00:01.975481+0000","last_fullsized":"2023-07-29T02:00:01.975481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:01:11.408184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967878+0000","last_change":"2023-07-29T01:59:57.960826+0000","last_active":"2023-07-29T02:00:01.967878+0000","last_peered":"2023-07-29T02:00:01.967878+0000","last_clean":"2023-07-29T02:00:01.967878+0000","last_became_active":"2023-07-29T01:59:57.959960+0000","last_became_peered":"2023-07-29T01:59:57.959960+0000","last_unstale":"2023-07-29T02:00:01.967878+0000","last_undegraded":"2023-07-29T02:00:01.967878+0000","last_fullsized":"2023-07-29T02:00:01.967878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979718+0000","last_change":"2023-07-29T01:59:57.976560+0000","last_active":"2023-07-29T02:00:01.979718+0000","last_peered":"2023-07-29T02:00:01.979718+0000","last_clean":"2023-07-29T02:00:01.979718+0000","last_became_active":"2023-07-29T01:59:57.975384+0000","last_became_peered":"2023-07-29T01:59:57.975384+0000","last_unstale":"2023-07-29T02:00:01.979718+0000","last_undegraded":"2023-07-29T02:00:01.979718+0000","last_fullsized":"2023-07-29T02:00:01.979718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971237+0000","last_change":"2023-07-29T01:59:57.967891+0000","last_active":"2023-07-29T02:00:01.971237+0000","last_peered":"2023-07-29T02:00:01.971237+0000","last_clean":"2023-07-29T02:00:01.971237+0000","last_became_active":"2023-07-29T01:59:57.967603+0000","last_became_peered":"2023-07-29T01:59:57.967603+0000","last_unstale":"2023-07-29T02:00:01.971237+0000","last_undegraded":"2023-07-29T02:00:01.971237+0000","last_fullsized":"2023-07-29T02:00:01.971237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:24:00.439433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978571+0000","last_change":"2023-07-29T01:59:57.966922+0000","last_active":"2023-07-29T02:00:01.978571+0000","last_peered":"2023-07-29T02:00:01.978571+0000","last_clean":"2023-07-29T02:00:01.978571+0000","last_became_active":"2023-07-29T01:59:57.966672+0000","last_became_peered":"2023-07-29T01:59:57.966672+0000","last_unstale":"2023-07-29T02:00:01.978571+0000","last_undegraded":"2023-07-29T02:00:01.978571+0000","last_fullsized":"2023-07-29T02:00:01.978571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972636+0000","last_change":"2023-07-29T01:59:57.968727+0000","last_active":"2023-07-29T02:00:01.972636+0000","last_peered":"2023-07-29T02:00:01.972636+0000","last_clean":"2023-07-29T02:00:01.972636+0000","last_became_active":"2023-07-29T01:59:57.968449+0000","last_became_peered":"2023-07-29T01:59:57.968449+0000","last_unstale":"2023-07-29T02:00:01.972636+0000","last_undegraded":"2023-07-29T02:00:01.972636+0000","last_fullsized":"2023-07-29T02:00:01.972636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4589,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":703776,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":331776,"data_stored":699769,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":109983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":108530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":113248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":110053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T02:00:27.967 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-29T02:00:27.967 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-29T02:00:27.967 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-29T02:00:27.968 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-29T02:00:27.968 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-29T02:00:28.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.137+0000 7f41ee4c4700 1 Processor -- start 2023-07-29T02:00:28.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.137+0000 7f41ee4c4700 1 -- start start 2023-07-29T02:00:28.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.138+0000 7f41ee4c4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e8072a90 0x7f41e806d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:28.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.138+0000 7f41ee4c4700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e8159310 con 0x7f41e8156740 2023-07-29T02:00:28.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.138+0000 7f41ee4c4700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e806d960 con 0x7f41e8159eb0 2023-07-29T02:00:28.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.138+0000 7f41ee4c4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e806a850 con 0x7f41e8072a90 2023-07-29T02:00:28.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.138+0000 7f41e7fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f41e8156740 0x7f41e81597a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:49970/0 (socket says 172.21.15.42:49970) 2023-07-29T02:00:28.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.138+0000 7f41e7fff700 1 -- 172.21.15.42:0/2000743049 learned_addr learned my addr 172.21.15.42:0/2000743049 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:28.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.138+0000 7f41eca61700 1 --2- 172.21.15.42:0/2000743049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e8072a90 0x7f41e806d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:28.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.139+0000 7f41e6ffd700 1 -- 172.21.15.42:0/2000743049 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146771742 0 0) 0x7f41e8159310 con 0x7f41e8156740 2023-07-29T02:00:28.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.139+0000 7f41e6ffd700 1 -- 172.21.15.42:0/2000743049 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41d00035b0 con 0x7f41e8156740 2023-07-29T02:00:28.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.139+0000 7f41e6ffd700 1 -- 172.21.15.42:0/2000743049 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802290549 0 0) 0x7f41e806d960 con 0x7f41e8159eb0 2023-07-29T02:00:28.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.139+0000 7f41e6ffd700 1 -- 172.21.15.42:0/2000743049 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41e8159310 con 0x7f41e8159eb0 2023-07-29T02:00:28.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.139+0000 7f41eca61700 1 -- 172.21.15.42:0/2000743049 >> v1:172.21.15.144:6789/0 conn(0x7f41e8159eb0 legacy=0x7f41e806cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:28.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.139+0000 7f41eca61700 1 -- 172.21.15.42:0/2000743049 >> v1:172.21.15.42:6789/0 conn(0x7f41e8156740 legacy=0x7f41e81597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:28.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.139+0000 7f41eca61700 1 -- 172.21.15.42:0/2000743049 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e806bea0 con 0x7f41e8072a90 2023-07-29T02:00:28.129 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.139+0000 7f41eca61700 1 --2- 172.21.15.42:0/2000743049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e8072a90 0x7f41e806d420 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f41e806c090 tx=0x7f41e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9f681e545bd7d51 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:28.129 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.139+0000 7f41e6ffd700 1 -- 172.21.15.42:0/2000743049 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e0016070 con 0x7f41e8072a90 2023-07-29T02:00:28.129 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.139+0000 7f41e6ffd700 1 -- 172.21.15.42:0/2000743049 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e000bb20 con 0x7f41e8072a90 2023-07-29T02:00:28.129 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.139+0000 7f41e6ffd700 1 -- 172.21.15.42:0/2000743049 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e000e070 con 0x7f41e8072a90 2023-07-29T02:00:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.140+0000 7f41ee4c4700 1 -- 172.21.15.42:0/2000743049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e8072a90 msgr2=0x7f41e806d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.140+0000 7f41ee4c4700 1 --2- 172.21.15.42:0/2000743049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e8072a90 0x7f41e806d420 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f41e806c090 tx=0x7f41e000b330 comp rx=0 tx=0).stop 2023-07-29T02:00:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.140+0000 7f41ee4c4700 1 -- 172.21.15.42:0/2000743049 shutdown_connections 2023-07-29T02:00:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.140+0000 7f41ee4c4700 1 --2- 172.21.15.42:0/2000743049 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e8072a90 0x7f41e806d420 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.140+0000 7f41ee4c4700 1 -- 172.21.15.42:0/2000743049 >> 172.21.15.42:0/2000743049 conn(0x7f41e80c8970 msgr2=0x7f41e80c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:28.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.140+0000 7f41ee4c4700 1 -- 172.21.15.42:0/2000743049 shutdown_connections 2023-07-29T02:00:28.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.140+0000 7f41ee4c4700 1 -- 172.21.15.42:0/2000743049 wait complete. 2023-07-29T02:00:28.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.141+0000 7f41ee4c4700 1 Processor -- start 2023-07-29T02:00:28.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.142+0000 7f41ee4c4700 1 -- start start 2023-07-29T02:00:28.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.142+0000 7f41ee4c4700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41e8072a90 0x7f41e80c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:28.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41ee4c4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41e8156740 0x7f41e8157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:28.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41ee4c4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e8159eb0 0x7f41e81ef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:28.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41ee4c4700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e81eeea0 con 0x7f41e8072a90 2023-07-29T02:00:28.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41ee4c4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e8071b30 con 0x7f41e8156740 2023-07-29T02:00:28.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41ee4c4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e815a6f0 con 0x7f41e8159eb0 2023-07-29T02:00:28.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41e7fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41e8072a90 0x7f41e80c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:28.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41e7fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41e8072a90 0x7f41e80c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56172/0 (socket says 172.21.15.42:56172) 2023-07-29T02:00:28.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41e7fff700 1 -- 172.21.15.42:0/4085162837 learned_addr learned my addr 172.21.15.42:0/4085162837 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:28.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41eca61700 1 --2- 172.21.15.42:0/4085162837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e8159eb0 0x7f41e81ef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:28.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41e77fe700 1 --2- 172.21.15.42:0/4085162837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41e8156740 0x7f41e8157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:28.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41e7fff700 1 -- 172.21.15.42:0/4085162837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e8159eb0 msgr2=0x7f41e81ef2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:28.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41e7fff700 1 --2- 172.21.15.42:0/4085162837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e8159eb0 0x7f41e81ef2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41e7fff700 1 -- 172.21.15.42:0/4085162837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41e8156740 msgr2=0x7f41e8157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:28.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41e7fff700 1 --2- 172.21.15.42:0/4085162837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41e8156740 0x7f41e8157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41e7fff700 1 -- 172.21.15.42:0/4085162837 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e0009a70 con 0x7f41e8072a90 2023-07-29T02:00:28.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41eca61700 1 --2- 172.21.15.42:0/4085162837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e8159eb0 0x7f41e81ef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:28.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41e77fe700 1 --2- 172.21.15.42:0/4085162837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41e8156740 0x7f41e8157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:28.135 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41e7fff700 1 --2- 172.21.15.42:0/4085162837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41e8072a90 0x7f41e80c5f20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f41d800c500 tx=0x7f41d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:28.135 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41e4ff9700 1 -- 172.21.15.42:0/4085162837 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8005d70 con 0x7f41e8072a90 2023-07-29T02:00:28.135 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41e4ff9700 1 -- 172.21.15.42:0/4085162837 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d80070d0 con 0x7f41e8072a90 2023-07-29T02:00:28.135 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41ee4c4700 1 -- 172.21.15.42:0/4085162837 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e81eeae0 con 0x7f41e8072a90 2023-07-29T02:00:28.135 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41e4ff9700 1 -- 172.21.15.42:0/4085162837 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8007460 con 0x7f41e8072a90 2023-07-29T02:00:28.135 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.143+0000 7f41ee4c4700 1 -- 172.21.15.42:0/4085162837 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e81f2820 con 0x7f41e8072a90 2023-07-29T02:00:28.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.144+0000 7f41ee4c4700 1 -- 172.21.15.42:0/4085162837 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e8074740 con 0x7f41e8072a90 2023-07-29T02:00:28.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.145+0000 7f41e4ff9700 1 -- 172.21.15.42:0/4085162837 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f41d80075c0 con 0x7f41e8072a90 2023-07-29T02:00:28.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.145+0000 7f41e4ff9700 1 --2- 172.21.15.42:0/4085162837 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f41d406a660 0x7f41d406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:28.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.145+0000 7f41e4ff9700 1 -- 172.21.15.42:0/4085162837 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f41d8088480 con 0x7f41e8072a90 2023-07-29T02:00:28.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.146+0000 7f41e77fe700 1 --2- 172.21.15.42:0/4085162837 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f41d406a660 0x7f41d406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:28.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.146+0000 7f41e77fe700 1 --2- 172.21.15.42:0/4085162837 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f41d406a660 0x7f41d406cb10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f41dc007fd0 tx=0x7f41dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:28.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.150+0000 7f41e4ff9700 1 -- 172.21.15.42:0/4085162837 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f41d80533e0 con 0x7f41e8072a90 2023-07-29T02:00:28.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.411+0000 7f41ee4c4700 1 -- 172.21.15.42:0/4085162837 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f41e81ef110 con 0x7f41e8072a90 2023-07-29T02:00:28.401 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.414+0000 7f41e4ff9700 1 -- 172.21.15.42:0/4085162837 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169787 (secure 0 0 0) 0x7f41d8017020 con 0x7f41e8072a90 2023-07-29T02:00:28.403 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:28.404 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.417+0000 7f41ee4c4700 1 -- 172.21.15.42:0/4085162837 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f41d406a660 msgr2=0x7f41d406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:28.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.417+0000 7f41ee4c4700 1 --2- 172.21.15.42:0/4085162837 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f41d406a660 0x7f41d406cb10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f41dc007fd0 tx=0x7f41dc009040 comp rx=0 tx=0).stop 2023-07-29T02:00:28.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.417+0000 7f41ee4c4700 1 -- 172.21.15.42:0/4085162837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41e8072a90 msgr2=0x7f41e80c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:28.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.417+0000 7f41ee4c4700 1 --2- 172.21.15.42:0/4085162837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41e8072a90 0x7f41e80c5f20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f41d800c500 tx=0x7f41d800c8c0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.417+0000 7f41ee4c4700 1 -- 172.21.15.42:0/4085162837 shutdown_connections 2023-07-29T02:00:28.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.417+0000 7f41ee4c4700 1 --2- 172.21.15.42:0/4085162837 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f41d406a660 0x7f41d406cb10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.417+0000 7f41ee4c4700 1 --2- 172.21.15.42:0/4085162837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f41e8159eb0 0x7f41e81ef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.417+0000 7f41ee4c4700 1 --2- 172.21.15.42:0/4085162837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f41e8072a90 0x7f41e80c5f20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.406 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.417+0000 7f41ee4c4700 1 --2- 172.21.15.42:0/4085162837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f41e8156740 0x7f41e8157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.406 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.417+0000 7f41ee4c4700 1 -- 172.21.15.42:0/4085162837 >> 172.21.15.42:0/4085162837 conn(0x7f41e80c8970 msgr2=0x7f41e8155350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:28.406 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.417+0000 7f41ee4c4700 1 -- 172.21.15.42:0/4085162837 shutdown_connections 2023-07-29T02:00:28.406 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.417+0000 7f41ee4c4700 1 -- 172.21.15.42:0/4085162837 wait complete. 2023-07-29T02:00:28.416 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":130830},{"type":"v1","addr":"172.21.15.144:6833","nonce":130830}]},"active_addr":"172.21.15.144:6833/130830","active_change":"2023-07-29T01:59:45.218701+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":2483839694}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":987768986}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":569278600}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.144:0","nonce":4198756772}]}]} 2023-07-29T02:00:28.421 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-29T02:00:28.421 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-29T02:00:28.421 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T02:00:28.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.559+0000 7efdad6be700 1 Processor -- start 2023-07-29T02:00:28.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.559+0000 7efdad6be700 1 -- start start 2023-07-29T02:00:28.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.560+0000 7efdad6be700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efda81535c0 0x7efda80c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:28.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.560+0000 7efdad6be700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efda80ca060 0x7efda80cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:28.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.560+0000 7efdad6be700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efda80cf6b0 0x7efda8159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:28.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.560+0000 7efdad6be700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda8153990 con 0x7efda81535c0 2023-07-29T02:00:28.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.560+0000 7efdad6be700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda80c5a10 con 0x7efda80ca060 2023-07-29T02:00:28.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.560+0000 7efdad6be700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda815c760 con 0x7efda80cf6b0 2023-07-29T02:00:28.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.560+0000 7efda6ffd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efda81535c0 0x7efda80c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:28.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.560+0000 7efda6ffd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efda81535c0 0x7efda80c54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56180/0 (socket says 172.21.15.42:56180) 2023-07-29T02:00:28.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.560+0000 7efda6ffd700 1 -- 172.21.15.42:0/2531462669 learned_addr learned my addr 172.21.15.42:0/2531462669 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:28.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.560+0000 7efda67fc700 1 --2- 172.21.15.42:0/2531462669 >> v2:172.21.15.144:3300/0 conn(0x7efda80ca060 0x7efda80cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:28.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.560+0000 7efda77fe700 1 --2- 172.21.15.42:0/2531462669 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efda80cf6b0 0x7efda8159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:28.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.560+0000 7efda6ffd700 1 -- 172.21.15.42:0/2531462669 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efda80cf6b0 msgr2=0x7efda8159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:28.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.560+0000 7efda6ffd700 1 --2- 172.21.15.42:0/2531462669 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efda80cf6b0 0x7efda8159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.560+0000 7efda6ffd700 1 -- 172.21.15.42:0/2531462669 >> v2:172.21.15.144:3300/0 conn(0x7efda80ca060 msgr2=0x7efda80cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:28.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.560+0000 7efda6ffd700 1 --2- 172.21.15.42:0/2531462669 >> v2:172.21.15.144:3300/0 conn(0x7efda80ca060 0x7efda80cf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.560+0000 7efda6ffd700 1 -- 172.21.15.42:0/2531462669 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda815ca00 con 0x7efda81535c0 2023-07-29T02:00:28.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.560+0000 7efda6ffd700 1 --2- 172.21.15.42:0/2531462669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efda81535c0 0x7efda80c54d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efda808cdf0 tx=0x7efd9c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac3b64922de211b server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:28.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.560+0000 7efda5ffb700 1 -- 172.21.15.42:0/2531462669 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c00b870 con 0x7efda81535c0 2023-07-29T02:00:28.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.561+0000 7efda5ffb700 1 -- 172.21.15.42:0/2531462669 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c00b9d0 con 0x7efda81535c0 2023-07-29T02:00:28.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.561+0000 7efda5ffb700 1 -- 172.21.15.42:0/2531462669 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c00bd60 con 0x7efda81535c0 2023-07-29T02:00:28.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.561+0000 7efdad6be700 1 -- 172.21.15.42:0/2531462669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efda81535c0 msgr2=0x7efda80c54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:28.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.561+0000 7efdad6be700 1 --2- 172.21.15.42:0/2531462669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efda81535c0 0x7efda80c54d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7efda808cdf0 tx=0x7efd9c009bd0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.561+0000 7efdad6be700 1 -- 172.21.15.42:0/2531462669 shutdown_connections 2023-07-29T02:00:28.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.561+0000 7efdad6be700 1 --2- 172.21.15.42:0/2531462669 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efda80cf6b0 0x7efda8159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.561+0000 7efdad6be700 1 --2- 172.21.15.42:0/2531462669 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efda81535c0 0x7efda80c54d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.561+0000 7efdad6be700 1 --2- 172.21.15.42:0/2531462669 >> v2:172.21.15.144:3300/0 conn(0x7efda80ca060 0x7efda80cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.561+0000 7efdad6be700 1 -- 172.21.15.42:0/2531462669 >> 172.21.15.42:0/2531462669 conn(0x7efda806cac0 msgr2=0x7efda806cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:28.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.561+0000 7efdad6be700 1 -- 172.21.15.42:0/2531462669 shutdown_connections 2023-07-29T02:00:28.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.561+0000 7efdad6be700 1 -- 172.21.15.42:0/2531462669 wait complete. 2023-07-29T02:00:28.555 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.562+0000 7efdad6be700 1 Processor -- start 2023-07-29T02:00:28.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.563+0000 7efdad6be700 1 -- start start 2023-07-29T02:00:28.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.563+0000 7efdad6be700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efda80ca060 0x7efda8158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:28.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.563+0000 7efdad6be700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda80cf6b0 0x7efda814ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:28.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.563+0000 7efdad6be700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efda81535c0 0x7efda814f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:28.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.563+0000 7efdad6be700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda81ef0a0 con 0x7efda81535c0 2023-07-29T02:00:28.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.563+0000 7efdad6be700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda81f0070 con 0x7efda80cf6b0 2023-07-29T02:00:28.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.563+0000 7efdad6be700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda80cf160 con 0x7efda80ca060 2023-07-29T02:00:28.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.563+0000 7efda77fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efda81535c0 0x7efda814f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:28.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.563+0000 7efda77fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efda81535c0 0x7efda814f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56190/0 (socket says 172.21.15.42:56190) 2023-07-29T02:00:28.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.563+0000 7efda77fe700 1 -- 172.21.15.42:0/168342394 learned_addr learned my addr 172.21.15.42:0/168342394 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:28.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.564+0000 7efda67fc700 1 --2- 172.21.15.42:0/168342394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda80cf6b0 0x7efda814ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:28.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.564+0000 7efda6ffd700 1 --2- 172.21.15.42:0/168342394 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efda80ca060 0x7efda8158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:28.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.564+0000 7efda77fe700 1 -- 172.21.15.42:0/168342394 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efda80ca060 msgr2=0x7efda8158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:28.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.564+0000 7efda77fe700 1 --2- 172.21.15.42:0/168342394 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efda80ca060 0x7efda8158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.564+0000 7efda77fe700 1 -- 172.21.15.42:0/168342394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda80cf6b0 msgr2=0x7efda814ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:28.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.564+0000 7efda77fe700 1 --2- 172.21.15.42:0/168342394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda80cf6b0 0x7efda814ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.564+0000 7efda77fe700 1 -- 172.21.15.42:0/168342394 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9c009550 con 0x7efda81535c0 2023-07-29T02:00:28.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.564+0000 7efda77fe700 1 --2- 172.21.15.42:0/168342394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efda81535c0 0x7efda814f190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efda0007e60 tx=0x7efda000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:28.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.564+0000 7efd8f7fe700 1 -- 172.21.15.42:0/168342394 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda000ed80 con 0x7efda81535c0 2023-07-29T02:00:28.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.564+0000 7efd8f7fe700 1 -- 172.21.15.42:0/168342394 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda0014420 con 0x7efda81535c0 2023-07-29T02:00:28.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.564+0000 7efdad6be700 1 -- 172.21.15.42:0/168342394 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda81efbe0 con 0x7efda81535c0 2023-07-29T02:00:28.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.564+0000 7efd8f7fe700 1 -- 172.21.15.42:0/168342394 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda00147d0 con 0x7efda81535c0 2023-07-29T02:00:28.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.564+0000 7efdad6be700 1 -- 172.21.15.42:0/168342394 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda81ef2b0 con 0x7efda81535c0 2023-07-29T02:00:28.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.565+0000 7efdad6be700 1 -- 172.21.15.42:0/168342394 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda80c6260 con 0x7efda81535c0 2023-07-29T02:00:28.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.565+0000 7efd8f7fe700 1 -- 172.21.15.42:0/168342394 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7efda0014930 con 0x7efda81535c0 2023-07-29T02:00:28.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.566+0000 7efd8f7fe700 1 --2- 172.21.15.42:0/168342394 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efd9406a690 0x7efd9406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:28.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.566+0000 7efd8f7fe700 1 -- 172.21.15.42:0/168342394 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efda0089490 con 0x7efda81535c0 2023-07-29T02:00:28.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.566+0000 7efda6ffd700 1 --2- 172.21.15.42:0/168342394 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efd9406a690 0x7efd9406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:28.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.566+0000 7efda6ffd700 1 --2- 172.21.15.42:0/168342394 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efd9406a690 0x7efd9406cb40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efd9c014040 tx=0x7efd9c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:28.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.570+0000 7efd8f7fe700 1 -- 172.21.15.42:0/168342394 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7efda00545c0 con 0x7efda81535c0 2023-07-29T02:00:28.760 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.772+0000 7efdad6be700 1 -- 172.21.15.42:0/168342394 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efda80cfdc0 con 0x7efda81535c0 2023-07-29T02:00:28.761 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.773+0000 7efd8f7fe700 1 -- 172.21.15.42:0/168342394 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19690 (secure 0 0 0) 0x7efda0057be0 con 0x7efda81535c0 2023-07-29T02:00:28.761 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:28.762 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T02:00:02.394460+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T01:59:55.827461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T01:59:56.924040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-29T01:59:59.996470+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T02:00:28.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.776+0000 7efdad6be700 1 -- 172.21.15.42:0/168342394 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efd9406a690 msgr2=0x7efd9406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:28.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.776+0000 7efdad6be700 1 --2- 172.21.15.42:0/168342394 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efd9406a690 0x7efd9406cb40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efd9c014040 tx=0x7efd9c008030 comp rx=0 tx=0).stop 2023-07-29T02:00:28.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.776+0000 7efdad6be700 1 -- 172.21.15.42:0/168342394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efda81535c0 msgr2=0x7efda814f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:28.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.776+0000 7efdad6be700 1 --2- 172.21.15.42:0/168342394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efda81535c0 0x7efda814f190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efda0007e60 tx=0x7efda000e3c0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.776+0000 7efdad6be700 1 -- 172.21.15.42:0/168342394 shutdown_connections 2023-07-29T02:00:28.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.776+0000 7efdad6be700 1 --2- 172.21.15.42:0/168342394 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efd9406a690 0x7efd9406cb40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.776+0000 7efdad6be700 1 --2- 172.21.15.42:0/168342394 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efda81535c0 0x7efda814f190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.776+0000 7efdad6be700 1 --2- 172.21.15.42:0/168342394 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efda80ca060 0x7efda8158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.776+0000 7efdad6be700 1 --2- 172.21.15.42:0/168342394 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efda80cf6b0 0x7efda814ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.776+0000 7efdad6be700 1 -- 172.21.15.42:0/168342394 >> 172.21.15.42:0/168342394 conn(0x7efda806cac0 msgr2=0x7efda8061190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:28.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.776+0000 7efdad6be700 1 -- 172.21.15.42:0/168342394 shutdown_connections 2023-07-29T02:00:28.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.776+0000 7efdad6be700 1 -- 172.21.15.42:0/168342394 wait complete. 2023-07-29T02:00:28.776 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-29T02:00:28.776 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T02:00:28.901 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.913+0000 7fc0895dc700 1 Processor -- start 2023-07-29T02:00:28.901 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.913+0000 7fc0895dc700 1 -- start start 2023-07-29T02:00:28.903 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.914+0000 7fc0895dc700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc0840cf460 0x7fc0840b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:28.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.914+0000 7fc0895dc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc084159cb0 0x7fc08415a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:28.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.914+0000 7fc0895dc700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0840b31d0 con 0x7fc0840cf830 2023-07-29T02:00:28.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.914+0000 7fc0895dc700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0840b3660 con 0x7fc0840cf460 2023-07-29T02:00:28.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.914+0000 7fc0895dc700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08415a1a0 con 0x7fc084159cb0 2023-07-29T02:00:28.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.914+0000 7fc082ffd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc0840cf460 0x7fc0840b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:28.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.914+0000 7fc082ffd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc0840cf460 0x7fc0840b4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56194/0 (socket says 172.21.15.42:56194) 2023-07-29T02:00:28.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.914+0000 7fc082ffd700 1 -- 172.21.15.42:0/3492019449 learned_addr learned my addr 172.21.15.42:0/3492019449 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:28.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.914+0000 7fc0827fc700 1 --2- 172.21.15.42:0/3492019449 >> v2:172.21.15.144:3300/0 conn(0x7fc084159cb0 0x7fc08415a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:28.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.914+0000 7fc082ffd700 1 -- 172.21.15.42:0/3492019449 >> v2:172.21.15.144:3300/0 conn(0x7fc084159cb0 msgr2=0x7fc08415a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:28.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.914+0000 7fc082ffd700 1 --2- 172.21.15.42:0/3492019449 >> v2:172.21.15.144:3300/0 conn(0x7fc084159cb0 0x7fc08415a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.914+0000 7fc082ffd700 1 -- 172.21.15.42:0/3492019449 >> v1:172.21.15.144:6789/0 conn(0x7fc0840cf830 legacy=0x7fc0841563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:28.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.914+0000 7fc082ffd700 1 -- 172.21.15.42:0/3492019449 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0840b2600 con 0x7fc0840cf460 2023-07-29T02:00:28.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.914+0000 7fc0827fc700 1 --2- 172.21.15.42:0/3492019449 >> v2:172.21.15.144:3300/0 conn(0x7fc084159cb0 0x7fc08415a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:28.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.915+0000 7fc082ffd700 1 --2- 172.21.15.42:0/3492019449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0840cf460 0x7fc0840b4c30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc0840c9090 tx=0x7fc078009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad825c73dd00d4b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:28.906 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.915+0000 7fc081ffb700 1 -- 172.21.15.42:0/3492019449 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078004230 con 0x7fc0840cf460 2023-07-29T02:00:28.906 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.915+0000 7fc081ffb700 1 -- 172.21.15.42:0/3492019449 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc078004390 con 0x7fc0840cf460 2023-07-29T02:00:28.906 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.915+0000 7fc081ffb700 1 -- 172.21.15.42:0/3492019449 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0780036a0 con 0x7fc0840cf460 2023-07-29T02:00:28.906 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.915+0000 7fc0895dc700 1 -- 172.21.15.42:0/3492019449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0840cf460 msgr2=0x7fc0840b4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:28.906 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.915+0000 7fc0895dc700 1 --2- 172.21.15.42:0/3492019449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0840cf460 0x7fc0840b4c30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc0840c9090 tx=0x7fc078009bd0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.906 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.915+0000 7fc0895dc700 1 -- 172.21.15.42:0/3492019449 shutdown_connections 2023-07-29T02:00:28.906 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.915+0000 7fc0895dc700 1 --2- 172.21.15.42:0/3492019449 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0840cf460 0x7fc0840b4c30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.907 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.915+0000 7fc0895dc700 1 --2- 172.21.15.42:0/3492019449 >> v2:172.21.15.144:3300/0 conn(0x7fc084159cb0 0x7fc08415a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.907 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.915+0000 7fc0895dc700 1 -- 172.21.15.42:0/3492019449 >> 172.21.15.42:0/3492019449 conn(0x7fc08406ca60 msgr2=0x7fc08406ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:28.907 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.915+0000 7fc0895dc700 1 -- 172.21.15.42:0/3492019449 shutdown_connections 2023-07-29T02:00:28.907 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.915+0000 7fc0895dc700 1 -- 172.21.15.42:0/3492019449 wait complete. 2023-07-29T02:00:28.909 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.917+0000 7fc0895dc700 1 Processor -- start 2023-07-29T02:00:28.909 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.917+0000 7fc0895dc700 1 -- start start 2023-07-29T02:00:28.910 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.917+0000 7fc0895dc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0840cf460 0x7fc0841ef1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:28.910 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.917+0000 7fc0895dc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0840cf830 0x7fc084153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:28.910 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.917+0000 7fc0895dc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc084159cb0 0x7fc0840cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:28.910 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.917+0000 7fc0895dc700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0841f2670 con 0x7fc0840cf460 2023-07-29T02:00:28.910 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.917+0000 7fc0895dc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0841ef730 con 0x7fc084159cb0 2023-07-29T02:00:28.910 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.917+0000 7fc0895dc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0841f1d60 con 0x7fc0840cf830 2023-07-29T02:00:28.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.918+0000 7fc082ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0840cf460 0x7fc0841ef1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:28.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.918+0000 7fc082ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0840cf460 0x7fc0841ef1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56196/0 (socket says 172.21.15.42:56196) 2023-07-29T02:00:28.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.918+0000 7fc082ffd700 1 -- 172.21.15.42:0/3304735897 learned_addr learned my addr 172.21.15.42:0/3304735897 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:28.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.918+0000 7fc0827fc700 1 --2- 172.21.15.42:0/3304735897 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0840cf830 0x7fc084153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:28.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.918+0000 7fc0837fe700 1 --2- 172.21.15.42:0/3304735897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc084159cb0 0x7fc0840cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:28.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.918+0000 7fc082ffd700 1 -- 172.21.15.42:0/3304735897 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0840cf830 msgr2=0x7fc084153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:28.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.918+0000 7fc082ffd700 1 --2- 172.21.15.42:0/3304735897 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0840cf830 0x7fc084153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.918+0000 7fc082ffd700 1 -- 172.21.15.42:0/3304735897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc084159cb0 msgr2=0x7fc0840cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:28.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.918+0000 7fc082ffd700 1 --2- 172.21.15.42:0/3304735897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc084159cb0 0x7fc0840cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:28.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.918+0000 7fc082ffd700 1 -- 172.21.15.42:0/3304735897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc078009550 con 0x7fc0840cf460 2023-07-29T02:00:28.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.918+0000 7fc082ffd700 1 --2- 172.21.15.42:0/3304735897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0840cf460 0x7fc0841ef1f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc078009fd0 tx=0x7fc078004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:28.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.918+0000 7fc06b7fe700 1 -- 172.21.15.42:0/3304735897 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078003e20 con 0x7fc0840cf460 2023-07-29T02:00:28.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.918+0000 7fc06b7fe700 1 -- 172.21.15.42:0/3304735897 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc078011630 con 0x7fc0840cf460 2023-07-29T02:00:28.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.918+0000 7fc0895dc700 1 -- 172.21.15.42:0/3304735897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0841e3140 con 0x7fc0840cf460 2023-07-29T02:00:28.913 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.918+0000 7fc06b7fe700 1 -- 172.21.15.42:0/3304735897 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0780119e0 con 0x7fc0840cf460 2023-07-29T02:00:28.913 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.918+0000 7fc0895dc700 1 -- 172.21.15.42:0/3304735897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0841f2020 con 0x7fc0840cf460 2023-07-29T02:00:28.913 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.919+0000 7fc0895dc700 1 -- 172.21.15.42:0/3304735897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0840c98b0 con 0x7fc0840cf460 2023-07-29T02:00:28.913 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.920+0000 7fc06b7fe700 1 -- 172.21.15.42:0/3304735897 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fc078011b40 con 0x7fc0840cf460 2023-07-29T02:00:28.913 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.920+0000 7fc06b7fe700 1 --2- 172.21.15.42:0/3304735897 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc07006a660 0x7fc07006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:28.913 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.920+0000 7fc06b7fe700 1 -- 172.21.15.42:0/3304735897 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc07808a3b0 con 0x7fc0840cf460 2023-07-29T02:00:28.913 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.920+0000 7fc0827fc700 1 --2- 172.21.15.42:0/3304735897 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc07006a660 0x7fc07006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:28.914 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.921+0000 7fc0827fc700 1 --2- 172.21.15.42:0/3304735897 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc07006a660 0x7fc07006cb10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc0841542d0 tx=0x7fc074008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:28.914 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:28.925+0000 7fc06b7fe700 1 -- 172.21.15.42:0/3304735897 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fc0780554b0 con 0x7fc0840cf460 2023-07-29T02:00:29.115 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.127+0000 7fc0895dc700 1 -- 172.21.15.42:0/3304735897 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc08404ea50 con 0x7fc0840cf460 2023-07-29T02:00:29.116 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.129+0000 7fc06b7fe700 1 -- 172.21.15.42:0/3304735897 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19690 (secure 0 0 0) 0x7fc078058ad0 con 0x7fc0840cf460 2023-07-29T02:00:29.117 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:29.117 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T02:00:02.394460+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T01:59:55.827461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T01:59:56.924040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-29T01:59:59.996470+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T02:00:29.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.131+0000 7fc0895dc700 1 -- 172.21.15.42:0/3304735897 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc07006a660 msgr2=0x7fc07006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.131+0000 7fc0895dc700 1 --2- 172.21.15.42:0/3304735897 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc07006a660 0x7fc07006cb10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc0841542d0 tx=0x7fc074008040 comp rx=0 tx=0).stop 2023-07-29T02:00:29.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.131+0000 7fc0895dc700 1 -- 172.21.15.42:0/3304735897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0840cf460 msgr2=0x7fc0841ef1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.131+0000 7fc0895dc700 1 --2- 172.21.15.42:0/3304735897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0840cf460 0x7fc0841ef1f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc078009fd0 tx=0x7fc078004750 comp rx=0 tx=0).stop 2023-07-29T02:00:29.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.131+0000 7fc0895dc700 1 -- 172.21.15.42:0/3304735897 shutdown_connections 2023-07-29T02:00:29.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.131+0000 7fc0895dc700 1 --2- 172.21.15.42:0/3304735897 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc07006a660 0x7fc07006cb10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.131+0000 7fc0895dc700 1 --2- 172.21.15.42:0/3304735897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc084159cb0 0x7fc0840cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.131+0000 7fc0895dc700 1 --2- 172.21.15.42:0/3304735897 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc0840cf460 0x7fc0841ef1f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.131+0000 7fc0895dc700 1 --2- 172.21.15.42:0/3304735897 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc0840cf830 0x7fc084153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.121 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.131+0000 7fc0895dc700 1 -- 172.21.15.42:0/3304735897 >> 172.21.15.42:0/3304735897 conn(0x7fc08406ca60 msgr2=0x7fc08415ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.121 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.131+0000 7fc0895dc700 1 -- 172.21.15.42:0/3304735897 shutdown_connections 2023-07-29T02:00:29.121 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.131+0000 7fc0895dc700 1 -- 172.21.15.42:0/3304735897 wait complete. 2023-07-29T02:00:29.131 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-29T02:00:29.132 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-29T02:00:29.132 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-29T02:00:29.133 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-29T02:00:29.133 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-29T02:00:29.134 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-29T02:00:29.134 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-29T02:00:29.135 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-29T02:00:29.354 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.361+0000 7ffa1c261700 1 Processor -- start 2023-07-29T02:00:29.354 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.361+0000 7ffa1c261700 1 -- start start 2023-07-29T02:00:29.354 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.362+0000 7ffa1c261700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa14166e70 0x7ffa140c07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.362+0000 7ffa1c261700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa140c02d0 con 0x7ffa14166aa0 2023-07-29T02:00:29.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.362+0000 7ffa1c261700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa140c5a10 con 0x7ffa140b0e50 2023-07-29T02:00:29.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.362+0000 7ffa1c261700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa140c72e0 con 0x7ffa14166e70 2023-07-29T02:00:29.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.363+0000 7ffa197fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa14166e70 0x7ffa140c07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.363+0000 7ffa197fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa14166e70 0x7ffa140c07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:56722/0 (socket says 172.21.15.42:56722) 2023-07-29T02:00:29.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.363+0000 7ffa197fc700 1 -- 172.21.15.42:0/3376977081 learned_addr learned my addr 172.21.15.42:0/3376977081 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.364+0000 7ffa197fc700 1 -- 172.21.15.42:0/3376977081 >> v1:172.21.15.144:6789/0 conn(0x7ffa140b0e50 legacy=0x7ffa14170710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-29T02:00:29.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.364+0000 7ffa197fc700 1 -- 172.21.15.42:0/3376977081 >> v1:172.21.15.42:6789/0 conn(0x7ffa14166aa0 legacy=0x7ffa140c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.364+0000 7ffa197fc700 1 -- 172.21.15.42:0/3376977081 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1406e3c0 con 0x7ffa14166e70 2023-07-29T02:00:29.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.365+0000 7ffa197fc700 1 --2- 172.21.15.42:0/3376977081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa14166e70 0x7ffa140c07c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009d80 tx=0x7ffa10007320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=671d6edc5e3e519b server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.365+0000 7ffa18ffb700 1 -- 172.21.15.42:0/3376977081 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10004230 con 0x7ffa14166e70 2023-07-29T02:00:29.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.365+0000 7ffa18ffb700 1 -- 172.21.15.42:0/3376977081 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa10004390 con 0x7ffa14166e70 2023-07-29T02:00:29.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.365+0000 7ffa18ffb700 1 -- 172.21.15.42:0/3376977081 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10009e70 con 0x7ffa14166e70 2023-07-29T02:00:29.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.366+0000 7ffa1c261700 1 -- 172.21.15.42:0/3376977081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa14166e70 msgr2=0x7ffa140c07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.357 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.366+0000 7ffa1c261700 1 --2- 172.21.15.42:0/3376977081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa14166e70 0x7ffa140c07c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009d80 tx=0x7ffa10007320 comp rx=0 tx=0).stop 2023-07-29T02:00:29.357 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.367+0000 7ffa1c261700 1 -- 172.21.15.42:0/3376977081 shutdown_connections 2023-07-29T02:00:29.357 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.367+0000 7ffa1c261700 1 --2- 172.21.15.42:0/3376977081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa14166e70 0x7ffa140c07c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.357 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.367+0000 7ffa1c261700 1 -- 172.21.15.42:0/3376977081 >> 172.21.15.42:0/3376977081 conn(0x7ffa140cae90 msgr2=0x7ffa140cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.367+0000 7f2bd5bdd700 1 Processor -- start 2023-07-29T02:00:29.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.367+0000 7ff4e9381700 1 Processor -- start 2023-07-29T02:00:29.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.367+0000 7f2bd5bdd700 1 -- start start 2023-07-29T02:00:29.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.369+0000 7f2bd5bdd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2bd014f4c0 0x7f2bd006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.369+0000 7f2bd5bdd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2bd00bfeb0 0x7f2bd006def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.369+0000 7f2bd5bdd700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd00c5b40 con 0x7f2bd00c73d0 2023-07-29T02:00:29.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.369+0000 7f2bd5bdd700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd006c210 con 0x7f2bd014f4c0 2023-07-29T02:00:29.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.369+0000 7f2bd5bdd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd006c4f0 con 0x7f2bd00bfeb0 2023-07-29T02:00:29.360 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.367+0000 7ff4e9381700 1 -- start start 2023-07-29T02:00:29.360 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.369+0000 7ff4e9381700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff4e40bfeb0 0x7ff4e4158d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.360 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.369+0000 7ff4e9381700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff4e40c73d0 0x7ff4e4159280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.360 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.369+0000 7ff4e9381700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e40c5b40 con 0x7ff4e414f4c0 2023-07-29T02:00:29.360 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.369+0000 7ff4e9381700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e406c210 con 0x7ff4e40c73d0 2023-07-29T02:00:29.360 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.369+0000 7ff4e9381700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e406c4f0 con 0x7ff4e40bfeb0 2023-07-29T02:00:29.361 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.369+0000 7f2bcf7fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2bd014f4c0 0x7f2bd006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.361 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.369+0000 7f2bceffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2bd00bfeb0 0x7f2bd006def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.361 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.369+0000 7f2bcf7fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2bd014f4c0 0x7f2bd006d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:39588/0 (socket says 172.21.15.42:39588) 2023-07-29T02:00:29.361 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.369+0000 7f2bcf7fe700 1 -- 172.21.15.42:0/2105920331 learned_addr learned my addr 172.21.15.42:0/2105920331 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.361 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.369+0000 7f2bceffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2bd00bfeb0 0x7f2bd006def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:56726/0 (socket says 172.21.15.42:56726) 2023-07-29T02:00:29.362 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.369+0000 7ff4e37fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff4e40c73d0 0x7ff4e4159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.362 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.369+0000 7ff4e37fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff4e40c73d0 0x7ff4e4159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56218/0 (socket says 172.21.15.42:56218) 2023-07-29T02:00:29.362 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.369+0000 7ff4e37fe700 1 -- 172.21.15.42:0/1828510521 learned_addr learned my addr 172.21.15.42:0/1828510521 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.362 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.369+0000 7f2bce7fc700 1 -- 172.21.15.42:0/2105920331 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464188657 0 0) 0x7f2bd00c5b40 con 0x7f2bd00c73d0 2023-07-29T02:00:29.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.369+0000 7f2bce7fc700 1 -- 172.21.15.42:0/2105920331 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bb80035b0 con 0x7f2bd00c73d0 2023-07-29T02:00:29.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.370+0000 7f484a68c700 1 Processor -- start 2023-07-29T02:00:29.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.370+0000 7f484a68c700 1 -- start start 2023-07-29T02:00:29.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.370+0000 7ffa1c261700 1 -- 172.21.15.42:0/3376977081 shutdown_connections 2023-07-29T02:00:29.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.370+0000 7f3c2cd85700 1 Processor -- start 2023-07-29T02:00:29.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.370+0000 7ff4e37fe700 1 -- 172.21.15.42:0/1828510521 >> v2:172.21.15.144:3300/0 conn(0x7ff4e40bfeb0 msgr2=0x7ff4e4158d40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-29T02:00:29.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.370+0000 7ff4e37fe700 1 --2- 172.21.15.42:0/1828510521 >> v2:172.21.15.144:3300/0 conn(0x7ff4e40bfeb0 0x7ff4e4158d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.370+0000 7ff4e37fe700 1 -- 172.21.15.42:0/1828510521 >> v1:172.21.15.144:6789/0 conn(0x7ff4e414f4c0 legacy=0x7ff4e406d9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-29T02:00:29.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.370+0000 7ff4e37fe700 1 -- 172.21.15.42:0/1828510521 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e40c5d90 con 0x7ff4e40c73d0 2023-07-29T02:00:29.366 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.370+0000 7f3c2cd85700 1 -- start start 2023-07-29T02:00:29.367 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.370+0000 7ff4e37fe700 1 --2- 172.21.15.42:0/1828510521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e40c73d0 0x7ff4e4159280 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff4e406ebb0 tx=0x7ff4d400d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65aa56998db953c server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.367 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.371+0000 7f231cc64700 1 Processor -- start 2023-07-29T02:00:29.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.371+0000 7ff4e1ffb700 1 -- 172.21.15.42:0/1828510521 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4010070 con 0x7ff4e40c73d0 2023-07-29T02:00:29.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.371+0000 7ff4e1ffb700 1 -- 172.21.15.42:0/1828510521 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d400da40 con 0x7ff4e40c73d0 2023-07-29T02:00:29.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.371+0000 7ff4e1ffb700 1 -- 172.21.15.42:0/1828510521 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d400ddd0 con 0x7ff4e40c73d0 2023-07-29T02:00:29.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.371+0000 7f484a68c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f48440c5510 0x7f48441626b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.371+0000 7f484a68c700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48440c5910 con 0x7f48441512f0 2023-07-29T02:00:29.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.371+0000 7f484a68c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4844157710 con 0x7f4844061520 2023-07-29T02:00:29.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.371+0000 7f484a68c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48440c8e20 con 0x7f48440c5510 2023-07-29T02:00:29.371 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.370+0000 7f2bcf7fe700 1 -- 172.21.15.42:0/2105920331 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2bd00bfeb0 msgr2=0x7f2bd006def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:29.371 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.370+0000 7f2bcf7fe700 1 --2- 172.21.15.42:0/2105920331 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2bd00bfeb0 0x7f2bd006def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.371 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.370+0000 7f2bcf7fe700 1 -- 172.21.15.42:0/2105920331 >> v1:172.21.15.144:6789/0 conn(0x7f2bd00c73d0 legacy=0x7f2bd0158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.370+0000 7f2bcf7fe700 1 -- 172.21.15.42:0/2105920331 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd00c5d90 con 0x7f2bd014f4c0 2023-07-29T02:00:29.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.370+0000 7f2bcf7fe700 1 --2- 172.21.15.42:0/2105920331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd014f4c0 0x7f2bd006d9b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00098f0 tx=0x7f2bc0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=537f962a6cbc4fa server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.370+0000 7f2bce7fc700 1 -- 172.21.15.42:0/2105920331 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0011830 con 0x7f2bd014f4c0 2023-07-29T02:00:29.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.370+0000 7f2bce7fc700 1 -- 172.21.15.42:0/2105920331 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc0011990 con 0x7f2bd014f4c0 2023-07-29T02:00:29.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.370+0000 7f2bce7fc700 1 -- 172.21.15.42:0/2105920331 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0011d20 con 0x7f2bd014f4c0 2023-07-29T02:00:29.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.372+0000 7f3c2cd85700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3c281597b0 0x7f3c281648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.372+0000 7f3c2cd85700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c280c68f0 con 0x7f3c281532e0 2023-07-29T02:00:29.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.372+0000 7f3c2cd85700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c281536b0 con 0x7f3c280c9bd0 2023-07-29T02:00:29.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.372+0000 7f3c2cd85700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c280cb2e0 con 0x7f3c281597b0 2023-07-29T02:00:29.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.372+0000 7f3c25d9b700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3c280c9bd0 0x7f3c281590a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.42:52524/0 (socket says 172.21.15.42:52524) 2023-07-29T02:00:29.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.372+0000 7f3c25d9b700 1 -- 172.21.15.42:0/3798118036 learned_addr learned my addr 172.21.15.42:0/3798118036 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:29.375 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.371+0000 7ffa1c261700 1 -- 172.21.15.42:0/3376977081 wait complete. 2023-07-29T02:00:29.375 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.372+0000 7ff4e9381700 1 -- 172.21.15.42:0/1828510521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e40c73d0 msgr2=0x7ff4e4159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.375 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.372+0000 7ff4e9381700 1 --2- 172.21.15.42:0/1828510521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e40c73d0 0x7ff4e4159280 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff4e406ebb0 tx=0x7ff4d400d330 comp rx=0 tx=0).stop 2023-07-29T02:00:29.376 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.372+0000 7ff4e9381700 1 -- 172.21.15.42:0/1828510521 shutdown_connections 2023-07-29T02:00:29.376 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.372+0000 7ff4e9381700 1 --2- 172.21.15.42:0/1828510521 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e40c73d0 0x7ff4e4159280 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.376 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.372+0000 7ff4e9381700 1 --2- 172.21.15.42:0/1828510521 >> v2:172.21.15.144:3300/0 conn(0x7ff4e40bfeb0 0x7ff4e4158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.376 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.372+0000 7ff4e9381700 1 -- 172.21.15.42:0/1828510521 >> 172.21.15.42:0/1828510521 conn(0x7ff4e40cae90 msgr2=0x7ff4e40cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.376 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.372+0000 7f3c26d9d700 1 --2- 172.21.15.42:0/3798118036 >> v2:172.21.15.144:3300/0 conn(0x7f3c281597b0 0x7f3c281648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.371+0000 7f231cc64700 1 -- start start 2023-07-29T02:00:29.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.372+0000 7f231cc64700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f231814f4c0 0x7f231806d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.372+0000 7f231cc64700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23180c5b40 con 0x7f2318159450 2023-07-29T02:00:29.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.372+0000 7f231cc64700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231806c210 con 0x7f23180bfeb0 2023-07-29T02:00:29.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.372+0000 7f231cc64700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f231806c4f0 con 0x7f231814f4c0 2023-07-29T02:00:29.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.372+0000 7f48437fe700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f4844061520 0x7f48440c2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.42:52518/0 (socket says 172.21.15.42:52518) 2023-07-29T02:00:29.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.372+0000 7f48437fe700 1 -- 172.21.15.42:0/2846013703 learned_addr learned my addr 172.21.15.42:0/2846013703 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:29.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.372+0000 7f4848c29700 1 --2- 172.21.15.42:0/2846013703 >> v2:172.21.15.144:3300/0 conn(0x7f48440c5510 0x7f48441626b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f3c2559a700 1 -- 172.21.15.42:0/3798118036 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078958478 0 0) 0x7f3c281536b0 con 0x7f3c280c9bd0 2023-07-29T02:00:29.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f3c2559a700 1 -- 172.21.15.42:0/3798118036 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c100035b0 con 0x7f3c280c9bd0 2023-07-29T02:00:29.379 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f231659c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f231814f4c0 0x7f231806d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.379 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f2bd5bdd700 1 -- 172.21.15.42:0/2105920331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd014f4c0 msgr2=0x7f2bd006d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.379 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f2bd5bdd700 1 --2- 172.21.15.42:0/2105920331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd014f4c0 0x7f2bd006d9b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00098f0 tx=0x7f2bc0009c00 comp rx=0 tx=0).stop 2023-07-29T02:00:29.380 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7ffa1c261700 1 Processor -- start 2023-07-29T02:00:29.380 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f231659c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f231814f4c0 0x7f231806d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:56746/0 (socket says 172.21.15.42:56746) 2023-07-29T02:00:29.380 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f231659c700 1 -- 172.21.15.42:0/3532039677 learned_addr learned my addr 172.21.15.42:0/3532039677 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.381 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f3c26d9d700 1 -- 172.21.15.42:0/3798118036 >> v1:172.21.15.144:6789/0 conn(0x7f3c280c9bd0 legacy=0x7f3c281590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.381 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f3c26d9d700 1 -- 172.21.15.42:0/3798118036 >> v1:172.21.15.42:6789/0 conn(0x7f3c281532e0 legacy=0x7f3c280cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:29.381 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f3c26d9d700 1 -- 172.21.15.42:0/3798118036 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c280ca130 con 0x7f3c281597b0 2023-07-29T02:00:29.381 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f4842ffd700 1 -- 172.21.15.42:0/2846013703 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310256612 0 0) 0x7f4844157710 con 0x7f4844061520 2023-07-29T02:00:29.381 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f4842ffd700 1 -- 172.21.15.42:0/2846013703 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f482c0035b0 con 0x7f4844061520 2023-07-29T02:00:29.382 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7ffa1c261700 1 -- start start 2023-07-29T02:00:29.382 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f2bd5bdd700 1 -- 172.21.15.42:0/2105920331 shutdown_connections 2023-07-29T02:00:29.382 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f2bd5bdd700 1 --2- 172.21.15.42:0/2105920331 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd014f4c0 0x7f2bd006d9b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.383 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f2bd5bdd700 1 --2- 172.21.15.42:0/2105920331 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2bd00bfeb0 0x7f2bd006def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.383 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f2bd5bdd700 1 -- 172.21.15.42:0/2105920331 >> 172.21.15.42:0/2105920331 conn(0x7f2bd00cae90 msgr2=0x7f2bd00cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.383 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f3c26d9d700 1 --2- 172.21.15.42:0/3798118036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c281597b0 0x7f3c281648c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009d90 tx=0x7f3c2000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40a485aedff7f74 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.383 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f231659c700 1 -- 172.21.15.42:0/3532039677 >> v1:172.21.15.144:6789/0 conn(0x7f23180bfeb0 legacy=0x7f2318158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:29.383 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f231659c700 1 -- 172.21.15.42:0/3532039677 >> v1:172.21.15.42:6789/0 conn(0x7f2318159450 legacy=0x7f231815fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:29.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f231659c700 1 -- 172.21.15.42:0/3532039677 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23180c5d90 con 0x7f231814f4c0 2023-07-29T02:00:29.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f3c2559a700 1 -- 172.21.15.42:0/3798118036 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2000e070 con 0x7f3c281597b0 2023-07-29T02:00:29.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f3c2559a700 1 -- 172.21.15.42:0/3798118036 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2000bae0 con 0x7f3c281597b0 2023-07-29T02:00:29.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f3c2559a700 1 -- 172.21.15.42:0/3798118036 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2000be70 con 0x7f3c281597b0 2023-07-29T02:00:29.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f4842ffd700 1 -- 172.21.15.42:0/2846013703 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3611193969 0 0) 0x7f48440c5910 con 0x7f48441512f0 2023-07-29T02:00:29.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.373+0000 7f4842ffd700 1 -- 172.21.15.42:0/2846013703 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4844157710 con 0x7f48441512f0 2023-07-29T02:00:29.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.374+0000 7f231659c700 1 --2- 172.21.15.42:0/3532039677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f231814f4c0 0x7f231806d9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2308009310 tx=0x7f2308009620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c1de0e3eab80c66 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.374+0000 7ff4e9381700 1 -- 172.21.15.42:0/1828510521 shutdown_connections 2023-07-29T02:00:29.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.374+0000 7f2bd5bdd700 1 -- 172.21.15.42:0/2105920331 shutdown_connections 2023-07-29T02:00:29.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.374+0000 7f2315d9b700 1 -- 172.21.15.42:0/3532039677 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308004230 con 0x7f231814f4c0 2023-07-29T02:00:29.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.374+0000 7f2315d9b700 1 -- 172.21.15.42:0/3532039677 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2308004390 con 0x7f231814f4c0 2023-07-29T02:00:29.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.374+0000 7f2315d9b700 1 -- 172.21.15.42:0/3532039677 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308009860 con 0x7f231814f4c0 2023-07-29T02:00:29.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.374+0000 7ffa1c261700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa14166aa0 0x7ffa14164c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.374+0000 7ffa1c261700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa141ee960 0x7ffa140a9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.374+0000 7ffa1c261700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa141ec920 0x7ffa141ecd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.374+0000 7ffa1c261700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa141ed2d0 con 0x7ffa141ee960 2023-07-29T02:00:29.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.374+0000 7ffa1c261700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa14204e40 con 0x7ffa14166aa0 2023-07-29T02:00:29.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.374+0000 7ffa1c261700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa141eef50 con 0x7ffa141ec920 2023-07-29T02:00:29.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.374+0000 7f4848c29700 1 -- 172.21.15.42:0/2846013703 >> v1:172.21.15.144:6789/0 conn(0x7f4844061520 legacy=0x7f48440c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.374+0000 7f4848c29700 1 -- 172.21.15.42:0/2846013703 >> v1:172.21.15.42:6789/0 conn(0x7f48441512f0 legacy=0x7f48440c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.374+0000 7f4848c29700 1 -- 172.21.15.42:0/2846013703 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4844156e00 con 0x7f48440c5510 2023-07-29T02:00:29.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.374+0000 7ffa1a7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa141ec920 0x7ffa141ecd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.374+0000 7ffa1a7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa141ec920 0x7ffa141ecd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:56754/0 (socket says 172.21.15.42:56754) 2023-07-29T02:00:29.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7ffa1a7fe700 1 -- 172.21.15.42:0/3543948242 learned_addr learned my addr 172.21.15.42:0/3543948242 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7f3c2cd85700 1 -- 172.21.15.42:0/3798118036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c281597b0 msgr2=0x7f3c281648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7f3c2cd85700 1 --2- 172.21.15.42:0/3798118036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c281597b0 0x7f3c281648c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3c20009d90 tx=0x7f3c2000b330 comp rx=0 tx=0).stop 2023-07-29T02:00:29.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7ffa19ffd700 1 --2- 172.21.15.42:0/3543948242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa14166aa0 0x7ffa14164c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7f231cc64700 1 -- 172.21.15.42:0/3532039677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f231814f4c0 msgr2=0x7f231806d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7f231cc64700 1 --2- 172.21.15.42:0/3532039677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f231814f4c0 0x7f231806d9b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2308009310 tx=0x7f2308009620 comp rx=0 tx=0).stop 2023-07-29T02:00:29.391 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7f4848c29700 1 --2- 172.21.15.42:0/2846013703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48440c5510 0x7f48441626b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4834009840 tx=0x7f4834009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d51ba5f4bff1dd5 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.391 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7f231cc64700 1 -- 172.21.15.42:0/3532039677 shutdown_connections 2023-07-29T02:00:29.391 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7f231cc64700 1 --2- 172.21.15.42:0/3532039677 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f231814f4c0 0x7f231806d9b0 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2308009310 tx=0x7f2308009620 comp rx=0 tx=0).stop 2023-07-29T02:00:29.391 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7f231cc64700 1 -- 172.21.15.42:0/3532039677 >> 172.21.15.42:0/3532039677 conn(0x7f23180cae90 msgr2=0x7f23180cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.392 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7f4842ffd700 1 -- 172.21.15.42:0/2846013703 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4834011830 con 0x7f48440c5510 2023-07-29T02:00:29.392 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7f4842ffd700 1 -- 172.21.15.42:0/2846013703 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4834011990 con 0x7f48440c5510 2023-07-29T02:00:29.392 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7f4842ffd700 1 -- 172.21.15.42:0/2846013703 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4834011d20 con 0x7f48440c5510 2023-07-29T02:00:29.392 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7ffa19ffd700 1 -- 172.21.15.42:0/3543948242 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa141ec920 msgr2=0x7ffa141ecd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.393 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7ffa19ffd700 1 --2- 172.21.15.42:0/3543948242 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffa141ec920 0x7ffa141ecd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.393 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7ffa19ffd700 1 -- 172.21.15.42:0/3543948242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa141ee960 msgr2=0x7ffa140a9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.393 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7ffa19ffd700 1 --2- 172.21.15.42:0/3543948242 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffa141ee960 0x7ffa140a9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.393 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7ffa19ffd700 1 -- 172.21.15.42:0/3543948242 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa10009a30 con 0x7ffa14166aa0 2023-07-29T02:00:29.394 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7ffa19ffd700 1 --2- 172.21.15.42:0/3543948242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa14166aa0 0x7ffa14164c10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa04000f60 tx=0x7ffa0400c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.394 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7f3c2cd85700 1 -- 172.21.15.42:0/3798118036 shutdown_connections 2023-07-29T02:00:29.394 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7f3c2cd85700 1 --2- 172.21.15.42:0/3798118036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c281597b0 0x7f3c281648c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.394 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.375+0000 7f3c2cd85700 1 -- 172.21.15.42:0/3798118036 >> 172.21.15.42:0/3798118036 conn(0x7f3c28061190 msgr2=0x7f3c28061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.394 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.376+0000 7f3c2cd85700 1 -- 172.21.15.42:0/3798118036 shutdown_connections 2023-07-29T02:00:29.395 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.376+0000 7f3c2cd85700 1 -- 172.21.15.42:0/3798118036 wait complete. 2023-07-29T02:00:29.395 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.374+0000 7ff4e9381700 1 -- 172.21.15.42:0/1828510521 wait complete. 2023-07-29T02:00:29.395 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.374+0000 7f2bd5bdd700 1 -- 172.21.15.42:0/2105920331 wait complete. 2023-07-29T02:00:29.396 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.376+0000 7ff4e9381700 1 Processor -- start 2023-07-29T02:00:29.396 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.376+0000 7f2bd5bdd700 1 Processor -- start 2023-07-29T02:00:29.396 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.377+0000 7f484a68c700 1 -- 172.21.15.42:0/2846013703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48440c5510 msgr2=0x7f48441626b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.396 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.377+0000 7f484a68c700 1 --2- 172.21.15.42:0/2846013703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48440c5510 0x7f48441626b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4834009840 tx=0x7f4834009b50 comp rx=0 tx=0).stop 2023-07-29T02:00:29.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.377+0000 7f484a68c700 1 -- 172.21.15.42:0/2846013703 shutdown_connections 2023-07-29T02:00:29.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.377+0000 7f484a68c700 1 --2- 172.21.15.42:0/2846013703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48440c5510 0x7f48441626b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.377+0000 7f484a68c700 1 -- 172.21.15.42:0/2846013703 >> 172.21.15.42:0/2846013703 conn(0x7f48440cc420 msgr2=0x7f48440c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.377+0000 7f2bd5bdd700 1 -- start start 2023-07-29T02:00:29.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.376+0000 7ff4e9381700 1 -- start start 2023-07-29T02:00:29.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.377+0000 7f484a68c700 1 -- 172.21.15.42:0/2846013703 shutdown_connections 2023-07-29T02:00:29.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.377+0000 7ff4e9381700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4e40c73d0 0x7ff4e41574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.377+0000 7ff4e9381700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e414f4c0 0x7ff4e4157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.399 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.377+0000 7ff4e9381700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4e41487f0 0x7ff4e4148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.399 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.377+0000 7ff4e9381700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e4156790 con 0x7ff4e414f4c0 2023-07-29T02:00:29.399 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.377+0000 7ff4e9381700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e414a7b0 con 0x7ff4e40c73d0 2023-07-29T02:00:29.399 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.377+0000 7ff4e9381700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e414aa90 con 0x7ff4e41487f0 2023-07-29T02:00:29.399 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.378+0000 7f3c2cd85700 1 Processor -- start 2023-07-29T02:00:29.400 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.378+0000 7ff4e37fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4e41487f0 0x7ff4e4148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.400 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.378+0000 7ff4e37fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4e41487f0 0x7ff4e4148c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:56764/0 (socket says 172.21.15.42:56764) 2023-07-29T02:00:29.400 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.378+0000 7ff4e37fe700 1 -- 172.21.15.42:0/3916110685 learned_addr learned my addr 172.21.15.42:0/3916110685 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.400 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.378+0000 7ff4e2ffd700 1 --2- 172.21.15.42:0/3916110685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4e40c73d0 0x7ff4e41574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.401 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.377+0000 7ffa0a7fc700 1 -- 172.21.15.42:0/3543948242 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa040052d0 con 0x7ffa14166aa0 2023-07-29T02:00:29.401 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.377+0000 7ffa0a7fc700 1 -- 172.21.15.42:0/3543948242 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa04005430 con 0x7ffa14166aa0 2023-07-29T02:00:29.401 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.377+0000 7ffa0a7fc700 1 -- 172.21.15.42:0/3543948242 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa040038c0 con 0x7ffa14166aa0 2023-07-29T02:00:29.401 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.377+0000 7ffa1c261700 1 -- 172.21.15.42:0/3543948242 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa141ef230 con 0x7ffa14166aa0 2023-07-29T02:00:29.401 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.378+0000 7ffa1c261700 1 -- 172.21.15.42:0/3543948242 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa141ef7f0 con 0x7ffa14166aa0 2023-07-29T02:00:29.402 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.378+0000 7f2bd5bdd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2bd00c73d0 0x7f2bd014aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.402 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.378+0000 7f2bd5bdd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd014f4c0 0x7f2bd00c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.402 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.378+0000 7f2bd5bdd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bd00c4fb0 0x7f2bd01556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.402 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.378+0000 7f2bd5bdd700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd00c3360 con 0x7f2bd00c4fb0 2023-07-29T02:00:29.402 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.378+0000 7f2bd5bdd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd00c3920 con 0x7f2bd014f4c0 2023-07-29T02:00:29.402 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.378+0000 7f2bd5bdd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd00c2940 con 0x7f2bd00c73d0 2023-07-29T02:00:29.402 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.378+0000 7f2bceffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd014f4c0 0x7f2bd00c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.402 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.378+0000 7f2bceffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd014f4c0 0x7f2bd00c3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:39632/0 (socket says 172.21.15.42:39632) 2023-07-29T02:00:29.403 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.378+0000 7ff4e27fc700 1 --2- 172.21.15.42:0/3916110685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e414f4c0 0x7ff4e4157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.403 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.378+0000 7f2bceffd700 1 -- 172.21.15.42:0/4054977817 learned_addr learned my addr 172.21.15.42:0/4054977817 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.403 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.378+0000 7f3c2cd85700 1 -- start start 2023-07-29T02:00:29.404 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.379+0000 7f2bceffd700 1 -- 172.21.15.42:0/4054977817 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2bd00c73d0 msgr2=0x7f2bd014aa60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-29T02:00:29.404 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.379+0000 7f2bceffd700 1 --2- 172.21.15.42:0/4054977817 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2bd00c73d0 0x7f2bd014aa60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.404 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.379+0000 7f2bceffd700 1 -- 172.21.15.42:0/4054977817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bd00c4fb0 msgr2=0x7f2bd01556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.404 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.379+0000 7f2bceffd700 1 --2- 172.21.15.42:0/4054977817 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2bd00c4fb0 0x7f2bd01556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.404 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.379+0000 7f2bceffd700 1 -- 172.21.15.42:0/4054977817 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc0009550 con 0x7f2bd014f4c0 2023-07-29T02:00:29.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.379+0000 7ff4e27fc700 1 -- 172.21.15.42:0/3916110685 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4e41487f0 msgr2=0x7ff4e4148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.379+0000 7ff4e27fc700 1 --2- 172.21.15.42:0/3916110685 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4e41487f0 0x7ff4e4148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.379+0000 7ff4e27fc700 1 -- 172.21.15.42:0/3916110685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4e40c73d0 msgr2=0x7ff4e41574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.379+0000 7ff4e27fc700 1 --2- 172.21.15.42:0/3916110685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff4e40c73d0 0x7ff4e41574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.379+0000 7ff4e27fc700 1 -- 172.21.15.42:0/3916110685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d40085d0 con 0x7ff4e414f4c0 2023-07-29T02:00:29.406 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.377+0000 7f484a68c700 1 -- 172.21.15.42:0/2846013703 wait complete. 2023-07-29T02:00:29.406 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.379+0000 7f484a68c700 1 Processor -- start 2023-07-29T02:00:29.406 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.379+0000 7ff4e27fc700 1 --2- 172.21.15.42:0/3916110685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e414f4c0 0x7ff4e4157a00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40c8d40 tx=0x7ff4d800b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.379+0000 7f2bceffd700 1 --2- 172.21.15.42:0/4054977817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd014f4c0 0x7f2bd00c3db0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4007a90 tx=0x7f2bc4007e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.380+0000 7f3c2cd85700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c280c9bd0 0x7f3c28157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.380+0000 7f3c2cd85700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c281532e0 0x7f3c2814fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.380+0000 7f3c2cd85700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c281597b0 0x7f3c280b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.380+0000 7f3c2cd85700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280b27b0 con 0x7f3c280c9bd0 2023-07-29T02:00:29.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.380+0000 7f3c2cd85700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c281f6df0 con 0x7f3c281597b0 2023-07-29T02:00:29.408 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.380+0000 7f3c2cd85700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c280b4860 con 0x7f3c281532e0 2023-07-29T02:00:29.408 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.380+0000 7f3c25d9b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c281532e0 0x7f3c2814fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.408 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.380+0000 7f3c25d9b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c281532e0 0x7f3c2814fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:56772/0 (socket says 172.21.15.42:56772) 2023-07-29T02:00:29.408 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.380+0000 7f3c25d9b700 1 -- 172.21.15.42:0/2227605308 learned_addr learned my addr 172.21.15.42:0/2227605308 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.408 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.380+0000 7f3c26d9d700 1 --2- 172.21.15.42:0/2227605308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c281597b0 0x7f3c280b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.409 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.380+0000 7f484a68c700 1 -- start start 2023-07-29T02:00:29.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.380+0000 7f2bb7fff700 1 -- 172.21.15.42:0/4054977817 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc4011040 con 0x7f2bd014f4c0 2023-07-29T02:00:29.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.380+0000 7f2bb7fff700 1 -- 172.21.15.42:0/4054977817 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc400c020 con 0x7f2bd014f4c0 2023-07-29T02:00:29.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.380+0000 7f2bb7fff700 1 -- 172.21.15.42:0/4054977817 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc400ab90 con 0x7f2bd014f4c0 2023-07-29T02:00:29.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.379+0000 7f231cc64700 1 -- 172.21.15.42:0/3532039677 shutdown_connections 2023-07-29T02:00:29.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.379+0000 7f231cc64700 1 -- 172.21.15.42:0/3532039677 wait complete. 2023-07-29T02:00:29.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.381+0000 7f3c26d9d700 1 -- 172.21.15.42:0/2227605308 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c281532e0 msgr2=0x7f3c2814fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.381+0000 7f3c26d9d700 1 --2- 172.21.15.42:0/2227605308 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c281532e0 0x7f3c2814fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.381+0000 7f3c26d9d700 1 -- 172.21.15.42:0/2227605308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c280c9bd0 msgr2=0x7f3c28157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.381+0000 7f3c26d9d700 1 --2- 172.21.15.42:0/2227605308 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c280c9bd0 0x7f3c28157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.381+0000 7f3c26d9d700 1 -- 172.21.15.42:0/2227605308 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c20009a70 con 0x7f3c281597b0 2023-07-29T02:00:29.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.381+0000 7f484a68c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4844061520 0x7f4844148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.381+0000 7f484a68c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48440c5510 0x7f48441de250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.381+0000 7f484a68c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48441512f0 0x7f48440cacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.415 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.381+0000 7f484a68c700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48441e9fe0 con 0x7f48440c5510 2023-07-29T02:00:29.415 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.381+0000 7f484a68c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4844148140 con 0x7f4844061520 2023-07-29T02:00:29.415 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.381+0000 7f484a68c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4844144190 con 0x7f48441512f0 2023-07-29T02:00:29.416 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.381+0000 7f4843fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4844061520 0x7f4844148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.416 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.381+0000 7f4843fff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4844061520 0x7f4844148560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:39642/0 (socket says 172.21.15.42:39642) 2023-07-29T02:00:29.416 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.381+0000 7f4843fff700 1 -- 172.21.15.42:0/3206542418 learned_addr learned my addr 172.21.15.42:0/3206542418 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.416 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.382+0000 7f48437fe700 1 --2- 172.21.15.42:0/3206542418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48440c5510 0x7f48441de250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.416 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.382+0000 7f4848c29700 1 --2- 172.21.15.42:0/3206542418 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48441512f0 0x7f48440cacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.417 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7f48437fe700 1 -- 172.21.15.42:0/3206542418 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48441512f0 msgr2=0x7f48440cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.417 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7f48437fe700 1 --2- 172.21.15.42:0/3206542418 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48441512f0 0x7f48440cacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.417 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7f48437fe700 1 -- 172.21.15.42:0/3206542418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4844061520 msgr2=0x7f4844148560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.417 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7f48437fe700 1 --2- 172.21.15.42:0/3206542418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4844061520 0x7f4844148560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.418 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7f48437fe700 1 -- 172.21.15.42:0/3206542418 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48340094a0 con 0x7f48440c5510 2023-07-29T02:00:29.418 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7f48437fe700 1 --2- 172.21.15.42:0/3206542418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48440c5510 0x7f48441de250 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f483800c490 tx=0x7f483800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.381+0000 7ffa0a7fc700 1 -- 172.21.15.42:0/3543948242 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7ffa04003a20 con 0x7ffa14166aa0 2023-07-29T02:00:29.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.381+0000 7ffa0a7fc700 1 --2- 172.21.15.42:0/3543948242 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff9f806a730 0x7ff9f806cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.382+0000 7ffa0a7fc700 1 -- 172.21.15.42:0/3543948242 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffa040881d0 con 0x7ffa14166aa0 2023-07-29T02:00:29.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.382+0000 7ffa1c261700 1 -- 172.21.15.42:0/3543948242 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffa14072c20 con 0x7ffa14166aa0 2023-07-29T02:00:29.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.382+0000 7ffa0a7fc700 1 --2- 172.21.15.42:0/3543948242 >> [v2:172.21.15.42:6808/131313,v1:172.21.15.42:6809/131313] conn(0x7ff9f8074380 0x7ff9f80767b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.382+0000 7ffa0a7fc700 1 -- 172.21.15.42:0/3543948242 --> [v2:172.21.15.42:6808/131313,v1:172.21.15.42:6809/131313] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff9f8076e80 con 0x7ff9f8074380 2023-07-29T02:00:29.420 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7ffa0a7fc700 1 -- 172.21.15.42:0/3543948242 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa040011e0 con 0x7ffa14166aa0 2023-07-29T02:00:29.420 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.380+0000 7f2bd5bdd700 1 -- 172.21.15.42:0/4054977817 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd00c2c20 con 0x7f2bd014f4c0 2023-07-29T02:00:29.420 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.380+0000 7f2bd5bdd700 1 -- 172.21.15.42:0/4054977817 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd00c35b0 con 0x7f2bd014f4c0 2023-07-29T02:00:29.420 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.381+0000 7f2bd5bdd700 1 -- 172.21.15.42:0/4054977817 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2bd00c6470 con 0x7f2bd014f4c0 2023-07-29T02:00:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.382+0000 7ff4cb7fe700 1 -- 172.21.15.42:0/3916110685 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8011830 con 0x7ff4e414f4c0 2023-07-29T02:00:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.382+0000 7ff4cb7fe700 1 -- 172.21.15.42:0/3916110685 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d80119b0 con 0x7ff4e414f4c0 2023-07-29T02:00:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.382+0000 7ff4cb7fe700 1 -- 172.21.15.42:0/3916110685 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8011d60 con 0x7ff4e414f4c0 2023-07-29T02:00:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.382+0000 7ff4e9381700 1 -- 172.21.15.42:0/3916110685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e41569e0 con 0x7ff4e414f4c0 2023-07-29T02:00:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.382+0000 7ff4e9381700 1 -- 172.21.15.42:0/3916110685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e4156fa0 con 0x7ff4e414f4c0 2023-07-29T02:00:29.421 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7ff4e9381700 1 -- 172.21.15.42:0/3916110685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff4e40c6470 con 0x7ff4e414f4c0 2023-07-29T02:00:29.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.382+0000 7f231cc64700 1 Processor -- start 2023-07-29T02:00:29.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.382+0000 7f231cc64700 1 -- start start 2023-07-29T02:00:29.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7f231cc64700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2318159450 0x7f23181f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7f231cc64700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f231814bbc0 0x7f23181480c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7f231cc64700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2318150960 0x7f231814c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7f231cc64700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23180c2430 con 0x7f2318150960 2023-07-29T02:00:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7f231cc64700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23181f3340 con 0x7f231814bbc0 2023-07-29T02:00:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7f231cc64700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23181f3620 con 0x7f2318159450 2023-07-29T02:00:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7f231659c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2318159450 0x7f23181f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7f231659c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2318159450 0x7f23181f3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:56788/0 (socket says 172.21.15.42:56788) 2023-07-29T02:00:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7f231659c700 1 -- 172.21.15.42:0/1361537813 learned_addr learned my addr 172.21.15.42:0/1361537813 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7f230dd9b700 1 --2- 172.21.15.42:0/1361537813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f231814bbc0 0x7f23181480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7f2316d9d700 1 --2- 172.21.15.42:0/1361537813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2318150960 0x7f231814c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7f2bb7fff700 1 -- 172.21.15.42:0/4054977817 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f2bc400acf0 con 0x7f2bd014f4c0 2023-07-29T02:00:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7f2bb7fff700 1 --2- 172.21.15.42:0/4054977817 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2bbc06a660 0x7f2bbc06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.383+0000 7f2bb7fff700 1 -- 172.21.15.42:0/4054977817 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2bc4089510 con 0x7f2bd014f4c0 2023-07-29T02:00:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f2bb7fff700 1 --2- 172.21.15.42:0/4054977817 >> [v2:172.21.15.42:6824/131326,v1:172.21.15.42:6825/131326] conn(0x7f2bbc074330 0x7f2bbc076760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f2bb7fff700 1 -- 172.21.15.42:0/4054977817 --> [v2:172.21.15.42:6824/131326,v1:172.21.15.42:6825/131326] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2bbc076e30 con 0x7f2bbc074330 2023-07-29T02:00:29.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f2bb7fff700 1 -- 172.21.15.42:0/4054977817 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2bc40898c0 con 0x7f2bd014f4c0 2023-07-29T02:00:29.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f231659c700 1 -- 172.21.15.42:0/1361537813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f231814bbc0 msgr2=0x7f23181480c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f231659c700 1 --2- 172.21.15.42:0/1361537813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f231814bbc0 0x7f23181480c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f231659c700 1 -- 172.21.15.42:0/1361537813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2318150960 msgr2=0x7f231814c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f231659c700 1 --2- 172.21.15.42:0/1361537813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2318150960 0x7f231814c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f2bcffff700 1 --2- 172.21.15.42:0/4054977817 >> [v2:172.21.15.42:6824/131326,v1:172.21.15.42:6825/131326] conn(0x7f2bbc074330 0x7f2bbc076760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f231659c700 1 -- 172.21.15.42:0/1361537813 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2308009de0 con 0x7f2318159450 2023-07-29T02:00:29.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7ffa197fc700 1 --2- 172.21.15.42:0/3543948242 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff9f806a730 0x7ff9f806cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f2bcf7fe700 1 --2- 172.21.15.42:0/4054977817 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2bbc06a660 0x7f2bbc06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f3c26d9d700 1 --2- 172.21.15.42:0/2227605308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c281597b0 0x7f3c280b2f20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3c20015000 tx=0x7f3c20004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7ffa1a7fe700 1 --2- 172.21.15.42:0/3543948242 >> [v2:172.21.15.42:6808/131313,v1:172.21.15.42:6809/131313] conn(0x7ff9f8074380 0x7ff9f80767b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f231659c700 1 --2- 172.21.15.42:0/1361537813 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2318159450 0x7f23181f3e20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2308000c00 tx=0x7f2308004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f2bcffff700 1 --2- 172.21.15.42:0/4054977817 >> [v2:172.21.15.42:6824/131326,v1:172.21.15.42:6825/131326] conn(0x7f2bbc074330 0x7f2bbc076760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f230f7fe700 1 -- 172.21.15.42:0/1361537813 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230801d070 con 0x7f2318159450 2023-07-29T02:00:29.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f230f7fe700 1 -- 172.21.15.42:0/1361537813 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23080036a0 con 0x7f2318159450 2023-07-29T02:00:29.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f230f7fe700 1 -- 172.21.15.42:0/1361537813 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308003a10 con 0x7f2318159450 2023-07-29T02:00:29.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f231cc64700 1 -- 172.21.15.42:0/1361537813 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23181f3900 con 0x7f2318159450 2023-07-29T02:00:29.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f231cc64700 1 -- 172.21.15.42:0/1361537813 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23180c2710 con 0x7f2318159450 2023-07-29T02:00:29.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.385+0000 7ffa1a7fe700 1 --2- 172.21.15.42:0/3543948242 >> [v2:172.21.15.42:6808/131313,v1:172.21.15.42:6809/131313] conn(0x7ff9f8074380 0x7ff9f80767b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.385+0000 7f4840ff9700 1 -- 172.21.15.42:0/3206542418 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838005e30 con 0x7f48440c5510 2023-07-29T02:00:29.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.386+0000 7f4840ff9700 1 -- 172.21.15.42:0/3206542418 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48380070d0 con 0x7f48440c5510 2023-07-29T02:00:29.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.386+0000 7f484a68c700 1 -- 172.21.15.42:0/3206542418 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48440c8900 con 0x7f48440c5510 2023-07-29T02:00:29.431 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.386+0000 7f484a68c700 1 -- 172.21.15.42:0/3206542418 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48441e9d00 con 0x7f48440c5510 2023-07-29T02:00:29.431 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.386+0000 7f4840ff9700 1 -- 172.21.15.42:0/3206542418 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838007440 con 0x7f48440c5510 2023-07-29T02:00:29.431 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.386+0000 7f231cc64700 1 -- 172.21.15.42:0/1361537813 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f23180c6470 con 0x7f2318159450 2023-07-29T02:00:29.431 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.386+0000 7ffa0a7fc700 1 -- 172.21.15.42:0/3543948242 <== osd.2 v2:172.21.15.42:6808/131313 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff9f8076e80 con 0x7ff9f8074380 2023-07-29T02:00:29.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f3c16ffd700 1 -- 172.21.15.42:0/2227605308 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c200045f0 con 0x7f3c281597b0 2023-07-29T02:00:29.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f3c16ffd700 1 -- 172.21.15.42:0/2227605308 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c20004770 con 0x7f3c281597b0 2023-07-29T02:00:29.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f3c16ffd700 1 -- 172.21.15.42:0/2227605308 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c20012670 con 0x7f3c281597b0 2023-07-29T02:00:29.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f3c2cd85700 1 -- 172.21.15.42:0/2227605308 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c280b4b40 con 0x7f3c281597b0 2023-07-29T02:00:29.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.384+0000 7f3c2cd85700 1 -- 172.21.15.42:0/2227605308 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c280b2a00 con 0x7f3c281597b0 2023-07-29T02:00:29.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.386+0000 7ffa197fc700 1 --2- 172.21.15.42:0/3543948242 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff9f806a730 0x7ff9f806cbe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa14071ec0 tx=0x7ffa10012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.386+0000 7f3c2cd85700 1 -- 172.21.15.42:0/2227605308 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3c0c000fc0 con 0x7f3c281597b0 2023-07-29T02:00:29.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.386+0000 7f2bcf7fe700 1 --2- 172.21.15.42:0/4054977817 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2bbc06a660 0x7f2bbc06cb10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0014040 tx=0x7f2bc0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.387+0000 7f230f7fe700 1 -- 172.21.15.42:0/1361537813 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f2308003b70 con 0x7f2318159450 2023-07-29T02:00:29.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.387+0000 7f230f7fe700 1 --2- 172.21.15.42:0/1361537813 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f22f806a6b0 0x7f22f806cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.387+0000 7f230f7fe700 1 -- 172.21.15.42:0/1361537813 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2308089fc0 con 0x7f2318159450 2023-07-29T02:00:29.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.388+0000 7f230f7fe700 1 --2- 172.21.15.42:0/1361537813 >> [v2:172.21.15.144:6824/131504,v1:172.21.15.144:6825/131504] conn(0x7f22f8074380 0x7f22f80767b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.388+0000 7f230f7fe700 1 -- 172.21.15.42:0/1361537813 --> [v2:172.21.15.144:6824/131504,v1:172.21.15.144:6825/131504] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22f8076e80 con 0x7f22f8074380 2023-07-29T02:00:29.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.388+0000 7f230f7fe700 1 -- 172.21.15.42:0/1361537813 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f230808a410 con 0x7f2318159450 2023-07-29T02:00:29.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.388+0000 7ff4cb7fe700 1 -- 172.21.15.42:0/3916110685 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7ff4d801a400 con 0x7ff4e414f4c0 2023-07-29T02:00:29.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.388+0000 7f484a68c700 1 -- 172.21.15.42:0/3206542418 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4824000fc0 con 0x7f48440c5510 2023-07-29T02:00:29.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.388+0000 7f2bb7fff700 1 -- 172.21.15.42:0/4054977817 <== osd.3 v2:172.21.15.42:6824/131326 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2bbc076e30 con 0x7f2bbc074330 2023-07-29T02:00:29.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.388+0000 7f230dd9b700 1 --2- 172.21.15.42:0/1361537813 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f22f806a6b0 0x7f22f806cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.388+0000 7ff4cb7fe700 1 --2- 172.21.15.42:0/3916110685 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff4cc06a810 0x7ff4cc06ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.389+0000 7f2316d9d700 1 --2- 172.21.15.42:0/1361537813 >> [v2:172.21.15.144:6824/131504,v1:172.21.15.144:6825/131504] conn(0x7f22f8074380 0x7f22f80767b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.388+0000 7f3c16ffd700 1 -- 172.21.15.42:0/2227605308 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f3c200127d0 con 0x7f3c281597b0 2023-07-29T02:00:29.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.389+0000 7f3c16ffd700 1 --2- 172.21.15.42:0/2227605308 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3c0806a730 0x7f3c0806cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.389+0000 7f3c16ffd700 1 -- 172.21.15.42:0/2227605308 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3c2008b2b0 con 0x7f3c281597b0 2023-07-29T02:00:29.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.389+0000 7f3c16ffd700 1 --2- 172.21.15.42:0/2227605308 >> [v2:172.21.15.42:6816/131312,v1:172.21.15.42:6817/131312] conn(0x7f3c08074400 0x7f3c08076830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.389+0000 7f3c16ffd700 1 -- 172.21.15.42:0/2227605308 --> [v2:172.21.15.42:6816/131312,v1:172.21.15.42:6817/131312] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c08076f00 con 0x7f3c08074400 2023-07-29T02:00:29.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.389+0000 7f3c16ffd700 1 -- 172.21.15.42:0/2227605308 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c2008b660 con 0x7f3c281597b0 2023-07-29T02:00:29.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.389+0000 7ff4cb7fe700 1 -- 172.21.15.42:0/3916110685 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff4d80894a0 con 0x7ff4e414f4c0 2023-07-29T02:00:29.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.389+0000 7ff4cb7fe700 1 --2- 172.21.15.42:0/3916110685 >> [v2:172.21.15.144:6800/131482,v1:172.21.15.144:6801/131482] conn(0x7ff4cc0744e0 0x7ff4cc076910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.389+0000 7ff4cb7fe700 1 -- 172.21.15.42:0/3916110685 --> [v2:172.21.15.144:6800/131482,v1:172.21.15.144:6801/131482] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4cc076fe0 con 0x7ff4cc0744e0 2023-07-29T02:00:29.439 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.389+0000 7ff4cb7fe700 1 -- 172.21.15.42:0/3916110685 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4d8089810 con 0x7ff4e414f4c0 2023-07-29T02:00:29.439 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.389+0000 7ff4e2ffd700 1 --2- 172.21.15.42:0/3916110685 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff4cc06a810 0x7ff4cc06ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.439 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.389+0000 7ff4e37fe700 1 --2- 172.21.15.42:0/3916110685 >> [v2:172.21.15.144:6800/131482,v1:172.21.15.144:6801/131482] conn(0x7ff4cc0744e0 0x7ff4cc076910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.439 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.389+0000 7f230dd9b700 1 --2- 172.21.15.42:0/1361537813 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f22f806a6b0 0x7f22f806cb60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f23180712d0 tx=0x7f2300007ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.440 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.390+0000 7ff4e2ffd700 1 --2- 172.21.15.42:0/3916110685 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff4cc06a810 0x7ff4cc06ccc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc009f60 tx=0x7ff4dc0094f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.440 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.390+0000 7ff4e37fe700 1 --2- 172.21.15.42:0/3916110685 >> [v2:172.21.15.144:6800/131482,v1:172.21.15.144:6801/131482] conn(0x7ff4cc0744e0 0x7ff4cc076910 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.440 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.390+0000 7f4840ff9700 1 -- 172.21.15.42:0/3206542418 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f48380075a0 con 0x7f48440c5510 2023-07-29T02:00:29.440 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.390+0000 7f4840ff9700 1 --2- 172.21.15.42:0/3206542418 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f483006a6b0 0x7f483006cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.441 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.390+0000 7ff4cb7fe700 1 -- 172.21.15.42:0/3916110685 <== osd.4 v2:172.21.15.144:6800/131482 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff4cc076fe0 con 0x7ff4cc0744e0 2023-07-29T02:00:29.441 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.391+0000 7f4840ff9700 1 -- 172.21.15.42:0/3206542418 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4838088570 con 0x7f48440c5510 2023-07-29T02:00:29.441 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.391+0000 7f4843fff700 1 --2- 172.21.15.42:0/3206542418 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f483006a6b0 0x7f483006cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.391+0000 7f4840ff9700 1 --2- 172.21.15.42:0/3206542418 >> [v2:172.21.15.42:6800/131311,v1:172.21.15.42:6801/131311] conn(0x7f4830074380 0x7f48300767b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.391+0000 7f4840ff9700 1 -- 172.21.15.42:0/3206542418 --> [v2:172.21.15.42:6800/131311,v1:172.21.15.42:6801/131311] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4830076e80 con 0x7f4830074380 2023-07-29T02:00:29.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.391+0000 7f4840ff9700 1 -- 172.21.15.42:0/3206542418 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4838088a10 con 0x7f48440c5510 2023-07-29T02:00:29.444 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.392+0000 7f75c9b4a700 1 Processor -- start 2023-07-29T02:00:29.444 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.392+0000 7f75c9b4a700 1 -- start start 2023-07-29T02:00:29.444 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.393+0000 7f75c9b4a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f75c40c6110 0x7f75c4071940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.444 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.393+0000 7f75c9b4a700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c41557d0 con 0x7f75c40c7d00 2023-07-29T02:00:29.444 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.393+0000 7f75c9b4a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c40c6c60 con 0x7f75c414f360 2023-07-29T02:00:29.445 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.393+0000 7f75c9b4a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75c40c6f40 con 0x7f75c40c6110 2023-07-29T02:00:29.445 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.393+0000 7f75c3fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f75c40c7d00 0x7f75c415fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50106/0 (socket says 172.21.15.42:50106) 2023-07-29T02:00:29.445 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.393+0000 7f75c3fff700 1 -- 172.21.15.42:0/678951072 learned_addr learned my addr 172.21.15.42:0/678951072 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:29.445 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.394+0000 7f75c2ffd700 1 --2- 172.21.15.42:0/678951072 >> v2:172.21.15.144:3300/0 conn(0x7f75c40c6110 0x7f75c4071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.445 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.394+0000 7f75c27fc700 1 -- 172.21.15.42:0/678951072 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747478341 0 0) 0x7f75c41557d0 con 0x7f75c40c7d00 2023-07-29T02:00:29.445 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.394+0000 7f75c27fc700 1 -- 172.21.15.42:0/678951072 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75ac0035b0 con 0x7f75c40c7d00 2023-07-29T02:00:29.445 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.394+0000 7f75c27fc700 1 -- 172.21.15.42:0/678951072 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2817736764 0 0) 0x7f75ac0035b0 con 0x7f75c40c7d00 2023-07-29T02:00:29.445 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.394+0000 7f75c27fc700 1 -- 172.21.15.42:0/678951072 >> v2:172.21.15.144:3300/0 conn(0x7f75c40c6110 msgr2=0x7f75c4071940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:29.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.394+0000 7f75c27fc700 1 --2- 172.21.15.42:0/678951072 >> v2:172.21.15.144:3300/0 conn(0x7f75c40c6110 0x7f75c4071940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.394+0000 7f75c27fc700 1 -- 172.21.15.42:0/678951072 >> v1:172.21.15.144:6789/0 conn(0x7f75c414f360 legacy=0x7f75c4071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.394+0000 7f75c27fc700 1 -- 172.21.15.42:0/678951072 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c40c7220 con 0x7f75c40c7d00 2023-07-29T02:00:29.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.394+0000 7f75c27fc700 1 -- 172.21.15.42:0/678951072 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7f75bc0019f0 con 0x7f75c40c7d00 2023-07-29T02:00:29.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.394+0000 7f75c27fc700 1 -- 172.21.15.42:0/678951072 >> v1:172.21.15.42:6789/0 conn(0x7f75c40c7d00 legacy=0x7f75c415fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.394+0000 7f75c27fc700 1 --2- 172.21.15.42:0/678951072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75ac003a00 0x7f75ac003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.394+0000 7f75c27fc700 1 --2- 172.21.15.42:0/678951072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75ac004850 0x7f75ac004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.447 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.394+0000 7f75c27fc700 1 --2- 172.21.15.42:0/678951072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f75ac005200 0x7f75ac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.447 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.394+0000 7f75c27fc700 1 -- 172.21.15.42:0/678951072 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c40c6f40 con 0x7f75ac003a00 2023-07-29T02:00:29.447 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.394+0000 7f75c27fc700 1 -- 172.21.15.42:0/678951072 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac00c060 con 0x7f75ac004850 2023-07-29T02:00:29.447 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.394+0000 7f75c27fc700 1 -- 172.21.15.42:0/678951072 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac00c220 con 0x7f75ac005200 2023-07-29T02:00:29.447 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.394+0000 7f75c3fff700 1 --2- 172.21.15.42:0/678951072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f75ac005200 0x7f75ac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.447 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.395+0000 7f75c2ffd700 1 --2- 172.21.15.42:0/678951072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75ac004850 0x7f75ac004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.447 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.395+0000 7f75c3fff700 1 -- 172.21.15.42:0/678951072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75ac004850 msgr2=0x7f75ac004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:29.448 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.395+0000 7f75c3fff700 1 --2- 172.21.15.42:0/678951072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75ac004850 0x7f75ac004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.448 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.395+0000 7f75c3fff700 1 -- 172.21.15.42:0/678951072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75ac003a00 msgr2=0x7f75ac003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:29.448 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.395+0000 7f75c3fff700 1 --2- 172.21.15.42:0/678951072 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75ac003a00 0x7f75ac003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.448 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.395+0000 7f75c3fff700 1 -- 172.21.15.42:0/678951072 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c40c7220 con 0x7f75ac005200 2023-07-29T02:00:29.448 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.395+0000 7f75c3fff700 1 -- 172.21.15.42:0/678951072 reap_dead start 2023-07-29T02:00:29.448 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.395+0000 7f75c3fff700 1 --2- 172.21.15.42:0/678951072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f75ac005200 0x7f75ac00ba10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f75bc00a850 tx=0x7f75ac005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f72ba6cf48fe3627 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.448 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.395+0000 7f75c27fc700 1 -- 172.21.15.42:0/678951072 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc00a2f0 con 0x7f75ac005200 2023-07-29T02:00:29.449 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.395+0000 7f75c27fc700 1 -- 172.21.15.42:0/678951072 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc012620 con 0x7f75ac005200 2023-07-29T02:00:29.449 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.395+0000 7f75c27fc700 1 -- 172.21.15.42:0/678951072 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc0129d0 con 0x7f75ac005200 2023-07-29T02:00:29.449 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.396+0000 7f75c9b4a700 1 -- 172.21.15.42:0/678951072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f75ac005200 msgr2=0x7f75ac00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.449 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.396+0000 7f75c9b4a700 1 --2- 172.21.15.42:0/678951072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f75ac005200 0x7f75ac00ba10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f75bc00a850 tx=0x7f75ac005880 comp rx=0 tx=0).stop 2023-07-29T02:00:29.449 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.396+0000 7f75c9b4a700 1 -- 172.21.15.42:0/678951072 shutdown_connections 2023-07-29T02:00:29.449 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.396+0000 7f75c9b4a700 1 --2- 172.21.15.42:0/678951072 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f75ac005200 0x7f75ac00ba10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.449 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.396+0000 7f75c9b4a700 1 -- 172.21.15.42:0/678951072 >> 172.21.15.42:0/678951072 conn(0x7f75c40cc420 msgr2=0x7f75c40c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.449 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.396+0000 7f75c9b4a700 1 -- 172.21.15.42:0/678951072 shutdown_connections 2023-07-29T02:00:29.450 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.396+0000 7f75c9b4a700 1 -- 172.21.15.42:0/678951072 wait complete. 2023-07-29T02:00:29.450 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.397+0000 7f4848c29700 1 --2- 172.21.15.42:0/3206542418 >> [v2:172.21.15.42:6800/131311,v1:172.21.15.42:6801/131311] conn(0x7f4830074380 0x7f48300767b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.450 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.397+0000 7f3c2659c700 1 --2- 172.21.15.42:0/2227605308 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3c0806a730 0x7f3c0806cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.397+0000 7f4848c29700 1 --2- 172.21.15.42:0/3206542418 >> [v2:172.21.15.42:6800/131311,v1:172.21.15.42:6801/131311] conn(0x7f4830074380 0x7f48300767b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.398+0000 7f3c25d9b700 1 --2- 172.21.15.42:0/2227605308 >> [v2:172.21.15.42:6816/131312,v1:172.21.15.42:6817/131312] conn(0x7f3c08074400 0x7f3c08076830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.398+0000 7f75c9b4a700 1 Processor -- start 2023-07-29T02:00:29.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.398+0000 7f2316d9d700 1 --2- 172.21.15.42:0/1361537813 >> [v2:172.21.15.144:6824/131504,v1:172.21.15.144:6825/131504] conn(0x7f22f8074380 0x7f22f80767b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.398+0000 7f3c25d9b700 1 --2- 172.21.15.42:0/2227605308 >> [v2:172.21.15.42:6816/131312,v1:172.21.15.42:6817/131312] conn(0x7f3c08074400 0x7f3c08076830 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.399+0000 7f230f7fe700 1 -- 172.21.15.42:0/1361537813 <== osd.6 v2:172.21.15.144:6824/131504 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f22f8076e80 con 0x7f22f8074380 2023-07-29T02:00:29.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.398+0000 7f75c9b4a700 1 -- start start 2023-07-29T02:00:29.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.399+0000 7f75c9b4a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75ac005200 0x7f75c40c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.399+0000 7f75c9b4a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75c4164dc0 0x7f75c4145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.399+0000 7f75c9b4a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f75c414fcf0 0x7f75c4150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.399+0000 7f75c9b4a700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c40c20a0 con 0x7f75c4164dc0 2023-07-29T02:00:29.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.399+0000 7f75c9b4a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c40c24c0 con 0x7f75ac005200 2023-07-29T02:00:29.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.399+0000 7f75c9b4a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c4165fe0 con 0x7f75c414fcf0 2023-07-29T02:00:29.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.400+0000 7f4840ff9700 1 -- 172.21.15.42:0/3206542418 <== osd.1 v2:172.21.15.42:6800/131311 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4830076e80 con 0x7f4830074380 2023-07-29T02:00:29.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.400+0000 7f75c37fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75ac005200 0x7f75c40c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.400+0000 7f75c37fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75ac005200 0x7f75c40c4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:39690/0 (socket says 172.21.15.42:39690) 2023-07-29T02:00:29.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.400+0000 7f75c37fe700 1 -- 172.21.15.42:0/3678156965 learned_addr learned my addr 172.21.15.42:0/3678156965 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.400+0000 7f75c3fff700 1 --2- 172.21.15.42:0/3678156965 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f75c414fcf0 0x7f75c4150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.400+0000 7f75c2ffd700 1 --2- 172.21.15.42:0/3678156965 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75c4164dc0 0x7f75c4145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.400+0000 7f75c37fe700 1 -- 172.21.15.42:0/3678156965 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f75c414fcf0 msgr2=0x7f75c4150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.400+0000 7f75c37fe700 1 --2- 172.21.15.42:0/3678156965 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f75c414fcf0 0x7f75c4150160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.456 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.400+0000 7f75c37fe700 1 -- 172.21.15.42:0/3678156965 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75c4164dc0 msgr2=0x7f75c4145010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.456 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.400+0000 7f75c37fe700 1 --2- 172.21.15.42:0/3678156965 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f75c4164dc0 0x7f75c4145010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.456 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.400+0000 7f75c37fe700 1 -- 172.21.15.42:0/3678156965 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c40c48f0 con 0x7f75ac005200 2023-07-29T02:00:29.456 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.401+0000 7f75c37fe700 1 --2- 172.21.15.42:0/3678156965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75ac005200 0x7f75c40c4d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f75b400c4d0 tx=0x7f75b400c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.456 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.401+0000 7f75abfff700 1 -- 172.21.15.42:0/3678156965 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b40052d0 con 0x7f75ac005200 2023-07-29T02:00:29.456 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.401+0000 7f75abfff700 1 -- 172.21.15.42:0/3678156965 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b4005450 con 0x7f75ac005200 2023-07-29T02:00:29.457 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.401+0000 7f75c9b4a700 1 -- 172.21.15.42:0/3678156965 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c4166230 con 0x7f75ac005200 2023-07-29T02:00:29.457 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.401+0000 7f75abfff700 1 -- 172.21.15.42:0/3678156965 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b40038c0 con 0x7f75ac005200 2023-07-29T02:00:29.457 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.402+0000 7f75c9b4a700 1 -- 172.21.15.42:0/3678156965 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c40c1cc0 con 0x7f75ac005200 2023-07-29T02:00:29.457 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.403+0000 7f75abfff700 1 -- 172.21.15.42:0/3678156965 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f75b4003a20 con 0x7f75ac005200 2023-07-29T02:00:29.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.403+0000 7f75c9b4a700 1 -- 172.21.15.42:0/3678156965 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f75c40c77e0 con 0x7f75ac005200 2023-07-29T02:00:29.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.404+0000 7f75abfff700 1 --2- 172.21.15.42:0/3678156965 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f75b006a660 0x7f75b006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.404+0000 7f4843fff700 1 --2- 172.21.15.42:0/3206542418 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f483006a6b0 0x7f483006cb60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f483c001560 tx=0x7f483c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.404+0000 7f75abfff700 1 -- 172.21.15.42:0/3678156965 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f75b4087bd0 con 0x7f75ac005200 2023-07-29T02:00:29.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.404+0000 7f75abfff700 1 --2- 172.21.15.42:0/3678156965 >> [v2:172.21.15.144:6808/131483,v1:172.21.15.144:6809/131483] conn(0x7f75b00742b0 0x7f75b00766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.404+0000 7f75abfff700 1 -- 172.21.15.42:0/3678156965 --> [v2:172.21.15.144:6808/131483,v1:172.21.15.144:6809/131483] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75b0076db0 con 0x7f75b00742b0 2023-07-29T02:00:29.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.404+0000 7f75abfff700 1 -- 172.21.15.42:0/3678156965 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75b4087f70 con 0x7f75ac005200 2023-07-29T02:00:29.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.404+0000 7f75c3fff700 1 --2- 172.21.15.42:0/3678156965 >> [v2:172.21.15.144:6808/131483,v1:172.21.15.144:6809/131483] conn(0x7f75b00742b0 0x7f75b00766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.405+0000 7f75c2ffd700 1 --2- 172.21.15.42:0/3678156965 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f75b006a660 0x7f75b006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.405+0000 7f75c3fff700 1 --2- 172.21.15.42:0/3678156965 >> [v2:172.21.15.144:6808/131483,v1:172.21.15.144:6809/131483] conn(0x7f75b00742b0 0x7f75b00766e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.406+0000 7f75c2ffd700 1 --2- 172.21.15.42:0/3678156965 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f75b006a660 0x7f75b006cb10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f75c4153070 tx=0x7f75b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.406+0000 7f75abfff700 1 -- 172.21.15.42:0/3678156965 <== osd.5 v2:172.21.15.144:6808/131483 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f75b0076db0 con 0x7f75b00742b0 2023-07-29T02:00:29.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.399+0000 7f3c16ffd700 1 -- 172.21.15.42:0/2227605308 <== osd.0 v2:172.21.15.42:6816/131312 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3c08076f00 con 0x7f3c08074400 2023-07-29T02:00:29.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.409+0000 7f3c2659c700 1 --2- 172.21.15.42:0/2227605308 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3c0806a730 0x7f3c0806cbe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3c18001600 tx=0x7f3c18007a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.463 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.420+0000 7f484a68c700 1 -- 172.21.15.42:0/3206542418 --> [v2:172.21.15.42:6800/131311,v1:172.21.15.42:6801/131311] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4824002d40 con 0x7f4830074380 2023-07-29T02:00:29.463 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.420+0000 7f4840ff9700 1 -- 172.21.15.42:0/3206542418 <== osd.1 v2:172.21.15.42:6800/131311 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4824002d40 con 0x7f4830074380 2023-07-29T02:00:29.464 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.419+0000 7fef0d778700 1 Processor -- start 2023-07-29T02:00:29.464 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.419+0000 7fef0d778700 1 -- start start 2023-07-29T02:00:29.465 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.420+0000 7fef0d778700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fef080b0d30 0x7fef080bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.465 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.420+0000 7fef0d778700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fef080c5890 0x7fef0806d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.465 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.420+0000 7fef0d778700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef0815e120 con 0x7fef080c1240 2023-07-29T02:00:29.466 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.420+0000 7fef0d778700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef08157c80 con 0x7fef080b0d30 2023-07-29T02:00:29.466 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.420+0000 7fef0d778700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef080c5d60 con 0x7fef080c5890 2023-07-29T02:00:29.466 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.420+0000 7fef077fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fef080c1240 0x7fef0806b760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50128/0 (socket says 172.21.15.42:50128) 2023-07-29T02:00:29.466 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.420+0000 7fef06ffd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fef080b0d30 0x7fef080bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.467 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.420+0000 7fef077fe700 1 -- 172.21.15.42:0/1787936876 learned_addr learned my addr 172.21.15.42:0/1787936876 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:29.467 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.421+0000 7f484a68c700 1 -- 172.21.15.42:0/3206542418 >> [v2:172.21.15.42:6800/131311,v1:172.21.15.42:6801/131311] conn(0x7f4830074380 msgr2=0x7f48300767b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.468 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.421+0000 7f484a68c700 1 --2- 172.21.15.42:0/3206542418 >> [v2:172.21.15.42:6800/131311,v1:172.21.15.42:6801/131311] conn(0x7f4830074380 0x7f48300767b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.468 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.421+0000 7fef06ffd700 1 -- 172.21.15.42:0/1787936876 >> v2:172.21.15.144:3300/0 conn(0x7fef080c5890 msgr2=0x7fef0806d9b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-29T02:00:29.468 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.421+0000 7fef06ffd700 1 --2- 172.21.15.42:0/1787936876 >> v2:172.21.15.144:3300/0 conn(0x7fef080c5890 0x7fef0806d9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.469 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.421+0000 7fef06ffd700 1 -- 172.21.15.42:0/1787936876 >> v1:172.21.15.42:6789/0 conn(0x7fef080c1240 legacy=0x7fef0806b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.469 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.421+0000 7fef06ffd700 1 -- 172.21.15.42:0/1787936876 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0815d7f0 con 0x7fef080b0d30 2023-07-29T02:00:29.469 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.421+0000 7fef06ffd700 1 --2- 172.21.15.42:0/1787936876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef080b0d30 0x7fef080bfeb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fef0806ebd0 tx=0x7feef8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cedbd32048aac5f server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.470 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.422+0000 7f484a68c700 1 -- 172.21.15.42:0/3206542418 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f483006a6b0 msgr2=0x7f483006cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.470 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.422+0000 7f484a68c700 1 --2- 172.21.15.42:0/3206542418 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f483006a6b0 0x7f483006cb60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f483c001560 tx=0x7f483c009040 comp rx=0 tx=0).stop 2023-07-29T02:00:29.470 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.422+0000 7f484a68c700 1 -- 172.21.15.42:0/3206542418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48440c5510 msgr2=0x7f48441de250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.471 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.422+0000 7f484a68c700 1 --2- 172.21.15.42:0/3206542418 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48440c5510 0x7f48441de250 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f483800c490 tx=0x7f483800c850 comp rx=0 tx=0).stop 2023-07-29T02:00:29.471 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.422+0000 7f4848c29700 1 -- 172.21.15.42:0/3206542418 reap_dead start 2023-07-29T02:00:29.471 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.422+0000 7f484a68c700 1 -- 172.21.15.42:0/3206542418 shutdown_connections 2023-07-29T02:00:29.471 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.422+0000 7f484a68c700 1 -- 172.21.15.42:0/3206542418 >> 172.21.15.42:0/3206542418 conn(0x7f48440cc420 msgr2=0x7f484406e070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.471 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.422+0000 7f484a68c700 1 -- 172.21.15.42:0/3206542418 shutdown_connections 2023-07-29T02:00:29.472 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.422+0000 7f484a68c700 1 -- 172.21.15.42:0/3206542418 wait complete. 2023-07-29T02:00:29.472 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.422+0000 7ffa1c261700 1 -- 172.21.15.42:0/3543948242 --> [v2:172.21.15.42:6808/131313,v1:172.21.15.42:6809/131313] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffa140c5cd0 con 0x7ff9f8074380 2023-07-29T02:00:29.472 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.422+0000 7ffa0a7fc700 1 -- 172.21.15.42:0/3543948242 <== osd.2 v2:172.21.15.42:6808/131313 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffa0c00f040 con 0x7ff9f8074380 2023-07-29T02:00:29.473 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.422+0000 7f2bd5bdd700 1 -- 172.21.15.42:0/4054977817 --> [v2:172.21.15.42:6824/131326,v1:172.21.15.42:6825/131326] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2bd0158820 con 0x7f2bbc074330 2023-07-29T02:00:29.473 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.422+0000 7fef05ffb700 1 -- 172.21.15.42:0/1787936876 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef8011830 con 0x7fef080b0d30 2023-07-29T02:00:29.473 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.422+0000 7fef05ffb700 1 -- 172.21.15.42:0/1787936876 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef8011990 con 0x7fef080b0d30 2023-07-29T02:00:29.473 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.422+0000 7fef05ffb700 1 -- 172.21.15.42:0/1787936876 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef8011d20 con 0x7fef080b0d30 2023-07-29T02:00:29.474 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.423+0000 7f2bb7fff700 1 -- 172.21.15.42:0/4054977817 <== osd.3 v2:172.21.15.42:6824/131326 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2bc8001d70 con 0x7f2bbc074330 2023-07-29T02:00:29.474 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.423+0000 7fef0d778700 1 -- 172.21.15.42:0/1787936876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef080b0d30 msgr2=0x7fef080bfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.475 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.423+0000 7fef0d778700 1 --2- 172.21.15.42:0/1787936876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef080b0d30 0x7fef080bfeb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fef0806ebd0 tx=0x7feef8009b20 comp rx=0 tx=0).stop 2023-07-29T02:00:29.475 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.423+0000 7fef0d778700 1 -- 172.21.15.42:0/1787936876 shutdown_connections 2023-07-29T02:00:29.475 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.423+0000 7fef0d778700 1 --2- 172.21.15.42:0/1787936876 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef080b0d30 0x7fef080bfeb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.475 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.423+0000 7fef0d778700 1 --2- 172.21.15.42:0/1787936876 >> v2:172.21.15.144:3300/0 conn(0x7fef080c5890 0x7fef0806d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.476 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.423+0000 7fef0d778700 1 -- 172.21.15.42:0/1787936876 >> 172.21.15.42:0/1787936876 conn(0x7fef080cae90 msgr2=0x7fef080cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.476 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.424+0000 7ffa1c261700 1 -- 172.21.15.42:0/3543948242 >> [v2:172.21.15.42:6808/131313,v1:172.21.15.42:6809/131313] conn(0x7ff9f8074380 msgr2=0x7ff9f80767b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.476 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.424+0000 7ffa1c261700 1 --2- 172.21.15.42:0/3543948242 >> [v2:172.21.15.42:6808/131313,v1:172.21.15.42:6809/131313] conn(0x7ff9f8074380 0x7ff9f80767b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.423+0000 7fef0d778700 1 -- 172.21.15.42:0/1787936876 shutdown_connections 2023-07-29T02:00:29.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.424+0000 7f2bd5bdd700 1 -- 172.21.15.42:0/4054977817 >> [v2:172.21.15.42:6824/131326,v1:172.21.15.42:6825/131326] conn(0x7f2bbc074330 msgr2=0x7f2bbc076760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.424+0000 7f2bd5bdd700 1 --2- 172.21.15.42:0/4054977817 >> [v2:172.21.15.42:6824/131326,v1:172.21.15.42:6825/131326] conn(0x7f2bbc074330 0x7f2bbc076760 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.424+0000 7f2bd5bdd700 1 -- 172.21.15.42:0/4054977817 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2bbc06a660 msgr2=0x7f2bbc06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.424+0000 7f2bd5bdd700 1 --2- 172.21.15.42:0/4054977817 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2bbc06a660 0x7f2bbc06cb10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0014040 tx=0x7f2bc0008030 comp rx=0 tx=0).stop 2023-07-29T02:00:29.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.424+0000 7f2bd5bdd700 1 -- 172.21.15.42:0/4054977817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd014f4c0 msgr2=0x7f2bd00c3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.424+0000 7f2bd5bdd700 1 --2- 172.21.15.42:0/4054977817 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2bd014f4c0 0x7f2bd00c3db0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4007a90 tx=0x7f2bc4007e50 comp rx=0 tx=0).stop 2023-07-29T02:00:29.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.424+0000 7f2bcffff700 1 -- 172.21.15.42:0/4054977817 reap_dead start 2023-07-29T02:00:29.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.424+0000 7fef0d778700 1 -- 172.21.15.42:0/1787936876 wait complete. 2023-07-29T02:00:29.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.424+0000 7ffa1c261700 1 -- 172.21.15.42:0/3543948242 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff9f806a730 msgr2=0x7ff9f806cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.424+0000 7ffa1c261700 1 --2- 172.21.15.42:0/3543948242 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff9f806a730 0x7ff9f806cbe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa14071ec0 tx=0x7ffa10012000 comp rx=0 tx=0).stop 2023-07-29T02:00:29.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.424+0000 7ffa1c261700 1 -- 172.21.15.42:0/3543948242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa14166aa0 msgr2=0x7ffa14164c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.424+0000 7ffa1c261700 1 --2- 172.21.15.42:0/3543948242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffa14166aa0 0x7ffa14164c10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa04000f60 tx=0x7ffa0400c730 comp rx=0 tx=0).stop 2023-07-29T02:00:29.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.424+0000 7ffa1a7fe700 1 -- 172.21.15.42:0/3543948242 reap_dead start 2023-07-29T02:00:29.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.424+0000 7f2bd5bdd700 1 -- 172.21.15.42:0/4054977817 shutdown_connections 2023-07-29T02:00:29.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.424+0000 7f2bd5bdd700 1 -- 172.21.15.42:0/4054977817 >> 172.21.15.42:0/4054977817 conn(0x7f2bd00cae90 msgr2=0x7f2bd014e210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.424+0000 7ff4e9381700 1 -- 172.21.15.42:0/3916110685 --> [v2:172.21.15.144:6800/131482,v1:172.21.15.144:6801/131482] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff4e40c6070 con 0x7ff4cc0744e0 2023-07-29T02:00:29.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.425+0000 7f2bd5bdd700 1 -- 172.21.15.42:0/4054977817 shutdown_connections 2023-07-29T02:00:29.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.425+0000 7f2bd5bdd700 1 -- 172.21.15.42:0/4054977817 wait complete. 2023-07-29T02:00:29.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.425+0000 7ff4cb7fe700 1 -- 172.21.15.42:0/3916110685 <== osd.4 v2:172.21.15.144:6800/131482 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff4d4004110 con 0x7ff4cc0744e0 2023-07-29T02:00:29.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.426+0000 7fef0d778700 1 Processor -- start 2023-07-29T02:00:29.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.426+0000 7ffa1c261700 1 -- 172.21.15.42:0/3543948242 shutdown_connections 2023-07-29T02:00:29.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.426+0000 7ffa1c261700 1 -- 172.21.15.42:0/3543948242 >> 172.21.15.42:0/3543948242 conn(0x7ffa140cae90 msgr2=0x7ffa140c64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.426+0000 7ffa1c261700 1 -- 172.21.15.42:0/3543948242 shutdown_connections 2023-07-29T02:00:29.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.426+0000 7ffa1c261700 1 -- 172.21.15.42:0/3543948242 wait complete. 2023-07-29T02:00:29.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.426+0000 7ff4e9381700 1 -- 172.21.15.42:0/3916110685 >> [v2:172.21.15.144:6800/131482,v1:172.21.15.144:6801/131482] conn(0x7ff4cc0744e0 msgr2=0x7ff4cc076910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.426+0000 7ff4e9381700 1 --2- 172.21.15.42:0/3916110685 >> [v2:172.21.15.144:6800/131482,v1:172.21.15.144:6801/131482] conn(0x7ff4cc0744e0 0x7ff4cc076910 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.426+0000 7ff4e9381700 1 -- 172.21.15.42:0/3916110685 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff4cc06a810 msgr2=0x7ff4cc06ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.426+0000 7ff4e9381700 1 --2- 172.21.15.42:0/3916110685 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff4cc06a810 0x7ff4cc06ccc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc009f60 tx=0x7ff4dc0094f0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.426+0000 7ff4e9381700 1 -- 172.21.15.42:0/3916110685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e414f4c0 msgr2=0x7ff4e4157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.426+0000 7ff4e9381700 1 --2- 172.21.15.42:0/3916110685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4e414f4c0 0x7ff4e4157a00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40c8d40 tx=0x7ff4d800b800 comp rx=0 tx=0).stop 2023-07-29T02:00:29.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.426+0000 7ff4e37fe700 1 -- 172.21.15.42:0/3916110685 reap_dead start 2023-07-29T02:00:29.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.426+0000 7fef0d778700 1 -- start start 2023-07-29T02:00:29.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.427+0000 7fef0d778700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef080b0d30 0x7fef0815a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.427+0000 7fef0d778700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef080c1240 0x7fef0806be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.427+0000 7fef0d778700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef080c5890 0x7fef080c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.427+0000 7fef0d778700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef08148390 con 0x7fef080c1240 2023-07-29T02:00:29.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.427+0000 7fef0d778700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0815ae70 con 0x7fef080c5890 2023-07-29T02:00:29.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.427+0000 7fef0d778700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef08147530 con 0x7fef080b0d30 2023-07-29T02:00:29.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.427+0000 7fef06ffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef080b0d30 0x7fef0815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.427+0000 7fef067fc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef080c1240 0x7fef0806be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.427+0000 7fef067fc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef080c1240 0x7fef0806be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56330/0 (socket says 172.21.15.42:56330) 2023-07-29T02:00:29.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.427+0000 7fef067fc700 1 -- 172.21.15.42:0/4220071481 learned_addr learned my addr 172.21.15.42:0/4220071481 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.428+0000 7fef077fe700 1 --2- 172.21.15.42:0/4220071481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef080c5890 0x7fef080c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.428+0000 7f231cc64700 1 -- 172.21.15.42:0/1361537813 --> [v2:172.21.15.144:6824/131504,v1:172.21.15.144:6825/131504] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2318158820 con 0x7f22f8074380 2023-07-29T02:00:29.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.428+0000 7fef067fc700 1 -- 172.21.15.42:0/4220071481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef080b0d30 msgr2=0x7fef0815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.428+0000 7fef067fc700 1 --2- 172.21.15.42:0/4220071481 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef080b0d30 0x7fef0815a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.428+0000 7fef067fc700 1 -- 172.21.15.42:0/4220071481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef080c5890 msgr2=0x7fef080c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.428+0000 7fef067fc700 1 --2- 172.21.15.42:0/4220071481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef080c5890 0x7fef080c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.428+0000 7fef067fc700 1 -- 172.21.15.42:0/4220071481 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef80094a0 con 0x7fef080c1240 2023-07-29T02:00:29.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.428+0000 7fef067fc700 1 --2- 172.21.15.42:0/4220071481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef080c1240 0x7fef0806be40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feefc00b450 tx=0x7feefc00b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.429+0000 7feeef7fe700 1 -- 172.21.15.42:0/4220071481 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc011830 con 0x7fef080c1240 2023-07-29T02:00:29.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.429+0000 7feeef7fe700 1 -- 172.21.15.42:0/4220071481 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feefc011990 con 0x7fef080c1240 2023-07-29T02:00:29.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.429+0000 7fef0d778700 1 -- 172.21.15.42:0/4220071481 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef08147810 con 0x7fef080c1240 2023-07-29T02:00:29.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.429+0000 7feeef7fe700 1 -- 172.21.15.42:0/4220071481 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc011d40 con 0x7fef080c1240 2023-07-29T02:00:29.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.429+0000 7fef0d778700 1 -- 172.21.15.42:0/4220071481 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef08147dd0 con 0x7fef080c1240 2023-07-29T02:00:29.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.432+0000 7f230f7fe700 1 -- 172.21.15.42:0/1361537813 <== osd.6 v2:172.21.15.144:6824/131504 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2310009a90 con 0x7f22f8074380 2023-07-29T02:00:29.489 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.432+0000 7feeef7fe700 1 -- 172.21.15.42:0/4220071481 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7feefc01a400 con 0x7fef080c1240 2023-07-29T02:00:29.489 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.432+0000 7f231cc64700 1 -- 172.21.15.42:0/1361537813 >> [v2:172.21.15.144:6824/131504,v1:172.21.15.144:6825/131504] conn(0x7f22f8074380 msgr2=0x7f22f80767b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.490 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.432+0000 7f231cc64700 1 --2- 172.21.15.42:0/1361537813 >> [v2:172.21.15.144:6824/131504,v1:172.21.15.144:6825/131504] conn(0x7f22f8074380 0x7f22f80767b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.490 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.433+0000 7f231cc64700 1 -- 172.21.15.42:0/1361537813 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f22f806a6b0 msgr2=0x7f22f806cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.490 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.433+0000 7f231cc64700 1 --2- 172.21.15.42:0/1361537813 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f22f806a6b0 0x7f22f806cb60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f23180712d0 tx=0x7f2300007ec0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.490 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.433+0000 7f231cc64700 1 -- 172.21.15.42:0/1361537813 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2318159450 msgr2=0x7f23181f3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.490 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.433+0000 7f231cc64700 1 --2- 172.21.15.42:0/1361537813 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2318159450 0x7f23181f3e20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2308000c00 tx=0x7f2308004750 comp rx=0 tx=0).stop 2023-07-29T02:00:29.490 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.433+0000 7f2316d9d700 1 -- 172.21.15.42:0/1361537813 reap_dead start 2023-07-29T02:00:29.490 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.433+0000 7f231cc64700 1 -- 172.21.15.42:0/1361537813 shutdown_connections 2023-07-29T02:00:29.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.433+0000 7f231cc64700 1 -- 172.21.15.42:0/1361537813 >> 172.21.15.42:0/1361537813 conn(0x7f23180cae90 msgr2=0x7f23180c0520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.433+0000 7f231cc64700 1 -- 172.21.15.42:0/1361537813 shutdown_connections 2023-07-29T02:00:29.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.433+0000 7f231cc64700 1 -- 172.21.15.42:0/1361537813 wait complete. 2023-07-29T02:00:29.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.433+0000 7feeef7fe700 1 --2- 172.21.15.42:0/4220071481 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7feef406a660 0x7feef406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.433+0000 7feeef7fe700 1 -- 172.21.15.42:0/4220071481 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feefc088c70 con 0x7fef080c1240 2023-07-29T02:00:29.492 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.433+0000 7fef06ffd700 1 --2- 172.21.15.42:0/4220071481 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7feef406a660 0x7feef406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.492 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.434+0000 7fef06ffd700 1 --2- 172.21.15.42:0/4220071481 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7feef406a660 0x7feef406cb10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feef80090b0 tx=0x7feef8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.492 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.435+0000 7f3c2cd85700 1 -- 172.21.15.42:0/2227605308 --> [v2:172.21.15.42:6816/131312,v1:172.21.15.42:6817/131312] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3c0c002d40 con 0x7f3c08074400 2023-07-29T02:00:29.492 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.435+0000 7ff4e9381700 1 -- 172.21.15.42:0/3916110685 shutdown_connections 2023-07-29T02:00:29.493 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.435+0000 7ff4e9381700 1 -- 172.21.15.42:0/3916110685 >> 172.21.15.42:0/3916110685 conn(0x7ff4e40cae90 msgr2=0x7ff4e414ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.493 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.435+0000 7ff4e9381700 1 -- 172.21.15.42:0/3916110685 shutdown_connections 2023-07-29T02:00:29.493 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.435+0000 7ff4e9381700 1 -- 172.21.15.42:0/3916110685 wait complete. 2023-07-29T02:00:29.493 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.435+0000 7f3c16ffd700 1 -- 172.21.15.42:0/2227605308 <== osd.0 v2:172.21.15.42:6816/131312 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3c0c002d40 con 0x7f3c08074400 2023-07-29T02:00:29.494 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.436+0000 7f3c2cd85700 1 -- 172.21.15.42:0/2227605308 >> [v2:172.21.15.42:6816/131312,v1:172.21.15.42:6817/131312] conn(0x7f3c08074400 msgr2=0x7f3c08076830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.494 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.436+0000 7f3c2cd85700 1 --2- 172.21.15.42:0/2227605308 >> [v2:172.21.15.42:6816/131312,v1:172.21.15.42:6817/131312] conn(0x7f3c08074400 0x7f3c08076830 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.494 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.436+0000 7f3c2cd85700 1 -- 172.21.15.42:0/2227605308 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3c0806a730 msgr2=0x7f3c0806cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.494 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.436+0000 7f3c2cd85700 1 --2- 172.21.15.42:0/2227605308 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3c0806a730 0x7f3c0806cbe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3c18001600 tx=0x7f3c18007a20 comp rx=0 tx=0).stop 2023-07-29T02:00:29.495 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.436+0000 7f3c2cd85700 1 -- 172.21.15.42:0/2227605308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c281597b0 msgr2=0x7f3c280b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.495 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.436+0000 7f3c2cd85700 1 --2- 172.21.15.42:0/2227605308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c281597b0 0x7f3c280b2f20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3c20015000 tx=0x7f3c20004ad0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.495 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.436+0000 7f3c26d9d700 1 -- 172.21.15.42:0/2227605308 reap_dead start 2023-07-29T02:00:29.495 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.436+0000 7f3c2cd85700 1 -- 172.21.15.42:0/2227605308 shutdown_connections 2023-07-29T02:00:29.495 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.436+0000 7f3c2cd85700 1 -- 172.21.15.42:0/2227605308 >> 172.21.15.42:0/2227605308 conn(0x7f3c28061190 msgr2=0x7f3c280cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.495 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.436+0000 7f3c2cd85700 1 -- 172.21.15.42:0/2227605308 shutdown_connections 2023-07-29T02:00:29.495 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.436+0000 7f3c2cd85700 1 -- 172.21.15.42:0/2227605308 wait complete. 2023-07-29T02:00:29.496 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.439+0000 7f75c9b4a700 1 -- 172.21.15.42:0/3678156965 --> [v2:172.21.15.144:6808/131483,v1:172.21.15.144:6809/131483] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f75c40c7500 con 0x7f75b00742b0 2023-07-29T02:00:29.496 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.439+0000 7f75abfff700 1 -- 172.21.15.42:0/3678156965 <== osd.5 v2:172.21.15.144:6808/131483 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f75bc012400 con 0x7f75b00742b0 2023-07-29T02:00:29.497 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.440+0000 7f75c9b4a700 1 -- 172.21.15.42:0/3678156965 >> [v2:172.21.15.144:6808/131483,v1:172.21.15.144:6809/131483] conn(0x7f75b00742b0 msgr2=0x7f75b00766e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.497 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.440+0000 7f75c9b4a700 1 --2- 172.21.15.42:0/3678156965 >> [v2:172.21.15.144:6808/131483,v1:172.21.15.144:6809/131483] conn(0x7f75b00742b0 0x7f75b00766e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.497 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.440+0000 7f75c9b4a700 1 -- 172.21.15.42:0/3678156965 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f75b006a660 msgr2=0x7f75b006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.497 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.440+0000 7f75c9b4a700 1 --2- 172.21.15.42:0/3678156965 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f75b006a660 0x7f75b006cb10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f75c4153070 tx=0x7f75b8008040 comp rx=0 tx=0).stop 2023-07-29T02:00:29.497 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.440+0000 7f75c9b4a700 1 -- 172.21.15.42:0/3678156965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75ac005200 msgr2=0x7f75c40c4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.497 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.440+0000 7f75c9b4a700 1 --2- 172.21.15.42:0/3678156965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f75ac005200 0x7f75c40c4d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f75b400c4d0 tx=0x7f75b400c7e0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.440+0000 7f75c3fff700 1 -- 172.21.15.42:0/3678156965 reap_dead start 2023-07-29T02:00:29.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.440+0000 7f75c9b4a700 1 -- 172.21.15.42:0/3678156965 shutdown_connections 2023-07-29T02:00:29.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.440+0000 7f75c9b4a700 1 -- 172.21.15.42:0/3678156965 >> 172.21.15.42:0/3678156965 conn(0x7f75c40cc420 msgr2=0x7f75c406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.440+0000 7f75c9b4a700 1 -- 172.21.15.42:0/3678156965 shutdown_connections 2023-07-29T02:00:29.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.440+0000 7f75c9b4a700 1 -- 172.21.15.42:0/3678156965 wait complete. 2023-07-29T02:00:29.499 INFO:teuthology.orchestra.run.smithi042.stdout:55834574860 2023-07-29T02:00:29.499 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-29T02:00:29.500 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.448+0000 7fef0d778700 1 --2- 172.21.15.42:0/4220071481 >> [v2:172.21.15.144:6816/131507,v1:172.21.15.144:6817/131507] conn(0x7fef08147fc0 0x7fef080c07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.500 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.448+0000 7fef0d778700 1 -- 172.21.15.42:0/4220071481 --> [v2:172.21.15.144:6816/131507,v1:172.21.15.144:6817/131507] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef0815dad0 con 0x7fef08147fc0 2023-07-29T02:00:29.500 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.448+0000 7fef077fe700 1 --2- 172.21.15.42:0/4220071481 >> [v2:172.21.15.144:6816/131507,v1:172.21.15.144:6817/131507] conn(0x7fef08147fc0 0x7fef080c07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.500 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.448+0000 7fef077fe700 1 --2- 172.21.15.42:0/4220071481 >> [v2:172.21.15.144:6816/131507,v1:172.21.15.144:6817/131507] conn(0x7fef08147fc0 0x7fef080c07f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.501 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.449+0000 7feeef7fe700 1 -- 172.21.15.42:0/4220071481 <== osd.7 v2:172.21.15.144:6816/131507 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fef00001f00 con 0x7fef08147fc0 2023-07-29T02:00:29.501 INFO:teuthology.orchestra.run.smithi042.stdout:55834574859 2023-07-29T02:00:29.502 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-29T02:00:29.503 INFO:teuthology.orchestra.run.smithi042.stdout:55834574858 2023-07-29T02:00:29.503 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-29T02:00:29.504 INFO:teuthology.orchestra.run.smithi042.stdout:55834574859 2023-07-29T02:00:29.504 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-29T02:00:29.505 INFO:teuthology.orchestra.run.smithi042.stdout:55834574859 2023-07-29T02:00:29.505 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-29T02:00:29.506 INFO:teuthology.orchestra.run.smithi042.stdout:55834574860 2023-07-29T02:00:29.506 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-29T02:00:29.507 INFO:teuthology.orchestra.run.smithi042.stdout:55834574858 2023-07-29T02:00:29.507 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-29T02:00:29.508 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.471+0000 7fef0d778700 1 -- 172.21.15.42:0/4220071481 --> [v2:172.21.15.144:6816/131507,v1:172.21.15.144:6817/131507] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fef080c03f0 con 0x7fef08147fc0 2023-07-29T02:00:29.508 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.472+0000 7feeef7fe700 1 -- 172.21.15.42:0/4220071481 <== osd.7 v2:172.21.15.144:6816/131507 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fef00013390 con 0x7fef08147fc0 2023-07-29T02:00:29.509 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.472+0000 7fef0d778700 1 -- 172.21.15.42:0/4220071481 >> [v2:172.21.15.144:6816/131507,v1:172.21.15.144:6817/131507] conn(0x7fef08147fc0 msgr2=0x7fef080c07f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.509 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.472+0000 7fef0d778700 1 --2- 172.21.15.42:0/4220071481 >> [v2:172.21.15.144:6816/131507,v1:172.21.15.144:6817/131507] conn(0x7fef08147fc0 0x7fef080c07f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.510 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.472+0000 7fef0d778700 1 -- 172.21.15.42:0/4220071481 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7feef406a660 msgr2=0x7feef406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.510 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.472+0000 7fef0d778700 1 --2- 172.21.15.42:0/4220071481 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7feef406a660 0x7feef406cb10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feef80090b0 tx=0x7feef8008030 comp rx=0 tx=0).stop 2023-07-29T02:00:29.510 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.472+0000 7fef0d778700 1 -- 172.21.15.42:0/4220071481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef080c1240 msgr2=0x7fef0806be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.510 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.472+0000 7fef0d778700 1 --2- 172.21.15.42:0/4220071481 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef080c1240 0x7fef0806be40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7feefc00b450 tx=0x7feefc00b760 comp rx=0 tx=0).stop 2023-07-29T02:00:29.510 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.472+0000 7fef077fe700 1 -- 172.21.15.42:0/4220071481 reap_dead start 2023-07-29T02:00:29.510 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.472+0000 7fef0d778700 1 -- 172.21.15.42:0/4220071481 shutdown_connections 2023-07-29T02:00:29.510 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.472+0000 7fef0d778700 1 -- 172.21.15.42:0/4220071481 >> 172.21.15.42:0/4220071481 conn(0x7fef080cae90 msgr2=0x7fef08071350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.510 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.472+0000 7fef0d778700 1 -- 172.21.15.42:0/4220071481 shutdown_connections 2023-07-29T02:00:29.511 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.472+0000 7fef0d778700 1 -- 172.21.15.42:0/4220071481 wait complete. 2023-07-29T02:00:29.511 INFO:teuthology.orchestra.run.smithi042.stdout:55834574859 2023-07-29T02:00:29.511 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-29T02:00:29.757 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.770+0000 7fcfc00cb700 1 Processor -- start 2023-07-29T02:00:29.757 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.770+0000 7fcfc00cb700 1 -- start start 2023-07-29T02:00:29.758 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.771+0000 7fcfc00cb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcfb80b4670 0x7fcfb8159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.758 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.771+0000 7fcfc00cb700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcfb81571e0 0x7fcfb8156500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.758 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.771+0000 7fcfc00cb700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb815a1c0 con 0x7fcfb80cf460 2023-07-29T02:00:29.759 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.771+0000 7fcfc00cb700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb80b3b70 con 0x7fcfb81571e0 2023-07-29T02:00:29.759 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.771+0000 7fcfc00cb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb80b2170 con 0x7fcfb80b4670 2023-07-29T02:00:29.759 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.771+0000 7fcfbd666700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcfb80b4670 0x7fcfb8159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.760 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.771+0000 7fcfbd666700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcfb80b4670 0x7fcfb8159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:56856/0 (socket says 172.21.15.42:56856) 2023-07-29T02:00:29.760 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.771+0000 7fcfbd666700 1 -- 172.21.15.42:0/853166658 learned_addr learned my addr 172.21.15.42:0/853166658 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.760 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.772+0000 7fcfbe668700 1 --2- 172.21.15.42:0/853166658 >> v2:172.21.15.42:3300/0 conn(0x7fcfb81571e0 0x7fcfb8156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.760 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.772+0000 7fcfbd666700 1 -- 172.21.15.42:0/853166658 >> v2:172.21.15.42:3300/0 conn(0x7fcfb81571e0 msgr2=0x7fcfb8156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:29.760 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.772+0000 7fcfbd666700 1 --2- 172.21.15.42:0/853166658 >> v2:172.21.15.42:3300/0 conn(0x7fcfb81571e0 0x7fcfb8156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.760 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.772+0000 7fcfbd666700 1 -- 172.21.15.42:0/853166658 >> v1:172.21.15.42:6789/0 conn(0x7fcfb80cf460 legacy=0x7fcfb80b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:29.760 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.772+0000 7fcfbd666700 1 -- 172.21.15.42:0/853166658 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb80b50b0 con 0x7fcfb80b4670 2023-07-29T02:00:29.761 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.772+0000 7fcfbd666700 1 --2- 172.21.15.42:0/853166658 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcfb80b4670 0x7fcfb8159c80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40098f0 tx=0x7fcfb4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fe5570093d21241 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.761 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.772+0000 7fcfbce65700 1 -- 172.21.15.42:0/853166658 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4004230 con 0x7fcfb80b4670 2023-07-29T02:00:29.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.772+0000 7fcfbce65700 1 -- 172.21.15.42:0/853166658 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb4004390 con 0x7fcfb80b4670 2023-07-29T02:00:29.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.772+0000 7fcfbce65700 1 -- 172.21.15.42:0/853166658 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40036a0 con 0x7fcfb80b4670 2023-07-29T02:00:29.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.773+0000 7fcfc00cb700 1 -- 172.21.15.42:0/853166658 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcfb80b4670 msgr2=0x7fcfb8159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.773+0000 7fcfc00cb700 1 --2- 172.21.15.42:0/853166658 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcfb80b4670 0x7fcfb8159c80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40098f0 tx=0x7fcfb4009c00 comp rx=0 tx=0).stop 2023-07-29T02:00:29.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.773+0000 7fcfc00cb700 1 -- 172.21.15.42:0/853166658 shutdown_connections 2023-07-29T02:00:29.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.773+0000 7fcfc00cb700 1 --2- 172.21.15.42:0/853166658 >> v2:172.21.15.42:3300/0 conn(0x7fcfb81571e0 0x7fcfb8156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.773+0000 7fcfc00cb700 1 --2- 172.21.15.42:0/853166658 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcfb80b4670 0x7fcfb8159c80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.773+0000 7fcfc00cb700 1 -- 172.21.15.42:0/853166658 >> 172.21.15.42:0/853166658 conn(0x7fcfb806ca60 msgr2=0x7fcfb806ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.774+0000 7fcfc00cb700 1 -- 172.21.15.42:0/853166658 shutdown_connections 2023-07-29T02:00:29.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.774+0000 7fcfc00cb700 1 -- 172.21.15.42:0/853166658 wait complete. 2023-07-29T02:00:29.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.775+0000 7fcfc00cb700 1 Processor -- start 2023-07-29T02:00:29.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.774+0000 7f2ed96d8700 1 Processor -- start 2023-07-29T02:00:29.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.774+0000 7f2ed96d8700 1 -- start start 2023-07-29T02:00:29.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.775+0000 7f2ed96d8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2ed4166aa0 0x7f2ed40c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.775+0000 7f2ed96d8700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2ed40b0e50 0x7f2ed40c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.775+0000 7f2ed96d8700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed40c02d0 con 0x7f2ed4166e70 2023-07-29T02:00:29.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.775+0000 7f2ed96d8700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed40c72e0 con 0x7f2ed40b0e50 2023-07-29T02:00:29.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.775+0000 7f2ed96d8700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed40c1870 con 0x7f2ed4166aa0 2023-07-29T02:00:29.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.776+0000 7f2ed27fc700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f2ed4166e70 0x7f2ed40c07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50150/0 (socket says 172.21.15.42:50150) 2023-07-29T02:00:29.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.776+0000 7f2ed27fc700 1 -- 172.21.15.42:0/2981057318 learned_addr learned my addr 172.21.15.42:0/2981057318 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:29.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.776+0000 7f2ed37fe700 1 --2- 172.21.15.42:0/2981057318 >> v2:172.21.15.42:3300/0 conn(0x7f2ed40b0e50 0x7f2ed40c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.776+0000 7f2ed2ffd700 1 --2- 172.21.15.42:0/2981057318 >> v2:172.21.15.144:3300/0 conn(0x7f2ed4166aa0 0x7f2ed40c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.776+0000 7f2ed37fe700 1 -- 172.21.15.42:0/2981057318 >> v2:172.21.15.144:3300/0 conn(0x7f2ed4166aa0 msgr2=0x7f2ed40c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:29.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.776+0000 7f2ed37fe700 1 --2- 172.21.15.42:0/2981057318 >> v2:172.21.15.144:3300/0 conn(0x7f2ed4166aa0 0x7f2ed40c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.776+0000 7f2ed37fe700 1 -- 172.21.15.42:0/2981057318 >> v1:172.21.15.42:6789/0 conn(0x7f2ed4166e70 legacy=0x7f2ed40c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.776+0000 7f2ed37fe700 1 -- 172.21.15.42:0/2981057318 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed40c5a10 con 0x7f2ed40b0e50 2023-07-29T02:00:29.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.777+0000 7f2ed37fe700 1 --2- 172.21.15.42:0/2981057318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ed40b0e50 0x7f2ed40c6a10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2ed406fa60 tx=0x7f2ecc007ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad54c41a7b1a482 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.777+0000 7f9a4450b700 1 Processor -- start 2023-07-29T02:00:29.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.776+0000 7fcfc00cb700 1 -- start start 2023-07-29T02:00:29.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.777+0000 7fcfc00cb700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb80b4670 0x7fcfb80c5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.777+0000 7fcfc00cb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfb80cf460 0x7fcfb81fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.777+0000 7fcfc00cb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcfb81571e0 0x7fcfb81feb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.777+0000 7fcfc00cb700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb80c8fa0 con 0x7fcfb80b4670 2023-07-29T02:00:29.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.777+0000 7fcfc00cb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb81e3160 con 0x7fcfb80cf460 2023-07-29T02:00:29.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.777+0000 7fcfc00cb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb80c5a70 con 0x7fcfb81571e0 2023-07-29T02:00:29.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.777+0000 7fcfbd666700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfb80cf460 0x7fcfb81fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.777+0000 7fcfbd666700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfb80cf460 0x7fcfb81fe5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:39728/0 (socket says 172.21.15.42:39728) 2023-07-29T02:00:29.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.777+0000 7fcfbd666700 1 -- 172.21.15.42:0/2084171084 learned_addr learned my addr 172.21.15.42:0/2084171084 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.777+0000 7f2ed1ffb700 1 -- 172.21.15.42:0/2981057318 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc004020 con 0x7f2ed40b0e50 2023-07-29T02:00:29.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.777+0000 7fcfbe668700 1 --2- 172.21.15.42:0/2084171084 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcfb81571e0 0x7fcfb81feb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.777+0000 7fcfbde67700 1 --2- 172.21.15.42:0/2084171084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb80b4670 0x7fcfb80c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.777+0000 7fcfbd666700 1 -- 172.21.15.42:0/2084171084 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcfb81571e0 msgr2=0x7fcfb81feb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.777+0000 7fcfbd666700 1 --2- 172.21.15.42:0/2084171084 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcfb81571e0 0x7fcfb81feb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.777+0000 7fcfbd666700 1 -- 172.21.15.42:0/2084171084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb80b4670 msgr2=0x7fcfb80c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.777+0000 7fcfbd666700 1 --2- 172.21.15.42:0/2084171084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb80b4670 0x7fcfb80c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.777+0000 7fcfbd666700 1 -- 172.21.15.42:0/2084171084 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb4009550 con 0x7fcfb80cf460 2023-07-29T02:00:29.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.777+0000 7fcfbde67700 1 --2- 172.21.15.42:0/2084171084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb80b4670 0x7fcfb80c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:29.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.778+0000 7f2ed1ffb700 1 -- 172.21.15.42:0/2981057318 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ecc004180 con 0x7f2ed40b0e50 2023-07-29T02:00:29.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.778+0000 7f2ed1ffb700 1 -- 172.21.15.42:0/2981057318 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc004530 con 0x7f2ed40b0e50 2023-07-29T02:00:29.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.778+0000 7fcfbd666700 1 --2- 172.21.15.42:0/2084171084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfb80cf460 0x7fcfb81fe5e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009130 tx=0x7fcfb4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.778+0000 7f9a4450b700 1 -- start start 2023-07-29T02:00:29.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.779+0000 7f9a4450b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a3c14f4c0 0x7f9a3c06d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.779+0000 7f9a4450b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9a3c159450 0x7f9a3c06def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.779+0000 7f9a4450b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3c0c5b40 con 0x7f9a3c0bfeb0 2023-07-29T02:00:29.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.779+0000 7f9a4450b700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3c06c210 con 0x7f9a3c159450 2023-07-29T02:00:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.779+0000 7f9a4450b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c06c4f0 con 0x7f9a3c14f4c0 2023-07-29T02:00:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.779+0000 7f9a422a7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a3c14f4c0 0x7f9a3c06d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.779+0000 7f9a422a7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a3c14f4c0 0x7f9a3c06d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:56870/0 (socket says 172.21.15.42:56870) 2023-07-29T02:00:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.779+0000 7f9a41aa6700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9a3c0bfeb0 0x7f9a3c158d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.42:52654/0 (socket says 172.21.15.42:52654) 2023-07-29T02:00:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.779+0000 7f9a422a7700 1 -- 172.21.15.42:0/1527754006 learned_addr learned my addr 172.21.15.42:0/1527754006 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.779+0000 7f9a42aa8700 1 --2- 172.21.15.42:0/1527754006 >> v2:172.21.15.42:3300/0 conn(0x7f9a3c159450 0x7f9a3c06def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.780+0000 7f9a42aa8700 1 -- 172.21.15.42:0/1527754006 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a3c14f4c0 msgr2=0x7f9a3c06d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:29.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.780+0000 7f9a42aa8700 1 --2- 172.21.15.42:0/1527754006 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a3c14f4c0 0x7f9a3c06d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.780+0000 7f9a42aa8700 1 -- 172.21.15.42:0/1527754006 >> v1:172.21.15.144:6789/0 conn(0x7f9a3c0bfeb0 legacy=0x7f9a3c158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:29.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.780+0000 7f9a42aa8700 1 -- 172.21.15.42:0/1527754006 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c0c5d90 con 0x7f9a3c159450 2023-07-29T02:00:29.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.780+0000 7f9a42aa8700 1 --2- 172.21.15.42:0/1527754006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a3c159450 0x7f9a3c06def0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c009840 tx=0x7f9a2c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9f6f391a01a9bf server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.781+0000 7f9a412a5700 1 -- 172.21.15.42:0/1527754006 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c004230 con 0x7f9a3c159450 2023-07-29T02:00:29.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.781+0000 7f9a412a5700 1 -- 172.21.15.42:0/1527754006 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c004390 con 0x7f9a3c159450 2023-07-29T02:00:29.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.781+0000 7f9a412a5700 1 -- 172.21.15.42:0/1527754006 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c0036a0 con 0x7f9a3c159450 2023-07-29T02:00:29.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.779+0000 7f701b78a700 1 Processor -- start 2023-07-29T02:00:29.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.779+0000 7f701b78a700 1 -- start start 2023-07-29T02:00:29.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.780+0000 7f701b78a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7014166aa0 0x7f70140c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.780+0000 7f701b78a700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70140c02d0 con 0x7f7014166e70 2023-07-29T02:00:29.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.780+0000 7f701b78a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70140c5a10 con 0x7f70140b0e50 2023-07-29T02:00:29.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.780+0000 7f701b78a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70140c72e0 con 0x7f7014166aa0 2023-07-29T02:00:29.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.781+0000 7f7018d25700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f7014166e70 0x7f70140c07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50166/0 (socket says 172.21.15.42:50166) 2023-07-29T02:00:29.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.781+0000 7f7018d25700 1 -- 172.21.15.42:0/489556576 learned_addr learned my addr 172.21.15.42:0/489556576 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:29.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.781+0000 7f7019526700 1 --2- 172.21.15.42:0/489556576 >> v2:172.21.15.144:3300/0 conn(0x7f7014166aa0 0x7f70140c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.781+0000 7f700bfff700 1 -- 172.21.15.42:0/489556576 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223076016 0 0) 0x7f70140c02d0 con 0x7f7014166e70 2023-07-29T02:00:29.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.781+0000 7f700bfff700 1 -- 172.21.15.42:0/489556576 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70000035b0 con 0x7f7014166e70 2023-07-29T02:00:29.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.781+0000 7f7019526700 1 -- 172.21.15.42:0/489556576 >> v1:172.21.15.144:6789/0 conn(0x7f70140b0e50 legacy=0x7f7014170710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.781+0000 7f700bfff700 1 -- 172.21.15.42:0/489556576 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491495118 0 0) 0x7f70140c5a10 con 0x7f70140b0e50 2023-07-29T02:00:29.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.781+0000 7f7019526700 1 -- 172.21.15.42:0/489556576 >> v1:172.21.15.42:6789/0 conn(0x7f7014166e70 legacy=0x7f70140c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.781+0000 7f7019526700 1 -- 172.21.15.42:0/489556576 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701406e3c0 con 0x7f7014166aa0 2023-07-29T02:00:29.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.782+0000 7f7019526700 1 --2- 172.21.15.42:0/489556576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7014166aa0 0x7f70140c64d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f701000a950 tx=0x7f701000ac60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ab8d24ccd0a8e52 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.782+0000 7f9a4450b700 1 -- 172.21.15.42:0/1527754006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a3c159450 msgr2=0x7f9a3c06def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.782+0000 7f9a4450b700 1 --2- 172.21.15.42:0/1527754006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a3c159450 0x7f9a3c06def0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c009840 tx=0x7f9a2c009b50 comp rx=0 tx=0).stop 2023-07-29T02:00:29.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.782+0000 7f9a4450b700 1 -- 172.21.15.42:0/1527754006 shutdown_connections 2023-07-29T02:00:29.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.782+0000 7f9a4450b700 1 --2- 172.21.15.42:0/1527754006 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a3c159450 0x7f9a3c06def0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.782+0000 7f9a4450b700 1 --2- 172.21.15.42:0/1527754006 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a3c14f4c0 0x7f9a3c06d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.779 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.782+0000 7f9a4450b700 1 -- 172.21.15.42:0/1527754006 >> 172.21.15.42:0/1527754006 conn(0x7f9a3c0cae90 msgr2=0x7f9a3c0cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.779 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.782+0000 7f9a4450b700 1 -- 172.21.15.42:0/1527754006 shutdown_connections 2023-07-29T02:00:29.779 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.782+0000 7f9a4450b700 1 -- 172.21.15.42:0/1527754006 wait complete. 2023-07-29T02:00:29.779 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.782+0000 7f700bfff700 1 -- 172.21.15.42:0/489556576 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701000c8c0 con 0x7f7014166aa0 2023-07-29T02:00:29.779 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.782+0000 7f700bfff700 1 -- 172.21.15.42:0/489556576 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701000ca20 con 0x7f7014166aa0 2023-07-29T02:00:29.779 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.782+0000 7f700bfff700 1 -- 172.21.15.42:0/489556576 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701000cd90 con 0x7f7014166aa0 2023-07-29T02:00:29.780 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.783+0000 7f701b78a700 1 -- 172.21.15.42:0/489556576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7014166aa0 msgr2=0x7f70140c64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.780 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.783+0000 7f701b78a700 1 --2- 172.21.15.42:0/489556576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7014166aa0 0x7f70140c64d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f701000a950 tx=0x7f701000ac60 comp rx=0 tx=0).stop 2023-07-29T02:00:29.780 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.783+0000 7f0174a32700 1 Processor -- start 2023-07-29T02:00:29.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.783+0000 7f701b78a700 1 -- 172.21.15.42:0/489556576 shutdown_connections 2023-07-29T02:00:29.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.783+0000 7f701b78a700 1 --2- 172.21.15.42:0/489556576 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7014166aa0 0x7f70140c64d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.783+0000 7f701b78a700 1 -- 172.21.15.42:0/489556576 >> 172.21.15.42:0/489556576 conn(0x7f70140cae90 msgr2=0x7f70140cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.783+0000 7f701b78a700 1 -- 172.21.15.42:0/489556576 shutdown_connections 2023-07-29T02:00:29.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.783+0000 7f701b78a700 1 -- 172.21.15.42:0/489556576 wait complete. 2023-07-29T02:00:29.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.784+0000 7f9a4450b700 1 Processor -- start 2023-07-29T02:00:29.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.778+0000 7fcfae7fc700 1 -- 172.21.15.42:0/2084171084 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4003c40 con 0x7fcfb80cf460 2023-07-29T02:00:29.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.778+0000 7fcfae7fc700 1 -- 172.21.15.42:0/2084171084 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb401f070 con 0x7fcfb80cf460 2023-07-29T02:00:29.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.778+0000 7fcfae7fc700 1 -- 172.21.15.42:0/2084171084 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb400b660 con 0x7fcfb80cf460 2023-07-29T02:00:29.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.784+0000 7fcfc00cb700 1 -- 172.21.15.42:0/2084171084 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb81fcf60 con 0x7fcfb80cf460 2023-07-29T02:00:29.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.784+0000 7fcfc00cb700 1 -- 172.21.15.42:0/2084171084 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb80c89e0 con 0x7fcfb80cf460 2023-07-29T02:00:29.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.784+0000 7f9a4450b700 1 -- start start 2023-07-29T02:00:29.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.783+0000 7f0174a32700 1 -- start start 2023-07-29T02:00:29.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7f0174a32700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0170070ae0 0x7f01700c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7f0174a32700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0170070eb0 0x7f0170161690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7f0174a32700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01700c6170 con 0x7f017006feb0 2023-07-29T02:00:29.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7f0174a32700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01700c78f0 con 0x7f0170070eb0 2023-07-29T02:00:29.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7f0174a32700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01700c5cf0 con 0x7f0170070ae0 2023-07-29T02:00:29.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7f016e59c700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f017006feb0 0x7f0170160f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50174/0 (socket says 172.21.15.42:50174) 2023-07-29T02:00:29.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7f016e59c700 1 -- 172.21.15.42:0/1595505273 learned_addr learned my addr 172.21.15.42:0/1595505273 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:29.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7f9a4450b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a3c14f4c0 0x7f9a3c1efe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7f9a4450b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a3c159450 0x7f9a3c1f0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7f9a4450b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a3c1488a0 0x7f9a3c14b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7f9a4450b700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c0c25c0 con 0x7f9a3c14f4c0 2023-07-29T02:00:29.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7f9a4450b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c14b1a0 con 0x7f9a3c1488a0 2023-07-29T02:00:29.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7f9a4450b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c14a640 con 0x7f9a3c159450 2023-07-29T02:00:29.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7f9a422a7700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a3c14f4c0 0x7f9a3c1efe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7f9a422a7700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a3c14f4c0 0x7f9a3c1efe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56376/0 (socket says 172.21.15.42:56376) 2023-07-29T02:00:29.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7f9a422a7700 1 -- 172.21.15.42:0/3445214230 learned_addr learned my addr 172.21.15.42:0/3445214230 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7fcf0204f700 1 Processor -- start 2023-07-29T02:00:29.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7f016f59e700 1 --2- 172.21.15.42:0/1595505273 >> v2:172.21.15.42:3300/0 conn(0x7f0170070eb0 0x7f0170161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7f016dd9b700 1 -- 172.21.15.42:0/1595505273 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3317215606 0 0) 0x7f01700c6170 con 0x7f017006feb0 2023-07-29T02:00:29.788 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f016dd9b700 1 -- 172.21.15.42:0/1595505273 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01580035b0 con 0x7f017006feb0 2023-07-29T02:00:29.788 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.779+0000 7f2ed96d8700 1 -- 172.21.15.42:0/2981057318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ed40b0e50 msgr2=0x7f2ed40c6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.788 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.779+0000 7f2ed96d8700 1 --2- 172.21.15.42:0/2981057318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ed40b0e50 0x7f2ed40c6a10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2ed406fa60 tx=0x7f2ecc007ba0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.788 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7f9a41aa6700 1 --2- 172.21.15.42:0/3445214230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a3c159450 0x7f9a3c1f0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f2ed96d8700 1 -- 172.21.15.42:0/2981057318 shutdown_connections 2023-07-29T02:00:29.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f2ed96d8700 1 --2- 172.21.15.42:0/2981057318 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ed40b0e50 0x7f2ed40c6a10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f2ed96d8700 1 --2- 172.21.15.42:0/2981057318 >> v2:172.21.15.144:3300/0 conn(0x7f2ed4166aa0 0x7f2ed40c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f2ed96d8700 1 -- 172.21.15.42:0/2981057318 >> 172.21.15.42:0/2981057318 conn(0x7f2ed40cae90 msgr2=0x7f2ed40cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.785+0000 7f701b78a700 1 Processor -- start 2023-07-29T02:00:29.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f016dd9b700 1 -- 172.21.15.42:0/1595505273 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1623656210 0 0) 0x7f01580035b0 con 0x7f017006feb0 2023-07-29T02:00:29.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f016dd9b700 1 -- 172.21.15.42:0/1595505273 >> v2:172.21.15.144:3300/0 conn(0x7f0170070ae0 msgr2=0x7f01700c7d10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-29T02:00:29.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f016dd9b700 1 --2- 172.21.15.42:0/1595505273 >> v2:172.21.15.144:3300/0 conn(0x7f0170070ae0 0x7f01700c7d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.791 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f016dd9b700 1 -- 172.21.15.42:0/1595505273 >> v2:172.21.15.42:3300/0 conn(0x7f0170070eb0 msgr2=0x7f0170161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:29.791 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f016dd9b700 1 --2- 172.21.15.42:0/1595505273 >> v2:172.21.15.42:3300/0 conn(0x7f0170070eb0 0x7f0170161690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.791 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f016dd9b700 1 -- 172.21.15.42:0/1595505273 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01700c7550 con 0x7f017006feb0 2023-07-29T02:00:29.791 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f016dd9b700 1 -- 172.21.15.42:0/1595505273 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7f0160001670 con 0x7f017006feb0 2023-07-29T02:00:29.791 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f016dd9b700 1 -- 172.21.15.42:0/1595505273 >> v1:172.21.15.42:6789/0 conn(0x7f017006feb0 legacy=0x7f0170160f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.791 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f016dd9b700 1 --2- 172.21.15.42:0/1595505273 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0158003a00 0x7f0158003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f9a422a7700 1 -- 172.21.15.42:0/3445214230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a3c159450 msgr2=0x7f9a3c1f0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f9a422a7700 1 --2- 172.21.15.42:0/3445214230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a3c159450 0x7f9a3c1f0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f9a422a7700 1 -- 172.21.15.42:0/3445214230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a3c1488a0 msgr2=0x7f9a3c14b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f9a422a7700 1 --2- 172.21.15.42:0/3445214230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a3c1488a0 0x7f9a3c14b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f9a422a7700 1 -- 172.21.15.42:0/3445214230 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c0094a0 con 0x7f9a3c14f4c0 2023-07-29T02:00:29.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f016dd9b700 1 --2- 172.21.15.42:0/1595505273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0158004850 0x7f0158004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f016dd9b700 1 --2- 172.21.15.42:0/1595505273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0158005200 0x7f015800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f016dd9b700 1 -- 172.21.15.42:0/1595505273 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01700c78f0 con 0x7f0158004850 2023-07-29T02:00:29.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f016dd9b700 1 -- 172.21.15.42:0/1595505273 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01700c5cf0 con 0x7f0158005200 2023-07-29T02:00:29.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f016dd9b700 1 -- 172.21.15.42:0/1595505273 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015800c100 con 0x7f0158003a00 2023-07-29T02:00:29.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7fcfc00cb700 1 -- 172.21.15.42:0/2084171084 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb804ea50 con 0x7fcfb80cf460 2023-07-29T02:00:29.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f016f59e700 1 --2- 172.21.15.42:0/1595505273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0158005200 0x7f015800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f9a422a7700 1 --2- 172.21.15.42:0/3445214230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a3c14f4c0 0x7f9a3c1efe30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9a3800e910 tx=0x7f9a3800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.795 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f016e59c700 1 --2- 172.21.15.42:0/1595505273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0158004850 0x7f0158004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.795 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f9a32ffd700 1 -- 172.21.15.42:0/3445214230 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a380096a0 con 0x7f9a3c14f4c0 2023-07-29T02:00:29.795 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f9a32ffd700 1 -- 172.21.15.42:0/3445214230 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3800ee60 con 0x7f9a3c14f4c0 2023-07-29T02:00:29.795 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f9a32ffd700 1 -- 172.21.15.42:0/3445214230 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3800ca70 con 0x7f9a3c14f4c0 2023-07-29T02:00:29.796 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f016f59e700 1 -- 172.21.15.42:0/1595505273 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0158003a00 msgr2=0x7f0158003e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-29T02:00:29.796 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f016f59e700 1 --2- 172.21.15.42:0/1595505273 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0158003a00 0x7f0158003e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.796 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f016f59e700 1 -- 172.21.15.42:0/1595505273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0158004850 msgr2=0x7f0158004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:29.797 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f016f59e700 1 --2- 172.21.15.42:0/1595505273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0158004850 0x7f0158004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.797 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f016f59e700 1 -- 172.21.15.42:0/1595505273 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01700c7550 con 0x7f0158005200 2023-07-29T02:00:29.797 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f016f59e700 1 -- 172.21.15.42:0/1595505273 reap_dead start 2023-07-29T02:00:29.797 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f016e59c700 1 --2- 172.21.15.42:0/1595505273 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0158004850 0x7f0158004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:29.797 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f016f59e700 1 --2- 172.21.15.42:0/1595505273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0158005200 0x7f015800ba10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0168009f90 tx=0x7f0158005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d72a381accf2970 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.797 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f2ed96d8700 1 -- 172.21.15.42:0/2981057318 shutdown_connections 2023-07-29T02:00:29.798 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7fcf0204f700 1 -- start start 2023-07-29T02:00:29.798 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7fcf0204f700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcefc14f4c0 0x7fcefc06d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.798 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7fcf0204f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcefc0bfeb0 0x7fcefc06def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.798 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7fcf0204f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcefc0c5b40 con 0x7fcefc0c73d0 2023-07-29T02:00:29.798 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7fcf0204f700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcefc06c210 con 0x7fcefc14f4c0 2023-07-29T02:00:29.799 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7fcf0204f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc06c4f0 con 0x7fcefc0bfeb0 2023-07-29T02:00:29.799 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7fcefb7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcefc14f4c0 0x7fcefc06d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.799 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7fcefb7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcefc14f4c0 0x7fcefc06d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56384/0 (socket says 172.21.15.42:56384) 2023-07-29T02:00:29.799 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7fcefb7fe700 1 -- 172.21.15.42:0/1555969403 learned_addr learned my addr 172.21.15.42:0/1555969403 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.799 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.788+0000 7fcefb7fe700 1 -- 172.21.15.42:0/1555969403 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcefc0bfeb0 msgr2=0x7fcefc06def0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-29T02:00:29.799 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.788+0000 7fcefb7fe700 1 --2- 172.21.15.42:0/1555969403 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcefc0bfeb0 0x7fcefc06def0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.800 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.788+0000 7fcefb7fe700 1 -- 172.21.15.42:0/1555969403 >> v1:172.21.15.144:6789/0 conn(0x7fcefc0c73d0 legacy=0x7fcefc158d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-29T02:00:29.800 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.788+0000 7fcefb7fe700 1 -- 172.21.15.42:0/1555969403 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc0c5d90 con 0x7fcefc14f4c0 2023-07-29T02:00:29.800 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f016dd9b700 1 -- 172.21.15.42:0/1595505273 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168003a20 con 0x7f0158005200 2023-07-29T02:00:29.800 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f016dd9b700 1 -- 172.21.15.42:0/1595505273 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016800f040 con 0x7f0158005200 2023-07-29T02:00:29.800 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f016dd9b700 1 -- 172.21.15.42:0/1595505273 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168003dc0 con 0x7f0158005200 2023-07-29T02:00:29.801 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.788+0000 7f9a4450b700 1 -- 172.21.15.42:0/3445214230 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3c14a900 con 0x7f9a3c14f4c0 2023-07-29T02:00:29.801 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.788+0000 7fcefb7fe700 1 --2- 172.21.15.42:0/1555969403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcefc14f4c0 0x7fcefc06d9b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009e50 tx=0x7fcef400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1a276ecdbf4aa4 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.802 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.788+0000 7fcfae7fc700 1 -- 172.21.15.42:0/2084171084 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fcfb4021030 con 0x7fcfb80cf460 2023-07-29T02:00:29.802 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.789+0000 7fcfae7fc700 1 --2- 172.21.15.42:0/2084171084 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcf9c06a6b0 0x7fcf9c06cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.802 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.786+0000 7f701b78a700 1 -- start start 2023-07-29T02:00:29.802 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f701b78a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7014166aa0 0x7f7014204310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.802 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f701b78a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f701408ad10 0x7f70140c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.803 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f701b78a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70141ef2a0 0x7f70141ef740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.803 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f701b78a700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70140c4930 con 0x7f7014166aa0 2023-07-29T02:00:29.803 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f701b78a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70141eeb30 con 0x7f701408ad10 2023-07-29T02:00:29.803 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.787+0000 7f701b78a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70140c4b80 con 0x7f70141ef2a0 2023-07-29T02:00:29.804 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.788+0000 7f9a4450b700 1 -- 172.21.15.42:0/3445214230 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3c14aec0 con 0x7f9a3c14f4c0 2023-07-29T02:00:29.804 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.789+0000 7f7018d25700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f701408ad10 0x7f70140c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.804 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.789+0000 7f7019d27700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70141ef2a0 0x7f70141ef740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.804 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.789+0000 7f7019526700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7014166aa0 0x7f7014204310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.804 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.789+0000 7f7019526700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7014166aa0 0x7f7014204310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56392/0 (socket says 172.21.15.42:56392) 2023-07-29T02:00:29.805 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.789+0000 7f7019526700 1 -- 172.21.15.42:0/1637891715 learned_addr learned my addr 172.21.15.42:0/1637891715 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.805 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.790+0000 7f9a4450b700 1 -- 172.21.15.42:0/3445214230 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3c04ea50 con 0x7f9a3c14f4c0 2023-07-29T02:00:29.805 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.788+0000 7f2ed96d8700 1 -- 172.21.15.42:0/2981057318 wait complete. 2023-07-29T02:00:29.806 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.790+0000 7f7019526700 1 -- 172.21.15.42:0/1637891715 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70141ef2a0 msgr2=0x7f70141ef740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.806 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.790+0000 7f7019526700 1 --2- 172.21.15.42:0/1637891715 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70141ef2a0 0x7f70141ef740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.806 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.790+0000 7f7019526700 1 -- 172.21.15.42:0/1637891715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f701408ad10 msgr2=0x7f70140c3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.806 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.790+0000 7f7019526700 1 --2- 172.21.15.42:0/1637891715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f701408ad10 0x7f70140c3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.806 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.790+0000 7f7019526700 1 -- 172.21.15.42:0/1637891715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701000a5b0 con 0x7f7014166aa0 2023-07-29T02:00:29.807 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.790+0000 7f2ed96d8700 1 Processor -- start 2023-07-29T02:00:29.807 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.790+0000 7fcefa7fc700 1 -- 172.21.15.42:0/1555969403 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4003c20 con 0x7fcefc14f4c0 2023-07-29T02:00:29.807 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.790+0000 7fcefa7fc700 1 -- 172.21.15.42:0/1555969403 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef4003d80 con 0x7fcefc14f4c0 2023-07-29T02:00:29.807 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.790+0000 7fcefa7fc700 1 -- 172.21.15.42:0/1555969403 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef400bbc0 con 0x7fcefc14f4c0 2023-07-29T02:00:29.808 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.790+0000 7fcfbde67700 1 --2- 172.21.15.42:0/2084171084 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcf9c06a6b0 0x7fcf9c06cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.808 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.790+0000 7fcfae7fc700 1 -- 172.21.15.42:0/2084171084 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcfb408a1c0 con 0x7fcfb80cf460 2023-07-29T02:00:29.808 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.790+0000 7fcfbde67700 1 --2- 172.21.15.42:0/2084171084 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcf9c06a6b0 0x7fcf9c06cb60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8003fc0 tx=0x7fcfa8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.808 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.790+0000 7f7019d27700 1 --2- 172.21.15.42:0/1637891715 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70141ef2a0 0x7f70141ef740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:29.808 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.790+0000 7f7018d25700 1 --2- 172.21.15.42:0/1637891715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f701408ad10 0x7f70140c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:29.809 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.790+0000 7f7019526700 1 --2- 172.21.15.42:0/1637891715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7014166aa0 0x7f7014204310 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f701406fa90 tx=0x7f7010004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.809 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.790+0000 7f7009ffb700 1 -- 172.21.15.42:0/1637891715 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7010004040 con 0x7f7014166aa0 2023-07-29T02:00:29.809 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.791+0000 7f7009ffb700 1 -- 172.21.15.42:0/1637891715 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70100041a0 con 0x7f7014166aa0 2023-07-29T02:00:29.809 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.791+0000 7f7009ffb700 1 -- 172.21.15.42:0/1637891715 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7010004530 con 0x7f7014166aa0 2023-07-29T02:00:29.809 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.791+0000 7f701b78a700 1 -- 172.21.15.42:0/1637891715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70140c4e60 con 0x7f7014166aa0 2023-07-29T02:00:29.809 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.791+0000 7f701b78a700 1 -- 172.21.15.42:0/1637891715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70141eed80 con 0x7f7014166aa0 2023-07-29T02:00:29.810 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.790+0000 7f3d00bbd700 1 Processor -- start 2023-07-29T02:00:29.810 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.790+0000 7f3d00bbd700 1 -- start start 2023-07-29T02:00:29.810 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.788+0000 7f0174a32700 1 -- 172.21.15.42:0/1595505273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0158005200 msgr2=0x7f015800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.810 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.788+0000 7f0174a32700 1 --2- 172.21.15.42:0/1595505273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0158005200 0x7f015800ba10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0168009f90 tx=0x7f0158005880 comp rx=0 tx=0).stop 2023-07-29T02:00:29.810 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.789+0000 7f0174a32700 1 -- 172.21.15.42:0/1595505273 shutdown_connections 2023-07-29T02:00:29.811 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.789+0000 7f0174a32700 1 --2- 172.21.15.42:0/1595505273 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0158005200 0x7f015800ba10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.811 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.789+0000 7f0174a32700 1 -- 172.21.15.42:0/1595505273 >> 172.21.15.42:0/1595505273 conn(0x7f017006daa0 msgr2=0x7f017006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.811 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.791+0000 7f0174a32700 1 -- 172.21.15.42:0/1595505273 shutdown_connections 2023-07-29T02:00:29.811 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.790+0000 7f9a32ffd700 1 -- 172.21.15.42:0/3445214230 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f9a3800cbd0 con 0x7f9a3c14f4c0 2023-07-29T02:00:29.811 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.791+0000 7f9a32ffd700 1 --2- 172.21.15.42:0/3445214230 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a2006a660 0x7f9a2006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.811 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.791+0000 7f9a32ffd700 1 -- 172.21.15.42:0/3445214230 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9a38088d30 con 0x7f9a3c14f4c0 2023-07-29T02:00:29.812 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.792+0000 7f3d00bbd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cfc14fff0 0x7f3cfc070b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.812 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.792+0000 7f3d00bbd700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cfc0c91b0 con 0x7f3cfc14fc20 2023-07-29T02:00:29.812 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.792+0000 7f3d00bbd700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cfc1592f0 con 0x7f3cfc06b860 2023-07-29T02:00:29.812 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.792+0000 7f3d00bbd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc1595d0 con 0x7f3cfc14fff0 2023-07-29T02:00:29.812 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.792+0000 7f3cfad9d700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f3cfc06b860 0x7f3cfc155cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.42:52698/0 (socket says 172.21.15.42:52698) 2023-07-29T02:00:29.813 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.792+0000 7f3cfad9d700 1 -- 172.21.15.42:0/4013086797 learned_addr learned my addr 172.21.15.42:0/4013086797 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:29.813 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.792+0000 7f3cf9d9b700 1 --2- 172.21.15.42:0/4013086797 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cfc14fff0 0x7f3cfc070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.813 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.791+0000 7fcf0204f700 1 -- 172.21.15.42:0/1555969403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcefc14f4c0 msgr2=0x7fcefc06d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.813 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.791+0000 7fcf0204f700 1 --2- 172.21.15.42:0/1555969403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcefc14f4c0 0x7fcefc06d9b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009e50 tx=0x7fcef400b330 comp rx=0 tx=0).stop 2023-07-29T02:00:29.814 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.792+0000 7f2ed96d8700 1 -- start start 2023-07-29T02:00:29.814 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.792+0000 7f701b78a700 1 -- 172.21.15.42:0/1637891715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff40052f0 con 0x7f7014166aa0 2023-07-29T02:00:29.814 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.793+0000 7f3cf9d9b700 1 -- 172.21.15.42:0/4013086797 >> v1:172.21.15.144:6789/0 conn(0x7f3cfc06b860 legacy=0x7f3cfc155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.814 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.793+0000 7f3cf9d9b700 1 -- 172.21.15.42:0/4013086797 >> v1:172.21.15.42:6789/0 conn(0x7f3cfc14fc20 legacy=0x7f3cfc0c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.814 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.793+0000 7f3cf9d9b700 1 -- 172.21.15.42:0/4013086797 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cfc1598b0 con 0x7f3cfc14fff0 2023-07-29T02:00:29.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.793+0000 7fcf0204f700 1 -- 172.21.15.42:0/1555969403 shutdown_connections 2023-07-29T02:00:29.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.793+0000 7fcf0204f700 1 --2- 172.21.15.42:0/1555969403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcefc14f4c0 0x7fcefc06d9b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.793+0000 7fcf0204f700 1 --2- 172.21.15.42:0/1555969403 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcefc0bfeb0 0x7fcefc06def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.793+0000 7fcf0204f700 1 -- 172.21.15.42:0/1555969403 >> 172.21.15.42:0/1555969403 conn(0x7fcefc0cae90 msgr2=0x7fcefc0cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.793+0000 7fcf0204f700 1 -- 172.21.15.42:0/1555969403 shutdown_connections 2023-07-29T02:00:29.816 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.793+0000 7fcf0204f700 1 -- 172.21.15.42:0/1555969403 wait complete. 2023-07-29T02:00:29.816 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.792+0000 7f9a41aa6700 1 --2- 172.21.15.42:0/3445214230 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a2006a660 0x7f9a2006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.816 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.792+0000 7f9a41aa6700 1 --2- 172.21.15.42:0/3445214230 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a2006a660 0x7f9a2006cb10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c152d80 tx=0x7f9a34005440 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.816 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.792+0000 7f0174a32700 1 -- 172.21.15.42:0/1595505273 wait complete. 2023-07-29T02:00:29.817 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.793+0000 7f2ed96d8700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ed4166aa0 0x7f2ed40ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.817 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.793+0000 7f2ed96d8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ed41eea40 0x7f2ed420ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.817 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.793+0000 7f2ed96d8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ed420d3c0 0x7f2ed42100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.817 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.793+0000 7f2ed96d8700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed41f4a40 con 0x7f2ed4166aa0 2023-07-29T02:00:29.818 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.793+0000 7f2ed96d8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed420d830 con 0x7f2ed41eea40 2023-07-29T02:00:29.818 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.793+0000 7f2ed96d8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed41f3de0 con 0x7f2ed420d3c0 2023-07-29T02:00:29.818 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.794+0000 7f2ed37fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ed420d3c0 0x7f2ed42100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.818 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.794+0000 7f2ed37fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ed420d3c0 0x7f2ed42100a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:56920/0 (socket says 172.21.15.42:56920) 2023-07-29T02:00:29.818 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.794+0000 7f2ed37fe700 1 -- 172.21.15.42:0/4112800108 learned_addr learned my addr 172.21.15.42:0/4112800108 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.818 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.793+0000 7f3cf9d9b700 1 --2- 172.21.15.42:0/4013086797 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cfc14fff0 0x7f3cfc070b00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009870 tx=0x7f3cec009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9eb484ecc03621d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.819 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.793+0000 7f3cf959a700 1 -- 172.21.15.42:0/4013086797 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec011830 con 0x7f3cfc14fff0 2023-07-29T02:00:29.819 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.793+0000 7f3cf959a700 1 -- 172.21.15.42:0/4013086797 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cec011990 con 0x7f3cfc14fff0 2023-07-29T02:00:29.819 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.793+0000 7f3cf959a700 1 -- 172.21.15.42:0/4013086797 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cec011d20 con 0x7f3cfc14fff0 2023-07-29T02:00:29.819 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.794+0000 7f2ed2ffd700 1 --2- 172.21.15.42:0/4112800108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ed4166aa0 0x7f2ed40ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.819 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.794+0000 7f2ed37fe700 1 -- 172.21.15.42:0/4112800108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ed41eea40 msgr2=0x7f2ed420ce80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-29T02:00:29.820 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.794+0000 7f2ed37fe700 1 --2- 172.21.15.42:0/4112800108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ed41eea40 0x7f2ed420ce80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.820 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.794+0000 7f2ed37fe700 1 -- 172.21.15.42:0/4112800108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ed4166aa0 msgr2=0x7f2ed40ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.820 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.794+0000 7f2ed37fe700 1 --2- 172.21.15.42:0/4112800108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ed4166aa0 0x7f2ed40ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.820 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.794+0000 7f2ed37fe700 1 -- 172.21.15.42:0/4112800108 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc007510 con 0x7f2ed420d3c0 2023-07-29T02:00:29.820 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.794+0000 7f0174a32700 1 Processor -- start 2023-07-29T02:00:29.821 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.794+0000 7f0174a32700 1 -- start start 2023-07-29T02:00:29.821 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.794+0000 7f3d00bbd700 1 -- 172.21.15.42:0/4013086797 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cfc14fff0 msgr2=0x7f3cfc070b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.821 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.794+0000 7f3d00bbd700 1 --2- 172.21.15.42:0/4013086797 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cfc14fff0 0x7f3cfc070b00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009870 tx=0x7f3cec009b80 comp rx=0 tx=0).stop 2023-07-29T02:00:29.822 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.794+0000 7f2ed37fe700 1 --2- 172.21.15.42:0/4112800108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ed420d3c0 0x7f2ed42100a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc007890 tx=0x7f2ecc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.822 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.795+0000 7f2ecb7fe700 1 -- 172.21.15.42:0/4112800108 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc0038b0 con 0x7f2ed420d3c0 2023-07-29T02:00:29.822 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.795+0000 7f2ecb7fe700 1 -- 172.21.15.42:0/4112800108 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ecc00f070 con 0x7f2ed420d3c0 2023-07-29T02:00:29.822 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.795+0000 7f2ecb7fe700 1 -- 172.21.15.42:0/4112800108 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc003c50 con 0x7f2ed420d3c0 2023-07-29T02:00:29.822 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.795+0000 7fcf0204f700 1 Processor -- start 2023-07-29T02:00:29.823 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.795+0000 7f2ed96d8700 1 -- 172.21.15.42:0/4112800108 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed41ee310 con 0x7f2ed420d3c0 2023-07-29T02:00:29.823 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.795+0000 7f0174a32700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0158005200 0x7f01700caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.823 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.795+0000 7f0174a32700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f01700b0c30 0x7f017014a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.824 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.795+0000 7f0174a32700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01700b04e0 0x7f017014aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.824 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.795+0000 7f0174a32700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0170149db0 con 0x7f0158005200 2023-07-29T02:00:29.824 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.795+0000 7f0174a32700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01700aa800 con 0x7f01700b04e0 2023-07-29T02:00:29.824 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.795+0000 7f0174a32700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01700c93e0 con 0x7f01700b0c30 2023-07-29T02:00:29.824 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.795+0000 7f016ed9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0158005200 0x7f01700caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.824 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.795+0000 7f016ed9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0158005200 0x7f01700caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56408/0 (socket says 172.21.15.42:56408) 2023-07-29T02:00:29.824 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.795+0000 7f016ed9d700 1 -- 172.21.15.42:0/3344450027 learned_addr learned my addr 172.21.15.42:0/3344450027 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.825 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.796+0000 7f016e59c700 1 --2- 172.21.15.42:0/3344450027 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f01700b0c30 0x7f017014a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.825 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.796+0000 7f016f59e700 1 --2- 172.21.15.42:0/3344450027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01700b04e0 0x7f017014aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.825 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.795+0000 7f2ed96d8700 1 -- 172.21.15.42:0/4112800108 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed41f4380 con 0x7f2ed420d3c0 2023-07-29T02:00:29.825 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.796+0000 7f016ed9d700 1 -- 172.21.15.42:0/3344450027 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f01700b0c30 msgr2=0x7f017014a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.826 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.796+0000 7f016ed9d700 1 --2- 172.21.15.42:0/3344450027 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f01700b0c30 0x7f017014a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.826 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.796+0000 7f016ed9d700 1 -- 172.21.15.42:0/3344450027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01700b04e0 msgr2=0x7f017014aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.826 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.796+0000 7f016ed9d700 1 --2- 172.21.15.42:0/3344450027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01700b04e0 0x7f017014aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.826 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.796+0000 7f016ed9d700 1 -- 172.21.15.42:0/3344450027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0170149130 con 0x7f0158005200 2023-07-29T02:00:29.826 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.796+0000 7f7b0c54c700 1 Processor -- start 2023-07-29T02:00:29.827 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.796+0000 7f016ed9d700 1 --2- 172.21.15.42:0/3344450027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0158005200 0x7f01700caf40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f016400b3c0 tx=0x7f016400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.827 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.796+0000 7f2ed96d8700 1 -- 172.21.15.42:0/4112800108 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed4071e30 con 0x7f2ed420d3c0 2023-07-29T02:00:29.828 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.795+0000 7fcf0204f700 1 -- start start 2023-07-29T02:00:29.828 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.796+0000 7fcf0204f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcefc0c73d0 0x7fcefc0c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.828 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.796+0000 7fcf0204f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcefc14f4c0 0x7fcefc06dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.796+0000 7fcf0204f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcefc156670 0x7fcefc156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.796+0000 7fcf0204f700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc156220 con 0x7fcefc14f4c0 2023-07-29T02:00:29.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.796+0000 7fcf0204f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc157010 con 0x7fcefc0c73d0 2023-07-29T02:00:29.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.796+0000 7fcf0204f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc0c3360 con 0x7fcefc156670 2023-07-29T02:00:29.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.797+0000 7fcefb7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcefc0c73d0 0x7fcefc0c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.797+0000 7fcefb7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcefc0c73d0 0x7fcefc0c2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:39792/0 (socket says 172.21.15.42:39792) 2023-07-29T02:00:29.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.797+0000 7fcefb7fe700 1 -- 172.21.15.42:0/1879973509 learned_addr learned my addr 172.21.15.42:0/1879973509 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.797+0000 7fcefaffd700 1 --2- 172.21.15.42:0/1879973509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcefc14f4c0 0x7fcefc06dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.797+0000 7fcfae7fc700 1 -- 172.21.15.42:0/2084171084 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fcfb40553b0 con 0x7fcfb80cf460 2023-07-29T02:00:29.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.797+0000 7f3d00bbd700 1 -- 172.21.15.42:0/4013086797 shutdown_connections 2023-07-29T02:00:29.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.797+0000 7f3d00bbd700 1 --2- 172.21.15.42:0/4013086797 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cfc14fff0 0x7f3cfc070b00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.797+0000 7f3d00bbd700 1 -- 172.21.15.42:0/4013086797 >> 172.21.15.42:0/4013086797 conn(0x7f3cfc0cc420 msgr2=0x7f3cfc0c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.797+0000 7f3d00bbd700 1 -- 172.21.15.42:0/4013086797 shutdown_connections 2023-07-29T02:00:29.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.797+0000 7f3d00bbd700 1 -- 172.21.15.42:0/4013086797 wait complete. 2023-07-29T02:00:29.832 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.797+0000 7fcefb7fe700 1 -- 172.21.15.42:0/1879973509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcefc156670 msgr2=0x7fcefc156ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-29T02:00:29.832 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.797+0000 7fcefb7fe700 1 --2- 172.21.15.42:0/1879973509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcefc156670 0x7fcefc156ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.832 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.797+0000 7fcefb7fe700 1 -- 172.21.15.42:0/1879973509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcefc14f4c0 msgr2=0x7fcefc06dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.832 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.797+0000 7fcefb7fe700 1 --2- 172.21.15.42:0/1879973509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcefc14f4c0 0x7fcefc06dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.832 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.797+0000 7fcefb7fe700 1 -- 172.21.15.42:0/1879973509 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef4009b30 con 0x7fcefc0c73d0 2023-07-29T02:00:29.833 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.797+0000 7fcefb7fe700 1 --2- 172.21.15.42:0/1879973509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcefc0c73d0 0x7fcefc0c2e20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcef400b370 tx=0x7fcef4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.833 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.797+0000 7fcee3fff700 1 -- 172.21.15.42:0/1879973509 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef40048a0 con 0x7fcefc0c73d0 2023-07-29T02:00:29.833 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.797+0000 7fcee3fff700 1 -- 172.21.15.42:0/1879973509 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef40092e0 con 0x7fcefc0c73d0 2023-07-29T02:00:29.833 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.798+0000 7fcee3fff700 1 -- 172.21.15.42:0/1879973509 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef40106c0 con 0x7fcefc0c73d0 2023-07-29T02:00:29.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.796+0000 7f7b0c54c700 1 -- start start 2023-07-29T02:00:29.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.798+0000 7f7b0c54c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7b0406eda0 0x7f7b04155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.798+0000 7f7b0c54c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7b0406cfa0 0x7f7b0406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.798+0000 7f7b0c54c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b0406cb10 con 0x7f7b0414f920 2023-07-29T02:00:29.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.798+0000 7f7b0c54c700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b0406d910 con 0x7f7b0406cfa0 2023-07-29T02:00:29.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.798+0000 7f7b0c54c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b04156280 con 0x7f7b0406eda0 2023-07-29T02:00:29.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.798+0000 7f7b09ae7700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7b0406cfa0 0x7f7b0406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.798+0000 7f7b09ae7700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7b0406cfa0 0x7f7b0406d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56422/0 (socket says 172.21.15.42:56422) 2023-07-29T02:00:29.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.798+0000 7f7b09ae7700 1 -- 172.21.15.42:0/3470686186 learned_addr learned my addr 172.21.15.42:0/3470686186 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.798+0000 7f7b0a2e8700 1 --2- 172.21.15.42:0/3470686186 >> v2:172.21.15.144:3300/0 conn(0x7f7b0406eda0 0x7f7b04155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.798+0000 7fcf0204f700 1 -- 172.21.15.42:0/1879973509 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcefc0c9a60 con 0x7fcefc0c73d0 2023-07-29T02:00:29.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.799+0000 7fcf0204f700 1 -- 172.21.15.42:0/1879973509 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcefc0c3a70 con 0x7fcefc0c73d0 2023-07-29T02:00:29.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.799+0000 7f3d00bbd700 1 Processor -- start 2023-07-29T02:00:29.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.798+0000 7f2ecb7fe700 1 -- 172.21.15.42:0/4112800108 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f2ecc003db0 con 0x7f2ed420d3c0 2023-07-29T02:00:29.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.799+0000 7f2ecb7fe700 1 --2- 172.21.15.42:0/4112800108 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2eb406a660 0x7f2eb406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.799+0000 7f2ecb7fe700 1 -- 172.21.15.42:0/4112800108 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2ecc08a7a0 con 0x7f2ed420d3c0 2023-07-29T02:00:29.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.799+0000 7f2ed2ffd700 1 --2- 172.21.15.42:0/4112800108 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2eb406a660 0x7f2eb406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.799+0000 7f3d00bbd700 1 -- start start 2023-07-29T02:00:29.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.798+0000 7f7b09ae7700 1 -- 172.21.15.42:0/3470686186 >> v2:172.21.15.144:3300/0 conn(0x7f7b0406eda0 msgr2=0x7f7b04155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:29.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.798+0000 7f7b09ae7700 1 --2- 172.21.15.42:0/3470686186 >> v2:172.21.15.144:3300/0 conn(0x7f7b0406eda0 0x7f7b04155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.798+0000 7f7b09ae7700 1 -- 172.21.15.42:0/3470686186 >> v1:172.21.15.144:6789/0 conn(0x7f7b0414f920 legacy=0x7f7b0414fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.798+0000 7f7b09ae7700 1 -- 172.21.15.42:0/3470686186 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b04156560 con 0x7f7b0406cfa0 2023-07-29T02:00:29.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.798+0000 7f7b09ae7700 1 --2- 172.21.15.42:0/3470686186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b0406cfa0 0x7f7b0406d3d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7b04070d00 tx=0x7f7afc00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c951175430641945 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.800+0000 7f2ed2ffd700 1 --2- 172.21.15.42:0/4112800108 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2eb406a660 0x7f2eb406cb10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4003c10 tx=0x7f2ec40098d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.800+0000 7f9a32ffd700 1 -- 172.21.15.42:0/3445214230 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f9a3808e020 con 0x7f9a3c14f4c0 2023-07-29T02:00:29.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.800+0000 7f01577fe700 1 -- 172.21.15.42:0/3344450027 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0164011620 con 0x7f0158005200 2023-07-29T02:00:29.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.800+0000 7f0174a32700 1 -- 172.21.15.42:0/3344450027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0170149410 con 0x7f0158005200 2023-07-29T02:00:29.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.800+0000 7f0174a32700 1 -- 172.21.15.42:0/3344450027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01701499d0 con 0x7f0158005200 2023-07-29T02:00:29.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.800+0000 7fcee3fff700 1 -- 172.21.15.42:0/1879973509 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fcef4023440 con 0x7fcefc0c73d0 2023-07-29T02:00:29.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.801+0000 7fcf0204f700 1 -- 172.21.15.42:0/1879973509 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcefc072df0 con 0x7fcefc0c73d0 2023-07-29T02:00:29.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.801+0000 7fcee3fff700 1 --2- 172.21.15.42:0/1879973509 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcee806a690 0x7fcee806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.800+0000 7f3d00bbd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cfc06b860 0x7f3cfc1ea180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.800+0000 7f3d00bbd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cfc14fc20 0x7f3cfc1f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.800+0000 7f3d00bbd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cfc14fff0 0x7f3cfc0c17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.800+0000 7f3d00bbd700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc14c200 con 0x7f3cfc14fff0 2023-07-29T02:00:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.800+0000 7f3d00bbd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc14a290 con 0x7f3cfc06b860 2023-07-29T02:00:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.800+0000 7f3d00bbd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc1f6770 con 0x7f3cfc14fc20 2023-07-29T02:00:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.800+0000 7f3cfa59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cfc06b860 0x7f3cfc1ea180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.800+0000 7f3cfa59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cfc06b860 0x7f3cfc1ea180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:39806/0 (socket says 172.21.15.42:39806) 2023-07-29T02:00:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.800+0000 7f3cfa59c700 1 -- 172.21.15.42:0/2098097843 learned_addr learned my addr 172.21.15.42:0/2098097843 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.800+0000 7f3cf9d9b700 1 --2- 172.21.15.42:0/2098097843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cfc14fc20 0x7f3cfc1f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.800+0000 7f3cfa59c700 1 -- 172.21.15.42:0/2098097843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cfc14fc20 msgr2=0x7f3cfc1f6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.800+0000 7f3cfa59c700 1 --2- 172.21.15.42:0/2098097843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cfc14fc20 0x7f3cfc1f6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.800+0000 7f3cfa59c700 1 -- 172.21.15.42:0/2098097843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cfc14fff0 msgr2=0x7f3cfc0c17d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-29T02:00:29.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.801+0000 7f3cfa59c700 1 --2- 172.21.15.42:0/2098097843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cfc14fff0 0x7f3cfc0c17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.801+0000 7f3cfa59c700 1 -- 172.21.15.42:0/2098097843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec0094a0 con 0x7f3cfc06b860 2023-07-29T02:00:29.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.801+0000 7f3cfa59c700 1 --2- 172.21.15.42:0/2098097843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cfc06b860 0x7f3cfc1ea180 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4001ed0 tx=0x7f3cf40021e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.801+0000 7fcee3fff700 1 -- 172.21.15.42:0/1879973509 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcef400e030 con 0x7fcefc0c73d0 2023-07-29T02:00:29.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.801+0000 7f01577fe700 1 -- 172.21.15.42:0/3344450027 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0164011780 con 0x7f0158005200 2023-07-29T02:00:29.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.801+0000 7f0174a32700 1 -- 172.21.15.42:0/3344450027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0170149ef0 con 0x7f0158005200 2023-07-29T02:00:29.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.801+0000 7f01577fe700 1 -- 172.21.15.42:0/3344450027 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0164011af0 con 0x7f0158005200 2023-07-29T02:00:29.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.801+0000 7f7009ffb700 1 -- 172.21.15.42:0/1637891715 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f7010021020 con 0x7f7014166aa0 2023-07-29T02:00:29.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.802+0000 7f7b092e6700 1 -- 172.21.15.42:0/3470686186 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc010070 con 0x7f7b0406cfa0 2023-07-29T02:00:29.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.802+0000 7f7b092e6700 1 -- 172.21.15.42:0/3470686186 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7afc00dd90 con 0x7f7b0406cfa0 2023-07-29T02:00:29.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.802+0000 7f7b092e6700 1 -- 172.21.15.42:0/3470686186 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7afc00b2d0 con 0x7f7b0406cfa0 2023-07-29T02:00:29.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.803+0000 7f2ecb7fe700 1 -- 172.21.15.42:0/4112800108 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f2ecc0558a0 con 0x7f2ed420d3c0 2023-07-29T02:00:29.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.802+0000 7fcefaffd700 1 --2- 172.21.15.42:0/1879973509 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcee806a690 0x7fcee806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.803+0000 7fcefaffd700 1 --2- 172.21.15.42:0/1879973509 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcee806a690 0x7fcee806cb40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcefc06e990 tx=0x7fceec009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.808+0000 7fcee3fff700 1 -- 172.21.15.42:0/1879973509 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fcef4054de0 con 0x7fcefc0c73d0 2023-07-29T02:00:29.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.802+0000 7f7009ffb700 1 --2- 172.21.15.42:0/1637891715 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6ff806a6b0 0x7f6ff806cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.847 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.802+0000 7f7009ffb700 1 -- 172.21.15.42:0/1637891715 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7010089e60 con 0x7f7014166aa0 2023-07-29T02:00:29.847 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.802+0000 7f7018d25700 1 --2- 172.21.15.42:0/1637891715 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6ff806a6b0 0x7f6ff806cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.847 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.802+0000 7f7018d25700 1 --2- 172.21.15.42:0/1637891715 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6ff806a6b0 0x7f6ff806cb60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7014069a90 tx=0x7f7004006050 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.847 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.810+0000 7f7009ffb700 1 -- 172.21.15.42:0/1637891715 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f7010054fe0 con 0x7f7014166aa0 2023-07-29T02:00:29.847 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.803+0000 7f7b0c54c700 1 -- 172.21.15.42:0/3470686186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b0406cfa0 msgr2=0x7f7b0406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.848 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.803+0000 7f7b0c54c700 1 --2- 172.21.15.42:0/3470686186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b0406cfa0 0x7f7b0406d3d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7b04070d00 tx=0x7f7afc00d430 comp rx=0 tx=0).stop 2023-07-29T02:00:29.848 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.803+0000 7f7b0c54c700 1 -- 172.21.15.42:0/3470686186 shutdown_connections 2023-07-29T02:00:29.848 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.803+0000 7f7b0c54c700 1 --2- 172.21.15.42:0/3470686186 >> v2:172.21.15.144:3300/0 conn(0x7f7b0406eda0 0x7f7b04155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.848 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.803+0000 7f7b0c54c700 1 --2- 172.21.15.42:0/3470686186 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b0406cfa0 0x7f7b0406d3d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.848 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.803+0000 7f7b0c54c700 1 -- 172.21.15.42:0/3470686186 >> 172.21.15.42:0/3470686186 conn(0x7f7b040cbf10 msgr2=0x7f7b040cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:29.848 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.803+0000 7f7b0c54c700 1 -- 172.21.15.42:0/3470686186 shutdown_connections 2023-07-29T02:00:29.848 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.803+0000 7f7b0c54c700 1 -- 172.21.15.42:0/3470686186 wait complete. 2023-07-29T02:00:29.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.804+0000 7f7b0c54c700 1 Processor -- start 2023-07-29T02:00:29.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.804+0000 7f7b0c54c700 1 -- start start 2023-07-29T02:00:29.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.805+0000 7f7b0c54c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b0406cfa0 0x7f7b041eb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.805+0000 7f7b0c54c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b0406eda0 0x7f7b040ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.805+0000 7f7b0c54c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b0414f920 0x7f7b040c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.805+0000 7f7b0c54c700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b041eb610 con 0x7f7b0406cfa0 2023-07-29T02:00:29.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.805+0000 7f7b0c54c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b041e0700 con 0x7f7b0406eda0 2023-07-29T02:00:29.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.805+0000 7f7b0c54c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b040c46a0 con 0x7f7b0414f920 2023-07-29T02:00:29.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.805+0000 7f7b0a2e8700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b0406cfa0 0x7f7b041eb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.805+0000 7f7b0a2e8700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b0406cfa0 0x7f7b041eb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56438/0 (socket says 172.21.15.42:56438) 2023-07-29T02:00:29.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.805+0000 7f7b0a2e8700 1 -- 172.21.15.42:0/1070998370 learned_addr learned my addr 172.21.15.42:0/1070998370 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:29.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.805+0000 7f7b09ae7700 1 --2- 172.21.15.42:0/1070998370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b0406eda0 0x7f7b040ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.805+0000 7f7b0a2e8700 1 -- 172.21.15.42:0/1070998370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b0414f920 msgr2=0x7f7b040c5140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-29T02:00:29.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.805+0000 7f7b0a2e8700 1 --2- 172.21.15.42:0/1070998370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b0414f920 0x7f7b040c5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.805+0000 7f7b0a2e8700 1 -- 172.21.15.42:0/1070998370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b0406eda0 msgr2=0x7f7b040ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:29.851 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.805+0000 7f7b0a2e8700 1 --2- 172.21.15.42:0/1070998370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b0406eda0 0x7f7b040ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:29.851 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.805+0000 7f7b0a2e8700 1 -- 172.21.15.42:0/1070998370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7afc00bd40 con 0x7f7b0406cfa0 2023-07-29T02:00:29.851 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.806+0000 7f7b0a2e8700 1 --2- 172.21.15.42:0/1070998370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b0406cfa0 0x7f7b041eb0d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7af400e810 tx=0x7f7af400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.851 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.806+0000 7f3cf2ffd700 1 -- 172.21.15.42:0/2098097843 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4003c00 con 0x7f3cfc06b860 2023-07-29T02:00:29.851 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.806+0000 7f3cf2ffd700 1 -- 172.21.15.42:0/2098097843 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf4003d60 con 0x7f3cfc06b860 2023-07-29T02:00:29.851 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.806+0000 7f3d00bbd700 1 -- 172.21.15.42:0/2098097843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cfc1f6470 con 0x7f3cfc06b860 2023-07-29T02:00:29.852 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.806+0000 7f3cf2ffd700 1 -- 172.21.15.42:0/2098097843 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf400abf0 con 0x7f3cfc06b860 2023-07-29T02:00:29.852 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.806+0000 7f3d00bbd700 1 -- 172.21.15.42:0/2098097843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cfc14db90 con 0x7f3cfc06b860 2023-07-29T02:00:29.852 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.807+0000 7f3d00bbd700 1 -- 172.21.15.42:0/2098097843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cfc04ea50 con 0x7f3cfc06b860 2023-07-29T02:00:29.852 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.808+0000 7f3cf2ffd700 1 -- 172.21.15.42:0/2098097843 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f3cf400ad50 con 0x7f3cfc06b860 2023-07-29T02:00:29.852 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.809+0000 7f3cf2ffd700 1 --2- 172.21.15.42:0/2098097843 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3cdc06a6e0 0x7f3cdc06cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.852 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.809+0000 7f3cf2ffd700 1 -- 172.21.15.42:0/2098097843 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3cf4088450 con 0x7f3cfc06b860 2023-07-29T02:00:29.852 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.809+0000 7f3cf9d9b700 1 --2- 172.21.15.42:0/2098097843 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3cdc06a6e0 0x7f3cdc06cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.810+0000 7f3cf9d9b700 1 --2- 172.21.15.42:0/2098097843 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3cdc06a6e0 0x7f3cdc06cb90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0090b0 tx=0x7f3cec008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.814+0000 7f3cf2ffd700 1 -- 172.21.15.42:0/2098097843 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f3cf408d060 con 0x7f3cfc06b860 2023-07-29T02:00:29.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.819+0000 7f7afaffd700 1 -- 172.21.15.42:0/1070998370 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af4013610 con 0x7f7b0406cfa0 2023-07-29T02:00:29.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.819+0000 7f7afaffd700 1 -- 172.21.15.42:0/1070998370 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af4013770 con 0x7f7b0406cfa0 2023-07-29T02:00:29.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.819+0000 7f7afaffd700 1 -- 172.21.15.42:0/1070998370 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af4013b00 con 0x7f7b0406cfa0 2023-07-29T02:00:29.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.811+0000 7f01577fe700 1 -- 172.21.15.42:0/3344450027 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f0164011c50 con 0x7f0158005200 2023-07-29T02:00:29.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.812+0000 7f01577fe700 1 --2- 172.21.15.42:0/3344450027 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f015c06a660 0x7f015c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.812+0000 7f01577fe700 1 -- 172.21.15.42:0/3344450027 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0164088ef0 con 0x7f0158005200 2023-07-29T02:00:29.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.812+0000 7f016e59c700 1 --2- 172.21.15.42:0/3344450027 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f015c06a660 0x7f015c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.812+0000 7f016e59c700 1 --2- 172.21.15.42:0/3344450027 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f015c06a660 0x7f015c06cb10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f01700c10f0 tx=0x7f0160007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:29.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.819+0000 7f01577fe700 1 -- 172.21.15.42:0/3344450027 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f01640532c0 con 0x7f0158005200 2023-07-29T02:00:29.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.823+0000 7f7b0c54c700 1 -- 172.21.15.42:0/1070998370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b041e09a0 con 0x7f7b0406cfa0 2023-07-29T02:00:29.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.823+0000 7f7b0c54c700 1 -- 172.21.15.42:0/1070998370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b040c4c20 con 0x7f7b0406cfa0 2023-07-29T02:00:29.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.831+0000 7f7b0c54c700 1 -- 172.21.15.42:0/1070998370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b0404ea50 con 0x7f7b0406cfa0 2023-07-29T02:00:29.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.845+0000 7f7afaffd700 1 -- 172.21.15.42:0/1070998370 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f7af4013c60 con 0x7f7b0406cfa0 2023-07-29T02:00:29.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.845+0000 7f7afaffd700 1 --2- 172.21.15.42:0/1070998370 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7ae806eb70 0x7f7ae8071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:29.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.845+0000 7f7afaffd700 1 -- 172.21.15.42:0/1070998370 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7af4089050 con 0x7f7b0406cfa0 2023-07-29T02:00:29.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.845+0000 7f7afaffd700 1 -- 172.21.15.42:0/1070998370 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f7af40894d0 con 0x7f7b0406cfa0 2023-07-29T02:00:29.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.863+0000 7f7b09ae7700 1 --2- 172.21.15.42:0/1070998370 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7ae806eb70 0x7f7ae8071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:29.876 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:29.889+0000 7f7b09ae7700 1 --2- 172.21.15.42:0/1070998370 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7ae806eb70 0x7f7ae8071020 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7afc00d470 tx=0x7f7afc00b000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:30.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.197+0000 7f2ed96d8700 1 -- 172.21.15.42:0/4112800108 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2ed404ea50 con 0x7f2ed420d3c0 2023-07-29T02:00:30.188 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.200+0000 7f2ecb7fe700 1 -- 172.21.15.42:0/4112800108 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2ecc058ec0 con 0x7f2ed420d3c0 2023-07-29T02:00:30.191 INFO:teuthology.orchestra.run.smithi042.stdout:55834574858 2023-07-29T02:00:30.192 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.204+0000 7f2ed96d8700 1 -- 172.21.15.42:0/4112800108 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2eb406a660 msgr2=0x7f2eb406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:30.192 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.204+0000 7f2ed96d8700 1 --2- 172.21.15.42:0/4112800108 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2eb406a660 0x7f2eb406cb10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4003c10 tx=0x7f2ec40098d0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.192 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.204+0000 7f2ed96d8700 1 -- 172.21.15.42:0/4112800108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ed420d3c0 msgr2=0x7f2ed42100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:30.192 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.204+0000 7f2ed96d8700 1 --2- 172.21.15.42:0/4112800108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ed420d3c0 0x7f2ed42100a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc007890 tx=0x7f2ecc004750 comp rx=0 tx=0).stop 2023-07-29T02:00:30.193 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.204+0000 7f2ed96d8700 1 -- 172.21.15.42:0/4112800108 shutdown_connections 2023-07-29T02:00:30.193 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.204+0000 7f2ed96d8700 1 --2- 172.21.15.42:0/4112800108 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2eb406a660 0x7f2eb406cb10 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4003c10 tx=0x7f2ec40098d0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.193 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.204+0000 7f2ed96d8700 1 --2- 172.21.15.42:0/4112800108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ed420d3c0 0x7f2ed42100a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.193 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.204+0000 7f2ed96d8700 1 --2- 172.21.15.42:0/4112800108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ed4166aa0 0x7f2ed40ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.193 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.205+0000 7f2ed96d8700 1 --2- 172.21.15.42:0/4112800108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ed41eea40 0x7f2ed420ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.193 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.205+0000 7f2ed96d8700 1 -- 172.21.15.42:0/4112800108 >> 172.21.15.42:0/4112800108 conn(0x7f2ed40cae90 msgr2=0x7f2ed40707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:30.194 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.205+0000 7f2ed96d8700 1 -- 172.21.15.42:0/4112800108 shutdown_connections 2023-07-29T02:00:30.194 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.205+0000 7f2ed96d8700 1 -- 172.21.15.42:0/4112800108 wait complete. 2023-07-29T02:00:30.201 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.214+0000 7f9a4450b700 1 -- 172.21.15.42:0/3445214230 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9a3c0c6710 con 0x7f9a3c14f4c0 2023-07-29T02:00:30.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.214+0000 7f9a32ffd700 1 -- 172.21.15.42:0/3445214230 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a380578e0 con 0x7f9a3c14f4c0 2023-07-29T02:00:30.203 INFO:teuthology.orchestra.run.smithi042.stdout:55834574857 2023-07-29T02:00:30.206 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.219+0000 7f9a4450b700 1 -- 172.21.15.42:0/3445214230 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a2006a660 msgr2=0x7f9a2006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:30.206 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.219+0000 7f9a4450b700 1 --2- 172.21.15.42:0/3445214230 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a2006a660 0x7f9a2006cb10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c152d80 tx=0x7f9a34005440 comp rx=0 tx=0).stop 2023-07-29T02:00:30.206 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.219+0000 7f9a4450b700 1 -- 172.21.15.42:0/3445214230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a3c14f4c0 msgr2=0x7f9a3c1efe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:30.206 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.219+0000 7f9a4450b700 1 --2- 172.21.15.42:0/3445214230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a3c14f4c0 0x7f9a3c1efe30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9a3800e910 tx=0x7f9a3800ec20 comp rx=0 tx=0).stop 2023-07-29T02:00:30.207 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.219+0000 7fcfc00cb700 1 -- 172.21.15.42:0/2084171084 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcfb815a1c0 con 0x7fcfb80cf460 2023-07-29T02:00:30.207 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.219+0000 7f9a4450b700 1 -- 172.21.15.42:0/3445214230 shutdown_connections 2023-07-29T02:00:30.207 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.219+0000 7f9a4450b700 1 --2- 172.21.15.42:0/3445214230 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a2006a660 0x7f9a2006cb10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.219+0000 7f9a4450b700 1 --2- 172.21.15.42:0/3445214230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a3c1488a0 0x7f9a3c14b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.219+0000 7f9a4450b700 1 --2- 172.21.15.42:0/3445214230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a3c14f4c0 0x7f9a3c1efe30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.219+0000 7f9a4450b700 1 --2- 172.21.15.42:0/3445214230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a3c159450 0x7f9a3c1f0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.219+0000 7f9a4450b700 1 -- 172.21.15.42:0/3445214230 >> 172.21.15.42:0/3445214230 conn(0x7f9a3c0cae90 msgr2=0x7f9a3c06d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:30.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.220+0000 7fcfae7fc700 1 -- 172.21.15.42:0/2084171084 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcfb815a1c0 con 0x7fcfb80cf460 2023-07-29T02:00:30.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.220+0000 7f9a4450b700 1 -- 172.21.15.42:0/3445214230 shutdown_connections 2023-07-29T02:00:30.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.220+0000 7f9a4450b700 1 -- 172.21.15.42:0/3445214230 wait complete. 2023-07-29T02:00:30.209 INFO:teuthology.orchestra.run.smithi042.stdout:55834574857 2023-07-29T02:00:30.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.1 2023-07-29T02:00:30.212 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.224+0000 7fcfc00cb700 1 -- 172.21.15.42:0/2084171084 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcf9c06a6b0 msgr2=0x7fcf9c06cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:30.212 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.224+0000 7fcfc00cb700 1 --2- 172.21.15.42:0/2084171084 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcf9c06a6b0 0x7fcf9c06cb60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcfa8003fc0 tx=0x7fcfa8009040 comp rx=0 tx=0).stop 2023-07-29T02:00:30.212 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.224+0000 7fcfc00cb700 1 -- 172.21.15.42:0/2084171084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfb80cf460 msgr2=0x7fcfb81fe5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:30.212 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.224+0000 7fcfc00cb700 1 --2- 172.21.15.42:0/2084171084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfb80cf460 0x7fcfb81fe5e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009130 tx=0x7fcfb4004750 comp rx=0 tx=0).stop 2023-07-29T02:00:30.213 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.225+0000 7fcfc00cb700 1 -- 172.21.15.42:0/2084171084 shutdown_connections 2023-07-29T02:00:30.213 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.225+0000 7fcfc00cb700 1 --2- 172.21.15.42:0/2084171084 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcf9c06a6b0 0x7fcf9c06cb60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.213 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.225+0000 7fcfc00cb700 1 --2- 172.21.15.42:0/2084171084 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcfb81571e0 0x7fcfb81feb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.213 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.225+0000 7fcfc00cb700 1 --2- 172.21.15.42:0/2084171084 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcfb80b4670 0x7fcfb80c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.213 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.225+0000 7fcfc00cb700 1 --2- 172.21.15.42:0/2084171084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcfb80cf460 0x7fcfb81fe5e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.214 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.225+0000 7fcfc00cb700 1 -- 172.21.15.42:0/2084171084 >> 172.21.15.42:0/2084171084 conn(0x7fcfb806ca60 msgr2=0x7fcfb8156690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:30.214 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.225+0000 7fcf0204f700 1 -- 172.21.15.42:0/1879973509 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcefc04ea50 con 0x7fcefc0c73d0 2023-07-29T02:00:30.214 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.226+0000 7fcee3fff700 1 -- 172.21.15.42:0/1879973509 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcef4058400 con 0x7fcefc0c73d0 2023-07-29T02:00:30.214 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.227+0000 7f701b78a700 1 -- 172.21.15.42:0/1637891715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6ff4005870 con 0x7f7014166aa0 2023-07-29T02:00:30.215 INFO:teuthology.orchestra.run.smithi042.stdout:55834574857 2023-07-29T02:00:30.215 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.228+0000 7f7009ffb700 1 -- 172.21.15.42:0/1637891715 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7010007dd0 con 0x7f7014166aa0 2023-07-29T02:00:30.216 INFO:teuthology.orchestra.run.smithi042.stdout:55834574857 2023-07-29T02:00:30.217 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.230+0000 7fcfc00cb700 1 -- 172.21.15.42:0/2084171084 shutdown_connections 2023-07-29T02:00:30.218 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.230+0000 7f0174a32700 1 -- 172.21.15.42:0/3344450027 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0170149ef0 con 0x7f0158005200 2023-07-29T02:00:30.218 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.230+0000 7fcfc00cb700 1 -- 172.21.15.42:0/2084171084 wait complete. 2023-07-29T02:00:30.219 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.230+0000 7f701b78a700 1 -- 172.21.15.42:0/1637891715 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6ff806a6b0 msgr2=0x7f6ff806cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:30.219 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.230+0000 7f701b78a700 1 --2- 172.21.15.42:0/1637891715 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6ff806a6b0 0x7f6ff806cb60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7014069a90 tx=0x7f7004006050 comp rx=0 tx=0).stop 2023-07-29T02:00:30.219 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.230+0000 7f701b78a700 1 -- 172.21.15.42:0/1637891715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7014166aa0 msgr2=0x7f7014204310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:30.219 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.230+0000 7f701b78a700 1 --2- 172.21.15.42:0/1637891715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7014166aa0 0x7f7014204310 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f701406fa90 tx=0x7f7010004750 comp rx=0 tx=0).stop 2023-07-29T02:00:30.219 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.231+0000 7f701b78a700 1 -- 172.21.15.42:0/1637891715 shutdown_connections 2023-07-29T02:00:30.219 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.231+0000 7f701b78a700 1 --2- 172.21.15.42:0/1637891715 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6ff806a6b0 0x7f6ff806cb60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.220 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.231+0000 7f701b78a700 1 --2- 172.21.15.42:0/1637891715 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f70141ef2a0 0x7f70141ef740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.220 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.231+0000 7f701b78a700 1 --2- 172.21.15.42:0/1637891715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7014166aa0 0x7f7014204310 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.220 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.231+0000 7f701b78a700 1 --2- 172.21.15.42:0/1637891715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f701408ad10 0x7f70140c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.220 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.231+0000 7f701b78a700 1 -- 172.21.15.42:0/1637891715 >> 172.21.15.42:0/1637891715 conn(0x7f70140cae90 msgr2=0x7f70140c9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:30.220 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.231+0000 7f701b78a700 1 -- 172.21.15.42:0/1637891715 shutdown_connections 2023-07-29T02:00:30.220 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.231+0000 7f701b78a700 1 -- 172.21.15.42:0/1637891715 wait complete. 2023-07-29T02:00:30.221 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.233+0000 7fcf0204f700 1 -- 172.21.15.42:0/1879973509 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcee806a690 msgr2=0x7fcee806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:30.221 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.233+0000 7fcf0204f700 1 --2- 172.21.15.42:0/1879973509 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcee806a690 0x7fcee806cb40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcefc06e990 tx=0x7fceec009190 comp rx=0 tx=0).stop 2023-07-29T02:00:30.221 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.233+0000 7fcf0204f700 1 -- 172.21.15.42:0/1879973509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcefc0c73d0 msgr2=0x7fcefc0c2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:30.221 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.233+0000 7fcf0204f700 1 --2- 172.21.15.42:0/1879973509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcefc0c73d0 0x7fcefc0c2e20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcef400b370 tx=0x7fcef4004ad0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.222 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.233+0000 7f3d00bbd700 1 -- 172.21.15.42:0/2098097843 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3cfc0c2b00 con 0x7f3cfc06b860 2023-07-29T02:00:30.222 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.233+0000 7f3cf2ffd700 1 -- 172.21.15.42:0/2098097843 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3cf40536f0 con 0x7f3cfc06b860 2023-07-29T02:00:30.222 INFO:teuthology.orchestra.run.smithi042.stdout:55834574858 2023-07-29T02:00:30.223 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.234+0000 7f01577fe700 1 -- 172.21.15.42:0/3344450027 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0170149ef0 con 0x7f0158005200 2023-07-29T02:00:30.223 INFO:teuthology.orchestra.run.smithi042.stdout:55834574856 2023-07-29T02:00:30.223 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.235+0000 7fcf0204f700 1 -- 172.21.15.42:0/1879973509 shutdown_connections 2023-07-29T02:00:30.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.235+0000 7fcf0204f700 1 --2- 172.21.15.42:0/1879973509 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcee806a690 0x7fcee806cb40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.235+0000 7fcf0204f700 1 --2- 172.21.15.42:0/1879973509 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcefc156670 0x7fcefc156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.235+0000 7fcf0204f700 1 --2- 172.21.15.42:0/1879973509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcefc0c73d0 0x7fcefc0c2e20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.235+0000 7fcf0204f700 1 --2- 172.21.15.42:0/1879973509 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcefc14f4c0 0x7fcefc06dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.235+0000 7fcf0204f700 1 -- 172.21.15.42:0/1879973509 >> 172.21.15.42:0/1879973509 conn(0x7fcefc0cae90 msgr2=0x7fcefc145320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:30.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.235+0000 7fcf0204f700 1 -- 172.21.15.42:0/1879973509 shutdown_connections 2023-07-29T02:00:30.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.235+0000 7fcf0204f700 1 -- 172.21.15.42:0/1879973509 wait complete. 2023-07-29T02:00:30.225 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.237+0000 7f3d00bbd700 1 -- 172.21.15.42:0/2098097843 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3cdc06a6e0 msgr2=0x7f3cdc06cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:30.225 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.237+0000 7f3d00bbd700 1 --2- 172.21.15.42:0/2098097843 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3cdc06a6e0 0x7f3cdc06cb90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0090b0 tx=0x7f3cec008030 comp rx=0 tx=0).stop 2023-07-29T02:00:30.225 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.237+0000 7f3d00bbd700 1 -- 172.21.15.42:0/2098097843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cfc06b860 msgr2=0x7f3cfc1ea180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:30.225 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.237+0000 7f3d00bbd700 1 --2- 172.21.15.42:0/2098097843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cfc06b860 0x7f3cfc1ea180 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4001ed0 tx=0x7f3cf40021e0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.241+0000 7f0174a32700 1 -- 172.21.15.42:0/3344450027 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f015c06a660 msgr2=0x7f015c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:30.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.241+0000 7f0174a32700 1 --2- 172.21.15.42:0/3344450027 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f015c06a660 0x7f015c06cb10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f01700c10f0 tx=0x7f0160007040 comp rx=0 tx=0).stop 2023-07-29T02:00:30.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.241+0000 7f0174a32700 1 -- 172.21.15.42:0/3344450027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0158005200 msgr2=0x7f01700caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:30.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.241+0000 7f0174a32700 1 --2- 172.21.15.42:0/3344450027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0158005200 0x7f01700caf40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f016400b3c0 tx=0x7f016400b6d0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.241+0000 7f0174a32700 1 -- 172.21.15.42:0/3344450027 shutdown_connections 2023-07-29T02:00:30.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.241+0000 7f0174a32700 1 --2- 172.21.15.42:0/3344450027 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f015c06a660 0x7f015c06cb10 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f01700c10f0 tx=0x7f0160007040 comp rx=0 tx=0).stop 2023-07-29T02:00:30.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.241+0000 7f0174a32700 1 --2- 172.21.15.42:0/3344450027 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01700b04e0 0x7f017014aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.241+0000 7f0174a32700 1 --2- 172.21.15.42:0/3344450027 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0158005200 0x7f01700caf40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.241+0000 7f0174a32700 1 --2- 172.21.15.42:0/3344450027 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f01700b0c30 0x7f017014a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.241+0000 7f0174a32700 1 -- 172.21.15.42:0/3344450027 >> 172.21.15.42:0/3344450027 conn(0x7f017006daa0 msgr2=0x7f01700c1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:30.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.244+0000 7f0174a32700 1 -- 172.21.15.42:0/3344450027 shutdown_connections 2023-07-29T02:00:30.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.244+0000 7f0174a32700 1 -- 172.21.15.42:0/3344450027 wait complete. 2023-07-29T02:00:30.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.244+0000 7f3d00bbd700 1 -- 172.21.15.42:0/2098097843 shutdown_connections 2023-07-29T02:00:30.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.244+0000 7f3d00bbd700 1 --2- 172.21.15.42:0/2098097843 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3cdc06a6e0 0x7f3cdc06cb90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.244+0000 7f3d00bbd700 1 --2- 172.21.15.42:0/2098097843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3cfc14fff0 0x7f3cfc0c17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.244+0000 7f3d00bbd700 1 --2- 172.21.15.42:0/2098097843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3cfc06b860 0x7f3cfc1ea180 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.244+0000 7f3d00bbd700 1 --2- 172.21.15.42:0/2098097843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3cfc14fc20 0x7f3cfc1f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.244+0000 7f3d00bbd700 1 -- 172.21.15.42:0/2098097843 >> 172.21.15.42:0/2098097843 conn(0x7f3cfc0cc420 msgr2=0x7f3cfc071720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:30.233 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.245+0000 7f3d00bbd700 1 -- 172.21.15.42:0/2098097843 shutdown_connections 2023-07-29T02:00:30.233 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.7 2023-07-29T02:00:30.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.246+0000 7f3d00bbd700 1 -- 172.21.15.42:0/2098097843 wait complete. 2023-07-29T02:00:30.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.0 2023-07-29T02:00:30.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2023-07-29T02:00:30.241 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.254+0000 7f7b0c54c700 1 -- 172.21.15.42:0/1070998370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7b041535f0 con 0x7f7b0406cfa0 2023-07-29T02:00:30.245 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.255+0000 7f7afaffd700 1 -- 172.21.15.42:0/1070998370 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7af4021090 con 0x7f7b0406cfa0 2023-07-29T02:00:30.245 INFO:teuthology.orchestra.run.smithi042.stdout:55834574857 2023-07-29T02:00:30.246 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.257+0000 7f7b0c54c700 1 -- 172.21.15.42:0/1070998370 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7ae806eb70 msgr2=0x7f7ae8071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:30.246 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.257+0000 7f7b0c54c700 1 --2- 172.21.15.42:0/1070998370 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7ae806eb70 0x7f7ae8071020 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7afc00d470 tx=0x7f7afc00b000 comp rx=0 tx=0).stop 2023-07-29T02:00:30.246 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.257+0000 7f7b0c54c700 1 -- 172.21.15.42:0/1070998370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b0406cfa0 msgr2=0x7f7b041eb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:30.246 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.257+0000 7f7b0c54c700 1 --2- 172.21.15.42:0/1070998370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b0406cfa0 0x7f7b041eb0d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7af400e810 tx=0x7f7af400eb20 comp rx=0 tx=0).stop 2023-07-29T02:00:30.246 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.258+0000 7f7b0c54c700 1 -- 172.21.15.42:0/1070998370 shutdown_connections 2023-07-29T02:00:30.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.258+0000 7f7b0c54c700 1 --2- 172.21.15.42:0/1070998370 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7ae806eb70 0x7f7ae8071020 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.258+0000 7f7b0c54c700 1 --2- 172.21.15.42:0/1070998370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7b0414f920 0x7f7b040c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.258+0000 7f7b0c54c700 1 --2- 172.21.15.42:0/1070998370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7b0406cfa0 0x7f7b041eb0d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.258+0000 7f7b0c54c700 1 --2- 172.21.15.42:0/1070998370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b0406eda0 0x7f7b040ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:30.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.258+0000 7f7b0c54c700 1 -- 172.21.15.42:0/1070998370 >> 172.21.15.42:0/1070998370 conn(0x7f7b040cbf10 msgr2=0x7f7b040c2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:30.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.258+0000 7f7b0c54c700 1 -- 172.21.15.42:0/1070998370 shutdown_connections 2023-07-29T02:00:30.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:30.258+0000 7f7b0c54c700 1 -- 172.21.15.42:0/1070998370 wait complete. 2023-07-29T02:00:30.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.3 2023-07-29T02:00:30.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.4 2023-07-29T02:00:30.255 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.5 2023-07-29T02:00:30.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.6 2023-07-29T02:00:31.212 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-29T02:00:31.234 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-29T02:00:31.240 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-29T02:00:31.240 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-29T02:00:31.249 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-29T02:00:31.254 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-29T02:00:31.257 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-29T02:00:31.259 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-29T02:00:31.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.432+0000 7f3c10592700 1 Processor -- start 2023-07-29T02:00:31.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.433+0000 7f3c10592700 1 -- start start 2023-07-29T02:00:31.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.434+0000 7f3c10592700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3c080bfeb0 0x7f3c08158d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.434+0000 7f3c10592700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c080c73d0 0x7f3c08159280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.434+0000 7f3c10592700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c080c5b40 con 0x7f3c0814f4c0 2023-07-29T02:00:31.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.434+0000 7f3c10592700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0806c210 con 0x7f3c080bfeb0 2023-07-29T02:00:31.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.434+0000 7f3c10592700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0806c4f0 con 0x7f3c080c73d0 2023-07-29T02:00:31.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.435+0000 7f3c0eb2f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c080c73d0 0x7f3c08159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.435+0000 7f3c0eb2f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c080c73d0 0x7f3c08159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:56966/0 (socket says 172.21.15.42:56966) 2023-07-29T02:00:31.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.435+0000 7f3c0eb2f700 1 -- 172.21.15.42:0/4198874356 learned_addr learned my addr 172.21.15.42:0/4198874356 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:31.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.435+0000 7f3c0db2d700 1 --2- 172.21.15.42:0/4198874356 >> v2:172.21.15.144:3300/0 conn(0x7f3c080bfeb0 0x7f3c08158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.441+0000 7f3c0d32c700 1 -- 172.21.15.42:0/4198874356 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663134117 0 0) 0x7f3c080c5b40 con 0x7f3c0814f4c0 2023-07-29T02:00:31.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.441+0000 7f3c0d32c700 1 -- 172.21.15.42:0/4198874356 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bf40035b0 con 0x7f3c0814f4c0 2023-07-29T02:00:31.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.442+0000 7f3c0db2d700 1 -- 172.21.15.42:0/4198874356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c080c73d0 msgr2=0x7f3c08159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:31.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.442+0000 7f3c0db2d700 1 --2- 172.21.15.42:0/4198874356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c080c73d0 0x7f3c08159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.442+0000 7f3c0db2d700 1 -- 172.21.15.42:0/4198874356 >> v1:172.21.15.144:6789/0 conn(0x7f3c0814f4c0 legacy=0x7f3c0806d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.442+0000 7f3c0d32c700 1 -- 172.21.15.42:0/4198874356 <== mon.1 v1:172.21.15.144:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4255409520 0 0) 0x7f3bf40035b0 con 0x7f3c0814f4c0 2023-07-29T02:00:31.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.442+0000 7f3c0db2d700 1 -- 172.21.15.42:0/4198874356 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c080c5d90 con 0x7f3c080bfeb0 2023-07-29T02:00:31.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.442+0000 7f3c0eb2f700 1 --2- 172.21.15.42:0/4198874356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c080c73d0 0x7f3c08159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:00:31.431 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.443+0000 7f3c0db2d700 1 --2- 172.21.15.42:0/4198874356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c080bfeb0 0x7f3c08158d40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009840 tx=0x7f3bf8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=214edd99fc3281fb server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.431 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.443+0000 7f3c0d32c700 1 -- 172.21.15.42:0/4198874356 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04001670 con 0x7f3c080bfeb0 2023-07-29T02:00:31.431 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.443+0000 7f3c0d32c700 1 -- 172.21.15.42:0/4198874356 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf8004030 con 0x7f3c080bfeb0 2023-07-29T02:00:31.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.443+0000 7f3c0d32c700 1 -- 172.21.15.42:0/4198874356 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf80043c0 con 0x7f3c080bfeb0 2023-07-29T02:00:31.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.444+0000 7f3c10592700 1 -- 172.21.15.42:0/4198874356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c080bfeb0 msgr2=0x7f3c08158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.444+0000 7f3c10592700 1 --2- 172.21.15.42:0/4198874356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c080bfeb0 0x7f3c08158d40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009840 tx=0x7f3bf8009b50 comp rx=0 tx=0).stop 2023-07-29T02:00:31.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.445+0000 7f3c10592700 1 -- 172.21.15.42:0/4198874356 shutdown_connections 2023-07-29T02:00:31.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.445+0000 7f3c10592700 1 --2- 172.21.15.42:0/4198874356 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c080c73d0 0x7f3c08159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.445+0000 7f3c10592700 1 --2- 172.21.15.42:0/4198874356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c080bfeb0 0x7f3c08158d40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.445+0000 7f3c10592700 1 -- 172.21.15.42:0/4198874356 >> 172.21.15.42:0/4198874356 conn(0x7f3c080cae90 msgr2=0x7f3c080cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:31.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.445+0000 7f3c10592700 1 -- 172.21.15.42:0/4198874356 shutdown_connections 2023-07-29T02:00:31.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.445+0000 7f3c10592700 1 -- 172.21.15.42:0/4198874356 wait complete. 2023-07-29T02:00:31.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.447+0000 7f3c10592700 1 Processor -- start 2023-07-29T02:00:31.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.447+0000 7f3c10592700 1 -- start start 2023-07-29T02:00:31.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.448+0000 7f3c10592700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c080c73d0 0x7f3c081f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.448+0000 7f3c10592700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c0814f4c0 0x7f3c08145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.448+0000 7f3c10592700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c081461b0 0x7f3c080c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.448+0000 7f3c10592700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c080c3500 con 0x7f3c0814f4c0 2023-07-29T02:00:31.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.448+0000 7f3c10592700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0814e190 con 0x7f3c081461b0 2023-07-29T02:00:31.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.448+0000 7f3c10592700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c080c49a0 con 0x7f3c080c73d0 2023-07-29T02:00:31.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.448+0000 7f3c0e32e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c080c73d0 0x7f3c081f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.448+0000 7f3c0e32e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c080c73d0 0x7f3c081f3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:56970/0 (socket says 172.21.15.42:56970) 2023-07-29T02:00:31.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.448+0000 7f3c0e32e700 1 -- 172.21.15.42:0/3055201637 learned_addr learned my addr 172.21.15.42:0/3055201637 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:31.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.448+0000 7f3c0eb2f700 1 --2- 172.21.15.42:0/3055201637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c081461b0 0x7f3c080c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.449+0000 7f3c0eb2f700 1 -- 172.21.15.42:0/3055201637 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c080c73d0 msgr2=0x7f3c081f3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.449+0000 7f3c0eb2f700 1 --2- 172.21.15.42:0/3055201637 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c080c73d0 0x7f3c081f3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.439 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.449+0000 7f3c0eb2f700 1 -- 172.21.15.42:0/3055201637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c0814f4c0 msgr2=0x7f3c08145340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.439 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.449+0000 7f3c0eb2f700 1 --2- 172.21.15.42:0/3055201637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c0814f4c0 0x7f3c08145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.439 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.449+0000 7f3c0eb2f700 1 -- 172.21.15.42:0/3055201637 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0000d050 con 0x7f3c081461b0 2023-07-29T02:00:31.439 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.449+0000 7f3c0eb2f700 1 --2- 172.21.15.42:0/3055201637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c081461b0 0x7f3c080c3f10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3c080c7870 tx=0x7f3c0000d560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.455+0000 7f3bfeffd700 1 -- 172.21.15.42:0/3055201637 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00010040 con 0x7f3c081461b0 2023-07-29T02:00:31.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.455+0000 7f3bfeffd700 1 -- 172.21.15.42:0/3055201637 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c000163f0 con 0x7f3c081461b0 2023-07-29T02:00:31.443 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.455+0000 7f3bfeffd700 1 -- 172.21.15.42:0/3055201637 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00016780 con 0x7f3c081461b0 2023-07-29T02:00:31.443 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.455+0000 7f3c10592700 1 -- 172.21.15.42:0/3055201637 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf80094a0 con 0x7f3c081461b0 2023-07-29T02:00:31.443 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.455+0000 7f3c10592700 1 -- 172.21.15.42:0/3055201637 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c080c4f60 con 0x7f3c081461b0 2023-07-29T02:00:31.443 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.456+0000 7f3c10592700 1 -- 172.21.15.42:0/3055201637 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c080c5150 con 0x7f3c081461b0 2023-07-29T02:00:31.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.457+0000 7f3bfeffd700 1 -- 172.21.15.42:0/3055201637 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f3c000168e0 con 0x7f3c081461b0 2023-07-29T02:00:31.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.458+0000 7f3bfeffd700 1 --2- 172.21.15.42:0/3055201637 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3bec06a6b0 0x7f3bec06cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.458+0000 7f3bfeffd700 1 -- 172.21.15.42:0/3055201637 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3c00089310 con 0x7f3c081461b0 2023-07-29T02:00:31.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.458+0000 7f3c0e32e700 1 --2- 172.21.15.42:0/3055201637 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3bec06a6b0 0x7f3bec06cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.459+0000 7f3c0e32e700 1 --2- 172.21.15.42:0/3055201637 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3bec06a6b0 0x7f3bec06cb60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3c04007fd0 tx=0x7f3c04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.449 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.462+0000 7f3bfeffd700 1 -- 172.21.15.42:0/3055201637 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f3c00054520 con 0x7f3c081461b0 2023-07-29T02:00:31.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.463+0000 7f37c63f9700 1 Processor -- start 2023-07-29T02:00:31.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.463+0000 7f37c63f9700 1 -- start start 2023-07-29T02:00:31.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.465+0000 7f37c63f9700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f37c0166aa0 0x7f37c00c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.465+0000 7f37c63f9700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f37c00b0e50 0x7f37c00c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.465+0000 7f37c63f9700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c00c02d0 con 0x7f37c0166e70 2023-07-29T02:00:31.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.465+0000 7f37c63f9700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c00c72e0 con 0x7f37c00b0e50 2023-07-29T02:00:31.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.465+0000 7f37c63f9700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c00c1870 con 0x7f37c0166aa0 2023-07-29T02:00:31.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.465+0000 7f37c4996700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f37c00b0e50 0x7f37c00c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.465+0000 7f37c4996700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f37c00b0e50 0x7f37c00c6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56466/0 (socket says 172.21.15.42:56466) 2023-07-29T02:00:31.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.465+0000 7f37c4996700 1 -- 172.21.15.42:0/1342852917 learned_addr learned my addr 172.21.15.42:0/1342852917 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:31.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.466+0000 7f37beffd700 1 -- 172.21.15.42:0/1342852917 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201637774 0 0) 0x7f37c00c02d0 con 0x7f37c0166e70 2023-07-29T02:00:31.456 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.467+0000 7f37beffd700 1 -- 172.21.15.42:0/1342852917 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37a8003590 con 0x7f37c0166e70 2023-07-29T02:00:31.456 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.467+0000 7f37c4996700 1 -- 172.21.15.42:0/1342852917 >> v2:172.21.15.144:3300/0 conn(0x7f37c0166aa0 msgr2=0x7f37c00c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:31.456 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.467+0000 7f37beffd700 1 -- 172.21.15.42:0/1342852917 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3937879296 0 0) 0x7f37a8003590 con 0x7f37c0166e70 2023-07-29T02:00:31.456 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.466+0000 7f37bffff700 1 --2- 172.21.15.42:0/1342852917 >> v2:172.21.15.144:3300/0 conn(0x7f37c0166aa0 0x7f37c00c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.457 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.467+0000 7f37c4996700 1 --2- 172.21.15.42:0/1342852917 >> v2:172.21.15.144:3300/0 conn(0x7f37c0166aa0 0x7f37c00c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.457 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.467+0000 7f37c4996700 1 -- 172.21.15.42:0/1342852917 >> v1:172.21.15.42:6789/0 conn(0x7f37c0166e70 legacy=0x7f37c00c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.457 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.467+0000 7f37c4996700 1 -- 172.21.15.42:0/1342852917 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c00c5a10 con 0x7f37c00b0e50 2023-07-29T02:00:31.457 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.467+0000 7f37bffff700 1 --2- 172.21.15.42:0/1342852917 >> v2:172.21.15.144:3300/0 conn(0x7f37c0166aa0 0x7f37c00c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:31.457 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.468+0000 7f37c4996700 1 --2- 172.21.15.42:0/1342852917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37c00b0e50 0x7f37c00c6a10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f37c006fa60 tx=0x7f37b800c5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca0950472afd399 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.457 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.468+0000 7f37beffd700 1 -- 172.21.15.42:0/1342852917 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b800f070 con 0x7f37c00b0e50 2023-07-29T02:00:31.457 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.468+0000 7f37beffd700 1 -- 172.21.15.42:0/1342852917 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b800ce00 con 0x7f37c00b0e50 2023-07-29T02:00:31.457 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.468+0000 7f37beffd700 1 -- 172.21.15.42:0/1342852917 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4001670 con 0x7f37c00b0e50 2023-07-29T02:00:31.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.469+0000 7f37c63f9700 1 -- 172.21.15.42:0/1342852917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37c00b0e50 msgr2=0x7f37c00c6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.469+0000 7f37c63f9700 1 --2- 172.21.15.42:0/1342852917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37c00b0e50 0x7f37c00c6a10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f37c006fa60 tx=0x7f37b800c5f0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.469+0000 7f37c63f9700 1 -- 172.21.15.42:0/1342852917 shutdown_connections 2023-07-29T02:00:31.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.469+0000 7f37c63f9700 1 --2- 172.21.15.42:0/1342852917 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37c00b0e50 0x7f37c00c6a10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.469+0000 7f37c63f9700 1 --2- 172.21.15.42:0/1342852917 >> v2:172.21.15.144:3300/0 conn(0x7f37c0166aa0 0x7f37c00c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.469+0000 7f37c63f9700 1 -- 172.21.15.42:0/1342852917 >> 172.21.15.42:0/1342852917 conn(0x7f37c00cae90 msgr2=0x7f37c00cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:31.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.470+0000 7f37c63f9700 1 -- 172.21.15.42:0/1342852917 shutdown_connections 2023-07-29T02:00:31.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.470+0000 7f37c63f9700 1 -- 172.21.15.42:0/1342852917 wait complete. 2023-07-29T02:00:31.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.471+0000 7f37c63f9700 1 Processor -- start 2023-07-29T02:00:31.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.472+0000 7f37c63f9700 1 -- start start 2023-07-29T02:00:31.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.473+0000 7f37c63f9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37c0166aa0 0x7f37c0207460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.473+0000 7f37c63f9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37c00c3690 0x7f37c016fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.473+0000 7f37c63f9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37c0171c60 0x7f37c0172100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.473+0000 7f37c63f9700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c00c2bd0 con 0x7f37c0171c60 2023-07-29T02:00:31.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.473+0000 7f37c63f9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c01717d0 con 0x7f37c00c3690 2023-07-29T02:00:31.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.473+0000 7f37c63f9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c00c22e0 con 0x7f37c0166aa0 2023-07-29T02:00:31.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.473+0000 7f37c4996700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37c0171c60 0x7f37c0172100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.463 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.473+0000 7f37c4996700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37c0171c60 0x7f37c0172100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56472/0 (socket says 172.21.15.42:56472) 2023-07-29T02:00:31.463 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.473+0000 7f37c4996700 1 -- 172.21.15.42:0/3074875969 learned_addr learned my addr 172.21.15.42:0/3074875969 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:31.463 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.474+0000 7f37c4996700 1 -- 172.21.15.42:0/3074875969 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37c0166aa0 msgr2=0x7f37c0207460 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-29T02:00:31.463 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.474+0000 7f37c4996700 1 --2- 172.21.15.42:0/3074875969 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37c0166aa0 0x7f37c0207460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.463 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.474+0000 7f37c4996700 1 -- 172.21.15.42:0/3074875969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37c00c3690 msgr2=0x7f37c016fcd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-29T02:00:31.463 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.474+0000 7f37c4996700 1 --2- 172.21.15.42:0/3074875969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37c00c3690 0x7f37c016fcd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.463 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.474+0000 7f37c4996700 1 -- 172.21.15.42:0/3074875969 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b800c050 con 0x7f37c0171c60 2023-07-29T02:00:31.463 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.474+0000 7f37c4996700 1 --2- 172.21.15.42:0/3074875969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37c0171c60 0x7f37c0172100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f37b800c2e0 tx=0x7f37b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.466 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.477+0000 7f37bcff9700 1 -- 172.21.15.42:0/3074875969 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b8007da0 con 0x7f37c0171c60 2023-07-29T02:00:31.466 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.477+0000 7f37bcff9700 1 -- 172.21.15.42:0/3074875969 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b8013430 con 0x7f37c0171c60 2023-07-29T02:00:31.466 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.477+0000 7f37bcff9700 1 -- 172.21.15.42:0/3074875969 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b80137a0 con 0x7f37c0171c60 2023-07-29T02:00:31.466 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.478+0000 7f37c63f9700 1 -- 172.21.15.42:0/3074875969 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c00c25c0 con 0x7f37c0171c60 2023-07-29T02:00:31.466 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.478+0000 7f37c63f9700 1 -- 172.21.15.42:0/3074875969 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c0171460 con 0x7f37c0171c60 2023-07-29T02:00:31.467 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.480+0000 7f37c63f9700 1 -- 172.21.15.42:0/3074875969 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c0170fe0 con 0x7f37c0171c60 2023-07-29T02:00:31.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.492+0000 7f4290e26700 1 Processor -- start 2023-07-29T02:00:31.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.492+0000 7f95027e7700 1 Processor -- start 2023-07-29T02:00:31.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.492+0000 7f4290e26700 1 -- start start 2023-07-29T02:00:31.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.492+0000 7f1a7d3e6700 1 Processor -- start 2023-07-29T02:00:31.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.492+0000 7f1a7d3e6700 1 -- start start 2023-07-29T02:00:31.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.493+0000 7f37bcff9700 1 -- 172.21.15.42:0/3074875969 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f37b8013900 con 0x7f37c0171c60 2023-07-29T02:00:31.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.493+0000 7f37bcff9700 1 --2- 172.21.15.42:0/3074875969 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f37ac06a6e0 0x7f37ac06cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.493+0000 7f37bcff9700 1 -- 172.21.15.42:0/3074875969 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f37b808acd0 con 0x7f37c0171c60 2023-07-29T02:00:31.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.494+0000 7f37bcff9700 1 -- 172.21.15.42:0/3074875969 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f37b808b0d0 con 0x7f37c0171c60 2023-07-29T02:00:31.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.494+0000 7f4290e26700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f428c0c5890 0x7f428c06d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.494+0000 7f4290e26700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f428c0c1240 0x7f428c06def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.494+0000 7f4290e26700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f428c15e120 con 0x7f428c0b0d30 2023-07-29T02:00:31.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.494+0000 7f4290e26700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428c157c80 con 0x7f428c0c5890 2023-07-29T02:00:31.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.494+0000 7f4290e26700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428c0c5d60 con 0x7f428c0c1240 2023-07-29T02:00:31.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.494+0000 7f428ad9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f428c0c1240 0x7f428c06def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.494+0000 7f428ad9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f428c0c1240 0x7f428c06def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:39856/0 (socket says 172.21.15.42:39856) 2023-07-29T02:00:31.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.494+0000 7f428ad9d700 1 -- 172.21.15.42:0/1195648604 learned_addr learned my addr 172.21.15.42:0/1195648604 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:31.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.494+0000 7f428ad9d700 1 -- 172.21.15.42:0/1195648604 >> v2:172.21.15.42:3300/0 conn(0x7f428c0c5890 msgr2=0x7f428c06d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:31.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.494+0000 7f428ad9d700 1 --2- 172.21.15.42:0/1195648604 >> v2:172.21.15.42:3300/0 conn(0x7f428c0c5890 0x7f428c06d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.494+0000 7f428ad9d700 1 -- 172.21.15.42:0/1195648604 >> v1:172.21.15.42:6789/0 conn(0x7f428c0b0d30 legacy=0x7f428c0bfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:31.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.494+0000 7f428ad9d700 1 -- 172.21.15.42:0/1195648604 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c15d7f0 con 0x7f428c0c1240 2023-07-29T02:00:31.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.495+0000 7f428ad9d700 1 --2- 172.21.15.42:0/1195648604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f428c0c1240 0x7f428c06def0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f428c0c7900 tx=0x7f4274009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50f4374c5ee6404 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.495+0000 7f428959a700 1 -- 172.21.15.42:0/1195648604 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4274004230 con 0x7f428c0c1240 2023-07-29T02:00:31.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.495+0000 7f428959a700 1 -- 172.21.15.42:0/1195648604 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4274004390 con 0x7f428c0c1240 2023-07-29T02:00:31.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.495+0000 7f428959a700 1 -- 172.21.15.42:0/1195648604 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42740036a0 con 0x7f428c0c1240 2023-07-29T02:00:31.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.493+0000 7f95027e7700 1 -- start start 2023-07-29T02:00:31.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.495+0000 7f95027e7700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f94fc0c5890 0x7f94fc06d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.495+0000 7f95027e7700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94fc15e120 con 0x7f94fc0b0d30 2023-07-29T02:00:31.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.495+0000 7f95027e7700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94fc157c80 con 0x7f94fc0c1240 2023-07-29T02:00:31.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.495+0000 7f95027e7700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94fc0c5d60 con 0x7f94fc0c5890 2023-07-29T02:00:31.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.495+0000 7f37bffff700 1 --2- 172.21.15.42:0/3074875969 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f37ac06a6e0 0x7f37ac06cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.493+0000 7f1a7d3e6700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f1a78072af0 0x7f1a78071050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.493+0000 7f1a7d3e6700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a780c61f0 con 0x7f1a78157420 2023-07-29T02:00:31.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.493+0000 7f1a7d3e6700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a780c8920 con 0x7f1a781577f0 2023-07-29T02:00:31.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.493+0000 7f1a7d3e6700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a780c6ee0 con 0x7f1a78072af0 2023-07-29T02:00:31.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.493+0000 7f1a76ffd700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f1a78157420 0x7f1a780c76a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50278/0 (socket says 172.21.15.42:50278) 2023-07-29T02:00:31.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.493+0000 7f1a76ffd700 1 -- 172.21.15.42:0/1683436089 learned_addr learned my addr 172.21.15.42:0/1683436089 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:31.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.493+0000 7f1a777fe700 1 --2- 172.21.15.42:0/1683436089 >> v2:172.21.15.42:3300/0 conn(0x7f1a78072af0 0x7f1a78071050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.494+0000 7f1a777fe700 1 -- 172.21.15.42:0/1683436089 >> v1:172.21.15.144:6789/0 conn(0x7f1a781577f0 legacy=0x7f1a78070940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-29T02:00:31.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.494+0000 7f1a777fe700 1 -- 172.21.15.42:0/1683436089 >> v1:172.21.15.42:6789/0 conn(0x7f1a78157420 legacy=0x7f1a780c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:31.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.494+0000 7f1a777fe700 1 -- 172.21.15.42:0/1683436089 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7815e1a0 con 0x7f1a78072af0 2023-07-29T02:00:31.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.494+0000 7f1a777fe700 1 --2- 172.21.15.42:0/1683436089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a78072af0 0x7f1a78071050 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009d90 tx=0x7f1a7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b33ed5befb7a06 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.495+0000 7f1a75ffb700 1 -- 172.21.15.42:0/1683436089 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7000e070 con 0x7f1a78072af0 2023-07-29T02:00:31.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.495+0000 7f1a75ffb700 1 -- 172.21.15.42:0/1683436089 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7000bb50 con 0x7f1a78072af0 2023-07-29T02:00:31.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.495+0000 7f1a75ffb700 1 -- 172.21.15.42:0/1683436089 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70003a20 con 0x7f1a78072af0 2023-07-29T02:00:31.489 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.496+0000 7f9500d84700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f94fc0c1240 0x7f94fc06b760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.42:52784/0 (socket says 172.21.15.42:52784) 2023-07-29T02:00:31.489 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.496+0000 7f9500d84700 1 -- 172.21.15.42:0/1400668191 learned_addr learned my addr 172.21.15.42:0/1400668191 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:31.489 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.496+0000 7f4290e26700 1 -- 172.21.15.42:0/1195648604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f428c0c1240 msgr2=0x7f428c06def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.489 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.496+0000 7f4290e26700 1 --2- 172.21.15.42:0/1195648604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f428c0c1240 0x7f428c06def0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f428c0c7900 tx=0x7f4274009bd0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.490 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.497+0000 7f4290e26700 1 -- 172.21.15.42:0/1195648604 shutdown_connections 2023-07-29T02:00:31.490 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.497+0000 7f4290e26700 1 --2- 172.21.15.42:0/1195648604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f428c0c1240 0x7f428c06def0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.490 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.497+0000 7f4290e26700 1 --2- 172.21.15.42:0/1195648604 >> v2:172.21.15.42:3300/0 conn(0x7f428c0c5890 0x7f428c06d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.490 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.497+0000 7f4290e26700 1 -- 172.21.15.42:0/1195648604 >> 172.21.15.42:0/1195648604 conn(0x7f428c0cae90 msgr2=0x7f428c0cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:31.490 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.497+0000 7f4290e26700 1 -- 172.21.15.42:0/1195648604 shutdown_connections 2023-07-29T02:00:31.490 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.497+0000 7f94fb7fe700 1 --2- 172.21.15.42:0/1400668191 >> v2:172.21.15.42:3300/0 conn(0x7f94fc0c5890 0x7f94fc06d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.497+0000 7f37bffff700 1 --2- 172.21.15.42:0/3074875969 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f37ac06a6e0 0x7f37ac06cb90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f37b0006fd0 tx=0x7f37b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.497+0000 7f94faffd700 1 -- 172.21.15.42:0/1400668191 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168138961 0 0) 0x7f94fc15e120 con 0x7f94fc0b0d30 2023-07-29T02:00:31.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.497+0000 7f94faffd700 1 -- 172.21.15.42:0/1400668191 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94e40035b0 con 0x7f94fc0b0d30 2023-07-29T02:00:31.492 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.497+0000 7f94faffd700 1 -- 172.21.15.42:0/1400668191 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3630066930 0 0) 0x7f94fc157c80 con 0x7f94fc0c1240 2023-07-29T02:00:31.492 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.497+0000 7f94faffd700 1 -- 172.21.15.42:0/1400668191 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94fc15e120 con 0x7f94fc0c1240 2023-07-29T02:00:31.492 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.497+0000 7f1a7d3e6700 1 -- 172.21.15.42:0/1683436089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a78072af0 msgr2=0x7f1a78071050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.492 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.497+0000 7f1a7d3e6700 1 --2- 172.21.15.42:0/1683436089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a78072af0 0x7f1a78071050 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009d90 tx=0x7f1a7000b330 comp rx=0 tx=0).stop 2023-07-29T02:00:31.492 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.497+0000 7f4290e26700 1 -- 172.21.15.42:0/1195648604 wait complete. 2023-07-29T02:00:31.493 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.497+0000 7f94fb7fe700 1 -- 172.21.15.42:0/1400668191 >> v1:172.21.15.144:6789/0 conn(0x7f94fc0c1240 legacy=0x7f94fc06b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.493 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.497+0000 7f94fb7fe700 1 -- 172.21.15.42:0/1400668191 >> v1:172.21.15.42:6789/0 conn(0x7f94fc0b0d30 legacy=0x7f94fc0bfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.493 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.498+0000 7f94fb7fe700 1 -- 172.21.15.42:0/1400668191 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94fc15d7f0 con 0x7f94fc0c5890 2023-07-29T02:00:31.493 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.498+0000 7f1a7d3e6700 1 -- 172.21.15.42:0/1683436089 shutdown_connections 2023-07-29T02:00:31.494 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.498+0000 7f1a7d3e6700 1 --2- 172.21.15.42:0/1683436089 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a78072af0 0x7f1a78071050 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.494 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.498+0000 7f1a7d3e6700 1 -- 172.21.15.42:0/1683436089 >> 172.21.15.42:0/1683436089 conn(0x7f1a780cc420 msgr2=0x7f1a780c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:31.494 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.498+0000 7f94fb7fe700 1 --2- 172.21.15.42:0/1400668191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94fc0c5890 0x7f94fc06d9b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f94ec009840 tx=0x7f94ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8177c4afb646f993 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.494 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.498+0000 7f94faffd700 1 -- 172.21.15.42:0/1400668191 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec004290 con 0x7f94fc0c5890 2023-07-29T02:00:31.495 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.498+0000 7f94faffd700 1 -- 172.21.15.42:0/1400668191 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec0043f0 con 0x7f94fc0c5890 2023-07-29T02:00:31.495 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.498+0000 7f94faffd700 1 -- 172.21.15.42:0/1400668191 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec0038a0 con 0x7f94fc0c5890 2023-07-29T02:00:31.495 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.499+0000 7f1a7d3e6700 1 -- 172.21.15.42:0/1683436089 shutdown_connections 2023-07-29T02:00:31.495 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.499+0000 7f95027e7700 1 -- 172.21.15.42:0/1400668191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94fc0c5890 msgr2=0x7f94fc06d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.495 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.499+0000 7f95027e7700 1 --2- 172.21.15.42:0/1400668191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94fc0c5890 0x7f94fc06d9b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f94ec009840 tx=0x7f94ec009b50 comp rx=0 tx=0).stop 2023-07-29T02:00:31.496 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.499+0000 7f95027e7700 1 -- 172.21.15.42:0/1400668191 shutdown_connections 2023-07-29T02:00:31.496 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.499+0000 7f95027e7700 1 --2- 172.21.15.42:0/1400668191 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94fc0c5890 0x7f94fc06d9b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.496 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.499+0000 7f4290e26700 1 Processor -- start 2023-07-29T02:00:31.496 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.499+0000 7f95027e7700 1 -- 172.21.15.42:0/1400668191 >> 172.21.15.42:0/1400668191 conn(0x7f94fc0cae90 msgr2=0x7f94fc0cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:31.497 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.500+0000 7f95027e7700 1 -- 172.21.15.42:0/1400668191 shutdown_connections 2023-07-29T02:00:31.497 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.499+0000 7f1a7d3e6700 1 -- 172.21.15.42:0/1683436089 wait complete. 2023-07-29T02:00:31.497 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.500+0000 7f1a7d3e6700 1 Processor -- start 2023-07-29T02:00:31.497 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.499+0000 7f4290e26700 1 -- start start 2023-07-29T02:00:31.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.500+0000 7f4290e26700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f428c0b0d30 0x7f428c15a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.500+0000 7f4290e26700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f428c0c1240 0x7f428c15a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.500+0000 7f4290e26700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f428c0c5890 0x7f428c0c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.500+0000 7f4290e26700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c0c2b10 con 0x7f428c0c5890 2023-07-29T02:00:31.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.500+0000 7f4290e26700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c0c3dc0 con 0x7f428c0b0d30 2023-07-29T02:00:31.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.501+0000 7f4290e26700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c0c2830 con 0x7f428c0c1240 2023-07-29T02:00:31.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.501+0000 7f4289d9b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f428c0c1240 0x7f428c15a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.499 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.501+0000 7f428a59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f428c0b0d30 0x7f428c15a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.499 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.501+0000 7f4289d9b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f428c0c1240 0x7f428c15a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:57006/0 (socket says 172.21.15.42:57006) 2023-07-29T02:00:31.499 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.501+0000 7f428a59c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f428c0b0d30 0x7f428c15a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:39872/0 (socket says 172.21.15.42:39872) 2023-07-29T02:00:31.499 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.501+0000 7f4289d9b700 1 -- 172.21.15.42:0/1840423122 learned_addr learned my addr 172.21.15.42:0/1840423122 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:31.499 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.500+0000 7f95027e7700 1 -- 172.21.15.42:0/1400668191 wait complete. 2023-07-29T02:00:31.499 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.501+0000 7f95027e7700 1 Processor -- start 2023-07-29T02:00:31.500 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.501+0000 7f4289d9b700 1 -- 172.21.15.42:0/1840423122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f428c0b0d30 msgr2=0x7f428c15a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.500 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.501+0000 7f4289d9b700 1 --2- 172.21.15.42:0/1840423122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f428c0b0d30 0x7f428c15a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.500 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.501+0000 7f4289d9b700 1 -- 172.21.15.42:0/1840423122 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f428c0c5890 msgr2=0x7f428c0c4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.500 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.501+0000 7f4289d9b700 1 --2- 172.21.15.42:0/1840423122 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f428c0c5890 0x7f428c0c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.500 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.501+0000 7f4289d9b700 1 -- 172.21.15.42:0/1840423122 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4274009550 con 0x7f428c0c1240 2023-07-29T02:00:31.501 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.501+0000 7f1a7d3e6700 1 -- start start 2023-07-29T02:00:31.501 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.502+0000 7f1a7d3e6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a78072af0 0x7f1a780c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.501 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.502+0000 7f1a7d3e6700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a78157420 0x7f1a7815e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.501 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.502+0000 7f1a7d3e6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a781577f0 0x7f1a781fbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.501 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.502+0000 7f1a7d3e6700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a781fc260 con 0x7f1a78157420 2023-07-29T02:00:31.502 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.502+0000 7f1a7d3e6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78159fb0 con 0x7f1a78072af0 2023-07-29T02:00:31.502 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.502+0000 7f1a7d3e6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7815a280 con 0x7f1a781577f0 2023-07-29T02:00:31.502 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.502+0000 7f1a76ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a78072af0 0x7f1a780c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.502 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.502+0000 7f1a76ffd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a78072af0 0x7f1a780c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:39876/0 (socket says 172.21.15.42:39876) 2023-07-29T02:00:31.502 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.502+0000 7f1a76ffd700 1 -- 172.21.15.42:0/2339708773 learned_addr learned my addr 172.21.15.42:0/2339708773 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:31.502 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.502+0000 7f1a777fe700 1 --2- 172.21.15.42:0/2339708773 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a781577f0 0x7f1a781fbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.502+0000 7f95027e7700 1 -- start start 2023-07-29T02:00:31.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.503+0000 7f1a76ffd700 1 -- 172.21.15.42:0/2339708773 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a781577f0 msgr2=0x7f1a781fbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.503+0000 7f1a76ffd700 1 --2- 172.21.15.42:0/2339708773 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a781577f0 0x7f1a781fbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.503+0000 7f1a76ffd700 1 -- 172.21.15.42:0/2339708773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a78157420 msgr2=0x7f1a7815e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.503+0000 7f1a76ffd700 1 --2- 172.21.15.42:0/2339708773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a78157420 0x7f1a7815e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.504 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.503+0000 7f1a76ffd700 1 -- 172.21.15.42:0/2339708773 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a70009a70 con 0x7f1a78072af0 2023-07-29T02:00:31.504 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.503+0000 7f4289d9b700 1 --2- 172.21.15.42:0/1840423122 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f428c0c1240 0x7f428c15a9a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f427c00b9c0 tx=0x7f427c00bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.504 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.503+0000 7f1a76ffd700 1 --2- 172.21.15.42:0/2339708773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a78072af0 0x7f1a780c4760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800c500 tx=0x7f1a6800c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.505 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.503+0000 7f95027e7700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94fc0b0d30 0x7f94fc1ed2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.505 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.503+0000 7f95027e7700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94fc0c1240 0x7f94fc1ee2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.505 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.503+0000 7f95027e7700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94fc0c5890 0x7f94fc1fe900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.505 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.503+0000 7f95027e7700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc1ee810 con 0x7f94fc0b0d30 2023-07-29T02:00:31.505 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.503+0000 7f95027e7700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc1ece50 con 0x7f94fc0c5890 2023-07-29T02:00:31.505 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.503+0000 7f95027e7700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc1fee40 con 0x7f94fc0c1240 2023-07-29T02:00:31.505 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.504+0000 7f94fb7fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94fc0c1240 0x7f94fc1ee2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.506 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.504+0000 7f9500d84700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94fc0c5890 0x7f94fc1fe900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.506 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.504+0000 7f94fbfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94fc0b0d30 0x7f94fc1ed2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.506 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.504+0000 7f9500d84700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94fc0c5890 0x7f94fc1fe900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:39886/0 (socket says 172.21.15.42:39886) 2023-07-29T02:00:31.506 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.504+0000 7f94fbfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94fc0b0d30 0x7f94fc1ed2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56504/0 (socket says 172.21.15.42:56504) 2023-07-29T02:00:31.506 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.504+0000 7f9500d84700 1 -- 172.21.15.42:0/3182728342 learned_addr learned my addr 172.21.15.42:0/3182728342 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:31.506 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.503+0000 7f4282ffd700 1 -- 172.21.15.42:0/1840423122 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c00ca30 con 0x7f428c0c1240 2023-07-29T02:00:31.507 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.503+0000 7f4282ffd700 1 -- 172.21.15.42:0/1840423122 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427c00cbb0 con 0x7f428c0c1240 2023-07-29T02:00:31.507 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.503+0000 7f4282ffd700 1 -- 172.21.15.42:0/1840423122 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c014440 con 0x7f428c0c1240 2023-07-29T02:00:31.507 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.503+0000 7f4290e26700 1 -- 172.21.15.42:0/1840423122 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428c158cd0 con 0x7f428c0c1240 2023-07-29T02:00:31.507 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.503+0000 7f4290e26700 1 -- 172.21.15.42:0/1840423122 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428c159c60 con 0x7f428c0c1240 2023-07-29T02:00:31.507 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.504+0000 7f1a677fe700 1 -- 172.21.15.42:0/2339708773 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68005d70 con 0x7f1a78072af0 2023-07-29T02:00:31.508 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.504+0000 7f1a677fe700 1 -- 172.21.15.42:0/2339708773 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a680070d0 con 0x7f1a78072af0 2023-07-29T02:00:31.508 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.504+0000 7f1a677fe700 1 -- 172.21.15.42:0/2339708773 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68007480 con 0x7f1a78072af0 2023-07-29T02:00:31.508 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.504+0000 7f1a7d3e6700 1 -- 172.21.15.42:0/2339708773 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a7815a560 con 0x7f1a78072af0 2023-07-29T02:00:31.508 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.504+0000 7f1a7d3e6700 1 -- 172.21.15.42:0/2339708773 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a780c3f60 con 0x7f1a78072af0 2023-07-29T02:00:31.509 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.504+0000 7f94fbfff700 1 -- 172.21.15.42:0/3182728342 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94fc0c1240 msgr2=0x7f94fc1ee2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.509 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.504+0000 7f94fbfff700 1 --2- 172.21.15.42:0/3182728342 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94fc0c1240 0x7f94fc1ee2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.509 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.504+0000 7f94fbfff700 1 -- 172.21.15.42:0/3182728342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94fc0c5890 msgr2=0x7f94fc1fe900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.509 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.504+0000 7f94fbfff700 1 --2- 172.21.15.42:0/3182728342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94fc0c5890 0x7f94fc1fe900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.509 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.504+0000 7f94fbfff700 1 -- 172.21.15.42:0/3182728342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec0094a0 con 0x7f94fc0b0d30 2023-07-29T02:00:31.509 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.505+0000 7f94fbfff700 1 --2- 172.21.15.42:0/3182728342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94fc0b0d30 0x7f94fc1ed2e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f94f000c450 tx=0x7f94f000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.510 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.505+0000 7f94f8ff9700 1 -- 172.21.15.42:0/3182728342 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f00052d0 con 0x7f94fc0b0d30 2023-07-29T02:00:31.510 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.505+0000 7f94f8ff9700 1 -- 172.21.15.42:0/3182728342 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f0005430 con 0x7f94fc0b0d30 2023-07-29T02:00:31.510 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.505+0000 7f94f8ff9700 1 -- 172.21.15.42:0/3182728342 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f00038c0 con 0x7f94fc0b0d30 2023-07-29T02:00:31.510 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.505+0000 7f95027e7700 1 -- 172.21.15.42:0/3182728342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94fc0c2ae0 con 0x7f94fc0b0d30 2023-07-29T02:00:31.510 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.505+0000 7f95027e7700 1 -- 172.21.15.42:0/3182728342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94fc0c3080 con 0x7f94fc0b0d30 2023-07-29T02:00:31.510 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.506+0000 7f4282ffd700 1 -- 172.21.15.42:0/1840423122 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f427c01d3b0 con 0x7f428c0c1240 2023-07-29T02:00:31.511 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.507+0000 7f2ba57a1700 1 Processor -- start 2023-07-29T02:00:31.511 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.507+0000 7f1a677fe700 1 -- 172.21.15.42:0/2339708773 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f1a680075e0 con 0x7f1a78072af0 2023-07-29T02:00:31.511 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.507+0000 7f4282ffd700 1 --2- 172.21.15.42:0/1840423122 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f426c06a6b0 0x7f426c06cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.512 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.507+0000 7f4282ffd700 1 -- 172.21.15.42:0/1840423122 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f427c0889f0 con 0x7f428c0c1240 2023-07-29T02:00:31.512 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.507+0000 7f428a59c700 1 --2- 172.21.15.42:0/1840423122 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f426c06a6b0 0x7f426c06cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.512 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.507+0000 7f1a677fe700 1 --2- 172.21.15.42:0/2339708773 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f1a5c06a630 0x7f1a5c06cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.512 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.507+0000 7f1a677fe700 1 -- 172.21.15.42:0/2339708773 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1a680883b0 con 0x7f1a78072af0 2023-07-29T02:00:31.513 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.508+0000 7f1a767fc700 1 --2- 172.21.15.42:0/2339708773 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f1a5c06a630 0x7f1a5c06cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.513 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.508+0000 7f1a767fc700 1 --2- 172.21.15.42:0/2339708773 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f1a5c06a630 0x7f1a5c06cae0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1a78061420 tx=0x7f1a6c007ae0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.513 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.508+0000 7f95027e7700 1 -- 172.21.15.42:0/3182728342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94fc1ed130 con 0x7f94fc0b0d30 2023-07-29T02:00:31.513 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.509+0000 7f2ba57a1700 1 -- start start 2023-07-29T02:00:31.514 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.509+0000 7f94f8ff9700 1 -- 172.21.15.42:0/3182728342 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f94f0003a20 con 0x7f94fc0b0d30 2023-07-29T02:00:31.514 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.509+0000 7f428a59c700 1 --2- 172.21.15.42:0/1840423122 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f426c06a6b0 0x7f426c06cb60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4284004f30 tx=0x7f4284009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.514 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.510+0000 7f94f8ff9700 1 --2- 172.21.15.42:0/3182728342 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f94e806a660 0x7f94e806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.515 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.510+0000 7f94f8ff9700 1 -- 172.21.15.42:0/3182728342 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f94f0088190 con 0x7f94fc0b0d30 2023-07-29T02:00:31.515 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.510+0000 7f2ba57a1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2ba01594e0 0x7f2ba01598e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.515 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.510+0000 7f2ba57a1700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba00c0730 con 0x7f2ba0153400 2023-07-29T02:00:31.516 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.510+0000 7f2ba57a1700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba00cbbc0 con 0x7f2ba00c5890 2023-07-29T02:00:31.516 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.510+0000 7f2ba57a1700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba00c1ea0 con 0x7f2ba01594e0 2023-07-29T02:00:31.516 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.510+0000 7f2b9e7fc700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f2ba00c5890 0x7f2ba00c64d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.42:52810/0 (socket says 172.21.15.42:52810) 2023-07-29T02:00:31.516 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.510+0000 7f2b9effd700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f2ba0153400 0x7f2ba00c7010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50320/0 (socket says 172.21.15.42:50320) 2023-07-29T02:00:31.516 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.510+0000 7f2b9e7fc700 1 -- 172.21.15.42:0/2859576563 learned_addr learned my addr 172.21.15.42:0/2859576563 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:31.516 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.511+0000 7f2b9f7fe700 1 --2- 172.21.15.42:0/2859576563 >> v2:172.21.15.144:3300/0 conn(0x7f2ba01594e0 0x7f2ba01598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.516 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.511+0000 7f2b9f7fe700 1 -- 172.21.15.42:0/2859576563 >> v1:172.21.15.144:6789/0 conn(0x7f2ba00c5890 legacy=0x7f2ba00c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:31.517 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.511+0000 7f2b9f7fe700 1 -- 172.21.15.42:0/2859576563 >> v1:172.21.15.42:6789/0 conn(0x7f2ba0153400 legacy=0x7f2ba00c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.517 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.511+0000 7f2b9f7fe700 1 -- 172.21.15.42:0/2859576563 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba00c1500 con 0x7f2ba01594e0 2023-07-29T02:00:31.517 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.511+0000 7f2b9f7fe700 1 --2- 172.21.15.42:0/2859576563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba01594e0 0x7f2ba01598e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009840 tx=0x7f2b94009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8517026dbee71036 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.517 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.512+0000 7f94fb7fe700 1 --2- 172.21.15.42:0/3182728342 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f94e806a660 0x7f94e806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.517 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.512+0000 7f94fb7fe700 1 --2- 172.21.15.42:0/3182728342 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f94e806a660 0x7f94e806cb10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f94fc0c5c90 tx=0x7f94ec010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.518 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.515+0000 7f4290e26700 1 -- 172.21.15.42:0/1840423122 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428c06d0c0 con 0x7f428c0c1240 2023-07-29T02:00:31.518 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.515+0000 7f94f8ff9700 1 -- 172.21.15.42:0/3182728342 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f94f0053310 con 0x7f94fc0b0d30 2023-07-29T02:00:31.518 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.515+0000 7f1a7d3e6700 1 -- 172.21.15.42:0/2339708773 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a540052f0 con 0x7f1a78072af0 2023-07-29T02:00:31.519 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.516+0000 7f2b9dffb700 1 -- 172.21.15.42:0/2859576563 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94004230 con 0x7f2ba01594e0 2023-07-29T02:00:31.520 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.516+0000 7f2b9dffb700 1 -- 172.21.15.42:0/2859576563 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b94004390 con 0x7f2ba01594e0 2023-07-29T02:00:31.520 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.516+0000 7f2b9dffb700 1 -- 172.21.15.42:0/2859576563 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b940036a0 con 0x7f2ba01594e0 2023-07-29T02:00:31.520 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.517+0000 7f2ba57a1700 1 -- 172.21.15.42:0/2859576563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba01594e0 msgr2=0x7f2ba01598e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.520 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.517+0000 7f2ba57a1700 1 --2- 172.21.15.42:0/2859576563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba01594e0 0x7f2ba01598e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009840 tx=0x7f2b94009b50 comp rx=0 tx=0).stop 2023-07-29T02:00:31.520 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.517+0000 7f2ba57a1700 1 -- 172.21.15.42:0/2859576563 shutdown_connections 2023-07-29T02:00:31.520 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.517+0000 7f2ba57a1700 1 --2- 172.21.15.42:0/2859576563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba01594e0 0x7f2ba01598e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.520 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.517+0000 7f2ba57a1700 1 -- 172.21.15.42:0/2859576563 >> 172.21.15.42:0/2859576563 conn(0x7f2ba00cae90 msgr2=0x7f2ba00cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:31.521 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.517+0000 7f2ba57a1700 1 -- 172.21.15.42:0/2859576563 shutdown_connections 2023-07-29T02:00:31.521 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.517+0000 7f2ba57a1700 1 -- 172.21.15.42:0/2859576563 wait complete. 2023-07-29T02:00:31.521 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.519+0000 7f2ba57a1700 1 Processor -- start 2023-07-29T02:00:31.521 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.520+0000 7f2ba57a1700 1 -- start start 2023-07-29T02:00:31.521 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.521+0000 7f2ba57a1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ba00c5890 0x7f2ba0151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.521 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.521+0000 7f2ba57a1700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba0153400 0x7f2ba01e30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.521 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.521+0000 7f2ba57a1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba01594e0 0x7f2ba01e3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.522 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.521+0000 7f2ba57a1700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba0072460 con 0x7f2ba0153400 2023-07-29T02:00:31.522 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.521+0000 7f2ba57a1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba01e2c50 con 0x7f2ba01594e0 2023-07-29T02:00:31.522 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.521+0000 7f2ba57a1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba0071ee0 con 0x7f2ba00c5890 2023-07-29T02:00:31.522 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.521+0000 7f2b9f7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba01594e0 0x7f2ba01e3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.522 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.521+0000 7f2b9f7fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba01594e0 0x7f2ba01e3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:39902/0 (socket says 172.21.15.42:39902) 2023-07-29T02:00:31.522 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.521+0000 7f2b9f7fe700 1 -- 172.21.15.42:0/4161272443 learned_addr learned my addr 172.21.15.42:0/4161272443 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:31.522 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.521+0000 7f2b9effd700 1 --2- 172.21.15.42:0/4161272443 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ba00c5890 0x7f2ba0151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.522 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.521+0000 7f2b9f7fe700 1 -- 172.21.15.42:0/4161272443 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ba00c5890 msgr2=0x7f2ba0151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.523 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.521+0000 7f2b9f7fe700 1 --2- 172.21.15.42:0/4161272443 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ba00c5890 0x7f2ba0151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.523 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.521+0000 7f2b9f7fe700 1 -- 172.21.15.42:0/4161272443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba0153400 msgr2=0x7f2ba01e30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.523 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.521+0000 7f2b9f7fe700 1 --2- 172.21.15.42:0/4161272443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba0153400 0x7f2ba01e30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.523 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.522+0000 7f2b9f7fe700 1 -- 172.21.15.42:0/4161272443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b940094a0 con 0x7f2ba01594e0 2023-07-29T02:00:31.523 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.522+0000 7f2b9f7fe700 1 --2- 172.21.15.42:0/4161272443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba01594e0 0x7f2ba01e3620 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009f50 tx=0x7f2b94004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.523 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.521+0000 7f1a677fe700 1 -- 172.21.15.42:0/2339708773 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f1a68017080 con 0x7f1a78072af0 2023-07-29T02:00:31.524 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.521+0000 7f4282ffd700 1 -- 172.21.15.42:0/1840423122 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f427c053c70 con 0x7f428c0c1240 2023-07-29T02:00:31.524 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.533+0000 7f2b8f7fe700 1 -- 172.21.15.42:0/4161272443 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94003df0 con 0x7f2ba01594e0 2023-07-29T02:00:31.524 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.533+0000 7f2b8f7fe700 1 -- 172.21.15.42:0/4161272443 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9401f070 con 0x7f2ba01594e0 2023-07-29T02:00:31.524 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.533+0000 7f2b8f7fe700 1 -- 172.21.15.42:0/4161272443 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b94011870 con 0x7f2ba01594e0 2023-07-29T02:00:31.525 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.533+0000 7f2ba57a1700 1 -- 172.21.15.42:0/4161272443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba01f2680 con 0x7f2ba01594e0 2023-07-29T02:00:31.525 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.533+0000 7f2ba57a1700 1 -- 172.21.15.42:0/4161272443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba01f2960 con 0x7f2ba01594e0 2023-07-29T02:00:31.525 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.536+0000 7f2b8f7fe700 1 -- 172.21.15.42:0/4161272443 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f2b94021030 con 0x7f2ba01594e0 2023-07-29T02:00:31.525 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.536+0000 7f2b8f7fe700 1 --2- 172.21.15.42:0/4161272443 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2b8406a680 0x7f2b8406cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.525 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.536+0000 7f2b8f7fe700 1 -- 172.21.15.42:0/4161272443 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2b9408a270 con 0x7f2ba01594e0 2023-07-29T02:00:31.526 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.538+0000 7f2b9effd700 1 --2- 172.21.15.42:0/4161272443 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2b8406a680 0x7f2b8406cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.526 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.538+0000 7f2b9effd700 1 --2- 172.21.15.42:0/4161272443 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2b8406a680 0x7f2b8406cb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2b980012e0 tx=0x7f2b98001b20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.546+0000 7f2ba57a1700 1 -- 172.21.15.42:0/4161272443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7c0052f0 con 0x7f2ba01594e0 2023-07-29T02:00:31.544 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.557+0000 7f2b8f7fe700 1 -- 172.21.15.42:0/4161272443 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f2b940553e0 con 0x7f2ba01594e0 2023-07-29T02:00:31.545 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.557+0000 7fec970ca700 1 Processor -- start 2023-07-29T02:00:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.558+0000 7fec970ca700 1 -- start start 2023-07-29T02:00:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.559+0000 7fec970ca700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fec9014f4c0 0x7fec9006d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.559+0000 7fec970ca700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fec900bfeb0 0x7fec9006def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.559+0000 7fec970ca700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec900c5b40 con 0x7fec900c73d0 2023-07-29T02:00:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.559+0000 7fec970ca700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9006c210 con 0x7fec9014f4c0 2023-07-29T02:00:31.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.559+0000 7fec970ca700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9006c4f0 con 0x7fec900bfeb0 2023-07-29T02:00:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.560+0000 7fec8ffff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fec900bfeb0 0x7fec9006def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.560+0000 7fec8ffff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fec900bfeb0 0x7fec9006def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:57048/0 (socket says 172.21.15.42:57048) 2023-07-29T02:00:31.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.560+0000 7fec8ffff700 1 -- 172.21.15.42:0/1396986444 learned_addr learned my addr 172.21.15.42:0/1396986444 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:31.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.561+0000 7fec8ffff700 1 -- 172.21.15.42:0/1396986444 >> v2:172.21.15.42:3300/0 conn(0x7fec9014f4c0 msgr2=0x7fec9006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:31.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.561+0000 7fec8ffff700 1 --2- 172.21.15.42:0/1396986444 >> v2:172.21.15.42:3300/0 conn(0x7fec9014f4c0 0x7fec9006d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.561+0000 7fec8ffff700 1 -- 172.21.15.42:0/1396986444 >> v1:172.21.15.144:6789/0 conn(0x7fec900c73d0 legacy=0x7fec90158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.561+0000 7fec8ffff700 1 -- 172.21.15.42:0/1396986444 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec900c5d90 con 0x7fec900bfeb0 2023-07-29T02:00:31.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.561+0000 7fec8ffff700 1 --2- 172.21.15.42:0/1396986444 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fec900bfeb0 0x7fec9006def0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fec840088f0 tx=0x7fec8400d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c137569b2b6a419 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.561+0000 7fec8f7fe700 1 -- 172.21.15.42:0/1396986444 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec84010070 con 0x7fec900bfeb0 2023-07-29T02:00:31.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.561+0000 7fec8f7fe700 1 -- 172.21.15.42:0/1396986444 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8400da80 con 0x7fec900bfeb0 2023-07-29T02:00:31.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.561+0000 7fec8f7fe700 1 -- 172.21.15.42:0/1396986444 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8400de10 con 0x7fec900bfeb0 2023-07-29T02:00:31.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.562+0000 7fec970ca700 1 -- 172.21.15.42:0/1396986444 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fec900bfeb0 msgr2=0x7fec9006def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.562+0000 7fec970ca700 1 --2- 172.21.15.42:0/1396986444 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fec900bfeb0 0x7fec9006def0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fec840088f0 tx=0x7fec8400d330 comp rx=0 tx=0).stop 2023-07-29T02:00:31.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.563+0000 7fec970ca700 1 -- 172.21.15.42:0/1396986444 shutdown_connections 2023-07-29T02:00:31.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.563+0000 7fec970ca700 1 --2- 172.21.15.42:0/1396986444 >> v2:172.21.15.42:3300/0 conn(0x7fec9014f4c0 0x7fec9006d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.563+0000 7fec970ca700 1 --2- 172.21.15.42:0/1396986444 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fec900bfeb0 0x7fec9006def0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.563+0000 7fec970ca700 1 -- 172.21.15.42:0/1396986444 >> 172.21.15.42:0/1396986444 conn(0x7fec900cae90 msgr2=0x7fec900cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:31.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.565+0000 7fec970ca700 1 -- 172.21.15.42:0/1396986444 shutdown_connections 2023-07-29T02:00:31.555 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.566+0000 7fec970ca700 1 -- 172.21.15.42:0/1396986444 wait complete. 2023-07-29T02:00:31.555 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.567+0000 7fec970ca700 1 Processor -- start 2023-07-29T02:00:31.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.568+0000 7fec970ca700 1 -- start start 2023-07-29T02:00:31.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.569+0000 7fec970ca700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fec900c73d0 0x7fec90144b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.569+0000 7fec970ca700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec9014f4c0 0x7fec90145040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.569+0000 7fec970ca700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec90157960 0x7fec901debf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.569+0000 7fec970ca700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec90152ac0 con 0x7fec9014f4c0 2023-07-29T02:00:31.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.569+0000 7fec970ca700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec901ddb60 con 0x7fec90157960 2023-07-29T02:00:31.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.569+0000 7fec970ca700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec90152440 con 0x7fec900c73d0 2023-07-29T02:00:31.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.570+0000 7fec95667700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec90157960 0x7fec901debf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.570+0000 7fec95667700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec90157960 0x7fec901debf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:39916/0 (socket says 172.21.15.42:39916) 2023-07-29T02:00:31.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.570+0000 7fec95667700 1 -- 172.21.15.42:0/2457704128 learned_addr learned my addr 172.21.15.42:0/2457704128 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:31.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.570+0000 7fec94e66700 1 --2- 172.21.15.42:0/2457704128 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fec900c73d0 0x7fec90144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.570+0000 7fec8ffff700 1 --2- 172.21.15.42:0/2457704128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec9014f4c0 0x7fec90145040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.570+0000 7fec94e66700 1 -- 172.21.15.42:0/2457704128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec90157960 msgr2=0x7fec901debf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.570+0000 7fec94e66700 1 --2- 172.21.15.42:0/2457704128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec90157960 0x7fec901debf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.570+0000 7fec94e66700 1 -- 172.21.15.42:0/2457704128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec9014f4c0 msgr2=0x7fec90145040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.570+0000 7fec94e66700 1 --2- 172.21.15.42:0/2457704128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec9014f4c0 0x7fec90145040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.570+0000 7fec94e66700 1 -- 172.21.15.42:0/2457704128 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec840085d0 con 0x7fec900c73d0 2023-07-29T02:00:31.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.571+0000 7fec94e66700 1 --2- 172.21.15.42:0/2457704128 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fec900c73d0 0x7fec90144b00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fec8000b410 tx=0x7fec8000b720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.572+0000 7fec8d7fa700 1 -- 172.21.15.42:0/2457704128 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec80011830 con 0x7fec900c73d0 2023-07-29T02:00:31.561 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.572+0000 7fec8d7fa700 1 -- 172.21.15.42:0/2457704128 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8000be90 con 0x7fec900c73d0 2023-07-29T02:00:31.561 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.572+0000 7fec8d7fa700 1 -- 172.21.15.42:0/2457704128 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec80011bd0 con 0x7fec900c73d0 2023-07-29T02:00:31.561 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.572+0000 7fec970ca700 1 -- 172.21.15.42:0/2457704128 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec901582c0 con 0x7fec900c73d0 2023-07-29T02:00:31.561 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.572+0000 7fec970ca700 1 -- 172.21.15.42:0/2457704128 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec901585a0 con 0x7fec900c73d0 2023-07-29T02:00:31.564 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.576+0000 7fec8d7fa700 1 -- 172.21.15.42:0/2457704128 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fec8001a410 con 0x7fec900c73d0 2023-07-29T02:00:31.564 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.576+0000 7fec8d7fa700 1 --2- 172.21.15.42:0/2457704128 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fec7c06a760 0x7fec7c06cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.564 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.577+0000 7fec8d7fa700 1 -- 172.21.15.42:0/2457704128 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fec80088bb0 con 0x7fec900c73d0 2023-07-29T02:00:31.565 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.577+0000 7fec8ffff700 1 --2- 172.21.15.42:0/2457704128 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fec7c06a760 0x7fec7c06cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.565 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.578+0000 7fec970ca700 1 -- 172.21.15.42:0/2457704128 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec700052f0 con 0x7fec900c73d0 2023-07-29T02:00:31.565 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.578+0000 7fec8ffff700 1 --2- 172.21.15.42:0/2457704128 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fec7c06a760 0x7fec7c06cc10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fec8400d370 tx=0x7fec84012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.570 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.583+0000 7fec8d7fa700 1 -- 172.21.15.42:0/2457704128 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fec80053ca0 con 0x7fec900c73d0 2023-07-29T02:00:31.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.589+0000 7febcdfd8700 1 Processor -- start 2023-07-29T02:00:31.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.589+0000 7febcdfd8700 1 -- start start 2023-07-29T02:00:31.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.591+0000 7febcdfd8700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7febc814f4c0 0x7febc806d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.591+0000 7febcdfd8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7febc80bfeb0 0x7febc806def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.591+0000 7febcdfd8700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc80c5b40 con 0x7febc80c73d0 2023-07-29T02:00:31.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.591+0000 7febcdfd8700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc806c210 con 0x7febc814f4c0 2023-07-29T02:00:31.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.591+0000 7febcdfd8700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc806c4f0 con 0x7febc80bfeb0 2023-07-29T02:00:31.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.591+0000 7febc77fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7febc814f4c0 0x7febc806d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.591+0000 7febc77fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7febc814f4c0 0x7febc806d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56544/0 (socket says 172.21.15.42:56544) 2023-07-29T02:00:31.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.591+0000 7febc77fe700 1 -- 172.21.15.42:0/1220824419 learned_addr learned my addr 172.21.15.42:0/1220824419 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:31.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.592+0000 7febc77fe700 1 -- 172.21.15.42:0/1220824419 >> v2:172.21.15.144:3300/0 conn(0x7febc80bfeb0 msgr2=0x7febc806def0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-29T02:00:31.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.592+0000 7febc77fe700 1 --2- 172.21.15.42:0/1220824419 >> v2:172.21.15.144:3300/0 conn(0x7febc80bfeb0 0x7febc806def0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.592+0000 7febc77fe700 1 -- 172.21.15.42:0/1220824419 >> v1:172.21.15.144:6789/0 conn(0x7febc80c73d0 legacy=0x7febc8158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:31.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.592+0000 7febc77fe700 1 -- 172.21.15.42:0/1220824419 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc80c5d90 con 0x7febc814f4c0 2023-07-29T02:00:31.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.592+0000 7febc77fe700 1 --2- 172.21.15.42:0/1220824419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc814f4c0 0x7febc806d9b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7febc806ebb0 tx=0x7febbc00d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e625a7454b7e6727 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.593+0000 7febc67fc700 1 -- 172.21.15.42:0/1220824419 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc010070 con 0x7febc814f4c0 2023-07-29T02:00:31.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.594+0000 7febc67fc700 1 -- 172.21.15.42:0/1220824419 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc00da40 con 0x7febc814f4c0 2023-07-29T02:00:31.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.594+0000 7febc67fc700 1 -- 172.21.15.42:0/1220824419 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc00ddd0 con 0x7febc814f4c0 2023-07-29T02:00:31.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.595+0000 7febcdfd8700 1 -- 172.21.15.42:0/1220824419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc814f4c0 msgr2=0x7febc806d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.595+0000 7febcdfd8700 1 --2- 172.21.15.42:0/1220824419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc814f4c0 0x7febc806d9b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7febc806ebb0 tx=0x7febbc00d330 comp rx=0 tx=0).stop 2023-07-29T02:00:31.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.595+0000 7febcdfd8700 1 -- 172.21.15.42:0/1220824419 shutdown_connections 2023-07-29T02:00:31.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.595+0000 7febcdfd8700 1 --2- 172.21.15.42:0/1220824419 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc814f4c0 0x7febc806d9b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.595+0000 7febcdfd8700 1 --2- 172.21.15.42:0/1220824419 >> v2:172.21.15.144:3300/0 conn(0x7febc80bfeb0 0x7febc806def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.595+0000 7febcdfd8700 1 -- 172.21.15.42:0/1220824419 >> 172.21.15.42:0/1220824419 conn(0x7febc80cae90 msgr2=0x7febc80cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:31.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.596+0000 7febcdfd8700 1 -- 172.21.15.42:0/1220824419 shutdown_connections 2023-07-29T02:00:31.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.596+0000 7febcdfd8700 1 -- 172.21.15.42:0/1220824419 wait complete. 2023-07-29T02:00:31.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.598+0000 7febcdfd8700 1 Processor -- start 2023-07-29T02:00:31.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.598+0000 7febcdfd8700 1 -- start start 2023-07-29T02:00:31.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.599+0000 7febcdfd8700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc80c73d0 0x7febc81ee4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.599+0000 7febcdfd8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febc814f4c0 0x7febc8140cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.599+0000 7febcdfd8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7febc80c8c90 0x7febc8141200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.599+0000 7febcdfd8700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc8142eb0 con 0x7febc80c73d0 2023-07-29T02:00:31.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.599+0000 7febcdfd8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc80ca400 con 0x7febc814f4c0 2023-07-29T02:00:31.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.599+0000 7febcdfd8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc81ee9f0 con 0x7febc80c8c90 2023-07-29T02:00:31.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.600+0000 7febc77fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc80c73d0 0x7febc81ee4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.600+0000 7febc77fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc80c73d0 0x7febc81ee4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56550/0 (socket says 172.21.15.42:56550) 2023-07-29T02:00:31.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.600+0000 7febc77fe700 1 -- 172.21.15.42:0/4093116767 learned_addr learned my addr 172.21.15.42:0/4093116767 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:31.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.601+0000 7febc77fe700 1 -- 172.21.15.42:0/4093116767 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7febc80c8c90 msgr2=0x7febc8141200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-29T02:00:31.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.601+0000 7febc77fe700 1 --2- 172.21.15.42:0/4093116767 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7febc80c8c90 0x7febc8141200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.601+0000 7febc77fe700 1 -- 172.21.15.42:0/4093116767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febc814f4c0 msgr2=0x7febc8140cc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-29T02:00:31.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.601+0000 7febc77fe700 1 --2- 172.21.15.42:0/4093116767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febc814f4c0 0x7febc8140cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.601+0000 7febc77fe700 1 -- 172.21.15.42:0/4093116767 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc0085d0 con 0x7febc80c73d0 2023-07-29T02:00:31.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.601+0000 7febc77fe700 1 --2- 172.21.15.42:0/4093116767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc80c73d0 0x7febc81ee4b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7febc806fa60 tx=0x7febbc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.602+0000 7febaffff700 1 -- 172.21.15.42:0/4093116767 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc009b90 con 0x7febc80c73d0 2023-07-29T02:00:31.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.602+0000 7febaffff700 1 -- 172.21.15.42:0/4093116767 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc009d10 con 0x7febc80c73d0 2023-07-29T02:00:31.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.602+0000 7febaffff700 1 -- 172.21.15.42:0/4093116767 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc0038e0 con 0x7febc80c73d0 2023-07-29T02:00:31.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.602+0000 7febcdfd8700 1 -- 172.21.15.42:0/4093116767 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc8144520 con 0x7febc80c73d0 2023-07-29T02:00:31.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.602+0000 7febcdfd8700 1 -- 172.21.15.42:0/4093116767 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc81404c0 con 0x7febc80c73d0 2023-07-29T02:00:31.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.605+0000 7febaffff700 1 -- 172.21.15.42:0/4093116767 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7febbc003a40 con 0x7febc80c73d0 2023-07-29T02:00:31.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.606+0000 7febaffff700 1 --2- 172.21.15.42:0/4093116767 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7febb406a730 0x7febb406cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:31.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.606+0000 7febaffff700 1 -- 172.21.15.42:0/4093116767 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7febbc08a180 con 0x7febc80c73d0 2023-07-29T02:00:31.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.608+0000 7febc6ffd700 1 --2- 172.21.15.42:0/4093116767 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7febb406a730 0x7febb406cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:31.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.608+0000 7febcdfd8700 1 -- 172.21.15.42:0/4093116767 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba80052f0 con 0x7febc80c73d0 2023-07-29T02:00:31.606 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.619+0000 7febaffff700 1 -- 172.21.15.42:0/4093116767 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7febbc055270 con 0x7febc80c73d0 2023-07-29T02:00:31.628 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.641+0000 7febc6ffd700 1 --2- 172.21.15.42:0/4093116767 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7febb406a730 0x7febb406cbe0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7febc8142da0 tx=0x7febb8006c60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:31.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.862+0000 7f3c10592700 1 -- 172.21.15.42:0/3055201637 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3c080c5150 con 0x7f3c081461b0 2023-07-29T02:00:31.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.862+0000 7f3bfeffd700 1 -- 172.21.15.42:0/3055201637 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c080c5150 con 0x7f3c081461b0 2023-07-29T02:00:31.853 INFO:teuthology.orchestra.run.smithi042.stdout:55834574860 2023-07-29T02:00:31.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.866+0000 7f3c10592700 1 -- 172.21.15.42:0/3055201637 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3bec06a6b0 msgr2=0x7f3bec06cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.866+0000 7f3c10592700 1 --2- 172.21.15.42:0/3055201637 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3bec06a6b0 0x7f3bec06cb60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3c04007fd0 tx=0x7f3c04009040 comp rx=0 tx=0).stop 2023-07-29T02:00:31.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.866+0000 7f3c10592700 1 -- 172.21.15.42:0/3055201637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c081461b0 msgr2=0x7f3c080c3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.866+0000 7f3c10592700 1 --2- 172.21.15.42:0/3055201637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c081461b0 0x7f3c080c3f10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3c080c7870 tx=0x7f3c0000d560 comp rx=0 tx=0).stop 2023-07-29T02:00:31.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.867+0000 7f3c10592700 1 -- 172.21.15.42:0/3055201637 shutdown_connections 2023-07-29T02:00:31.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.867+0000 7f3c10592700 1 --2- 172.21.15.42:0/3055201637 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3bec06a6b0 0x7f3bec06cb60 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3c04007fd0 tx=0x7f3c04009040 comp rx=0 tx=0).stop 2023-07-29T02:00:31.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.867+0000 7f3c10592700 1 --2- 172.21.15.42:0/3055201637 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c081461b0 0x7f3c080c3f10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.867+0000 7f3c10592700 1 --2- 172.21.15.42:0/3055201637 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3c080c73d0 0x7f3c081f3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.867+0000 7f3c10592700 1 --2- 172.21.15.42:0/3055201637 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3c0814f4c0 0x7f3c08145340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.867+0000 7f3c10592700 1 -- 172.21.15.42:0/3055201637 >> 172.21.15.42:0/3055201637 conn(0x7f3c080cae90 msgr2=0x7f3c080cb260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:31.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.867+0000 7f3c10592700 1 -- 172.21.15.42:0/3055201637 shutdown_connections 2023-07-29T02:00:31.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.867+0000 7f3c10592700 1 -- 172.21.15.42:0/3055201637 wait complete. 2023-07-29T02:00:31.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.1 2023-07-29T02:00:31.874 DEBUG:teuthology.parallel:result is None 2023-07-29T02:00:31.895 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.908+0000 7f37c63f9700 1 -- 172.21.15.42:0/3074875969 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f37c0170fe0 con 0x7f37c0171c60 2023-07-29T02:00:31.896 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.908+0000 7f37bcff9700 1 -- 172.21.15.42:0/3074875969 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37c0170fe0 con 0x7f37c0171c60 2023-07-29T02:00:31.896 INFO:teuthology.orchestra.run.smithi042.stdout:55834574859 2023-07-29T02:00:31.899 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.912+0000 7f37c63f9700 1 -- 172.21.15.42:0/3074875969 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f37ac06a6e0 msgr2=0x7f37ac06cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.899 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.912+0000 7f37c63f9700 1 --2- 172.21.15.42:0/3074875969 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f37ac06a6e0 0x7f37ac06cb90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f37b0006fd0 tx=0x7f37b0008040 comp rx=0 tx=0).stop 2023-07-29T02:00:31.899 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.912+0000 7f37c63f9700 1 -- 172.21.15.42:0/3074875969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37c0171c60 msgr2=0x7f37c0172100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.900 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.912+0000 7f37c63f9700 1 --2- 172.21.15.42:0/3074875969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37c0171c60 0x7f37c0172100 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f37b800c2e0 tx=0x7f37b8004ad0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.900 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.912+0000 7f37c63f9700 1 -- 172.21.15.42:0/3074875969 shutdown_connections 2023-07-29T02:00:31.900 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.912+0000 7f37c63f9700 1 --2- 172.21.15.42:0/3074875969 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f37ac06a6e0 0x7f37ac06cb90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.900 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.912+0000 7f37c63f9700 1 --2- 172.21.15.42:0/3074875969 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f37c0171c60 0x7f37c0172100 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.901 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.912+0000 7f37c63f9700 1 --2- 172.21.15.42:0/3074875969 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f37c0166aa0 0x7f37c0207460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.901 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.912+0000 7f37c63f9700 1 --2- 172.21.15.42:0/3074875969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f37c00c3690 0x7f37c016fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.901 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.912+0000 7f37c63f9700 1 -- 172.21.15.42:0/3074875969 >> 172.21.15.42:0/3074875969 conn(0x7f37c00cae90 msgr2=0x7f37c00c64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:31.901 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.912+0000 7f37c63f9700 1 -- 172.21.15.42:0/3074875969 shutdown_connections 2023-07-29T02:00:31.901 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.912+0000 7f37c63f9700 1 -- 172.21.15.42:0/3074875969 wait complete. 2023-07-29T02:00:31.908 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.921+0000 7f95027e7700 1 -- 172.21.15.42:0/3182728342 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f94fc04ea50 con 0x7f94fc0b0d30 2023-07-29T02:00:31.909 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.922+0000 7f94f8ff9700 1 -- 172.21.15.42:0/3182728342 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f94f0056930 con 0x7f94fc0b0d30 2023-07-29T02:00:31.910 INFO:teuthology.orchestra.run.smithi042.stdout:55834574859 2023-07-29T02:00:31.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.923+0000 7f4290e26700 1 -- 172.21.15.42:0/1840423122 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f428c04ea50 con 0x7f428c0c1240 2023-07-29T02:00:31.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.924+0000 7f4282ffd700 1 -- 172.21.15.42:0/1840423122 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f427c019070 con 0x7f428c0c1240 2023-07-29T02:00:31.914 INFO:teuthology.orchestra.run.smithi042.stdout:55834574859 2023-07-29T02:00:31.914 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.926+0000 7f95027e7700 1 -- 172.21.15.42:0/3182728342 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f94e806a660 msgr2=0x7f94e806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.915 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.926+0000 7f95027e7700 1 --2- 172.21.15.42:0/3182728342 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f94e806a660 0x7f94e806cb10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f94fc0c5c90 tx=0x7f94ec010000 comp rx=0 tx=0).stop 2023-07-29T02:00:31.915 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.926+0000 7f95027e7700 1 -- 172.21.15.42:0/3182728342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94fc0b0d30 msgr2=0x7f94fc1ed2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.915 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.926+0000 7f95027e7700 1 --2- 172.21.15.42:0/3182728342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94fc0b0d30 0x7f94fc1ed2e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f94f000c450 tx=0x7f94f000c760 comp rx=0 tx=0).stop 2023-07-29T02:00:31.916 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.927+0000 7f4290e26700 1 -- 172.21.15.42:0/1840423122 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f426c06a6b0 msgr2=0x7f426c06cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.916 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.927+0000 7f4290e26700 1 --2- 172.21.15.42:0/1840423122 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f426c06a6b0 0x7f426c06cb60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4284004f30 tx=0x7f4284009040 comp rx=0 tx=0).stop 2023-07-29T02:00:31.917 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.927+0000 7f4290e26700 1 -- 172.21.15.42:0/1840423122 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f428c0c1240 msgr2=0x7f428c15a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.917 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.927+0000 7f4290e26700 1 --2- 172.21.15.42:0/1840423122 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f428c0c1240 0x7f428c15a9a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f427c00b9c0 tx=0x7f427c00bd80 comp rx=0 tx=0).stop 2023-07-29T02:00:31.917 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.927+0000 7f95027e7700 1 -- 172.21.15.42:0/3182728342 shutdown_connections 2023-07-29T02:00:31.918 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.927+0000 7f95027e7700 1 --2- 172.21.15.42:0/3182728342 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f94e806a660 0x7f94e806cb10 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f94fc0c5c90 tx=0x7f94ec010000 comp rx=0 tx=0).stop 2023-07-29T02:00:31.918 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.927+0000 7f95027e7700 1 --2- 172.21.15.42:0/3182728342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94fc0c5890 0x7f94fc1fe900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.918 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.927+0000 7f95027e7700 1 --2- 172.21.15.42:0/3182728342 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94fc0b0d30 0x7f94fc1ed2e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.927+0000 7f95027e7700 1 --2- 172.21.15.42:0/3182728342 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94fc0c1240 0x7f94fc1ee2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.927+0000 7f95027e7700 1 -- 172.21.15.42:0/3182728342 >> 172.21.15.42:0/3182728342 conn(0x7f94fc0cae90 msgr2=0x7f94fc070880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:31.920 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.927+0000 7f4290e26700 1 -- 172.21.15.42:0/1840423122 shutdown_connections 2023-07-29T02:00:31.920 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.927+0000 7f4290e26700 1 --2- 172.21.15.42:0/1840423122 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f426c06a6b0 0x7f426c06cb60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.921 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.927+0000 7f4290e26700 1 --2- 172.21.15.42:0/1840423122 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f428c0c5890 0x7f428c0c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.921 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.927+0000 7f4290e26700 1 --2- 172.21.15.42:0/1840423122 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f428c0b0d30 0x7f428c15a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.921 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.927+0000 7f4290e26700 1 --2- 172.21.15.42:0/1840423122 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f428c0c1240 0x7f428c15a9a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.921 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.927+0000 7f4290e26700 1 -- 172.21.15.42:0/1840423122 >> 172.21.15.42:0/1840423122 conn(0x7f428c0cae90 msgr2=0x7f428c0c8330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:31.922 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.929+0000 7f4290e26700 1 -- 172.21.15.42:0/1840423122 shutdown_connections 2023-07-29T02:00:31.922 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.929+0000 7f4290e26700 1 -- 172.21.15.42:0/1840423122 wait complete. 2023-07-29T02:00:31.922 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.930+0000 7f1a7d3e6700 1 -- 172.21.15.42:0/2339708773 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1a540055a0 con 0x7f1a78072af0 2023-07-29T02:00:31.923 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.930+0000 7f95027e7700 1 -- 172.21.15.42:0/3182728342 shutdown_connections 2023-07-29T02:00:31.924 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.930+0000 7f95027e7700 1 -- 172.21.15.42:0/3182728342 wait complete. 2023-07-29T02:00:31.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2023-07-29T02:00:31.925 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.932+0000 7f1a677fe700 1 -- 172.21.15.42:0/2339708773 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a68053390 con 0x7f1a78072af0 2023-07-29T02:00:31.925 DEBUG:teuthology.parallel:result is None 2023-07-29T02:00:31.925 INFO:teuthology.orchestra.run.smithi042.stdout:55834574859 2023-07-29T02:00:31.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.935+0000 7f1a7d3e6700 1 -- 172.21.15.42:0/2339708773 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f1a5c06a630 msgr2=0x7f1a5c06cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.935+0000 7f1a7d3e6700 1 --2- 172.21.15.42:0/2339708773 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f1a5c06a630 0x7f1a5c06cae0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1a78061420 tx=0x7f1a6c007ae0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.935+0000 7f1a7d3e6700 1 -- 172.21.15.42:0/2339708773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a78072af0 msgr2=0x7f1a780c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.935+0000 7f1a7d3e6700 1 --2- 172.21.15.42:0/2339708773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a78072af0 0x7f1a780c4760 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800c500 tx=0x7f1a6800c810 comp rx=0 tx=0).stop 2023-07-29T02:00:31.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.936+0000 7f1a7d3e6700 1 -- 172.21.15.42:0/2339708773 shutdown_connections 2023-07-29T02:00:31.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.936+0000 7f1a7d3e6700 1 --2- 172.21.15.42:0/2339708773 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f1a5c06a630 0x7f1a5c06cae0 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1a78061420 tx=0x7f1a6c007ae0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.936+0000 7f1a7d3e6700 1 --2- 172.21.15.42:0/2339708773 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a781577f0 0x7f1a781fbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.936+0000 7f1a7d3e6700 1 --2- 172.21.15.42:0/2339708773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a78072af0 0x7f1a780c4760 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.936+0000 7f1a7d3e6700 1 --2- 172.21.15.42:0/2339708773 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a78157420 0x7f1a7815e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.936+0000 7f1a7d3e6700 1 -- 172.21.15.42:0/2339708773 >> 172.21.15.42:0/2339708773 conn(0x7f1a780cc420 msgr2=0x7f1a781562d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:31.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.940+0000 7f1a7d3e6700 1 -- 172.21.15.42:0/2339708773 shutdown_connections 2023-07-29T02:00:31.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.942+0000 7f1a7d3e6700 1 -- 172.21.15.42:0/2339708773 wait complete. 2023-07-29T02:00:31.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2023-07-29T02:00:31.933 DEBUG:teuthology.parallel:result is None 2023-07-29T02:00:31.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574859 for osd.2 2023-07-29T02:00:31.938 DEBUG:teuthology.parallel:result is None 2023-07-29T02:00:31.941 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.954+0000 7f2ba57a1700 1 -- 172.21.15.42:0/4161272443 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2b7c005870 con 0x7f2ba01594e0 2023-07-29T02:00:31.942 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.955+0000 7f2b8f7fe700 1 -- 172.21.15.42:0/4161272443 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2b94058a00 con 0x7f2ba01594e0 2023-07-29T02:00:31.942 INFO:teuthology.orchestra.run.smithi042.stdout:55834574858 2023-07-29T02:00:31.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.957+0000 7f2ba57a1700 1 -- 172.21.15.42:0/4161272443 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2b8406a680 msgr2=0x7f2b8406cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.957+0000 7f2ba57a1700 1 --2- 172.21.15.42:0/4161272443 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2b8406a680 0x7f2b8406cb30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2b980012e0 tx=0x7f2b98001b20 comp rx=0 tx=0).stop 2023-07-29T02:00:31.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.957+0000 7f2ba57a1700 1 -- 172.21.15.42:0/4161272443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba01594e0 msgr2=0x7f2ba01e3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.957+0000 7f2ba57a1700 1 --2- 172.21.15.42:0/4161272443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba01594e0 0x7f2ba01e3620 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2b94009f50 tx=0x7f2b94004750 comp rx=0 tx=0).stop 2023-07-29T02:00:31.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.957+0000 7f2ba57a1700 1 -- 172.21.15.42:0/4161272443 shutdown_connections 2023-07-29T02:00:31.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.957+0000 7f2ba57a1700 1 --2- 172.21.15.42:0/4161272443 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2b8406a680 0x7f2b8406cb30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.957+0000 7f2ba57a1700 1 --2- 172.21.15.42:0/4161272443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ba01594e0 0x7f2ba01e3620 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.957+0000 7f2ba57a1700 1 --2- 172.21.15.42:0/4161272443 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ba00c5890 0x7f2ba0151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.957+0000 7f2ba57a1700 1 --2- 172.21.15.42:0/4161272443 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ba0153400 0x7f2ba01e30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.957+0000 7f2ba57a1700 1 -- 172.21.15.42:0/4161272443 >> 172.21.15.42:0/4161272443 conn(0x7f2ba00cae90 msgr2=0x7f2ba00ca6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:31.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.957+0000 7f2ba57a1700 1 -- 172.21.15.42:0/4161272443 shutdown_connections 2023-07-29T02:00:31.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.957+0000 7f2ba57a1700 1 -- 172.21.15.42:0/4161272443 wait complete. 2023-07-29T02:00:31.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2023-07-29T02:00:31.949 DEBUG:teuthology.parallel:result is None 2023-07-29T02:00:31.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2023-07-29T02:00:31.958 DEBUG:teuthology.parallel:result is None 2023-07-29T02:00:31.959 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.971+0000 7fec970ca700 1 -- 172.21.15.42:0/2457704128 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fec700055a0 con 0x7fec900c73d0 2023-07-29T02:00:31.959 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.971+0000 7fec8d7fa700 1 -- 172.21.15.42:0/2457704128 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec80015020 con 0x7fec900c73d0 2023-07-29T02:00:31.959 INFO:teuthology.orchestra.run.smithi042.stdout:55834574859 2023-07-29T02:00:31.961 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.973+0000 7fec970ca700 1 -- 172.21.15.42:0/2457704128 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fec7c06a760 msgr2=0x7fec7c06cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.961 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.973+0000 7fec970ca700 1 --2- 172.21.15.42:0/2457704128 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fec7c06a760 0x7fec7c06cc10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fec8400d370 tx=0x7fec84012000 comp rx=0 tx=0).stop 2023-07-29T02:00:31.962 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.973+0000 7fec970ca700 1 -- 172.21.15.42:0/2457704128 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fec900c73d0 msgr2=0x7fec90144b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.962 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.973+0000 7fec970ca700 1 --2- 172.21.15.42:0/2457704128 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fec900c73d0 0x7fec90144b00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fec8000b410 tx=0x7fec8000b720 comp rx=0 tx=0).stop 2023-07-29T02:00:31.962 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.974+0000 7fec970ca700 1 -- 172.21.15.42:0/2457704128 shutdown_connections 2023-07-29T02:00:31.962 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.974+0000 7fec970ca700 1 --2- 172.21.15.42:0/2457704128 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fec7c06a760 0x7fec7c06cc10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.962 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.974+0000 7fec970ca700 1 --2- 172.21.15.42:0/2457704128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fec90157960 0x7fec901debf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.962 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.974+0000 7fec970ca700 1 --2- 172.21.15.42:0/2457704128 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fec900c73d0 0x7fec90144b00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.962 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.974+0000 7fec970ca700 1 --2- 172.21.15.42:0/2457704128 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fec9014f4c0 0x7fec90145040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.963 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.974+0000 7fec970ca700 1 -- 172.21.15.42:0/2457704128 >> 172.21.15.42:0/2457704128 conn(0x7fec900cae90 msgr2=0x7fec9014ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:31.963 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.974+0000 7fec970ca700 1 -- 172.21.15.42:0/2457704128 shutdown_connections 2023-07-29T02:00:31.963 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.974+0000 7fec970ca700 1 -- 172.21.15.42:0/2457704128 wait complete. 2023-07-29T02:00:31.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.979+0000 7febcdfd8700 1 -- 172.21.15.42:0/4093116767 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7feba80055a0 con 0x7febc80c73d0 2023-07-29T02:00:31.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.979+0000 7febaffff700 1 -- 172.21.15.42:0/4093116767 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7febbc01b070 con 0x7febc80c73d0 2023-07-29T02:00:31.967 INFO:teuthology.orchestra.run.smithi042.stdout:55834574860 2023-07-29T02:00:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.981+0000 7febcdfd8700 1 -- 172.21.15.42:0/4093116767 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7febb406a730 msgr2=0x7febb406cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.981+0000 7febcdfd8700 1 --2- 172.21.15.42:0/4093116767 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7febb406a730 0x7febb406cbe0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7febc8142da0 tx=0x7febb8006c60 comp rx=0 tx=0).stop 2023-07-29T02:00:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.981+0000 7febcdfd8700 1 -- 172.21.15.42:0/4093116767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc80c73d0 msgr2=0x7febc81ee4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.981+0000 7febcdfd8700 1 --2- 172.21.15.42:0/4093116767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc80c73d0 0x7febc81ee4b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7febc806fa60 tx=0x7febbc004750 comp rx=0 tx=0).stop 2023-07-29T02:00:31.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.981+0000 7febcdfd8700 1 -- 172.21.15.42:0/4093116767 shutdown_connections 2023-07-29T02:00:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.981+0000 7febcdfd8700 1 --2- 172.21.15.42:0/4093116767 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7febb406a730 0x7febb406cbe0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.981+0000 7febcdfd8700 1 --2- 172.21.15.42:0/4093116767 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7febc80c8c90 0x7febc8141200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.981+0000 7febcdfd8700 1 --2- 172.21.15.42:0/4093116767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7febc80c73d0 0x7febc81ee4b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.981+0000 7febcdfd8700 1 --2- 172.21.15.42:0/4093116767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7febc814f4c0 0x7febc8140cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:31.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.981+0000 7febcdfd8700 1 -- 172.21.15.42:0/4093116767 >> 172.21.15.42:0/4093116767 conn(0x7febc80cae90 msgr2=0x7febc806d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:31.971 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.981+0000 7febcdfd8700 1 -- 172.21.15.42:0/4093116767 shutdown_connections 2023-07-29T02:00:31.971 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:31.981+0000 7febcdfd8700 1 -- 172.21.15.42:0/4093116767 wait complete. 2023-07-29T02:00:31.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2023-07-29T02:00:31.975 DEBUG:teuthology.parallel:result is None 2023-07-29T02:00:31.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.5 2023-07-29T02:00:31.982 DEBUG:teuthology.parallel:result is None 2023-07-29T02:00:31.982 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-29T02:00:31.982 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T02:00:32.147 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.160+0000 7f117c60c700 1 Processor -- start 2023-07-29T02:00:32.147 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.160+0000 7f117c60c700 1 -- start start 2023-07-29T02:00:32.150 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f117c60c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f11740c6000 0x7f1174158b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.150 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f117c60c700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11740c77a0 con 0x7f117414f7d0 2023-07-29T02:00:32.150 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f117c60c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1174071410 con 0x7f11740c6850 2023-07-29T02:00:32.151 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f117c60c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11740c7fb0 con 0x7f11740c6000 2023-07-29T02:00:32.151 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f117a3a8700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f117414f7d0 0x7f117406a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50358/0 (socket says 172.21.15.42:50358) 2023-07-29T02:00:32.151 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f117a3a8700 1 -- 172.21.15.42:0/238420141 learned_addr learned my addr 172.21.15.42:0/238420141 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:32.151 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f1179ba7700 1 --2- 172.21.15.42:0/238420141 >> v2:172.21.15.144:3300/0 conn(0x7f11740c6000 0x7f1174158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.151 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f11793a6700 1 -- 172.21.15.42:0/238420141 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163770892 0 0) 0x7f11740c77a0 con 0x7f117414f7d0 2023-07-29T02:00:32.151 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f11793a6700 1 -- 172.21.15.42:0/238420141 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11600046c0 con 0x7f117414f7d0 2023-07-29T02:00:32.151 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f11793a6700 1 -- 172.21.15.42:0/238420141 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2792290467 0 0) 0x7f11600046c0 con 0x7f117414f7d0 2023-07-29T02:00:32.151 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f11793a6700 1 -- 172.21.15.42:0/238420141 >> v2:172.21.15.144:3300/0 conn(0x7f11740c6000 msgr2=0x7f1174158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:32.152 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f11793a6700 1 --2- 172.21.15.42:0/238420141 >> v2:172.21.15.144:3300/0 conn(0x7f11740c6000 0x7f1174158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.152 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f11793a6700 1 -- 172.21.15.42:0/238420141 >> v1:172.21.15.144:6789/0 conn(0x7f11740c6850 legacy=0x7f1174159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:32.152 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f11793a6700 1 -- 172.21.15.42:0/238420141 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1174159990 con 0x7f117414f7d0 2023-07-29T02:00:32.152 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f11793a6700 1 -- 172.21.15.42:0/238420141 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7f1164001670 con 0x7f117414f7d0 2023-07-29T02:00:32.152 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f11793a6700 1 -- 172.21.15.42:0/238420141 >> v1:172.21.15.42:6789/0 conn(0x7f117414f7d0 legacy=0x7f117406a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:32.153 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f11793a6700 1 --2- 172.21.15.42:0/238420141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1160004b10 0x7f1160004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.153 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f11793a6700 1 --2- 172.21.15.42:0/238420141 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1160005960 0x7f1160005dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.153 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f11793a6700 1 --2- 172.21.15.42:0/238420141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1160006310 0x7f116000cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.153 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f11793a6700 1 -- 172.21.15.42:0/238420141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11740c7fb0 con 0x7f1160004b10 2023-07-29T02:00:32.153 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f11793a6700 1 -- 172.21.15.42:0/238420141 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116000d190 con 0x7f1160006310 2023-07-29T02:00:32.153 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f11793a6700 1 -- 172.21.15.42:0/238420141 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f116000d350 con 0x7f1160005960 2023-07-29T02:00:32.154 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.161+0000 7f117a3a8700 1 --2- 172.21.15.42:0/238420141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1160004b10 0x7f1160004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.154 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.162+0000 7f117aba9700 1 --2- 172.21.15.42:0/238420141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1160006310 0x7f116000cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.154 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.162+0000 7f1179ba7700 1 --2- 172.21.15.42:0/238420141 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1160005960 0x7f1160005dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.154 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.162+0000 7f117a3a8700 1 -- 172.21.15.42:0/238420141 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1160005960 msgr2=0x7f1160005dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:32.154 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.162+0000 7f117a3a8700 1 --2- 172.21.15.42:0/238420141 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1160005960 0x7f1160005dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.154 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.162+0000 7f117a3a8700 1 -- 172.21.15.42:0/238420141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1160006310 msgr2=0x7f116000cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:32.154 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.162+0000 7f117a3a8700 1 --2- 172.21.15.42:0/238420141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1160006310 0x7f116000cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.155 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.162+0000 7f117a3a8700 1 -- 172.21.15.42:0/238420141 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11600046c0 con 0x7f1160004b10 2023-07-29T02:00:32.155 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.162+0000 7f117aba9700 1 --2- 172.21.15.42:0/238420141 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1160006310 0x7f116000cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:32.155 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.162+0000 7f117aba9700 1 -- 172.21.15.42:0/238420141 reap_dead start 2023-07-29T02:00:32.155 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.162+0000 7f117a3a8700 1 --2- 172.21.15.42:0/238420141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1160004b10 0x7f1160004f20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f116400c2a0 tx=0x7f1160006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca63dcca9adcd220 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:32.155 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.162+0000 7f11793a6700 1 -- 172.21.15.42:0/238420141 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1164007c10 con 0x7f1160004b10 2023-07-29T02:00:32.155 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.162+0000 7f11793a6700 1 -- 172.21.15.42:0/238420141 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116400cdc0 con 0x7f1160004b10 2023-07-29T02:00:32.155 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.162+0000 7f11793a6700 1 -- 172.21.15.42:0/238420141 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1164005ba0 con 0x7f1160004b10 2023-07-29T02:00:32.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.163+0000 7f117c60c700 1 -- 172.21.15.42:0/238420141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1160004b10 msgr2=0x7f1160004f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:32.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.163+0000 7f117c60c700 1 --2- 172.21.15.42:0/238420141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1160004b10 0x7f1160004f20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f116400c2a0 tx=0x7f1160006990 comp rx=0 tx=0).stop 2023-07-29T02:00:32.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.163+0000 7f117c60c700 1 -- 172.21.15.42:0/238420141 shutdown_connections 2023-07-29T02:00:32.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.163+0000 7f117c60c700 1 --2- 172.21.15.42:0/238420141 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1160004b10 0x7f1160004f20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.163+0000 7f117c60c700 1 -- 172.21.15.42:0/238420141 >> 172.21.15.42:0/238420141 conn(0x7f11740cc360 msgr2=0x7f11740c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:32.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.163+0000 7f117c60c700 1 -- 172.21.15.42:0/238420141 shutdown_connections 2023-07-29T02:00:32.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.163+0000 7f117c60c700 1 -- 172.21.15.42:0/238420141 wait complete. 2023-07-29T02:00:32.159 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.164+0000 7f117c60c700 1 Processor -- start 2023-07-29T02:00:32.160 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.164+0000 7f117c60c700 1 -- start start 2023-07-29T02:00:32.160 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f117c60c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1160004b10 0x7f11740c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.160 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f117c60c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11741eaf80 0x7f1174157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.161 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f117c60c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1174144060 0x7f11741444d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.161 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f117c60c700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11741eb4c0 con 0x7f1174144060 2023-07-29T02:00:32.161 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f117c60c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1174158300 con 0x7f1160004b10 2023-07-29T02:00:32.161 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f117c60c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11740c3c00 con 0x7f11741eaf80 2023-07-29T02:00:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f117aba9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1174144060 0x7f11741444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f117aba9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1174144060 0x7f11741444d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56568/0 (socket says 172.21.15.42:56568) 2023-07-29T02:00:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f117aba9700 1 -- 172.21.15.42:0/2033408483 learned_addr learned my addr 172.21.15.42:0/2033408483 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:32.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f117a3a8700 1 --2- 172.21.15.42:0/2033408483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1160004b10 0x7f11740c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.163 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f1179ba7700 1 --2- 172.21.15.42:0/2033408483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11741eaf80 0x7f1174157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.163 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f117aba9700 1 -- 172.21.15.42:0/2033408483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11741eaf80 msgr2=0x7f1174157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:32.163 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f117aba9700 1 --2- 172.21.15.42:0/2033408483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11741eaf80 0x7f1174157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.164 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f117aba9700 1 -- 172.21.15.42:0/2033408483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1160004b10 msgr2=0x7f11740c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:32.164 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f117aba9700 1 --2- 172.21.15.42:0/2033408483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1160004b10 0x7f11740c0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.164 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f117aba9700 1 -- 172.21.15.42:0/2033408483 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11740c53b0 con 0x7f1174144060 2023-07-29T02:00:32.164 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f117aba9700 1 --2- 172.21.15.42:0/2033408483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1174144060 0x7f11741444d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f117406d510 tx=0x7f116c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:32.165 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f116affd700 1 -- 172.21.15.42:0/2033408483 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c00eee0 con 0x7f1174144060 2023-07-29T02:00:32.165 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f116affd700 1 -- 172.21.15.42:0/2033408483 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c003e10 con 0x7f1174144060 2023-07-29T02:00:32.165 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f117c60c700 1 -- 172.21.15.42:0/2033408483 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11740c5690 con 0x7f1174144060 2023-07-29T02:00:32.165 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f116affd700 1 -- 172.21.15.42:0/2033408483 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c005310 con 0x7f1174144060 2023-07-29T02:00:32.166 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.165+0000 7f117c60c700 1 -- 172.21.15.42:0/2033408483 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11740c3ea0 con 0x7f1174144060 2023-07-29T02:00:32.166 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.166+0000 7f117c60c700 1 -- 172.21.15.42:0/2033408483 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117404ea50 con 0x7f1174144060 2023-07-29T02:00:32.166 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.167+0000 7f116affd700 1 -- 172.21.15.42:0/2033408483 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f116c005470 con 0x7f1174144060 2023-07-29T02:00:32.166 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.167+0000 7f116affd700 1 --2- 172.21.15.42:0/2033408483 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f115806a660 0x7f115806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.167 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.167+0000 7f116affd700 1 -- 172.21.15.42:0/2033408483 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f116c08a990 con 0x7f1174144060 2023-07-29T02:00:32.167 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.168+0000 7f117a3a8700 1 --2- 172.21.15.42:0/2033408483 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f115806a660 0x7f115806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.167 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.168+0000 7f117a3a8700 1 --2- 172.21.15.42:0/2033408483 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f115806a660 0x7f115806cb10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1164015040 tx=0x7f1164007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:32.167 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.172+0000 7f116affd700 1 -- 172.21.15.42:0/2033408483 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f116c0594a0 con 0x7f1174144060 2023-07-29T02:00:32.357 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.369+0000 7f117c60c700 1 -- 172.21.15.42:0/2033408483 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11740c7cd0 con 0x7f115806a660 2023-07-29T02:00:32.367 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.380+0000 7f116affd700 1 -- 172.21.15.42:0/2033408483 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367571 (secure 0 0 0) 0x7f1164007b30 con 0x7f115806a660 2023-07-29T02:00:32.370 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:32.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.384+0000 7f117c60c700 1 -- 172.21.15.42:0/2033408483 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f115806a660 msgr2=0x7f115806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:32.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.384+0000 7f117c60c700 1 --2- 172.21.15.42:0/2033408483 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f115806a660 0x7f115806cb10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1164015040 tx=0x7f1164007000 comp rx=0 tx=0).stop 2023-07-29T02:00:32.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.384+0000 7f117c60c700 1 -- 172.21.15.42:0/2033408483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1174144060 msgr2=0x7f11741444d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:32.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.384+0000 7f117c60c700 1 --2- 172.21.15.42:0/2033408483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1174144060 0x7f11741444d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f117406d510 tx=0x7f116c00ed50 comp rx=0 tx=0).stop 2023-07-29T02:00:32.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.384+0000 7f117c60c700 1 -- 172.21.15.42:0/2033408483 shutdown_connections 2023-07-29T02:00:32.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.384+0000 7f117c60c700 1 --2- 172.21.15.42:0/2033408483 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f115806a660 0x7f115806cb10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.384+0000 7f117c60c700 1 --2- 172.21.15.42:0/2033408483 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1174144060 0x7f11741444d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.384+0000 7f117c60c700 1 --2- 172.21.15.42:0/2033408483 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1160004b10 0x7f11740c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.384+0000 7f117c60c700 1 --2- 172.21.15.42:0/2033408483 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f11741eaf80 0x7f1174157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.384+0000 7f117c60c700 1 -- 172.21.15.42:0/2033408483 >> 172.21.15.42:0/2033408483 conn(0x7f11740cc360 msgr2=0x7f11741590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:32.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.384+0000 7f117c60c700 1 -- 172.21.15.42:0/2033408483 shutdown_connections 2023-07-29T02:00:32.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.384+0000 7f117c60c700 1 -- 172.21.15.42:0/2033408483 wait complete. 2023-07-29T02:00:32.374 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2023-07-29T02:00:32.383 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-07-29T02:00:31.239642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594957,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217884,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756836,"statfs":{"total":773094113280,"available":772871000064,"internally_reserved":0,"allocated":2322432,"data_stored":2064161,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003327"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972736+0000","last_change":"2023-07-29T01:59:57.958129+0000","last_active":"2023-07-29T02:00:01.972736+0000","last_peered":"2023-07-29T02:00:01.972736+0000","last_clean":"2023-07-29T02:00:01.972736+0000","last_became_active":"2023-07-29T01:59:57.957742+0000","last_became_peered":"2023-07-29T01:59:57.957742+0000","last_unstale":"2023-07-29T02:00:01.972736+0000","last_undegraded":"2023-07-29T02:00:01.972736+0000","last_fullsized":"2023-07-29T02:00:01.972736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:32.550358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975520+0000","last_change":"2023-07-29T01:59:57.974652+0000","last_active":"2023-07-29T02:00:01.975520+0000","last_peered":"2023-07-29T02:00:01.975520+0000","last_clean":"2023-07-29T02:00:01.975520+0000","last_became_active":"2023-07-29T01:59:57.974338+0000","last_became_peered":"2023-07-29T01:59:57.974338+0000","last_unstale":"2023-07-29T02:00:01.975520+0000","last_undegraded":"2023-07-29T02:00:01.975520+0000","last_fullsized":"2023-07-29T02:00:01.975520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978265+0000","last_change":"2023-07-29T01:59:57.973621+0000","last_active":"2023-07-29T02:00:01.978265+0000","last_peered":"2023-07-29T02:00:01.978265+0000","last_clean":"2023-07-29T02:00:01.978265+0000","last_became_active":"2023-07-29T01:59:57.973406+0000","last_became_peered":"2023-07-29T01:59:57.973406+0000","last_unstale":"2023-07-29T02:00:01.978265+0000","last_undegraded":"2023-07-29T02:00:01.978265+0000","last_fullsized":"2023-07-29T02:00:01.978265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:08:23.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968045+0000","last_change":"2023-07-29T01:59:57.965192+0000","last_active":"2023-07-29T02:00:01.968045+0000","last_peered":"2023-07-29T02:00:01.968045+0000","last_clean":"2023-07-29T02:00:01.968045+0000","last_became_active":"2023-07-29T01:59:57.964865+0000","last_became_peered":"2023-07-29T01:59:57.964865+0000","last_unstale":"2023-07-29T02:00:01.968045+0000","last_undegraded":"2023-07-29T02:00:01.968045+0000","last_fullsized":"2023-07-29T02:00:01.968045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:32.905717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967106+0000","last_change":"2023-07-29T01:59:57.971026+0000","last_active":"2023-07-29T02:00:01.967106+0000","last_peered":"2023-07-29T02:00:01.967106+0000","last_clean":"2023-07-29T02:00:01.967106+0000","last_became_active":"2023-07-29T01:59:57.970733+0000","last_became_peered":"2023-07-29T01:59:57.970733+0000","last_unstale":"2023-07-29T02:00:01.967106+0000","last_undegraded":"2023-07-29T02:00:01.967106+0000","last_fullsized":"2023-07-29T02:00:01.967106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971129+0000","last_change":"2023-07-29T01:59:57.965729+0000","last_active":"2023-07-29T02:00:01.971129+0000","last_peered":"2023-07-29T02:00:01.971129+0000","last_clean":"2023-07-29T02:00:01.971129+0000","last_became_active":"2023-07-29T01:59:57.964993+0000","last_became_peered":"2023-07-29T01:59:57.964993+0000","last_unstale":"2023-07-29T02:00:01.971129+0000","last_undegraded":"2023-07-29T02:00:01.971129+0000","last_fullsized":"2023-07-29T02:00:01.971129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974411+0000","last_change":"2023-07-29T01:59:57.970481+0000","last_active":"2023-07-29T02:00:01.974411+0000","last_peered":"2023-07-29T02:00:01.974411+0000","last_clean":"2023-07-29T02:00:01.974411+0000","last_became_active":"2023-07-29T01:59:57.970232+0000","last_became_peered":"2023-07-29T01:59:57.970232+0000","last_unstale":"2023-07-29T02:00:01.974411+0000","last_undegraded":"2023-07-29T02:00:01.974411+0000","last_fullsized":"2023-07-29T02:00:01.974411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974000+0000","last_change":"2023-07-29T01:59:57.963201+0000","last_active":"2023-07-29T02:00:01.974000+0000","last_peered":"2023-07-29T02:00:01.974000+0000","last_clean":"2023-07-29T02:00:01.974000+0000","last_became_active":"2023-07-29T01:59:57.962884+0000","last_became_peered":"2023-07-29T01:59:57.962884+0000","last_unstale":"2023-07-29T02:00:01.974000+0000","last_undegraded":"2023-07-29T02:00:01.974000+0000","last_fullsized":"2023-07-29T02:00:01.974000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967238+0000","last_change":"2023-07-29T01:59:57.971916+0000","last_active":"2023-07-29T02:00:01.967238+0000","last_peered":"2023-07-29T02:00:01.967238+0000","last_clean":"2023-07-29T02:00:01.967238+0000","last_became_active":"2023-07-29T01:59:57.971640+0000","last_became_peered":"2023-07-29T01:59:57.971640+0000","last_unstale":"2023-07-29T02:00:01.967238+0000","last_undegraded":"2023-07-29T02:00:01.967238+0000","last_fullsized":"2023-07-29T02:00:01.967238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975619+0000","last_change":"2023-07-29T01:59:57.963080+0000","last_active":"2023-07-29T02:00:01.975619+0000","last_peered":"2023-07-29T02:00:01.975619+0000","last_clean":"2023-07-29T02:00:01.975619+0000","last_became_active":"2023-07-29T01:59:57.962799+0000","last_became_peered":"2023-07-29T01:59:57.962799+0000","last_unstale":"2023-07-29T02:00:01.975619+0000","last_undegraded":"2023-07-29T02:00:01.975619+0000","last_fullsized":"2023-07-29T02:00:01.975619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978173+0000","last_change":"2023-07-29T01:59:57.970172+0000","last_active":"2023-07-29T02:00:01.978173+0000","last_peered":"2023-07-29T02:00:01.978173+0000","last_clean":"2023-07-29T02:00:01.978173+0000","last_became_active":"2023-07-29T01:59:57.969868+0000","last_became_peered":"2023-07-29T01:59:57.969868+0000","last_unstale":"2023-07-29T02:00:01.978173+0000","last_undegraded":"2023-07-29T02:00:01.978173+0000","last_fullsized":"2023-07-29T02:00:01.978173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972765+0000","last_change":"2023-07-29T01:59:57.964171+0000","last_active":"2023-07-29T02:00:01.972765+0000","last_peered":"2023-07-29T02:00:01.972765+0000","last_clean":"2023-07-29T02:00:01.972765+0000","last_became_active":"2023-07-29T01:59:57.963902+0000","last_became_peered":"2023-07-29T01:59:57.963902+0000","last_unstale":"2023-07-29T02:00:01.972765+0000","last_undegraded":"2023-07-29T02:00:01.972765+0000","last_fullsized":"2023-07-29T02:00:01.972765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:51.691001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972884+0000","last_change":"2023-07-29T01:59:57.963492+0000","last_active":"2023-07-29T02:00:01.972884+0000","last_peered":"2023-07-29T02:00:01.972884+0000","last_clean":"2023-07-29T02:00:01.972884+0000","last_became_active":"2023-07-29T01:59:57.963239+0000","last_became_peered":"2023-07-29T01:59:57.963239+0000","last_unstale":"2023-07-29T02:00:01.972884+0000","last_undegraded":"2023-07-29T02:00:01.972884+0000","last_fullsized":"2023-07-29T02:00:01.972884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:08.001986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974742+0000","last_change":"2023-07-29T01:59:57.961369+0000","last_active":"2023-07-29T02:00:01.974742+0000","last_peered":"2023-07-29T02:00:01.974742+0000","last_clean":"2023-07-29T02:00:01.974742+0000","last_became_active":"2023-07-29T01:59:57.960709+0000","last_became_peered":"2023-07-29T01:59:57.960709+0000","last_unstale":"2023-07-29T02:00:01.974742+0000","last_undegraded":"2023-07-29T02:00:01.974742+0000","last_fullsized":"2023-07-29T02:00:01.974742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974229+0000","last_change":"2023-07-29T01:59:57.970498+0000","last_active":"2023-07-29T02:00:01.974229+0000","last_peered":"2023-07-29T02:00:01.974229+0000","last_clean":"2023-07-29T02:00:01.974229+0000","last_became_active":"2023-07-29T01:59:57.970263+0000","last_became_peered":"2023-07-29T01:59:57.970263+0000","last_unstale":"2023-07-29T02:00:01.974229+0000","last_undegraded":"2023-07-29T02:00:01.974229+0000","last_fullsized":"2023-07-29T02:00:01.974229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975567+0000","last_change":"2023-07-29T01:59:57.965648+0000","last_active":"2023-07-29T02:00:01.975567+0000","last_peered":"2023-07-29T02:00:01.975567+0000","last_clean":"2023-07-29T02:00:01.975567+0000","last_became_active":"2023-07-29T01:59:57.964696+0000","last_became_peered":"2023-07-29T01:59:57.964696+0000","last_unstale":"2023-07-29T02:00:01.975567+0000","last_undegraded":"2023-07-29T02:00:01.975567+0000","last_fullsized":"2023-07-29T02:00:01.975567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:19:14.641252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967346+0000","last_change":"2023-07-29T01:59:57.969148+0000","last_active":"2023-07-29T02:00:01.967346+0000","last_peered":"2023-07-29T02:00:01.967346+0000","last_clean":"2023-07-29T02:00:01.967346+0000","last_became_active":"2023-07-29T01:59:57.968885+0000","last_became_peered":"2023-07-29T01:59:57.968885+0000","last_unstale":"2023-07-29T02:00:01.967346+0000","last_undegraded":"2023-07-29T02:00:01.967346+0000","last_fullsized":"2023-07-29T02:00:01.967346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977442+0000","last_change":"2023-07-29T01:59:57.963189+0000","last_active":"2023-07-29T02:00:01.977442+0000","last_peered":"2023-07-29T02:00:01.977442+0000","last_clean":"2023-07-29T02:00:01.977442+0000","last_became_active":"2023-07-29T01:59:57.962919+0000","last_became_peered":"2023-07-29T01:59:57.962919+0000","last_unstale":"2023-07-29T02:00:01.977442+0000","last_undegraded":"2023-07-29T02:00:01.977442+0000","last_fullsized":"2023-07-29T02:00:01.977442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:16:58.718803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973218+0000","last_change":"2023-07-29T01:59:57.960380+0000","last_active":"2023-07-29T02:00:01.973218+0000","last_peered":"2023-07-29T02:00:01.973218+0000","last_clean":"2023-07-29T02:00:01.973218+0000","last_became_active":"2023-07-29T01:59:57.960111+0000","last_became_peered":"2023-07-29T01:59:57.960111+0000","last_unstale":"2023-07-29T02:00:01.973218+0000","last_undegraded":"2023-07-29T02:00:01.973218+0000","last_fullsized":"2023-07-29T02:00:01.973218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:45.956813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977046+0000","last_change":"2023-07-29T01:59:57.961945+0000","last_active":"2023-07-29T02:00:01.977046+0000","last_peered":"2023-07-29T02:00:01.977046+0000","last_clean":"2023-07-29T02:00:01.977046+0000","last_became_active":"2023-07-29T01:59:57.961655+0000","last_became_peered":"2023-07-29T01:59:57.961655+0000","last_unstale":"2023-07-29T02:00:01.977046+0000","last_undegraded":"2023-07-29T02:00:01.977046+0000","last_fullsized":"2023-07-29T02:00:01.977046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.203628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974482+0000","last_change":"2023-07-29T01:59:57.971030+0000","last_active":"2023-07-29T02:00:01.974482+0000","last_peered":"2023-07-29T02:00:01.974482+0000","last_clean":"2023-07-29T02:00:01.974482+0000","last_became_active":"2023-07-29T01:59:57.970757+0000","last_became_peered":"2023-07-29T01:59:57.970757+0000","last_unstale":"2023-07-29T02:00:01.974482+0000","last_undegraded":"2023-07-29T02:00:01.974482+0000","last_fullsized":"2023-07-29T02:00:01.974482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966509+0000","last_change":"2023-07-29T01:59:57.974734+0000","last_active":"2023-07-29T02:00:01.966509+0000","last_peered":"2023-07-29T02:00:01.966509+0000","last_clean":"2023-07-29T02:00:01.966509+0000","last_became_active":"2023-07-29T01:59:57.974436+0000","last_became_peered":"2023-07-29T01:59:57.974436+0000","last_unstale":"2023-07-29T02:00:01.966509+0000","last_undegraded":"2023-07-29T02:00:01.966509+0000","last_fullsized":"2023-07-29T02:00:01.966509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979698+0000","last_change":"2023-07-29T01:59:57.967259+0000","last_active":"2023-07-29T02:00:01.979698+0000","last_peered":"2023-07-29T02:00:01.979698+0000","last_clean":"2023-07-29T02:00:01.979698+0000","last_became_active":"2023-07-29T01:59:57.966987+0000","last_became_peered":"2023-07-29T01:59:57.966987+0000","last_unstale":"2023-07-29T02:00:01.979698+0000","last_undegraded":"2023-07-29T02:00:01.979698+0000","last_fullsized":"2023-07-29T02:00:01.979698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973494+0000","last_change":"2023-07-29T01:59:57.971976+0000","last_active":"2023-07-29T02:00:01.973494+0000","last_peered":"2023-07-29T02:00:01.973494+0000","last_clean":"2023-07-29T02:00:01.973494+0000","last_became_active":"2023-07-29T01:59:57.971733+0000","last_became_peered":"2023-07-29T01:59:57.971733+0000","last_unstale":"2023-07-29T02:00:01.973494+0000","last_undegraded":"2023-07-29T02:00:01.973494+0000","last_fullsized":"2023-07-29T02:00:01.973494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972112+0000","last_change":"2023-07-29T01:59:57.973644+0000","last_active":"2023-07-29T02:00:01.972112+0000","last_peered":"2023-07-29T02:00:01.972112+0000","last_clean":"2023-07-29T02:00:01.972112+0000","last_became_active":"2023-07-29T01:59:57.969742+0000","last_became_peered":"2023-07-29T01:59:57.969742+0000","last_unstale":"2023-07-29T02:00:01.972112+0000","last_undegraded":"2023-07-29T02:00:01.972112+0000","last_fullsized":"2023-07-29T02:00:01.972112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975642+0000","last_change":"2023-07-29T01:59:57.969779+0000","last_active":"2023-07-29T02:00:01.975642+0000","last_peered":"2023-07-29T02:00:01.975642+0000","last_clean":"2023-07-29T02:00:01.975642+0000","last_became_active":"2023-07-29T01:59:57.969409+0000","last_became_peered":"2023-07-29T01:59:57.969409+0000","last_unstale":"2023-07-29T02:00:01.975642+0000","last_undegraded":"2023-07-29T02:00:01.975642+0000","last_fullsized":"2023-07-29T02:00:01.975642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977989+0000","last_change":"2023-07-29T01:59:57.965799+0000","last_active":"2023-07-29T02:00:01.977989+0000","last_peered":"2023-07-29T02:00:01.977989+0000","last_clean":"2023-07-29T02:00:01.977989+0000","last_became_active":"2023-07-29T01:59:57.963774+0000","last_became_peered":"2023-07-29T01:59:57.963774+0000","last_unstale":"2023-07-29T02:00:01.977989+0000","last_undegraded":"2023-07-29T02:00:01.977989+0000","last_fullsized":"2023-07-29T02:00:01.977989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399488+0000","last_change":"2023-07-29T02:00:01.994114+0000","last_active":"2023-07-29T02:00:02.399488+0000","last_peered":"2023-07-29T02:00:02.399488+0000","last_clean":"2023-07-29T02:00:02.399488+0000","last_became_active":"2023-07-29T02:00:01.993731+0000","last_became_peered":"2023-07-29T02:00:01.993731+0000","last_unstale":"2023-07-29T02:00:02.399488+0000","last_undegraded":"2023-07-29T02:00:02.399488+0000","last_fullsized":"2023-07-29T02:00:02.399488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:14:25.422754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399152+0000","last_change":"2023-07-29T01:59:57.552913+0000","last_active":"2023-07-29T02:00:02.399152+0000","last_peered":"2023-07-29T02:00:02.399152+0000","last_clean":"2023-07-29T02:00:02.399152+0000","last_became_active":"2023-07-29T01:59:57.552673+0000","last_became_peered":"2023-07-29T01:59:57.552673+0000","last_unstale":"2023-07-29T02:00:02.399152+0000","last_undegraded":"2023-07-29T02:00:02.399152+0000","last_fullsized":"2023-07-29T02:00:02.399152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:49:56.335019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978862+0000","last_change":"2023-07-29T01:59:57.970140+0000","last_active":"2023-07-29T02:00:01.978862+0000","last_peered":"2023-07-29T02:00:01.978862+0000","last_clean":"2023-07-29T02:00:01.978862+0000","last_became_active":"2023-07-29T01:59:57.969821+0000","last_became_peered":"2023-07-29T01:59:57.969821+0000","last_unstale":"2023-07-29T02:00:01.978862+0000","last_undegraded":"2023-07-29T02:00:01.978862+0000","last_fullsized":"2023-07-29T02:00:01.978862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439205+0000","last_change":"2023-07-29T02:00:01.992728+0000","last_active":"2023-07-29T02:00:02.439205+0000","last_peered":"2023-07-29T02:00:02.439205+0000","last_clean":"2023-07-29T02:00:02.439205+0000","last_became_active":"2023-07-29T02:00:01.992338+0000","last_became_peered":"2023-07-29T02:00:01.992338+0000","last_unstale":"2023-07-29T02:00:02.439205+0000","last_undegraded":"2023-07-29T02:00:02.439205+0000","last_fullsized":"2023-07-29T02:00:02.439205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:37.968145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972242+0000","last_change":"2023-07-29T01:59:57.547793+0000","last_active":"2023-07-29T02:00:01.972242+0000","last_peered":"2023-07-29T02:00:01.972242+0000","last_clean":"2023-07-29T02:00:01.972242+0000","last_became_active":"2023-07-29T01:59:57.547455+0000","last_became_peered":"2023-07-29T01:59:57.547455+0000","last_unstale":"2023-07-29T02:00:01.972242+0000","last_undegraded":"2023-07-29T02:00:01.972242+0000","last_fullsized":"2023-07-29T02:00:01.972242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967048+0000","last_change":"2023-07-29T01:59:57.964646+0000","last_active":"2023-07-29T02:00:01.967048+0000","last_peered":"2023-07-29T02:00:01.967048+0000","last_clean":"2023-07-29T02:00:01.967048+0000","last_became_active":"2023-07-29T01:59:57.964393+0000","last_became_peered":"2023-07-29T01:59:57.964393+0000","last_unstale":"2023-07-29T02:00:01.967048+0000","last_undegraded":"2023-07-29T02:00:01.967048+0000","last_fullsized":"2023-07-29T02:00:01.967048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440161+0000","last_change":"2023-07-29T02:00:01.982883+0000","last_active":"2023-07-29T02:00:02.440161+0000","last_peered":"2023-07-29T02:00:02.440161+0000","last_clean":"2023-07-29T02:00:02.440161+0000","last_became_active":"2023-07-29T02:00:01.982042+0000","last_became_peered":"2023-07-29T02:00:01.982042+0000","last_unstale":"2023-07-29T02:00:02.440161+0000","last_undegraded":"2023-07-29T02:00:02.440161+0000","last_fullsized":"2023-07-29T02:00:02.440161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977952+0000","last_change":"2023-07-29T01:59:57.535286+0000","last_active":"2023-07-29T02:00:01.977952+0000","last_peered":"2023-07-29T02:00:01.977952+0000","last_clean":"2023-07-29T02:00:01.977952+0000","last_became_active":"2023-07-29T01:59:57.533523+0000","last_became_peered":"2023-07-29T01:59:57.533523+0000","last_unstale":"2023-07-29T02:00:01.977952+0000","last_undegraded":"2023-07-29T02:00:01.977952+0000","last_fullsized":"2023-07-29T02:00:01.977952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968772+0000","last_change":"2023-07-29T01:59:57.963792+0000","last_active":"2023-07-29T02:00:01.968772+0000","last_peered":"2023-07-29T02:00:01.968772+0000","last_clean":"2023-07-29T02:00:01.968772+0000","last_became_active":"2023-07-29T01:59:57.963466+0000","last_became_peered":"2023-07-29T01:59:57.963466+0000","last_unstale":"2023-07-29T02:00:01.968772+0000","last_undegraded":"2023-07-29T02:00:01.968772+0000","last_fullsized":"2023-07-29T02:00:01.968772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:28.048947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.438720+0000","last_change":"2023-07-29T02:00:01.984458+0000","last_active":"2023-07-29T02:00:02.438720+0000","last_peered":"2023-07-29T02:00:02.438720+0000","last_clean":"2023-07-29T02:00:02.438720+0000","last_became_active":"2023-07-29T02:00:01.984000+0000","last_became_peered":"2023-07-29T02:00:01.984000+0000","last_unstale":"2023-07-29T02:00:02.438720+0000","last_undegraded":"2023-07-29T02:00:02.438720+0000","last_fullsized":"2023-07-29T02:00:02.438720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967445+0000","last_change":"2023-07-29T01:59:57.537082+0000","last_active":"2023-07-29T02:00:01.967445+0000","last_peered":"2023-07-29T02:00:01.967445+0000","last_clean":"2023-07-29T02:00:01.967445+0000","last_became_active":"2023-07-29T01:59:57.536732+0000","last_became_peered":"2023-07-29T01:59:57.536732+0000","last_unstale":"2023-07-29T02:00:01.967445+0000","last_undegraded":"2023-07-29T02:00:01.967445+0000","last_fullsized":"2023-07-29T02:00:01.967445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977852+0000","last_change":"2023-07-29T01:59:57.971203+0000","last_active":"2023-07-29T02:00:01.977852+0000","last_peered":"2023-07-29T02:00:01.977852+0000","last_clean":"2023-07-29T02:00:01.977852+0000","last_became_active":"2023-07-29T01:59:57.970902+0000","last_became_peered":"2023-07-29T01:59:57.970902+0000","last_unstale":"2023-07-29T02:00:01.977852+0000","last_undegraded":"2023-07-29T02:00:01.977852+0000","last_fullsized":"2023-07-29T02:00:01.977852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399530+0000","last_change":"2023-07-29T02:00:01.991435+0000","last_active":"2023-07-29T02:00:02.399530+0000","last_peered":"2023-07-29T02:00:02.399530+0000","last_clean":"2023-07-29T02:00:02.399530+0000","last_became_active":"2023-07-29T02:00:01.989456+0000","last_became_peered":"2023-07-29T02:00:01.989456+0000","last_unstale":"2023-07-29T02:00:02.399530+0000","last_undegraded":"2023-07-29T02:00:02.399530+0000","last_fullsized":"2023-07-29T02:00:02.399530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975677+0000","last_change":"2023-07-29T01:59:57.540572+0000","last_active":"2023-07-29T02:00:01.975677+0000","last_peered":"2023-07-29T02:00:01.975677+0000","last_clean":"2023-07-29T02:00:01.975677+0000","last_became_active":"2023-07-29T01:59:57.540113+0000","last_became_peered":"2023-07-29T01:59:57.540113+0000","last_unstale":"2023-07-29T02:00:01.975677+0000","last_undegraded":"2023-07-29T02:00:01.975677+0000","last_fullsized":"2023-07-29T02:00:01.975677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979625+0000","last_change":"2023-07-29T01:59:57.967343+0000","last_active":"2023-07-29T02:00:01.979625+0000","last_peered":"2023-07-29T02:00:01.979625+0000","last_clean":"2023-07-29T02:00:01.979625+0000","last_became_active":"2023-07-29T01:59:57.967083+0000","last_became_peered":"2023-07-29T01:59:57.967083+0000","last_unstale":"2023-07-29T02:00:01.979625+0000","last_undegraded":"2023-07-29T02:00:01.979625+0000","last_fullsized":"2023-07-29T02:00:01.979625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441217+0000","last_change":"2023-07-29T02:00:01.996761+0000","last_active":"2023-07-29T02:00:02.441217+0000","last_peered":"2023-07-29T02:00:02.441217+0000","last_clean":"2023-07-29T02:00:02.441217+0000","last_became_active":"2023-07-29T02:00:01.996035+0000","last_became_peered":"2023-07-29T02:00:01.996035+0000","last_unstale":"2023-07-29T02:00:02.441217+0000","last_undegraded":"2023-07-29T02:00:02.441217+0000","last_fullsized":"2023-07-29T02:00:02.441217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"25'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958140+0000","last_change":"2023-07-29T01:59:57.548665+0000","last_active":"2023-07-29T02:00:02.958140+0000","last_peered":"2023-07-29T02:00:02.958140+0000","last_clean":"2023-07-29T02:00:02.958140+0000","last_became_active":"2023-07-29T01:59:57.547803+0000","last_became_peered":"2023-07-29T01:59:57.547803+0000","last_unstale":"2023-07-29T02:00:02.958140+0000","last_undegraded":"2023-07-29T02:00:02.958140+0000","last_fullsized":"2023-07-29T02:00:02.958140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971561+0000","last_change":"2023-07-29T01:59:57.969319+0000","last_active":"2023-07-29T02:00:01.971561+0000","last_peered":"2023-07-29T02:00:01.971561+0000","last_clean":"2023-07-29T02:00:01.971561+0000","last_became_active":"2023-07-29T01:59:57.969006+0000","last_became_peered":"2023-07-29T01:59:57.969006+0000","last_unstale":"2023-07-29T02:00:01.971561+0000","last_undegraded":"2023-07-29T02:00:01.971561+0000","last_fullsized":"2023-07-29T02:00:01.971561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:30:28.393515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440217+0000","last_change":"2023-07-29T02:00:01.996124+0000","last_active":"2023-07-29T02:00:02.440217+0000","last_peered":"2023-07-29T02:00:02.440217+0000","last_clean":"2023-07-29T02:00:02.440217+0000","last_became_active":"2023-07-29T02:00:01.995757+0000","last_became_peered":"2023-07-29T02:00:01.995757+0000","last_unstale":"2023-07-29T02:00:02.440217+0000","last_undegraded":"2023-07-29T02:00:02.440217+0000","last_fullsized":"2023-07-29T02:00:02.440217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:24:03.881006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:11.051405+0000","last_change":"2023-07-29T01:59:57.541936+0000","last_active":"2023-07-29T02:00:11.051405+0000","last_peered":"2023-07-29T02:00:11.051405+0000","last_clean":"2023-07-29T02:00:11.051405+0000","last_became_active":"2023-07-29T01:59:57.541434+0000","last_became_peered":"2023-07-29T01:59:57.541434+0000","last_unstale":"2023-07-29T02:00:11.051405+0000","last_undegraded":"2023-07-29T02:00:11.051405+0000","last_fullsized":"2023-07-29T02:00:11.051405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3791,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976628+0000","last_change":"2023-07-29T01:59:57.962725+0000","last_active":"2023-07-29T02:00:01.976628+0000","last_peered":"2023-07-29T02:00:01.976628+0000","last_clean":"2023-07-29T02:00:01.976628+0000","last_became_active":"2023-07-29T01:59:57.962459+0000","last_became_peered":"2023-07-29T01:59:57.962459+0000","last_unstale":"2023-07-29T02:00:01.976628+0000","last_undegraded":"2023-07-29T02:00:01.976628+0000","last_fullsized":"2023-07-29T02:00:01.976628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401186+0000","last_change":"2023-07-29T02:00:01.996160+0000","last_active":"2023-07-29T02:00:02.401186+0000","last_peered":"2023-07-29T02:00:02.401186+0000","last_clean":"2023-07-29T02:00:02.401186+0000","last_became_active":"2023-07-29T02:00:01.995827+0000","last_became_peered":"2023-07-29T02:00:01.995827+0000","last_unstale":"2023-07-29T02:00:02.401186+0000","last_undegraded":"2023-07-29T02:00:02.401186+0000","last_fullsized":"2023-07-29T02:00:02.401186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958252+0000","last_change":"2023-07-29T01:59:57.545705+0000","last_active":"2023-07-29T02:00:02.958252+0000","last_peered":"2023-07-29T02:00:02.958252+0000","last_clean":"2023-07-29T02:00:02.958252+0000","last_became_active":"2023-07-29T01:59:57.545406+0000","last_became_peered":"2023-07-29T01:59:57.545406+0000","last_unstale":"2023-07-29T02:00:02.958252+0000","last_undegraded":"2023-07-29T02:00:02.958252+0000","last_fullsized":"2023-07-29T02:00:02.958252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:31.903601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.980027+0000","last_change":"2023-07-29T01:59:57.970072+0000","last_active":"2023-07-29T02:00:01.980027+0000","last_peered":"2023-07-29T02:00:01.980027+0000","last_clean":"2023-07-29T02:00:01.980027+0000","last_became_active":"2023-07-29T01:59:57.969809+0000","last_became_peered":"2023-07-29T01:59:57.969809+0000","last_unstale":"2023-07-29T02:00:01.980027+0000","last_undegraded":"2023-07-29T02:00:01.980027+0000","last_fullsized":"2023-07-29T02:00:01.980027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440272+0000","last_change":"2023-07-29T02:00:01.997402+0000","last_active":"2023-07-29T02:00:02.440272+0000","last_peered":"2023-07-29T02:00:02.440272+0000","last_clean":"2023-07-29T02:00:02.440272+0000","last_became_active":"2023-07-29T02:00:01.996969+0000","last_became_peered":"2023-07-29T02:00:01.996969+0000","last_unstale":"2023-07-29T02:00:02.440272+0000","last_undegraded":"2023-07-29T02:00:02.440272+0000","last_fullsized":"2023-07-29T02:00:02.440272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:46:37.088979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966653+0000","last_change":"2023-07-29T01:59:57.541115+0000","last_active":"2023-07-29T02:00:01.966653+0000","last_peered":"2023-07-29T02:00:01.966653+0000","last_clean":"2023-07-29T02:00:01.966653+0000","last_became_active":"2023-07-29T01:59:57.540800+0000","last_became_peered":"2023-07-29T01:59:57.540800+0000","last_unstale":"2023-07-29T02:00:01.966653+0000","last_undegraded":"2023-07-29T02:00:01.966653+0000","last_fullsized":"2023-07-29T02:00:01.966653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977902+0000","last_change":"2023-07-29T01:59:57.964198+0000","last_active":"2023-07-29T02:00:01.977902+0000","last_peered":"2023-07-29T02:00:01.977902+0000","last_clean":"2023-07-29T02:00:01.977902+0000","last_became_active":"2023-07-29T01:59:57.963510+0000","last_became_peered":"2023-07-29T01:59:57.963510+0000","last_unstale":"2023-07-29T02:00:01.977902+0000","last_undegraded":"2023-07-29T02:00:01.977902+0000","last_fullsized":"2023-07-29T02:00:01.977902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441378+0000","last_change":"2023-07-29T02:00:01.996496+0000","last_active":"2023-07-29T02:00:02.441378+0000","last_peered":"2023-07-29T02:00:02.441378+0000","last_clean":"2023-07-29T02:00:02.441378+0000","last_became_active":"2023-07-29T02:00:01.996084+0000","last_became_peered":"2023-07-29T02:00:01.996084+0000","last_unstale":"2023-07-29T02:00:02.441378+0000","last_undegraded":"2023-07-29T02:00:02.441378+0000","last_fullsized":"2023-07-29T02:00:02.441378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:59:57.581952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974316+0000","last_change":"2023-07-29T01:59:57.548464+0000","last_active":"2023-07-29T02:00:01.974316+0000","last_peered":"2023-07-29T02:00:01.974316+0000","last_clean":"2023-07-29T02:00:01.974316+0000","last_became_active":"2023-07-29T01:59:57.548109+0000","last_became_peered":"2023-07-29T01:59:57.548109+0000","last_unstale":"2023-07-29T02:00:01.974316+0000","last_undegraded":"2023-07-29T02:00:01.974316+0000","last_fullsized":"2023-07-29T02:00:01.974316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:13.433053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967896+0000","last_change":"2023-07-29T01:59:57.962096+0000","last_active":"2023-07-29T02:00:01.967896+0000","last_peered":"2023-07-29T02:00:01.967896+0000","last_clean":"2023-07-29T02:00:01.967896+0000","last_became_active":"2023-07-29T01:59:57.961759+0000","last_became_peered":"2023-07-29T01:59:57.961759+0000","last_unstale":"2023-07-29T02:00:01.967896+0000","last_undegraded":"2023-07-29T02:00:01.967896+0000","last_fullsized":"2023-07-29T02:00:01.967896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400737+0000","last_change":"2023-07-29T02:00:01.993066+0000","last_active":"2023-07-29T02:00:02.400737+0000","last_peered":"2023-07-29T02:00:02.400737+0000","last_clean":"2023-07-29T02:00:02.400737+0000","last_became_active":"2023-07-29T02:00:01.992592+0000","last_became_peered":"2023-07-29T02:00:01.992592+0000","last_unstale":"2023-07-29T02:00:02.400737+0000","last_undegraded":"2023-07-29T02:00:02.400737+0000","last_fullsized":"2023-07-29T02:00:02.400737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:14:06.353802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958759+0000","last_change":"2023-07-29T01:59:57.543707+0000","last_active":"2023-07-29T02:00:02.958759+0000","last_peered":"2023-07-29T02:00:02.958759+0000","last_clean":"2023-07-29T02:00:02.958759+0000","last_became_active":"2023-07-29T01:59:57.543398+0000","last_became_peered":"2023-07-29T01:59:57.543398+0000","last_unstale":"2023-07-29T02:00:02.958759+0000","last_undegraded":"2023-07-29T02:00:02.958759+0000","last_fullsized":"2023-07-29T02:00:02.958759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977853+0000","last_change":"2023-07-29T01:59:57.966269+0000","last_active":"2023-07-29T02:00:01.977853+0000","last_peered":"2023-07-29T02:00:01.977853+0000","last_clean":"2023-07-29T02:00:01.977853+0000","last_became_active":"2023-07-29T01:59:57.965962+0000","last_became_peered":"2023-07-29T01:59:57.965962+0000","last_unstale":"2023-07-29T02:00:01.977853+0000","last_undegraded":"2023-07-29T02:00:01.977853+0000","last_fullsized":"2023-07-29T02:00:01.977853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400336+0000","last_change":"2023-07-29T02:00:01.992987+0000","last_active":"2023-07-29T02:00:02.400336+0000","last_peered":"2023-07-29T02:00:02.400336+0000","last_clean":"2023-07-29T02:00:02.400336+0000","last_became_active":"2023-07-29T02:00:01.992384+0000","last_became_peered":"2023-07-29T02:00:01.992384+0000","last_unstale":"2023-07-29T02:00:02.400336+0000","last_undegraded":"2023-07-29T02:00:02.400336+0000","last_fullsized":"2023-07-29T02:00:02.400336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400080+0000","last_change":"2023-07-29T01:59:57.548392+0000","last_active":"2023-07-29T02:00:02.400080+0000","last_peered":"2023-07-29T02:00:02.400080+0000","last_clean":"2023-07-29T02:00:02.400080+0000","last_became_active":"2023-07-29T01:59:57.548084+0000","last_became_peered":"2023-07-29T01:59:57.548084+0000","last_unstale":"2023-07-29T02:00:02.400080+0000","last_undegraded":"2023-07-29T02:00:02.400080+0000","last_fullsized":"2023-07-29T02:00:02.400080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973873+0000","last_change":"2023-07-29T01:59:57.965613+0000","last_active":"2023-07-29T02:00:01.973873+0000","last_peered":"2023-07-29T02:00:01.973873+0000","last_clean":"2023-07-29T02:00:01.973873+0000","last_became_active":"2023-07-29T01:59:57.964626+0000","last_became_peered":"2023-07-29T01:59:57.964626+0000","last_unstale":"2023-07-29T02:00:01.973873+0000","last_undegraded":"2023-07-29T02:00:01.973873+0000","last_fullsized":"2023-07-29T02:00:01.973873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442405+0000","last_change":"2023-07-29T02:00:01.990978+0000","last_active":"2023-07-29T02:00:02.442405+0000","last_peered":"2023-07-29T02:00:02.442405+0000","last_clean":"2023-07-29T02:00:02.442405+0000","last_became_active":"2023-07-29T02:00:01.990579+0000","last_became_peered":"2023-07-29T02:00:01.990579+0000","last_unstale":"2023-07-29T02:00:02.442405+0000","last_undegraded":"2023-07-29T02:00:02.442405+0000","last_fullsized":"2023-07-29T02:00:02.442405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:11:53.398210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957642+0000","last_change":"2023-07-29T01:59:57.549270+0000","last_active":"2023-07-29T02:00:02.957642+0000","last_peered":"2023-07-29T02:00:02.957642+0000","last_clean":"2023-07-29T02:00:02.957642+0000","last_became_active":"2023-07-29T01:59:57.548981+0000","last_became_peered":"2023-07-29T01:59:57.548981+0000","last_unstale":"2023-07-29T02:00:02.957642+0000","last_undegraded":"2023-07-29T02:00:02.957642+0000","last_fullsized":"2023-07-29T02:00:02.957642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:05.783369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972647+0000","last_change":"2023-07-29T01:59:57.969851+0000","last_active":"2023-07-29T02:00:01.972647+0000","last_peered":"2023-07-29T02:00:01.972647+0000","last_clean":"2023-07-29T02:00:01.972647+0000","last_became_active":"2023-07-29T01:59:57.969501+0000","last_became_peered":"2023-07-29T01:59:57.969501+0000","last_unstale":"2023-07-29T02:00:01.972647+0000","last_undegraded":"2023-07-29T02:00:01.972647+0000","last_fullsized":"2023-07-29T02:00:01.972647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442608+0000","last_change":"2023-07-29T02:00:01.989766+0000","last_active":"2023-07-29T02:00:02.442608+0000","last_peered":"2023-07-29T02:00:02.442608+0000","last_clean":"2023-07-29T02:00:02.442608+0000","last_became_active":"2023-07-29T02:00:01.989364+0000","last_became_peered":"2023-07-29T02:00:01.989364+0000","last_unstale":"2023-07-29T02:00:02.442608+0000","last_undegraded":"2023-07-29T02:00:02.442608+0000","last_fullsized":"2023-07-29T02:00:02.442608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:01:14.849757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400580+0000","last_change":"2023-07-29T01:59:57.541329+0000","last_active":"2023-07-29T02:00:02.400580+0000","last_peered":"2023-07-29T02:00:02.400580+0000","last_clean":"2023-07-29T02:00:02.400580+0000","last_became_active":"2023-07-29T01:59:57.541056+0000","last_became_peered":"2023-07-29T01:59:57.541056+0000","last_unstale":"2023-07-29T02:00:02.400580+0000","last_undegraded":"2023-07-29T02:00:02.400580+0000","last_fullsized":"2023-07-29T02:00:02.400580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968261+0000","last_change":"2023-07-29T01:59:57.975244+0000","last_active":"2023-07-29T02:00:01.968261+0000","last_peered":"2023-07-29T02:00:01.968261+0000","last_clean":"2023-07-29T02:00:01.968261+0000","last_became_active":"2023-07-29T01:59:57.974998+0000","last_became_peered":"2023-07-29T01:59:57.974998+0000","last_unstale":"2023-07-29T02:00:01.968261+0000","last_undegraded":"2023-07-29T02:00:01.968261+0000","last_fullsized":"2023-07-29T02:00:01.968261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:14.435169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442656+0000","last_change":"2023-07-29T02:00:01.990823+0000","last_active":"2023-07-29T02:00:02.442656+0000","last_peered":"2023-07-29T02:00:02.442656+0000","last_clean":"2023-07-29T02:00:02.442656+0000","last_became_active":"2023-07-29T02:00:01.990276+0000","last_became_peered":"2023-07-29T02:00:01.990276+0000","last_unstale":"2023-07-29T02:00:02.442656+0000","last_undegraded":"2023-07-29T02:00:02.442656+0000","last_fullsized":"2023-07-29T02:00:02.442656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974632+0000","last_change":"2023-07-29T01:59:57.544524+0000","last_active":"2023-07-29T02:00:01.974632+0000","last_peered":"2023-07-29T02:00:01.974632+0000","last_clean":"2023-07-29T02:00:01.974632+0000","last_became_active":"2023-07-29T01:59:57.544231+0000","last_became_peered":"2023-07-29T01:59:57.544231+0000","last_unstale":"2023-07-29T02:00:01.974632+0000","last_undegraded":"2023-07-29T02:00:01.974632+0000","last_fullsized":"2023-07-29T02:00:01.974632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966682+0000","last_change":"2023-07-29T01:59:57.974773+0000","last_active":"2023-07-29T02:00:01.966682+0000","last_peered":"2023-07-29T02:00:01.966682+0000","last_clean":"2023-07-29T02:00:01.966682+0000","last_became_active":"2023-07-29T01:59:57.974525+0000","last_became_peered":"2023-07-29T01:59:57.974525+0000","last_unstale":"2023-07-29T02:00:01.966682+0000","last_undegraded":"2023-07-29T02:00:01.966682+0000","last_fullsized":"2023-07-29T02:00:01.966682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442650+0000","last_change":"2023-07-29T02:00:01.988872+0000","last_active":"2023-07-29T02:00:02.442650+0000","last_peered":"2023-07-29T02:00:02.442650+0000","last_clean":"2023-07-29T02:00:02.442650+0000","last_became_active":"2023-07-29T02:00:01.988486+0000","last_became_peered":"2023-07-29T02:00:01.988486+0000","last_unstale":"2023-07-29T02:00:02.442650+0000","last_undegraded":"2023-07-29T02:00:02.442650+0000","last_fullsized":"2023-07-29T02:00:02.442650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:07.842328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.954789+0000","last_change":"2023-07-29T01:59:57.535498+0000","last_active":"2023-07-29T02:00:02.954789+0000","last_peered":"2023-07-29T02:00:02.954789+0000","last_clean":"2023-07-29T02:00:02.954789+0000","last_became_active":"2023-07-29T01:59:57.534813+0000","last_became_peered":"2023-07-29T01:59:57.534813+0000","last_unstale":"2023-07-29T02:00:02.954789+0000","last_undegraded":"2023-07-29T02:00:02.954789+0000","last_fullsized":"2023-07-29T02:00:02.954789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976870+0000","last_change":"2023-07-29T01:59:57.962897+0000","last_active":"2023-07-29T02:00:01.976870+0000","last_peered":"2023-07-29T02:00:01.976870+0000","last_clean":"2023-07-29T02:00:01.976870+0000","last_became_active":"2023-07-29T01:59:57.962184+0000","last_became_peered":"2023-07-29T01:59:57.962184+0000","last_unstale":"2023-07-29T02:00:01.976870+0000","last_undegraded":"2023-07-29T02:00:01.976870+0000","last_fullsized":"2023-07-29T02:00:01.976870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440114+0000","last_change":"2023-07-29T02:00:01.989538+0000","last_active":"2023-07-29T02:00:02.440114+0000","last_peered":"2023-07-29T02:00:02.440114+0000","last_clean":"2023-07-29T02:00:02.440114+0000","last_became_active":"2023-07-29T02:00:01.989151+0000","last_became_peered":"2023-07-29T02:00:01.989151+0000","last_unstale":"2023-07-29T02:00:02.440114+0000","last_undegraded":"2023-07-29T02:00:02.440114+0000","last_fullsized":"2023-07-29T02:00:02.440114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:21:35.031304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968357+0000","last_change":"2023-07-29T01:59:57.544466+0000","last_active":"2023-07-29T02:00:01.968357+0000","last_peered":"2023-07-29T02:00:01.968357+0000","last_clean":"2023-07-29T02:00:01.968357+0000","last_became_active":"2023-07-29T01:59:57.544120+0000","last_became_peered":"2023-07-29T01:59:57.544120+0000","last_unstale":"2023-07-29T02:00:01.968357+0000","last_undegraded":"2023-07-29T02:00:01.968357+0000","last_fullsized":"2023-07-29T02:00:01.968357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977082+0000","last_change":"2023-07-29T01:59:57.962277+0000","last_active":"2023-07-29T02:00:01.977082+0000","last_peered":"2023-07-29T02:00:01.977082+0000","last_clean":"2023-07-29T02:00:01.977082+0000","last_became_active":"2023-07-29T01:59:57.961975+0000","last_became_peered":"2023-07-29T01:59:57.961975+0000","last_unstale":"2023-07-29T02:00:01.977082+0000","last_undegraded":"2023-07-29T02:00:01.977082+0000","last_fullsized":"2023-07-29T02:00:01.977082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:27:01.059953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400809+0000","last_change":"2023-07-29T02:00:01.988563+0000","last_active":"2023-07-29T02:00:02.400809+0000","last_peered":"2023-07-29T02:00:02.400809+0000","last_clean":"2023-07-29T02:00:02.400809+0000","last_became_active":"2023-07-29T02:00:01.988155+0000","last_became_peered":"2023-07-29T02:00:01.988155+0000","last_unstale":"2023-07-29T02:00:02.400809+0000","last_undegraded":"2023-07-29T02:00:02.400809+0000","last_fullsized":"2023-07-29T02:00:02.400809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972477+0000","last_change":"2023-07-29T01:59:57.549764+0000","last_active":"2023-07-29T02:00:01.972477+0000","last_peered":"2023-07-29T02:00:01.972477+0000","last_clean":"2023-07-29T02:00:01.972477+0000","last_became_active":"2023-07-29T01:59:57.549470+0000","last_became_peered":"2023-07-29T01:59:57.549470+0000","last_unstale":"2023-07-29T02:00:01.972477+0000","last_undegraded":"2023-07-29T02:00:01.972477+0000","last_fullsized":"2023-07-29T02:00:01.972477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976948+0000","last_change":"2023-07-29T01:59:57.962303+0000","last_active":"2023-07-29T02:00:01.976948+0000","last_peered":"2023-07-29T02:00:01.976948+0000","last_clean":"2023-07-29T02:00:01.976948+0000","last_became_active":"2023-07-29T01:59:57.962016+0000","last_became_peered":"2023-07-29T01:59:57.962016+0000","last_unstale":"2023-07-29T02:00:01.976948+0000","last_undegraded":"2023-07-29T02:00:01.976948+0000","last_fullsized":"2023-07-29T02:00:01.976948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:08.813083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399334+0000","last_change":"2023-07-29T02:00:01.992380+0000","last_active":"2023-07-29T02:00:02.399334+0000","last_peered":"2023-07-29T02:00:02.399334+0000","last_clean":"2023-07-29T02:00:02.399334+0000","last_became_active":"2023-07-29T02:00:01.992042+0000","last_became_peered":"2023-07-29T02:00:01.992042+0000","last_unstale":"2023-07-29T02:00:02.399334+0000","last_undegraded":"2023-07-29T02:00:02.399334+0000","last_fullsized":"2023-07-29T02:00:02.399334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:24:44.331640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977747+0000","last_change":"2023-07-29T01:59:57.537045+0000","last_active":"2023-07-29T02:00:01.977747+0000","last_peered":"2023-07-29T02:00:01.977747+0000","last_clean":"2023-07-29T02:00:01.977747+0000","last_became_active":"2023-07-29T01:59:57.535762+0000","last_became_peered":"2023-07-29T01:59:57.535762+0000","last_unstale":"2023-07-29T02:00:01.977747+0000","last_undegraded":"2023-07-29T02:00:01.977747+0000","last_fullsized":"2023-07-29T02:00:01.977747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972302+0000","last_change":"2023-07-29T01:59:57.975103+0000","last_active":"2023-07-29T02:00:01.972302+0000","last_peered":"2023-07-29T02:00:01.972302+0000","last_clean":"2023-07-29T02:00:01.972302+0000","last_became_active":"2023-07-29T01:59:57.974834+0000","last_became_peered":"2023-07-29T01:59:57.974834+0000","last_unstale":"2023-07-29T02:00:01.972302+0000","last_undegraded":"2023-07-29T02:00:01.972302+0000","last_fullsized":"2023-07-29T02:00:01.972302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401174+0000","last_change":"2023-07-29T02:00:01.990813+0000","last_active":"2023-07-29T02:00:02.401174+0000","last_peered":"2023-07-29T02:00:02.401174+0000","last_clean":"2023-07-29T02:00:02.401174+0000","last_became_active":"2023-07-29T02:00:01.990464+0000","last_became_peered":"2023-07-29T02:00:01.990464+0000","last_unstale":"2023-07-29T02:00:02.401174+0000","last_undegraded":"2023-07-29T02:00:02.401174+0000","last_fullsized":"2023-07-29T02:00:02.401174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:16:46.676860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958405+0000","last_change":"2023-07-29T01:59:57.540561+0000","last_active":"2023-07-29T02:00:02.958405+0000","last_peered":"2023-07-29T02:00:02.958405+0000","last_clean":"2023-07-29T02:00:02.958405+0000","last_became_active":"2023-07-29T01:59:57.540292+0000","last_became_peered":"2023-07-29T01:59:57.540292+0000","last_unstale":"2023-07-29T02:00:02.958405+0000","last_undegraded":"2023-07-29T02:00:02.958405+0000","last_fullsized":"2023-07-29T02:00:02.958405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978068+0000","last_change":"2023-07-29T01:59:52.448098+0000","last_active":"2023-07-29T02:00:01.978068+0000","last_peered":"2023-07-29T02:00:01.978068+0000","last_clean":"2023-07-29T02:00:01.978068+0000","last_became_active":"2023-07-29T01:59:52.447782+0000","last_became_peered":"2023-07-29T01:59:52.447782+0000","last_unstale":"2023-07-29T02:00:01.978068+0000","last_undegraded":"2023-07-29T02:00:01.978068+0000","last_fullsized":"2023-07-29T02:00:01.978068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:31.981804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977648+0000","last_change":"2023-07-29T01:59:57.967845+0000","last_active":"2023-07-29T02:00:01.977648+0000","last_peered":"2023-07-29T02:00:01.977648+0000","last_clean":"2023-07-29T02:00:01.977648+0000","last_became_active":"2023-07-29T01:59:57.966065+0000","last_became_peered":"2023-07-29T01:59:57.966065+0000","last_unstale":"2023-07-29T02:00:01.977648+0000","last_undegraded":"2023-07-29T02:00:01.977648+0000","last_fullsized":"2023-07-29T02:00:01.977648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439054+0000","last_change":"2023-07-29T02:00:01.996414+0000","last_active":"2023-07-29T02:00:02.439054+0000","last_peered":"2023-07-29T02:00:02.439054+0000","last_clean":"2023-07-29T02:00:02.439054+0000","last_became_active":"2023-07-29T02:00:01.995963+0000","last_became_peered":"2023-07-29T02:00:01.995963+0000","last_unstale":"2023-07-29T02:00:02.439054+0000","last_undegraded":"2023-07-29T02:00:02.439054+0000","last_fullsized":"2023-07-29T02:00:02.439054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:06:19.130853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.980059+0000","last_change":"2023-07-29T01:59:52.445649+0000","last_active":"2023-07-29T02:00:01.980059+0000","last_peered":"2023-07-29T02:00:01.980059+0000","last_clean":"2023-07-29T02:00:01.980059+0000","last_became_active":"2023-07-29T01:59:52.445337+0000","last_became_peered":"2023-07-29T01:59:52.445337+0000","last_unstale":"2023-07-29T02:00:01.980059+0000","last_undegraded":"2023-07-29T02:00:01.980059+0000","last_fullsized":"2023-07-29T02:00:01.980059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439989+0000","last_change":"2023-07-29T01:59:57.537863+0000","last_active":"2023-07-29T02:00:02.439989+0000","last_peered":"2023-07-29T02:00:02.439989+0000","last_clean":"2023-07-29T02:00:02.439989+0000","last_became_active":"2023-07-29T01:59:57.537581+0000","last_became_peered":"2023-07-29T01:59:57.537581+0000","last_unstale":"2023-07-29T02:00:02.439989+0000","last_undegraded":"2023-07-29T02:00:02.439989+0000","last_fullsized":"2023-07-29T02:00:02.439989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:02:57.137574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972545+0000","last_change":"2023-07-29T01:59:57.961598+0000","last_active":"2023-07-29T02:00:01.972545+0000","last_peered":"2023-07-29T02:00:01.972545+0000","last_clean":"2023-07-29T02:00:01.972545+0000","last_became_active":"2023-07-29T01:59:57.961298+0000","last_became_peered":"2023-07-29T01:59:57.961298+0000","last_unstale":"2023-07-29T02:00:01.972545+0000","last_undegraded":"2023-07-29T02:00:01.972545+0000","last_fullsized":"2023-07-29T02:00:01.972545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:11:49.956637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400459+0000","last_change":"2023-07-29T02:00:01.987452+0000","last_active":"2023-07-29T02:00:02.400459+0000","last_peered":"2023-07-29T02:00:02.400459+0000","last_clean":"2023-07-29T02:00:02.400459+0000","last_became_active":"2023-07-29T02:00:01.986915+0000","last_became_peered":"2023-07-29T02:00:01.986915+0000","last_unstale":"2023-07-29T02:00:02.400459+0000","last_undegraded":"2023-07-29T02:00:02.400459+0000","last_fullsized":"2023-07-29T02:00:02.400459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:35:48.256508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973327+0000","last_change":"2023-07-29T01:59:52.448423+0000","last_active":"2023-07-29T02:00:01.973327+0000","last_peered":"2023-07-29T02:00:01.973327+0000","last_clean":"2023-07-29T02:00:01.973327+0000","last_became_active":"2023-07-29T01:59:52.448052+0000","last_became_peered":"2023-07-29T01:59:52.448052+0000","last_unstale":"2023-07-29T02:00:01.973327+0000","last_undegraded":"2023-07-29T02:00:01.973327+0000","last_fullsized":"2023-07-29T02:00:01.973327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:31.981804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973579+0000","last_change":"2023-07-29T01:59:52.450730+0000","last_active":"2023-07-29T02:00:01.973579+0000","last_peered":"2023-07-29T02:00:01.973579+0000","last_clean":"2023-07-29T02:00:01.973579+0000","last_became_active":"2023-07-29T01:59:52.449582+0000","last_became_peered":"2023-07-29T01:59:52.449582+0000","last_unstale":"2023-07-29T02:00:01.973579+0000","last_undegraded":"2023-07-29T02:00:01.973579+0000","last_fullsized":"2023-07-29T02:00:01.973579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:01:27.099648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966496+0000","last_change":"2023-07-29T01:59:57.546474+0000","last_active":"2023-07-29T02:00:01.966496+0000","last_peered":"2023-07-29T02:00:01.966496+0000","last_clean":"2023-07-29T02:00:01.966496+0000","last_became_active":"2023-07-29T01:59:57.546179+0000","last_became_peered":"2023-07-29T01:59:57.546179+0000","last_unstale":"2023-07-29T02:00:01.966496+0000","last_undegraded":"2023-07-29T02:00:01.966496+0000","last_fullsized":"2023-07-29T02:00:01.966496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967788+0000","last_change":"2023-07-29T01:59:57.975316+0000","last_active":"2023-07-29T02:00:01.967788+0000","last_peered":"2023-07-29T02:00:01.967788+0000","last_clean":"2023-07-29T02:00:01.967788+0000","last_became_active":"2023-07-29T01:59:57.975078+0000","last_became_peered":"2023-07-29T01:59:57.975078+0000","last_unstale":"2023-07-29T02:00:01.967788+0000","last_undegraded":"2023-07-29T02:00:01.967788+0000","last_fullsized":"2023-07-29T02:00:01.967788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442819+0000","last_change":"2023-07-29T02:00:01.987385+0000","last_active":"2023-07-29T02:00:02.442819+0000","last_peered":"2023-07-29T02:00:02.442819+0000","last_clean":"2023-07-29T02:00:02.442819+0000","last_became_active":"2023-07-29T02:00:01.986937+0000","last_became_peered":"2023-07-29T02:00:01.986937+0000","last_unstale":"2023-07-29T02:00:02.442819+0000","last_undegraded":"2023-07-29T02:00:02.442819+0000","last_fullsized":"2023-07-29T02:00:02.442819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:53.580244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974915+0000","last_change":"2023-07-29T01:59:53.171806+0000","last_active":"2023-07-29T02:00:01.974915+0000","last_peered":"2023-07-29T02:00:01.974915+0000","last_clean":"2023-07-29T02:00:01.974915+0000","last_became_active":"2023-07-29T01:59:53.171467+0000","last_became_peered":"2023-07-29T01:59:53.171467+0000","last_unstale":"2023-07-29T02:00:01.974915+0000","last_undegraded":"2023-07-29T02:00:01.974915+0000","last_fullsized":"2023-07-29T02:00:01.974915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972796+0000","last_change":"2023-07-29T01:59:57.549442+0000","last_active":"2023-07-29T02:00:01.972796+0000","last_peered":"2023-07-29T02:00:01.972796+0000","last_clean":"2023-07-29T02:00:01.972796+0000","last_became_active":"2023-07-29T01:59:57.549151+0000","last_became_peered":"2023-07-29T01:59:57.549151+0000","last_unstale":"2023-07-29T02:00:01.972796+0000","last_undegraded":"2023-07-29T02:00:01.972796+0000","last_fullsized":"2023-07-29T02:00:01.972796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972211+0000","last_change":"2023-07-29T01:59:57.973471+0000","last_active":"2023-07-29T02:00:01.972211+0000","last_peered":"2023-07-29T02:00:01.972211+0000","last_clean":"2023-07-29T02:00:01.972211+0000","last_became_active":"2023-07-29T01:59:57.969273+0000","last_became_peered":"2023-07-29T01:59:57.969273+0000","last_unstale":"2023-07-29T02:00:01.972211+0000","last_undegraded":"2023-07-29T02:00:01.972211+0000","last_fullsized":"2023-07-29T02:00:01.972211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:56:07.949649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400121+0000","last_change":"2023-07-29T02:00:01.993242+0000","last_active":"2023-07-29T02:00:02.400121+0000","last_peered":"2023-07-29T02:00:02.400121+0000","last_clean":"2023-07-29T02:00:02.400121+0000","last_became_active":"2023-07-29T02:00:01.992406+0000","last_became_peered":"2023-07-29T02:00:01.992406+0000","last_unstale":"2023-07-29T02:00:02.400121+0000","last_undegraded":"2023-07-29T02:00:02.400121+0000","last_fullsized":"2023-07-29T02:00:02.400121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:12.254656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973406+0000","last_change":"2023-07-29T01:59:53.171746+0000","last_active":"2023-07-29T02:00:01.973406+0000","last_peered":"2023-07-29T02:00:01.973406+0000","last_clean":"2023-07-29T02:00:01.973406+0000","last_became_active":"2023-07-29T01:59:53.171440+0000","last_became_peered":"2023-07-29T01:59:53.171440+0000","last_unstale":"2023-07-29T02:00:01.973406+0000","last_undegraded":"2023-07-29T02:00:01.973406+0000","last_fullsized":"2023-07-29T02:00:01.973406+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:17:56.960611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976818+0000","last_change":"2023-07-29T01:59:57.537970+0000","last_active":"2023-07-29T02:00:01.976818+0000","last_peered":"2023-07-29T02:00:01.976818+0000","last_clean":"2023-07-29T02:00:01.976818+0000","last_became_active":"2023-07-29T01:59:57.537665+0000","last_became_peered":"2023-07-29T01:59:57.537665+0000","last_unstale":"2023-07-29T02:00:01.976818+0000","last_undegraded":"2023-07-29T02:00:01.976818+0000","last_fullsized":"2023-07-29T02:00:01.976818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968235+0000","last_change":"2023-07-29T01:59:57.968655+0000","last_active":"2023-07-29T02:00:01.968235+0000","last_peered":"2023-07-29T02:00:01.968235+0000","last_clean":"2023-07-29T02:00:01.968235+0000","last_became_active":"2023-07-29T01:59:57.968373+0000","last_became_peered":"2023-07-29T01:59:57.968373+0000","last_unstale":"2023-07-29T02:00:01.968235+0000","last_undegraded":"2023-07-29T02:00:01.968235+0000","last_fullsized":"2023-07-29T02:00:01.968235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:06.785485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439797+0000","last_change":"2023-07-29T02:00:01.984885+0000","last_active":"2023-07-29T02:00:02.439797+0000","last_peered":"2023-07-29T02:00:02.439797+0000","last_clean":"2023-07-29T02:00:02.439797+0000","last_became_active":"2023-07-29T02:00:01.984476+0000","last_became_peered":"2023-07-29T02:00:01.984476+0000","last_unstale":"2023-07-29T02:00:02.439797+0000","last_undegraded":"2023-07-29T02:00:02.439797+0000","last_fullsized":"2023-07-29T02:00:02.439797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973534+0000","last_change":"2023-07-29T01:59:53.172039+0000","last_active":"2023-07-29T02:00:01.973534+0000","last_peered":"2023-07-29T02:00:01.973534+0000","last_clean":"2023-07-29T02:00:01.973534+0000","last_became_active":"2023-07-29T01:59:53.171617+0000","last_became_peered":"2023-07-29T01:59:53.171617+0000","last_unstale":"2023-07-29T02:00:01.973534+0000","last_undegraded":"2023-07-29T02:00:01.973534+0000","last_fullsized":"2023-07-29T02:00:01.973534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976735+0000","last_change":"2023-07-29T01:59:57.540888+0000","last_active":"2023-07-29T02:00:01.976735+0000","last_peered":"2023-07-29T02:00:01.976735+0000","last_clean":"2023-07-29T02:00:01.976735+0000","last_became_active":"2023-07-29T01:59:57.540449+0000","last_became_peered":"2023-07-29T01:59:57.540449+0000","last_unstale":"2023-07-29T02:00:01.976735+0000","last_undegraded":"2023-07-29T02:00:01.976735+0000","last_fullsized":"2023-07-29T02:00:01.976735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974278+0000","last_change":"2023-07-29T01:59:57.968216+0000","last_active":"2023-07-29T02:00:01.974278+0000","last_peered":"2023-07-29T02:00:01.974278+0000","last_clean":"2023-07-29T02:00:01.974278+0000","last_became_active":"2023-07-29T01:59:57.967933+0000","last_became_peered":"2023-07-29T01:59:57.967933+0000","last_unstale":"2023-07-29T02:00:01.974278+0000","last_undegraded":"2023-07-29T02:00:01.974278+0000","last_fullsized":"2023-07-29T02:00:01.974278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439338+0000","last_change":"2023-07-29T02:00:01.985121+0000","last_active":"2023-07-29T02:00:02.439338+0000","last_peered":"2023-07-29T02:00:02.439338+0000","last_clean":"2023-07-29T02:00:02.439338+0000","last_became_active":"2023-07-29T02:00:01.984691+0000","last_became_peered":"2023-07-29T02:00:01.984691+0000","last_unstale":"2023-07-29T02:00:02.439338+0000","last_undegraded":"2023-07-29T02:00:02.439338+0000","last_fullsized":"2023-07-29T02:00:02.439338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:54.400954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967930+0000","last_change":"2023-07-29T01:59:53.171808+0000","last_active":"2023-07-29T02:00:01.967930+0000","last_peered":"2023-07-29T02:00:01.967930+0000","last_clean":"2023-07-29T02:00:01.967930+0000","last_became_active":"2023-07-29T01:59:53.171463+0000","last_became_peered":"2023-07-29T01:59:53.171463+0000","last_unstale":"2023-07-29T02:00:01.967930+0000","last_undegraded":"2023-07-29T02:00:01.967930+0000","last_fullsized":"2023-07-29T02:00:01.967930+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:07:59.559814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973914+0000","last_change":"2023-07-29T01:59:57.549468+0000","last_active":"2023-07-29T02:00:01.973914+0000","last_peered":"2023-07-29T02:00:01.973914+0000","last_clean":"2023-07-29T02:00:01.973914+0000","last_became_active":"2023-07-29T01:59:57.549181+0000","last_became_peered":"2023-07-29T01:59:57.549181+0000","last_unstale":"2023-07-29T02:00:01.973914+0000","last_undegraded":"2023-07-29T02:00:01.973914+0000","last_fullsized":"2023-07-29T02:00:01.973914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966982+0000","last_change":"2023-07-29T01:59:57.963908+0000","last_active":"2023-07-29T02:00:01.966982+0000","last_peered":"2023-07-29T02:00:01.966982+0000","last_clean":"2023-07-29T02:00:01.966982+0000","last_became_active":"2023-07-29T01:59:57.963659+0000","last_became_peered":"2023-07-29T01:59:57.963659+0000","last_unstale":"2023-07-29T02:00:01.966982+0000","last_undegraded":"2023-07-29T02:00:01.966982+0000","last_fullsized":"2023-07-29T02:00:01.966982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440428+0000","last_change":"2023-07-29T02:00:01.984197+0000","last_active":"2023-07-29T02:00:02.440428+0000","last_peered":"2023-07-29T02:00:02.440428+0000","last_clean":"2023-07-29T02:00:02.440428+0000","last_became_active":"2023-07-29T02:00:01.983744+0000","last_became_peered":"2023-07-29T02:00:01.983744+0000","last_unstale":"2023-07-29T02:00:02.440428+0000","last_undegraded":"2023-07-29T02:00:02.440428+0000","last_fullsized":"2023-07-29T02:00:02.440428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968731+0000","last_change":"2023-07-29T01:59:52.449102+0000","last_active":"2023-07-29T02:00:01.968731+0000","last_peered":"2023-07-29T02:00:01.968731+0000","last_clean":"2023-07-29T02:00:01.968731+0000","last_became_active":"2023-07-29T01:59:52.448814+0000","last_became_peered":"2023-07-29T01:59:52.448814+0000","last_unstale":"2023-07-29T02:00:01.968731+0000","last_undegraded":"2023-07-29T02:00:01.968731+0000","last_fullsized":"2023-07-29T02:00:01.968731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977814+0000","last_change":"2023-07-29T01:59:57.544590+0000","last_active":"2023-07-29T02:00:01.977814+0000","last_peered":"2023-07-29T02:00:01.977814+0000","last_clean":"2023-07-29T02:00:01.977814+0000","last_became_active":"2023-07-29T01:59:57.544317+0000","last_became_peered":"2023-07-29T01:59:57.544317+0000","last_unstale":"2023-07-29T02:00:01.977814+0000","last_undegraded":"2023-07-29T02:00:01.977814+0000","last_fullsized":"2023-07-29T02:00:01.977814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971685+0000","last_change":"2023-07-29T01:59:57.973912+0000","last_active":"2023-07-29T02:00:01.971685+0000","last_peered":"2023-07-29T02:00:01.971685+0000","last_clean":"2023-07-29T02:00:01.971685+0000","last_became_active":"2023-07-29T01:59:57.969642+0000","last_became_peered":"2023-07-29T01:59:57.969642+0000","last_unstale":"2023-07-29T02:00:01.971685+0000","last_undegraded":"2023-07-29T02:00:01.971685+0000","last_fullsized":"2023-07-29T02:00:01.971685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440741+0000","last_change":"2023-07-29T02:00:01.999117+0000","last_active":"2023-07-29T02:00:02.440741+0000","last_peered":"2023-07-29T02:00:02.440741+0000","last_clean":"2023-07-29T02:00:02.440741+0000","last_became_active":"2023-07-29T02:00:01.998715+0000","last_became_peered":"2023-07-29T02:00:01.998715+0000","last_unstale":"2023-07-29T02:00:02.440741+0000","last_undegraded":"2023-07-29T02:00:02.440741+0000","last_fullsized":"2023-07-29T02:00:02.440741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440569+0000","last_change":"2023-07-29T01:59:57.545933+0000","last_active":"2023-07-29T02:00:02.440569+0000","last_peered":"2023-07-29T02:00:02.440569+0000","last_clean":"2023-07-29T02:00:02.440569+0000","last_became_active":"2023-07-29T01:59:57.545744+0000","last_became_peered":"2023-07-29T01:59:57.545744+0000","last_unstale":"2023-07-29T02:00:02.440569+0000","last_undegraded":"2023-07-29T02:00:02.440569+0000","last_fullsized":"2023-07-29T02:00:02.440569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972541+0000","last_change":"2023-07-29T01:59:57.970577+0000","last_active":"2023-07-29T02:00:01.972541+0000","last_peered":"2023-07-29T02:00:01.972541+0000","last_clean":"2023-07-29T02:00:01.972541+0000","last_became_active":"2023-07-29T01:59:57.970252+0000","last_became_peered":"2023-07-29T01:59:57.970252+0000","last_unstale":"2023-07-29T02:00:01.972541+0000","last_undegraded":"2023-07-29T02:00:01.972541+0000","last_fullsized":"2023-07-29T02:00:01.972541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:09.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399784+0000","last_change":"2023-07-29T02:00:01.989885+0000","last_active":"2023-07-29T02:00:02.399784+0000","last_peered":"2023-07-29T02:00:02.399784+0000","last_clean":"2023-07-29T02:00:02.399784+0000","last_became_active":"2023-07-29T02:00:01.989481+0000","last_became_peered":"2023-07-29T02:00:01.989481+0000","last_unstale":"2023-07-29T02:00:02.399784+0000","last_undegraded":"2023-07-29T02:00:02.399784+0000","last_fullsized":"2023-07-29T02:00:02.399784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957691+0000","last_change":"2023-07-29T01:59:57.543782+0000","last_active":"2023-07-29T02:00:02.957691+0000","last_peered":"2023-07-29T02:00:02.957691+0000","last_clean":"2023-07-29T02:00:02.957691+0000","last_became_active":"2023-07-29T01:59:57.543445+0000","last_became_peered":"2023-07-29T01:59:57.543445+0000","last_unstale":"2023-07-29T02:00:02.957691+0000","last_undegraded":"2023-07-29T02:00:02.957691+0000","last_fullsized":"2023-07-29T02:00:02.957691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.970956+0000","last_change":"2023-07-29T01:59:57.965177+0000","last_active":"2023-07-29T02:00:01.970956+0000","last_peered":"2023-07-29T02:00:01.970956+0000","last_clean":"2023-07-29T02:00:01.970956+0000","last_became_active":"2023-07-29T01:59:57.964925+0000","last_became_peered":"2023-07-29T01:59:57.964925+0000","last_unstale":"2023-07-29T02:00:01.970956+0000","last_undegraded":"2023-07-29T02:00:01.970956+0000","last_fullsized":"2023-07-29T02:00:01.970956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401320+0000","last_change":"2023-07-29T02:00:01.985786+0000","last_active":"2023-07-29T02:00:02.401320+0000","last_peered":"2023-07-29T02:00:02.401320+0000","last_clean":"2023-07-29T02:00:02.401320+0000","last_became_active":"2023-07-29T02:00:01.985310+0000","last_became_peered":"2023-07-29T02:00:01.985310+0000","last_unstale":"2023-07-29T02:00:02.401320+0000","last_undegraded":"2023-07-29T02:00:02.401320+0000","last_fullsized":"2023-07-29T02:00:02.401320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957725+0000","last_change":"2023-07-29T01:59:57.541908+0000","last_active":"2023-07-29T02:00:02.957725+0000","last_peered":"2023-07-29T02:00:02.957725+0000","last_clean":"2023-07-29T02:00:02.957725+0000","last_became_active":"2023-07-29T01:59:57.541633+0000","last_became_peered":"2023-07-29T01:59:57.541633+0000","last_unstale":"2023-07-29T02:00:02.957725+0000","last_undegraded":"2023-07-29T02:00:02.957725+0000","last_fullsized":"2023-07-29T02:00:02.957725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.970785+0000","last_change":"2023-07-29T01:59:57.965915+0000","last_active":"2023-07-29T02:00:01.970785+0000","last_peered":"2023-07-29T02:00:01.970785+0000","last_clean":"2023-07-29T02:00:01.970785+0000","last_became_active":"2023-07-29T01:59:57.965383+0000","last_became_peered":"2023-07-29T01:59:57.965383+0000","last_unstale":"2023-07-29T02:00:01.970785+0000","last_undegraded":"2023-07-29T02:00:01.970785+0000","last_fullsized":"2023-07-29T02:00:01.970785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.398445+0000","last_change":"2023-07-29T02:00:01.994436+0000","last_active":"2023-07-29T02:00:02.398445+0000","last_peered":"2023-07-29T02:00:02.398445+0000","last_clean":"2023-07-29T02:00:02.398445+0000","last_became_active":"2023-07-29T02:00:01.993454+0000","last_became_peered":"2023-07-29T02:00:01.993454+0000","last_unstale":"2023-07-29T02:00:02.398445+0000","last_undegraded":"2023-07-29T02:00:02.398445+0000","last_fullsized":"2023-07-29T02:00:02.398445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:46.998657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441131+0000","last_change":"2023-07-29T01:59:57.539625+0000","last_active":"2023-07-29T02:00:02.441131+0000","last_peered":"2023-07-29T02:00:02.441131+0000","last_clean":"2023-07-29T02:00:02.441131+0000","last_became_active":"2023-07-29T01:59:57.539181+0000","last_became_peered":"2023-07-29T01:59:57.539181+0000","last_unstale":"2023-07-29T02:00:02.441131+0000","last_undegraded":"2023-07-29T02:00:02.441131+0000","last_fullsized":"2023-07-29T02:00:02.441131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:02:57.137574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979518+0000","last_change":"2023-07-29T01:59:57.966812+0000","last_active":"2023-07-29T02:00:01.979518+0000","last_peered":"2023-07-29T02:00:01.979518+0000","last_clean":"2023-07-29T02:00:01.979518+0000","last_became_active":"2023-07-29T01:59:57.966580+0000","last_became_peered":"2023-07-29T01:59:57.966580+0000","last_unstale":"2023-07-29T02:00:01.979518+0000","last_undegraded":"2023-07-29T02:00:01.979518+0000","last_fullsized":"2023-07-29T02:00:01.979518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.203628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439475+0000","last_change":"2023-07-29T02:00:01.985984+0000","last_active":"2023-07-29T02:00:02.439475+0000","last_peered":"2023-07-29T02:00:02.439475+0000","last_clean":"2023-07-29T02:00:02.439475+0000","last_became_active":"2023-07-29T02:00:01.985554+0000","last_became_peered":"2023-07-29T02:00:01.985554+0000","last_unstale":"2023-07-29T02:00:02.439475+0000","last_undegraded":"2023-07-29T02:00:02.439475+0000","last_fullsized":"2023-07-29T02:00:02.439475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:50:50.164635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957483+0000","last_change":"2023-07-29T01:59:57.537754+0000","last_active":"2023-07-29T02:00:02.957483+0000","last_peered":"2023-07-29T02:00:02.957483+0000","last_clean":"2023-07-29T02:00:02.957483+0000","last_became_active":"2023-07-29T01:59:57.537457+0000","last_became_peered":"2023-07-29T01:59:57.537457+0000","last_unstale":"2023-07-29T02:00:02.957483+0000","last_undegraded":"2023-07-29T02:00:02.957483+0000","last_fullsized":"2023-07-29T02:00:02.957483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975481+0000","last_change":"2023-07-29T01:59:57.960633+0000","last_active":"2023-07-29T02:00:01.975481+0000","last_peered":"2023-07-29T02:00:01.975481+0000","last_clean":"2023-07-29T02:00:01.975481+0000","last_became_active":"2023-07-29T01:59:57.960318+0000","last_became_peered":"2023-07-29T01:59:57.960318+0000","last_unstale":"2023-07-29T02:00:01.975481+0000","last_undegraded":"2023-07-29T02:00:01.975481+0000","last_fullsized":"2023-07-29T02:00:01.975481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:01:11.408184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967878+0000","last_change":"2023-07-29T01:59:57.960826+0000","last_active":"2023-07-29T02:00:01.967878+0000","last_peered":"2023-07-29T02:00:01.967878+0000","last_clean":"2023-07-29T02:00:01.967878+0000","last_became_active":"2023-07-29T01:59:57.959960+0000","last_became_peered":"2023-07-29T01:59:57.959960+0000","last_unstale":"2023-07-29T02:00:01.967878+0000","last_undegraded":"2023-07-29T02:00:01.967878+0000","last_fullsized":"2023-07-29T02:00:01.967878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979718+0000","last_change":"2023-07-29T01:59:57.976560+0000","last_active":"2023-07-29T02:00:01.979718+0000","last_peered":"2023-07-29T02:00:01.979718+0000","last_clean":"2023-07-29T02:00:01.979718+0000","last_became_active":"2023-07-29T01:59:57.975384+0000","last_became_peered":"2023-07-29T01:59:57.975384+0000","last_unstale":"2023-07-29T02:00:01.979718+0000","last_undegraded":"2023-07-29T02:00:01.979718+0000","last_fullsized":"2023-07-29T02:00:01.979718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971237+0000","last_change":"2023-07-29T01:59:57.967891+0000","last_active":"2023-07-29T02:00:01.971237+0000","last_peered":"2023-07-29T02:00:01.971237+0000","last_clean":"2023-07-29T02:00:01.971237+0000","last_became_active":"2023-07-29T01:59:57.967603+0000","last_became_peered":"2023-07-29T01:59:57.967603+0000","last_unstale":"2023-07-29T02:00:01.971237+0000","last_undegraded":"2023-07-29T02:00:01.971237+0000","last_fullsized":"2023-07-29T02:00:01.971237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:24:00.439433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978571+0000","last_change":"2023-07-29T01:59:57.966922+0000","last_active":"2023-07-29T02:00:01.978571+0000","last_peered":"2023-07-29T02:00:01.978571+0000","last_clean":"2023-07-29T02:00:01.978571+0000","last_became_active":"2023-07-29T01:59:57.966672+0000","last_became_peered":"2023-07-29T01:59:57.966672+0000","last_unstale":"2023-07-29T02:00:01.978571+0000","last_undegraded":"2023-07-29T02:00:01.978571+0000","last_fullsized":"2023-07-29T02:00:01.978571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972636+0000","last_change":"2023-07-29T01:59:57.968727+0000","last_active":"2023-07-29T02:00:01.972636+0000","last_peered":"2023-07-29T02:00:01.972636+0000","last_clean":"2023-07-29T02:00:01.972636+0000","last_became_active":"2023-07-29T01:59:57.968449+0000","last_became_peered":"2023-07-29T01:59:57.968449+0000","last_unstale":"2023-07-29T02:00:01.972636+0000","last_undegraded":"2023-07-29T02:00:01.972636+0000","last_fullsized":"2023-07-29T02:00:01.972636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4589,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":703776,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":331776,"data_stored":699769,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":109983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":108530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":113248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":110053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T02:00:32.391 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T02:00:32.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.561+0000 7f320cbd2700 1 Processor -- start 2023-07-29T02:00:32.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.561+0000 7f320cbd2700 1 -- start start 2023-07-29T02:00:32.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.562+0000 7f320cbd2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3208153480 0x7f32080707d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.562+0000 7f320cbd2700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f32080c66d0 0x7f3208070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.562+0000 7f320cbd2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f32080c5f50 0x7f32080c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.562+0000 7f320cbd2700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32080c7210 con 0x7f32080c66d0 2023-07-29T02:00:32.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.562+0000 7f320cbd2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3208072bb0 con 0x7f32080c5f50 2023-07-29T02:00:32.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.562+0000 7f320cbd2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3208072940 con 0x7f3208153480 2023-07-29T02:00:32.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.562+0000 7f3205d9b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f32080c66d0 0x7f3208070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.562+0000 7f3205d9b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f32080c66d0 0x7f3208070d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56574/0 (socket says 172.21.15.42:56574) 2023-07-29T02:00:32.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.562+0000 7f3205d9b700 1 -- 172.21.15.42:0/4126773900 learned_addr learned my addr 172.21.15.42:0/4126773900 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:32.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.562+0000 7f3206d9d700 1 --2- 172.21.15.42:0/4126773900 >> v2:172.21.15.144:3300/0 conn(0x7f32080c5f50 0x7f32080c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.562+0000 7f320659c700 1 --2- 172.21.15.42:0/4126773900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3208153480 0x7f32080707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.562+0000 7f3205d9b700 1 -- 172.21.15.42:0/4126773900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3208153480 msgr2=0x7f32080707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:32.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.562+0000 7f3205d9b700 1 --2- 172.21.15.42:0/4126773900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3208153480 0x7f32080707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.562+0000 7f3205d9b700 1 -- 172.21.15.42:0/4126773900 >> v2:172.21.15.144:3300/0 conn(0x7f32080c5f50 msgr2=0x7f32080c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:32.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.562+0000 7f3205d9b700 1 --2- 172.21.15.42:0/4126773900 >> v2:172.21.15.144:3300/0 conn(0x7f32080c5f50 0x7f32080c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.562+0000 7f3205d9b700 1 -- 172.21.15.42:0/4126773900 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3208153850 con 0x7f32080c66d0 2023-07-29T02:00:32.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.562+0000 7f320659c700 1 --2- 172.21.15.42:0/4126773900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3208153480 0x7f32080707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:32.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.562+0000 7f3206d9d700 1 --2- 172.21.15.42:0/4126773900 >> v2:172.21.15.144:3300/0 conn(0x7f32080c5f50 0x7f32080c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:32.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.563+0000 7f3205d9b700 1 --2- 172.21.15.42:0/4126773900 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32080c66d0 0x7f3208070d10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f320806ff90 tx=0x7f31f8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32a2bcf3e9f51fc server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:32.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.563+0000 7f320559a700 1 -- 172.21.15.42:0/4126773900 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f800b870 con 0x7f32080c66d0 2023-07-29T02:00:32.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.563+0000 7f320559a700 1 -- 172.21.15.42:0/4126773900 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f800b9d0 con 0x7f32080c66d0 2023-07-29T02:00:32.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.563+0000 7f320559a700 1 -- 172.21.15.42:0/4126773900 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f800bd60 con 0x7f32080c66d0 2023-07-29T02:00:32.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.563+0000 7f320cbd2700 1 -- 172.21.15.42:0/4126773900 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32080c66d0 msgr2=0x7f3208070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:32.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.563+0000 7f320cbd2700 1 --2- 172.21.15.42:0/4126773900 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32080c66d0 0x7f3208070d10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f320806ff90 tx=0x7f31f8009bd0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.563+0000 7f320cbd2700 1 -- 172.21.15.42:0/4126773900 shutdown_connections 2023-07-29T02:00:32.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.563+0000 7f320cbd2700 1 --2- 172.21.15.42:0/4126773900 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3208153480 0x7f32080707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.563+0000 7f320cbd2700 1 --2- 172.21.15.42:0/4126773900 >> v2:172.21.15.144:3300/0 conn(0x7f32080c5f50 0x7f32080c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.563+0000 7f320cbd2700 1 --2- 172.21.15.42:0/4126773900 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32080c66d0 0x7f3208070d10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.563+0000 7f320cbd2700 1 -- 172.21.15.42:0/4126773900 >> 172.21.15.42:0/4126773900 conn(0x7f32080cc360 msgr2=0x7f32080c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:32.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.563+0000 7f320cbd2700 1 -- 172.21.15.42:0/4126773900 shutdown_connections 2023-07-29T02:00:32.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.563+0000 7f320cbd2700 1 -- 172.21.15.42:0/4126773900 wait complete. 2023-07-29T02:00:32.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.565+0000 7f320cbd2700 1 Processor -- start 2023-07-29T02:00:32.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.565+0000 7f320cbd2700 1 -- start start 2023-07-29T02:00:32.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.565+0000 7f320cbd2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32080c5f50 0x7f320814e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.565+0000 7f320cbd2700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32080c66d0 0x7f32081f1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.565+0000 7f320cbd2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3208153480 0x7f320814f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.566+0000 7f320cbd2700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32081eeb70 con 0x7f32080c66d0 2023-07-29T02:00:32.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.566+0000 7f320cbd2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32080c17e0 con 0x7f3208153480 2023-07-29T02:00:32.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.566+0000 7f320cbd2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32081ee2c0 con 0x7f32080c5f50 2023-07-29T02:00:32.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.566+0000 7f3205d9b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32080c66d0 0x7f32081f1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.566+0000 7f3205d9b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32080c66d0 0x7f32081f1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56580/0 (socket says 172.21.15.42:56580) 2023-07-29T02:00:32.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.566+0000 7f3205d9b700 1 -- 172.21.15.42:0/672447017 learned_addr learned my addr 172.21.15.42:0/672447017 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:32.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.566+0000 7f3206d9d700 1 --2- 172.21.15.42:0/672447017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3208153480 0x7f320814f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.566+0000 7f320659c700 1 --2- 172.21.15.42:0/672447017 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32080c5f50 0x7f320814e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.566+0000 7f3205d9b700 1 -- 172.21.15.42:0/672447017 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32080c5f50 msgr2=0x7f320814e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:32.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.566+0000 7f3205d9b700 1 --2- 172.21.15.42:0/672447017 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32080c5f50 0x7f320814e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.566+0000 7f3205d9b700 1 -- 172.21.15.42:0/672447017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3208153480 msgr2=0x7f320814f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:32.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.566+0000 7f3205d9b700 1 --2- 172.21.15.42:0/672447017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3208153480 0x7f320814f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.566+0000 7f3205d9b700 1 -- 172.21.15.42:0/672447017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f8009550 con 0x7f32080c66d0 2023-07-29T02:00:32.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.566+0000 7f3206d9d700 1 --2- 172.21.15.42:0/672447017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3208153480 0x7f320814f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:32.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.566+0000 7f3205d9b700 1 --2- 172.21.15.42:0/672447017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32080c66d0 0x7f32081f1830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f31f8013000 tx=0x7f31f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:32.561 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.566+0000 7f31f6ffd700 1 -- 172.21.15.42:0/672447017 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f8004310 con 0x7f32080c66d0 2023-07-29T02:00:32.561 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.566+0000 7f31f6ffd700 1 -- 172.21.15.42:0/672447017 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f801f070 con 0x7f32080c66d0 2023-07-29T02:00:32.561 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.566+0000 7f320cbd2700 1 -- 172.21.15.42:0/672447017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32081f1d70 con 0x7f32080c66d0 2023-07-29T02:00:32.561 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.566+0000 7f31f6ffd700 1 -- 172.21.15.42:0/672447017 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f80036a0 con 0x7f32080c66d0 2023-07-29T02:00:32.561 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.566+0000 7f320cbd2700 1 -- 172.21.15.42:0/672447017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320814e5c0 con 0x7f32080c66d0 2023-07-29T02:00:32.561 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.567+0000 7f320cbd2700 1 -- 172.21.15.42:0/672447017 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32081eecb0 con 0x7f32080c66d0 2023-07-29T02:00:32.561 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.568+0000 7f31f6ffd700 1 -- 172.21.15.42:0/672447017 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f31f8021030 con 0x7f32080c66d0 2023-07-29T02:00:32.562 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.568+0000 7f31f6ffd700 1 --2- 172.21.15.42:0/672447017 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f31e806a690 0x7f31e806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.562 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.568+0000 7f31f6ffd700 1 -- 172.21.15.42:0/672447017 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f31f808a130 con 0x7f32080c66d0 2023-07-29T02:00:32.562 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.568+0000 7f320659c700 1 --2- 172.21.15.42:0/672447017 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f31e806a690 0x7f31e806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.562 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.569+0000 7f320659c700 1 --2- 172.21.15.42:0/672447017 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f31e806a690 0x7f31e806cb40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f31fc006fd0 tx=0x7f31fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:32.563 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.573+0000 7f31f6ffd700 1 -- 172.21.15.42:0/672447017 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f32081eecb0 con 0x7f32080c66d0 2023-07-29T02:00:32.759 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.770+0000 7f320cbd2700 1 -- 172.21.15.42:0/672447017 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3208159c90 con 0x7f31e806a690 2023-07-29T02:00:32.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.781+0000 7f31f6ffd700 1 -- 172.21.15.42:0/672447017 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367571 (secure 0 0 0) 0x7f31fc00c050 con 0x7f31e806a690 2023-07-29T02:00:32.773 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:32.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.784+0000 7f320cbd2700 1 -- 172.21.15.42:0/672447017 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f31e806a690 msgr2=0x7f31e806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:32.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.784+0000 7f320cbd2700 1 --2- 172.21.15.42:0/672447017 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f31e806a690 0x7f31e806cb40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f31fc006fd0 tx=0x7f31fc008040 comp rx=0 tx=0).stop 2023-07-29T02:00:32.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.785+0000 7f320cbd2700 1 -- 172.21.15.42:0/672447017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32080c66d0 msgr2=0x7f32081f1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:32.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.785+0000 7f320cbd2700 1 --2- 172.21.15.42:0/672447017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32080c66d0 0x7f32081f1830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f31f8013000 tx=0x7f31f8004750 comp rx=0 tx=0).stop 2023-07-29T02:00:32.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.785+0000 7f320cbd2700 1 -- 172.21.15.42:0/672447017 shutdown_connections 2023-07-29T02:00:32.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.785+0000 7f320cbd2700 1 --2- 172.21.15.42:0/672447017 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f31e806a690 0x7f31e806cb40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.785+0000 7f320cbd2700 1 --2- 172.21.15.42:0/672447017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3208153480 0x7f320814f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.785+0000 7f320cbd2700 1 --2- 172.21.15.42:0/672447017 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f32080c5f50 0x7f320814e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.785+0000 7f320cbd2700 1 --2- 172.21.15.42:0/672447017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f32080c66d0 0x7f32081f1830 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.785+0000 7f320cbd2700 1 -- 172.21.15.42:0/672447017 >> 172.21.15.42:0/672447017 conn(0x7f32080cc360 msgr2=0x7f32080bcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:32.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.785+0000 7f320cbd2700 1 -- 172.21.15.42:0/672447017 shutdown_connections 2023-07-29T02:00:32.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.785+0000 7f320cbd2700 1 -- 172.21.15.42:0/672447017 wait complete. 2023-07-29T02:00:32.778 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2023-07-29T02:00:32.785 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-07-29T02:00:31.239642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594957,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217884,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756836,"statfs":{"total":773094113280,"available":772871000064,"internally_reserved":0,"allocated":2322432,"data_stored":2064161,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003327"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972736+0000","last_change":"2023-07-29T01:59:57.958129+0000","last_active":"2023-07-29T02:00:01.972736+0000","last_peered":"2023-07-29T02:00:01.972736+0000","last_clean":"2023-07-29T02:00:01.972736+0000","last_became_active":"2023-07-29T01:59:57.957742+0000","last_became_peered":"2023-07-29T01:59:57.957742+0000","last_unstale":"2023-07-29T02:00:01.972736+0000","last_undegraded":"2023-07-29T02:00:01.972736+0000","last_fullsized":"2023-07-29T02:00:01.972736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:32.550358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975520+0000","last_change":"2023-07-29T01:59:57.974652+0000","last_active":"2023-07-29T02:00:01.975520+0000","last_peered":"2023-07-29T02:00:01.975520+0000","last_clean":"2023-07-29T02:00:01.975520+0000","last_became_active":"2023-07-29T01:59:57.974338+0000","last_became_peered":"2023-07-29T01:59:57.974338+0000","last_unstale":"2023-07-29T02:00:01.975520+0000","last_undegraded":"2023-07-29T02:00:01.975520+0000","last_fullsized":"2023-07-29T02:00:01.975520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978265+0000","last_change":"2023-07-29T01:59:57.973621+0000","last_active":"2023-07-29T02:00:01.978265+0000","last_peered":"2023-07-29T02:00:01.978265+0000","last_clean":"2023-07-29T02:00:01.978265+0000","last_became_active":"2023-07-29T01:59:57.973406+0000","last_became_peered":"2023-07-29T01:59:57.973406+0000","last_unstale":"2023-07-29T02:00:01.978265+0000","last_undegraded":"2023-07-29T02:00:01.978265+0000","last_fullsized":"2023-07-29T02:00:01.978265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:08:23.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968045+0000","last_change":"2023-07-29T01:59:57.965192+0000","last_active":"2023-07-29T02:00:01.968045+0000","last_peered":"2023-07-29T02:00:01.968045+0000","last_clean":"2023-07-29T02:00:01.968045+0000","last_became_active":"2023-07-29T01:59:57.964865+0000","last_became_peered":"2023-07-29T01:59:57.964865+0000","last_unstale":"2023-07-29T02:00:01.968045+0000","last_undegraded":"2023-07-29T02:00:01.968045+0000","last_fullsized":"2023-07-29T02:00:01.968045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:32.905717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967106+0000","last_change":"2023-07-29T01:59:57.971026+0000","last_active":"2023-07-29T02:00:01.967106+0000","last_peered":"2023-07-29T02:00:01.967106+0000","last_clean":"2023-07-29T02:00:01.967106+0000","last_became_active":"2023-07-29T01:59:57.970733+0000","last_became_peered":"2023-07-29T01:59:57.970733+0000","last_unstale":"2023-07-29T02:00:01.967106+0000","last_undegraded":"2023-07-29T02:00:01.967106+0000","last_fullsized":"2023-07-29T02:00:01.967106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971129+0000","last_change":"2023-07-29T01:59:57.965729+0000","last_active":"2023-07-29T02:00:01.971129+0000","last_peered":"2023-07-29T02:00:01.971129+0000","last_clean":"2023-07-29T02:00:01.971129+0000","last_became_active":"2023-07-29T01:59:57.964993+0000","last_became_peered":"2023-07-29T01:59:57.964993+0000","last_unstale":"2023-07-29T02:00:01.971129+0000","last_undegraded":"2023-07-29T02:00:01.971129+0000","last_fullsized":"2023-07-29T02:00:01.971129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974411+0000","last_change":"2023-07-29T01:59:57.970481+0000","last_active":"2023-07-29T02:00:01.974411+0000","last_peered":"2023-07-29T02:00:01.974411+0000","last_clean":"2023-07-29T02:00:01.974411+0000","last_became_active":"2023-07-29T01:59:57.970232+0000","last_became_peered":"2023-07-29T01:59:57.970232+0000","last_unstale":"2023-07-29T02:00:01.974411+0000","last_undegraded":"2023-07-29T02:00:01.974411+0000","last_fullsized":"2023-07-29T02:00:01.974411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974000+0000","last_change":"2023-07-29T01:59:57.963201+0000","last_active":"2023-07-29T02:00:01.974000+0000","last_peered":"2023-07-29T02:00:01.974000+0000","last_clean":"2023-07-29T02:00:01.974000+0000","last_became_active":"2023-07-29T01:59:57.962884+0000","last_became_peered":"2023-07-29T01:59:57.962884+0000","last_unstale":"2023-07-29T02:00:01.974000+0000","last_undegraded":"2023-07-29T02:00:01.974000+0000","last_fullsized":"2023-07-29T02:00:01.974000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967238+0000","last_change":"2023-07-29T01:59:57.971916+0000","last_active":"2023-07-29T02:00:01.967238+0000","last_peered":"2023-07-29T02:00:01.967238+0000","last_clean":"2023-07-29T02:00:01.967238+0000","last_became_active":"2023-07-29T01:59:57.971640+0000","last_became_peered":"2023-07-29T01:59:57.971640+0000","last_unstale":"2023-07-29T02:00:01.967238+0000","last_undegraded":"2023-07-29T02:00:01.967238+0000","last_fullsized":"2023-07-29T02:00:01.967238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975619+0000","last_change":"2023-07-29T01:59:57.963080+0000","last_active":"2023-07-29T02:00:01.975619+0000","last_peered":"2023-07-29T02:00:01.975619+0000","last_clean":"2023-07-29T02:00:01.975619+0000","last_became_active":"2023-07-29T01:59:57.962799+0000","last_became_peered":"2023-07-29T01:59:57.962799+0000","last_unstale":"2023-07-29T02:00:01.975619+0000","last_undegraded":"2023-07-29T02:00:01.975619+0000","last_fullsized":"2023-07-29T02:00:01.975619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978173+0000","last_change":"2023-07-29T01:59:57.970172+0000","last_active":"2023-07-29T02:00:01.978173+0000","last_peered":"2023-07-29T02:00:01.978173+0000","last_clean":"2023-07-29T02:00:01.978173+0000","last_became_active":"2023-07-29T01:59:57.969868+0000","last_became_peered":"2023-07-29T01:59:57.969868+0000","last_unstale":"2023-07-29T02:00:01.978173+0000","last_undegraded":"2023-07-29T02:00:01.978173+0000","last_fullsized":"2023-07-29T02:00:01.978173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972765+0000","last_change":"2023-07-29T01:59:57.964171+0000","last_active":"2023-07-29T02:00:01.972765+0000","last_peered":"2023-07-29T02:00:01.972765+0000","last_clean":"2023-07-29T02:00:01.972765+0000","last_became_active":"2023-07-29T01:59:57.963902+0000","last_became_peered":"2023-07-29T01:59:57.963902+0000","last_unstale":"2023-07-29T02:00:01.972765+0000","last_undegraded":"2023-07-29T02:00:01.972765+0000","last_fullsized":"2023-07-29T02:00:01.972765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:51.691001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972884+0000","last_change":"2023-07-29T01:59:57.963492+0000","last_active":"2023-07-29T02:00:01.972884+0000","last_peered":"2023-07-29T02:00:01.972884+0000","last_clean":"2023-07-29T02:00:01.972884+0000","last_became_active":"2023-07-29T01:59:57.963239+0000","last_became_peered":"2023-07-29T01:59:57.963239+0000","last_unstale":"2023-07-29T02:00:01.972884+0000","last_undegraded":"2023-07-29T02:00:01.972884+0000","last_fullsized":"2023-07-29T02:00:01.972884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:08.001986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974742+0000","last_change":"2023-07-29T01:59:57.961369+0000","last_active":"2023-07-29T02:00:01.974742+0000","last_peered":"2023-07-29T02:00:01.974742+0000","last_clean":"2023-07-29T02:00:01.974742+0000","last_became_active":"2023-07-29T01:59:57.960709+0000","last_became_peered":"2023-07-29T01:59:57.960709+0000","last_unstale":"2023-07-29T02:00:01.974742+0000","last_undegraded":"2023-07-29T02:00:01.974742+0000","last_fullsized":"2023-07-29T02:00:01.974742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974229+0000","last_change":"2023-07-29T01:59:57.970498+0000","last_active":"2023-07-29T02:00:01.974229+0000","last_peered":"2023-07-29T02:00:01.974229+0000","last_clean":"2023-07-29T02:00:01.974229+0000","last_became_active":"2023-07-29T01:59:57.970263+0000","last_became_peered":"2023-07-29T01:59:57.970263+0000","last_unstale":"2023-07-29T02:00:01.974229+0000","last_undegraded":"2023-07-29T02:00:01.974229+0000","last_fullsized":"2023-07-29T02:00:01.974229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975567+0000","last_change":"2023-07-29T01:59:57.965648+0000","last_active":"2023-07-29T02:00:01.975567+0000","last_peered":"2023-07-29T02:00:01.975567+0000","last_clean":"2023-07-29T02:00:01.975567+0000","last_became_active":"2023-07-29T01:59:57.964696+0000","last_became_peered":"2023-07-29T01:59:57.964696+0000","last_unstale":"2023-07-29T02:00:01.975567+0000","last_undegraded":"2023-07-29T02:00:01.975567+0000","last_fullsized":"2023-07-29T02:00:01.975567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:19:14.641252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967346+0000","last_change":"2023-07-29T01:59:57.969148+0000","last_active":"2023-07-29T02:00:01.967346+0000","last_peered":"2023-07-29T02:00:01.967346+0000","last_clean":"2023-07-29T02:00:01.967346+0000","last_became_active":"2023-07-29T01:59:57.968885+0000","last_became_peered":"2023-07-29T01:59:57.968885+0000","last_unstale":"2023-07-29T02:00:01.967346+0000","last_undegraded":"2023-07-29T02:00:01.967346+0000","last_fullsized":"2023-07-29T02:00:01.967346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977442+0000","last_change":"2023-07-29T01:59:57.963189+0000","last_active":"2023-07-29T02:00:01.977442+0000","last_peered":"2023-07-29T02:00:01.977442+0000","last_clean":"2023-07-29T02:00:01.977442+0000","last_became_active":"2023-07-29T01:59:57.962919+0000","last_became_peered":"2023-07-29T01:59:57.962919+0000","last_unstale":"2023-07-29T02:00:01.977442+0000","last_undegraded":"2023-07-29T02:00:01.977442+0000","last_fullsized":"2023-07-29T02:00:01.977442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:16:58.718803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973218+0000","last_change":"2023-07-29T01:59:57.960380+0000","last_active":"2023-07-29T02:00:01.973218+0000","last_peered":"2023-07-29T02:00:01.973218+0000","last_clean":"2023-07-29T02:00:01.973218+0000","last_became_active":"2023-07-29T01:59:57.960111+0000","last_became_peered":"2023-07-29T01:59:57.960111+0000","last_unstale":"2023-07-29T02:00:01.973218+0000","last_undegraded":"2023-07-29T02:00:01.973218+0000","last_fullsized":"2023-07-29T02:00:01.973218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:45.956813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977046+0000","last_change":"2023-07-29T01:59:57.961945+0000","last_active":"2023-07-29T02:00:01.977046+0000","last_peered":"2023-07-29T02:00:01.977046+0000","last_clean":"2023-07-29T02:00:01.977046+0000","last_became_active":"2023-07-29T01:59:57.961655+0000","last_became_peered":"2023-07-29T01:59:57.961655+0000","last_unstale":"2023-07-29T02:00:01.977046+0000","last_undegraded":"2023-07-29T02:00:01.977046+0000","last_fullsized":"2023-07-29T02:00:01.977046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.203628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974482+0000","last_change":"2023-07-29T01:59:57.971030+0000","last_active":"2023-07-29T02:00:01.974482+0000","last_peered":"2023-07-29T02:00:01.974482+0000","last_clean":"2023-07-29T02:00:01.974482+0000","last_became_active":"2023-07-29T01:59:57.970757+0000","last_became_peered":"2023-07-29T01:59:57.970757+0000","last_unstale":"2023-07-29T02:00:01.974482+0000","last_undegraded":"2023-07-29T02:00:01.974482+0000","last_fullsized":"2023-07-29T02:00:01.974482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966509+0000","last_change":"2023-07-29T01:59:57.974734+0000","last_active":"2023-07-29T02:00:01.966509+0000","last_peered":"2023-07-29T02:00:01.966509+0000","last_clean":"2023-07-29T02:00:01.966509+0000","last_became_active":"2023-07-29T01:59:57.974436+0000","last_became_peered":"2023-07-29T01:59:57.974436+0000","last_unstale":"2023-07-29T02:00:01.966509+0000","last_undegraded":"2023-07-29T02:00:01.966509+0000","last_fullsized":"2023-07-29T02:00:01.966509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979698+0000","last_change":"2023-07-29T01:59:57.967259+0000","last_active":"2023-07-29T02:00:01.979698+0000","last_peered":"2023-07-29T02:00:01.979698+0000","last_clean":"2023-07-29T02:00:01.979698+0000","last_became_active":"2023-07-29T01:59:57.966987+0000","last_became_peered":"2023-07-29T01:59:57.966987+0000","last_unstale":"2023-07-29T02:00:01.979698+0000","last_undegraded":"2023-07-29T02:00:01.979698+0000","last_fullsized":"2023-07-29T02:00:01.979698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973494+0000","last_change":"2023-07-29T01:59:57.971976+0000","last_active":"2023-07-29T02:00:01.973494+0000","last_peered":"2023-07-29T02:00:01.973494+0000","last_clean":"2023-07-29T02:00:01.973494+0000","last_became_active":"2023-07-29T01:59:57.971733+0000","last_became_peered":"2023-07-29T01:59:57.971733+0000","last_unstale":"2023-07-29T02:00:01.973494+0000","last_undegraded":"2023-07-29T02:00:01.973494+0000","last_fullsized":"2023-07-29T02:00:01.973494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972112+0000","last_change":"2023-07-29T01:59:57.973644+0000","last_active":"2023-07-29T02:00:01.972112+0000","last_peered":"2023-07-29T02:00:01.972112+0000","last_clean":"2023-07-29T02:00:01.972112+0000","last_became_active":"2023-07-29T01:59:57.969742+0000","last_became_peered":"2023-07-29T01:59:57.969742+0000","last_unstale":"2023-07-29T02:00:01.972112+0000","last_undegraded":"2023-07-29T02:00:01.972112+0000","last_fullsized":"2023-07-29T02:00:01.972112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975642+0000","last_change":"2023-07-29T01:59:57.969779+0000","last_active":"2023-07-29T02:00:01.975642+0000","last_peered":"2023-07-29T02:00:01.975642+0000","last_clean":"2023-07-29T02:00:01.975642+0000","last_became_active":"2023-07-29T01:59:57.969409+0000","last_became_peered":"2023-07-29T01:59:57.969409+0000","last_unstale":"2023-07-29T02:00:01.975642+0000","last_undegraded":"2023-07-29T02:00:01.975642+0000","last_fullsized":"2023-07-29T02:00:01.975642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977989+0000","last_change":"2023-07-29T01:59:57.965799+0000","last_active":"2023-07-29T02:00:01.977989+0000","last_peered":"2023-07-29T02:00:01.977989+0000","last_clean":"2023-07-29T02:00:01.977989+0000","last_became_active":"2023-07-29T01:59:57.963774+0000","last_became_peered":"2023-07-29T01:59:57.963774+0000","last_unstale":"2023-07-29T02:00:01.977989+0000","last_undegraded":"2023-07-29T02:00:01.977989+0000","last_fullsized":"2023-07-29T02:00:01.977989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399488+0000","last_change":"2023-07-29T02:00:01.994114+0000","last_active":"2023-07-29T02:00:02.399488+0000","last_peered":"2023-07-29T02:00:02.399488+0000","last_clean":"2023-07-29T02:00:02.399488+0000","last_became_active":"2023-07-29T02:00:01.993731+0000","last_became_peered":"2023-07-29T02:00:01.993731+0000","last_unstale":"2023-07-29T02:00:02.399488+0000","last_undegraded":"2023-07-29T02:00:02.399488+0000","last_fullsized":"2023-07-29T02:00:02.399488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:14:25.422754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399152+0000","last_change":"2023-07-29T01:59:57.552913+0000","last_active":"2023-07-29T02:00:02.399152+0000","last_peered":"2023-07-29T02:00:02.399152+0000","last_clean":"2023-07-29T02:00:02.399152+0000","last_became_active":"2023-07-29T01:59:57.552673+0000","last_became_peered":"2023-07-29T01:59:57.552673+0000","last_unstale":"2023-07-29T02:00:02.399152+0000","last_undegraded":"2023-07-29T02:00:02.399152+0000","last_fullsized":"2023-07-29T02:00:02.399152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:49:56.335019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978862+0000","last_change":"2023-07-29T01:59:57.970140+0000","last_active":"2023-07-29T02:00:01.978862+0000","last_peered":"2023-07-29T02:00:01.978862+0000","last_clean":"2023-07-29T02:00:01.978862+0000","last_became_active":"2023-07-29T01:59:57.969821+0000","last_became_peered":"2023-07-29T01:59:57.969821+0000","last_unstale":"2023-07-29T02:00:01.978862+0000","last_undegraded":"2023-07-29T02:00:01.978862+0000","last_fullsized":"2023-07-29T02:00:01.978862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439205+0000","last_change":"2023-07-29T02:00:01.992728+0000","last_active":"2023-07-29T02:00:02.439205+0000","last_peered":"2023-07-29T02:00:02.439205+0000","last_clean":"2023-07-29T02:00:02.439205+0000","last_became_active":"2023-07-29T02:00:01.992338+0000","last_became_peered":"2023-07-29T02:00:01.992338+0000","last_unstale":"2023-07-29T02:00:02.439205+0000","last_undegraded":"2023-07-29T02:00:02.439205+0000","last_fullsized":"2023-07-29T02:00:02.439205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:37.968145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972242+0000","last_change":"2023-07-29T01:59:57.547793+0000","last_active":"2023-07-29T02:00:01.972242+0000","last_peered":"2023-07-29T02:00:01.972242+0000","last_clean":"2023-07-29T02:00:01.972242+0000","last_became_active":"2023-07-29T01:59:57.547455+0000","last_became_peered":"2023-07-29T01:59:57.547455+0000","last_unstale":"2023-07-29T02:00:01.972242+0000","last_undegraded":"2023-07-29T02:00:01.972242+0000","last_fullsized":"2023-07-29T02:00:01.972242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967048+0000","last_change":"2023-07-29T01:59:57.964646+0000","last_active":"2023-07-29T02:00:01.967048+0000","last_peered":"2023-07-29T02:00:01.967048+0000","last_clean":"2023-07-29T02:00:01.967048+0000","last_became_active":"2023-07-29T01:59:57.964393+0000","last_became_peered":"2023-07-29T01:59:57.964393+0000","last_unstale":"2023-07-29T02:00:01.967048+0000","last_undegraded":"2023-07-29T02:00:01.967048+0000","last_fullsized":"2023-07-29T02:00:01.967048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440161+0000","last_change":"2023-07-29T02:00:01.982883+0000","last_active":"2023-07-29T02:00:02.440161+0000","last_peered":"2023-07-29T02:00:02.440161+0000","last_clean":"2023-07-29T02:00:02.440161+0000","last_became_active":"2023-07-29T02:00:01.982042+0000","last_became_peered":"2023-07-29T02:00:01.982042+0000","last_unstale":"2023-07-29T02:00:02.440161+0000","last_undegraded":"2023-07-29T02:00:02.440161+0000","last_fullsized":"2023-07-29T02:00:02.440161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977952+0000","last_change":"2023-07-29T01:59:57.535286+0000","last_active":"2023-07-29T02:00:01.977952+0000","last_peered":"2023-07-29T02:00:01.977952+0000","last_clean":"2023-07-29T02:00:01.977952+0000","last_became_active":"2023-07-29T01:59:57.533523+0000","last_became_peered":"2023-07-29T01:59:57.533523+0000","last_unstale":"2023-07-29T02:00:01.977952+0000","last_undegraded":"2023-07-29T02:00:01.977952+0000","last_fullsized":"2023-07-29T02:00:01.977952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968772+0000","last_change":"2023-07-29T01:59:57.963792+0000","last_active":"2023-07-29T02:00:01.968772+0000","last_peered":"2023-07-29T02:00:01.968772+0000","last_clean":"2023-07-29T02:00:01.968772+0000","last_became_active":"2023-07-29T01:59:57.963466+0000","last_became_peered":"2023-07-29T01:59:57.963466+0000","last_unstale":"2023-07-29T02:00:01.968772+0000","last_undegraded":"2023-07-29T02:00:01.968772+0000","last_fullsized":"2023-07-29T02:00:01.968772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:28.048947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.438720+0000","last_change":"2023-07-29T02:00:01.984458+0000","last_active":"2023-07-29T02:00:02.438720+0000","last_peered":"2023-07-29T02:00:02.438720+0000","last_clean":"2023-07-29T02:00:02.438720+0000","last_became_active":"2023-07-29T02:00:01.984000+0000","last_became_peered":"2023-07-29T02:00:01.984000+0000","last_unstale":"2023-07-29T02:00:02.438720+0000","last_undegraded":"2023-07-29T02:00:02.438720+0000","last_fullsized":"2023-07-29T02:00:02.438720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967445+0000","last_change":"2023-07-29T01:59:57.537082+0000","last_active":"2023-07-29T02:00:01.967445+0000","last_peered":"2023-07-29T02:00:01.967445+0000","last_clean":"2023-07-29T02:00:01.967445+0000","last_became_active":"2023-07-29T01:59:57.536732+0000","last_became_peered":"2023-07-29T01:59:57.536732+0000","last_unstale":"2023-07-29T02:00:01.967445+0000","last_undegraded":"2023-07-29T02:00:01.967445+0000","last_fullsized":"2023-07-29T02:00:01.967445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977852+0000","last_change":"2023-07-29T01:59:57.971203+0000","last_active":"2023-07-29T02:00:01.977852+0000","last_peered":"2023-07-29T02:00:01.977852+0000","last_clean":"2023-07-29T02:00:01.977852+0000","last_became_active":"2023-07-29T01:59:57.970902+0000","last_became_peered":"2023-07-29T01:59:57.970902+0000","last_unstale":"2023-07-29T02:00:01.977852+0000","last_undegraded":"2023-07-29T02:00:01.977852+0000","last_fullsized":"2023-07-29T02:00:01.977852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399530+0000","last_change":"2023-07-29T02:00:01.991435+0000","last_active":"2023-07-29T02:00:02.399530+0000","last_peered":"2023-07-29T02:00:02.399530+0000","last_clean":"2023-07-29T02:00:02.399530+0000","last_became_active":"2023-07-29T02:00:01.989456+0000","last_became_peered":"2023-07-29T02:00:01.989456+0000","last_unstale":"2023-07-29T02:00:02.399530+0000","last_undegraded":"2023-07-29T02:00:02.399530+0000","last_fullsized":"2023-07-29T02:00:02.399530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975677+0000","last_change":"2023-07-29T01:59:57.540572+0000","last_active":"2023-07-29T02:00:01.975677+0000","last_peered":"2023-07-29T02:00:01.975677+0000","last_clean":"2023-07-29T02:00:01.975677+0000","last_became_active":"2023-07-29T01:59:57.540113+0000","last_became_peered":"2023-07-29T01:59:57.540113+0000","last_unstale":"2023-07-29T02:00:01.975677+0000","last_undegraded":"2023-07-29T02:00:01.975677+0000","last_fullsized":"2023-07-29T02:00:01.975677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979625+0000","last_change":"2023-07-29T01:59:57.967343+0000","last_active":"2023-07-29T02:00:01.979625+0000","last_peered":"2023-07-29T02:00:01.979625+0000","last_clean":"2023-07-29T02:00:01.979625+0000","last_became_active":"2023-07-29T01:59:57.967083+0000","last_became_peered":"2023-07-29T01:59:57.967083+0000","last_unstale":"2023-07-29T02:00:01.979625+0000","last_undegraded":"2023-07-29T02:00:01.979625+0000","last_fullsized":"2023-07-29T02:00:01.979625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441217+0000","last_change":"2023-07-29T02:00:01.996761+0000","last_active":"2023-07-29T02:00:02.441217+0000","last_peered":"2023-07-29T02:00:02.441217+0000","last_clean":"2023-07-29T02:00:02.441217+0000","last_became_active":"2023-07-29T02:00:01.996035+0000","last_became_peered":"2023-07-29T02:00:01.996035+0000","last_unstale":"2023-07-29T02:00:02.441217+0000","last_undegraded":"2023-07-29T02:00:02.441217+0000","last_fullsized":"2023-07-29T02:00:02.441217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"25'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958140+0000","last_change":"2023-07-29T01:59:57.548665+0000","last_active":"2023-07-29T02:00:02.958140+0000","last_peered":"2023-07-29T02:00:02.958140+0000","last_clean":"2023-07-29T02:00:02.958140+0000","last_became_active":"2023-07-29T01:59:57.547803+0000","last_became_peered":"2023-07-29T01:59:57.547803+0000","last_unstale":"2023-07-29T02:00:02.958140+0000","last_undegraded":"2023-07-29T02:00:02.958140+0000","last_fullsized":"2023-07-29T02:00:02.958140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971561+0000","last_change":"2023-07-29T01:59:57.969319+0000","last_active":"2023-07-29T02:00:01.971561+0000","last_peered":"2023-07-29T02:00:01.971561+0000","last_clean":"2023-07-29T02:00:01.971561+0000","last_became_active":"2023-07-29T01:59:57.969006+0000","last_became_peered":"2023-07-29T01:59:57.969006+0000","last_unstale":"2023-07-29T02:00:01.971561+0000","last_undegraded":"2023-07-29T02:00:01.971561+0000","last_fullsized":"2023-07-29T02:00:01.971561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:30:28.393515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440217+0000","last_change":"2023-07-29T02:00:01.996124+0000","last_active":"2023-07-29T02:00:02.440217+0000","last_peered":"2023-07-29T02:00:02.440217+0000","last_clean":"2023-07-29T02:00:02.440217+0000","last_became_active":"2023-07-29T02:00:01.995757+0000","last_became_peered":"2023-07-29T02:00:01.995757+0000","last_unstale":"2023-07-29T02:00:02.440217+0000","last_undegraded":"2023-07-29T02:00:02.440217+0000","last_fullsized":"2023-07-29T02:00:02.440217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:24:03.881006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:11.051405+0000","last_change":"2023-07-29T01:59:57.541936+0000","last_active":"2023-07-29T02:00:11.051405+0000","last_peered":"2023-07-29T02:00:11.051405+0000","last_clean":"2023-07-29T02:00:11.051405+0000","last_became_active":"2023-07-29T01:59:57.541434+0000","last_became_peered":"2023-07-29T01:59:57.541434+0000","last_unstale":"2023-07-29T02:00:11.051405+0000","last_undegraded":"2023-07-29T02:00:11.051405+0000","last_fullsized":"2023-07-29T02:00:11.051405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3791,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976628+0000","last_change":"2023-07-29T01:59:57.962725+0000","last_active":"2023-07-29T02:00:01.976628+0000","last_peered":"2023-07-29T02:00:01.976628+0000","last_clean":"2023-07-29T02:00:01.976628+0000","last_became_active":"2023-07-29T01:59:57.962459+0000","last_became_peered":"2023-07-29T01:59:57.962459+0000","last_unstale":"2023-07-29T02:00:01.976628+0000","last_undegraded":"2023-07-29T02:00:01.976628+0000","last_fullsized":"2023-07-29T02:00:01.976628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401186+0000","last_change":"2023-07-29T02:00:01.996160+0000","last_active":"2023-07-29T02:00:02.401186+0000","last_peered":"2023-07-29T02:00:02.401186+0000","last_clean":"2023-07-29T02:00:02.401186+0000","last_became_active":"2023-07-29T02:00:01.995827+0000","last_became_peered":"2023-07-29T02:00:01.995827+0000","last_unstale":"2023-07-29T02:00:02.401186+0000","last_undegraded":"2023-07-29T02:00:02.401186+0000","last_fullsized":"2023-07-29T02:00:02.401186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958252+0000","last_change":"2023-07-29T01:59:57.545705+0000","last_active":"2023-07-29T02:00:02.958252+0000","last_peered":"2023-07-29T02:00:02.958252+0000","last_clean":"2023-07-29T02:00:02.958252+0000","last_became_active":"2023-07-29T01:59:57.545406+0000","last_became_peered":"2023-07-29T01:59:57.545406+0000","last_unstale":"2023-07-29T02:00:02.958252+0000","last_undegraded":"2023-07-29T02:00:02.958252+0000","last_fullsized":"2023-07-29T02:00:02.958252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:31.903601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.980027+0000","last_change":"2023-07-29T01:59:57.970072+0000","last_active":"2023-07-29T02:00:01.980027+0000","last_peered":"2023-07-29T02:00:01.980027+0000","last_clean":"2023-07-29T02:00:01.980027+0000","last_became_active":"2023-07-29T01:59:57.969809+0000","last_became_peered":"2023-07-29T01:59:57.969809+0000","last_unstale":"2023-07-29T02:00:01.980027+0000","last_undegraded":"2023-07-29T02:00:01.980027+0000","last_fullsized":"2023-07-29T02:00:01.980027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440272+0000","last_change":"2023-07-29T02:00:01.997402+0000","last_active":"2023-07-29T02:00:02.440272+0000","last_peered":"2023-07-29T02:00:02.440272+0000","last_clean":"2023-07-29T02:00:02.440272+0000","last_became_active":"2023-07-29T02:00:01.996969+0000","last_became_peered":"2023-07-29T02:00:01.996969+0000","last_unstale":"2023-07-29T02:00:02.440272+0000","last_undegraded":"2023-07-29T02:00:02.440272+0000","last_fullsized":"2023-07-29T02:00:02.440272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:46:37.088979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966653+0000","last_change":"2023-07-29T01:59:57.541115+0000","last_active":"2023-07-29T02:00:01.966653+0000","last_peered":"2023-07-29T02:00:01.966653+0000","last_clean":"2023-07-29T02:00:01.966653+0000","last_became_active":"2023-07-29T01:59:57.540800+0000","last_became_peered":"2023-07-29T01:59:57.540800+0000","last_unstale":"2023-07-29T02:00:01.966653+0000","last_undegraded":"2023-07-29T02:00:01.966653+0000","last_fullsized":"2023-07-29T02:00:01.966653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977902+0000","last_change":"2023-07-29T01:59:57.964198+0000","last_active":"2023-07-29T02:00:01.977902+0000","last_peered":"2023-07-29T02:00:01.977902+0000","last_clean":"2023-07-29T02:00:01.977902+0000","last_became_active":"2023-07-29T01:59:57.963510+0000","last_became_peered":"2023-07-29T01:59:57.963510+0000","last_unstale":"2023-07-29T02:00:01.977902+0000","last_undegraded":"2023-07-29T02:00:01.977902+0000","last_fullsized":"2023-07-29T02:00:01.977902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441378+0000","last_change":"2023-07-29T02:00:01.996496+0000","last_active":"2023-07-29T02:00:02.441378+0000","last_peered":"2023-07-29T02:00:02.441378+0000","last_clean":"2023-07-29T02:00:02.441378+0000","last_became_active":"2023-07-29T02:00:01.996084+0000","last_became_peered":"2023-07-29T02:00:01.996084+0000","last_unstale":"2023-07-29T02:00:02.441378+0000","last_undegraded":"2023-07-29T02:00:02.441378+0000","last_fullsized":"2023-07-29T02:00:02.441378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:59:57.581952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974316+0000","last_change":"2023-07-29T01:59:57.548464+0000","last_active":"2023-07-29T02:00:01.974316+0000","last_peered":"2023-07-29T02:00:01.974316+0000","last_clean":"2023-07-29T02:00:01.974316+0000","last_became_active":"2023-07-29T01:59:57.548109+0000","last_became_peered":"2023-07-29T01:59:57.548109+0000","last_unstale":"2023-07-29T02:00:01.974316+0000","last_undegraded":"2023-07-29T02:00:01.974316+0000","last_fullsized":"2023-07-29T02:00:01.974316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:13.433053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967896+0000","last_change":"2023-07-29T01:59:57.962096+0000","last_active":"2023-07-29T02:00:01.967896+0000","last_peered":"2023-07-29T02:00:01.967896+0000","last_clean":"2023-07-29T02:00:01.967896+0000","last_became_active":"2023-07-29T01:59:57.961759+0000","last_became_peered":"2023-07-29T01:59:57.961759+0000","last_unstale":"2023-07-29T02:00:01.967896+0000","last_undegraded":"2023-07-29T02:00:01.967896+0000","last_fullsized":"2023-07-29T02:00:01.967896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400737+0000","last_change":"2023-07-29T02:00:01.993066+0000","last_active":"2023-07-29T02:00:02.400737+0000","last_peered":"2023-07-29T02:00:02.400737+0000","last_clean":"2023-07-29T02:00:02.400737+0000","last_became_active":"2023-07-29T02:00:01.992592+0000","last_became_peered":"2023-07-29T02:00:01.992592+0000","last_unstale":"2023-07-29T02:00:02.400737+0000","last_undegraded":"2023-07-29T02:00:02.400737+0000","last_fullsized":"2023-07-29T02:00:02.400737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:14:06.353802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958759+0000","last_change":"2023-07-29T01:59:57.543707+0000","last_active":"2023-07-29T02:00:02.958759+0000","last_peered":"2023-07-29T02:00:02.958759+0000","last_clean":"2023-07-29T02:00:02.958759+0000","last_became_active":"2023-07-29T01:59:57.543398+0000","last_became_peered":"2023-07-29T01:59:57.543398+0000","last_unstale":"2023-07-29T02:00:02.958759+0000","last_undegraded":"2023-07-29T02:00:02.958759+0000","last_fullsized":"2023-07-29T02:00:02.958759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977853+0000","last_change":"2023-07-29T01:59:57.966269+0000","last_active":"2023-07-29T02:00:01.977853+0000","last_peered":"2023-07-29T02:00:01.977853+0000","last_clean":"2023-07-29T02:00:01.977853+0000","last_became_active":"2023-07-29T01:59:57.965962+0000","last_became_peered":"2023-07-29T01:59:57.965962+0000","last_unstale":"2023-07-29T02:00:01.977853+0000","last_undegraded":"2023-07-29T02:00:01.977853+0000","last_fullsized":"2023-07-29T02:00:01.977853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400336+0000","last_change":"2023-07-29T02:00:01.992987+0000","last_active":"2023-07-29T02:00:02.400336+0000","last_peered":"2023-07-29T02:00:02.400336+0000","last_clean":"2023-07-29T02:00:02.400336+0000","last_became_active":"2023-07-29T02:00:01.992384+0000","last_became_peered":"2023-07-29T02:00:01.992384+0000","last_unstale":"2023-07-29T02:00:02.400336+0000","last_undegraded":"2023-07-29T02:00:02.400336+0000","last_fullsized":"2023-07-29T02:00:02.400336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400080+0000","last_change":"2023-07-29T01:59:57.548392+0000","last_active":"2023-07-29T02:00:02.400080+0000","last_peered":"2023-07-29T02:00:02.400080+0000","last_clean":"2023-07-29T02:00:02.400080+0000","last_became_active":"2023-07-29T01:59:57.548084+0000","last_became_peered":"2023-07-29T01:59:57.548084+0000","last_unstale":"2023-07-29T02:00:02.400080+0000","last_undegraded":"2023-07-29T02:00:02.400080+0000","last_fullsized":"2023-07-29T02:00:02.400080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973873+0000","last_change":"2023-07-29T01:59:57.965613+0000","last_active":"2023-07-29T02:00:01.973873+0000","last_peered":"2023-07-29T02:00:01.973873+0000","last_clean":"2023-07-29T02:00:01.973873+0000","last_became_active":"2023-07-29T01:59:57.964626+0000","last_became_peered":"2023-07-29T01:59:57.964626+0000","last_unstale":"2023-07-29T02:00:01.973873+0000","last_undegraded":"2023-07-29T02:00:01.973873+0000","last_fullsized":"2023-07-29T02:00:01.973873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442405+0000","last_change":"2023-07-29T02:00:01.990978+0000","last_active":"2023-07-29T02:00:02.442405+0000","last_peered":"2023-07-29T02:00:02.442405+0000","last_clean":"2023-07-29T02:00:02.442405+0000","last_became_active":"2023-07-29T02:00:01.990579+0000","last_became_peered":"2023-07-29T02:00:01.990579+0000","last_unstale":"2023-07-29T02:00:02.442405+0000","last_undegraded":"2023-07-29T02:00:02.442405+0000","last_fullsized":"2023-07-29T02:00:02.442405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:11:53.398210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957642+0000","last_change":"2023-07-29T01:59:57.549270+0000","last_active":"2023-07-29T02:00:02.957642+0000","last_peered":"2023-07-29T02:00:02.957642+0000","last_clean":"2023-07-29T02:00:02.957642+0000","last_became_active":"2023-07-29T01:59:57.548981+0000","last_became_peered":"2023-07-29T01:59:57.548981+0000","last_unstale":"2023-07-29T02:00:02.957642+0000","last_undegraded":"2023-07-29T02:00:02.957642+0000","last_fullsized":"2023-07-29T02:00:02.957642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:05.783369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972647+0000","last_change":"2023-07-29T01:59:57.969851+0000","last_active":"2023-07-29T02:00:01.972647+0000","last_peered":"2023-07-29T02:00:01.972647+0000","last_clean":"2023-07-29T02:00:01.972647+0000","last_became_active":"2023-07-29T01:59:57.969501+0000","last_became_peered":"2023-07-29T01:59:57.969501+0000","last_unstale":"2023-07-29T02:00:01.972647+0000","last_undegraded":"2023-07-29T02:00:01.972647+0000","last_fullsized":"2023-07-29T02:00:01.972647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442608+0000","last_change":"2023-07-29T02:00:01.989766+0000","last_active":"2023-07-29T02:00:02.442608+0000","last_peered":"2023-07-29T02:00:02.442608+0000","last_clean":"2023-07-29T02:00:02.442608+0000","last_became_active":"2023-07-29T02:00:01.989364+0000","last_became_peered":"2023-07-29T02:00:01.989364+0000","last_unstale":"2023-07-29T02:00:02.442608+0000","last_undegraded":"2023-07-29T02:00:02.442608+0000","last_fullsized":"2023-07-29T02:00:02.442608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:01:14.849757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400580+0000","last_change":"2023-07-29T01:59:57.541329+0000","last_active":"2023-07-29T02:00:02.400580+0000","last_peered":"2023-07-29T02:00:02.400580+0000","last_clean":"2023-07-29T02:00:02.400580+0000","last_became_active":"2023-07-29T01:59:57.541056+0000","last_became_peered":"2023-07-29T01:59:57.541056+0000","last_unstale":"2023-07-29T02:00:02.400580+0000","last_undegraded":"2023-07-29T02:00:02.400580+0000","last_fullsized":"2023-07-29T02:00:02.400580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968261+0000","last_change":"2023-07-29T01:59:57.975244+0000","last_active":"2023-07-29T02:00:01.968261+0000","last_peered":"2023-07-29T02:00:01.968261+0000","last_clean":"2023-07-29T02:00:01.968261+0000","last_became_active":"2023-07-29T01:59:57.974998+0000","last_became_peered":"2023-07-29T01:59:57.974998+0000","last_unstale":"2023-07-29T02:00:01.968261+0000","last_undegraded":"2023-07-29T02:00:01.968261+0000","last_fullsized":"2023-07-29T02:00:01.968261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:14.435169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442656+0000","last_change":"2023-07-29T02:00:01.990823+0000","last_active":"2023-07-29T02:00:02.442656+0000","last_peered":"2023-07-29T02:00:02.442656+0000","last_clean":"2023-07-29T02:00:02.442656+0000","last_became_active":"2023-07-29T02:00:01.990276+0000","last_became_peered":"2023-07-29T02:00:01.990276+0000","last_unstale":"2023-07-29T02:00:02.442656+0000","last_undegraded":"2023-07-29T02:00:02.442656+0000","last_fullsized":"2023-07-29T02:00:02.442656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974632+0000","last_change":"2023-07-29T01:59:57.544524+0000","last_active":"2023-07-29T02:00:01.974632+0000","last_peered":"2023-07-29T02:00:01.974632+0000","last_clean":"2023-07-29T02:00:01.974632+0000","last_became_active":"2023-07-29T01:59:57.544231+0000","last_became_peered":"2023-07-29T01:59:57.544231+0000","last_unstale":"2023-07-29T02:00:01.974632+0000","last_undegraded":"2023-07-29T02:00:01.974632+0000","last_fullsized":"2023-07-29T02:00:01.974632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966682+0000","last_change":"2023-07-29T01:59:57.974773+0000","last_active":"2023-07-29T02:00:01.966682+0000","last_peered":"2023-07-29T02:00:01.966682+0000","last_clean":"2023-07-29T02:00:01.966682+0000","last_became_active":"2023-07-29T01:59:57.974525+0000","last_became_peered":"2023-07-29T01:59:57.974525+0000","last_unstale":"2023-07-29T02:00:01.966682+0000","last_undegraded":"2023-07-29T02:00:01.966682+0000","last_fullsized":"2023-07-29T02:00:01.966682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442650+0000","last_change":"2023-07-29T02:00:01.988872+0000","last_active":"2023-07-29T02:00:02.442650+0000","last_peered":"2023-07-29T02:00:02.442650+0000","last_clean":"2023-07-29T02:00:02.442650+0000","last_became_active":"2023-07-29T02:00:01.988486+0000","last_became_peered":"2023-07-29T02:00:01.988486+0000","last_unstale":"2023-07-29T02:00:02.442650+0000","last_undegraded":"2023-07-29T02:00:02.442650+0000","last_fullsized":"2023-07-29T02:00:02.442650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:07.842328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.954789+0000","last_change":"2023-07-29T01:59:57.535498+0000","last_active":"2023-07-29T02:00:02.954789+0000","last_peered":"2023-07-29T02:00:02.954789+0000","last_clean":"2023-07-29T02:00:02.954789+0000","last_became_active":"2023-07-29T01:59:57.534813+0000","last_became_peered":"2023-07-29T01:59:57.534813+0000","last_unstale":"2023-07-29T02:00:02.954789+0000","last_undegraded":"2023-07-29T02:00:02.954789+0000","last_fullsized":"2023-07-29T02:00:02.954789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976870+0000","last_change":"2023-07-29T01:59:57.962897+0000","last_active":"2023-07-29T02:00:01.976870+0000","last_peered":"2023-07-29T02:00:01.976870+0000","last_clean":"2023-07-29T02:00:01.976870+0000","last_became_active":"2023-07-29T01:59:57.962184+0000","last_became_peered":"2023-07-29T01:59:57.962184+0000","last_unstale":"2023-07-29T02:00:01.976870+0000","last_undegraded":"2023-07-29T02:00:01.976870+0000","last_fullsized":"2023-07-29T02:00:01.976870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440114+0000","last_change":"2023-07-29T02:00:01.989538+0000","last_active":"2023-07-29T02:00:02.440114+0000","last_peered":"2023-07-29T02:00:02.440114+0000","last_clean":"2023-07-29T02:00:02.440114+0000","last_became_active":"2023-07-29T02:00:01.989151+0000","last_became_peered":"2023-07-29T02:00:01.989151+0000","last_unstale":"2023-07-29T02:00:02.440114+0000","last_undegraded":"2023-07-29T02:00:02.440114+0000","last_fullsized":"2023-07-29T02:00:02.440114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:21:35.031304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968357+0000","last_change":"2023-07-29T01:59:57.544466+0000","last_active":"2023-07-29T02:00:01.968357+0000","last_peered":"2023-07-29T02:00:01.968357+0000","last_clean":"2023-07-29T02:00:01.968357+0000","last_became_active":"2023-07-29T01:59:57.544120+0000","last_became_peered":"2023-07-29T01:59:57.544120+0000","last_unstale":"2023-07-29T02:00:01.968357+0000","last_undegraded":"2023-07-29T02:00:01.968357+0000","last_fullsized":"2023-07-29T02:00:01.968357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977082+0000","last_change":"2023-07-29T01:59:57.962277+0000","last_active":"2023-07-29T02:00:01.977082+0000","last_peered":"2023-07-29T02:00:01.977082+0000","last_clean":"2023-07-29T02:00:01.977082+0000","last_became_active":"2023-07-29T01:59:57.961975+0000","last_became_peered":"2023-07-29T01:59:57.961975+0000","last_unstale":"2023-07-29T02:00:01.977082+0000","last_undegraded":"2023-07-29T02:00:01.977082+0000","last_fullsized":"2023-07-29T02:00:01.977082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:27:01.059953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400809+0000","last_change":"2023-07-29T02:00:01.988563+0000","last_active":"2023-07-29T02:00:02.400809+0000","last_peered":"2023-07-29T02:00:02.400809+0000","last_clean":"2023-07-29T02:00:02.400809+0000","last_became_active":"2023-07-29T02:00:01.988155+0000","last_became_peered":"2023-07-29T02:00:01.988155+0000","last_unstale":"2023-07-29T02:00:02.400809+0000","last_undegraded":"2023-07-29T02:00:02.400809+0000","last_fullsized":"2023-07-29T02:00:02.400809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972477+0000","last_change":"2023-07-29T01:59:57.549764+0000","last_active":"2023-07-29T02:00:01.972477+0000","last_peered":"2023-07-29T02:00:01.972477+0000","last_clean":"2023-07-29T02:00:01.972477+0000","last_became_active":"2023-07-29T01:59:57.549470+0000","last_became_peered":"2023-07-29T01:59:57.549470+0000","last_unstale":"2023-07-29T02:00:01.972477+0000","last_undegraded":"2023-07-29T02:00:01.972477+0000","last_fullsized":"2023-07-29T02:00:01.972477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976948+0000","last_change":"2023-07-29T01:59:57.962303+0000","last_active":"2023-07-29T02:00:01.976948+0000","last_peered":"2023-07-29T02:00:01.976948+0000","last_clean":"2023-07-29T02:00:01.976948+0000","last_became_active":"2023-07-29T01:59:57.962016+0000","last_became_peered":"2023-07-29T01:59:57.962016+0000","last_unstale":"2023-07-29T02:00:01.976948+0000","last_undegraded":"2023-07-29T02:00:01.976948+0000","last_fullsized":"2023-07-29T02:00:01.976948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:08.813083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399334+0000","last_change":"2023-07-29T02:00:01.992380+0000","last_active":"2023-07-29T02:00:02.399334+0000","last_peered":"2023-07-29T02:00:02.399334+0000","last_clean":"2023-07-29T02:00:02.399334+0000","last_became_active":"2023-07-29T02:00:01.992042+0000","last_became_peered":"2023-07-29T02:00:01.992042+0000","last_unstale":"2023-07-29T02:00:02.399334+0000","last_undegraded":"2023-07-29T02:00:02.399334+0000","last_fullsized":"2023-07-29T02:00:02.399334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:24:44.331640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977747+0000","last_change":"2023-07-29T01:59:57.537045+0000","last_active":"2023-07-29T02:00:01.977747+0000","last_peered":"2023-07-29T02:00:01.977747+0000","last_clean":"2023-07-29T02:00:01.977747+0000","last_became_active":"2023-07-29T01:59:57.535762+0000","last_became_peered":"2023-07-29T01:59:57.535762+0000","last_unstale":"2023-07-29T02:00:01.977747+0000","last_undegraded":"2023-07-29T02:00:01.977747+0000","last_fullsized":"2023-07-29T02:00:01.977747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972302+0000","last_change":"2023-07-29T01:59:57.975103+0000","last_active":"2023-07-29T02:00:01.972302+0000","last_peered":"2023-07-29T02:00:01.972302+0000","last_clean":"2023-07-29T02:00:01.972302+0000","last_became_active":"2023-07-29T01:59:57.974834+0000","last_became_peered":"2023-07-29T01:59:57.974834+0000","last_unstale":"2023-07-29T02:00:01.972302+0000","last_undegraded":"2023-07-29T02:00:01.972302+0000","last_fullsized":"2023-07-29T02:00:01.972302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401174+0000","last_change":"2023-07-29T02:00:01.990813+0000","last_active":"2023-07-29T02:00:02.401174+0000","last_peered":"2023-07-29T02:00:02.401174+0000","last_clean":"2023-07-29T02:00:02.401174+0000","last_became_active":"2023-07-29T02:00:01.990464+0000","last_became_peered":"2023-07-29T02:00:01.990464+0000","last_unstale":"2023-07-29T02:00:02.401174+0000","last_undegraded":"2023-07-29T02:00:02.401174+0000","last_fullsized":"2023-07-29T02:00:02.401174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:16:46.676860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958405+0000","last_change":"2023-07-29T01:59:57.540561+0000","last_active":"2023-07-29T02:00:02.958405+0000","last_peered":"2023-07-29T02:00:02.958405+0000","last_clean":"2023-07-29T02:00:02.958405+0000","last_became_active":"2023-07-29T01:59:57.540292+0000","last_became_peered":"2023-07-29T01:59:57.540292+0000","last_unstale":"2023-07-29T02:00:02.958405+0000","last_undegraded":"2023-07-29T02:00:02.958405+0000","last_fullsized":"2023-07-29T02:00:02.958405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978068+0000","last_change":"2023-07-29T01:59:52.448098+0000","last_active":"2023-07-29T02:00:01.978068+0000","last_peered":"2023-07-29T02:00:01.978068+0000","last_clean":"2023-07-29T02:00:01.978068+0000","last_became_active":"2023-07-29T01:59:52.447782+0000","last_became_peered":"2023-07-29T01:59:52.447782+0000","last_unstale":"2023-07-29T02:00:01.978068+0000","last_undegraded":"2023-07-29T02:00:01.978068+0000","last_fullsized":"2023-07-29T02:00:01.978068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:31.981804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977648+0000","last_change":"2023-07-29T01:59:57.967845+0000","last_active":"2023-07-29T02:00:01.977648+0000","last_peered":"2023-07-29T02:00:01.977648+0000","last_clean":"2023-07-29T02:00:01.977648+0000","last_became_active":"2023-07-29T01:59:57.966065+0000","last_became_peered":"2023-07-29T01:59:57.966065+0000","last_unstale":"2023-07-29T02:00:01.977648+0000","last_undegraded":"2023-07-29T02:00:01.977648+0000","last_fullsized":"2023-07-29T02:00:01.977648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439054+0000","last_change":"2023-07-29T02:00:01.996414+0000","last_active":"2023-07-29T02:00:02.439054+0000","last_peered":"2023-07-29T02:00:02.439054+0000","last_clean":"2023-07-29T02:00:02.439054+0000","last_became_active":"2023-07-29T02:00:01.995963+0000","last_became_peered":"2023-07-29T02:00:01.995963+0000","last_unstale":"2023-07-29T02:00:02.439054+0000","last_undegraded":"2023-07-29T02:00:02.439054+0000","last_fullsized":"2023-07-29T02:00:02.439054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:06:19.130853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.980059+0000","last_change":"2023-07-29T01:59:52.445649+0000","last_active":"2023-07-29T02:00:01.980059+0000","last_peered":"2023-07-29T02:00:01.980059+0000","last_clean":"2023-07-29T02:00:01.980059+0000","last_became_active":"2023-07-29T01:59:52.445337+0000","last_became_peered":"2023-07-29T01:59:52.445337+0000","last_unstale":"2023-07-29T02:00:01.980059+0000","last_undegraded":"2023-07-29T02:00:01.980059+0000","last_fullsized":"2023-07-29T02:00:01.980059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439989+0000","last_change":"2023-07-29T01:59:57.537863+0000","last_active":"2023-07-29T02:00:02.439989+0000","last_peered":"2023-07-29T02:00:02.439989+0000","last_clean":"2023-07-29T02:00:02.439989+0000","last_became_active":"2023-07-29T01:59:57.537581+0000","last_became_peered":"2023-07-29T01:59:57.537581+0000","last_unstale":"2023-07-29T02:00:02.439989+0000","last_undegraded":"2023-07-29T02:00:02.439989+0000","last_fullsized":"2023-07-29T02:00:02.439989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:02:57.137574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972545+0000","last_change":"2023-07-29T01:59:57.961598+0000","last_active":"2023-07-29T02:00:01.972545+0000","last_peered":"2023-07-29T02:00:01.972545+0000","last_clean":"2023-07-29T02:00:01.972545+0000","last_became_active":"2023-07-29T01:59:57.961298+0000","last_became_peered":"2023-07-29T01:59:57.961298+0000","last_unstale":"2023-07-29T02:00:01.972545+0000","last_undegraded":"2023-07-29T02:00:01.972545+0000","last_fullsized":"2023-07-29T02:00:01.972545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:11:49.956637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400459+0000","last_change":"2023-07-29T02:00:01.987452+0000","last_active":"2023-07-29T02:00:02.400459+0000","last_peered":"2023-07-29T02:00:02.400459+0000","last_clean":"2023-07-29T02:00:02.400459+0000","last_became_active":"2023-07-29T02:00:01.986915+0000","last_became_peered":"2023-07-29T02:00:01.986915+0000","last_unstale":"2023-07-29T02:00:02.400459+0000","last_undegraded":"2023-07-29T02:00:02.400459+0000","last_fullsized":"2023-07-29T02:00:02.400459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:35:48.256508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973327+0000","last_change":"2023-07-29T01:59:52.448423+0000","last_active":"2023-07-29T02:00:01.973327+0000","last_peered":"2023-07-29T02:00:01.973327+0000","last_clean":"2023-07-29T02:00:01.973327+0000","last_became_active":"2023-07-29T01:59:52.448052+0000","last_became_peered":"2023-07-29T01:59:52.448052+0000","last_unstale":"2023-07-29T02:00:01.973327+0000","last_undegraded":"2023-07-29T02:00:01.973327+0000","last_fullsized":"2023-07-29T02:00:01.973327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:31.981804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973579+0000","last_change":"2023-07-29T01:59:52.450730+0000","last_active":"2023-07-29T02:00:01.973579+0000","last_peered":"2023-07-29T02:00:01.973579+0000","last_clean":"2023-07-29T02:00:01.973579+0000","last_became_active":"2023-07-29T01:59:52.449582+0000","last_became_peered":"2023-07-29T01:59:52.449582+0000","last_unstale":"2023-07-29T02:00:01.973579+0000","last_undegraded":"2023-07-29T02:00:01.973579+0000","last_fullsized":"2023-07-29T02:00:01.973579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:01:27.099648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966496+0000","last_change":"2023-07-29T01:59:57.546474+0000","last_active":"2023-07-29T02:00:01.966496+0000","last_peered":"2023-07-29T02:00:01.966496+0000","last_clean":"2023-07-29T02:00:01.966496+0000","last_became_active":"2023-07-29T01:59:57.546179+0000","last_became_peered":"2023-07-29T01:59:57.546179+0000","last_unstale":"2023-07-29T02:00:01.966496+0000","last_undegraded":"2023-07-29T02:00:01.966496+0000","last_fullsized":"2023-07-29T02:00:01.966496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967788+0000","last_change":"2023-07-29T01:59:57.975316+0000","last_active":"2023-07-29T02:00:01.967788+0000","last_peered":"2023-07-29T02:00:01.967788+0000","last_clean":"2023-07-29T02:00:01.967788+0000","last_became_active":"2023-07-29T01:59:57.975078+0000","last_became_peered":"2023-07-29T01:59:57.975078+0000","last_unstale":"2023-07-29T02:00:01.967788+0000","last_undegraded":"2023-07-29T02:00:01.967788+0000","last_fullsized":"2023-07-29T02:00:01.967788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442819+0000","last_change":"2023-07-29T02:00:01.987385+0000","last_active":"2023-07-29T02:00:02.442819+0000","last_peered":"2023-07-29T02:00:02.442819+0000","last_clean":"2023-07-29T02:00:02.442819+0000","last_became_active":"2023-07-29T02:00:01.986937+0000","last_became_peered":"2023-07-29T02:00:01.986937+0000","last_unstale":"2023-07-29T02:00:02.442819+0000","last_undegraded":"2023-07-29T02:00:02.442819+0000","last_fullsized":"2023-07-29T02:00:02.442819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:53.580244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974915+0000","last_change":"2023-07-29T01:59:53.171806+0000","last_active":"2023-07-29T02:00:01.974915+0000","last_peered":"2023-07-29T02:00:01.974915+0000","last_clean":"2023-07-29T02:00:01.974915+0000","last_became_active":"2023-07-29T01:59:53.171467+0000","last_became_peered":"2023-07-29T01:59:53.171467+0000","last_unstale":"2023-07-29T02:00:01.974915+0000","last_undegraded":"2023-07-29T02:00:01.974915+0000","last_fullsized":"2023-07-29T02:00:01.974915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972796+0000","last_change":"2023-07-29T01:59:57.549442+0000","last_active":"2023-07-29T02:00:01.972796+0000","last_peered":"2023-07-29T02:00:01.972796+0000","last_clean":"2023-07-29T02:00:01.972796+0000","last_became_active":"2023-07-29T01:59:57.549151+0000","last_became_peered":"2023-07-29T01:59:57.549151+0000","last_unstale":"2023-07-29T02:00:01.972796+0000","last_undegraded":"2023-07-29T02:00:01.972796+0000","last_fullsized":"2023-07-29T02:00:01.972796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972211+0000","last_change":"2023-07-29T01:59:57.973471+0000","last_active":"2023-07-29T02:00:01.972211+0000","last_peered":"2023-07-29T02:00:01.972211+0000","last_clean":"2023-07-29T02:00:01.972211+0000","last_became_active":"2023-07-29T01:59:57.969273+0000","last_became_peered":"2023-07-29T01:59:57.969273+0000","last_unstale":"2023-07-29T02:00:01.972211+0000","last_undegraded":"2023-07-29T02:00:01.972211+0000","last_fullsized":"2023-07-29T02:00:01.972211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:56:07.949649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400121+0000","last_change":"2023-07-29T02:00:01.993242+0000","last_active":"2023-07-29T02:00:02.400121+0000","last_peered":"2023-07-29T02:00:02.400121+0000","last_clean":"2023-07-29T02:00:02.400121+0000","last_became_active":"2023-07-29T02:00:01.992406+0000","last_became_peered":"2023-07-29T02:00:01.992406+0000","last_unstale":"2023-07-29T02:00:02.400121+0000","last_undegraded":"2023-07-29T02:00:02.400121+0000","last_fullsized":"2023-07-29T02:00:02.400121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:12.254656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973406+0000","last_change":"2023-07-29T01:59:53.171746+0000","last_active":"2023-07-29T02:00:01.973406+0000","last_peered":"2023-07-29T02:00:01.973406+0000","last_clean":"2023-07-29T02:00:01.973406+0000","last_became_active":"2023-07-29T01:59:53.171440+0000","last_became_peered":"2023-07-29T01:59:53.171440+0000","last_unstale":"2023-07-29T02:00:01.973406+0000","last_undegraded":"2023-07-29T02:00:01.973406+0000","last_fullsized":"2023-07-29T02:00:01.973406+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:17:56.960611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976818+0000","last_change":"2023-07-29T01:59:57.537970+0000","last_active":"2023-07-29T02:00:01.976818+0000","last_peered":"2023-07-29T02:00:01.976818+0000","last_clean":"2023-07-29T02:00:01.976818+0000","last_became_active":"2023-07-29T01:59:57.537665+0000","last_became_peered":"2023-07-29T01:59:57.537665+0000","last_unstale":"2023-07-29T02:00:01.976818+0000","last_undegraded":"2023-07-29T02:00:01.976818+0000","last_fullsized":"2023-07-29T02:00:01.976818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968235+0000","last_change":"2023-07-29T01:59:57.968655+0000","last_active":"2023-07-29T02:00:01.968235+0000","last_peered":"2023-07-29T02:00:01.968235+0000","last_clean":"2023-07-29T02:00:01.968235+0000","last_became_active":"2023-07-29T01:59:57.968373+0000","last_became_peered":"2023-07-29T01:59:57.968373+0000","last_unstale":"2023-07-29T02:00:01.968235+0000","last_undegraded":"2023-07-29T02:00:01.968235+0000","last_fullsized":"2023-07-29T02:00:01.968235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:06.785485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439797+0000","last_change":"2023-07-29T02:00:01.984885+0000","last_active":"2023-07-29T02:00:02.439797+0000","last_peered":"2023-07-29T02:00:02.439797+0000","last_clean":"2023-07-29T02:00:02.439797+0000","last_became_active":"2023-07-29T02:00:01.984476+0000","last_became_peered":"2023-07-29T02:00:01.984476+0000","last_unstale":"2023-07-29T02:00:02.439797+0000","last_undegraded":"2023-07-29T02:00:02.439797+0000","last_fullsized":"2023-07-29T02:00:02.439797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973534+0000","last_change":"2023-07-29T01:59:53.172039+0000","last_active":"2023-07-29T02:00:01.973534+0000","last_peered":"2023-07-29T02:00:01.973534+0000","last_clean":"2023-07-29T02:00:01.973534+0000","last_became_active":"2023-07-29T01:59:53.171617+0000","last_became_peered":"2023-07-29T01:59:53.171617+0000","last_unstale":"2023-07-29T02:00:01.973534+0000","last_undegraded":"2023-07-29T02:00:01.973534+0000","last_fullsized":"2023-07-29T02:00:01.973534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976735+0000","last_change":"2023-07-29T01:59:57.540888+0000","last_active":"2023-07-29T02:00:01.976735+0000","last_peered":"2023-07-29T02:00:01.976735+0000","last_clean":"2023-07-29T02:00:01.976735+0000","last_became_active":"2023-07-29T01:59:57.540449+0000","last_became_peered":"2023-07-29T01:59:57.540449+0000","last_unstale":"2023-07-29T02:00:01.976735+0000","last_undegraded":"2023-07-29T02:00:01.976735+0000","last_fullsized":"2023-07-29T02:00:01.976735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974278+0000","last_change":"2023-07-29T01:59:57.968216+0000","last_active":"2023-07-29T02:00:01.974278+0000","last_peered":"2023-07-29T02:00:01.974278+0000","last_clean":"2023-07-29T02:00:01.974278+0000","last_became_active":"2023-07-29T01:59:57.967933+0000","last_became_peered":"2023-07-29T01:59:57.967933+0000","last_unstale":"2023-07-29T02:00:01.974278+0000","last_undegraded":"2023-07-29T02:00:01.974278+0000","last_fullsized":"2023-07-29T02:00:01.974278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439338+0000","last_change":"2023-07-29T02:00:01.985121+0000","last_active":"2023-07-29T02:00:02.439338+0000","last_peered":"2023-07-29T02:00:02.439338+0000","last_clean":"2023-07-29T02:00:02.439338+0000","last_became_active":"2023-07-29T02:00:01.984691+0000","last_became_peered":"2023-07-29T02:00:01.984691+0000","last_unstale":"2023-07-29T02:00:02.439338+0000","last_undegraded":"2023-07-29T02:00:02.439338+0000","last_fullsized":"2023-07-29T02:00:02.439338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:54.400954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967930+0000","last_change":"2023-07-29T01:59:53.171808+0000","last_active":"2023-07-29T02:00:01.967930+0000","last_peered":"2023-07-29T02:00:01.967930+0000","last_clean":"2023-07-29T02:00:01.967930+0000","last_became_active":"2023-07-29T01:59:53.171463+0000","last_became_peered":"2023-07-29T01:59:53.171463+0000","last_unstale":"2023-07-29T02:00:01.967930+0000","last_undegraded":"2023-07-29T02:00:01.967930+0000","last_fullsized":"2023-07-29T02:00:01.967930+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:07:59.559814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973914+0000","last_change":"2023-07-29T01:59:57.549468+0000","last_active":"2023-07-29T02:00:01.973914+0000","last_peered":"2023-07-29T02:00:01.973914+0000","last_clean":"2023-07-29T02:00:01.973914+0000","last_became_active":"2023-07-29T01:59:57.549181+0000","last_became_peered":"2023-07-29T01:59:57.549181+0000","last_unstale":"2023-07-29T02:00:01.973914+0000","last_undegraded":"2023-07-29T02:00:01.973914+0000","last_fullsized":"2023-07-29T02:00:01.973914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966982+0000","last_change":"2023-07-29T01:59:57.963908+0000","last_active":"2023-07-29T02:00:01.966982+0000","last_peered":"2023-07-29T02:00:01.966982+0000","last_clean":"2023-07-29T02:00:01.966982+0000","last_became_active":"2023-07-29T01:59:57.963659+0000","last_became_peered":"2023-07-29T01:59:57.963659+0000","last_unstale":"2023-07-29T02:00:01.966982+0000","last_undegraded":"2023-07-29T02:00:01.966982+0000","last_fullsized":"2023-07-29T02:00:01.966982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440428+0000","last_change":"2023-07-29T02:00:01.984197+0000","last_active":"2023-07-29T02:00:02.440428+0000","last_peered":"2023-07-29T02:00:02.440428+0000","last_clean":"2023-07-29T02:00:02.440428+0000","last_became_active":"2023-07-29T02:00:01.983744+0000","last_became_peered":"2023-07-29T02:00:01.983744+0000","last_unstale":"2023-07-29T02:00:02.440428+0000","last_undegraded":"2023-07-29T02:00:02.440428+0000","last_fullsized":"2023-07-29T02:00:02.440428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968731+0000","last_change":"2023-07-29T01:59:52.449102+0000","last_active":"2023-07-29T02:00:01.968731+0000","last_peered":"2023-07-29T02:00:01.968731+0000","last_clean":"2023-07-29T02:00:01.968731+0000","last_became_active":"2023-07-29T01:59:52.448814+0000","last_became_peered":"2023-07-29T01:59:52.448814+0000","last_unstale":"2023-07-29T02:00:01.968731+0000","last_undegraded":"2023-07-29T02:00:01.968731+0000","last_fullsized":"2023-07-29T02:00:01.968731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977814+0000","last_change":"2023-07-29T01:59:57.544590+0000","last_active":"2023-07-29T02:00:01.977814+0000","last_peered":"2023-07-29T02:00:01.977814+0000","last_clean":"2023-07-29T02:00:01.977814+0000","last_became_active":"2023-07-29T01:59:57.544317+0000","last_became_peered":"2023-07-29T01:59:57.544317+0000","last_unstale":"2023-07-29T02:00:01.977814+0000","last_undegraded":"2023-07-29T02:00:01.977814+0000","last_fullsized":"2023-07-29T02:00:01.977814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971685+0000","last_change":"2023-07-29T01:59:57.973912+0000","last_active":"2023-07-29T02:00:01.971685+0000","last_peered":"2023-07-29T02:00:01.971685+0000","last_clean":"2023-07-29T02:00:01.971685+0000","last_became_active":"2023-07-29T01:59:57.969642+0000","last_became_peered":"2023-07-29T01:59:57.969642+0000","last_unstale":"2023-07-29T02:00:01.971685+0000","last_undegraded":"2023-07-29T02:00:01.971685+0000","last_fullsized":"2023-07-29T02:00:01.971685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440741+0000","last_change":"2023-07-29T02:00:01.999117+0000","last_active":"2023-07-29T02:00:02.440741+0000","last_peered":"2023-07-29T02:00:02.440741+0000","last_clean":"2023-07-29T02:00:02.440741+0000","last_became_active":"2023-07-29T02:00:01.998715+0000","last_became_peered":"2023-07-29T02:00:01.998715+0000","last_unstale":"2023-07-29T02:00:02.440741+0000","last_undegraded":"2023-07-29T02:00:02.440741+0000","last_fullsized":"2023-07-29T02:00:02.440741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440569+0000","last_change":"2023-07-29T01:59:57.545933+0000","last_active":"2023-07-29T02:00:02.440569+0000","last_peered":"2023-07-29T02:00:02.440569+0000","last_clean":"2023-07-29T02:00:02.440569+0000","last_became_active":"2023-07-29T01:59:57.545744+0000","last_became_peered":"2023-07-29T01:59:57.545744+0000","last_unstale":"2023-07-29T02:00:02.440569+0000","last_undegraded":"2023-07-29T02:00:02.440569+0000","last_fullsized":"2023-07-29T02:00:02.440569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972541+0000","last_change":"2023-07-29T01:59:57.970577+0000","last_active":"2023-07-29T02:00:01.972541+0000","last_peered":"2023-07-29T02:00:01.972541+0000","last_clean":"2023-07-29T02:00:01.972541+0000","last_became_active":"2023-07-29T01:59:57.970252+0000","last_became_peered":"2023-07-29T01:59:57.970252+0000","last_unstale":"2023-07-29T02:00:01.972541+0000","last_undegraded":"2023-07-29T02:00:01.972541+0000","last_fullsized":"2023-07-29T02:00:01.972541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:09.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399784+0000","last_change":"2023-07-29T02:00:01.989885+0000","last_active":"2023-07-29T02:00:02.399784+0000","last_peered":"2023-07-29T02:00:02.399784+0000","last_clean":"2023-07-29T02:00:02.399784+0000","last_became_active":"2023-07-29T02:00:01.989481+0000","last_became_peered":"2023-07-29T02:00:01.989481+0000","last_unstale":"2023-07-29T02:00:02.399784+0000","last_undegraded":"2023-07-29T02:00:02.399784+0000","last_fullsized":"2023-07-29T02:00:02.399784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957691+0000","last_change":"2023-07-29T01:59:57.543782+0000","last_active":"2023-07-29T02:00:02.957691+0000","last_peered":"2023-07-29T02:00:02.957691+0000","last_clean":"2023-07-29T02:00:02.957691+0000","last_became_active":"2023-07-29T01:59:57.543445+0000","last_became_peered":"2023-07-29T01:59:57.543445+0000","last_unstale":"2023-07-29T02:00:02.957691+0000","last_undegraded":"2023-07-29T02:00:02.957691+0000","last_fullsized":"2023-07-29T02:00:02.957691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.970956+0000","last_change":"2023-07-29T01:59:57.965177+0000","last_active":"2023-07-29T02:00:01.970956+0000","last_peered":"2023-07-29T02:00:01.970956+0000","last_clean":"2023-07-29T02:00:01.970956+0000","last_became_active":"2023-07-29T01:59:57.964925+0000","last_became_peered":"2023-07-29T01:59:57.964925+0000","last_unstale":"2023-07-29T02:00:01.970956+0000","last_undegraded":"2023-07-29T02:00:01.970956+0000","last_fullsized":"2023-07-29T02:00:01.970956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401320+0000","last_change":"2023-07-29T02:00:01.985786+0000","last_active":"2023-07-29T02:00:02.401320+0000","last_peered":"2023-07-29T02:00:02.401320+0000","last_clean":"2023-07-29T02:00:02.401320+0000","last_became_active":"2023-07-29T02:00:01.985310+0000","last_became_peered":"2023-07-29T02:00:01.985310+0000","last_unstale":"2023-07-29T02:00:02.401320+0000","last_undegraded":"2023-07-29T02:00:02.401320+0000","last_fullsized":"2023-07-29T02:00:02.401320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957725+0000","last_change":"2023-07-29T01:59:57.541908+0000","last_active":"2023-07-29T02:00:02.957725+0000","last_peered":"2023-07-29T02:00:02.957725+0000","last_clean":"2023-07-29T02:00:02.957725+0000","last_became_active":"2023-07-29T01:59:57.541633+0000","last_became_peered":"2023-07-29T01:59:57.541633+0000","last_unstale":"2023-07-29T02:00:02.957725+0000","last_undegraded":"2023-07-29T02:00:02.957725+0000","last_fullsized":"2023-07-29T02:00:02.957725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.970785+0000","last_change":"2023-07-29T01:59:57.965915+0000","last_active":"2023-07-29T02:00:01.970785+0000","last_peered":"2023-07-29T02:00:01.970785+0000","last_clean":"2023-07-29T02:00:01.970785+0000","last_became_active":"2023-07-29T01:59:57.965383+0000","last_became_peered":"2023-07-29T01:59:57.965383+0000","last_unstale":"2023-07-29T02:00:01.970785+0000","last_undegraded":"2023-07-29T02:00:01.970785+0000","last_fullsized":"2023-07-29T02:00:01.970785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.398445+0000","last_change":"2023-07-29T02:00:01.994436+0000","last_active":"2023-07-29T02:00:02.398445+0000","last_peered":"2023-07-29T02:00:02.398445+0000","last_clean":"2023-07-29T02:00:02.398445+0000","last_became_active":"2023-07-29T02:00:01.993454+0000","last_became_peered":"2023-07-29T02:00:01.993454+0000","last_unstale":"2023-07-29T02:00:02.398445+0000","last_undegraded":"2023-07-29T02:00:02.398445+0000","last_fullsized":"2023-07-29T02:00:02.398445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:46.998657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441131+0000","last_change":"2023-07-29T01:59:57.539625+0000","last_active":"2023-07-29T02:00:02.441131+0000","last_peered":"2023-07-29T02:00:02.441131+0000","last_clean":"2023-07-29T02:00:02.441131+0000","last_became_active":"2023-07-29T01:59:57.539181+0000","last_became_peered":"2023-07-29T01:59:57.539181+0000","last_unstale":"2023-07-29T02:00:02.441131+0000","last_undegraded":"2023-07-29T02:00:02.441131+0000","last_fullsized":"2023-07-29T02:00:02.441131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:02:57.137574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979518+0000","last_change":"2023-07-29T01:59:57.966812+0000","last_active":"2023-07-29T02:00:01.979518+0000","last_peered":"2023-07-29T02:00:01.979518+0000","last_clean":"2023-07-29T02:00:01.979518+0000","last_became_active":"2023-07-29T01:59:57.966580+0000","last_became_peered":"2023-07-29T01:59:57.966580+0000","last_unstale":"2023-07-29T02:00:01.979518+0000","last_undegraded":"2023-07-29T02:00:01.979518+0000","last_fullsized":"2023-07-29T02:00:01.979518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.203628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439475+0000","last_change":"2023-07-29T02:00:01.985984+0000","last_active":"2023-07-29T02:00:02.439475+0000","last_peered":"2023-07-29T02:00:02.439475+0000","last_clean":"2023-07-29T02:00:02.439475+0000","last_became_active":"2023-07-29T02:00:01.985554+0000","last_became_peered":"2023-07-29T02:00:01.985554+0000","last_unstale":"2023-07-29T02:00:02.439475+0000","last_undegraded":"2023-07-29T02:00:02.439475+0000","last_fullsized":"2023-07-29T02:00:02.439475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:50:50.164635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957483+0000","last_change":"2023-07-29T01:59:57.537754+0000","last_active":"2023-07-29T02:00:02.957483+0000","last_peered":"2023-07-29T02:00:02.957483+0000","last_clean":"2023-07-29T02:00:02.957483+0000","last_became_active":"2023-07-29T01:59:57.537457+0000","last_became_peered":"2023-07-29T01:59:57.537457+0000","last_unstale":"2023-07-29T02:00:02.957483+0000","last_undegraded":"2023-07-29T02:00:02.957483+0000","last_fullsized":"2023-07-29T02:00:02.957483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975481+0000","last_change":"2023-07-29T01:59:57.960633+0000","last_active":"2023-07-29T02:00:01.975481+0000","last_peered":"2023-07-29T02:00:01.975481+0000","last_clean":"2023-07-29T02:00:01.975481+0000","last_became_active":"2023-07-29T01:59:57.960318+0000","last_became_peered":"2023-07-29T01:59:57.960318+0000","last_unstale":"2023-07-29T02:00:01.975481+0000","last_undegraded":"2023-07-29T02:00:01.975481+0000","last_fullsized":"2023-07-29T02:00:01.975481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:01:11.408184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967878+0000","last_change":"2023-07-29T01:59:57.960826+0000","last_active":"2023-07-29T02:00:01.967878+0000","last_peered":"2023-07-29T02:00:01.967878+0000","last_clean":"2023-07-29T02:00:01.967878+0000","last_became_active":"2023-07-29T01:59:57.959960+0000","last_became_peered":"2023-07-29T01:59:57.959960+0000","last_unstale":"2023-07-29T02:00:01.967878+0000","last_undegraded":"2023-07-29T02:00:01.967878+0000","last_fullsized":"2023-07-29T02:00:01.967878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979718+0000","last_change":"2023-07-29T01:59:57.976560+0000","last_active":"2023-07-29T02:00:01.979718+0000","last_peered":"2023-07-29T02:00:01.979718+0000","last_clean":"2023-07-29T02:00:01.979718+0000","last_became_active":"2023-07-29T01:59:57.975384+0000","last_became_peered":"2023-07-29T01:59:57.975384+0000","last_unstale":"2023-07-29T02:00:01.979718+0000","last_undegraded":"2023-07-29T02:00:01.979718+0000","last_fullsized":"2023-07-29T02:00:01.979718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971237+0000","last_change":"2023-07-29T01:59:57.967891+0000","last_active":"2023-07-29T02:00:01.971237+0000","last_peered":"2023-07-29T02:00:01.971237+0000","last_clean":"2023-07-29T02:00:01.971237+0000","last_became_active":"2023-07-29T01:59:57.967603+0000","last_became_peered":"2023-07-29T01:59:57.967603+0000","last_unstale":"2023-07-29T02:00:01.971237+0000","last_undegraded":"2023-07-29T02:00:01.971237+0000","last_fullsized":"2023-07-29T02:00:01.971237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:24:00.439433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978571+0000","last_change":"2023-07-29T01:59:57.966922+0000","last_active":"2023-07-29T02:00:01.978571+0000","last_peered":"2023-07-29T02:00:01.978571+0000","last_clean":"2023-07-29T02:00:01.978571+0000","last_became_active":"2023-07-29T01:59:57.966672+0000","last_became_peered":"2023-07-29T01:59:57.966672+0000","last_unstale":"2023-07-29T02:00:01.978571+0000","last_undegraded":"2023-07-29T02:00:01.978571+0000","last_fullsized":"2023-07-29T02:00:01.978571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972636+0000","last_change":"2023-07-29T01:59:57.968727+0000","last_active":"2023-07-29T02:00:01.972636+0000","last_peered":"2023-07-29T02:00:01.972636+0000","last_clean":"2023-07-29T02:00:01.972636+0000","last_became_active":"2023-07-29T01:59:57.968449+0000","last_became_peered":"2023-07-29T01:59:57.968449+0000","last_unstale":"2023-07-29T02:00:01.972636+0000","last_undegraded":"2023-07-29T02:00:01.972636+0000","last_fullsized":"2023-07-29T02:00:01.972636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4589,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":703776,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":331776,"data_stored":699769,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":109983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":108530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.21299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":113248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":110053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T02:00:32.793 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-29T02:00:32.793 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-29T02:00:32.794 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-29T02:00:32.794 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-29T02:00:32.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.961+0000 7fe17efd3700 1 Processor -- start 2023-07-29T02:00:32.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.961+0000 7fe17efd3700 1 -- start start 2023-07-29T02:00:32.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.961+0000 7fe17efd3700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe17806e1e0 0x7fe178156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.961+0000 7fe17efd3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe178151410 0x7fe1780c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.961+0000 7fe17efd3700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1780720b0 con 0x7fe1780c57b0 2023-07-29T02:00:32.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.961+0000 7fe17efd3700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe178071240 con 0x7fe17806e1e0 2023-07-29T02:00:32.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.961+0000 7fe17efd3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe178072370 con 0x7fe178151410 2023-07-29T02:00:32.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.962+0000 7fe177fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe17806e1e0 0x7fe178156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.962+0000 7fe177fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe17806e1e0 0x7fe178156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56588/0 (socket says 172.21.15.42:56588) 2023-07-29T02:00:32.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.962+0000 7fe177fff700 1 -- 172.21.15.42:0/321165034 learned_addr learned my addr 172.21.15.42:0/321165034 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:32.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.962+0000 7fe17d570700 1 --2- 172.21.15.42:0/321165034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe178151410 0x7fe1780c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.962+0000 7fe177fff700 1 -- 172.21.15.42:0/321165034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe178151410 msgr2=0x7fe1780c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:32.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.962+0000 7fe177fff700 1 --2- 172.21.15.42:0/321165034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe178151410 0x7fe1780c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.962+0000 7fe177fff700 1 -- 172.21.15.42:0/321165034 >> v1:172.21.15.144:6789/0 conn(0x7fe1780c57b0 legacy=0x7fe178150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:32.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.962+0000 7fe177fff700 1 -- 172.21.15.42:0/321165034 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe178072650 con 0x7fe17806e1e0 2023-07-29T02:00:32.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.962+0000 7fe177fff700 1 --2- 172.21.15.42:0/321165034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe17806e1e0 0x7fe178156ef0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe1640098f0 tx=0x7fe164009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0ee6c3266842aa server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:32.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.962+0000 7fe1777fe700 1 -- 172.21.15.42:0/321165034 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16400b8a0 con 0x7fe17806e1e0 2023-07-29T02:00:32.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.962+0000 7fe1777fe700 1 -- 172.21.15.42:0/321165034 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16400ba00 con 0x7fe17806e1e0 2023-07-29T02:00:32.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.962+0000 7fe1777fe700 1 -- 172.21.15.42:0/321165034 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16400bd90 con 0x7fe17806e1e0 2023-07-29T02:00:32.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.963+0000 7fe17efd3700 1 -- 172.21.15.42:0/321165034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe17806e1e0 msgr2=0x7fe178156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:32.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.963+0000 7fe17efd3700 1 --2- 172.21.15.42:0/321165034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe17806e1e0 0x7fe178156ef0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe1640098f0 tx=0x7fe164009c00 comp rx=0 tx=0).stop 2023-07-29T02:00:32.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.963+0000 7fe17efd3700 1 -- 172.21.15.42:0/321165034 shutdown_connections 2023-07-29T02:00:32.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.963+0000 7fe17efd3700 1 --2- 172.21.15.42:0/321165034 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe178151410 0x7fe1780c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.963+0000 7fe17efd3700 1 --2- 172.21.15.42:0/321165034 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe17806e1e0 0x7fe178156ef0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.963+0000 7fe17efd3700 1 -- 172.21.15.42:0/321165034 >> 172.21.15.42:0/321165034 conn(0x7fe1780c8970 msgr2=0x7fe1780c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:32.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.963+0000 7fe17efd3700 1 -- 172.21.15.42:0/321165034 shutdown_connections 2023-07-29T02:00:32.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.963+0000 7fe17efd3700 1 -- 172.21.15.42:0/321165034 wait complete. 2023-07-29T02:00:32.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.964+0000 7fe17efd3700 1 Processor -- start 2023-07-29T02:00:32.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.964+0000 7fe17efd3700 1 -- start start 2023-07-29T02:00:32.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.965+0000 7fe17efd3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe17806e1e0 0x7fe178155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.965+0000 7fe17efd3700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1780c57b0 0x7fe1781e1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.965+0000 7fe17efd3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe178151410 0x7fe1781e15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.965+0000 7fe17efd3700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780cad10 con 0x7fe1780c57b0 2023-07-29T02:00:32.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.965+0000 7fe17efd3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1781e0300 con 0x7fe17806e1e0 2023-07-29T02:00:32.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.965+0000 7fe17efd3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1781e2810 con 0x7fe178151410 2023-07-29T02:00:32.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.965+0000 7fe177fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1780c57b0 0x7fe1781e1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.965+0000 7fe177fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1780c57b0 0x7fe1781e1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56594/0 (socket says 172.21.15.42:56594) 2023-07-29T02:00:32.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.965+0000 7fe177fff700 1 -- 172.21.15.42:0/1035383813 learned_addr learned my addr 172.21.15.42:0/1035383813 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:32.958 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.965+0000 7fe17cd6f700 1 --2- 172.21.15.42:0/1035383813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe17806e1e0 0x7fe178155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.958 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.965+0000 7fe17d570700 1 --2- 172.21.15.42:0/1035383813 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe178151410 0x7fe1781e15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.958 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.965+0000 7fe177fff700 1 -- 172.21.15.42:0/1035383813 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe178151410 msgr2=0x7fe1781e15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:32.958 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.965+0000 7fe177fff700 1 --2- 172.21.15.42:0/1035383813 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe178151410 0x7fe1781e15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.958 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.965+0000 7fe177fff700 1 -- 172.21.15.42:0/1035383813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe17806e1e0 msgr2=0x7fe178155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:32.958 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.965+0000 7fe177fff700 1 --2- 172.21.15.42:0/1035383813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe17806e1e0 0x7fe178155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:32.958 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.965+0000 7fe177fff700 1 -- 172.21.15.42:0/1035383813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe164009550 con 0x7fe1780c57b0 2023-07-29T02:00:32.958 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.965+0000 7fe17cd6f700 1 --2- 172.21.15.42:0/1035383813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe17806e1e0 0x7fe178155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:32.959 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.965+0000 7fe17d570700 1 --2- 172.21.15.42:0/1035383813 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe178151410 0x7fe1781e15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:32.959 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.966+0000 7fe177fff700 1 --2- 172.21.15.42:0/1035383813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1780c57b0 0x7fe1781e1080 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe164000c00 tx=0x7fe164004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:32.959 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.966+0000 7fe1757fa700 1 -- 172.21.15.42:0/1035383813 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164004480 con 0x7fe1780c57b0 2023-07-29T02:00:32.959 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.966+0000 7fe1757fa700 1 -- 172.21.15.42:0/1035383813 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16401f070 con 0x7fe1780c57b0 2023-07-29T02:00:32.959 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.966+0000 7fe17efd3700 1 -- 172.21.15.42:0/1035383813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1781e2af0 con 0x7fe1780c57b0 2023-07-29T02:00:32.959 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.966+0000 7fe1757fa700 1 -- 172.21.15.42:0/1035383813 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1640038c0 con 0x7fe1780c57b0 2023-07-29T02:00:32.959 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.966+0000 7fe17efd3700 1 -- 172.21.15.42:0/1035383813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1781e0880 con 0x7fe1780c57b0 2023-07-29T02:00:32.960 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.967+0000 7fe17efd3700 1 -- 172.21.15.42:0/1035383813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe178074740 con 0x7fe1780c57b0 2023-07-29T02:00:32.963 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.967+0000 7fe1757fa700 1 -- 172.21.15.42:0/1035383813 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fe164021030 con 0x7fe1780c57b0 2023-07-29T02:00:32.963 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.968+0000 7fe1757fa700 1 --2- 172.21.15.42:0/1035383813 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe15c06a660 0x7fe15c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:32.963 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.968+0000 7fe1757fa700 1 -- 172.21.15.42:0/1035383813 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe16408a0f0 con 0x7fe1780c57b0 2023-07-29T02:00:32.964 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.968+0000 7fe17cd6f700 1 --2- 172.21.15.42:0/1035383813 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe15c06a660 0x7fe15c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:32.964 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.968+0000 7fe17cd6f700 1 --2- 172.21.15.42:0/1035383813 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe15c06a660 0x7fe15c06cb10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe16c000f60 tx=0x7fe16c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:32.964 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:32.972+0000 7fe1757fa700 1 -- 172.21.15.42:0/1035383813 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fe164055200 con 0x7fe1780c57b0 2023-07-29T02:00:33.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.217+0000 7fe17efd3700 1 -- 172.21.15.42:0/1035383813 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe1780c6750 con 0x7fe1780c57b0 2023-07-29T02:00:33.206 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.217+0000 7fe1757fa700 1 -- 172.21.15.42:0/1035383813 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe1780c6750 con 0x7fe1780c57b0 2023-07-29T02:00:33.206 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:33.206 INFO:teuthology.orchestra.run.smithi042.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-29T02:00:33.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.220+0000 7fe17efd3700 1 -- 172.21.15.42:0/1035383813 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe15c06a660 msgr2=0x7fe15c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:33.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.220+0000 7fe17efd3700 1 --2- 172.21.15.42:0/1035383813 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe15c06a660 0x7fe15c06cb10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe16c000f60 tx=0x7fe16c009040 comp rx=0 tx=0).stop 2023-07-29T02:00:33.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.220+0000 7fe17efd3700 1 -- 172.21.15.42:0/1035383813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1780c57b0 msgr2=0x7fe1781e1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:33.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.220+0000 7fe17efd3700 1 --2- 172.21.15.42:0/1035383813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1780c57b0 0x7fe1781e1080 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe164000c00 tx=0x7fe164004750 comp rx=0 tx=0).stop 2023-07-29T02:00:33.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.220+0000 7fe17efd3700 1 -- 172.21.15.42:0/1035383813 shutdown_connections 2023-07-29T02:00:33.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.220+0000 7fe17efd3700 1 --2- 172.21.15.42:0/1035383813 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe15c06a660 0x7fe15c06cb10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:33.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.220+0000 7fe17efd3700 1 --2- 172.21.15.42:0/1035383813 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe178151410 0x7fe1781e15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:33.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.220+0000 7fe17efd3700 1 --2- 172.21.15.42:0/1035383813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe17806e1e0 0x7fe178155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:33.210 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.220+0000 7fe17efd3700 1 --2- 172.21.15.42:0/1035383813 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe1780c57b0 0x7fe1781e1080 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:33.210 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.220+0000 7fe17efd3700 1 -- 172.21.15.42:0/1035383813 >> 172.21.15.42:0/1035383813 conn(0x7fe1780c8970 msgr2=0x7fe17806cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:33.210 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.220+0000 7fe17efd3700 1 -- 172.21.15.42:0/1035383813 shutdown_connections 2023-07-29T02:00:33.210 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.220+0000 7fe17efd3700 1 -- 172.21.15.42:0/1035383813 wait complete. 2023-07-29T02:00:33.221 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-29T02:00:33.221 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T02:00:33.347 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.358+0000 7f1a0d96d700 1 Processor -- start 2023-07-29T02:00:33.347 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.358+0000 7f1a0d96d700 1 -- start start 2023-07-29T02:00:33.348 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.359+0000 7f1a0d96d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a081567d0 0x7f1a08159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:33.349 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.359+0000 7f1a0d96d700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a080c7700 con 0x7f1a080c7210 2023-07-29T02:00:33.349 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.359+0000 7f1a0d96d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a08159170 con 0x7f1a08159e90 2023-07-29T02:00:33.349 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.359+0000 7f1a0d96d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0806b160 con 0x7f1a081567d0 2023-07-29T02:00:33.349 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.359+0000 7f1a067fc700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f1a080c7210 0x7f1a0806cd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50404/0 (socket says 172.21.15.42:50404) 2023-07-29T02:00:33.350 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.359+0000 7f1a067fc700 1 -- 172.21.15.42:0/3582201984 learned_addr learned my addr 172.21.15.42:0/3582201984 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:33.350 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.359+0000 7f1a06ffd700 1 --2- 172.21.15.42:0/3582201984 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a081567d0 0x7f1a08159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:33.350 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.360+0000 7f1a05ffb700 1 -- 172.21.15.42:0/3582201984 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216213682 0 0) 0x7f1a080c7700 con 0x7f1a080c7210 2023-07-29T02:00:33.350 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.360+0000 7f1a05ffb700 1 -- 172.21.15.42:0/3582201984 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19f00035b0 con 0x7f1a080c7210 2023-07-29T02:00:33.350 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.360+0000 7f1a05ffb700 1 -- 172.21.15.42:0/3582201984 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4097739436 0 0) 0x7f1a08159170 con 0x7f1a08159e90 2023-07-29T02:00:33.350 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.360+0000 7f1a06ffd700 1 -- 172.21.15.42:0/3582201984 >> v1:172.21.15.144:6789/0 conn(0x7f1a08159e90 legacy=0x7f1a08163a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:33.350 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.360+0000 7f1a06ffd700 1 -- 172.21.15.42:0/3582201984 >> v1:172.21.15.42:6789/0 conn(0x7f1a080c7210 legacy=0x7f1a0806cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:33.351 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.360+0000 7f1a06ffd700 1 -- 172.21.15.42:0/3582201984 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a08156ba0 con 0x7f1a081567d0 2023-07-29T02:00:33.351 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.360+0000 7f1a06ffd700 1 --2- 172.21.15.42:0/3582201984 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a081567d0 0x7f1a08159950 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009870 tx=0x7f19fc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=202f32d074a5c46f server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:33.351 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.360+0000 7f1a05ffb700 1 -- 172.21.15.42:0/3582201984 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc011830 con 0x7f1a081567d0 2023-07-29T02:00:33.351 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.360+0000 7f1a05ffb700 1 -- 172.21.15.42:0/3582201984 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc011990 con 0x7f1a081567d0 2023-07-29T02:00:33.351 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.360+0000 7f1a05ffb700 1 -- 172.21.15.42:0/3582201984 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc011d00 con 0x7f1a081567d0 2023-07-29T02:00:33.354 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.361+0000 7f1a0d96d700 1 -- 172.21.15.42:0/3582201984 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a081567d0 msgr2=0x7f1a08159950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:33.354 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.361+0000 7f1a0d96d700 1 --2- 172.21.15.42:0/3582201984 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a081567d0 0x7f1a08159950 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009870 tx=0x7f19fc009b80 comp rx=0 tx=0).stop 2023-07-29T02:00:33.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.361+0000 7f1a0d96d700 1 -- 172.21.15.42:0/3582201984 shutdown_connections 2023-07-29T02:00:33.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.361+0000 7f1a0d96d700 1 --2- 172.21.15.42:0/3582201984 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a081567d0 0x7f1a08159950 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:33.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.361+0000 7f1a0d96d700 1 -- 172.21.15.42:0/3582201984 >> 172.21.15.42:0/3582201984 conn(0x7f1a080c8970 msgr2=0x7f1a080c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:33.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.361+0000 7f1a0d96d700 1 -- 172.21.15.42:0/3582201984 shutdown_connections 2023-07-29T02:00:33.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.361+0000 7f1a0d96d700 1 -- 172.21.15.42:0/3582201984 wait complete. 2023-07-29T02:00:33.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.362+0000 7f1a0d96d700 1 Processor -- start 2023-07-29T02:00:33.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.362+0000 7f1a0d96d700 1 -- start start 2023-07-29T02:00:33.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.363+0000 7f1a0d96d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a080c7210 0x7f1a08151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:33.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.363+0000 7f1a0d96d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a081567d0 0x7f1a081efc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:33.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.363+0000 7f1a0d96d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a08159e90 0x7f1a081f01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:33.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.363+0000 7f1a0d96d700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a081586a0 con 0x7f1a080c7210 2023-07-29T02:00:33.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.363+0000 7f1a0d96d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a08159040 con 0x7f1a08159e90 2023-07-29T02:00:33.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.363+0000 7f1a0d96d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a08157a90 con 0x7f1a081567d0 2023-07-29T02:00:33.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.363+0000 7f1a06ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a080c7210 0x7f1a08151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:33.357 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.363+0000 7f1a06ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a080c7210 0x7f1a08151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56606/0 (socket says 172.21.15.42:56606) 2023-07-29T02:00:33.357 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.363+0000 7f1a06ffd700 1 -- 172.21.15.42:0/2621526480 learned_addr learned my addr 172.21.15.42:0/2621526480 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:33.357 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.363+0000 7f1a067fc700 1 --2- 172.21.15.42:0/2621526480 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a081567d0 0x7f1a081efc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:33.357 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.363+0000 7f1a077fe700 1 --2- 172.21.15.42:0/2621526480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a08159e90 0x7f1a081f01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:33.357 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.363+0000 7f1a06ffd700 1 -- 172.21.15.42:0/2621526480 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a081567d0 msgr2=0x7f1a081efc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:33.357 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.363+0000 7f1a06ffd700 1 --2- 172.21.15.42:0/2621526480 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a081567d0 0x7f1a081efc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:33.357 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.363+0000 7f1a06ffd700 1 -- 172.21.15.42:0/2621526480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a08159e90 msgr2=0x7f1a081f01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:33.357 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.363+0000 7f1a06ffd700 1 --2- 172.21.15.42:0/2621526480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a08159e90 0x7f1a081f01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:33.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.363+0000 7f1a06ffd700 1 -- 172.21.15.42:0/2621526480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19fc0094a0 con 0x7f1a080c7210 2023-07-29T02:00:33.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.363+0000 7f1a077fe700 1 --2- 172.21.15.42:0/2621526480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a08159e90 0x7f1a081f01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:33.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.363+0000 7f1a06ffd700 1 --2- 172.21.15.42:0/2621526480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a080c7210 0x7f1a08151ff0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0097c0 tx=0x7f19fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:33.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.364+0000 7f19effff700 1 -- 172.21.15.42:0/2621526480 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0045d0 con 0x7f1a080c7210 2023-07-29T02:00:33.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.364+0000 7f19effff700 1 -- 172.21.15.42:0/2621526480 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc01f070 con 0x7f1a080c7210 2023-07-29T02:00:33.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.364+0000 7f19effff700 1 -- 172.21.15.42:0/2621526480 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0038e0 con 0x7f1a080c7210 2023-07-29T02:00:33.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.364+0000 7f1a0d96d700 1 -- 172.21.15.42:0/2621526480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a08157d70 con 0x7f1a080c7210 2023-07-29T02:00:33.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.364+0000 7f1a0d96d700 1 -- 172.21.15.42:0/2621526480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a08158330 con 0x7f1a080c7210 2023-07-29T02:00:33.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.365+0000 7f1a0d96d700 1 -- 172.21.15.42:0/2621526480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a08074740 con 0x7f1a080c7210 2023-07-29T02:00:33.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.365+0000 7f19effff700 1 -- 172.21.15.42:0/2621526480 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f19fc003a40 con 0x7f1a080c7210 2023-07-29T02:00:33.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.365+0000 7f19effff700 1 --2- 172.21.15.42:0/2621526480 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f19f406a660 0x7f19f406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:33.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.366+0000 7f19effff700 1 -- 172.21.15.42:0/2621526480 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f19fc021070 con 0x7f1a080c7210 2023-07-29T02:00:33.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.366+0000 7f1a067fc700 1 --2- 172.21.15.42:0/2621526480 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f19f406a660 0x7f19f406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:33.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.366+0000 7f1a067fc700 1 --2- 172.21.15.42:0/2621526480 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f19f406a660 0x7f19f406cb10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1a081519a0 tx=0x7f19f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:33.360 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.370+0000 7f19effff700 1 -- 172.21.15.42:0/2621526480 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f19fc0559a0 con 0x7f1a080c7210 2023-07-29T02:00:33.562 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.574+0000 7f1a0d96d700 1 -- 172.21.15.42:0/2621526480 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a081584c0 con 0x7f1a080c7210 2023-07-29T02:00:33.563 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.575+0000 7f19effff700 1 -- 172.21.15.42:0/2621526480 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19690 (secure 0 0 0) 0x7f19fc058fc0 con 0x7f1a080c7210 2023-07-29T02:00:33.564 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:33.564 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T02:00:02.394460+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T01:59:55.827461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T01:59:56.924040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-29T01:59:59.996470+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T02:00:33.566 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.577+0000 7f1a0d96d700 1 -- 172.21.15.42:0/2621526480 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f19f406a660 msgr2=0x7f19f406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:33.566 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.577+0000 7f1a0d96d700 1 --2- 172.21.15.42:0/2621526480 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f19f406a660 0x7f19f406cb10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1a081519a0 tx=0x7f19f8009040 comp rx=0 tx=0).stop 2023-07-29T02:00:33.566 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.577+0000 7f1a0d96d700 1 -- 172.21.15.42:0/2621526480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a080c7210 msgr2=0x7f1a08151ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:33.566 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.577+0000 7f1a0d96d700 1 --2- 172.21.15.42:0/2621526480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a080c7210 0x7f1a08151ff0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0097c0 tx=0x7f19fc004750 comp rx=0 tx=0).stop 2023-07-29T02:00:33.566 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.577+0000 7f1a0d96d700 1 -- 172.21.15.42:0/2621526480 shutdown_connections 2023-07-29T02:00:33.566 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.577+0000 7f1a0d96d700 1 --2- 172.21.15.42:0/2621526480 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f19f406a660 0x7f19f406cb10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:33.566 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.577+0000 7f1a0d96d700 1 --2- 172.21.15.42:0/2621526480 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a08159e90 0x7f1a081f01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:33.567 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.577+0000 7f1a0d96d700 1 --2- 172.21.15.42:0/2621526480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1a080c7210 0x7f1a08151ff0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:33.567 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.577+0000 7f1a0d96d700 1 --2- 172.21.15.42:0/2621526480 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1a081567d0 0x7f1a081efc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:33.567 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.577+0000 7f1a0d96d700 1 -- 172.21.15.42:0/2621526480 >> 172.21.15.42:0/2621526480 conn(0x7f1a080c8970 msgr2=0x7f1a08153610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:33.567 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.577+0000 7f1a0d96d700 1 -- 172.21.15.42:0/2621526480 shutdown_connections 2023-07-29T02:00:33.567 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.577+0000 7f1a0d96d700 1 -- 172.21.15.42:0/2621526480 wait complete. 2023-07-29T02:00:33.578 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-29T01:59:50.906228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-29T01:59:51.290583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T01:59:55.827461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T01:59:56.924040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-29T01:59:59.996470+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-29T02:00:33.579 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-29T02:00:33.707 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.718+0000 7f4e08ab1700 1 Processor -- start 2023-07-29T02:00:33.707 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.718+0000 7f4e08ab1700 1 -- start start 2023-07-29T02:00:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.719+0000 7f4e08ab1700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4e040ccfa0 0x7f4e040cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.719+0000 7f4e08ab1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e040c3890 0x7f4e040c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:33.708 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.719+0000 7f4e08ab1700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0415b1d0 con 0x7f4e0406f530 2023-07-29T02:00:33.709 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.719+0000 7f4e08ab1700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e040c9820 con 0x7f4e040ccfa0 2023-07-29T02:00:33.709 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.719+0000 7f4e08ab1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e040cd8b0 con 0x7f4e040c3890 2023-07-29T02:00:33.709 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.720+0000 7f4e0259c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4e040ccfa0 0x7f4e040cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:33.709 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.720+0000 7f4e02d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e040c3890 0x7f4e040c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:33.709 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.720+0000 7f4e0259c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4e040ccfa0 0x7f4e040cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:39992/0 (socket says 172.21.15.42:39992) 2023-07-29T02:00:33.709 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.720+0000 7f4e02d9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e040c3890 0x7f4e040c3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:57132/0 (socket says 172.21.15.42:57132) 2023-07-29T02:00:33.710 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.720+0000 7f4e0259c700 1 -- 172.21.15.42:0/2599802912 learned_addr learned my addr 172.21.15.42:0/2599802912 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:33.711 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.720+0000 7f4e02d9d700 1 -- 172.21.15.42:0/2599802912 >> v2:172.21.15.144:3300/0 conn(0x7f4e040ccfa0 msgr2=0x7f4e040cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:33.711 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.720+0000 7f4e02d9d700 1 --2- 172.21.15.42:0/2599802912 >> v2:172.21.15.144:3300/0 conn(0x7f4e040ccfa0 0x7f4e040cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:33.711 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.720+0000 7f4e02d9d700 1 -- 172.21.15.42:0/2599802912 >> v1:172.21.15.144:6789/0 conn(0x7f4e0406f530 legacy=0x7f4e0406dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:33.711 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.720+0000 7f4e02d9d700 1 -- 172.21.15.42:0/2599802912 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0415a650 con 0x7f4e040c3890 2023-07-29T02:00:33.711 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.720+0000 7f4e02d9d700 1 --2- 172.21.15.42:0/2599802912 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e040c3890 0x7f4e040c3d30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009d90 tx=0x7f4dfc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=640b7d07cc4ea988 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:33.712 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.721+0000 7f4e0159a700 1 -- 172.21.15.42:0/2599802912 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc00e070 con 0x7f4e040c3890 2023-07-29T02:00:33.712 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.721+0000 7f4e0159a700 1 -- 172.21.15.42:0/2599802912 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc00bb20 con 0x7f4e040c3890 2023-07-29T02:00:33.712 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.721+0000 7f4e0159a700 1 -- 172.21.15.42:0/2599802912 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc012430 con 0x7f4e040c3890 2023-07-29T02:00:33.712 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.721+0000 7f4e08ab1700 1 -- 172.21.15.42:0/2599802912 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e040c3890 msgr2=0x7f4e040c3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:33.712 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.721+0000 7f4e08ab1700 1 --2- 172.21.15.42:0/2599802912 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e040c3890 0x7f4e040c3d30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009d90 tx=0x7f4dfc00b330 comp rx=0 tx=0).stop 2023-07-29T02:00:33.712 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.721+0000 7f4e08ab1700 1 -- 172.21.15.42:0/2599802912 shutdown_connections 2023-07-29T02:00:33.713 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.721+0000 7f4e08ab1700 1 --2- 172.21.15.42:0/2599802912 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e040c3890 0x7f4e040c3d30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:33.713 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.721+0000 7f4e08ab1700 1 --2- 172.21.15.42:0/2599802912 >> v2:172.21.15.144:3300/0 conn(0x7f4e040ccfa0 0x7f4e040cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:33.713 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.721+0000 7f4e08ab1700 1 -- 172.21.15.42:0/2599802912 >> 172.21.15.42:0/2599802912 conn(0x7f4e04061190 msgr2=0x7f4e04061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:33.713 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.721+0000 7f4e08ab1700 1 -- 172.21.15.42:0/2599802912 shutdown_connections 2023-07-29T02:00:33.713 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.721+0000 7f4e08ab1700 1 -- 172.21.15.42:0/2599802912 wait complete. 2023-07-29T02:00:33.713 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.723+0000 7f4e08ab1700 1 Processor -- start 2023-07-29T02:00:33.713 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.723+0000 7f4e08ab1700 1 -- start start 2023-07-29T02:00:33.715 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.723+0000 7f4e08ab1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e0406f530 0x7f4e04155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:33.715 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.723+0000 7f4e08ab1700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e040c3890 0x7f4e041ed390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:33.715 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.724+0000 7f4e08ab1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e040ccfa0 0x7f4e041433c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:33.716 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.724+0000 7f4e08ab1700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e04155890 con 0x7f4e040c3890 2023-07-29T02:00:33.716 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.724+0000 7f4e08ab1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e04158bd0 con 0x7f4e040ccfa0 2023-07-29T02:00:33.716 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.724+0000 7f4e08ab1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e041ed8d0 con 0x7f4e0406f530 2023-07-29T02:00:33.716 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.724+0000 7f4e01d9b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e040c3890 0x7f4e041ed390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:33.716 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.724+0000 7f4e01d9b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e040c3890 0x7f4e041ed390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56622/0 (socket says 172.21.15.42:56622) 2023-07-29T02:00:33.716 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.724+0000 7f4e01d9b700 1 -- 172.21.15.42:0/3599415302 learned_addr learned my addr 172.21.15.42:0/3599415302 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.724+0000 7f4e0259c700 1 --2- 172.21.15.42:0/3599415302 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e0406f530 0x7f4e04155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.724+0000 7f4e02d9d700 1 --2- 172.21.15.42:0/3599415302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e040ccfa0 0x7f4e041433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.724+0000 7f4e01d9b700 1 -- 172.21.15.42:0/3599415302 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e0406f530 msgr2=0x7f4e04155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.724+0000 7f4e01d9b700 1 --2- 172.21.15.42:0/3599415302 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e0406f530 0x7f4e04155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.724+0000 7f4e01d9b700 1 -- 172.21.15.42:0/3599415302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e040ccfa0 msgr2=0x7f4e041433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.724+0000 7f4e01d9b700 1 --2- 172.21.15.42:0/3599415302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e040ccfa0 0x7f4e041433c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:33.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.724+0000 7f4e01d9b700 1 -- 172.21.15.42:0/3599415302 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc009a70 con 0x7f4e040c3890 2023-07-29T02:00:33.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.724+0000 7f4e01d9b700 1 --2- 172.21.15.42:0/3599415302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e040c3890 0x7f4e041ed390 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4df400c430 tx=0x7f4df400c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:33.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.724+0000 7f4df2ffd700 1 -- 172.21.15.42:0/3599415302 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df40050d0 con 0x7f4e040c3890 2023-07-29T02:00:33.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.724+0000 7f4df2ffd700 1 -- 172.21.15.42:0/3599415302 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df4005250 con 0x7f4e040c3890 2023-07-29T02:00:33.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.724+0000 7f4df2ffd700 1 -- 172.21.15.42:0/3599415302 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4006860 con 0x7f4e040c3890 2023-07-29T02:00:33.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.724+0000 7f4e08ab1700 1 -- 172.21.15.42:0/3599415302 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e041ee500 con 0x7f4e040c3890 2023-07-29T02:00:33.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.724+0000 7f4e08ab1700 1 -- 172.21.15.42:0/3599415302 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0415a090 con 0x7f4e040c3890 2023-07-29T02:00:33.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.725+0000 7f4e08ab1700 1 -- 172.21.15.42:0/3599415302 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e041ee690 con 0x7f4e040c3890 2023-07-29T02:00:33.719 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.726+0000 7f4df2ffd700 1 -- 172.21.15.42:0/3599415302 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f4df4003680 con 0x7f4e040c3890 2023-07-29T02:00:33.719 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.726+0000 7f4df2ffd700 1 --2- 172.21.15.42:0/3599415302 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4de406a660 0x7f4de406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:33.719 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.726+0000 7f4df2ffd700 1 -- 172.21.15.42:0/3599415302 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4df4087e90 con 0x7f4e040c3890 2023-07-29T02:00:33.719 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.726+0000 7f4e0259c700 1 --2- 172.21.15.42:0/3599415302 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4de406a660 0x7f4de406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:33.719 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.727+0000 7f4e0259c700 1 --2- 172.21.15.42:0/3599415302 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4de406a660 0x7f4de406cb10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4df8006cf0 tx=0x7f4df8009290 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:33.719 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.731+0000 7f4df2ffd700 1 -- 172.21.15.42:0/3599415302 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f4df404b2c0 con 0x7f4e040c3890 2023-07-29T02:00:33.915 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.927+0000 7f4e08ab1700 1 -- 172.21.15.42:0/3599415302 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4e0404ea50 con 0x7f4e040c3890 2023-07-29T02:00:33.916 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.927+0000 7f4df2ffd700 1 -- 172.21.15.42:0/3599415302 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4df4052fa0 con 0x7f4e040c3890 2023-07-29T02:00:33.916 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 8 2023-07-29T02:00:33.918 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.929+0000 7f4e08ab1700 1 -- 172.21.15.42:0/3599415302 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4de406a660 msgr2=0x7f4de406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:33.918 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.929+0000 7f4e08ab1700 1 --2- 172.21.15.42:0/3599415302 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4de406a660 0x7f4de406cb10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4df8006cf0 tx=0x7f4df8009290 comp rx=0 tx=0).stop 2023-07-29T02:00:33.918 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.929+0000 7f4e08ab1700 1 -- 172.21.15.42:0/3599415302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e040c3890 msgr2=0x7f4e041ed390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:33.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.929+0000 7f4e08ab1700 1 --2- 172.21.15.42:0/3599415302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e040c3890 0x7f4e041ed390 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4df400c430 tx=0x7f4df400c740 comp rx=0 tx=0).stop 2023-07-29T02:00:33.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.929+0000 7f4e08ab1700 1 -- 172.21.15.42:0/3599415302 shutdown_connections 2023-07-29T02:00:33.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.929+0000 7f4e08ab1700 1 --2- 172.21.15.42:0/3599415302 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4de406a660 0x7f4de406cb10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:33.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.929+0000 7f4e08ab1700 1 --2- 172.21.15.42:0/3599415302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e040ccfa0 0x7f4e041433c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:33.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.929+0000 7f4e08ab1700 1 --2- 172.21.15.42:0/3599415302 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e0406f530 0x7f4e04155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:33.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.929+0000 7f4e08ab1700 1 --2- 172.21.15.42:0/3599415302 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e040c3890 0x7f4e041ed390 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:33.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.929+0000 7f4e08ab1700 1 -- 172.21.15.42:0/3599415302 >> 172.21.15.42:0/3599415302 conn(0x7f4e04061190 msgr2=0x7f4e040c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:33.920 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.929+0000 7f4e08ab1700 1 -- 172.21.15.42:0/3599415302 shutdown_connections 2023-07-29T02:00:33.920 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:33.930+0000 7f4e08ab1700 1 -- 172.21.15.42:0/3599415302 wait complete. 2023-07-29T02:00:33.930 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-29T02:00:34.060 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.071+0000 7efdcc80f700 1 Processor -- start 2023-07-29T02:00:34.060 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.071+0000 7efdcc80f700 1 -- start start 2023-07-29T02:00:34.062 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.072+0000 7efdcc80f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efdc81531a0 0x7efdc806f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.062 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.072+0000 7efdcc80f700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efdc80c8580 0x7efdc815c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.063 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.072+0000 7efdcc80f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc806c870 con 0x7efdc8071840 2023-07-29T02:00:34.063 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.072+0000 7efdcc80f700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc80c74a0 con 0x7efdc80c8580 2023-07-29T02:00:34.063 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.072+0000 7efdcc80f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc806fa50 con 0x7efdc81531a0 2023-07-29T02:00:34.063 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.072+0000 7efdc5d9b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efdc80c8580 0x7efdc815c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.063 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.072+0000 7efdc5d9b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efdc80c8580 0x7efdc815c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56628/0 (socket says 172.21.15.42:56628) 2023-07-29T02:00:34.064 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.072+0000 7efdc5d9b700 1 -- 172.21.15.42:0/3883115919 learned_addr learned my addr 172.21.15.42:0/3883115919 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:34.064 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.073+0000 7efdc659c700 1 --2- 172.21.15.42:0/3883115919 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efdc81531a0 0x7efdc806f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.064 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.073+0000 7efdc5d9b700 1 -- 172.21.15.42:0/3883115919 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efdc81531a0 msgr2=0x7efdc806f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:34.064 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.073+0000 7efdc5d9b700 1 --2- 172.21.15.42:0/3883115919 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efdc81531a0 0x7efdc806f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.065 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.073+0000 7efdc5d9b700 1 -- 172.21.15.42:0/3883115919 >> v1:172.21.15.144:6789/0 conn(0x7efdc8071840 legacy=0x7efdc806a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:34.065 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.073+0000 7efdc5d9b700 1 -- 172.21.15.42:0/3883115919 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc815ca00 con 0x7efdc80c8580 2023-07-29T02:00:34.065 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.073+0000 7efdc5d9b700 1 --2- 172.21.15.42:0/3883115919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdc80c8580 0x7efdc815c4c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efdb80098f0 tx=0x7efdb8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471f520296064bc6 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:34.065 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.073+0000 7efdc559a700 1 -- 172.21.15.42:0/3883115919 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb8004230 con 0x7efdc80c8580 2023-07-29T02:00:34.065 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.073+0000 7efdc559a700 1 -- 172.21.15.42:0/3883115919 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb8004390 con 0x7efdc80c8580 2023-07-29T02:00:34.065 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.073+0000 7efdc559a700 1 -- 172.21.15.42:0/3883115919 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb80036a0 con 0x7efdc80c8580 2023-07-29T02:00:34.065 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.073+0000 7efdcc80f700 1 -- 172.21.15.42:0/3883115919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdc80c8580 msgr2=0x7efdc815c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:34.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.073+0000 7efdcc80f700 1 --2- 172.21.15.42:0/3883115919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdc80c8580 0x7efdc815c4c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efdb80098f0 tx=0x7efdb8009c00 comp rx=0 tx=0).stop 2023-07-29T02:00:34.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.074+0000 7efdcc80f700 1 -- 172.21.15.42:0/3883115919 shutdown_connections 2023-07-29T02:00:34.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.074+0000 7efdcc80f700 1 --2- 172.21.15.42:0/3883115919 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efdc81531a0 0x7efdc806f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.074+0000 7efdcc80f700 1 --2- 172.21.15.42:0/3883115919 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdc80c8580 0x7efdc815c4c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.074+0000 7efdcc80f700 1 -- 172.21.15.42:0/3883115919 >> 172.21.15.42:0/3883115919 conn(0x7efdc80cbf10 msgr2=0x7efdc80cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:34.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.074+0000 7efdcc80f700 1 -- 172.21.15.42:0/3883115919 shutdown_connections 2023-07-29T02:00:34.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.074+0000 7efdcc80f700 1 -- 172.21.15.42:0/3883115919 wait complete. 2023-07-29T02:00:34.068 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.075+0000 7efdcc80f700 1 Processor -- start 2023-07-29T02:00:34.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.075+0000 7efdcc80f700 1 -- start start 2023-07-29T02:00:34.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.076+0000 7efdcc80f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdc8071840 0x7efdc815a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.076+0000 7efdcc80f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efdc80c8580 0x7efdc814f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.076+0000 7efdcc80f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efdc81531a0 0x7efdc814fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.076+0000 7efdcc80f700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc814ba10 con 0x7efdc8071840 2023-07-29T02:00:34.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.076+0000 7efdcc80f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc814bcf0 con 0x7efdc80c8580 2023-07-29T02:00:34.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.076+0000 7efdcc80f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc814bfd0 con 0x7efdc81531a0 2023-07-29T02:00:34.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.076+0000 7efdc659c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdc8071840 0x7efdc815a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.076+0000 7efdc659c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdc8071840 0x7efdc815a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56634/0 (socket says 172.21.15.42:56634) 2023-07-29T02:00:34.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.076+0000 7efdc659c700 1 -- 172.21.15.42:0/14973108 learned_addr learned my addr 172.21.15.42:0/14973108 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:34.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.076+0000 7efdc6d9d700 1 --2- 172.21.15.42:0/14973108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efdc81531a0 0x7efdc814fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.076+0000 7efdc5d9b700 1 --2- 172.21.15.42:0/14973108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efdc80c8580 0x7efdc814f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.076+0000 7efdc659c700 1 -- 172.21.15.42:0/14973108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efdc81531a0 msgr2=0x7efdc814fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:34.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.076+0000 7efdc659c700 1 --2- 172.21.15.42:0/14973108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efdc81531a0 0x7efdc814fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.076+0000 7efdc659c700 1 -- 172.21.15.42:0/14973108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efdc80c8580 msgr2=0x7efdc814f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:34.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.076+0000 7efdc659c700 1 --2- 172.21.15.42:0/14973108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efdc80c8580 0x7efdc814f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.076+0000 7efdc659c700 1 -- 172.21.15.42:0/14973108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb8009550 con 0x7efdc8071840 2023-07-29T02:00:34.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.076+0000 7efdc659c700 1 --2- 172.21.15.42:0/14973108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdc8071840 0x7efdc815a8d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00c7f0 tx=0x7efdbc00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:34.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.076+0000 7efdb6ffd700 1 -- 172.21.15.42:0/14973108 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc004220 con 0x7efdc8071840 2023-07-29T02:00:34.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.076+0000 7efdb6ffd700 1 -- 172.21.15.42:0/14973108 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdbc004380 con 0x7efdc8071840 2023-07-29T02:00:34.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.076+0000 7efdcc80f700 1 -- 172.21.15.42:0/14973108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc814c2b0 con 0x7efdc8071840 2023-07-29T02:00:34.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.077+0000 7efdb6ffd700 1 -- 172.21.15.42:0/14973108 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdbc0036a0 con 0x7efdc8071840 2023-07-29T02:00:34.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.077+0000 7efdcc80f700 1 -- 172.21.15.42:0/14973108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc815a090 con 0x7efdc8071840 2023-07-29T02:00:34.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.078+0000 7efdcc80f700 1 -- 172.21.15.42:0/14973108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc804ea50 con 0x7efdc8071840 2023-07-29T02:00:34.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.078+0000 7efdb6ffd700 1 -- 172.21.15.42:0/14973108 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7efdbc003800 con 0x7efdc8071840 2023-07-29T02:00:34.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.078+0000 7efdb6ffd700 1 --2- 172.21.15.42:0/14973108 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efda806a660 0x7efda806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.078+0000 7efdb6ffd700 1 -- 172.21.15.42:0/14973108 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efdbc088890 con 0x7efdc8071840 2023-07-29T02:00:34.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.079+0000 7efdc5d9b700 1 --2- 172.21.15.42:0/14973108 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efda806a660 0x7efda806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.079+0000 7efdc5d9b700 1 --2- 172.21.15.42:0/14973108 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efda806a660 0x7efda806cb10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efdb8009130 tx=0x7efdb8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:34.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.083+0000 7efdb6ffd700 1 -- 172.21.15.42:0/14973108 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7efdbc057430 con 0x7efdc8071840 2023-07-29T02:00:34.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.280+0000 7efdcc80f700 1 -- 172.21.15.42:0/14973108 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efdc80c6360 con 0x7efdc8071840 2023-07-29T02:00:34.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.280+0000 7efdb6ffd700 1 -- 172.21.15.42:0/14973108 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7efdbc056fc0 con 0x7efdc8071840 2023-07-29T02:00:34.269 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2023-07-29T02:00:34.271 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.282+0000 7efdcc80f700 1 -- 172.21.15.42:0/14973108 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efda806a660 msgr2=0x7efda806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:34.271 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.282+0000 7efdcc80f700 1 --2- 172.21.15.42:0/14973108 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efda806a660 0x7efda806cb10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efdb8009130 tx=0x7efdb8008030 comp rx=0 tx=0).stop 2023-07-29T02:00:34.271 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.282+0000 7efdcc80f700 1 -- 172.21.15.42:0/14973108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdc8071840 msgr2=0x7efdc815a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:34.271 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.282+0000 7efdcc80f700 1 --2- 172.21.15.42:0/14973108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdc8071840 0x7efdc815a8d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efdbc00c7f0 tx=0x7efdbc00cb00 comp rx=0 tx=0).stop 2023-07-29T02:00:34.271 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.282+0000 7efdcc80f700 1 -- 172.21.15.42:0/14973108 shutdown_connections 2023-07-29T02:00:34.271 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.282+0000 7efdcc80f700 1 --2- 172.21.15.42:0/14973108 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efda806a660 0x7efda806cb10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.272 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.282+0000 7efdcc80f700 1 --2- 172.21.15.42:0/14973108 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efdc81531a0 0x7efdc814fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.272 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.282+0000 7efdcc80f700 1 --2- 172.21.15.42:0/14973108 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efdc8071840 0x7efdc815a8d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.272 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.282+0000 7efdcc80f700 1 --2- 172.21.15.42:0/14973108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efdc80c8580 0x7efdc814f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.272 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.282+0000 7efdcc80f700 1 -- 172.21.15.42:0/14973108 >> 172.21.15.42:0/14973108 conn(0x7efdc80cbf10 msgr2=0x7efdc8151440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:34.272 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.282+0000 7efdcc80f700 1 -- 172.21.15.42:0/14973108 shutdown_connections 2023-07-29T02:00:34.272 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.282+0000 7efdcc80f700 1 -- 172.21.15.42:0/14973108 wait complete. 2023-07-29T02:00:34.283 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-29T02:00:34.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.423+0000 7f4be167b700 1 Processor -- start 2023-07-29T02:00:34.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.423+0000 7f4be167b700 1 -- start start 2023-07-29T02:00:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.424+0000 7f4be167b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4bdc06ce70 0x7f4bdc15c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.424+0000 7f4be167b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4bdc0c8000 0x7f4bdc163ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.424+0000 7f4be167b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bdc070bc0 con 0x7f4bdc15cc80 2023-07-29T02:00:34.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.424+0000 7f4be167b700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bdc153660 con 0x7f4bdc06ce70 2023-07-29T02:00:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.424+0000 7f4be167b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc159c20 con 0x7f4bdc0c8000 2023-07-29T02:00:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.424+0000 7f4bdaffd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4bdc06ce70 0x7f4bdc15c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.424+0000 7f4bdaffd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4bdc06ce70 0x7f4bdc15c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56642/0 (socket says 172.21.15.42:56642) 2023-07-29T02:00:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.424+0000 7f4bdaffd700 1 -- 172.21.15.42:0/2490452408 learned_addr learned my addr 172.21.15.42:0/2490452408 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:34.420 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.424+0000 7f4bdb7fe700 1 --2- 172.21.15.42:0/2490452408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4bdc0c8000 0x7f4bdc163ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.424+0000 7f4bdaffd700 1 -- 172.21.15.42:0/2490452408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4bdc0c8000 msgr2=0x7f4bdc163ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.424+0000 7f4bdaffd700 1 --2- 172.21.15.42:0/2490452408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4bdc0c8000 0x7f4bdc163ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.424+0000 7f4bdaffd700 1 -- 172.21.15.42:0/2490452408 >> v1:172.21.15.144:6789/0 conn(0x7f4bdc15cc80 legacy=0x7f4bdc06fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.424+0000 7f4bdaffd700 1 -- 172.21.15.42:0/2490452408 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc06d240 con 0x7f4bdc06ce70 2023-07-29T02:00:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.424+0000 7f4bdb7fe700 1 --2- 172.21.15.42:0/2490452408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4bdc0c8000 0x7f4bdc163ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:34.421 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.425+0000 7f4bdaffd700 1 --2- 172.21.15.42:0/2490452408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc06ce70 0x7f4bdc15c740 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00098f0 tx=0x7f4bd0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317702ec32e65241 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.425+0000 7f4bd9ffb700 1 -- 172.21.15.42:0/2490452408 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd000b8a0 con 0x7f4bdc06ce70 2023-07-29T02:00:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.425+0000 7f4bd9ffb700 1 -- 172.21.15.42:0/2490452408 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd000ba00 con 0x7f4bdc06ce70 2023-07-29T02:00:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.425+0000 7f4bd9ffb700 1 -- 172.21.15.42:0/2490452408 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd000bd90 con 0x7f4bdc06ce70 2023-07-29T02:00:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.425+0000 7f4be167b700 1 -- 172.21.15.42:0/2490452408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc06ce70 msgr2=0x7f4bdc15c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.425+0000 7f4be167b700 1 --2- 172.21.15.42:0/2490452408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc06ce70 0x7f4bdc15c740 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4bd00098f0 tx=0x7f4bd0009c00 comp rx=0 tx=0).stop 2023-07-29T02:00:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.425+0000 7f4be167b700 1 -- 172.21.15.42:0/2490452408 shutdown_connections 2023-07-29T02:00:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.425+0000 7f4be167b700 1 --2- 172.21.15.42:0/2490452408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4bdc0c8000 0x7f4bdc163ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.425+0000 7f4be167b700 1 --2- 172.21.15.42:0/2490452408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc06ce70 0x7f4bdc15c740 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.425+0000 7f4be167b700 1 -- 172.21.15.42:0/2490452408 >> 172.21.15.42:0/2490452408 conn(0x7f4bdc0721c0 msgr2=0x7f4bdc0725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:34.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.425+0000 7f4be167b700 1 -- 172.21.15.42:0/2490452408 shutdown_connections 2023-07-29T02:00:34.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.425+0000 7f4be167b700 1 -- 172.21.15.42:0/2490452408 wait complete. 2023-07-29T02:00:34.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.427+0000 7f4be167b700 1 Processor -- start 2023-07-29T02:00:34.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.427+0000 7f4be167b700 1 -- start start 2023-07-29T02:00:34.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.427+0000 7f4be167b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc06ce70 0x7f4bdc154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.427+0000 7f4be167b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bdc0c8000 0x7f4bdc15ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.427+0000 7f4be167b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4bdc15cc80 0x7f4bdc1509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.427+0000 7f4be167b700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc153dc0 con 0x7f4bdc06ce70 2023-07-29T02:00:34.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.427+0000 7f4be167b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc154080 con 0x7f4bdc0c8000 2023-07-29T02:00:34.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.427+0000 7f4be167b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc1f1be0 con 0x7f4bdc15cc80 2023-07-29T02:00:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.428+0000 7f4bdaffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc06ce70 0x7f4bdc154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.428+0000 7f4bdaffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc06ce70 0x7f4bdc154e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56648/0 (socket says 172.21.15.42:56648) 2023-07-29T02:00:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.428+0000 7f4bdaffd700 1 -- 172.21.15.42:0/4013644990 learned_addr learned my addr 172.21.15.42:0/4013644990 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.428+0000 7f4bdb7fe700 1 --2- 172.21.15.42:0/4013644990 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4bdc15cc80 0x7f4bdc1509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.428+0000 7f4bda7fc700 1 --2- 172.21.15.42:0/4013644990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bdc0c8000 0x7f4bdc15ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.428+0000 7f4bdaffd700 1 -- 172.21.15.42:0/4013644990 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4bdc15cc80 msgr2=0x7f4bdc1509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:34.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.428+0000 7f4bdaffd700 1 --2- 172.21.15.42:0/4013644990 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4bdc15cc80 0x7f4bdc1509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.428+0000 7f4bdaffd700 1 -- 172.21.15.42:0/4013644990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bdc0c8000 msgr2=0x7f4bdc15ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:34.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.428+0000 7f4bdaffd700 1 --2- 172.21.15.42:0/4013644990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bdc0c8000 0x7f4bdc15ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.428+0000 7f4bdaffd700 1 -- 172.21.15.42:0/4013644990 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd0009550 con 0x7f4bdc06ce70 2023-07-29T02:00:34.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.428+0000 7f4bdaffd700 1 --2- 172.21.15.42:0/4013644990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc06ce70 0x7f4bdc154e20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0000c00 tx=0x7f4bd0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:34.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.428+0000 7f4bc37fe700 1 -- 172.21.15.42:0/4013644990 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd0004480 con 0x7f4bdc06ce70 2023-07-29T02:00:34.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.428+0000 7f4bc37fe700 1 -- 172.21.15.42:0/4013644990 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd001f070 con 0x7f4bdc06ce70 2023-07-29T02:00:34.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.428+0000 7f4be167b700 1 -- 172.21.15.42:0/4013644990 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bdc1f1ec0 con 0x7f4bdc06ce70 2023-07-29T02:00:34.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.428+0000 7f4bc37fe700 1 -- 172.21.15.42:0/4013644990 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd00038c0 con 0x7f4bdc06ce70 2023-07-29T02:00:34.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.428+0000 7f4be167b700 1 -- 172.21.15.42:0/4013644990 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bdc1f2480 con 0x7f4bdc06ce70 2023-07-29T02:00:34.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.429+0000 7f4be167b700 1 -- 172.21.15.42:0/4013644990 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bdc04ea50 con 0x7f4bdc06ce70 2023-07-29T02:00:34.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.430+0000 7f4bc37fe700 1 -- 172.21.15.42:0/4013644990 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f4bd0021030 con 0x7f4bdc06ce70 2023-07-29T02:00:34.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.430+0000 7f4bc37fe700 1 --2- 172.21.15.42:0/4013644990 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4bc806a660 0x7f4bc806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.430+0000 7f4bc37fe700 1 -- 172.21.15.42:0/4013644990 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4bd008a2c0 con 0x7f4bdc06ce70 2023-07-29T02:00:34.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.430+0000 7f4bda7fc700 1 --2- 172.21.15.42:0/4013644990 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4bc806a660 0x7f4bc806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.431+0000 7f4bda7fc700 1 --2- 172.21.15.42:0/4013644990 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4bc806a660 0x7f4bc806cb10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc157ef0 tx=0x7f4bcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:34.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.434+0000 7f4bc37fe700 1 -- 172.21.15.42:0/4013644990 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f4bd0055460 con 0x7f4bdc06ce70 2023-07-29T02:00:34.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.633+0000 7f4be167b700 1 -- 172.21.15.42:0/4013644990 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4bdc0c3c10 con 0x7f4bdc06ce70 2023-07-29T02:00:34.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.633+0000 7f4bc37fe700 1 -- 172.21.15.42:0/4013644990 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4bd0058a80 con 0x7f4bdc06ce70 2023-07-29T02:00:34.622 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2023-07-29T02:00:34.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.635+0000 7f4be167b700 1 -- 172.21.15.42:0/4013644990 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4bc806a660 msgr2=0x7f4bc806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:34.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.635+0000 7f4be167b700 1 --2- 172.21.15.42:0/4013644990 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4bc806a660 0x7f4bc806cb10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc157ef0 tx=0x7f4bcc009040 comp rx=0 tx=0).stop 2023-07-29T02:00:34.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.635+0000 7f4be167b700 1 -- 172.21.15.42:0/4013644990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc06ce70 msgr2=0x7f4bdc154e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:34.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.635+0000 7f4be167b700 1 --2- 172.21.15.42:0/4013644990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc06ce70 0x7f4bdc154e20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0000c00 tx=0x7f4bd0004750 comp rx=0 tx=0).stop 2023-07-29T02:00:34.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.635+0000 7f4be167b700 1 -- 172.21.15.42:0/4013644990 shutdown_connections 2023-07-29T02:00:34.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.635+0000 7f4be167b700 1 --2- 172.21.15.42:0/4013644990 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4bc806a660 0x7f4bc806cb10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.635+0000 7f4be167b700 1 --2- 172.21.15.42:0/4013644990 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4bdc15cc80 0x7f4bdc1509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.635+0000 7f4be167b700 1 --2- 172.21.15.42:0/4013644990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4bdc06ce70 0x7f4bdc154e20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.635+0000 7f4be167b700 1 --2- 172.21.15.42:0/4013644990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bdc0c8000 0x7f4bdc15ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.635+0000 7f4be167b700 1 -- 172.21.15.42:0/4013644990 >> 172.21.15.42:0/4013644990 conn(0x7f4bdc0721c0 msgr2=0x7f4bdc152c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:34.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.636+0000 7f4be167b700 1 -- 172.21.15.42:0/4013644990 shutdown_connections 2023-07-29T02:00:34.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.636+0000 7f4be167b700 1 -- 172.21.15.42:0/4013644990 wait complete. 2023-07-29T02:00:34.636 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-29T02:00:34.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.775+0000 7f2afdea2700 1 Processor -- start 2023-07-29T02:00:34.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.775+0000 7f2afdea2700 1 -- start start 2023-07-29T02:00:34.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.776+0000 7f2afdea2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2af81531a0 0x7f2af806f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.776+0000 7f2afdea2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2af8071840 0x7f2af806a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.776+0000 7f2afdea2700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af806c870 con 0x7f2af80c8580 2023-07-29T02:00:34.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.776+0000 7f2afdea2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af80c74a0 con 0x7f2af8071840 2023-07-29T02:00:34.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.776+0000 7f2afdea2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af806fa50 con 0x7f2af81531a0 2023-07-29T02:00:34.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.776+0000 7f2af6ffd700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f2af80c8580 0x7f2af815c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50460/0 (socket says 172.21.15.42:50460) 2023-07-29T02:00:34.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.776+0000 7f2af6ffd700 1 -- 172.21.15.42:0/4050549839 learned_addr learned my addr 172.21.15.42:0/4050549839 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:34.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.776+0000 7f2af77fe700 1 --2- 172.21.15.42:0/4050549839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2af81531a0 0x7f2af806f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.776+0000 7f2af67fc700 1 -- 172.21.15.42:0/4050549839 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204594508 0 0) 0x7f2af806c870 con 0x7f2af80c8580 2023-07-29T02:00:34.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.776+0000 7f2af67fc700 1 -- 172.21.15.42:0/4050549839 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ae40035b0 con 0x7f2af80c8580 2023-07-29T02:00:34.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.776+0000 7f2af7fff700 1 --2- 172.21.15.42:0/4050549839 >> v2:172.21.15.144:3300/0 conn(0x7f2af8071840 0x7f2af806a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af67fc700 1 -- 172.21.15.42:0/4050549839 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 569445335 0 0) 0x7f2ae40035b0 con 0x7f2af80c8580 2023-07-29T02:00:34.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af67fc700 1 -- 172.21.15.42:0/4050549839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2af81531a0 msgr2=0x7f2af806f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:34.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af67fc700 1 --2- 172.21.15.42:0/4050549839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2af81531a0 0x7f2af806f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af67fc700 1 -- 172.21.15.42:0/4050549839 >> v2:172.21.15.144:3300/0 conn(0x7f2af8071840 msgr2=0x7f2af806a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:34.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af67fc700 1 --2- 172.21.15.42:0/4050549839 >> v2:172.21.15.144:3300/0 conn(0x7f2af8071840 0x7f2af806a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af67fc700 1 -- 172.21.15.42:0/4050549839 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af806d450 con 0x7f2af80c8580 2023-07-29T02:00:34.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af67fc700 1 -- 172.21.15.42:0/4050549839 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7f2ae8001670 con 0x7f2af80c8580 2023-07-29T02:00:34.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af67fc700 1 -- 172.21.15.42:0/4050549839 >> v1:172.21.15.42:6789/0 conn(0x7f2af80c8580 legacy=0x7f2af815c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:34.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af67fc700 1 --2- 172.21.15.42:0/4050549839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ae4003a00 0x7f2ae4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af67fc700 1 --2- 172.21.15.42:0/4050549839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2af81531a0 0x7f2ae4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af67fc700 1 --2- 172.21.15.42:0/4050549839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ae4004d90 0x7f2ae4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af67fc700 1 -- 172.21.15.42:0/4050549839 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af806fa50 con 0x7f2ae4004d90 2023-07-29T02:00:34.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af67fc700 1 -- 172.21.15.42:0/4050549839 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae400ba10 con 0x7f2ae4003a00 2023-07-29T02:00:34.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af67fc700 1 -- 172.21.15.42:0/4050549839 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae400bb50 con 0x7f2af81531a0 2023-07-29T02:00:34.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af7fff700 1 --2- 172.21.15.42:0/4050549839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ae4004d90 0x7f2ae4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af77fe700 1 --2- 172.21.15.42:0/4050549839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ae4003a00 0x7f2ae4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af6ffd700 1 --2- 172.21.15.42:0/4050549839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2af81531a0 0x7f2ae4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af7fff700 1 -- 172.21.15.42:0/4050549839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2af81531a0 msgr2=0x7f2ae4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:34.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af7fff700 1 --2- 172.21.15.42:0/4050549839 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2af81531a0 0x7f2ae4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af7fff700 1 -- 172.21.15.42:0/4050549839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ae4003a00 msgr2=0x7f2ae4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:34.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af7fff700 1 --2- 172.21.15.42:0/4050549839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ae4003a00 0x7f2ae4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af7fff700 1 -- 172.21.15.42:0/4050549839 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae40035b0 con 0x7f2ae4004d90 2023-07-29T02:00:34.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af7fff700 1 --2- 172.21.15.42:0/4050549839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ae4004d90 0x7f2ae4005200 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2af0009fc0 tx=0x7f2ae4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1919e7bd8350dc5 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:34.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af67fc700 1 -- 172.21.15.42:0/4050549839 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af000ebd0 con 0x7f2ae4004d90 2023-07-29T02:00:34.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af67fc700 1 -- 172.21.15.42:0/4050549839 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af000f040 con 0x7f2ae4004d90 2023-07-29T02:00:34.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.777+0000 7f2af67fc700 1 -- 172.21.15.42:0/4050549839 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0014480 con 0x7f2ae4004d90 2023-07-29T02:00:34.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.778+0000 7f2afdea2700 1 -- 172.21.15.42:0/4050549839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ae4004d90 msgr2=0x7f2ae4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:34.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.778+0000 7f2afdea2700 1 --2- 172.21.15.42:0/4050549839 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ae4004d90 0x7f2ae4005200 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2af0009fc0 tx=0x7f2ae4005880 comp rx=0 tx=0).stop 2023-07-29T02:00:34.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.778+0000 7f2af7fff700 1 -- 172.21.15.42:0/4050549839 reap_dead start 2023-07-29T02:00:34.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.778+0000 7f2afdea2700 1 -- 172.21.15.42:0/4050549839 shutdown_connections 2023-07-29T02:00:34.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.778+0000 7f2afdea2700 1 -- 172.21.15.42:0/4050549839 >> 172.21.15.42:0/4050549839 conn(0x7f2af80cbf10 msgr2=0x7f2af80cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:34.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.778+0000 7f2afdea2700 1 -- 172.21.15.42:0/4050549839 shutdown_connections 2023-07-29T02:00:34.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.778+0000 7f2afdea2700 1 -- 172.21.15.42:0/4050549839 wait complete. 2023-07-29T02:00:34.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.779+0000 7f2afdea2700 1 Processor -- start 2023-07-29T02:00:34.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.779+0000 7f2afdea2700 1 -- start start 2023-07-29T02:00:34.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.780+0000 7f2afdea2700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2af81e5740 0x7f2af8155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.780+0000 7f2afdea2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2af81e5b10 0x7f2af814e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.780+0000 7f2afdea2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2af81562b0 0x7f2af81eeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.780+0000 7f2afdea2700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af814e6b0 con 0x7f2af81e5740 2023-07-29T02:00:34.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.780+0000 7f2afdea2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af814ef90 con 0x7f2af81e5b10 2023-07-29T02:00:34.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.780+0000 7f2afdea2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af81ef0a0 con 0x7f2af81562b0 2023-07-29T02:00:34.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.780+0000 7f2af77fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2af81e5740 0x7f2af8155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.780+0000 7f2af77fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2af81e5740 0x7f2af8155b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56668/0 (socket says 172.21.15.42:56668) 2023-07-29T02:00:34.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.780+0000 7f2af77fe700 1 -- 172.21.15.42:0/4075535272 learned_addr learned my addr 172.21.15.42:0/4075535272 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:34.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.780+0000 7f2af7fff700 1 --2- 172.21.15.42:0/4075535272 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2af81562b0 0x7f2af81eeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.780+0000 7f2af6ffd700 1 --2- 172.21.15.42:0/4075535272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2af81e5b10 0x7f2af814e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.780+0000 7f2af77fe700 1 -- 172.21.15.42:0/4075535272 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2af81562b0 msgr2=0x7f2af81eeb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:34.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.780+0000 7f2af77fe700 1 --2- 172.21.15.42:0/4075535272 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2af81562b0 0x7f2af81eeb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.780+0000 7f2af77fe700 1 -- 172.21.15.42:0/4075535272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2af81e5b10 msgr2=0x7f2af814e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:34.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.780+0000 7f2af77fe700 1 --2- 172.21.15.42:0/4075535272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2af81e5b10 0x7f2af814e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.780+0000 7f2af77fe700 1 -- 172.21.15.42:0/4075535272 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af806f860 con 0x7f2af81e5740 2023-07-29T02:00:34.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.780+0000 7f2af6ffd700 1 --2- 172.21.15.42:0/4075535272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2af81e5b10 0x7f2af814e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:34.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.781+0000 7f2af77fe700 1 --2- 172.21.15.42:0/4075535272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2af81e5740 0x7f2af8155b50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0011a00 tx=0x7f2ae0011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:34.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.781+0000 7f2aeffff700 1 -- 172.21.15.42:0/4075535272 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae000f8e0 con 0x7f2af81e5740 2023-07-29T02:00:34.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.781+0000 7f2aeffff700 1 -- 172.21.15.42:0/4075535272 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae000fa60 con 0x7f2af81e5740 2023-07-29T02:00:34.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.781+0000 7f2aeffff700 1 -- 172.21.15.42:0/4075535272 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae000fe50 con 0x7f2af81e5740 2023-07-29T02:00:34.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.781+0000 7f2afdea2700 1 -- 172.21.15.42:0/4075535272 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af81553c0 con 0x7f2af81e5740 2023-07-29T02:00:34.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.781+0000 7f2afdea2700 1 -- 172.21.15.42:0/4075535272 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af8153960 con 0x7f2af81e5740 2023-07-29T02:00:34.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.782+0000 7f2afdea2700 1 -- 172.21.15.42:0/4075535272 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af81559a0 con 0x7f2af81e5740 2023-07-29T02:00:34.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.782+0000 7f2aeffff700 1 -- 172.21.15.42:0/4075535272 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f2ae0014440 con 0x7f2af81e5740 2023-07-29T02:00:34.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.783+0000 7f2aeffff700 1 --2- 172.21.15.42:0/4075535272 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2ad806a660 0x7f2ad806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:34.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.783+0000 7f2aeffff700 1 -- 172.21.15.42:0/4075535272 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2ae0089480 con 0x7f2af81e5740 2023-07-29T02:00:34.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.783+0000 7f2af6ffd700 1 --2- 172.21.15.42:0/4075535272 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2ad806a660 0x7f2ad806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:34.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.783+0000 7f2af6ffd700 1 --2- 172.21.15.42:0/4075535272 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2ad806a660 0x7f2ad806cb10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2ae80048d0 tx=0x7f2ae8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:34.779 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.787+0000 7f2aeffff700 1 -- 172.21.15.42:0/4075535272 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f2ae0054590 con 0x7f2af81e5740 2023-07-29T02:00:34.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.986+0000 7f2afdea2700 1 -- 172.21.15.42:0/4075535272 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2af80c6d70 con 0x7f2af81e5740 2023-07-29T02:00:34.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.987+0000 7f2aeffff700 1 -- 172.21.15.42:0/4075535272 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ae0057bb0 con 0x7f2af81e5740 2023-07-29T02:00:34.976 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2023-07-29T02:00:34.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.989+0000 7f2afdea2700 1 -- 172.21.15.42:0/4075535272 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2ad806a660 msgr2=0x7f2ad806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:34.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.989+0000 7f2afdea2700 1 --2- 172.21.15.42:0/4075535272 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2ad806a660 0x7f2ad806cb10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2ae80048d0 tx=0x7f2ae8009040 comp rx=0 tx=0).stop 2023-07-29T02:00:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.989+0000 7f2afdea2700 1 -- 172.21.15.42:0/4075535272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2af81e5740 msgr2=0x7f2af8155b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.989+0000 7f2afdea2700 1 --2- 172.21.15.42:0/4075535272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2af81e5740 0x7f2af8155b50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0011a00 tx=0x7f2ae0011d10 comp rx=0 tx=0).stop 2023-07-29T02:00:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.989+0000 7f2afdea2700 1 -- 172.21.15.42:0/4075535272 shutdown_connections 2023-07-29T02:00:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.989+0000 7f2afdea2700 1 --2- 172.21.15.42:0/4075535272 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2ad806a660 0x7f2ad806cb10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.989+0000 7f2afdea2700 1 --2- 172.21.15.42:0/4075535272 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2af81562b0 0x7f2af81eeb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.989+0000 7f2afdea2700 1 --2- 172.21.15.42:0/4075535272 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2af81e5740 0x7f2af8155b50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.979 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.989+0000 7f2afdea2700 1 --2- 172.21.15.42:0/4075535272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2af81e5b10 0x7f2af814e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:34.979 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.989+0000 7f2afdea2700 1 -- 172.21.15.42:0/4075535272 >> 172.21.15.42:0/4075535272 conn(0x7f2af80cbf10 msgr2=0x7f2af806a750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:34.979 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.989+0000 7f2afdea2700 1 -- 172.21.15.42:0/4075535272 shutdown_connections 2023-07-29T02:00:34.979 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:34.989+0000 7f2afdea2700 1 -- 172.21.15.42:0/4075535272 wait complete. 2023-07-29T02:00:34.990 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-29T02:00:35.117 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.129+0000 7fee9ec54700 1 Processor -- start 2023-07-29T02:00:35.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.129+0000 7fee9ec54700 1 -- start start 2023-07-29T02:00:35.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.130+0000 7fee9ec54700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fee9806eda0 0x7fee98155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.130+0000 7fee9ec54700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fee9806cfa0 0x7fee9806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.130+0000 7fee9ec54700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee9814f920 0x7fee9814fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.130+0000 7fee9ec54700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9806d910 con 0x7fee9806cfa0 2023-07-29T02:00:35.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.130+0000 7fee9ec54700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9806cb10 con 0x7fee9806eda0 2023-07-29T02:00:35.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.130+0000 7fee9ec54700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee981502e0 con 0x7fee9814f920 2023-07-29T02:00:35.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.131+0000 7fee97fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fee9806cfa0 0x7fee9806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.121 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.131+0000 7fee97fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fee9806cfa0 0x7fee9806d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56676/0 (socket says 172.21.15.42:56676) 2023-07-29T02:00:35.121 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.131+0000 7fee97fff700 1 -- 172.21.15.42:0/3760384389 learned_addr learned my addr 172.21.15.42:0/3760384389 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:35.121 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.131+0000 7fee9d1f1700 1 --2- 172.21.15.42:0/3760384389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee9814f920 0x7fee9814fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.121 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.131+0000 7fee9c9f0700 1 --2- 172.21.15.42:0/3760384389 >> v2:172.21.15.144:3300/0 conn(0x7fee9806eda0 0x7fee98155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.121 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.131+0000 7fee97fff700 1 -- 172.21.15.42:0/3760384389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee9814f920 msgr2=0x7fee9814fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:35.121 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.131+0000 7fee97fff700 1 --2- 172.21.15.42:0/3760384389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee9814f920 0x7fee9814fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.121 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.131+0000 7fee97fff700 1 -- 172.21.15.42:0/3760384389 >> v2:172.21.15.144:3300/0 conn(0x7fee9806eda0 msgr2=0x7fee98155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:35.121 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.131+0000 7fee97fff700 1 --2- 172.21.15.42:0/3760384389 >> v2:172.21.15.144:3300/0 conn(0x7fee9806eda0 0x7fee98155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.122 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.131+0000 7fee97fff700 1 -- 172.21.15.42:0/3760384389 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee98156280 con 0x7fee9806cfa0 2023-07-29T02:00:35.122 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.131+0000 7fee97fff700 1 --2- 172.21.15.42:0/3760384389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee9806cfa0 0x7fee9806d3d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fee98070d00 tx=0x7fee84009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da15ac3f216bb90c server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:35.122 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.131+0000 7fee977fe700 1 -- 172.21.15.42:0/3760384389 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee84011830 con 0x7fee9806cfa0 2023-07-29T02:00:35.122 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.131+0000 7fee977fe700 1 -- 172.21.15.42:0/3760384389 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee84011990 con 0x7fee9806cfa0 2023-07-29T02:00:35.122 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.131+0000 7fee977fe700 1 -- 172.21.15.42:0/3760384389 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee84011d20 con 0x7fee9806cfa0 2023-07-29T02:00:35.124 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.132+0000 7fee9ec54700 1 -- 172.21.15.42:0/3760384389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee9806cfa0 msgr2=0x7fee9806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:35.124 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.132+0000 7fee9ec54700 1 --2- 172.21.15.42:0/3760384389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee9806cfa0 0x7fee9806d3d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fee98070d00 tx=0x7fee84009bd0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.132+0000 7fee9ec54700 1 -- 172.21.15.42:0/3760384389 shutdown_connections 2023-07-29T02:00:35.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.132+0000 7fee9ec54700 1 --2- 172.21.15.42:0/3760384389 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee9814f920 0x7fee9814fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.132+0000 7fee9ec54700 1 --2- 172.21.15.42:0/3760384389 >> v2:172.21.15.144:3300/0 conn(0x7fee9806eda0 0x7fee98155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.132+0000 7fee9ec54700 1 --2- 172.21.15.42:0/3760384389 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee9806cfa0 0x7fee9806d3d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.132+0000 7fee9ec54700 1 -- 172.21.15.42:0/3760384389 >> 172.21.15.42:0/3760384389 conn(0x7fee980cbf10 msgr2=0x7fee980cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:35.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.132+0000 7fee9ec54700 1 -- 172.21.15.42:0/3760384389 shutdown_connections 2023-07-29T02:00:35.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.132+0000 7fee9ec54700 1 -- 172.21.15.42:0/3760384389 wait complete. 2023-07-29T02:00:35.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.133+0000 7fee9ec54700 1 Processor -- start 2023-07-29T02:00:35.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.133+0000 7fee9ec54700 1 -- start start 2023-07-29T02:00:35.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.134+0000 7fee9ec54700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee9806cfa0 0x7fee98155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.134+0000 7fee9ec54700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee9806eda0 0x7fee9814d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.134+0000 7fee9ec54700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee9814f920 0x7fee981490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.134+0000 7fee9ec54700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee98154410 con 0x7fee9814f920 2023-07-29T02:00:35.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.134+0000 7fee9ec54700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee98156010 con 0x7fee9806cfa0 2023-07-29T02:00:35.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.134+0000 7fee9ec54700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9814b4d0 con 0x7fee9806eda0 2023-07-29T02:00:35.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.134+0000 7fee9d1f1700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee9814f920 0x7fee981490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.134+0000 7fee9d1f1700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee9814f920 0x7fee981490b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56686/0 (socket says 172.21.15.42:56686) 2023-07-29T02:00:35.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.134+0000 7fee9d1f1700 1 -- 172.21.15.42:0/3731967973 learned_addr learned my addr 172.21.15.42:0/3731967973 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:35.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.134+0000 7fee97fff700 1 --2- 172.21.15.42:0/3731967973 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee9806eda0 0x7fee9814d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.134+0000 7fee9c9f0700 1 --2- 172.21.15.42:0/3731967973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee9806cfa0 0x7fee98155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.134+0000 7fee9d1f1700 1 -- 172.21.15.42:0/3731967973 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee9806eda0 msgr2=0x7fee9814d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:35.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.134+0000 7fee9d1f1700 1 --2- 172.21.15.42:0/3731967973 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee9806eda0 0x7fee9814d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.134+0000 7fee9d1f1700 1 -- 172.21.15.42:0/3731967973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee9806cfa0 msgr2=0x7fee98155ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:35.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.134+0000 7fee9d1f1700 1 --2- 172.21.15.42:0/3731967973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee9806cfa0 0x7fee98155ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.134+0000 7fee9d1f1700 1 -- 172.21.15.42:0/3731967973 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee84009550 con 0x7fee9814f920 2023-07-29T02:00:35.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.135+0000 7fee9d1f1700 1 --2- 172.21.15.42:0/3731967973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee9814f920 0x7fee981490b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fee9000efc0 tx=0x7fee9000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:35.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.135+0000 7fee957fa700 1 -- 172.21.15.42:0/3731967973 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9000cad0 con 0x7fee9814f920 2023-07-29T02:00:35.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.135+0000 7fee957fa700 1 -- 172.21.15.42:0/3731967973 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9000f040 con 0x7fee9814f920 2023-07-29T02:00:35.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.135+0000 7fee9ec54700 1 -- 172.21.15.42:0/3731967973 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9814b7b0 con 0x7fee9814f920 2023-07-29T02:00:35.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.135+0000 7fee957fa700 1 -- 172.21.15.42:0/3731967973 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9000ce70 con 0x7fee9814f920 2023-07-29T02:00:35.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.135+0000 7fee9ec54700 1 -- 172.21.15.42:0/3731967973 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee98153dc0 con 0x7fee9814f920 2023-07-29T02:00:35.129 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.136+0000 7fee9ec54700 1 -- 172.21.15.42:0/3731967973 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee98154580 con 0x7fee9814f920 2023-07-29T02:00:35.129 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.136+0000 7fee957fa700 1 -- 172.21.15.42:0/3731967973 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fee90014480 con 0x7fee9814f920 2023-07-29T02:00:35.129 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.136+0000 7fee957fa700 1 --2- 172.21.15.42:0/3731967973 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fee7c06a660 0x7fee7c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.130 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.137+0000 7fee957fa700 1 -- 172.21.15.42:0/3731967973 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fee90089520 con 0x7fee9814f920 2023-07-29T02:00:35.130 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.137+0000 7fee9c9f0700 1 --2- 172.21.15.42:0/3731967973 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fee7c06a660 0x7fee7c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.130 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.137+0000 7fee9c9f0700 1 --2- 172.21.15.42:0/3731967973 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fee7c06a660 0x7fee7c06cb10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009be0 tx=0x7fee8c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:35.130 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.141+0000 7fee957fa700 1 -- 172.21.15.42:0/3731967973 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fee900545a0 con 0x7fee9814f920 2023-07-29T02:00:35.328 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.339+0000 7fee9ec54700 1 -- 172.21.15.42:0/3731967973 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fee9804ea50 con 0x7fee9814f920 2023-07-29T02:00:35.328 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.339+0000 7fee957fa700 1 -- 172.21.15.42:0/3731967973 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fee90018020 con 0x7fee9814f920 2023-07-29T02:00:35.328 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2023-07-29T02:00:35.330 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.342+0000 7fee9ec54700 1 -- 172.21.15.42:0/3731967973 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fee7c06a660 msgr2=0x7fee7c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:35.330 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.342+0000 7fee9ec54700 1 --2- 172.21.15.42:0/3731967973 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fee7c06a660 0x7fee7c06cb10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009be0 tx=0x7fee8c009210 comp rx=0 tx=0).stop 2023-07-29T02:00:35.331 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.342+0000 7fee9ec54700 1 -- 172.21.15.42:0/3731967973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee9814f920 msgr2=0x7fee981490b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:35.331 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.342+0000 7fee9ec54700 1 --2- 172.21.15.42:0/3731967973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee9814f920 0x7fee981490b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fee9000efc0 tx=0x7fee9000c0c0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.331 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.342+0000 7fee9ec54700 1 -- 172.21.15.42:0/3731967973 shutdown_connections 2023-07-29T02:00:35.331 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.342+0000 7fee9ec54700 1 --2- 172.21.15.42:0/3731967973 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fee7c06a660 0x7fee7c06cb10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.331 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.342+0000 7fee9ec54700 1 --2- 172.21.15.42:0/3731967973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee9814f920 0x7fee981490b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.331 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.342+0000 7fee9ec54700 1 --2- 172.21.15.42:0/3731967973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee9806cfa0 0x7fee98155ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.331 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.342+0000 7fee9ec54700 1 --2- 172.21.15.42:0/3731967973 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee9806eda0 0x7fee9814d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.332 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.342+0000 7fee9ec54700 1 -- 172.21.15.42:0/3731967973 >> 172.21.15.42:0/3731967973 conn(0x7fee980cbf10 msgr2=0x7fee980c16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:35.332 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.342+0000 7fee9ec54700 1 -- 172.21.15.42:0/3731967973 shutdown_connections 2023-07-29T02:00:35.332 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.342+0000 7fee9ec54700 1 -- 172.21.15.42:0/3731967973 wait complete. 2023-07-29T02:00:35.342 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:00:35.468 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.479+0000 7f8b994a3700 1 Processor -- start 2023-07-29T02:00:35.468 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.479+0000 7f8b994a3700 1 -- start start 2023-07-29T02:00:35.469 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.480+0000 7f8b994a3700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8b94159cb0 0x7f8b940b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.469 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.480+0000 7f8b994a3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b940cf830 0x7f8b941563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.469 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.480+0000 7f8b994a3700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b940b31d0 con 0x7f8b940cf460 2023-07-29T02:00:35.470 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.480+0000 7f8b994a3700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b940b3660 con 0x7f8b94159cb0 2023-07-29T02:00:35.470 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.480+0000 7f8b994a3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9415a1a0 con 0x7f8b940cf830 2023-07-29T02:00:35.470 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.480+0000 7f8b927fc700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8b94159cb0 0x7f8b940b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.470 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.480+0000 7f8b927fc700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8b94159cb0 0x7f8b940b4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56692/0 (socket says 172.21.15.42:56692) 2023-07-29T02:00:35.470 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.480+0000 7f8b927fc700 1 -- 172.21.15.42:0/2759749518 learned_addr learned my addr 172.21.15.42:0/2759749518 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:35.470 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.480+0000 7f8b937fe700 1 --2- 172.21.15.42:0/2759749518 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b940cf830 0x7f8b941563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.470 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.480+0000 7f8b927fc700 1 -- 172.21.15.42:0/2759749518 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b940cf830 msgr2=0x7f8b941563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:35.471 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.480+0000 7f8b927fc700 1 --2- 172.21.15.42:0/2759749518 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b940cf830 0x7f8b941563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.471 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.480+0000 7f8b927fc700 1 -- 172.21.15.42:0/2759749518 >> v1:172.21.15.144:6789/0 conn(0x7f8b940cf460 legacy=0x7f8b9415a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:35.471 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.480+0000 7f8b927fc700 1 -- 172.21.15.42:0/2759749518 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b940b2600 con 0x7f8b94159cb0 2023-07-29T02:00:35.471 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.481+0000 7f8b927fc700 1 --2- 172.21.15.42:0/2759749518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b94159cb0 0x7f8b940b4c30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8b840098f0 tx=0x7f8b84009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea4504b9097920f server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:35.471 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.481+0000 7f8b91ffb700 1 -- 172.21.15.42:0/2759749518 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84011830 con 0x7f8b94159cb0 2023-07-29T02:00:35.471 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.481+0000 7f8b91ffb700 1 -- 172.21.15.42:0/2759749518 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b84011990 con 0x7f8b94159cb0 2023-07-29T02:00:35.471 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.481+0000 7f8b91ffb700 1 -- 172.21.15.42:0/2759749518 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84011d20 con 0x7f8b94159cb0 2023-07-29T02:00:35.473 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.481+0000 7f8b994a3700 1 -- 172.21.15.42:0/2759749518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b94159cb0 msgr2=0x7f8b940b4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:35.473 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.481+0000 7f8b994a3700 1 --2- 172.21.15.42:0/2759749518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b94159cb0 0x7f8b940b4c30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8b840098f0 tx=0x7f8b84009c00 comp rx=0 tx=0).stop 2023-07-29T02:00:35.474 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.481+0000 7f8b994a3700 1 -- 172.21.15.42:0/2759749518 shutdown_connections 2023-07-29T02:00:35.474 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.481+0000 7f8b994a3700 1 --2- 172.21.15.42:0/2759749518 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b940cf830 0x7f8b941563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.474 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.481+0000 7f8b994a3700 1 --2- 172.21.15.42:0/2759749518 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b94159cb0 0x7f8b940b4c30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.474 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.481+0000 7f8b994a3700 1 -- 172.21.15.42:0/2759749518 >> 172.21.15.42:0/2759749518 conn(0x7f8b9406ca60 msgr2=0x7f8b9406ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:35.474 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.481+0000 7f8b994a3700 1 -- 172.21.15.42:0/2759749518 shutdown_connections 2023-07-29T02:00:35.474 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.481+0000 7f8b994a3700 1 -- 172.21.15.42:0/2759749518 wait complete. 2023-07-29T02:00:35.474 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.483+0000 7f8b994a3700 1 Processor -- start 2023-07-29T02:00:35.475 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.483+0000 7f8b994a3700 1 -- start start 2023-07-29T02:00:35.475 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.484+0000 7f8b994a3700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b940cf460 0x7f8b940c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.475 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.484+0000 7f8b994a3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b940cf830 0x7f8b941eeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.475 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.484+0000 7f8b994a3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b94159cb0 0x7f8b941ef3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.475 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.484+0000 7f8b994a3700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b94150760 con 0x7f8b940cf460 2023-07-29T02:00:35.475 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.484+0000 7f8b994a3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940cac30 con 0x7f8b94159cb0 2023-07-29T02:00:35.475 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.484+0000 7f8b994a3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b941f2ca0 con 0x7f8b940cf830 2023-07-29T02:00:35.475 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.484+0000 7f8b92ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b940cf460 0x7f8b940c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.476 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.484+0000 7f8b92ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b940cf460 0x7f8b940c7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56696/0 (socket says 172.21.15.42:56696) 2023-07-29T02:00:35.476 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.484+0000 7f8b92ffd700 1 -- 172.21.15.42:0/2608692288 learned_addr learned my addr 172.21.15.42:0/2608692288 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:35.476 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.484+0000 7f8b927fc700 1 --2- 172.21.15.42:0/2608692288 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b940cf830 0x7f8b941eeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.476 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.484+0000 7f8b937fe700 1 --2- 172.21.15.42:0/2608692288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b94159cb0 0x7f8b941ef3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.476 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.485+0000 7f8b92ffd700 1 -- 172.21.15.42:0/2608692288 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b940cf830 msgr2=0x7f8b941eeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:35.476 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.485+0000 7f8b92ffd700 1 --2- 172.21.15.42:0/2608692288 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b940cf830 0x7f8b941eeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.476 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.485+0000 7f8b92ffd700 1 -- 172.21.15.42:0/2608692288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b94159cb0 msgr2=0x7f8b941ef3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:35.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.485+0000 7f8b92ffd700 1 --2- 172.21.15.42:0/2608692288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b94159cb0 0x7f8b941ef3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.485+0000 7f8b92ffd700 1 -- 172.21.15.42:0/2608692288 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b84009550 con 0x7f8b940cf460 2023-07-29T02:00:35.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.485+0000 7f8b92ffd700 1 --2- 172.21.15.42:0/2608692288 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b940cf460 0x7f8b940c7900 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8b8800c480 tx=0x7f8b8800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:35.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.485+0000 7f8b7b7fe700 1 -- 172.21.15.42:0/2608692288 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b880052d0 con 0x7f8b940cf460 2023-07-29T02:00:35.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.485+0000 7f8b7b7fe700 1 -- 172.21.15.42:0/2608692288 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b88005430 con 0x7f8b940cf460 2023-07-29T02:00:35.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.485+0000 7f8b994a3700 1 -- 172.21.15.42:0/2608692288 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b940ce400 con 0x7f8b940cf460 2023-07-29T02:00:35.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.485+0000 7f8b7b7fe700 1 -- 172.21.15.42:0/2608692288 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b880038c0 con 0x7f8b940cf460 2023-07-29T02:00:35.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.485+0000 7f8b994a3700 1 -- 172.21.15.42:0/2608692288 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b940ce120 con 0x7f8b940cf460 2023-07-29T02:00:35.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.486+0000 7f8b994a3700 1 -- 172.21.15.42:0/2608692288 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b941eecf0 con 0x7f8b940cf460 2023-07-29T02:00:35.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.486+0000 7f8b7b7fe700 1 -- 172.21.15.42:0/2608692288 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f8b88003a20 con 0x7f8b940cf460 2023-07-29T02:00:35.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.487+0000 7f8b7b7fe700 1 --2- 172.21.15.42:0/2608692288 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8b8006a660 0x7f8b8006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.487+0000 7f8b7b7fe700 1 -- 172.21.15.42:0/2608692288 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8b880880a0 con 0x7f8b940cf460 2023-07-29T02:00:35.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.487+0000 7f8b927fc700 1 --2- 172.21.15.42:0/2608692288 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8b8006a660 0x7f8b8006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.488+0000 7f8b927fc700 1 --2- 172.21.15.42:0/2608692288 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8b8006a660 0x7f8b8006cb10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8b84009c40 tx=0x7f8b84008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:35.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.492+0000 7f8b7b7fe700 1 -- 172.21.15.42:0/2608692288 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f8b88053240 con 0x7f8b940cf460 2023-07-29T02:00:35.724 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.736+0000 7f8b994a3700 1 -- 172.21.15.42:0/2608692288 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b9415aff0 con 0x7f8b940cf460 2023-07-29T02:00:35.725 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.737+0000 7f8b7b7fe700 1 -- 172.21.15.42:0/2608692288 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6165 (secure 0 0 0) 0x7f8b88056860 con 0x7f8b940cf460 2023-07-29T02:00:35.725 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:35.725 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:00:26.432410+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6837/1851767861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1851767861},{"type":"v1","addr":"172.21.15.42:6837","nonce":1851767861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:00:35.727 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.739+0000 7f8b994a3700 1 -- 172.21.15.42:0/2608692288 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8b8006a660 msgr2=0x7f8b8006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:35.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.739+0000 7f8b994a3700 1 --2- 172.21.15.42:0/2608692288 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8b8006a660 0x7f8b8006cb10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8b84009c40 tx=0x7f8b84008030 comp rx=0 tx=0).stop 2023-07-29T02:00:35.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.739+0000 7f8b994a3700 1 -- 172.21.15.42:0/2608692288 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b940cf460 msgr2=0x7f8b940c7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:35.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.739+0000 7f8b994a3700 1 --2- 172.21.15.42:0/2608692288 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b940cf460 0x7f8b940c7900 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8b8800c480 tx=0x7f8b8800c790 comp rx=0 tx=0).stop 2023-07-29T02:00:35.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.739+0000 7f8b994a3700 1 -- 172.21.15.42:0/2608692288 shutdown_connections 2023-07-29T02:00:35.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.739+0000 7f8b994a3700 1 --2- 172.21.15.42:0/2608692288 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8b8006a660 0x7f8b8006cb10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.739+0000 7f8b994a3700 1 --2- 172.21.15.42:0/2608692288 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8b94159cb0 0x7f8b941ef3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.739+0000 7f8b994a3700 1 --2- 172.21.15.42:0/2608692288 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8b940cf460 0x7f8b940c7900 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.739+0000 7f8b994a3700 1 --2- 172.21.15.42:0/2608692288 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8b940cf830 0x7f8b941eeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.739+0000 7f8b994a3700 1 -- 172.21.15.42:0/2608692288 >> 172.21.15.42:0/2608692288 conn(0x7f8b9406ca60 msgr2=0x7f8b9415b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:35.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.739+0000 7f8b994a3700 1 -- 172.21.15.42:0/2608692288 shutdown_connections 2023-07-29T02:00:35.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.739+0000 7f8b994a3700 1 -- 172.21.15.42:0/2608692288 wait complete. 2023-07-29T02:00:35.730 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 10 2023-07-29T02:00:35.740 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T02:00:35.865 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.876+0000 7f646357e700 1 Processor -- start 2023-07-29T02:00:35.865 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.876+0000 7f646357e700 1 -- start start 2023-07-29T02:00:35.867 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.877+0000 7f646357e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f645c1535c0 0x7f645c0c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.868 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.877+0000 7f646357e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f645c159820 0x7f645c159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.868 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.877+0000 7f646357e700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f645c153990 con 0x7f645c0ca060 2023-07-29T02:00:35.868 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.877+0000 7f646357e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f645c15a1e0 con 0x7f645c159820 2023-07-29T02:00:35.868 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.877+0000 7f646357e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645c0c5a10 con 0x7f645c1535c0 2023-07-29T02:00:35.868 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.877+0000 7f6460b19700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f645c0ca060 0x7f645c0cf170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50508/0 (socket says 172.21.15.42:50508) 2023-07-29T02:00:35.868 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.877+0000 7f6460b19700 1 -- 172.21.15.42:0/3046675678 learned_addr learned my addr 172.21.15.42:0/3046675678 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:35.869 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f646131a700 1 --2- 172.21.15.42:0/3046675678 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f645c1535c0 0x7f645c0c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.869 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f6461b1b700 1 --2- 172.21.15.42:0/3046675678 >> v2:172.21.15.144:3300/0 conn(0x7f645c159820 0x7f645c159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.869 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f6453fff700 1 -- 172.21.15.42:0/3046675678 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149047034 0 0) 0x7f645c153990 con 0x7f645c0ca060 2023-07-29T02:00:35.869 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f6453fff700 1 -- 172.21.15.42:0/3046675678 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64480035b0 con 0x7f645c0ca060 2023-07-29T02:00:35.869 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f6453fff700 1 -- 172.21.15.42:0/3046675678 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 60824967 0 0) 0x7f64480035b0 con 0x7f645c0ca060 2023-07-29T02:00:35.869 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f6453fff700 1 -- 172.21.15.42:0/3046675678 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f645c1535c0 msgr2=0x7f645c0c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:35.869 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f6453fff700 1 --2- 172.21.15.42:0/3046675678 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f645c1535c0 0x7f645c0c54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.870 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f6453fff700 1 -- 172.21.15.42:0/3046675678 >> v2:172.21.15.144:3300/0 conn(0x7f645c159820 msgr2=0x7f645c159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:35.870 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f6453fff700 1 --2- 172.21.15.42:0/3046675678 >> v2:172.21.15.144:3300/0 conn(0x7f645c159820 0x7f645c159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.870 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f6453fff700 1 -- 172.21.15.42:0/3046675678 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c15c760 con 0x7f645c0ca060 2023-07-29T02:00:35.870 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f6453fff700 1 -- 172.21.15.42:0/3046675678 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7f64580017f0 con 0x7f645c0ca060 2023-07-29T02:00:35.870 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f6453fff700 1 -- 172.21.15.42:0/3046675678 >> v1:172.21.15.42:6789/0 conn(0x7f645c0ca060 legacy=0x7f645c0cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:35.870 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f6453fff700 1 --2- 172.21.15.42:0/3046675678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6448003a00 0x7f6448003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.870 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f6453fff700 1 --2- 172.21.15.42:0/3046675678 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6448004430 0x7f64480048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.870 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f6453fff700 1 --2- 172.21.15.42:0/3046675678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6448004f10 0x7f644800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.871 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f6453fff700 1 -- 172.21.15.42:0/3046675678 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c15a1e0 con 0x7f6448003a00 2023-07-29T02:00:35.871 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f6453fff700 1 -- 172.21.15.42:0/3046675678 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c0c5a10 con 0x7f6448004f10 2023-07-29T02:00:35.871 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f6453fff700 1 -- 172.21.15.42:0/3046675678 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644800bf50 con 0x7f6448004430 2023-07-29T02:00:35.871 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f646131a700 1 --2- 172.21.15.42:0/3046675678 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f645c1535c0 0x7f645c0c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:00:35.871 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f646131a700 1 --2- 172.21.15.42:0/3046675678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6448003a00 0x7f6448003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.871 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f6461b1b700 1 --2- 172.21.15.42:0/3046675678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6448004f10 0x7f644800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.871 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f6460b19700 1 --2- 172.21.15.42:0/3046675678 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6448004430 0x7f64480048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.872 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f646131a700 1 -- 172.21.15.42:0/3046675678 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6448004430 msgr2=0x7f64480048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:35.872 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f646131a700 1 --2- 172.21.15.42:0/3046675678 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6448004430 0x7f64480048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.872 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f646131a700 1 -- 172.21.15.42:0/3046675678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6448004f10 msgr2=0x7f644800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:35.872 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f646131a700 1 --2- 172.21.15.42:0/3046675678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6448004f10 0x7f644800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.872 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.878+0000 7f646131a700 1 -- 172.21.15.42:0/3046675678 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64480035b0 con 0x7f6448003a00 2023-07-29T02:00:35.872 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.879+0000 7f646131a700 1 --2- 172.21.15.42:0/3046675678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6448003a00 0x7f6448003e10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f645c06bcf0 tx=0x7f6448005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43bc1590d392461 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:35.872 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.879+0000 7f6453fff700 1 -- 172.21.15.42:0/3046675678 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c004030 con 0x7f6448003a00 2023-07-29T02:00:35.873 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.879+0000 7f6453fff700 1 -- 172.21.15.42:0/3046675678 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c004190 con 0x7f6448003a00 2023-07-29T02:00:35.873 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.879+0000 7f6453fff700 1 -- 172.21.15.42:0/3046675678 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c004540 con 0x7f6448003a00 2023-07-29T02:00:35.873 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.879+0000 7f646357e700 1 -- 172.21.15.42:0/3046675678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6448003a00 msgr2=0x7f6448003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:35.873 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.879+0000 7f646357e700 1 --2- 172.21.15.42:0/3046675678 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6448003a00 0x7f6448003e10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f645c06bcf0 tx=0x7f6448005880 comp rx=0 tx=0).stop 2023-07-29T02:00:35.873 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.879+0000 7f6461b1b700 1 -- 172.21.15.42:0/3046675678 reap_dead start 2023-07-29T02:00:35.873 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.879+0000 7f646357e700 1 -- 172.21.15.42:0/3046675678 shutdown_connections 2023-07-29T02:00:35.873 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.879+0000 7f646357e700 1 -- 172.21.15.42:0/3046675678 >> 172.21.15.42:0/3046675678 conn(0x7f645c06cac0 msgr2=0x7f645c06cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:35.873 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.879+0000 7f646357e700 1 -- 172.21.15.42:0/3046675678 shutdown_connections 2023-07-29T02:00:35.874 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.879+0000 7f646357e700 1 -- 172.21.15.42:0/3046675678 wait complete. 2023-07-29T02:00:35.875 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.880+0000 7f646357e700 1 Processor -- start 2023-07-29T02:00:35.876 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.881+0000 7f646357e700 1 -- start start 2023-07-29T02:00:35.876 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.881+0000 7f646357e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6448003a00 0x7f645c0b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.876 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.881+0000 7f646357e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f645c0b34e0 0x7f645c148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.876 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.881+0000 7f646357e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f645c0cd690 0x7f645c1493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.876 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.881+0000 7f646357e700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c0ce5b0 con 0x7f6448003a00 2023-07-29T02:00:35.876 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.881+0000 7f646357e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c0ce850 con 0x7f645c0cd690 2023-07-29T02:00:35.876 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.881+0000 7f646357e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645c0ceb10 con 0x7f645c0b34e0 2023-07-29T02:00:35.877 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.881+0000 7f646131a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6448003a00 0x7f645c0b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.877 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.881+0000 7f646131a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6448003a00 0x7f645c0b40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56716/0 (socket says 172.21.15.42:56716) 2023-07-29T02:00:35.877 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.881+0000 7f646131a700 1 -- 172.21.15.42:0/4288030349 learned_addr learned my addr 172.21.15.42:0/4288030349 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:35.877 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.881+0000 7f6460b19700 1 --2- 172.21.15.42:0/4288030349 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f645c0b34e0 0x7f645c148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.877 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.881+0000 7f6461b1b700 1 --2- 172.21.15.42:0/4288030349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f645c0cd690 0x7f645c1493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.877 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.882+0000 7f646131a700 1 -- 172.21.15.42:0/4288030349 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f645c0b34e0 msgr2=0x7f645c148e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:35.877 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.882+0000 7f646131a700 1 --2- 172.21.15.42:0/4288030349 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f645c0b34e0 0x7f645c148e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.877 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.882+0000 7f646131a700 1 -- 172.21.15.42:0/4288030349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f645c0cd690 msgr2=0x7f645c1493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:35.878 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.882+0000 7f646131a700 1 --2- 172.21.15.42:0/4288030349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f645c0cd690 0x7f645c1493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:35.878 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.882+0000 7f646131a700 1 -- 172.21.15.42:0/4288030349 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c0cedf0 con 0x7f6448003a00 2023-07-29T02:00:35.878 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.882+0000 7f646131a700 1 --2- 172.21.15.42:0/4288030349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6448003a00 0x7f645c0b40e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f64480056e0 tx=0x7f644c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:35.878 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.882+0000 7f6451ffb700 1 -- 172.21.15.42:0/4288030349 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c004030 con 0x7f6448003a00 2023-07-29T02:00:35.878 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.882+0000 7f6451ffb700 1 -- 172.21.15.42:0/4288030349 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c003ab0 con 0x7f6448003a00 2023-07-29T02:00:35.878 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.882+0000 7f646357e700 1 -- 172.21.15.42:0/4288030349 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645c1483a0 con 0x7f6448003a00 2023-07-29T02:00:35.878 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.882+0000 7f6451ffb700 1 -- 172.21.15.42:0/4288030349 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644c003e40 con 0x7f6448003a00 2023-07-29T02:00:35.878 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.882+0000 7f646357e700 1 -- 172.21.15.42:0/4288030349 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645c148960 con 0x7f6448003a00 2023-07-29T02:00:35.879 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.883+0000 7f646357e700 1 -- 172.21.15.42:0/4288030349 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645c0c5f30 con 0x7f6448003a00 2023-07-29T02:00:35.879 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.884+0000 7f6451ffb700 1 -- 172.21.15.42:0/4288030349 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f644c013470 con 0x7f6448003a00 2023-07-29T02:00:35.879 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.884+0000 7f6451ffb700 1 --2- 172.21.15.42:0/4288030349 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f644006a690 0x7f644006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:35.879 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.884+0000 7f6451ffb700 1 -- 172.21.15.42:0/4288030349 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f644c08aad0 con 0x7f6448003a00 2023-07-29T02:00:35.879 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.885+0000 7f6460b19700 1 --2- 172.21.15.42:0/4288030349 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f644006a690 0x7f644006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:35.879 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.885+0000 7f6460b19700 1 --2- 172.21.15.42:0/4288030349 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f644006a690 0x7f644006cb40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f64580011d0 tx=0x7f6458009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:35.880 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:35.888+0000 7f6451ffb700 1 -- 172.21.15.42:0/4288030349 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f644c055c50 con 0x7f6448003a00 2023-07-29T02:00:35.882 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:00:35.884 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:00:36.080 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.092+0000 7f646357e700 1 -- 172.21.15.42:0/4288030349 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f645c04ea50 con 0x7f6448003a00 2023-07-29T02:00:36.081 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.093+0000 7f6451ffb700 1 -- 172.21.15.42:0/4288030349 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19690 (secure 0 0 0) 0x7f644c059270 con 0x7f6448003a00 2023-07-29T02:00:36.082 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:36.082 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T02:00:02.394460+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T01:59:55.827461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T01:59:56.924040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-29T01:59:59.996470+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T02:00:36.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.095+0000 7f646357e700 1 -- 172.21.15.42:0/4288030349 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f644006a690 msgr2=0x7f644006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:36.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.095+0000 7f646357e700 1 --2- 172.21.15.42:0/4288030349 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f644006a690 0x7f644006cb40 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f64580011d0 tx=0x7f6458009040 comp rx=0 tx=0).stop 2023-07-29T02:00:36.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.095+0000 7f646357e700 1 -- 172.21.15.42:0/4288030349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6448003a00 msgr2=0x7f645c0b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:36.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.095+0000 7f646357e700 1 --2- 172.21.15.42:0/4288030349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6448003a00 0x7f645c0b40e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f64480056e0 tx=0x7f644c0047c0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.095+0000 7f646357e700 1 -- 172.21.15.42:0/4288030349 shutdown_connections 2023-07-29T02:00:36.085 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.095+0000 7f646357e700 1 --2- 172.21.15.42:0/4288030349 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f644006a690 0x7f644006cb40 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.085 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.095+0000 7f646357e700 1 --2- 172.21.15.42:0/4288030349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f645c0cd690 0x7f645c1493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.085 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.095+0000 7f646357e700 1 --2- 172.21.15.42:0/4288030349 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6448003a00 0x7f645c0b40e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.085 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.095+0000 7f646357e700 1 --2- 172.21.15.42:0/4288030349 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f645c0b34e0 0x7f645c148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.085 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.095+0000 7f646357e700 1 -- 172.21.15.42:0/4288030349 >> 172.21.15.42:0/4288030349 conn(0x7f645c06cac0 msgr2=0x7f645c150880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:36.085 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.095+0000 7f646357e700 1 -- 172.21.15.42:0/4288030349 shutdown_connections 2023-07-29T02:00:36.085 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.095+0000 7f646357e700 1 -- 172.21.15.42:0/4288030349 wait complete. 2023-07-29T02:00:36.096 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-29T01:59:50.906228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-29T01:59:51.290583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T01:59:55.827461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T01:59:56.924040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-29T01:59:59.996470+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-29T02:00:36.097 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-29T02:00:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.236+0000 7fc81fa77700 1 Processor -- start 2023-07-29T02:00:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.236+0000 7fc81fa77700 1 -- start start 2023-07-29T02:00:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.237+0000 7fc81fa77700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc818153650 0x7fc8180b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.237+0000 7fc81fa77700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc8181590e0 0x7fc81806fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:36.227 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.237+0000 7fc81fa77700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81806ce40 con 0x7fc818153280 2023-07-29T02:00:36.227 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.237+0000 7fc81fa77700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81806e3c0 con 0x7fc8181590e0 2023-07-29T02:00:36.227 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.237+0000 7fc81fa77700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81806d120 con 0x7fc818153650 2023-07-29T02:00:36.227 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.237+0000 7fc81e014700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc8181590e0 0x7fc81806fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:36.227 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.237+0000 7fc81d813700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc818153280 0x7fc81806eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50528/0 (socket says 172.21.15.42:50528) 2023-07-29T02:00:36.227 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.237+0000 7fc81e014700 1 --2- 172.21.15.42:0/1448156038 >> v2:172.21.15.42:3300/0 conn(0x7fc8181590e0 0x7fc81806fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56728/0 (socket says 172.21.15.42:56728) 2023-07-29T02:00:36.227 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.237+0000 7fc81d813700 1 -- 172.21.15.42:0/1448156038 learned_addr learned my addr 172.21.15.42:0/1448156038 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:36.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.237+0000 7fc81d012700 1 --2- 172.21.15.42:0/1448156038 >> v2:172.21.15.144:3300/0 conn(0x7fc818153650 0x7fc8180b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:36.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.237+0000 7fc81e014700 1 -- 172.21.15.42:0/1448156038 >> v2:172.21.15.144:3300/0 conn(0x7fc818153650 msgr2=0x7fc8180b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:36.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.237+0000 7fc81e014700 1 --2- 172.21.15.42:0/1448156038 >> v2:172.21.15.144:3300/0 conn(0x7fc818153650 0x7fc8180b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.237+0000 7fc81e014700 1 -- 172.21.15.42:0/1448156038 >> v1:172.21.15.42:6789/0 conn(0x7fc818153280 legacy=0x7fc81806eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:36.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.237+0000 7fc81e014700 1 -- 172.21.15.42:0/1448156038 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81806d400 con 0x7fc8181590e0 2023-07-29T02:00:36.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.237+0000 7fc81c811700 1 -- 172.21.15.42:0/1448156038 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345120536 0 0) 0x7fc81806ce40 con 0x7fc818153280 2023-07-29T02:00:36.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.237+0000 7fc81e014700 1 --2- 172.21.15.42:0/1448156038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8181590e0 0x7fc81806fc70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc818071ce0 tx=0x7fc81000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54adadc15a1f9be4 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:36.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.238+0000 7fc81c811700 1 -- 172.21.15.42:0/1448156038 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81000e070 con 0x7fc8181590e0 2023-07-29T02:00:36.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.238+0000 7fc81c811700 1 -- 172.21.15.42:0/1448156038 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81000bbd0 con 0x7fc8181590e0 2023-07-29T02:00:36.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.238+0000 7fc81c811700 1 -- 172.21.15.42:0/1448156038 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810012430 con 0x7fc8181590e0 2023-07-29T02:00:36.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.238+0000 7fc81fa77700 1 -- 172.21.15.42:0/1448156038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8181590e0 msgr2=0x7fc81806fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:36.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.238+0000 7fc81fa77700 1 --2- 172.21.15.42:0/1448156038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8181590e0 0x7fc81806fc70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc818071ce0 tx=0x7fc81000b330 comp rx=0 tx=0).stop 2023-07-29T02:00:36.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.238+0000 7fc81fa77700 1 -- 172.21.15.42:0/1448156038 shutdown_connections 2023-07-29T02:00:36.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.238+0000 7fc81fa77700 1 --2- 172.21.15.42:0/1448156038 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8181590e0 0x7fc81806fc70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.238+0000 7fc81fa77700 1 --2- 172.21.15.42:0/1448156038 >> v2:172.21.15.144:3300/0 conn(0x7fc818153650 0x7fc8180b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.238+0000 7fc81fa77700 1 -- 172.21.15.42:0/1448156038 >> 172.21.15.42:0/1448156038 conn(0x7fc818072230 msgr2=0x7fc818072600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:36.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.238+0000 7fc81fa77700 1 -- 172.21.15.42:0/1448156038 shutdown_connections 2023-07-29T02:00:36.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.238+0000 7fc81fa77700 1 -- 172.21.15.42:0/1448156038 wait complete. 2023-07-29T02:00:36.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.240+0000 7fc81fa77700 1 Processor -- start 2023-07-29T02:00:36.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.240+0000 7fc81fa77700 1 -- start start 2023-07-29T02:00:36.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.241+0000 7fc81fa77700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc818153280 0x7fc8180c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:36.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.241+0000 7fc81fa77700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc818153650 0x7fc8180c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:36.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.241+0000 7fc81fa77700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8181590e0 0x7fc8180cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:36.233 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.241+0000 7fc81fa77700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8180c4770 con 0x7fc8181590e0 2023-07-29T02:00:36.233 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.241+0000 7fc81fa77700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8181f2e00 con 0x7fc818153280 2023-07-29T02:00:36.233 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.241+0000 7fc81fa77700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8181f2890 con 0x7fc818153650 2023-07-29T02:00:36.233 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.241+0000 7fc81e014700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8181590e0 0x7fc8180cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:36.233 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.241+0000 7fc81e014700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8181590e0 0x7fc8180cc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56734/0 (socket says 172.21.15.42:56734) 2023-07-29T02:00:36.233 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.241+0000 7fc81e014700 1 -- 172.21.15.42:0/2417249611 learned_addr learned my addr 172.21.15.42:0/2417249611 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:36.233 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.241+0000 7fc81d813700 1 --2- 172.21.15.42:0/2417249611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc818153280 0x7fc8180c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:36.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.241+0000 7fc81d012700 1 --2- 172.21.15.42:0/2417249611 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc818153650 0x7fc8180c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:36.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.241+0000 7fc81e014700 1 -- 172.21.15.42:0/2417249611 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc818153650 msgr2=0x7fc8180c3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:36.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.241+0000 7fc81e014700 1 --2- 172.21.15.42:0/2417249611 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc818153650 0x7fc8180c3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.241+0000 7fc81e014700 1 -- 172.21.15.42:0/2417249611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc818153280 msgr2=0x7fc8180c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:36.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.241+0000 7fc81e014700 1 --2- 172.21.15.42:0/2417249611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc818153280 0x7fc8180c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.241+0000 7fc81e014700 1 -- 172.21.15.42:0/2417249611 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc810009a70 con 0x7fc8181590e0 2023-07-29T02:00:36.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.241+0000 7fc81d012700 1 --2- 172.21.15.42:0/2417249611 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc818153650 0x7fc8180c3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:36.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.241+0000 7fc81d813700 1 --2- 172.21.15.42:0/2417249611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc818153280 0x7fc8180c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:36.235 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.241+0000 7fc81e014700 1 --2- 172.21.15.42:0/2417249611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8181590e0 0x7fc8180cc200 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc810013000 tx=0x7fc810004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:36.235 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.242+0000 7fc80e7fc700 1 -- 172.21.15.42:0/2417249611 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810012430 con 0x7fc8181590e0 2023-07-29T02:00:36.235 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.242+0000 7fc80e7fc700 1 -- 172.21.15.42:0/2417249611 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc810020070 con 0x7fc8181590e0 2023-07-29T02:00:36.235 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.242+0000 7fc80e7fc700 1 -- 172.21.15.42:0/2417249611 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc810004280 con 0x7fc8181590e0 2023-07-29T02:00:36.235 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.242+0000 7fc81fa77700 1 -- 172.21.15.42:0/2417249611 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8180c2120 con 0x7fc8181590e0 2023-07-29T02:00:36.235 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.242+0000 7fc81fa77700 1 -- 172.21.15.42:0/2417249611 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8180c30d0 con 0x7fc8181590e0 2023-07-29T02:00:36.236 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.243+0000 7fc81fa77700 1 -- 172.21.15.42:0/2417249611 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc81806c570 con 0x7fc8181590e0 2023-07-29T02:00:36.236 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.243+0000 7fc80e7fc700 1 -- 172.21.15.42:0/2417249611 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fc8100043e0 con 0x7fc8181590e0 2023-07-29T02:00:36.237 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.243+0000 7fc80e7fc700 1 --2- 172.21.15.42:0/2417249611 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc7fc06a660 0x7fc7fc06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:36.237 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.244+0000 7fc80e7fc700 1 -- 172.21.15.42:0/2417249611 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc810022070 con 0x7fc8181590e0 2023-07-29T02:00:36.237 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.244+0000 7fc81d813700 1 --2- 172.21.15.42:0/2417249611 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc7fc06a660 0x7fc7fc06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:36.237 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.244+0000 7fc81d813700 1 --2- 172.21.15.42:0/2417249611 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc7fc06a660 0x7fc7fc06cb10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc814000f60 tx=0x7fc814007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:36.237 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.248+0000 7fc80e7fc700 1 -- 172.21.15.42:0/2417249611 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fc810055e40 con 0x7fc8181590e0 2023-07-29T02:00:36.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.446+0000 7fc81fa77700 1 -- 172.21.15.42:0/2417249611 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc81804ea50 con 0x7fc8181590e0 2023-07-29T02:00:36.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.446+0000 7fc80e7fc700 1 -- 172.21.15.42:0/2417249611 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc81002c020 con 0x7fc8181590e0 2023-07-29T02:00:36.435 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 8 2023-07-29T02:00:36.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.448+0000 7fc81fa77700 1 -- 172.21.15.42:0/2417249611 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc7fc06a660 msgr2=0x7fc7fc06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:36.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.448+0000 7fc81fa77700 1 --2- 172.21.15.42:0/2417249611 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc7fc06a660 0x7fc7fc06cb10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc814000f60 tx=0x7fc814007ca0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.449+0000 7fc81fa77700 1 -- 172.21.15.42:0/2417249611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8181590e0 msgr2=0x7fc8180cc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:36.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.449+0000 7fc81fa77700 1 --2- 172.21.15.42:0/2417249611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8181590e0 0x7fc8180cc200 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc810013000 tx=0x7fc810004ad0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.449+0000 7fc81fa77700 1 -- 172.21.15.42:0/2417249611 shutdown_connections 2023-07-29T02:00:36.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.449+0000 7fc81fa77700 1 --2- 172.21.15.42:0/2417249611 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc7fc06a660 0x7fc7fc06cb10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.449+0000 7fc81fa77700 1 --2- 172.21.15.42:0/2417249611 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc8181590e0 0x7fc8180cc200 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.449+0000 7fc81fa77700 1 --2- 172.21.15.42:0/2417249611 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc818153280 0x7fc8180c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.449+0000 7fc81fa77700 1 --2- 172.21.15.42:0/2417249611 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc818153650 0x7fc8180c3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.449+0000 7fc81fa77700 1 -- 172.21.15.42:0/2417249611 >> 172.21.15.42:0/2417249611 conn(0x7fc818072230 msgr2=0x7fc818150030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:36.439 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.449+0000 7fc81fa77700 1 -- 172.21.15.42:0/2417249611 shutdown_connections 2023-07-29T02:00:36.439 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.449+0000 7fc81fa77700 1 -- 172.21.15.42:0/2417249611 wait complete. 2023-07-29T02:00:36.449 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-29T02:00:36.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.588+0000 7fc64accf700 1 Processor -- start 2023-07-29T02:00:36.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.588+0000 7fc64accf700 1 -- start start 2023-07-29T02:00:36.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.589+0000 7fc64accf700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc64414f360 0x7fc64406a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:36.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.589+0000 7fc64accf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6440c6110 0x7fc644071230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:36.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.589+0000 7fc64accf700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc6440c7d00 0x7fc644071770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:36.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.589+0000 7fc64accf700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6441557d0 con 0x7fc6440c7d00 2023-07-29T02:00:36.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.589+0000 7fc64accf700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6440c6c60 con 0x7fc64414f360 2023-07-29T02:00:36.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.589+0000 7fc64accf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6440c6f40 con 0x7fc6440c6110 2023-07-29T02:00:36.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.589+0000 7fc64926c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc6440c7d00 0x7fc644071770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:36.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.589+0000 7fc64926c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc6440c7d00 0x7fc644071770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56742/0 (socket says 172.21.15.42:56742) 2023-07-29T02:00:36.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.589+0000 7fc64926c700 1 -- 172.21.15.42:0/2139119360 learned_addr learned my addr 172.21.15.42:0/2139119360 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:36.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.589+0000 7fc648a6b700 1 --2- 172.21.15.42:0/2139119360 >> v2:172.21.15.144:3300/0 conn(0x7fc64414f360 0x7fc64406a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:36.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.589+0000 7fc643fff700 1 --2- 172.21.15.42:0/2139119360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6440c6110 0x7fc644071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:36.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.590+0000 7fc64926c700 1 -- 172.21.15.42:0/2139119360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6440c6110 msgr2=0x7fc644071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:36.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.590+0000 7fc64926c700 1 --2- 172.21.15.42:0/2139119360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6440c6110 0x7fc644071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.590+0000 7fc64926c700 1 -- 172.21.15.42:0/2139119360 >> v2:172.21.15.144:3300/0 conn(0x7fc64414f360 msgr2=0x7fc64406a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:36.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.590+0000 7fc64926c700 1 --2- 172.21.15.42:0/2139119360 >> v2:172.21.15.144:3300/0 conn(0x7fc64414f360 0x7fc64406a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.590+0000 7fc64926c700 1 -- 172.21.15.42:0/2139119360 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6440c7220 con 0x7fc6440c7d00 2023-07-29T02:00:36.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.590+0000 7fc64926c700 1 --2- 172.21.15.42:0/2139119360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6440c7d00 0x7fc644071770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc644068220 tx=0x7fc63c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f97c0b3c99cd0b server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:36.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.590+0000 7fc6437fe700 1 -- 172.21.15.42:0/2139119360 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c00e070 con 0x7fc6440c7d00 2023-07-29T02:00:36.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.590+0000 7fc6437fe700 1 -- 172.21.15.42:0/2139119360 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63c00b9c0 con 0x7fc6440c7d00 2023-07-29T02:00:36.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.590+0000 7fc6437fe700 1 -- 172.21.15.42:0/2139119360 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63c00bd70 con 0x7fc6440c7d00 2023-07-29T02:00:36.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.590+0000 7fc64accf700 1 -- 172.21.15.42:0/2139119360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6440c7d00 msgr2=0x7fc644071770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:36.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.590+0000 7fc64accf700 1 --2- 172.21.15.42:0/2139119360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6440c7d00 0x7fc644071770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc644068220 tx=0x7fc63c00b330 comp rx=0 tx=0).stop 2023-07-29T02:00:36.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.590+0000 7fc64accf700 1 -- 172.21.15.42:0/2139119360 shutdown_connections 2023-07-29T02:00:36.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.590+0000 7fc64accf700 1 --2- 172.21.15.42:0/2139119360 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6440c7d00 0x7fc644071770 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.590+0000 7fc64accf700 1 --2- 172.21.15.42:0/2139119360 >> v2:172.21.15.144:3300/0 conn(0x7fc64414f360 0x7fc64406a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.590+0000 7fc64accf700 1 --2- 172.21.15.42:0/2139119360 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6440c6110 0x7fc644071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.590+0000 7fc64accf700 1 -- 172.21.15.42:0/2139119360 >> 172.21.15.42:0/2139119360 conn(0x7fc6440cc420 msgr2=0x7fc6440c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:36.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.591+0000 7fc64accf700 1 -- 172.21.15.42:0/2139119360 shutdown_connections 2023-07-29T02:00:36.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.591+0000 7fc64accf700 1 -- 172.21.15.42:0/2139119360 wait complete. 2023-07-29T02:00:36.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.592+0000 7fc64accf700 1 Processor -- start 2023-07-29T02:00:36.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.592+0000 7fc64accf700 1 -- start start 2023-07-29T02:00:36.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc64accf700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6440c6110 0x7fc6441ed0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:36.585 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc64accf700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6440c7d00 0x7fc6440ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:36.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc64accf700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc64414f360 0x7fc6440c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:36.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc64accf700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc644147180 con 0x7fc6440c7d00 2023-07-29T02:00:36.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc64accf700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6441ed5f0 con 0x7fc64414f360 2023-07-29T02:00:36.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc64accf700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6440c4f80 con 0x7fc6440c6110 2023-07-29T02:00:36.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc643fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6440c7d00 0x7fc6440ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:36.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc643fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6440c7d00 0x7fc6440ca180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56746/0 (socket says 172.21.15.42:56746) 2023-07-29T02:00:36.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc643fff700 1 -- 172.21.15.42:0/1391480854 learned_addr learned my addr 172.21.15.42:0/1391480854 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:36.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc648a6b700 1 --2- 172.21.15.42:0/1391480854 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6440c6110 0x7fc6441ed0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:36.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc64926c700 1 --2- 172.21.15.42:0/1391480854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc64414f360 0x7fc6440c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:36.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc643fff700 1 -- 172.21.15.42:0/1391480854 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6440c6110 msgr2=0x7fc6441ed0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:36.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc643fff700 1 --2- 172.21.15.42:0/1391480854 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6440c6110 0x7fc6441ed0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc643fff700 1 -- 172.21.15.42:0/1391480854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc64414f360 msgr2=0x7fc6440c3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:36.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc643fff700 1 --2- 172.21.15.42:0/1391480854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc64414f360 0x7fc6440c3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc643fff700 1 -- 172.21.15.42:0/1391480854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c009b30 con 0x7fc6440c7d00 2023-07-29T02:00:36.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc64926c700 1 --2- 172.21.15.42:0/1391480854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc64414f360 0x7fc6440c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:36.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc643fff700 1 --2- 172.21.15.42:0/1391480854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6440c7d00 0x7fc6440ca180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc63000d930 tx=0x7fc63000dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:36.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc6417fa700 1 -- 172.21.15.42:0/1391480854 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000a7c0 con 0x7fc6440c7d00 2023-07-29T02:00:36.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc6417fa700 1 -- 172.21.15.42:0/1391480854 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63000a920 con 0x7fc6440c7d00 2023-07-29T02:00:36.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc64accf700 1 -- 172.21.15.42:0/1391480854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6440c30c0 con 0x7fc6440c7d00 2023-07-29T02:00:36.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc6417fa700 1 -- 172.21.15.42:0/1391480854 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63000acb0 con 0x7fc6440c7d00 2023-07-29T02:00:36.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.593+0000 7fc64accf700 1 -- 172.21.15.42:0/1391480854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6440c3680 con 0x7fc6440c7d00 2023-07-29T02:00:36.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.594+0000 7fc64accf700 1 -- 172.21.15.42:0/1391480854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64404ea50 con 0x7fc6440c7d00 2023-07-29T02:00:36.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.595+0000 7fc6417fa700 1 -- 172.21.15.42:0/1391480854 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fc630011460 con 0x7fc6440c7d00 2023-07-29T02:00:36.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.595+0000 7fc6417fa700 1 --2- 172.21.15.42:0/1391480854 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc62806a690 0x7fc62806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:36.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.595+0000 7fc6417fa700 1 -- 172.21.15.42:0/1391480854 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc630088e60 con 0x7fc6440c7d00 2023-07-29T02:00:36.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.595+0000 7fc648a6b700 1 --2- 172.21.15.42:0/1391480854 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc62806a690 0x7fc62806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:36.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.596+0000 7fc648a6b700 1 --2- 172.21.15.42:0/1391480854 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc62806a690 0x7fc62806cb40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc638006b20 tx=0x7fc638008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:36.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.599+0000 7fc6417fa700 1 -- 172.21.15.42:0/1391480854 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fc630053ef0 con 0x7fc6440c7d00 2023-07-29T02:00:36.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.797+0000 7fc64accf700 1 -- 172.21.15.42:0/1391480854 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc644070e00 con 0x7fc6440c7d00 2023-07-29T02:00:36.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.797+0000 7fc6417fa700 1 -- 172.21.15.42:0/1391480854 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc63000b040 con 0x7fc6440c7d00 2023-07-29T02:00:36.786 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2023-07-29T02:00:36.788 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.799+0000 7fc64accf700 1 -- 172.21.15.42:0/1391480854 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc62806a690 msgr2=0x7fc62806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:36.788 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.800+0000 7fc64accf700 1 --2- 172.21.15.42:0/1391480854 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc62806a690 0x7fc62806cb40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc638006b20 tx=0x7fc638008040 comp rx=0 tx=0).stop 2023-07-29T02:00:36.788 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.800+0000 7fc64accf700 1 -- 172.21.15.42:0/1391480854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6440c7d00 msgr2=0x7fc6440ca180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:36.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.800+0000 7fc64accf700 1 --2- 172.21.15.42:0/1391480854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6440c7d00 0x7fc6440ca180 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc63000d930 tx=0x7fc63000dc40 comp rx=0 tx=0).stop 2023-07-29T02:00:36.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.800+0000 7fc64accf700 1 -- 172.21.15.42:0/1391480854 shutdown_connections 2023-07-29T02:00:36.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.800+0000 7fc64accf700 1 --2- 172.21.15.42:0/1391480854 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc62806a690 0x7fc62806cb40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.800+0000 7fc64accf700 1 --2- 172.21.15.42:0/1391480854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc64414f360 0x7fc6440c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.800+0000 7fc64accf700 1 --2- 172.21.15.42:0/1391480854 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc6440c6110 0x7fc6441ed0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.800+0000 7fc64accf700 1 --2- 172.21.15.42:0/1391480854 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc6440c7d00 0x7fc6440ca180 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.800+0000 7fc64accf700 1 -- 172.21.15.42:0/1391480854 >> 172.21.15.42:0/1391480854 conn(0x7fc6440cc420 msgr2=0x7fc64414cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:36.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.800+0000 7fc64accf700 1 -- 172.21.15.42:0/1391480854 shutdown_connections 2023-07-29T02:00:36.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.800+0000 7fc64accf700 1 -- 172.21.15.42:0/1391480854 wait complete. 2023-07-29T02:00:36.800 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-29T02:00:36.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.939+0000 7f8d79e05700 1 Processor -- start 2023-07-29T02:00:36.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.939+0000 7f8d79e05700 1 -- start start 2023-07-29T02:00:36.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.940+0000 7f8d79e05700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d74150030 0x7f8d7406f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:36.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.940+0000 7f8d79e05700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7406cb10 con 0x7f8d74155bd0 2023-07-29T02:00:36.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.940+0000 7f8d79e05700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d74156000 con 0x7f8d7406eda0 2023-07-29T02:00:36.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.940+0000 7f8d79e05700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d74156280 con 0x7f8d74150030 2023-07-29T02:00:36.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.940+0000 7f8d72ffd700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f8d74155bd0 0x7f8d7414f920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50558/0 (socket says 172.21.15.42:50558) 2023-07-29T02:00:36.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.940+0000 7f8d72ffd700 1 -- 172.21.15.42:0/1845848111 learned_addr learned my addr 172.21.15.42:0/1845848111 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:36.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.940+0000 7f8d73fff700 1 --2- 172.21.15.42:0/1845848111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d74150030 0x7f8d7406f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:36.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.940+0000 7f8d727fc700 1 -- 172.21.15.42:0/1845848111 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4182423919 0 0) 0x7f8d7406cb10 con 0x7f8d74155bd0 2023-07-29T02:00:36.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.940+0000 7f8d727fc700 1 -- 172.21.15.42:0/1845848111 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d600035b0 con 0x7f8d74155bd0 2023-07-29T02:00:36.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.940+0000 7f8d73fff700 1 -- 172.21.15.42:0/1845848111 >> v1:172.21.15.144:6789/0 conn(0x7f8d7406eda0 legacy=0x7f8d7406cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:36.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.940+0000 7f8d727fc700 1 -- 172.21.15.42:0/1845848111 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696446444 0 0) 0x7f8d74156000 con 0x7f8d7406eda0 2023-07-29T02:00:36.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.940+0000 7f8d73fff700 1 -- 172.21.15.42:0/1845848111 >> v1:172.21.15.42:6789/0 conn(0x7f8d74155bd0 legacy=0x7f8d7414f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:36.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.940+0000 7f8d73fff700 1 -- 172.21.15.42:0/1845848111 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d74156560 con 0x7f8d74150030 2023-07-29T02:00:36.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.941+0000 7f8d73fff700 1 --2- 172.21.15.42:0/1845848111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d74150030 0x7f8d7406f170 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009dc0 tx=0x7f8d6c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52f21e0fdf603c4e server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:36.933 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.941+0000 7f8d727fc700 1 -- 172.21.15.42:0/1845848111 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c00e070 con 0x7f8d74150030 2023-07-29T02:00:36.933 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.941+0000 7f8d727fc700 1 -- 172.21.15.42:0/1845848111 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c00bb20 con 0x7f8d74150030 2023-07-29T02:00:36.933 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.941+0000 7f8d727fc700 1 -- 172.21.15.42:0/1845848111 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c00bed0 con 0x7f8d74150030 2023-07-29T02:00:36.933 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.941+0000 7f8d79e05700 1 -- 172.21.15.42:0/1845848111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d74150030 msgr2=0x7f8d7406f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:36.933 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.941+0000 7f8d79e05700 1 --2- 172.21.15.42:0/1845848111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d74150030 0x7f8d7406f170 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009dc0 tx=0x7f8d6c00b330 comp rx=0 tx=0).stop 2023-07-29T02:00:36.933 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.941+0000 7f8d79e05700 1 -- 172.21.15.42:0/1845848111 shutdown_connections 2023-07-29T02:00:36.933 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.941+0000 7f8d79e05700 1 --2- 172.21.15.42:0/1845848111 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d74150030 0x7f8d7406f170 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.941+0000 7f8d79e05700 1 -- 172.21.15.42:0/1845848111 >> 172.21.15.42:0/1845848111 conn(0x7f8d740cbf10 msgr2=0x7f8d740cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:36.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.941+0000 7f8d79e05700 1 -- 172.21.15.42:0/1845848111 shutdown_connections 2023-07-29T02:00:36.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.941+0000 7f8d79e05700 1 -- 172.21.15.42:0/1845848111 wait complete. 2023-07-29T02:00:36.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.943+0000 7f8d79e05700 1 Processor -- start 2023-07-29T02:00:36.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.943+0000 7f8d79e05700 1 -- start start 2023-07-29T02:00:36.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.943+0000 7f8d79e05700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d7406eda0 0x7f8d741dea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:36.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.943+0000 7f8d79e05700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d74150030 0x7f8d740c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:36.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.943+0000 7f8d79e05700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d74155bd0 0x7f8d740c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:36.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.943+0000 7f8d79e05700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d741dd690 con 0x7f8d74150030 2023-07-29T02:00:36.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.943+0000 7f8d79e05700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d741509e0 con 0x7f8d74155bd0 2023-07-29T02:00:36.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.943+0000 7f8d79e05700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d741dd140 con 0x7f8d7406eda0 2023-07-29T02:00:36.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.944+0000 7f8d72ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d74150030 0x7f8d740c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:36.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.944+0000 7f8d72ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d74150030 0x7f8d740c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56760/0 (socket says 172.21.15.42:56760) 2023-07-29T02:00:36.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.944+0000 7f8d72ffd700 1 -- 172.21.15.42:0/2938686403 learned_addr learned my addr 172.21.15.42:0/2938686403 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:36.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.944+0000 7f8d73fff700 1 --2- 172.21.15.42:0/2938686403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d74155bd0 0x7f8d740c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:36.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.944+0000 7f8d737fe700 1 --2- 172.21.15.42:0/2938686403 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d7406eda0 0x7f8d741dea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:36.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.944+0000 7f8d72ffd700 1 -- 172.21.15.42:0/2938686403 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d7406eda0 msgr2=0x7f8d741dea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:36.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.944+0000 7f8d72ffd700 1 --2- 172.21.15.42:0/2938686403 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d7406eda0 0x7f8d741dea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.944+0000 7f8d72ffd700 1 -- 172.21.15.42:0/2938686403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d74155bd0 msgr2=0x7f8d740c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:36.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.944+0000 7f8d72ffd700 1 --2- 172.21.15.42:0/2938686403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d74155bd0 0x7f8d740c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:36.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.944+0000 7f8d72ffd700 1 -- 172.21.15.42:0/2938686403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c009a70 con 0x7f8d74150030 2023-07-29T02:00:36.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.944+0000 7f8d72ffd700 1 --2- 172.21.15.42:0/2938686403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d74150030 0x7f8d740c8dd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400c450 tx=0x7f8d6400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:36.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.944+0000 7f8d6bfff700 1 -- 172.21.15.42:0/2938686403 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d64005b40 con 0x7f8d74150030 2023-07-29T02:00:36.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.944+0000 7f8d6bfff700 1 -- 172.21.15.42:0/2938686403 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d64005ca0 con 0x7f8d74150030 2023-07-29T02:00:36.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.944+0000 7f8d79e05700 1 -- 172.21.15.42:0/2938686403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d741def80 con 0x7f8d74150030 2023-07-29T02:00:36.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.944+0000 7f8d6bfff700 1 -- 172.21.15.42:0/2938686403 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d640072f0 con 0x7f8d74150030 2023-07-29T02:00:36.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.944+0000 7f8d79e05700 1 -- 172.21.15.42:0/2938686403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d741dd3b0 con 0x7f8d74150030 2023-07-29T02:00:36.938 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.945+0000 7f8d79e05700 1 -- 172.21.15.42:0/2938686403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d74152ed0 con 0x7f8d74150030 2023-07-29T02:00:36.938 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.946+0000 7f8d6bfff700 1 -- 172.21.15.42:0/2938686403 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f8d64007450 con 0x7f8d74150030 2023-07-29T02:00:36.938 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.946+0000 7f8d6bfff700 1 --2- 172.21.15.42:0/2938686403 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8d5406a660 0x7f8d5406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:36.938 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.946+0000 7f8d6bfff700 1 -- 172.21.15.42:0/2938686403 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8d64088040 con 0x7f8d74150030 2023-07-29T02:00:36.938 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.946+0000 7f8d737fe700 1 --2- 172.21.15.42:0/2938686403 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8d5406a660 0x7f8d5406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:36.939 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.947+0000 7f8d737fe700 1 --2- 172.21.15.42:0/2938686403 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8d5406a660 0x7f8d5406cb10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c000f60 tx=0x7f8d5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:36.939 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:36.950+0000 7f8d6bfff700 1 -- 172.21.15.42:0/2938686403 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f8d74152ed0 con 0x7f8d74150030 2023-07-29T02:00:37.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.146+0000 7f8d79e05700 1 -- 172.21.15.42:0/2938686403 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8d74152ed0 con 0x7f8d74150030 2023-07-29T02:00:37.135 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.146+0000 7f8d6bfff700 1 -- 172.21.15.42:0/2938686403 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8d64017020 con 0x7f8d74150030 2023-07-29T02:00:37.135 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2023-07-29T02:00:37.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.148+0000 7f8d79e05700 1 -- 172.21.15.42:0/2938686403 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8d5406a660 msgr2=0x7f8d5406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:37.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.148+0000 7f8d79e05700 1 --2- 172.21.15.42:0/2938686403 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8d5406a660 0x7f8d5406cb10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c000f60 tx=0x7f8d5c009040 comp rx=0 tx=0).stop 2023-07-29T02:00:37.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.148+0000 7f8d79e05700 1 -- 172.21.15.42:0/2938686403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d74150030 msgr2=0x7f8d740c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:37.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.148+0000 7f8d79e05700 1 --2- 172.21.15.42:0/2938686403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d74150030 0x7f8d740c8dd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8d6400c450 tx=0x7f8d6400c760 comp rx=0 tx=0).stop 2023-07-29T02:00:37.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.148+0000 7f8d79e05700 1 -- 172.21.15.42:0/2938686403 shutdown_connections 2023-07-29T02:00:37.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.148+0000 7f8d79e05700 1 --2- 172.21.15.42:0/2938686403 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8d5406a660 0x7f8d5406cb10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.148+0000 7f8d79e05700 1 --2- 172.21.15.42:0/2938686403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d74155bd0 0x7f8d740c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.148+0000 7f8d79e05700 1 --2- 172.21.15.42:0/2938686403 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d7406eda0 0x7f8d741dea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.148+0000 7f8d79e05700 1 --2- 172.21.15.42:0/2938686403 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d74150030 0x7f8d740c8dd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.148+0000 7f8d79e05700 1 -- 172.21.15.42:0/2938686403 >> 172.21.15.42:0/2938686403 conn(0x7f8d740cbf10 msgr2=0x7f8d740738a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:37.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.148+0000 7f8d79e05700 1 -- 172.21.15.42:0/2938686403 shutdown_connections 2023-07-29T02:00:37.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.148+0000 7f8d79e05700 1 -- 172.21.15.42:0/2938686403 wait complete. 2023-07-29T02:00:37.149 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-29T02:00:37.276 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.288+0000 7f73dc0e5700 1 Processor -- start 2023-07-29T02:00:37.276 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.288+0000 7f73dc0e5700 1 -- start start 2023-07-29T02:00:37.278 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.289+0000 7f73dc0e5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f73d4155bd0 0x7f73d414f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:37.278 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.289+0000 7f73dc0e5700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d406cb10 con 0x7f73d414fe60 2023-07-29T02:00:37.278 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.289+0000 7f73dc0e5700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d4156000 con 0x7f73d406eda0 2023-07-29T02:00:37.278 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.289+0000 7f73dc0e5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d41502a0 con 0x7f73d4155bd0 2023-07-29T02:00:37.278 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.289+0000 7f73da682700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f73d414fe60 0x7f73d406f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50574/0 (socket says 172.21.15.42:50574) 2023-07-29T02:00:37.278 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.289+0000 7f73da682700 1 -- 172.21.15.42:0/4217678379 learned_addr learned my addr 172.21.15.42:0/4217678379 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:37.278 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.289+0000 7f73d9680700 1 --2- 172.21.15.42:0/4217678379 >> v2:172.21.15.144:3300/0 conn(0x7f73d4155bd0 0x7f73d414f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:37.279 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.289+0000 7f73d8e7f700 1 -- 172.21.15.42:0/4217678379 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786274546 0 0) 0x7f73d406cb10 con 0x7f73d414fe60 2023-07-29T02:00:37.279 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.289+0000 7f73d8e7f700 1 -- 172.21.15.42:0/4217678379 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73c00035b0 con 0x7f73d414fe60 2023-07-29T02:00:37.279 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.289+0000 7f73d9680700 1 -- 172.21.15.42:0/4217678379 >> v1:172.21.15.144:6789/0 conn(0x7f73d406eda0 legacy=0x7f73d406cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:37.279 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.289+0000 7f73d9680700 1 -- 172.21.15.42:0/4217678379 >> v1:172.21.15.42:6789/0 conn(0x7f73d414fe60 legacy=0x7f73d406f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:37.279 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.289+0000 7f73d9680700 1 -- 172.21.15.42:0/4217678379 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d4156280 con 0x7f73d4155bd0 2023-07-29T02:00:37.279 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.290+0000 7f73d9680700 1 --2- 172.21.15.42:0/4217678379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73d4155bd0 0x7f73d414f920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009840 tx=0x7f73c4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d0a6bc09a27fcc4 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:37.280 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.290+0000 7f73d8e7f700 1 -- 172.21.15.42:0/4217678379 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c4011830 con 0x7f73d4155bd0 2023-07-29T02:00:37.280 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.290+0000 7f73d8e7f700 1 -- 172.21.15.42:0/4217678379 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c4011990 con 0x7f73d4155bd0 2023-07-29T02:00:37.281 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.290+0000 7f73d8e7f700 1 -- 172.21.15.42:0/4217678379 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c4011d20 con 0x7f73d4155bd0 2023-07-29T02:00:37.281 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.290+0000 7f73dc0e5700 1 -- 172.21.15.42:0/4217678379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73d4155bd0 msgr2=0x7f73d414f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:37.281 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.290+0000 7f73dc0e5700 1 --2- 172.21.15.42:0/4217678379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73d4155bd0 0x7f73d414f920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009840 tx=0x7f73c4009b50 comp rx=0 tx=0).stop 2023-07-29T02:00:37.281 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.290+0000 7f73dc0e5700 1 -- 172.21.15.42:0/4217678379 shutdown_connections 2023-07-29T02:00:37.281 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.290+0000 7f73dc0e5700 1 --2- 172.21.15.42:0/4217678379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73d4155bd0 0x7f73d414f920 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.281 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.290+0000 7f73dc0e5700 1 -- 172.21.15.42:0/4217678379 >> 172.21.15.42:0/4217678379 conn(0x7f73d40cbf10 msgr2=0x7f73d40cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:37.281 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.290+0000 7f73dc0e5700 1 -- 172.21.15.42:0/4217678379 shutdown_connections 2023-07-29T02:00:37.282 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.290+0000 7f73dc0e5700 1 -- 172.21.15.42:0/4217678379 wait complete. 2023-07-29T02:00:37.282 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.292+0000 7f73dc0e5700 1 Processor -- start 2023-07-29T02:00:37.282 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.292+0000 7f73dc0e5700 1 -- start start 2023-07-29T02:00:37.284 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.293+0000 7f73dc0e5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73d406eda0 0x7f73d41f03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:37.284 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.293+0000 7f73dc0e5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73d414fe60 0x7f73d4152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:37.284 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.293+0000 7f73dc0e5700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73d4155bd0 0x7f73d41ee200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:37.284 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.293+0000 7f73dc0e5700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d40cbb90 con 0x7f73d4155bd0 2023-07-29T02:00:37.284 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.293+0000 7f73dc0e5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d40cb5d0 con 0x7f73d406eda0 2023-07-29T02:00:37.284 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.293+0000 7f73dc0e5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d40cb8b0 con 0x7f73d414fe60 2023-07-29T02:00:37.285 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.293+0000 7f73da682700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73d4155bd0 0x7f73d41ee200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:37.285 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.293+0000 7f73da682700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73d4155bd0 0x7f73d41ee200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56776/0 (socket says 172.21.15.42:56776) 2023-07-29T02:00:37.285 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.293+0000 7f73da682700 1 -- 172.21.15.42:0/456349934 learned_addr learned my addr 172.21.15.42:0/456349934 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:37.285 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.293+0000 7f73d9e81700 1 --2- 172.21.15.42:0/456349934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73d406eda0 0x7f73d41f03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:37.285 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.293+0000 7f73d9680700 1 --2- 172.21.15.42:0/456349934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73d414fe60 0x7f73d4152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:37.285 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.293+0000 7f73da682700 1 -- 172.21.15.42:0/456349934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73d414fe60 msgr2=0x7f73d4152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:37.285 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.293+0000 7f73da682700 1 --2- 172.21.15.42:0/456349934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73d414fe60 0x7f73d4152890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.285 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.293+0000 7f73da682700 1 -- 172.21.15.42:0/456349934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73d406eda0 msgr2=0x7f73d41f03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:37.286 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.293+0000 7f73da682700 1 --2- 172.21.15.42:0/456349934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73d406eda0 0x7f73d41f03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.286 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.293+0000 7f73da682700 1 -- 172.21.15.42:0/456349934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c40094a0 con 0x7f73d4155bd0 2023-07-29T02:00:37.286 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.294+0000 7f73da682700 1 --2- 172.21.15.42:0/456349934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73d4155bd0 0x7f73d41ee200 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00cb40 tx=0x7f73cc00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:37.286 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.294+0000 7f73ca7fc700 1 -- 172.21.15.42:0/456349934 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc00a9e0 con 0x7f73d4155bd0 2023-07-29T02:00:37.286 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.294+0000 7f73ca7fc700 1 -- 172.21.15.42:0/456349934 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73cc00ab40 con 0x7f73d4155bd0 2023-07-29T02:00:37.286 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.294+0000 7f73dc0e5700 1 -- 172.21.15.42:0/456349934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73d41eda00 con 0x7f73d4155bd0 2023-07-29T02:00:37.286 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.294+0000 7f73ca7fc700 1 -- 172.21.15.42:0/456349934 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc012400 con 0x7f73d4155bd0 2023-07-29T02:00:37.287 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.294+0000 7f73dc0e5700 1 -- 172.21.15.42:0/456349934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d40c3150 con 0x7f73d4155bd0 2023-07-29T02:00:37.287 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.295+0000 7f73dc0e5700 1 -- 172.21.15.42:0/456349934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d404ea50 con 0x7f73d4155bd0 2023-07-29T02:00:37.287 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.295+0000 7f73ca7fc700 1 -- 172.21.15.42:0/456349934 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f73cc01b3b0 con 0x7f73d4155bd0 2023-07-29T02:00:37.287 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.295+0000 7f73ca7fc700 1 --2- 172.21.15.42:0/456349934 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f73b806a660 0x7f73b806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:37.287 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.296+0000 7f73ca7fc700 1 -- 172.21.15.42:0/456349934 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f73cc088990 con 0x7f73d4155bd0 2023-07-29T02:00:37.287 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.296+0000 7f73d9e81700 1 --2- 172.21.15.42:0/456349934 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f73b806a660 0x7f73b806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:37.288 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.296+0000 7f73d9e81700 1 --2- 172.21.15.42:0/456349934 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f73b806a660 0x7f73b806cb10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f73d0000f60 tx=0x7f73d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:37.288 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.300+0000 7f73ca7fc700 1 -- 172.21.15.42:0/456349934 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f73cc04c2c0 con 0x7f73d4155bd0 2023-07-29T02:00:37.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.500+0000 7f73dc0e5700 1 -- 172.21.15.42:0/456349934 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f73d41535f0 con 0x7f73d4155bd0 2023-07-29T02:00:37.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.500+0000 7f73ca7fc700 1 -- 172.21.15.42:0/456349934 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f73cc053b50 con 0x7f73d4155bd0 2023-07-29T02:00:37.489 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2023-07-29T02:00:37.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.502+0000 7f73dc0e5700 1 -- 172.21.15.42:0/456349934 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f73b806a660 msgr2=0x7f73b806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:37.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.502+0000 7f73dc0e5700 1 --2- 172.21.15.42:0/456349934 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f73b806a660 0x7f73b806cb10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f73d0000f60 tx=0x7f73d0009040 comp rx=0 tx=0).stop 2023-07-29T02:00:37.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.502+0000 7f73dc0e5700 1 -- 172.21.15.42:0/456349934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73d4155bd0 msgr2=0x7f73d41ee200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:37.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.502+0000 7f73dc0e5700 1 --2- 172.21.15.42:0/456349934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73d4155bd0 0x7f73d41ee200 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f73cc00cb40 tx=0x7f73cc00ce50 comp rx=0 tx=0).stop 2023-07-29T02:00:37.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.502+0000 7f73dc0e5700 1 -- 172.21.15.42:0/456349934 shutdown_connections 2023-07-29T02:00:37.492 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.502+0000 7f73dc0e5700 1 --2- 172.21.15.42:0/456349934 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f73b806a660 0x7f73b806cb10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.492 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.502+0000 7f73dc0e5700 1 --2- 172.21.15.42:0/456349934 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f73d4155bd0 0x7f73d41ee200 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.492 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.502+0000 7f73dc0e5700 1 --2- 172.21.15.42:0/456349934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f73d406eda0 0x7f73d41f03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.492 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.502+0000 7f73dc0e5700 1 --2- 172.21.15.42:0/456349934 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f73d414fe60 0x7f73d4152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.492 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.502+0000 7f73dc0e5700 1 -- 172.21.15.42:0/456349934 >> 172.21.15.42:0/456349934 conn(0x7f73d40cbf10 msgr2=0x7f73d40c16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:37.493 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.502+0000 7f73dc0e5700 1 -- 172.21.15.42:0/456349934 shutdown_connections 2023-07-29T02:00:37.493 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.502+0000 7f73dc0e5700 1 -- 172.21.15.42:0/456349934 wait complete. 2023-07-29T02:00:37.503 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-29T02:00:37.631 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.643+0000 7f62ad22f700 1 Processor -- start 2023-07-29T02:00:37.632 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.643+0000 7f62ad22f700 1 -- start start 2023-07-29T02:00:37.633 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.644+0000 7f62ad22f700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f62a80b0f00 0x7f62a80c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:37.634 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.644+0000 7f62ad22f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f62a80b12d0 0x7f62a81590e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:37.634 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.644+0000 7f62ad22f700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a806d6f0 con 0x7f62a80c0fa0 2023-07-29T02:00:37.634 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.644+0000 7f62ad22f700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a80c7450 con 0x7f62a80b0f00 2023-07-29T02:00:37.634 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.644+0000 7f62ad22f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a80c7730 con 0x7f62a80b12d0 2023-07-29T02:00:37.634 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.644+0000 7f62a6d9d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f62a80b0f00 0x7f62a80c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:37.634 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.644+0000 7f62a759e700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f62a80c0fa0 0x7f62a8152da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50588/0 (socket says 172.21.15.42:50588) 2023-07-29T02:00:37.634 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.644+0000 7f62a759e700 1 -- 172.21.15.42:0/1571032254 learned_addr learned my addr 172.21.15.42:0/1571032254 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:37.635 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.644+0000 7f62a659c700 1 --2- 172.21.15.42:0/1571032254 >> v2:172.21.15.144:3300/0 conn(0x7f62a80b12d0 0x7f62a81590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:37.635 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.644+0000 7f62a6d9d700 1 -- 172.21.15.42:0/1571032254 >> v2:172.21.15.144:3300/0 conn(0x7f62a80b12d0 msgr2=0x7f62a81590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:37.635 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.644+0000 7f62a6d9d700 1 --2- 172.21.15.42:0/1571032254 >> v2:172.21.15.144:3300/0 conn(0x7f62a80b12d0 0x7f62a81590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.635 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.644+0000 7f62a6d9d700 1 -- 172.21.15.42:0/1571032254 >> v1:172.21.15.42:6789/0 conn(0x7f62a80c0fa0 legacy=0x7f62a8152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:37.635 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.644+0000 7f62a5d9b700 1 -- 172.21.15.42:0/1571032254 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4173997980 0 0) 0x7f62a806d6f0 con 0x7f62a80c0fa0 2023-07-29T02:00:37.635 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.644+0000 7f62a6d9d700 1 -- 172.21.15.42:0/1571032254 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a806cdc0 con 0x7f62a80b0f00 2023-07-29T02:00:37.635 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.644+0000 7f62a659c700 1 --2- 172.21.15.42:0/1571032254 >> v2:172.21.15.144:3300/0 conn(0x7f62a80b12d0 0x7f62a81590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:37.636 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.644+0000 7f62a6d9d700 1 --2- 172.21.15.42:0/1571032254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62a80b0f00 0x7f62a80c6dc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f62a8156c10 tx=0x7f62a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fdb8aa28d68e50b server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:37.636 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.645+0000 7f62a5d9b700 1 -- 172.21.15.42:0/1571032254 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a000e070 con 0x7f62a80b0f00 2023-07-29T02:00:37.636 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.645+0000 7f62a5d9b700 1 -- 172.21.15.42:0/1571032254 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a000bbd0 con 0x7f62a80b0f00 2023-07-29T02:00:37.636 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.645+0000 7f62a5d9b700 1 -- 172.21.15.42:0/1571032254 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a0012430 con 0x7f62a80b0f00 2023-07-29T02:00:37.636 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.645+0000 7f62ad22f700 1 -- 172.21.15.42:0/1571032254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62a80b0f00 msgr2=0x7f62a80c6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:37.640 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.645+0000 7f62ad22f700 1 --2- 172.21.15.42:0/1571032254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62a80b0f00 0x7f62a80c6dc0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f62a8156c10 tx=0x7f62a000b330 comp rx=0 tx=0).stop 2023-07-29T02:00:37.640 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.645+0000 7f62ad22f700 1 -- 172.21.15.42:0/1571032254 shutdown_connections 2023-07-29T02:00:37.640 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.645+0000 7f62ad22f700 1 --2- 172.21.15.42:0/1571032254 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62a80b0f00 0x7f62a80c6dc0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.640 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.645+0000 7f62ad22f700 1 --2- 172.21.15.42:0/1571032254 >> v2:172.21.15.144:3300/0 conn(0x7f62a80b12d0 0x7f62a81590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.641 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.645+0000 7f62ad22f700 1 -- 172.21.15.42:0/1571032254 >> 172.21.15.42:0/1571032254 conn(0x7f62a80ccc50 msgr2=0x7f62a806ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:37.641 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.645+0000 7f62ad22f700 1 -- 172.21.15.42:0/1571032254 shutdown_connections 2023-07-29T02:00:37.641 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.645+0000 7f62ad22f700 1 -- 172.21.15.42:0/1571032254 wait complete. 2023-07-29T02:00:37.643 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.647+0000 7f62ad22f700 1 Processor -- start 2023-07-29T02:00:37.643 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.647+0000 7f62ad22f700 1 -- start start 2023-07-29T02:00:37.643 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.647+0000 7f62ad22f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62a80b0f00 0x7f62a8154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:37.643 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.647+0000 7f62ad22f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62a80b12d0 0x7f62a81ef5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:37.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.647+0000 7f62ad22f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a80c0fa0 0x7f62a80c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:37.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.647+0000 7f62ad22f700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a81ef120 con 0x7f62a80b12d0 2023-07-29T02:00:37.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.647+0000 7f62ad22f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a81f2550 con 0x7f62a80c0fa0 2023-07-29T02:00:37.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.647+0000 7f62ad22f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a81f2810 con 0x7f62a80b0f00 2023-07-29T02:00:37.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.647+0000 7f62a659c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62a80b12d0 0x7f62a81ef5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:37.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.648+0000 7f62a659c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62a80b12d0 0x7f62a81ef5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56788/0 (socket says 172.21.15.42:56788) 2023-07-29T02:00:37.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.648+0000 7f62a659c700 1 -- 172.21.15.42:0/420140815 learned_addr learned my addr 172.21.15.42:0/420140815 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:37.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.648+0000 7f62a6d9d700 1 --2- 172.21.15.42:0/420140815 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62a80b0f00 0x7f62a8154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:37.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.648+0000 7f62a759e700 1 --2- 172.21.15.42:0/420140815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a80c0fa0 0x7f62a80c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:37.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.648+0000 7f62a659c700 1 -- 172.21.15.42:0/420140815 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62a80b0f00 msgr2=0x7f62a8154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:37.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.648+0000 7f62a659c700 1 --2- 172.21.15.42:0/420140815 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62a80b0f00 0x7f62a8154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.648+0000 7f62a659c700 1 -- 172.21.15.42:0/420140815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a80c0fa0 msgr2=0x7f62a80c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:37.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.648+0000 7f62a659c700 1 --2- 172.21.15.42:0/420140815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a80c0fa0 0x7f62a80c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.648+0000 7f62a659c700 1 -- 172.21.15.42:0/420140815 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a0009a70 con 0x7f62a80b12d0 2023-07-29T02:00:37.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.648+0000 7f62a659c700 1 --2- 172.21.15.42:0/420140815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62a80b12d0 0x7f62a81ef5b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f629c00c750 tx=0x7f629c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:37.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.648+0000 7f628f7fe700 1 -- 172.21.15.42:0/420140815 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c011800 con 0x7f62a80b12d0 2023-07-29T02:00:37.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.648+0000 7f628f7fe700 1 -- 172.21.15.42:0/420140815 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629c011960 con 0x7f62a80b12d0 2023-07-29T02:00:37.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.648+0000 7f62ad22f700 1 -- 172.21.15.42:0/420140815 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a81f2af0 con 0x7f62a80b12d0 2023-07-29T02:00:37.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.648+0000 7f628f7fe700 1 -- 172.21.15.42:0/420140815 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c011cd0 con 0x7f62a80b12d0 2023-07-29T02:00:37.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.648+0000 7f62ad22f700 1 -- 172.21.15.42:0/420140815 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a81eedb0 con 0x7f62a80b12d0 2023-07-29T02:00:37.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.649+0000 7f62ad22f700 1 -- 172.21.15.42:0/420140815 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a81ef2d0 con 0x7f62a80b12d0 2023-07-29T02:00:37.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.650+0000 7f628f7fe700 1 -- 172.21.15.42:0/420140815 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f629c021350 con 0x7f62a80b12d0 2023-07-29T02:00:37.647 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.650+0000 7f628f7fe700 1 --2- 172.21.15.42:0/420140815 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f629406a660 0x7f629406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:37.647 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.650+0000 7f628f7fe700 1 -- 172.21.15.42:0/420140815 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f629c088da0 con 0x7f62a80b12d0 2023-07-29T02:00:37.647 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.650+0000 7f62a6d9d700 1 --2- 172.21.15.42:0/420140815 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f629406a660 0x7f629406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:37.647 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.651+0000 7f62a6d9d700 1 --2- 172.21.15.42:0/420140815 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f629406a660 0x7f629406cb10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f62a0014040 tx=0x7f62a0011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:37.647 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.655+0000 7f628f7fe700 1 -- 172.21.15.42:0/420140815 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f62a81ef2d0 con 0x7f62a80b12d0 2023-07-29T02:00:37.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.851+0000 7f62ad22f700 1 -- 172.21.15.42:0/420140815 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f62a804ea50 con 0x7f62a80b12d0 2023-07-29T02:00:37.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.852+0000 7f628f7fe700 1 -- 172.21.15.42:0/420140815 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f629c0578c0 con 0x7f62a80b12d0 2023-07-29T02:00:37.841 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2023-07-29T02:00:37.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.854+0000 7f62ad22f700 1 -- 172.21.15.42:0/420140815 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f629406a660 msgr2=0x7f629406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:37.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.854+0000 7f62ad22f700 1 --2- 172.21.15.42:0/420140815 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f629406a660 0x7f629406cb10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f62a0014040 tx=0x7f62a0011000 comp rx=0 tx=0).stop 2023-07-29T02:00:37.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.854+0000 7f62ad22f700 1 -- 172.21.15.42:0/420140815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62a80b12d0 msgr2=0x7f62a81ef5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:37.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.854+0000 7f62ad22f700 1 --2- 172.21.15.42:0/420140815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62a80b12d0 0x7f62a81ef5b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f629c00c750 tx=0x7f629c00cb10 comp rx=0 tx=0).stop 2023-07-29T02:00:37.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.854+0000 7f62ad22f700 1 -- 172.21.15.42:0/420140815 shutdown_connections 2023-07-29T02:00:37.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.854+0000 7f62ad22f700 1 --2- 172.21.15.42:0/420140815 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f629406a660 0x7f629406cb10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.854+0000 7f62ad22f700 1 --2- 172.21.15.42:0/420140815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62a80c0fa0 0x7f62a80c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.854+0000 7f62ad22f700 1 --2- 172.21.15.42:0/420140815 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62a80b0f00 0x7f62a8154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.854+0000 7f62ad22f700 1 --2- 172.21.15.42:0/420140815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62a80b12d0 0x7f62a81ef5b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.854+0000 7f62ad22f700 1 -- 172.21.15.42:0/420140815 >> 172.21.15.42:0/420140815 conn(0x7f62a80ccc50 msgr2=0x7f62a81512f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:37.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.854+0000 7f62ad22f700 1 -- 172.21.15.42:0/420140815 shutdown_connections 2023-07-29T02:00:37.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.854+0000 7f62ad22f700 1 -- 172.21.15.42:0/420140815 wait complete. 2023-07-29T02:00:37.855 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:00:37.981 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.992+0000 7f85e7657700 1 Processor -- start 2023-07-29T02:00:37.981 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.992+0000 7f85e7657700 1 -- start start 2023-07-29T02:00:37.982 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.993+0000 7f85e7657700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f85e00ca060 0x7f85e00cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:37.982 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.993+0000 7f85e7657700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f85e00cf6b0 0x7f85e0159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:37.983 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.993+0000 7f85e7657700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e0153990 con 0x7f85e01535c0 2023-07-29T02:00:37.983 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.993+0000 7f85e7657700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e015c760 con 0x7f85e00ca060 2023-07-29T02:00:37.983 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.993+0000 7f85e7657700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e015ca00 con 0x7f85e00cf6b0 2023-07-29T02:00:37.983 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.993+0000 7f85e4bf2700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f85e00ca060 0x7f85e00cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:37.983 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.993+0000 7f85e53f3700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f85e01535c0 0x7f85e00c54d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50598/0 (socket says 172.21.15.42:50598) 2023-07-29T02:00:37.983 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.993+0000 7f85e53f3700 1 -- 172.21.15.42:0/1817890178 learned_addr learned my addr 172.21.15.42:0/1817890178 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:37.983 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.993+0000 7f85e5bf4700 1 --2- 172.21.15.42:0/1817890178 >> v2:172.21.15.144:3300/0 conn(0x7f85e00cf6b0 0x7f85e0159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:37.983 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.993+0000 7f85e4bf2700 1 -- 172.21.15.42:0/1817890178 >> v2:172.21.15.144:3300/0 conn(0x7f85e00cf6b0 msgr2=0x7f85e0159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:37.984 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.993+0000 7f85e4bf2700 1 --2- 172.21.15.42:0/1817890178 >> v2:172.21.15.144:3300/0 conn(0x7f85e00cf6b0 0x7f85e0159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.984 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.993+0000 7f85d7fff700 1 -- 172.21.15.42:0/1817890178 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3675500977 0 0) 0x7f85e0153990 con 0x7f85e01535c0 2023-07-29T02:00:37.984 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.993+0000 7f85e4bf2700 1 -- 172.21.15.42:0/1817890178 >> v1:172.21.15.42:6789/0 conn(0x7f85e01535c0 legacy=0x7f85e00c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:37.984 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.993+0000 7f85e4bf2700 1 -- 172.21.15.42:0/1817890178 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e015cce0 con 0x7f85e00ca060 2023-07-29T02:00:37.984 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.993+0000 7f85e5bf4700 1 --2- 172.21.15.42:0/1817890178 >> v2:172.21.15.144:3300/0 conn(0x7f85e00cf6b0 0x7f85e0159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:37.984 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.994+0000 7f85e4bf2700 1 --2- 172.21.15.42:0/1817890178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85e00ca060 0x7f85e00cf170 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f85e00c42d0 tx=0x7f85d0009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f87abf78a733c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:37.984 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.994+0000 7f85d7fff700 1 -- 172.21.15.42:0/1817890178 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d0005e30 con 0x7f85e00ca060 2023-07-29T02:00:37.985 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.994+0000 7f85d7fff700 1 -- 172.21.15.42:0/1817890178 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d0006030 con 0x7f85e00ca060 2023-07-29T02:00:37.985 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.994+0000 7f85d7fff700 1 -- 172.21.15.42:0/1817890178 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d00063c0 con 0x7f85e00ca060 2023-07-29T02:00:37.987 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.994+0000 7f85e7657700 1 -- 172.21.15.42:0/1817890178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85e00ca060 msgr2=0x7f85e00cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:37.987 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.994+0000 7f85e7657700 1 --2- 172.21.15.42:0/1817890178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85e00ca060 0x7f85e00cf170 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f85e00c42d0 tx=0x7f85d0009b00 comp rx=0 tx=0).stop 2023-07-29T02:00:37.987 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.994+0000 7f85e7657700 1 -- 172.21.15.42:0/1817890178 shutdown_connections 2023-07-29T02:00:37.987 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.994+0000 7f85e7657700 1 --2- 172.21.15.42:0/1817890178 >> v2:172.21.15.144:3300/0 conn(0x7f85e00cf6b0 0x7f85e0159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.988 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.994+0000 7f85e7657700 1 --2- 172.21.15.42:0/1817890178 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85e00ca060 0x7f85e00cf170 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.988 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.994+0000 7f85e7657700 1 -- 172.21.15.42:0/1817890178 >> 172.21.15.42:0/1817890178 conn(0x7f85e006cac0 msgr2=0x7f85e006cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:37.988 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.995+0000 7f85e7657700 1 -- 172.21.15.42:0/1817890178 shutdown_connections 2023-07-29T02:00:37.988 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.995+0000 7f85e7657700 1 -- 172.21.15.42:0/1817890178 wait complete. 2023-07-29T02:00:37.988 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.996+0000 7f85e7657700 1 Processor -- start 2023-07-29T02:00:37.988 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.996+0000 7f85e7657700 1 -- start start 2023-07-29T02:00:37.988 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.996+0000 7f85e7657700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85e00ca060 0x7f85e0157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:37.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.996+0000 7f85e7657700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85e00cf6b0 0x7f85e01efaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:37.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.996+0000 7f85e7657700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f85e01535c0 0x7f85e014ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:37.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.996+0000 7f85e7657700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e00b44d0 con 0x7f85e00ca060 2023-07-29T02:00:37.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.996+0000 7f85e7657700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e01f0030 con 0x7f85e00cf6b0 2023-07-29T02:00:37.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.996+0000 7f85e7657700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e01576f0 con 0x7f85e01535c0 2023-07-29T02:00:37.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.997+0000 7f85e53f3700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85e00ca060 0x7f85e0157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:37.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.997+0000 7f85e53f3700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85e00ca060 0x7f85e0157060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56800/0 (socket says 172.21.15.42:56800) 2023-07-29T02:00:37.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.997+0000 7f85e53f3700 1 -- 172.21.15.42:0/802383748 learned_addr learned my addr 172.21.15.42:0/802383748 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:37.990 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.997+0000 7f85e4bf2700 1 --2- 172.21.15.42:0/802383748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85e00cf6b0 0x7f85e01efaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:37.990 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.997+0000 7f85e5bf4700 1 --2- 172.21.15.42:0/802383748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f85e01535c0 0x7f85e014ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:37.990 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.997+0000 7f85e53f3700 1 -- 172.21.15.42:0/802383748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f85e01535c0 msgr2=0x7f85e014ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:37.990 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.997+0000 7f85e53f3700 1 --2- 172.21.15.42:0/802383748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f85e01535c0 0x7f85e014ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.990 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.997+0000 7f85e53f3700 1 -- 172.21.15.42:0/802383748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85e00cf6b0 msgr2=0x7f85e01efaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:37.990 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.997+0000 7f85e53f3700 1 --2- 172.21.15.42:0/802383748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85e00cf6b0 0x7f85e01efaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:37.990 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.997+0000 7f85e53f3700 1 -- 172.21.15.42:0/802383748 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d0009430 con 0x7f85e00ca060 2023-07-29T02:00:37.990 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.997+0000 7f85e4bf2700 1 --2- 172.21.15.42:0/802383748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85e00cf6b0 0x7f85e01efaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:37.991 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.997+0000 7f85e53f3700 1 --2- 172.21.15.42:0/802383748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85e00ca060 0x7f85e0157060 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00c750 tx=0x7f85dc00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:37.991 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.997+0000 7f85d5ffb700 1 -- 172.21.15.42:0/802383748 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc004c80 con 0x7f85e00ca060 2023-07-29T02:00:37.991 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.997+0000 7f85d5ffb700 1 -- 172.21.15.42:0/802383748 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc004e00 con 0x7f85e00ca060 2023-07-29T02:00:37.991 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.997+0000 7f85e7657700 1 -- 172.21.15.42:0/802383748 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e00b2ea0 con 0x7f85e00ca060 2023-07-29T02:00:37.991 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.997+0000 7f85d5ffb700 1 -- 172.21.15.42:0/802383748 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc007310 con 0x7f85e00ca060 2023-07-29T02:00:37.991 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.997+0000 7f85e7657700 1 -- 172.21.15.42:0/802383748 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e00b3460 con 0x7f85e00ca060 2023-07-29T02:00:37.991 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.998+0000 7f85e7657700 1 -- 172.21.15.42:0/802383748 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e00c6260 con 0x7f85e00ca060 2023-07-29T02:00:37.992 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.999+0000 7f85d5ffb700 1 -- 172.21.15.42:0/802383748 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f85dc007470 con 0x7f85e00ca060 2023-07-29T02:00:37.992 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.999+0000 7f85d5ffb700 1 --2- 172.21.15.42:0/802383748 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f85c406a660 0x7f85c406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:37.992 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.999+0000 7f85d5ffb700 1 -- 172.21.15.42:0/802383748 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f85dc088c00 con 0x7f85e00ca060 2023-07-29T02:00:37.993 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:37.999+0000 7f85e4bf2700 1 --2- 172.21.15.42:0/802383748 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f85c406a660 0x7f85c406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:37.993 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.000+0000 7f85e4bf2700 1 --2- 172.21.15.42:0/802383748 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f85c406a660 0x7f85c406cb10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f85e00b5220 tx=0x7f85d0008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:37.993 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.005+0000 7f85d5ffb700 1 -- 172.21.15.42:0/802383748 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f85dc053c70 con 0x7f85e00ca060 2023-07-29T02:00:38.236 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.248+0000 7f85e7657700 1 -- 172.21.15.42:0/802383748 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85e00c5ef0 con 0x7f85e00ca060 2023-07-29T02:00:38.237 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.249+0000 7f85d5ffb700 1 -- 172.21.15.42:0/802383748 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6165 (secure 0 0 0) 0x7f85dc057290 con 0x7f85e00ca060 2023-07-29T02:00:38.237 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:38.238 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:00:26.432410+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6837/1851767861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1851767861},{"type":"v1","addr":"172.21.15.42:6837","nonce":1851767861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:00:38.239 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.251+0000 7f85e7657700 1 -- 172.21.15.42:0/802383748 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f85c406a660 msgr2=0x7f85c406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:38.239 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.251+0000 7f85e7657700 1 --2- 172.21.15.42:0/802383748 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f85c406a660 0x7f85c406cb10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f85e00b5220 tx=0x7f85d0008070 comp rx=0 tx=0).stop 2023-07-29T02:00:38.239 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.251+0000 7f85e7657700 1 -- 172.21.15.42:0/802383748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85e00ca060 msgr2=0x7f85e0157060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:38.240 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.251+0000 7f85e7657700 1 --2- 172.21.15.42:0/802383748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85e00ca060 0x7f85e0157060 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00c750 tx=0x7f85dc00cb10 comp rx=0 tx=0).stop 2023-07-29T02:00:38.240 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.251+0000 7f85e7657700 1 -- 172.21.15.42:0/802383748 shutdown_connections 2023-07-29T02:00:38.240 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.251+0000 7f85e7657700 1 --2- 172.21.15.42:0/802383748 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f85c406a660 0x7f85c406cb10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.240 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.251+0000 7f85e7657700 1 --2- 172.21.15.42:0/802383748 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f85e01535c0 0x7f85e014ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.240 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.251+0000 7f85e7657700 1 --2- 172.21.15.42:0/802383748 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f85e00ca060 0x7f85e0157060 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.240 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.251+0000 7f85e7657700 1 --2- 172.21.15.42:0/802383748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85e00cf6b0 0x7f85e01efaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.240 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.251+0000 7f85e7657700 1 -- 172.21.15.42:0/802383748 >> 172.21.15.42:0/802383748 conn(0x7f85e006cac0 msgr2=0x7f85e014ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:38.241 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.251+0000 7f85e7657700 1 -- 172.21.15.42:0/802383748 shutdown_connections 2023-07-29T02:00:38.241 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.251+0000 7f85e7657700 1 -- 172.21.15.42:0/802383748 wait complete. 2023-07-29T02:00:38.241 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 10 2023-07-29T02:00:38.251 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T02:00:38.376 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.387+0000 7ff41ef6c700 1 Processor -- start 2023-07-29T02:00:38.376 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.387+0000 7ff41ef6c700 1 -- start start 2023-07-29T02:00:38.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.388+0000 7ff41ef6c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4181567d0 0x7ff418159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:38.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.388+0000 7ff41ef6c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff4180c7210 0x7ff41806cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:38.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.388+0000 7ff41ef6c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4180c7700 con 0x7ff418159e90 2023-07-29T02:00:38.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.388+0000 7ff41ef6c700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41806b160 con 0x7ff4180c7210 2023-07-29T02:00:38.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.388+0000 7ff41ef6c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff418159170 con 0x7ff4181567d0 2023-07-29T02:00:38.379 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.388+0000 7ff417fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff4180c7210 0x7ff41806cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:38.379 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.388+0000 7ff417fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff4180c7210 0x7ff41806cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56810/0 (socket says 172.21.15.42:56810) 2023-07-29T02:00:38.379 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.388+0000 7ff417fff700 1 -- 172.21.15.42:0/3651882213 learned_addr learned my addr 172.21.15.42:0/3651882213 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:38.379 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.389+0000 7ff41cd08700 1 --2- 172.21.15.42:0/3651882213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4181567d0 0x7ff418159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:38.379 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.389+0000 7ff417fff700 1 -- 172.21.15.42:0/3651882213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4181567d0 msgr2=0x7ff418159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:38.379 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.389+0000 7ff417fff700 1 --2- 172.21.15.42:0/3651882213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4181567d0 0x7ff418159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.379 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.389+0000 7ff417fff700 1 -- 172.21.15.42:0/3651882213 >> v1:172.21.15.144:6789/0 conn(0x7ff418159e90 legacy=0x7ff41815c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:38.379 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.389+0000 7ff417fff700 1 -- 172.21.15.42:0/3651882213 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff418156ba0 con 0x7ff4180c7210 2023-07-29T02:00:38.380 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.389+0000 7ff417fff700 1 --2- 172.21.15.42:0/3651882213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4180c7210 0x7ff41806cd10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff4040098f0 tx=0x7ff404009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb044ab121903cd server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:38.380 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.389+0000 7ff4177fe700 1 -- 172.21.15.42:0/3651882213 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404011830 con 0x7ff4180c7210 2023-07-29T02:00:38.380 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.389+0000 7ff4177fe700 1 -- 172.21.15.42:0/3651882213 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff404011990 con 0x7ff4180c7210 2023-07-29T02:00:38.380 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.389+0000 7ff4177fe700 1 -- 172.21.15.42:0/3651882213 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404011d20 con 0x7ff4180c7210 2023-07-29T02:00:38.380 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.390+0000 7ff41ef6c700 1 -- 172.21.15.42:0/3651882213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4180c7210 msgr2=0x7ff41806cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:38.380 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.390+0000 7ff41ef6c700 1 --2- 172.21.15.42:0/3651882213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4180c7210 0x7ff41806cd10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff4040098f0 tx=0x7ff404009c00 comp rx=0 tx=0).stop 2023-07-29T02:00:38.380 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.390+0000 7ff41ef6c700 1 -- 172.21.15.42:0/3651882213 shutdown_connections 2023-07-29T02:00:38.381 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.390+0000 7ff41ef6c700 1 --2- 172.21.15.42:0/3651882213 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4181567d0 0x7ff418159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.381 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.390+0000 7ff41ef6c700 1 --2- 172.21.15.42:0/3651882213 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4180c7210 0x7ff41806cd10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.381 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.390+0000 7ff41ef6c700 1 -- 172.21.15.42:0/3651882213 >> 172.21.15.42:0/3651882213 conn(0x7ff4180c8970 msgr2=0x7ff4180c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:38.381 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.390+0000 7ff41ef6c700 1 -- 172.21.15.42:0/3651882213 shutdown_connections 2023-07-29T02:00:38.381 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.390+0000 7ff41ef6c700 1 -- 172.21.15.42:0/3651882213 wait complete. 2023-07-29T02:00:38.383 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.391+0000 7ff41ef6c700 1 Processor -- start 2023-07-29T02:00:38.383 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.391+0000 7ff41ef6c700 1 -- start start 2023-07-29T02:00:38.383 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.392+0000 7ff41ef6c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4180c7210 0x7ff418155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:38.383 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.392+0000 7ff41ef6c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4181567d0 0x7ff418155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:38.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.392+0000 7ff41ef6c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff418159e90 0x7ff4180c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:38.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.392+0000 7ff41ef6c700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4180c4970 con 0x7ff4181567d0 2023-07-29T02:00:38.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.392+0000 7ff41ef6c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4181e24e0 con 0x7ff418159e90 2023-07-29T02:00:38.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.392+0000 7ff41ef6c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4180c3210 con 0x7ff4180c7210 2023-07-29T02:00:38.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.392+0000 7ff417fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4181567d0 0x7ff418155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:38.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.392+0000 7ff417fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4181567d0 0x7ff418155120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56816/0 (socket says 172.21.15.42:56816) 2023-07-29T02:00:38.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.392+0000 7ff417fff700 1 -- 172.21.15.42:0/1896096434 learned_addr learned my addr 172.21.15.42:0/1896096434 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:38.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.393+0000 7ff41cd08700 1 --2- 172.21.15.42:0/1896096434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4180c7210 0x7ff418155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:38.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.393+0000 7ff41d509700 1 --2- 172.21.15.42:0/1896096434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff418159e90 0x7ff4180c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:38.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.393+0000 7ff417fff700 1 -- 172.21.15.42:0/1896096434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4180c7210 msgr2=0x7ff418155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:38.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.393+0000 7ff417fff700 1 --2- 172.21.15.42:0/1896096434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4180c7210 0x7ff418155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.393+0000 7ff417fff700 1 -- 172.21.15.42:0/1896096434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff418159e90 msgr2=0x7ff4180c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:38.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.393+0000 7ff417fff700 1 --2- 172.21.15.42:0/1896096434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff418159e90 0x7ff4180c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.393+0000 7ff417fff700 1 -- 172.21.15.42:0/1896096434 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff404009550 con 0x7ff4181567d0 2023-07-29T02:00:38.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.393+0000 7ff41d509700 1 --2- 172.21.15.42:0/1896096434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff418159e90 0x7ff4180c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:38.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.393+0000 7ff417fff700 1 --2- 172.21.15.42:0/1896096434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4181567d0 0x7ff418155120 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff404000c00 tx=0x7ff404004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:38.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.393+0000 7ff4157fa700 1 -- 172.21.15.42:0/1896096434 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404004570 con 0x7ff4181567d0 2023-07-29T02:00:38.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.393+0000 7ff4157fa700 1 -- 172.21.15.42:0/1896096434 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40401f070 con 0x7ff4181567d0 2023-07-29T02:00:38.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.393+0000 7ff41ef6c700 1 -- 172.21.15.42:0/1896096434 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4180c34f0 con 0x7ff4181567d0 2023-07-29T02:00:38.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.393+0000 7ff4157fa700 1 -- 172.21.15.42:0/1896096434 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4040038c0 con 0x7ff4181567d0 2023-07-29T02:00:38.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.393+0000 7ff41ef6c700 1 -- 172.21.15.42:0/1896096434 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4181e4350 con 0x7ff4181567d0 2023-07-29T02:00:38.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.394+0000 7ff41ef6c700 1 -- 172.21.15.42:0/1896096434 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff418074740 con 0x7ff4181567d0 2023-07-29T02:00:38.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.395+0000 7ff4157fa700 1 -- 172.21.15.42:0/1896096434 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7ff404021030 con 0x7ff4181567d0 2023-07-29T02:00:38.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.395+0000 7ff4157fa700 1 --2- 172.21.15.42:0/1896096434 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff3fc06a660 0x7ff3fc06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:38.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.395+0000 7ff4157fa700 1 -- 172.21.15.42:0/1896096434 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff40408a210 con 0x7ff4181567d0 2023-07-29T02:00:38.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.395+0000 7ff41cd08700 1 --2- 172.21.15.42:0/1896096434 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff3fc06a660 0x7ff3fc06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:38.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.396+0000 7ff41cd08700 1 --2- 172.21.15.42:0/1896096434 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff3fc06a660 0x7ff3fc06cb10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff40c009b70 tx=0x7ff40c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:38.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.399+0000 7ff4157fa700 1 -- 172.21.15.42:0/1896096434 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7ff4040553b0 con 0x7ff4181567d0 2023-07-29T02:00:38.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.600+0000 7ff41ef6c700 1 -- 172.21.15.42:0/1896096434 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4180c3680 con 0x7ff4181567d0 2023-07-29T02:00:38.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.601+0000 7ff4157fa700 1 -- 172.21.15.42:0/1896096434 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19690 (secure 0 0 0) 0x7ff4040589d0 con 0x7ff4181567d0 2023-07-29T02:00:38.590 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:38.590 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T02:00:02.394460+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T01:59:55.827461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T01:59:56.924040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-29T01:59:59.996470+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T02:00:38.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.603+0000 7ff41ef6c700 1 -- 172.21.15.42:0/1896096434 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff3fc06a660 msgr2=0x7ff3fc06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:38.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.603+0000 7ff41ef6c700 1 --2- 172.21.15.42:0/1896096434 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff3fc06a660 0x7ff3fc06cb10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff40c009b70 tx=0x7ff40c008040 comp rx=0 tx=0).stop 2023-07-29T02:00:38.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.603+0000 7ff41ef6c700 1 -- 172.21.15.42:0/1896096434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4181567d0 msgr2=0x7ff418155120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.603+0000 7ff41ef6c700 1 --2- 172.21.15.42:0/1896096434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4181567d0 0x7ff418155120 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff404000c00 tx=0x7ff404004750 comp rx=0 tx=0).stop 2023-07-29T02:00:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.604+0000 7ff41ef6c700 1 -- 172.21.15.42:0/1896096434 shutdown_connections 2023-07-29T02:00:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.604+0000 7ff41ef6c700 1 --2- 172.21.15.42:0/1896096434 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff3fc06a660 0x7ff3fc06cb10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.604+0000 7ff41ef6c700 1 --2- 172.21.15.42:0/1896096434 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff418159e90 0x7ff4180c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.604+0000 7ff41ef6c700 1 --2- 172.21.15.42:0/1896096434 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4180c7210 0x7ff418155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.604+0000 7ff41ef6c700 1 --2- 172.21.15.42:0/1896096434 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4181567d0 0x7ff418155120 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.604+0000 7ff41ef6c700 1 -- 172.21.15.42:0/1896096434 >> 172.21.15.42:0/1896096434 conn(0x7ff4180c8970 msgr2=0x7ff418158220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:38.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.604+0000 7ff41ef6c700 1 -- 172.21.15.42:0/1896096434 shutdown_connections 2023-07-29T02:00:38.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.604+0000 7ff41ef6c700 1 -- 172.21.15.42:0/1896096434 wait complete. 2023-07-29T02:00:38.605 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:00:38.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.740+0000 7f6cb72c0700 1 Processor -- start 2023-07-29T02:00:38.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.740+0000 7f6cb72c0700 1 -- start start 2023-07-29T02:00:38.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.741+0000 7f6cb72c0700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6cb01567d0 0x7f6cb0159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:38.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.741+0000 7f6cb72c0700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6cb00c7210 0x7f6cb006cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:38.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.741+0000 7f6cb72c0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6cb0159e90 0x7f6cb006d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:38.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.741+0000 7f6cb72c0700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb006b160 con 0x7f6cb00c7210 2023-07-29T02:00:38.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.741+0000 7f6cb72c0700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cb00c7700 con 0x7f6cb01567d0 2023-07-29T02:00:38.732 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.741+0000 7f6cb72c0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb0159170 con 0x7f6cb0159e90 2023-07-29T02:00:38.732 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.741+0000 7f6cb485b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6cb00c7210 0x7f6cb006cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:38.732 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.741+0000 7f6cb485b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6cb00c7210 0x7f6cb006cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56822/0 (socket says 172.21.15.42:56822) 2023-07-29T02:00:38.732 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.741+0000 7f6cb485b700 1 -- 172.21.15.42:0/1903469992 learned_addr learned my addr 172.21.15.42:0/1903469992 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:38.732 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.741+0000 7f6cb585d700 1 --2- 172.21.15.42:0/1903469992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6cb0159e90 0x7f6cb006d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:38.732 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.741+0000 7f6cb505c700 1 --2- 172.21.15.42:0/1903469992 >> v2:172.21.15.144:3300/0 conn(0x7f6cb01567d0 0x7f6cb0159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:38.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.741+0000 7f6cb485b700 1 -- 172.21.15.42:0/1903469992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6cb0159e90 msgr2=0x7f6cb006d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:38.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.741+0000 7f6cb485b700 1 --2- 172.21.15.42:0/1903469992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6cb0159e90 0x7f6cb006d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.742+0000 7f6cb485b700 1 -- 172.21.15.42:0/1903469992 >> v2:172.21.15.144:3300/0 conn(0x7f6cb01567d0 msgr2=0x7f6cb0159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:38.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.742+0000 7f6cb485b700 1 --2- 172.21.15.42:0/1903469992 >> v2:172.21.15.144:3300/0 conn(0x7f6cb01567d0 0x7f6cb0159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.742+0000 7f6cb485b700 1 -- 172.21.15.42:0/1903469992 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb0156ba0 con 0x7f6cb00c7210 2023-07-29T02:00:38.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.742+0000 7f6cb505c700 1 --2- 172.21.15.42:0/1903469992 >> v2:172.21.15.144:3300/0 conn(0x7f6cb01567d0 0x7f6cb0159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:38.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.742+0000 7f6cb485b700 1 --2- 172.21.15.42:0/1903469992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cb00c7210 0x7f6cb006cd10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00704b0 tx=0x7f6cac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1af56c29628cf5 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:38.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.742+0000 7f6ca7fff700 1 -- 172.21.15.42:0/1903469992 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac011830 con 0x7f6cb00c7210 2023-07-29T02:00:38.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.742+0000 7f6ca7fff700 1 -- 172.21.15.42:0/1903469992 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cac011990 con 0x7f6cb00c7210 2023-07-29T02:00:38.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.742+0000 7f6ca7fff700 1 -- 172.21.15.42:0/1903469992 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac011d20 con 0x7f6cb00c7210 2023-07-29T02:00:38.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.742+0000 7f6cb72c0700 1 -- 172.21.15.42:0/1903469992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cb00c7210 msgr2=0x7f6cb006cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:38.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.742+0000 7f6cb72c0700 1 --2- 172.21.15.42:0/1903469992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cb00c7210 0x7f6cb006cd10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6cb00704b0 tx=0x7f6cac009bd0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.742+0000 7f6cb72c0700 1 -- 172.21.15.42:0/1903469992 shutdown_connections 2023-07-29T02:00:38.735 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.742+0000 7f6cb72c0700 1 --2- 172.21.15.42:0/1903469992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6cb0159e90 0x7f6cb006d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.735 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.742+0000 7f6cb72c0700 1 --2- 172.21.15.42:0/1903469992 >> v2:172.21.15.144:3300/0 conn(0x7f6cb01567d0 0x7f6cb0159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.735 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.742+0000 7f6cb72c0700 1 --2- 172.21.15.42:0/1903469992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cb00c7210 0x7f6cb006cd10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.735 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.742+0000 7f6cb72c0700 1 -- 172.21.15.42:0/1903469992 >> 172.21.15.42:0/1903469992 conn(0x7f6cb00c8970 msgr2=0x7f6cb00c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:38.735 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.743+0000 7f6cb72c0700 1 -- 172.21.15.42:0/1903469992 shutdown_connections 2023-07-29T02:00:38.735 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.743+0000 7f6cb72c0700 1 -- 172.21.15.42:0/1903469992 wait complete. 2023-07-29T02:00:38.737 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.744+0000 7f6cb72c0700 1 Processor -- start 2023-07-29T02:00:38.738 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.744+0000 7f6cb72c0700 1 -- start start 2023-07-29T02:00:38.738 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.744+0000 7f6cb72c0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cb00c7210 0x7f6cb0071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:38.738 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.744+0000 7f6cb72c0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6cb01567d0 0x7f6cb01ee930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:38.738 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.744+0000 7f6cb72c0700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cb0159e90 0x7f6cb00ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:38.738 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.745+0000 7f6cb72c0700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb00ae240 con 0x7f6cb0159e90 2023-07-29T02:00:38.738 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.745+0000 7f6cb72c0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb01ef1f0 con 0x7f6cb00c7210 2023-07-29T02:00:38.738 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.745+0000 7f6cb72c0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb01ef4d0 con 0x7f6cb01567d0 2023-07-29T02:00:38.738 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.745+0000 7f6cb585d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cb0159e90 0x7f6cb00ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:38.739 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.745+0000 7f6cb585d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cb0159e90 0x7f6cb00ae9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56832/0 (socket says 172.21.15.42:56832) 2023-07-29T02:00:38.739 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.745+0000 7f6cb585d700 1 -- 172.21.15.42:0/1655426707 learned_addr learned my addr 172.21.15.42:0/1655426707 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:38.739 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.745+0000 7f6cb485b700 1 --2- 172.21.15.42:0/1655426707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6cb01567d0 0x7f6cb01ee930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:38.739 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.745+0000 7f6cb505c700 1 --2- 172.21.15.42:0/1655426707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cb00c7210 0x7f6cb0071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:38.739 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.745+0000 7f6cb585d700 1 -- 172.21.15.42:0/1655426707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6cb01567d0 msgr2=0x7f6cb01ee930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:38.739 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.745+0000 7f6cb585d700 1 --2- 172.21.15.42:0/1655426707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6cb01567d0 0x7f6cb01ee930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.739 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.745+0000 7f6cb585d700 1 -- 172.21.15.42:0/1655426707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cb00c7210 msgr2=0x7f6cb0071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:38.740 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.745+0000 7f6cb585d700 1 --2- 172.21.15.42:0/1655426707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cb00c7210 0x7f6cb0071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.740 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.745+0000 7f6cb585d700 1 -- 172.21.15.42:0/1655426707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac009550 con 0x7f6cb0159e90 2023-07-29T02:00:38.740 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.745+0000 7f6cb585d700 1 --2- 172.21.15.42:0/1655426707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cb0159e90 0x7f6cb00ae9a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800efc0 tx=0x7f6ca8009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:38.740 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.745+0000 7f6ca5ffb700 1 -- 172.21.15.42:0/1655426707 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8009b20 con 0x7f6cb0159e90 2023-07-29T02:00:38.740 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.745+0000 7f6ca5ffb700 1 -- 172.21.15.42:0/1655426707 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca800f040 con 0x7f6cb0159e90 2023-07-29T02:00:38.740 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.745+0000 7f6cb72c0700 1 -- 172.21.15.42:0/1655426707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb00af920 con 0x7f6cb0159e90 2023-07-29T02:00:38.740 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.745+0000 7f6ca5ffb700 1 -- 172.21.15.42:0/1655426707 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca800cc90 con 0x7f6cb0159e90 2023-07-29T02:00:38.741 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.746+0000 7f6cb72c0700 1 -- 172.21.15.42:0/1655426707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb00af5d0 con 0x7f6cb0159e90 2023-07-29T02:00:38.741 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.746+0000 7f6cb72c0700 1 -- 172.21.15.42:0/1655426707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb0074740 con 0x7f6cb0159e90 2023-07-29T02:00:38.741 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.747+0000 7f6ca5ffb700 1 -- 172.21.15.42:0/1655426707 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f6ca8014480 con 0x7f6cb0159e90 2023-07-29T02:00:38.741 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.747+0000 7f6ca5ffb700 1 --2- 172.21.15.42:0/1655426707 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6c9406a660 0x7f6c9406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:38.741 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.747+0000 7f6ca5ffb700 1 -- 172.21.15.42:0/1655426707 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6ca8089830 con 0x7f6cb0159e90 2023-07-29T02:00:38.741 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.748+0000 7f6cb505c700 1 --2- 172.21.15.42:0/1655426707 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6c9406a660 0x7f6c9406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:38.741 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.748+0000 7f6cb505c700 1 --2- 172.21.15.42:0/1655426707 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6c9406a660 0x7f6c9406cb10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00045f0 tx=0x7f6ca0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:38.742 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.752+0000 7f6ca5ffb700 1 -- 172.21.15.42:0/1655426707 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f6ca80548b0 con 0x7f6cb0159e90 2023-07-29T02:00:38.985 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.996+0000 7f6cb72c0700 1 -- 172.21.15.42:0/1655426707 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6cb00afb10 con 0x7f6cb0159e90 2023-07-29T02:00:38.985 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:38.997+0000 7f6ca5ffb700 1 -- 172.21.15.42:0/1655426707 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6165 (secure 0 0 0) 0x7f6cb00afb10 con 0x7f6cb0159e90 2023-07-29T02:00:38.985 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:38.986 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:00:26.432410+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6837/1851767861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1851767861},{"type":"v1","addr":"172.21.15.42:6837","nonce":1851767861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:00:38.988 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.000+0000 7f6cb72c0700 1 -- 172.21.15.42:0/1655426707 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6c9406a660 msgr2=0x7f6c9406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:38.988 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.000+0000 7f6cb72c0700 1 --2- 172.21.15.42:0/1655426707 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6c9406a660 0x7f6c9406cb10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00045f0 tx=0x7f6ca0008040 comp rx=0 tx=0).stop 2023-07-29T02:00:38.988 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.000+0000 7f6cb72c0700 1 -- 172.21.15.42:0/1655426707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cb0159e90 msgr2=0x7f6cb00ae9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:38.988 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.000+0000 7f6cb72c0700 1 --2- 172.21.15.42:0/1655426707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cb0159e90 0x7f6cb00ae9a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6ca800efc0 tx=0x7f6ca8009f60 comp rx=0 tx=0).stop 2023-07-29T02:00:38.988 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.000+0000 7f6cb72c0700 1 -- 172.21.15.42:0/1655426707 shutdown_connections 2023-07-29T02:00:38.988 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.000+0000 7f6cb72c0700 1 --2- 172.21.15.42:0/1655426707 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6c9406a660 0x7f6c9406cb10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.000+0000 7f6cb72c0700 1 --2- 172.21.15.42:0/1655426707 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6cb0159e90 0x7f6cb00ae9a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.000+0000 7f6cb72c0700 1 --2- 172.21.15.42:0/1655426707 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6cb00c7210 0x7f6cb0071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.000+0000 7f6cb72c0700 1 --2- 172.21.15.42:0/1655426707 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6cb01567d0 0x7f6cb01ee930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:38.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.000+0000 7f6cb72c0700 1 -- 172.21.15.42:0/1655426707 >> 172.21.15.42:0/1655426707 conn(0x7f6cb00c8970 msgr2=0x7f6cb01580f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:38.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.000+0000 7f6cb72c0700 1 -- 172.21.15.42:0/1655426707 shutdown_connections 2023-07-29T02:00:38.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.000+0000 7f6cb72c0700 1 -- 172.21.15.42:0/1655426707 wait complete. 2023-07-29T02:00:38.990 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 10 2023-07-29T02:00:39.603 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 10, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-29T01:59:57.946839+0000', 'modified': '2023-07-29T02:00:26.432410+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4300': {'gid': 4300, 'name': 'e', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.42:6837/1851767861', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.42:6836', 'nonce': 1851767861}, {'type': 'v1', 'addr': '172.21.15.42:6837', 'nonce': 1851767861}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-29T02:00:39.603 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-29T02:00:39.603 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-07-29T02:00:39.743 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.756+0000 7fba70465700 1 Processor -- start 2023-07-29T02:00:39.744 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.756+0000 7fba70465700 1 -- start start 2023-07-29T02:00:39.744 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.757+0000 7fba70465700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fba680cd370 0x7fba681625b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:39.745 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.757+0000 7fba70465700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba6815b1d0 con 0x7fba680ccfa0 2023-07-29T02:00:39.745 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.757+0000 7fba70465700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba680cd810 con 0x7fba6806f530 2023-07-29T02:00:39.745 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.757+0000 7fba70465700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba680c9820 con 0x7fba680cd370 2023-07-29T02:00:39.745 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.757+0000 7fba6e201700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fba680ccfa0 0x7fba6806dc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50640/0 (socket says 172.21.15.42:50640) 2023-07-29T02:00:39.745 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.757+0000 7fba6e201700 1 -- 172.21.15.42:0/2107436570 learned_addr learned my addr 172.21.15.42:0/2107436570 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:39.747 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.758+0000 7fba6ea02700 1 --2- 172.21.15.42:0/2107436570 >> v2:172.21.15.144:3300/0 conn(0x7fba680cd370 0x7fba681625b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:39.747 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.758+0000 7fba6d1ff700 1 -- 172.21.15.42:0/2107436570 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2533967478 0 0) 0x7fba6815b1d0 con 0x7fba680ccfa0 2023-07-29T02:00:39.747 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.758+0000 7fba6d1ff700 1 -- 172.21.15.42:0/2107436570 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba540035b0 con 0x7fba680ccfa0 2023-07-29T02:00:39.747 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.758+0000 7fba6ea02700 1 -- 172.21.15.42:0/2107436570 >> v1:172.21.15.144:6789/0 conn(0x7fba6806f530 legacy=0x7fba680c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:39.747 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.758+0000 7fba6ea02700 1 -- 172.21.15.42:0/2107436570 >> v1:172.21.15.42:6789/0 conn(0x7fba680ccfa0 legacy=0x7fba6806dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:39.748 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.758+0000 7fba6ea02700 1 -- 172.21.15.42:0/2107436570 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6815a650 con 0x7fba680cd370 2023-07-29T02:00:39.748 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.758+0000 7fba6ea02700 1 --2- 172.21.15.42:0/2107436570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba680cd370 0x7fba681625b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fba60009d90 tx=0x7fba6000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=182d3c8fa3118c14 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:39.748 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.758+0000 7fba6d1ff700 1 -- 172.21.15.42:0/2107436570 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6000e070 con 0x7fba680cd370 2023-07-29T02:00:39.748 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.758+0000 7fba6d1ff700 1 -- 172.21.15.42:0/2107436570 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6000bb20 con 0x7fba680cd370 2023-07-29T02:00:39.748 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.758+0000 7fba6d1ff700 1 -- 172.21.15.42:0/2107436570 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60012430 con 0x7fba680cd370 2023-07-29T02:00:39.748 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.759+0000 7fba70465700 1 -- 172.21.15.42:0/2107436570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba680cd370 msgr2=0x7fba681625b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:39.749 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.759+0000 7fba70465700 1 --2- 172.21.15.42:0/2107436570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba680cd370 0x7fba681625b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fba60009d90 tx=0x7fba6000b330 comp rx=0 tx=0).stop 2023-07-29T02:00:39.749 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.759+0000 7fba70465700 1 -- 172.21.15.42:0/2107436570 shutdown_connections 2023-07-29T02:00:39.749 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.759+0000 7fba70465700 1 --2- 172.21.15.42:0/2107436570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba680cd370 0x7fba681625b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.749 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.759+0000 7fba70465700 1 -- 172.21.15.42:0/2107436570 >> 172.21.15.42:0/2107436570 conn(0x7fba68061190 msgr2=0x7fba68061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:39.750 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.759+0000 7fba70465700 1 -- 172.21.15.42:0/2107436570 shutdown_connections 2023-07-29T02:00:39.750 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.759+0000 7fba70465700 1 -- 172.21.15.42:0/2107436570 wait complete. 2023-07-29T02:00:39.752 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.760+0000 7fba70465700 1 Processor -- start 2023-07-29T02:00:39.752 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.761+0000 7fba70465700 1 -- start start 2023-07-29T02:00:39.752 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.761+0000 7fba70465700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba6806f530 0x7fba681e0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:39.752 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.761+0000 7fba70465700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba680ccfa0 0x7fba68152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:39.753 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.761+0000 7fba70465700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba680cd370 0x7fba68143880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:39.753 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.761+0000 7fba70465700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba680cc3b0 con 0x7fba680cd370 2023-07-29T02:00:39.753 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.761+0000 7fba70465700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6806d370 con 0x7fba6806f530 2023-07-29T02:00:39.753 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.761+0000 7fba70465700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6806d860 con 0x7fba680ccfa0 2023-07-29T02:00:39.753 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.761+0000 7fba6ea02700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba680cd370 0x7fba68143880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:39.753 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.761+0000 7fba6ea02700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba680cd370 0x7fba68143880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56846/0 (socket says 172.21.15.42:56846) 2023-07-29T02:00:39.753 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.761+0000 7fba6ea02700 1 -- 172.21.15.42:0/410616999 learned_addr learned my addr 172.21.15.42:0/410616999 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:39.754 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.762+0000 7fba6e201700 1 --2- 172.21.15.42:0/410616999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba6806f530 0x7fba681e0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:39.754 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.762+0000 7fba6da00700 1 --2- 172.21.15.42:0/410616999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba680ccfa0 0x7fba68152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:39.754 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.762+0000 7fba6ea02700 1 -- 172.21.15.42:0/410616999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba680ccfa0 msgr2=0x7fba68152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:39.754 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.762+0000 7fba6ea02700 1 --2- 172.21.15.42:0/410616999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba680ccfa0 0x7fba68152640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.754 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.762+0000 7fba6ea02700 1 -- 172.21.15.42:0/410616999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba6806f530 msgr2=0x7fba681e0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:39.754 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.762+0000 7fba6ea02700 1 --2- 172.21.15.42:0/410616999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba6806f530 0x7fba681e0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.754 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.762+0000 7fba6ea02700 1 -- 172.21.15.42:0/410616999 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba60009a70 con 0x7fba680cd370 2023-07-29T02:00:39.755 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.762+0000 7fba6ea02700 1 --2- 172.21.15.42:0/410616999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba680cd370 0x7fba68143880 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fba68068b60 tx=0x7fba60004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:39.755 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.762+0000 7fba5effd700 1 -- 172.21.15.42:0/410616999 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60012430 con 0x7fba680cd370 2023-07-29T02:00:39.755 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.762+0000 7fba5effd700 1 -- 172.21.15.42:0/410616999 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba60020070 con 0x7fba680cd370 2023-07-29T02:00:39.755 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.762+0000 7fba70465700 1 -- 172.21.15.42:0/410616999 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba6806d580 con 0x7fba680cd370 2023-07-29T02:00:39.755 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.762+0000 7fba5effd700 1 -- 172.21.15.42:0/410616999 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba60004280 con 0x7fba680cd370 2023-07-29T02:00:39.755 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.762+0000 7fba70465700 1 -- 172.21.15.42:0/410616999 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba681e2260 con 0x7fba680cd370 2023-07-29T02:00:39.755 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.763+0000 7fba5effd700 1 -- 172.21.15.42:0/410616999 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fba600043e0 con 0x7fba680cd370 2023-07-29T02:00:39.756 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.764+0000 7fba5effd700 1 --2- 172.21.15.42:0/410616999 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fba4c06a660 0x7fba4c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:39.756 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.764+0000 7fba5effd700 1 -- 172.21.15.42:0/410616999 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fba60022070 con 0x7fba680cd370 2023-07-29T02:00:39.756 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.764+0000 7fba6e201700 1 --2- 172.21.15.42:0/410616999 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fba4c06a660 0x7fba4c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:39.756 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.765+0000 7fba6e201700 1 --2- 172.21.15.42:0/410616999 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fba4c06a660 0x7fba4c06cb10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fba64004a10 tx=0x7fba64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:39.761 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.766+0000 7fba7c5f2b80 1 Processor -- start 2023-07-29T02:00:39.761 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.766+0000 7fba7c5f2b80 1 -- start start 2023-07-29T02:00:39.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.767+0000 7fba7c5f2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db58b6180 0x559db58bb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:39.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.767+0000 7fba7c5f2b80 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db5878990 0x559db58c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:39.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.767+0000 7fba7c5f2b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db58b6550 0x559db58c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:39.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.767+0000 7fba7c5f2b80 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db57ce9c0 con 0x559db5878990 2023-07-29T02:00:39.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.767+0000 7fba7c5f2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db57cc380 con 0x559db58b6180 2023-07-29T02:00:39.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.767+0000 7fba7c5f2b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x559db57c7c70 con 0x559db58b6550 2023-07-29T02:00:39.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.767+0000 7fba6da00700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db5878990 0x559db58c04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:39.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.767+0000 7fba6da00700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db5878990 0x559db58c04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56852/0 (socket says 172.21.15.42:56852) 2023-07-29T02:00:39.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.767+0000 7fba6da00700 1 -- 172.21.15.42:0/2465858908 learned_addr learned my addr 172.21.15.42:0/2465858908 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:39.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.767+0000 7fba6e201700 1 --2- 172.21.15.42:0/2465858908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db58b6180 0x559db58bb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:39.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.767+0000 7fba6ea02700 1 --2- 172.21.15.42:0/2465858908 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db58b6550 0x559db58c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:39.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.767+0000 7fba6da00700 1 -- 172.21.15.42:0/2465858908 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db58b6550 msgr2=0x559db58c0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:39.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.767+0000 7fba6da00700 1 --2- 172.21.15.42:0/2465858908 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db58b6550 0x559db58c0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.767+0000 7fba6da00700 1 -- 172.21.15.42:0/2465858908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db58b6180 msgr2=0x559db58bb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:39.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.767+0000 7fba6da00700 1 --2- 172.21.15.42:0/2465858908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db58b6180 0x559db58bb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.767+0000 7fba6da00700 1 -- 172.21.15.42:0/2465858908 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559db55f5d90 con 0x559db5878990 2023-07-29T02:00:39.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.768+0000 7fba6da00700 1 --2- 172.21.15.42:0/2465858908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db5878990 0x559db58c04f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fba580014e0 tx=0x7fba580017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3429d00c798d41eb server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:39.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.768+0000 7fba4bfff700 1 -- 172.21.15.42:0/2465858908 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba58011780 con 0x559db5878990 2023-07-29T02:00:39.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.768+0000 7fba4bfff700 1 -- 172.21.15.42:0/2465858908 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5800d050 con 0x559db5878990 2023-07-29T02:00:39.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.768+0000 7fba4bfff700 1 -- 172.21.15.42:0/2465858908 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba58011ae0 con 0x559db5878990 2023-07-29T02:00:39.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.768+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/2465858908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db5878990 msgr2=0x559db58c04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:39.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.768+0000 7fba7c5f2b80 1 --2- 172.21.15.42:0/2465858908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db5878990 0x559db58c04f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fba580014e0 tx=0x7fba580017f0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.768+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/2465858908 shutdown_connections 2023-07-29T02:00:39.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.768+0000 7fba7c5f2b80 1 --2- 172.21.15.42:0/2465858908 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db58b6550 0x559db58c0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.768+0000 7fba7c5f2b80 1 --2- 172.21.15.42:0/2465858908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db58b6180 0x559db58bb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.768+0000 7fba7c5f2b80 1 --2- 172.21.15.42:0/2465858908 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db5878990 0x559db58c04f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.768+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/2465858908 >> 172.21.15.42:0/2465858908 conn(0x559db5873630 msgr2=0x559db5874420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:39.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.769+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/2465858908 shutdown_connections 2023-07-29T02:00:39.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.769+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/2465858908 wait complete. 2023-07-29T02:00:39.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.769+0000 7fba7c5f2b80 1 -- start start 2023-07-29T02:00:39.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.769+0000 7fba7c5f2b80 1 Processor -- start 2023-07-29T02:00:39.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.770+0000 7fba7c5f2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db5878990 0x559db589c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:39.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.770+0000 7fba7c5f2b80 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6180 0x559db58ba580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:39.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.770+0000 7fba7c5f2b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db58b6550 0x559db589da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:39.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.770+0000 7fba7c5f2b80 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db57644c0 con 0x559db58b6180 2023-07-29T02:00:39.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.770+0000 7fba7c5f2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db5764160 con 0x559db5878990 2023-07-29T02:00:39.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.770+0000 7fba7c5f2b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x559db564b8d0 con 0x559db58b6550 2023-07-29T02:00:39.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.770+0000 7fba7c5f2b80 10 client.0 _ll_register_callbacks cb 0x559db576d5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-29T02:00:39.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.770+0000 7fba6da00700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6180 0x559db58ba580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:39.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.770+0000 7fba6da00700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6180 0x559db58ba580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56858/0 (socket says 172.21.15.42:56858) 2023-07-29T02:00:39.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.770+0000 7fba6da00700 1 -- 172.21.15.42:0/3006513258 learned_addr learned my addr 172.21.15.42:0/3006513258 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:39.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.770+0000 7fba6e201700 1 --2- 172.21.15.42:0/3006513258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db5878990 0x559db589c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:39.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.770+0000 7fba6ea02700 1 --2- 172.21.15.42:0/3006513258 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db58b6550 0x559db589da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:39.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba6da00700 1 -- 172.21.15.42:0/3006513258 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db58b6550 msgr2=0x559db589da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:39.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba6da00700 1 --2- 172.21.15.42:0/3006513258 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db58b6550 0x559db589da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba6da00700 1 -- 172.21.15.42:0/3006513258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db5878990 msgr2=0x559db589c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:39.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba6da00700 1 --2- 172.21.15.42:0/3006513258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db5878990 0x559db589c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba6da00700 1 -- 172.21.15.42:0/3006513258 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba680cd810 con 0x559db58b6180 2023-07-29T02:00:39.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba6e201700 1 --2- 172.21.15.42:0/3006513258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db5878990 0x559db589c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:39.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba6ea02700 1 --2- 172.21.15.42:0/3006513258 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db58b6550 0x559db589da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:39.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba6da00700 1 --2- 172.21.15.42:0/3006513258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6180 0x559db58ba580 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fba58014040 tx=0x7fba58000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8192fa292a819b4e server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:39.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba497fa700 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2023-07-29T02:00:39.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba497fa700 1 -- 172.21.15.42:0/3006513258 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba58003c80 con 0x559db58b6180 2023-07-29T02:00:39.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba497fa700 1 -- 172.21.15.42:0/3006513258 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fba58003de0 con 0x559db58b6180 2023-07-29T02:00:39.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/3006513258 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559db583c290 con 0x559db58b6180 2023-07-29T02:00:39.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba497fa700 1 -- 172.21.15.42:0/3006513258 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba58006860 con 0x559db58b6180 2023-07-29T02:00:39.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba7c5f2b80 10 client.4857 fetch_fsmap learned FSMap version 10 2023-07-29T02:00:39.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/3006513258 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x559db55dec10 con 0x559db58b6180 2023-07-29T02:00:39.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba497fa700 1 -- 172.21.15.42:0/3006513258 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559db583c290 con 0x559db58b6180 2023-07-29T02:00:39.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba497fa700 1 -- 172.21.15.42:0/3006513258 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 10) v1 ==== 4204+0+0 (secure 0 0 0) 0x7fba580069c0 con 0x559db58b6180 2023-07-29T02:00:39.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba7c5f2b80 10 client.4857 fetch_fsmap finished waiting for FSMap version 10 2023-07-29T02:00:39.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba7c5f2b80 10 client.4857 resolve_mds: resolved name 'e' to daemon mds.e 2023-07-29T02:00:39.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba7c5f2b80 20 client.4857 populate_metadata read hostname 'smithi042' 2023-07-29T02:00:39.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba7c5f2b80 1 --2- 172.21.15.42:0/3006513258 >> [v2:172.21.15.42:6836/1851767861,v1:172.21.15.42:6837/1851767861] conn(0x559db58ca210 0x559db58ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:39.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba7c5f2b80 4 client.4857 mds_command: new command op to 4300 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-29T02:00:39.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.771+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/3006513258 --> [v2:172.21.15.42:6836/1851767861,v1:172.21.15.42:6837/1851767861] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559db57c0cf0 con 0x559db58ca210 2023-07-29T02:00:39.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.772+0000 7fba6e201700 1 --2- 172.21.15.42:0/3006513258 >> [v2:172.21.15.42:6836/1851767861,v1:172.21.15.42:6837/1851767861] conn(0x559db58ca210 0x559db58ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:39.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.772+0000 7fba497fa700 10 client.4857 ms_handle_connect on v2:172.21.15.42:6836/1851767861 2023-07-29T02:00:39.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.772+0000 7fba6e201700 1 --2- 172.21.15.42:0/3006513258 >> [v2:172.21.15.42:6836/1851767861,v1:172.21.15.42:6837/1851767861] conn(0x559db58ca210 0x559db58ca5e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f60bf568be0d79df server_cookie=4c8511f7b6aa2d21 in_seq=0 out_seq=0 2023-07-29T02:00:39.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.772+0000 7fba497fa700 1 -- 172.21.15.42:0/3006513258 <== mds.0 v2:172.21.15.42:6836/1851767861 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x559db57c0cf0 con 0x559db58ca210 2023-07-29T02:00:39.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.772+0000 7fba497fa700 10 client.4857 handle_command_reply: tid=0 2023-07-29T02:00:39.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.772+0000 7fba7c5f2b80 1 client.4857 shutdown 2023-07-29T02:00:39.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.773+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/3006513258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6180 msgr2=0x559db58ba580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:39.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.773+0000 7fba7c5f2b80 1 --2- 172.21.15.42:0/3006513258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6180 0x559db58ba580 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fba58014040 tx=0x7fba58000ed0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.773+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/3006513258 shutdown_connections 2023-07-29T02:00:39.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.773+0000 7fba7c5f2b80 1 --2- 172.21.15.42:0/3006513258 >> [v2:172.21.15.42:6836/1851767861,v1:172.21.15.42:6837/1851767861] conn(0x559db58ca210 0x559db58ca5e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.773+0000 7fba7c5f2b80 1 --2- 172.21.15.42:0/3006513258 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db58b6550 0x559db589da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.773+0000 7fba7c5f2b80 1 --2- 172.21.15.42:0/3006513258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db5878990 0x559db589c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.773+0000 7fba7c5f2b80 1 --2- 172.21.15.42:0/3006513258 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6180 0x559db58ba580 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.773+0000 7fba497fa700 0 client.4857 ms_handle_reset on v2:172.21.15.42:6836/1851767861 2023-07-29T02:00:39.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.773+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/3006513258 >> 172.21.15.42:0/3006513258 conn(0x559db5873630 msgr2=0x559db5876540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:39.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.773+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/3006513258 shutdown_connections 2023-07-29T02:00:39.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.773+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/3006513258 wait complete. 2023-07-29T02:00:39.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.773+0000 7fba7c5f2b80 20 client.4857 trim_cache size 0 max 16384 2023-07-29T02:00:39.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.791+0000 7fba7c5f2b80 1 Processor -- start 2023-07-29T02:00:39.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.791+0000 7fba7c5f2b80 1 -- start start 2023-07-29T02:00:39.780 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.791+0000 7fba7c5f2b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db5878990 0x559db5872340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:39.780 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.791+0000 7fba7c5f2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db58b6180 0x559db5898e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:39.780 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.791+0000 7fba7c5f2b80 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6550 0x559db58993a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.791+0000 7fba7c5f2b80 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db589ce90 con 0x559db58b6550 2023-07-29T02:00:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.791+0000 7fba7c5f2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db589c870 con 0x559db58b6180 2023-07-29T02:00:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.791+0000 7fba7c5f2b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x559db589b790 con 0x559db5878990 2023-07-29T02:00:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.792+0000 7fba6ea02700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6550 0x559db58993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.792+0000 7fba6ea02700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6550 0x559db58993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56866/0 (socket says 172.21.15.42:56866) 2023-07-29T02:00:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.792+0000 7fba6ea02700 1 -- 172.21.15.42:0/942049188 learned_addr learned my addr 172.21.15.42:0/942049188 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:39.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.792+0000 7fba6e201700 1 --2- 172.21.15.42:0/942049188 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db5878990 0x559db5872340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.792+0000 7fba6da00700 1 --2- 172.21.15.42:0/942049188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db58b6180 0x559db5898e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.792+0000 7fba6ea02700 1 -- 172.21.15.42:0/942049188 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db5878990 msgr2=0x559db5872340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.792+0000 7fba6ea02700 1 --2- 172.21.15.42:0/942049188 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db5878990 0x559db5872340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.792+0000 7fba6ea02700 1 -- 172.21.15.42:0/942049188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db58b6180 msgr2=0x559db5898e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.792+0000 7fba6ea02700 1 --2- 172.21.15.42:0/942049188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db58b6180 0x559db5898e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.792+0000 7fba6ea02700 1 -- 172.21.15.42:0/942049188 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559db561c200 con 0x559db58b6550 2023-07-29T02:00:39.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.792+0000 7fba6ea02700 1 --2- 172.21.15.42:0/942049188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6550 0x559db58993a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fba600558a0 tx=0x7fba60058d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8b34cb284431dd server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:39.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.792+0000 7fba5cdad700 1 -- 172.21.15.42:0/942049188 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6005d150 con 0x559db58b6550 2023-07-29T02:00:39.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.792+0000 7fba5cdad700 1 -- 172.21.15.42:0/942049188 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba60061780 con 0x559db58b6550 2023-07-29T02:00:39.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.792+0000 7fba5cdad700 1 -- 172.21.15.42:0/942049188 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba600612f0 con 0x559db58b6550 2023-07-29T02:00:39.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.793+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/942049188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6550 msgr2=0x559db58993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:39.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.793+0000 7fba7c5f2b80 1 --2- 172.21.15.42:0/942049188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6550 0x559db58993a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fba600558a0 tx=0x7fba60058d00 comp rx=0 tx=0).stop 2023-07-29T02:00:39.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.793+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/942049188 shutdown_connections 2023-07-29T02:00:39.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.793+0000 7fba7c5f2b80 1 --2- 172.21.15.42:0/942049188 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6550 0x559db58993a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.793+0000 7fba7c5f2b80 1 --2- 172.21.15.42:0/942049188 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db5878990 0x559db5872340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.793+0000 7fba7c5f2b80 1 --2- 172.21.15.42:0/942049188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db58b6180 0x559db5898e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.793+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/942049188 >> 172.21.15.42:0/942049188 conn(0x559db5873630 msgr2=0x559db58755d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.793+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/942049188 shutdown_connections 2023-07-29T02:00:39.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.793+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/942049188 wait complete. 2023-07-29T02:00:39.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.793+0000 7fba7c5f2b80 1 -- start start 2023-07-29T02:00:39.788 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.793+0000 7fba7c5f2b80 1 Processor -- start 2023-07-29T02:00:39.788 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.794+0000 7fba7c5f2b80 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db5878990 0x559db58b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:39.788 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.794+0000 7fba7c5f2b80 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6180 0x559db58b6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:39.788 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.794+0000 7fba7c5f2b80 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db58b6550 0x559db58b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:39.788 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.794+0000 7fba7c5f2b80 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db58d1290 con 0x559db58b6180 2023-07-29T02:00:39.788 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.794+0000 7fba7c5f2b80 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x559db58b4120 con 0x559db5878990 2023-07-29T02:00:39.788 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.794+0000 7fba7c5f2b80 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x559db58b7610 con 0x559db58b6550 2023-07-29T02:00:39.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.794+0000 7fba7c5f2b80 10 client.0 _ll_register_callbacks cb 0x7fba58001380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-29T02:00:39.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.794+0000 7fba6da00700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6180 0x559db58b6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:39.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.794+0000 7fba6da00700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6180 0x559db58b6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56872/0 (socket says 172.21.15.42:56872) 2023-07-29T02:00:39.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.794+0000 7fba6da00700 1 -- 172.21.15.42:0/3149723101 learned_addr learned my addr 172.21.15.42:0/3149723101 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:39.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.795+0000 7fba6ea02700 1 --2- 172.21.15.42:0/3149723101 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db58b6550 0x559db58b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:39.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.795+0000 7fba6e201700 1 --2- 172.21.15.42:0/3149723101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db5878990 0x559db58b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:39.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.795+0000 7fba6da00700 1 -- 172.21.15.42:0/3149723101 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db58b6550 msgr2=0x559db58b7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:39.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.795+0000 7fba6da00700 1 --2- 172.21.15.42:0/3149723101 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db58b6550 0x559db58b7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.795+0000 7fba6da00700 1 -- 172.21.15.42:0/3149723101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db5878990 msgr2=0x559db58b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:39.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.795+0000 7fba6da00700 1 --2- 172.21.15.42:0/3149723101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db5878990 0x559db58b3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.795+0000 7fba6da00700 1 -- 172.21.15.42:0/3149723101 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba681e2260 con 0x559db58b6180 2023-07-29T02:00:39.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.795+0000 7fba6ea02700 1 --2- 172.21.15.42:0/3149723101 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db58b6550 0x559db58b7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:39.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.795+0000 7fba6da00700 1 --2- 172.21.15.42:0/3149723101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6180 0x559db58b6c00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fba58001180 tx=0x7fba58009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b476ed6b05fd5d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:39.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.795+0000 7fba497fa700 10 client.0 ms_handle_connect on v2:172.21.15.42:3300/0 2023-07-29T02:00:39.791 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.795+0000 7fba497fa700 1 -- 172.21.15.42:0/3149723101 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba58003c80 con 0x559db58b6180 2023-07-29T02:00:39.791 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.795+0000 7fba497fa700 1 -- 172.21.15.42:0/3149723101 <== mon.0 v2:172.21.15.42:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fba58003de0 con 0x559db58b6180 2023-07-29T02:00:39.791 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.795+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/3149723101 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fba5800d050 con 0x559db58b6180 2023-07-29T02:00:39.791 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.795+0000 7fba497fa700 1 -- 172.21.15.42:0/3149723101 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_get_version_reply(handle=1 version=10) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba58007160 con 0x559db58b6180 2023-07-29T02:00:39.791 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.795+0000 7fba7c5f2b80 10 client.4863 fetch_fsmap learned FSMap version 10 2023-07-29T02:00:39.791 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.795+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/3149723101 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,fsmap=10,monmap=2+}) v3 -- 0x559db55f4260 con 0x559db58b6180 2023-07-29T02:00:39.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.795+0000 7fba497fa700 1 -- 172.21.15.42:0/3149723101 <== mon.0 v2:172.21.15.42:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5800d050 con 0x559db58b6180 2023-07-29T02:00:39.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.795+0000 7fba497fa700 1 -- 172.21.15.42:0/3149723101 <== mon.0 v2:172.21.15.42:3300/0 5 ==== fsmap(e 10) v1 ==== 4204+0+0 (secure 0 0 0) 0x7fba5803d070 con 0x559db58b6180 2023-07-29T02:00:39.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.795+0000 7fba7c5f2b80 10 client.4863 fetch_fsmap finished waiting for FSMap version 10 2023-07-29T02:00:39.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba7c5f2b80 10 client.4863 resolve_mds: resolved name 'e' to daemon mds.e 2023-07-29T02:00:39.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba7c5f2b80 20 client.4863 populate_metadata read hostname 'smithi042' 2023-07-29T02:00:39.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba7c5f2b80 1 --2- 172.21.15.42:0/3149723101 >> [v2:172.21.15.42:6836/1851767861,v1:172.21.15.42:6837/1851767861] conn(0x559db59162f0 0x559db58c03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:39.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba7c5f2b80 4 client.4863 mds_command: new command op to 4300 tid=0[{"prefix": "status"}] 2023-07-29T02:00:39.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/3149723101 --> [v2:172.21.15.42:6836/1851767861,v1:172.21.15.42:6837/1851767861] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559db57c0a10 con 0x559db59162f0 2023-07-29T02:00:39.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba6e201700 1 --2- 172.21.15.42:0/3149723101 >> [v2:172.21.15.42:6836/1851767861,v1:172.21.15.42:6837/1851767861] conn(0x559db59162f0 0x559db58c03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:39.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba497fa700 10 client.4863 ms_handle_connect on v2:172.21.15.42:6836/1851767861 2023-07-29T02:00:39.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba6e201700 1 --2- 172.21.15.42:0/3149723101 >> [v2:172.21.15.42:6836/1851767861,v1:172.21.15.42:6837/1851767861] conn(0x559db59162f0 0x559db58c03f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34f0d217891f7ae5 server_cookie=680bf98a342972dc in_seq=0 out_seq=0 2023-07-29T02:00:39.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba497fa700 1 -- 172.21.15.42:0/3149723101 <== mds.0 v2:172.21.15.42:6836/1851767861 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x559db57c0a10 con 0x559db59162f0 2023-07-29T02:00:39.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba497fa700 10 client.4863 handle_command_reply: tid=0 2023-07-29T02:00:39.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba7c5f2b80 1 client.4863 shutdown 2023-07-29T02:00:39.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/3149723101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6180 msgr2=0x559db58b6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:39.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba7c5f2b80 1 --2- 172.21.15.42:0/3149723101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6180 0x559db58b6c00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fba58001180 tx=0x7fba58009040 comp rx=0 tx=0).stop 2023-07-29T02:00:39.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/3149723101 shutdown_connections 2023-07-29T02:00:39.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba7c5f2b80 1 --2- 172.21.15.42:0/3149723101 >> [v2:172.21.15.42:6836/1851767861,v1:172.21.15.42:6837/1851767861] conn(0x559db59162f0 0x559db58c03f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba7c5f2b80 1 --2- 172.21.15.42:0/3149723101 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x559db58b6550 0x559db58b7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba7c5f2b80 1 --2- 172.21.15.42:0/3149723101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559db5878990 0x559db58b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba7c5f2b80 1 --2- 172.21.15.42:0/3149723101 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x559db58b6180 0x559db58b6c00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba497fa700 0 client.4863 ms_handle_reset on v2:172.21.15.42:6836/1851767861 2023-07-29T02:00:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/3149723101 >> 172.21.15.42:0/3149723101 conn(0x559db5873630 msgr2=0x559db589d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/3149723101 shutdown_connections 2023-07-29T02:00:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.796+0000 7fba7c5f2b80 1 -- 172.21.15.42:0/3149723101 wait complete. 2023-07-29T02:00:39.795 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.797+0000 7fba7c5f2b80 20 client.4863 trim_cache size 0 max 16384 2023-07-29T02:00:39.795 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2023-07-29T02:00:39.796 INFO:teuthology.orchestra.run.smithi042.stdout: "cluster_fsid": "f97a53ee-a392-4212-b8f0-a81cb72fe6f6", 2023-07-29T02:00:39.796 INFO:teuthology.orchestra.run.smithi042.stdout: "whoami": 0, 2023-07-29T02:00:39.796 INFO:teuthology.orchestra.run.smithi042.stdout: "id": 4300, 2023-07-29T02:00:39.796 INFO:teuthology.orchestra.run.smithi042.stdout: "want_state": "up:active", 2023-07-29T02:00:39.796 INFO:teuthology.orchestra.run.smithi042.stdout: "state": "up:active", 2023-07-29T02:00:39.796 INFO:teuthology.orchestra.run.smithi042.stdout: "fs_name": "cephfs", 2023-07-29T02:00:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: "rank_uptime": 41.848428341999998, 2023-07-29T02:00:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: "mdsmap_epoch": 10, 2023-07-29T02:00:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch": 25, 2023-07-29T02:00:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: "osdmap_epoch_barrier": 25, 2023-07-29T02:00:39.797 INFO:teuthology.orchestra.run.smithi042.stdout: "uptime": 47.220060801999999 2023-07-29T02:00:39.797 INFO:teuthology.orchestra.run.smithi042.stdout:} 2023-07-29T02:00:39.798 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.797+0000 7fba70465700 1 -- 172.21.15.42:0/410616999 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fba4c06a660 msgr2=0x7fba4c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:39.799 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.797+0000 7fba70465700 1 --2- 172.21.15.42:0/410616999 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fba4c06a660 0x7fba4c06cb10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fba64004a10 tx=0x7fba64009040 comp rx=0 tx=0).stop 2023-07-29T02:00:39.799 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.797+0000 7fba70465700 1 -- 172.21.15.42:0/410616999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba680cd370 msgr2=0x7fba68143880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:39.799 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.797+0000 7fba70465700 1 --2- 172.21.15.42:0/410616999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba680cd370 0x7fba68143880 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fba68068b60 tx=0x7fba60004ad0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.799 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.797+0000 7fba70465700 1 -- 172.21.15.42:0/410616999 shutdown_connections 2023-07-29T02:00:39.799 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.797+0000 7fba70465700 1 --2- 172.21.15.42:0/410616999 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fba4c06a660 0x7fba4c06cb10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.799 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.797+0000 7fba70465700 1 --2- 172.21.15.42:0/410616999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fba680cd370 0x7fba68143880 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.800 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.797+0000 7fba70465700 1 --2- 172.21.15.42:0/410616999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fba6806f530 0x7fba681e0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.800 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.797+0000 7fba70465700 1 --2- 172.21.15.42:0/410616999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fba680ccfa0 0x7fba68152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:39.800 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.797+0000 7fba70465700 1 -- 172.21.15.42:0/410616999 >> 172.21.15.42:0/410616999 conn(0x7fba68061190 msgr2=0x7fba680c82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:39.800 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.797+0000 7fba70465700 1 -- 172.21.15.42:0/410616999 shutdown_connections 2023-07-29T02:00:39.800 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:39.797+0000 7fba70465700 1 -- 172.21.15.42:0/410616999 wait complete. 2023-07-29T02:00:39.801 INFO:teuthology.run_tasks:Running task kclient... 2023-07-29T02:00:39.814 INFO:tasks.kclient:Mounting kernel clients... 2023-07-29T02:00:39.814 INFO:tasks.kclient:config is {'client.0': {}} 2023-07-29T02:00:39.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:39.815 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2023-07-29T02:00:39.832 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-07-29T02:00:39.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:39.833 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-29T02:00:39.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:39.909 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2023-07-29T02:00:40.022 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-07-29T02:00:40.022 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-29T02:00:40.023 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-29T02:00:40.023 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-29T02:00:40.150 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.163+0000 7f0cce68c700 1 Processor -- start 2023-07-29T02:00:40.150 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.163+0000 7f0cce68c700 1 -- start start 2023-07-29T02:00:40.151 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.163+0000 7f0cce68c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0cc8072ac0 0x7f0cc806d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:40.151 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.163+0000 7f0cce68c700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc80702e0 con 0x7f0cc80b0c90 2023-07-29T02:00:40.152 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.163+0000 7f0cce68c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc8070580 con 0x7f0cc80c5820 2023-07-29T02:00:40.152 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.163+0000 7f0cce68c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc80b1060 con 0x7f0cc8072ac0 2023-07-29T02:00:40.152 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.163+0000 7f0cc7fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f0cc80b0c90 0x7f0cc815a340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50682/0 (socket says 172.21.15.42:50682) 2023-07-29T02:00:40.152 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.163+0000 7f0cc7fff700 1 -- 172.21.15.42:0/2321159356 learned_addr learned my addr 172.21.15.42:0/2321159356 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:40.152 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.164+0000 7f0cc77fe700 1 --2- 172.21.15.42:0/2321159356 >> v2:172.21.15.144:3300/0 conn(0x7f0cc8072ac0 0x7f0cc806d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:40.152 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.164+0000 7f0cc6ffd700 1 -- 172.21.15.42:0/2321159356 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226079774 0 0) 0x7f0cc80702e0 con 0x7f0cc80b0c90 2023-07-29T02:00:40.153 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.164+0000 7f0cc6ffd700 1 -- 172.21.15.42:0/2321159356 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cb00035b0 con 0x7f0cc80b0c90 2023-07-29T02:00:40.153 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.164+0000 7f0cc77fe700 1 -- 172.21.15.42:0/2321159356 >> v1:172.21.15.144:6789/0 conn(0x7f0cc80c5820 legacy=0x7f0cc81616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:40.153 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.164+0000 7f0cc6ffd700 1 -- 172.21.15.42:0/2321159356 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349356525 0 0) 0x7f0cc8070580 con 0x7f0cc80c5820 2023-07-29T02:00:40.153 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.164+0000 7f0cc77fe700 1 -- 172.21.15.42:0/2321159356 >> v1:172.21.15.42:6789/0 conn(0x7f0cc80b0c90 legacy=0x7f0cc815a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:40.153 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.164+0000 7f0cc77fe700 1 -- 172.21.15.42:0/2321159356 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc80726a0 con 0x7f0cc8072ac0 2023-07-29T02:00:40.153 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.164+0000 7f0cc77fe700 1 --2- 172.21.15.42:0/2321159356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cc8072ac0 0x7f0cc806d890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009840 tx=0x7f0cbc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46af543d26cadfbc server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:40.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.164+0000 7f0cc6ffd700 1 -- 172.21.15.42:0/2321159356 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc004230 con 0x7f0cc8072ac0 2023-07-29T02:00:40.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.164+0000 7f0cc6ffd700 1 -- 172.21.15.42:0/2321159356 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc004390 con 0x7f0cc8072ac0 2023-07-29T02:00:40.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.164+0000 7f0cc6ffd700 1 -- 172.21.15.42:0/2321159356 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc0036a0 con 0x7f0cc8072ac0 2023-07-29T02:00:40.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.165+0000 7f0cce68c700 1 -- 172.21.15.42:0/2321159356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cc8072ac0 msgr2=0x7f0cc806d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:40.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.165+0000 7f0cce68c700 1 --2- 172.21.15.42:0/2321159356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cc8072ac0 0x7f0cc806d890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009840 tx=0x7f0cbc009b50 comp rx=0 tx=0).stop 2023-07-29T02:00:40.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.165+0000 7f0cce68c700 1 -- 172.21.15.42:0/2321159356 shutdown_connections 2023-07-29T02:00:40.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.165+0000 7f0cce68c700 1 --2- 172.21.15.42:0/2321159356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cc8072ac0 0x7f0cc806d890 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:40.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.165+0000 7f0cce68c700 1 -- 172.21.15.42:0/2321159356 >> 172.21.15.42:0/2321159356 conn(0x7f0cc806b3e0 msgr2=0x7f0cc80cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:40.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.165+0000 7f0cce68c700 1 -- 172.21.15.42:0/2321159356 shutdown_connections 2023-07-29T02:00:40.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.165+0000 7f0cce68c700 1 -- 172.21.15.42:0/2321159356 wait complete. 2023-07-29T02:00:40.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.166+0000 7f0cce68c700 1 Processor -- start 2023-07-29T02:00:40.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.166+0000 7f0cce68c700 1 -- start start 2023-07-29T02:00:40.158 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.167+0000 7f0cce68c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cc8072ac0 0x7f0cc81ef4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:40.158 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.167+0000 7f0cce68c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0cc80b0c90 0x7f0cc81ef9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:40.158 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.167+0000 7f0cce68c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cc80c5820 0x7f0cc80c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:40.158 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.167+0000 7f0cce68c700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc81f00e0 con 0x7f0cc80b0c90 2023-07-29T02:00:40.158 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.167+0000 7f0cce68c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc81e3e30 con 0x7f0cc8072ac0 2023-07-29T02:00:40.158 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.167+0000 7f0cce68c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc815a790 con 0x7f0cc80c5820 2023-07-29T02:00:40.158 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.167+0000 7f0cc77fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0cc80b0c90 0x7f0cc81ef9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:40.158 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.167+0000 7f0cc77fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0cc80b0c90 0x7f0cc81ef9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56886/0 (socket says 172.21.15.42:56886) 2023-07-29T02:00:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.167+0000 7f0cc77fe700 1 -- 172.21.15.42:0/2643098168 learned_addr learned my addr 172.21.15.42:0/2643098168 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.168+0000 7f0cc7fff700 1 --2- 172.21.15.42:0/2643098168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cc8072ac0 0x7f0cc81ef4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.168+0000 7f0cccc29700 1 --2- 172.21.15.42:0/2643098168 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cc80c5820 0x7f0cc80c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.168+0000 7f0cc77fe700 1 -- 172.21.15.42:0/2643098168 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cc80c5820 msgr2=0x7f0cc80c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.168+0000 7f0cc77fe700 1 --2- 172.21.15.42:0/2643098168 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cc80c5820 0x7f0cc80c2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.168+0000 7f0cc77fe700 1 -- 172.21.15.42:0/2643098168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cc8072ac0 msgr2=0x7f0cc81ef4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:40.159 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.168+0000 7f0cc77fe700 1 --2- 172.21.15.42:0/2643098168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cc8072ac0 0x7f0cc81ef4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.168+0000 7f0cc77fe700 1 -- 172.21.15.42:0/2643098168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cbc0094a0 con 0x7f0cc80b0c90 2023-07-29T02:00:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.168+0000 7f0cc7fff700 1 --2- 172.21.15.42:0/2643098168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cc8072ac0 0x7f0cc81ef4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.168+0000 7f0cc77fe700 1 --2- 172.21.15.42:0/2643098168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0cc80b0c90 0x7f0cc81ef9e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc0090b0 tx=0x7f0cbc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.168+0000 7f0cc4ff9700 1 -- 172.21.15.42:0/2643098168 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc011630 con 0x7f0cc80b0c90 2023-07-29T02:00:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.168+0000 7f0cc4ff9700 1 -- 172.21.15.42:0/2643098168 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc01f070 con 0x7f0cc80b0c90 2023-07-29T02:00:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.168+0000 7f0cc4ff9700 1 -- 172.21.15.42:0/2643098168 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc0119b0 con 0x7f0cc80b0c90 2023-07-29T02:00:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.168+0000 7f0cce68c700 1 -- 172.21.15.42:0/2643098168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc815a1d0 con 0x7f0cc80b0c90 2023-07-29T02:00:40.160 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.168+0000 7f0cce68c700 1 -- 172.21.15.42:0/2643098168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc81e3a50 con 0x7f0cc80b0c90 2023-07-29T02:00:40.161 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.169+0000 7f0cce68c700 1 -- 172.21.15.42:0/2643098168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc81e3c10 con 0x7f0cc80b0c90 2023-07-29T02:00:40.161 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.169+0000 7f0cc4ff9700 1 -- 172.21.15.42:0/2643098168 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f0cbc011b10 con 0x7f0cc80b0c90 2023-07-29T02:00:40.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.170+0000 7f0cc4ff9700 1 --2- 172.21.15.42:0/2643098168 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f0cb406a6b0 0x7f0cb406cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:40.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.170+0000 7f0cc4ff9700 1 -- 172.21.15.42:0/2643098168 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0cbc021070 con 0x7f0cc80b0c90 2023-07-29T02:00:40.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.170+0000 7f0cc7fff700 1 --2- 172.21.15.42:0/2643098168 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f0cb406a6b0 0x7f0cb406cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:40.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.171+0000 7f0cc7fff700 1 --2- 172.21.15.42:0/2643098168 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f0cb406a6b0 0x7f0cb406cb60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8005910 tx=0x7f0cb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:40.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.174+0000 7f0cc4ff9700 1 -- 172.21.15.42:0/2643098168 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f0cbc055990 con 0x7f0cc80b0c90 2023-07-29T02:00:40.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.423+0000 7f0cce68c700 1 -- 172.21.15.42:0/2643098168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0cc81e3f70 con 0x7f0cc80b0c90 2023-07-29T02:00:40.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.423+0000 7f0cc4ff9700 1 -- 172.21.15.42:0/2643098168 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v10) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0cc81e3f70 con 0x7f0cc80b0c90 2023-07-29T02:00:40.411 INFO:teuthology.orchestra.run.smithi042.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-29T02:00:40.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.425+0000 7f0cce68c700 1 -- 172.21.15.42:0/2643098168 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f0cb406a6b0 msgr2=0x7f0cb406cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:40.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.425+0000 7f0cce68c700 1 --2- 172.21.15.42:0/2643098168 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f0cb406a6b0 0x7f0cb406cb60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8005910 tx=0x7f0cb8009040 comp rx=0 tx=0).stop 2023-07-29T02:00:40.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.425+0000 7f0cce68c700 1 -- 172.21.15.42:0/2643098168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0cc80b0c90 msgr2=0x7f0cc81ef9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:40.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.425+0000 7f0cce68c700 1 --2- 172.21.15.42:0/2643098168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0cc80b0c90 0x7f0cc81ef9e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc0090b0 tx=0x7f0cbc004750 comp rx=0 tx=0).stop 2023-07-29T02:00:40.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.425+0000 7f0cce68c700 1 -- 172.21.15.42:0/2643098168 shutdown_connections 2023-07-29T02:00:40.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.425+0000 7f0cce68c700 1 --2- 172.21.15.42:0/2643098168 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f0cb406a6b0 0x7f0cb406cb60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:40.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.425+0000 7f0cce68c700 1 --2- 172.21.15.42:0/2643098168 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0cc80c5820 0x7f0cc80c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:40.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.425+0000 7f0cce68c700 1 --2- 172.21.15.42:0/2643098168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0cc8072ac0 0x7f0cc81ef4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:40.415 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.425+0000 7f0cce68c700 1 --2- 172.21.15.42:0/2643098168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0cc80b0c90 0x7f0cc81ef9e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:40.415 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.425+0000 7f0cce68c700 1 -- 172.21.15.42:0/2643098168 >> 172.21.15.42:0/2643098168 conn(0x7f0cc806b3e0 msgr2=0x7f0cc806d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:40.415 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.425+0000 7f0cce68c700 1 -- 172.21.15.42:0/2643098168 shutdown_connections 2023-07-29T02:00:40.415 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:40.425+0000 7f0cce68c700 1 -- 172.21.15.42:0/2643098168 wait complete. 2023-07-29T02:00:40.425 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-29T02:00:40.425 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-29T02:00:40.425 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi042.front.sepia.ceph.com 2023-07-29T02:00:40.425 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-29T02:00:40.425 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-29T02:00:40.426 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-29T02:00:40.426 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-29T02:00:40.426 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-29T02:00:40.426 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-29T02:00:40.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:40.427 DEBUG:teuthology.orchestra.run.smithi042:> ip addr 2023-07-29T02:00:40.444 INFO:teuthology.orchestra.run.smithi042.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-29T02:00:40.445 INFO:teuthology.orchestra.run.smithi042.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-29T02:00:40.445 INFO:teuthology.orchestra.run.smithi042.stdout: inet 127.0.0.1/8 scope host lo 2023-07-29T02:00:40.445 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2023-07-29T02:00:40.445 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 ::1/128 scope host 2023-07-29T02:00:40.445 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2023-07-29T02:00:40.445 INFO:teuthology.orchestra.run.smithi042.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-29T02:00:40.445 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0e brd ff:ff:ff:ff:ff:ff 2023-07-29T02:00:40.446 INFO:teuthology.orchestra.run.smithi042.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-29T02:00:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:6b:fd:0f brd ff:ff:ff:ff:ff:ff 2023-07-29T02:00:40.446 INFO:teuthology.orchestra.run.smithi042.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-29T02:00:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:40 brd ff:ff:ff:ff:ff:ff 2023-07-29T02:00:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: inet 172.21.15.42/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-29T02:00:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft 41910sec preferred_lft 41910sec 2023-07-29T02:00:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: inet6 fe80::ec4:7aff:febd:1440/64 scope link 2023-07-29T02:00:40.446 INFO:teuthology.orchestra.run.smithi042.stdout: valid_lft forever preferred_lft forever 2023-07-29T02:00:40.447 INFO:teuthology.orchestra.run.smithi042.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-29T02:00:40.447 INFO:teuthology.orchestra.run.smithi042.stdout: link/ether 0c:c4:7a:bd:14:41 brd ff:ff:ff:ff:ff:ff 2023-07-29T02:00:40.447 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-29T02:00:40.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:40.448 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2023-07-29T02:00:40.448 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2023-07-29T02:00:40.449 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add name ceph-brx type bridge 2023-07-29T02:00:40.449 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr flush dev ceph-brx 2023-07-29T02:00:40.449 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set ceph-brx up 2023-07-29T02:00:40.449 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-29T02:00:40.450 DEBUG:teuthology.orchestra.run.smithi042:> ') 2023-07-29T02:00:40.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:40.564 DEBUG:teuthology.orchestra.run.smithi042:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-29T02:00:40.591 INFO:teuthology.orchestra.run.smithi042.stdout:1 2023-07-29T02:00:40.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:40.593 DEBUG:teuthology.orchestra.run.smithi042:> route 2023-07-29T02:00:40.653 INFO:teuthology.orchestra.run.smithi042.stdout:Kernel IP routing table 2023-07-29T02:00:40.654 INFO:teuthology.orchestra.run.smithi042.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-29T02:00:40.654 INFO:teuthology.orchestra.run.smithi042.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-29T02:00:40.654 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-29T02:00:40.654 INFO:teuthology.orchestra.run.smithi042.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-29T02:00:40.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:40.656 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2023-07-29T02:00:40.656 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2023-07-29T02:00:40.656 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-29T02:00:40.657 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-29T02:00:40.657 DEBUG:teuthology.orchestra.run.smithi042:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-29T02:00:40.657 DEBUG:teuthology.orchestra.run.smithi042:> ') 2023-07-29T02:00:40.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:40.761 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2023-07-29T02:00:40.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:40.779 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list-id 2023-07-29T02:00:40.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:40.837 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2023-07-29T02:00:40.837 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2023-07-29T02:00:40.837 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-29T02:00:40.837 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-29T02:00:40.838 DEBUG:teuthology.orchestra.run.smithi042:> ') 2023-07-29T02:00:40.932 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-29T02:00:40.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:40.933 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2023-07-29T02:00:40.934 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2023-07-29T02:00:40.934 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-29T02:00:40.935 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-29T02:00:40.935 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-29T02:00:40.936 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-29T02:00:40.936 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-29T02:00:40.937 DEBUG:teuthology.orchestra.run.smithi042:> ') 2023-07-29T02:00:41.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:41.139 DEBUG:teuthology.orchestra.run.smithi042:> (cd / && exec bash -c ' 2023-07-29T02:00:41.139 DEBUG:teuthology.orchestra.run.smithi042:> set -e 2023-07-29T02:00:41.139 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set brx.0 up 2023-07-29T02:00:41.140 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link set dev brx.0 master ceph-brx 2023-07-29T02:00:41.140 DEBUG:teuthology.orchestra.run.smithi042:> ') 2023-07-29T02:00:41.273 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-29T02:00:41.274 DEBUG:teuthology.orchestra.run.smithi042:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-29T02:00:41.298 INFO:teuthology.orchestra.run.smithi042.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-29T02:00:41.298 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-29T02:00:41.298 DEBUG:teuthology.orchestra.run.smithi042:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-29T02:00:41.355 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-29T02:00:41.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:41.381 DEBUG:teuthology.orchestra.run.smithi042:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-29T02:00:41.442 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-29T02:00:41.442 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-29T02:00:41.443 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2023-07-29T02:00:41.569 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-29T02:00:41.570 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-29T02:00:41.570 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2023-07-29T02:00:41.570 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-07-29T02:00:41.570 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-29T02:00:41.643 INFO:teuthology.orchestra.run.smithi042.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-29T02:00:41.643 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-29T02:00:41.643 INFO:teuthology.orchestra.run.smithi042.stdout:invalid new device string format 2023-07-29T02:00:41.643 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:3300,172.21.15.144:3300,172.21.15.144:3301" 2023-07-29T02:00:41.644 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-29T02:00:41.644 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: resolved to: "172.21.15.42:6789,172.21.15.144:6789,172.21.15.144:6790" 2023-07-29T02:00:41.644 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.42:6789,172.21.15.144:6789,172.21.15.144:6790:/ 2023-07-29T02:00:41.644 INFO:teuthology.orchestra.run.smithi042.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f97a53ee-a392-4212-b8f0-a81cb72fe6f6" will pass to kernel 2023-07-29T02:00:41.646 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-29T02:00:41.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:41.646 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-29T02:00:41.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:41.674 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-29T02:00:41.747 INFO:teuthology.orchestra.run.smithi042.stdout:client4646 2023-07-29T02:00:41.747 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T02:00:41.747 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-29T02:00:41.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:41.805 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-29T02:00:41.878 INFO:teuthology.orchestra.run.smithi042.stdout:client4646 2023-07-29T02:00:41.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:41.878 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-29T02:00:41.950 INFO:teuthology.orchestra.run.smithi042.stdout:client4646 2023-07-29T02:00:41.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:00:41.951 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f97a53ee-a392-4212-b8f0-a81cb72fe6f6.client4646/status') 2023-07-29T02:00:42.033 INFO:teuthology.orchestra.run.smithi042.stdout:instance: client.4646 (3)172.21.15.42:0/2265541446 2023-07-29T02:00:42.033 INFO:teuthology.orchestra.run.smithi042.stdout:blocklisted: false 2023-07-29T02:00:42.033 INFO:teuthology.orchestra.run.smithi042.stderr:0+1 records in 2023-07-29T02:00:42.034 INFO:teuthology.orchestra.run.smithi042.stderr:0+1 records out 2023-07-29T02:00:42.034 INFO:teuthology.orchestra.run.smithi042.stderr:70 bytes copied, 2.6484e-05 s, 2.6 MB/s 2023-07-29T02:00:42.035 INFO:teuthology.run_tasks:Running task mds_thrash... 2023-07-29T02:00:42.047 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T02:00:42.200 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.213+0000 7fbc711c0700 1 Processor -- start 2023-07-29T02:00:42.200 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.213+0000 7fbc711c0700 1 -- start start 2023-07-29T02:00:42.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.213+0000 7fbc711c0700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbc6c0c7210 0x7fbc6c06cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:42.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.213+0000 7fbc711c0700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbc6c072a90 0x7fbc6c06d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:42.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.213+0000 7fbc711c0700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6c0c7700 con 0x7fbc6c1567d0 2023-07-29T02:00:42.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.213+0000 7fbc711c0700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6c06b160 con 0x7fbc6c0c7210 2023-07-29T02:00:42.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.213+0000 7fbc711c0700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6c159170 con 0x7fbc6c072a90 2023-07-29T02:00:42.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.213+0000 7fbc6a59c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbc6c0c7210 0x7fbc6c06cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:42.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.213+0000 7fbc6a59c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbc6c0c7210 0x7fbc6c06cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56898/0 (socket says 172.21.15.42:56898) 2023-07-29T02:00:42.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.213+0000 7fbc6a59c700 1 -- 172.21.15.42:0/3510642569 learned_addr learned my addr 172.21.15.42:0/3510642569 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:42.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.214+0000 7fbc6a59c700 1 -- 172.21.15.42:0/3510642569 >> v2:172.21.15.144:3300/0 conn(0x7fbc6c072a90 msgr2=0x7fbc6c06d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:42.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.214+0000 7fbc6a59c700 1 --2- 172.21.15.42:0/3510642569 >> v2:172.21.15.144:3300/0 conn(0x7fbc6c072a90 0x7fbc6c06d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.214+0000 7fbc6a59c700 1 -- 172.21.15.42:0/3510642569 >> v1:172.21.15.144:6789/0 conn(0x7fbc6c1567d0 legacy=0x7fbc6c159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:42.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.214+0000 7fbc6a59c700 1 -- 172.21.15.42:0/3510642569 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c156ba0 con 0x7fbc6c0c7210 2023-07-29T02:00:42.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.214+0000 7fbc6a59c700 1 --2- 172.21.15.42:0/3510642569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc6c0c7210 0x7fbc6c06cd10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c06e5b0 tx=0x7fbc54009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de1704f2fa333b8a server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:42.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.214+0000 7fbc69d9b700 1 -- 172.21.15.42:0/3510642569 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54004230 con 0x7fbc6c0c7210 2023-07-29T02:00:42.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.214+0000 7fbc69d9b700 1 -- 172.21.15.42:0/3510642569 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc54004390 con 0x7fbc6c0c7210 2023-07-29T02:00:42.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.214+0000 7fbc69d9b700 1 -- 172.21.15.42:0/3510642569 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc540036a0 con 0x7fbc6c0c7210 2023-07-29T02:00:42.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.215+0000 7fbc711c0700 1 -- 172.21.15.42:0/3510642569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc6c0c7210 msgr2=0x7fbc6c06cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:42.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.215+0000 7fbc711c0700 1 --2- 172.21.15.42:0/3510642569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc6c0c7210 0x7fbc6c06cd10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c06e5b0 tx=0x7fbc54009bd0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.215+0000 7fbc711c0700 1 -- 172.21.15.42:0/3510642569 shutdown_connections 2023-07-29T02:00:42.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.215+0000 7fbc711c0700 1 --2- 172.21.15.42:0/3510642569 >> v2:172.21.15.144:3300/0 conn(0x7fbc6c072a90 0x7fbc6c06d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.206 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.215+0000 7fbc711c0700 1 --2- 172.21.15.42:0/3510642569 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc6c0c7210 0x7fbc6c06cd10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.206 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.215+0000 7fbc711c0700 1 -- 172.21.15.42:0/3510642569 >> 172.21.15.42:0/3510642569 conn(0x7fbc6c0c8970 msgr2=0x7fbc6c0c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:42.206 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.215+0000 7fbc711c0700 1 -- 172.21.15.42:0/3510642569 shutdown_connections 2023-07-29T02:00:42.206 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.215+0000 7fbc711c0700 1 -- 172.21.15.42:0/3510642569 wait complete. 2023-07-29T02:00:42.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.216+0000 7fbc711c0700 1 Processor -- start 2023-07-29T02:00:42.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.216+0000 7fbc711c0700 1 -- start start 2023-07-29T02:00:42.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.217+0000 7fbc711c0700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc6c072a90 0x7fbc6c1f2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:42.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.217+0000 7fbc711c0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc6c0c7210 0x7fbc6c0c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:42.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.217+0000 7fbc711c0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc6c1567d0 0x7fbc6c152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:42.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.217+0000 7fbc711c0700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c1ef360 con 0x7fbc6c072a90 2023-07-29T02:00:42.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.217+0000 7fbc711c0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c1f2db0 con 0x7fbc6c0c7210 2023-07-29T02:00:42.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.217+0000 7fbc711c0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c1eea00 con 0x7fbc6c1567d0 2023-07-29T02:00:42.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.217+0000 7fbc6ad9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc6c072a90 0x7fbc6c1f2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:42.210 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.217+0000 7fbc6ad9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc6c072a90 0x7fbc6c1f2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56902/0 (socket says 172.21.15.42:56902) 2023-07-29T02:00:42.210 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.217+0000 7fbc6ad9d700 1 -- 172.21.15.42:0/797057920 learned_addr learned my addr 172.21.15.42:0/797057920 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:42.210 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.217+0000 7fbc6b59e700 1 --2- 172.21.15.42:0/797057920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc6c1567d0 0x7fbc6c152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:42.210 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.217+0000 7fbc6a59c700 1 --2- 172.21.15.42:0/797057920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc6c0c7210 0x7fbc6c0c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:42.210 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.217+0000 7fbc6ad9d700 1 -- 172.21.15.42:0/797057920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc6c1567d0 msgr2=0x7fbc6c152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:42.210 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.217+0000 7fbc6ad9d700 1 --2- 172.21.15.42:0/797057920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc6c1567d0 0x7fbc6c152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.210 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.217+0000 7fbc6ad9d700 1 -- 172.21.15.42:0/797057920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc6c0c7210 msgr2=0x7fbc6c0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:42.211 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.217+0000 7fbc6ad9d700 1 --2- 172.21.15.42:0/797057920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc6c0c7210 0x7fbc6c0c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.211 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.217+0000 7fbc6ad9d700 1 -- 172.21.15.42:0/797057920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc54009550 con 0x7fbc6c072a90 2023-07-29T02:00:42.211 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.217+0000 7fbc6a59c700 1 --2- 172.21.15.42:0/797057920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc6c0c7210 0x7fbc6c0c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:42.211 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.218+0000 7fbc6ad9d700 1 --2- 172.21.15.42:0/797057920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc6c072a90 0x7fbc6c1f2870 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00b470 tx=0x7fbc5c00b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:42.211 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.218+0000 7fbc637fe700 1 -- 172.21.15.42:0/797057920 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c011830 con 0x7fbc6c072a90 2023-07-29T02:00:42.211 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.218+0000 7fbc637fe700 1 -- 172.21.15.42:0/797057920 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5c0119b0 con 0x7fbc6c072a90 2023-07-29T02:00:42.211 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.218+0000 7fbc637fe700 1 -- 172.21.15.42:0/797057920 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c011d60 con 0x7fbc6c072a90 2023-07-29T02:00:42.212 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.218+0000 7fbc711c0700 1 -- 172.21.15.42:0/797057920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6c0b0620 con 0x7fbc6c072a90 2023-07-29T02:00:42.212 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.218+0000 7fbc711c0700 1 -- 172.21.15.42:0/797057920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6c1eeca0 con 0x7fbc6c072a90 2023-07-29T02:00:42.212 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.219+0000 7fbc711c0700 1 -- 172.21.15.42:0/797057920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6c074740 con 0x7fbc6c072a90 2023-07-29T02:00:42.212 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.219+0000 7fbc637fe700 1 -- 172.21.15.42:0/797057920 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fbc5c01a400 con 0x7fbc6c072a90 2023-07-29T02:00:42.212 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.219+0000 7fbc637fe700 1 --2- 172.21.15.42:0/797057920 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbc4c06a660 0x7fbc4c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:42.212 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.220+0000 7fbc637fe700 1 -- 172.21.15.42:0/797057920 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbc5c088dc0 con 0x7fbc6c072a90 2023-07-29T02:00:42.212 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.220+0000 7fbc6a59c700 1 --2- 172.21.15.42:0/797057920 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbc4c06a660 0x7fbc4c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:42.213 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.220+0000 7fbc6a59c700 1 --2- 172.21.15.42:0/797057920 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbc4c06a660 0x7fbc4c06cb10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c072a60 tx=0x7fbc54008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:42.213 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.224+0000 7fbc637fe700 1 -- 172.21.15.42:0/797057920 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fbc5c053ed0 con 0x7fbc6c072a90 2023-07-29T02:00:42.409 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.422+0000 7fbc711c0700 1 -- 172.21.15.42:0/797057920 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc6c04ea50 con 0x7fbc6c072a90 2023-07-29T02:00:42.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.423+0000 7fbc637fe700 1 -- 172.21.15.42:0/797057920 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19690 (secure 0 0 0) 0x7fbc5c015090 con 0x7fbc6c072a90 2023-07-29T02:00:42.411 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:42.411 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T02:00:02.394460+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T01:59:55.827461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T01:59:56.924040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-29T01:59:59.996470+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T02:00:42.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.425+0000 7fbc711c0700 1 -- 172.21.15.42:0/797057920 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbc4c06a660 msgr2=0x7fbc4c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:42.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.425+0000 7fbc711c0700 1 --2- 172.21.15.42:0/797057920 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbc4c06a660 0x7fbc4c06cb10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c072a60 tx=0x7fbc54008030 comp rx=0 tx=0).stop 2023-07-29T02:00:42.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.425+0000 7fbc711c0700 1 -- 172.21.15.42:0/797057920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc6c072a90 msgr2=0x7fbc6c1f2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:42.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.425+0000 7fbc711c0700 1 --2- 172.21.15.42:0/797057920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc6c072a90 0x7fbc6c1f2870 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00b470 tx=0x7fbc5c00b830 comp rx=0 tx=0).stop 2023-07-29T02:00:42.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.425+0000 7fbc711c0700 1 -- 172.21.15.42:0/797057920 shutdown_connections 2023-07-29T02:00:42.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.425+0000 7fbc711c0700 1 --2- 172.21.15.42:0/797057920 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbc4c06a660 0x7fbc4c06cb10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.425+0000 7fbc711c0700 1 --2- 172.21.15.42:0/797057920 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbc6c1567d0 0x7fbc6c152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.425+0000 7fbc711c0700 1 --2- 172.21.15.42:0/797057920 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbc6c072a90 0x7fbc6c1f2870 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.425+0000 7fbc711c0700 1 --2- 172.21.15.42:0/797057920 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc6c0c7210 0x7fbc6c0c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.425+0000 7fbc711c0700 1 -- 172.21.15.42:0/797057920 >> 172.21.15.42:0/797057920 conn(0x7fbc6c0c8970 msgr2=0x7fbc6c157840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.425+0000 7fbc711c0700 1 -- 172.21.15.42:0/797057920 shutdown_connections 2023-07-29T02:00:42.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.425+0000 7fbc711c0700 1 -- 172.21.15.42:0/797057920 wait complete. 2023-07-29T02:00:42.425 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-29T01:59:50.906228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-29T01:59:51.290583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T01:59:55.827461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T01:59:56.924040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-29T01:59:59.996470+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-29T02:00:42.425 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-29T02:00:42.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.566+0000 7f36aedac700 1 Processor -- start 2023-07-29T02:00:42.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.566+0000 7f36aedac700 1 -- start start 2023-07-29T02:00:42.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.567+0000 7f36aedac700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f36a8150340 0x7f36a8070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:42.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.567+0000 7f36aedac700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f36a80c0d70 0x7f36a80c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:42.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.567+0000 7f36aedac700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a80c77f0 con 0x7f36a80bfeb0 2023-07-29T02:00:42.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.567+0000 7f36aedac700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a80c05b0 con 0x7f36a80c0d70 2023-07-29T02:00:42.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.567+0000 7f36aedac700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a8072010 con 0x7f36a8150340 2023-07-29T02:00:42.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.567+0000 7f36a7fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f36a80c0d70 0x7f36a80c12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:42.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.567+0000 7f36ad349700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f36a80bfeb0 0x7f36a80b06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50718/0 (socket says 172.21.15.42:50718) 2023-07-29T02:00:42.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.567+0000 7f36ad349700 1 -- 172.21.15.42:0/238155990 learned_addr learned my addr 172.21.15.42:0/238155990 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:42.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.568+0000 7f36acb48700 1 --2- 172.21.15.42:0/238155990 >> v2:172.21.15.144:3300/0 conn(0x7f36a8150340 0x7f36a8070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:42.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.568+0000 7f36a7fff700 1 -- 172.21.15.42:0/238155990 >> v2:172.21.15.144:3300/0 conn(0x7f36a8150340 msgr2=0x7f36a8070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:42.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.568+0000 7f36a7fff700 1 --2- 172.21.15.42:0/238155990 >> v2:172.21.15.144:3300/0 conn(0x7f36a8150340 0x7f36a8070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.568+0000 7f36a7fff700 1 -- 172.21.15.42:0/238155990 >> v1:172.21.15.42:6789/0 conn(0x7f36a80bfeb0 legacy=0x7f36a80b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:42.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.568+0000 7f36a7fff700 1 -- 172.21.15.42:0/238155990 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a8071a30 con 0x7f36a80c0d70 2023-07-29T02:00:42.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.568+0000 7f36a77fe700 1 -- 172.21.15.42:0/238155990 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839547745 0 0) 0x7f36a0001490 con 0x7f36a80bfeb0 2023-07-29T02:00:42.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.568+0000 7f36acb48700 1 --2- 172.21.15.42:0/238155990 >> v2:172.21.15.144:3300/0 conn(0x7f36a8150340 0x7f36a8070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:42.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.568+0000 7f36a7fff700 1 --2- 172.21.15.42:0/238155990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36a80c0d70 0x7f36a80c12c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f36a806cca0 tx=0x7f3694009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fbaa0544c25867 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:42.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.568+0000 7f36a77fe700 1 -- 172.21.15.42:0/238155990 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3694011830 con 0x7f36a80c0d70 2023-07-29T02:00:42.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.568+0000 7f36a77fe700 1 -- 172.21.15.42:0/238155990 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3694011990 con 0x7f36a80c0d70 2023-07-29T02:00:42.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.568+0000 7f36a77fe700 1 -- 172.21.15.42:0/238155990 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3694011d20 con 0x7f36a80c0d70 2023-07-29T02:00:42.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.569+0000 7f36aedac700 1 -- 172.21.15.42:0/238155990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36a80c0d70 msgr2=0x7f36a80c12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:42.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.569+0000 7f36aedac700 1 --2- 172.21.15.42:0/238155990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36a80c0d70 0x7f36a80c12c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f36a806cca0 tx=0x7f3694009b20 comp rx=0 tx=0).stop 2023-07-29T02:00:42.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.569+0000 7f36aedac700 1 -- 172.21.15.42:0/238155990 shutdown_connections 2023-07-29T02:00:42.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.569+0000 7f36aedac700 1 --2- 172.21.15.42:0/238155990 >> v2:172.21.15.144:3300/0 conn(0x7f36a8150340 0x7f36a8070080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.569+0000 7f36aedac700 1 --2- 172.21.15.42:0/238155990 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36a80c0d70 0x7f36a80c12c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.569+0000 7f36aedac700 1 -- 172.21.15.42:0/238155990 >> 172.21.15.42:0/238155990 conn(0x7f36a80cae90 msgr2=0x7f36a80cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:42.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.569+0000 7f36aedac700 1 -- 172.21.15.42:0/238155990 shutdown_connections 2023-07-29T02:00:42.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.569+0000 7f36aedac700 1 -- 172.21.15.42:0/238155990 wait complete. 2023-07-29T02:00:42.562 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.570+0000 7f36aedac700 1 Processor -- start 2023-07-29T02:00:42.563 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.570+0000 7f36aedac700 1 -- start start 2023-07-29T02:00:42.563 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.571+0000 7f36aedac700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36a80bfeb0 0x7f36a80c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:42.563 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.571+0000 7f36aedac700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36a80c0d70 0x7f36a814bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:42.563 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.571+0000 7f36aedac700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36a8150340 0x7f36a81497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:42.563 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.571+0000 7f36aedac700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a81ee890 con 0x7f36a80c0d70 2023-07-29T02:00:42.564 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.571+0000 7f36aedac700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a81eeb50 con 0x7f36a8150340 2023-07-29T02:00:42.564 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.571+0000 7f36aedac700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a81eee30 con 0x7f36a80bfeb0 2023-07-29T02:00:42.564 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.571+0000 7f36a7fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36a80c0d70 0x7f36a814bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:42.564 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.571+0000 7f36a7fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36a80c0d70 0x7f36a814bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56918/0 (socket says 172.21.15.42:56918) 2023-07-29T02:00:42.564 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.571+0000 7f36a7fff700 1 -- 172.21.15.42:0/151515848 learned_addr learned my addr 172.21.15.42:0/151515848 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:42.564 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.571+0000 7f36acb48700 1 --2- 172.21.15.42:0/151515848 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36a80bfeb0 0x7f36a80c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:42.564 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.571+0000 7f36ad349700 1 --2- 172.21.15.42:0/151515848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36a8150340 0x7f36a81497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:42.565 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.571+0000 7f36a7fff700 1 -- 172.21.15.42:0/151515848 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36a80bfeb0 msgr2=0x7f36a80c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:42.565 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.571+0000 7f36a7fff700 1 --2- 172.21.15.42:0/151515848 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36a80bfeb0 0x7f36a80c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.565 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.571+0000 7f36a7fff700 1 -- 172.21.15.42:0/151515848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36a8150340 msgr2=0x7f36a81497d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:42.565 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.571+0000 7f36a7fff700 1 --2- 172.21.15.42:0/151515848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36a8150340 0x7f36a81497d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.565 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.571+0000 7f36a7fff700 1 -- 172.21.15.42:0/151515848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36940094a0 con 0x7f36a80c0d70 2023-07-29T02:00:42.565 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.571+0000 7f36a7fff700 1 --2- 172.21.15.42:0/151515848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36a80c0d70 0x7f36a814bee0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f36940090b0 tx=0x7f3694004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:42.565 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.572+0000 7f36a57fa700 1 -- 172.21.15.42:0/151515848 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36940036a0 con 0x7f36a80c0d70 2023-07-29T02:00:42.565 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.572+0000 7f36a57fa700 1 -- 172.21.15.42:0/151515848 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369401f070 con 0x7f36a80c0d70 2023-07-29T02:00:42.566 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.572+0000 7f36aedac700 1 -- 172.21.15.42:0/151515848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a81ef110 con 0x7f36a80c0d70 2023-07-29T02:00:42.566 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.572+0000 7f36a57fa700 1 -- 172.21.15.42:0/151515848 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3694003a00 con 0x7f36a80c0d70 2023-07-29T02:00:42.566 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.572+0000 7f36aedac700 1 -- 172.21.15.42:0/151515848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a81ef6d0 con 0x7f36a80c0d70 2023-07-29T02:00:42.566 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.572+0000 7f36aedac700 1 -- 172.21.15.42:0/151515848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a8152720 con 0x7f36a80c0d70 2023-07-29T02:00:42.566 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.573+0000 7f36a57fa700 1 -- 172.21.15.42:0/151515848 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f3694003b60 con 0x7f36a80c0d70 2023-07-29T02:00:42.566 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.573+0000 7f36a57fa700 1 --2- 172.21.15.42:0/151515848 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f368c06a660 0x7f368c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:42.566 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.574+0000 7f36a57fa700 1 -- 172.21.15.42:0/151515848 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3694021070 con 0x7f36a80c0d70 2023-07-29T02:00:42.566 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.574+0000 7f36acb48700 1 --2- 172.21.15.42:0/151515848 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f368c06a660 0x7f368c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:42.567 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.574+0000 7f36acb48700 1 --2- 172.21.15.42:0/151515848 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f368c06a660 0x7f368c06cb10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f369c0099d0 tx=0x7f369c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:42.567 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.578+0000 7f36a57fa700 1 -- 172.21.15.42:0/151515848 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f36940558e0 con 0x7f36a80c0d70 2023-07-29T02:00:42.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.776+0000 7f36aedac700 1 -- 172.21.15.42:0/151515848 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f36a8071ca0 con 0x7f36a80c0d70 2023-07-29T02:00:42.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.776+0000 7f36a57fa700 1 -- 172.21.15.42:0/151515848 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f36940150a0 con 0x7f36a80c0d70 2023-07-29T02:00:42.764 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 8 2023-07-29T02:00:42.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.778+0000 7f36aedac700 1 -- 172.21.15.42:0/151515848 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f368c06a660 msgr2=0x7f368c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:42.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.778+0000 7f36aedac700 1 --2- 172.21.15.42:0/151515848 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f368c06a660 0x7f368c06cb10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f369c0099d0 tx=0x7f369c008040 comp rx=0 tx=0).stop 2023-07-29T02:00:42.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.778+0000 7f36aedac700 1 -- 172.21.15.42:0/151515848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36a80c0d70 msgr2=0x7f36a814bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:42.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.778+0000 7f36aedac700 1 --2- 172.21.15.42:0/151515848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36a80c0d70 0x7f36a814bee0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f36940090b0 tx=0x7f3694004750 comp rx=0 tx=0).stop 2023-07-29T02:00:42.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.778+0000 7f36aedac700 1 -- 172.21.15.42:0/151515848 shutdown_connections 2023-07-29T02:00:42.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.778+0000 7f36aedac700 1 --2- 172.21.15.42:0/151515848 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f368c06a660 0x7f368c06cb10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.778+0000 7f36aedac700 1 --2- 172.21.15.42:0/151515848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36a8150340 0x7f36a81497d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.778+0000 7f36aedac700 1 --2- 172.21.15.42:0/151515848 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f36a80bfeb0 0x7f36a80c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.778+0000 7f36aedac700 1 --2- 172.21.15.42:0/151515848 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36a80c0d70 0x7f36a814bee0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.778+0000 7f36aedac700 1 -- 172.21.15.42:0/151515848 >> 172.21.15.42:0/151515848 conn(0x7f36a80cae90 msgr2=0x7f36a814d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:42.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.778+0000 7f36aedac700 1 -- 172.21.15.42:0/151515848 shutdown_connections 2023-07-29T02:00:42.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.778+0000 7f36aedac700 1 -- 172.21.15.42:0/151515848 wait complete. 2023-07-29T02:00:42.777 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-29T02:00:42.906 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.918+0000 7fcc40a29700 1 Processor -- start 2023-07-29T02:00:42.906 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.918+0000 7fcc40a29700 1 -- start start 2023-07-29T02:00:42.908 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.919+0000 7fcc40a29700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcc3c13ed20 0x7fcc3c156650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:42.908 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.919+0000 7fcc40a29700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc3c071120 0x7fcc3c0c6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:42.908 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.919+0000 7fcc40a29700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcc3c0c6ec0 0x7fcc3c1574f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:42.909 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.919+0000 7fcc40a29700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3c072dc0 con 0x7fcc3c0c6ec0 2023-07-29T02:00:42.909 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.919+0000 7fcc40a29700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3c0c83c0 con 0x7fcc3c13ed20 2023-07-29T02:00:42.909 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.919+0000 7fcc40a29700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c071d10 con 0x7fcc3c071120 2023-07-29T02:00:42.909 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.919+0000 7fcc3ad9d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcc3c0c6ec0 0x7fcc3c1574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:42.909 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.919+0000 7fcc3ad9d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fcc3c0c6ec0 0x7fcc3c1574f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56928/0 (socket says 172.21.15.42:56928) 2023-07-29T02:00:42.910 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.919+0000 7fcc3ad9d700 1 -- 172.21.15.42:0/905316230 learned_addr learned my addr 172.21.15.42:0/905316230 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:42.910 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.920+0000 7fcc39d9b700 1 --2- 172.21.15.42:0/905316230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc3c071120 0x7fcc3c0c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:42.910 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.920+0000 7fcc3a59c700 1 --2- 172.21.15.42:0/905316230 >> v2:172.21.15.144:3300/0 conn(0x7fcc3c13ed20 0x7fcc3c156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:42.910 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.920+0000 7fcc3ad9d700 1 -- 172.21.15.42:0/905316230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc3c071120 msgr2=0x7fcc3c0c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:42.910 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.920+0000 7fcc3ad9d700 1 --2- 172.21.15.42:0/905316230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc3c071120 0x7fcc3c0c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.910 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.920+0000 7fcc3ad9d700 1 -- 172.21.15.42:0/905316230 >> v2:172.21.15.144:3300/0 conn(0x7fcc3c13ed20 msgr2=0x7fcc3c156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:42.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.920+0000 7fcc3ad9d700 1 --2- 172.21.15.42:0/905316230 >> v2:172.21.15.144:3300/0 conn(0x7fcc3c13ed20 0x7fcc3c156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.920+0000 7fcc3ad9d700 1 -- 172.21.15.42:0/905316230 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3c156b90 con 0x7fcc3c0c6ec0 2023-07-29T02:00:42.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.920+0000 7fcc3a59c700 1 --2- 172.21.15.42:0/905316230 >> v2:172.21.15.144:3300/0 conn(0x7fcc3c13ed20 0x7fcc3c156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:42.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.920+0000 7fcc3ad9d700 1 --2- 172.21.15.42:0/905316230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc3c0c6ec0 0x7fcc3c1574f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c070f20 tx=0x7fcc3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b40325a1a54f665 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:42.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.920+0000 7fcc3959a700 1 -- 172.21.15.42:0/905316230 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3400e070 con 0x7fcc3c0c6ec0 2023-07-29T02:00:42.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.920+0000 7fcc3959a700 1 -- 172.21.15.42:0/905316230 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3400b980 con 0x7fcc3c0c6ec0 2023-07-29T02:00:42.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.920+0000 7fcc3959a700 1 -- 172.21.15.42:0/905316230 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3400bd30 con 0x7fcc3c0c6ec0 2023-07-29T02:00:42.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.921+0000 7fcc40a29700 1 -- 172.21.15.42:0/905316230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc3c0c6ec0 msgr2=0x7fcc3c1574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:42.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.921+0000 7fcc40a29700 1 --2- 172.21.15.42:0/905316230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc3c0c6ec0 0x7fcc3c1574f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c070f20 tx=0x7fcc3400b330 comp rx=0 tx=0).stop 2023-07-29T02:00:42.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.921+0000 7fcc40a29700 1 -- 172.21.15.42:0/905316230 shutdown_connections 2023-07-29T02:00:42.913 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.921+0000 7fcc40a29700 1 --2- 172.21.15.42:0/905316230 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc3c0c6ec0 0x7fcc3c1574f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.913 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.921+0000 7fcc40a29700 1 --2- 172.21.15.42:0/905316230 >> v2:172.21.15.144:3300/0 conn(0x7fcc3c13ed20 0x7fcc3c156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.913 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.921+0000 7fcc40a29700 1 --2- 172.21.15.42:0/905316230 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc3c071120 0x7fcc3c0c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.913 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.921+0000 7fcc40a29700 1 -- 172.21.15.42:0/905316230 >> 172.21.15.42:0/905316230 conn(0x7fcc3c0ccc50 msgr2=0x7fcc3c06ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:42.913 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.921+0000 7fcc40a29700 1 -- 172.21.15.42:0/905316230 shutdown_connections 2023-07-29T02:00:42.913 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.921+0000 7fcc40a29700 1 -- 172.21.15.42:0/905316230 wait complete. 2023-07-29T02:00:42.915 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.922+0000 7fcc40a29700 1 Processor -- start 2023-07-29T02:00:42.915 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.922+0000 7fcc40a29700 1 -- start start 2023-07-29T02:00:42.916 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.923+0000 7fcc40a29700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc3c071120 0x7fcc3c0ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:42.916 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.923+0000 7fcc40a29700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc3c0c6ec0 0x7fcc3c0c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:42.916 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.923+0000 7fcc40a29700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc3c13ed20 0x7fcc3c154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:42.916 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.923+0000 7fcc40a29700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c153cc0 con 0x7fcc3c071120 2023-07-29T02:00:42.916 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.923+0000 7fcc40a29700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c1ef460 con 0x7fcc3c0c6ec0 2023-07-29T02:00:42.916 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.923+0000 7fcc40a29700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3c1ee8e0 con 0x7fcc3c13ed20 2023-07-29T02:00:42.916 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.923+0000 7fcc3a59c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc3c071120 0x7fcc3c0ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:42.917 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.923+0000 7fcc3a59c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc3c071120 0x7fcc3c0ca610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56930/0 (socket says 172.21.15.42:56930) 2023-07-29T02:00:42.917 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.923+0000 7fcc3a59c700 1 -- 172.21.15.42:0/1792447950 learned_addr learned my addr 172.21.15.42:0/1792447950 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:42.917 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.923+0000 7fcc39d9b700 1 --2- 172.21.15.42:0/1792447950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc3c0c6ec0 0x7fcc3c0c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:42.917 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.923+0000 7fcc3ad9d700 1 --2- 172.21.15.42:0/1792447950 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc3c13ed20 0x7fcc3c154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:42.917 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.923+0000 7fcc3a59c700 1 -- 172.21.15.42:0/1792447950 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc3c13ed20 msgr2=0x7fcc3c154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:42.917 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.923+0000 7fcc3a59c700 1 --2- 172.21.15.42:0/1792447950 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc3c13ed20 0x7fcc3c154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.917 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.923+0000 7fcc3a59c700 1 -- 172.21.15.42:0/1792447950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc3c0c6ec0 msgr2=0x7fcc3c0c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:42.917 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.923+0000 7fcc3a59c700 1 --2- 172.21.15.42:0/1792447950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc3c0c6ec0 0x7fcc3c0c5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:42.918 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.923+0000 7fcc3a59c700 1 -- 172.21.15.42:0/1792447950 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc34009b30 con 0x7fcc3c071120 2023-07-29T02:00:42.918 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.923+0000 7fcc39d9b700 1 --2- 172.21.15.42:0/1792447950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc3c0c6ec0 0x7fcc3c0c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:42.918 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.923+0000 7fcc3ad9d700 1 --2- 172.21.15.42:0/1792447950 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc3c13ed20 0x7fcc3c154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:42.918 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.923+0000 7fcc3a59c700 1 --2- 172.21.15.42:0/1792447950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc3c071120 0x7fcc3c0ca610 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000e810 tx=0x7fcc3000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:42.918 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.924+0000 7fcc2affd700 1 -- 172.21.15.42:0/1792447950 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3000c020 con 0x7fcc3c071120 2023-07-29T02:00:42.918 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.924+0000 7fcc2affd700 1 -- 172.21.15.42:0/1792447950 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc30004250 con 0x7fcc3c071120 2023-07-29T02:00:42.918 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.924+0000 7fcc2affd700 1 -- 172.21.15.42:0/1792447950 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc300036a0 con 0x7fcc3c071120 2023-07-29T02:00:42.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.924+0000 7fcc40a29700 1 -- 172.21.15.42:0/1792447950 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc3c1eebc0 con 0x7fcc3c071120 2023-07-29T02:00:42.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.924+0000 7fcc40a29700 1 -- 172.21.15.42:0/1792447950 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc3c1ef180 con 0x7fcc3c071120 2023-07-29T02:00:42.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.925+0000 7fcc40a29700 1 -- 172.21.15.42:0/1792447950 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc3c04ea50 con 0x7fcc3c071120 2023-07-29T02:00:42.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.925+0000 7fcc2affd700 1 -- 172.21.15.42:0/1792447950 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fcc30003800 con 0x7fcc3c071120 2023-07-29T02:00:42.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.926+0000 7fcc2affd700 1 --2- 172.21.15.42:0/1792447950 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcc1c06a690 0x7fcc1c06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:42.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.926+0000 7fcc2affd700 1 -- 172.21.15.42:0/1792447950 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcc30088d40 con 0x7fcc3c071120 2023-07-29T02:00:42.920 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.926+0000 7fcc39d9b700 1 --2- 172.21.15.42:0/1792447950 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcc1c06a690 0x7fcc1c06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:42.920 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.926+0000 7fcc39d9b700 1 --2- 172.21.15.42:0/1792447950 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcc1c06a690 0x7fcc1c06cb40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c13ceb0 tx=0x7fcc2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:42.920 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:42.930+0000 7fcc2affd700 1 -- 172.21.15.42:0/1792447950 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fcc30053dc0 con 0x7fcc3c071120 2023-07-29T02:00:43.115 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.128+0000 7fcc40a29700 1 -- 172.21.15.42:0/1792447950 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc3c0c98a0 con 0x7fcc3c071120 2023-07-29T02:00:43.116 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.128+0000 7fcc2affd700 1 -- 172.21.15.42:0/1792447950 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc300573e0 con 0x7fcc3c071120 2023-07-29T02:00:43.116 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2023-07-29T02:00:43.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.130+0000 7fcc40a29700 1 -- 172.21.15.42:0/1792447950 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcc1c06a690 msgr2=0x7fcc1c06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:43.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.130+0000 7fcc40a29700 1 --2- 172.21.15.42:0/1792447950 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcc1c06a690 0x7fcc1c06cb40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c13ceb0 tx=0x7fcc2c008040 comp rx=0 tx=0).stop 2023-07-29T02:00:43.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.130+0000 7fcc40a29700 1 -- 172.21.15.42:0/1792447950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc3c071120 msgr2=0x7fcc3c0ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:43.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.130+0000 7fcc40a29700 1 --2- 172.21.15.42:0/1792447950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc3c071120 0x7fcc3c0ca610 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcc3000e810 tx=0x7fcc3000ebd0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.130+0000 7fcc40a29700 1 -- 172.21.15.42:0/1792447950 shutdown_connections 2023-07-29T02:00:43.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.130+0000 7fcc40a29700 1 --2- 172.21.15.42:0/1792447950 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcc1c06a690 0x7fcc1c06cb40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.130+0000 7fcc40a29700 1 --2- 172.21.15.42:0/1792447950 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcc3c13ed20 0x7fcc3c154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.130+0000 7fcc40a29700 1 --2- 172.21.15.42:0/1792447950 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcc3c071120 0x7fcc3c0ca610 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.130+0000 7fcc40a29700 1 --2- 172.21.15.42:0/1792447950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcc3c0c6ec0 0x7fcc3c0c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.130+0000 7fcc40a29700 1 -- 172.21.15.42:0/1792447950 >> 172.21.15.42:0/1792447950 conn(0x7fcc3c0ccc50 msgr2=0x7fcc3c13d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:43.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.131+0000 7fcc40a29700 1 -- 172.21.15.42:0/1792447950 shutdown_connections 2023-07-29T02:00:43.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.131+0000 7fcc40a29700 1 -- 172.21.15.42:0/1792447950 wait complete. 2023-07-29T02:00:43.130 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-29T02:00:43.258 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.271+0000 7f2f22d2a700 1 Processor -- start 2023-07-29T02:00:43.258 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.271+0000 7f2f22d2a700 1 -- start start 2023-07-29T02:00:43.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.272+0000 7f2f22d2a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2f1c070a70 0x7f2f1c0c5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:43.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.272+0000 7f2f22d2a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f1c0b0b20 0x7f2f1c070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:43.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.272+0000 7f2f22d2a700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f1c0c5f40 con 0x7f2f1c06b860 2023-07-29T02:00:43.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.272+0000 7f2f22d2a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1c071f30 con 0x7f2f1c070a70 2023-07-29T02:00:43.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.272+0000 7f2f22d2a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c071380 con 0x7f2f1c0b0b20 2023-07-29T02:00:43.262 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.272+0000 7f2f212c7700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f2f1c06b860 0x7f2f1c06bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50746/0 (socket says 172.21.15.42:50746) 2023-07-29T02:00:43.262 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.272+0000 7f2f212c7700 1 -- 172.21.15.42:0/3021284959 learned_addr learned my addr 172.21.15.42:0/3021284959 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:43.262 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.272+0000 7f2f20ac6700 1 --2- 172.21.15.42:0/3021284959 >> v2:172.21.15.144:3300/0 conn(0x7f2f1c070a70 0x7f2f1c0c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:43.262 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.272+0000 7f2f1bfff700 1 --2- 172.21.15.42:0/3021284959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f1c0b0b20 0x7f2f1c070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:43.262 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.272+0000 7f2f1b7fe700 1 -- 172.21.15.42:0/3021284959 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728171739 0 0) 0x7f2f1c0c5f40 con 0x7f2f1c06b860 2023-07-29T02:00:43.262 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.272+0000 7f2f1b7fe700 1 -- 172.21.15.42:0/3021284959 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f0c0035b0 con 0x7f2f1c06b860 2023-07-29T02:00:43.262 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.272+0000 7f2f1b7fe700 1 -- 172.21.15.42:0/3021284959 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1381970685 0 0) 0x7f2f0c0035b0 con 0x7f2f1c06b860 2023-07-29T02:00:43.263 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.272+0000 7f2f20ac6700 1 -- 172.21.15.42:0/3021284959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f1c0b0b20 msgr2=0x7f2f1c070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:43.263 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.272+0000 7f2f20ac6700 1 --2- 172.21.15.42:0/3021284959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f1c0b0b20 0x7f2f1c070e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.263 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.272+0000 7f2f20ac6700 1 -- 172.21.15.42:0/3021284959 >> v1:172.21.15.42:6789/0 conn(0x7f2f1c06b860 legacy=0x7f2f1c06bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:43.263 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.272+0000 7f2f20ac6700 1 -- 172.21.15.42:0/3021284959 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c1570a0 con 0x7f2f1c070a70 2023-07-29T02:00:43.263 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.272+0000 7f2f1bfff700 1 --2- 172.21.15.42:0/3021284959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f1c0b0b20 0x7f2f1c070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:00:43.263 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.273+0000 7f2f20ac6700 1 --2- 172.21.15.42:0/3021284959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f1c070a70 0x7f2f1c0c5890 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2f10009870 tx=0x7f2f10009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83e841147a72a046 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:43.263 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.273+0000 7f2f1b7fe700 1 -- 172.21.15.42:0/3021284959 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f140019f0 con 0x7f2f1c070a70 2023-07-29T02:00:43.263 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.273+0000 7f2f1b7fe700 1 -- 172.21.15.42:0/3021284959 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f10004030 con 0x7f2f1c070a70 2023-07-29T02:00:43.264 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.273+0000 7f2f1b7fe700 1 -- 172.21.15.42:0/3021284959 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f100043c0 con 0x7f2f1c070a70 2023-07-29T02:00:43.264 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.273+0000 7f2f22d2a700 1 -- 172.21.15.42:0/3021284959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f1c070a70 msgr2=0x7f2f1c0c5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:43.264 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.273+0000 7f2f22d2a700 1 --2- 172.21.15.42:0/3021284959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f1c070a70 0x7f2f1c0c5890 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2f10009870 tx=0x7f2f10009b80 comp rx=0 tx=0).stop 2023-07-29T02:00:43.264 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.273+0000 7f2f22d2a700 1 -- 172.21.15.42:0/3021284959 shutdown_connections 2023-07-29T02:00:43.264 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.273+0000 7f2f22d2a700 1 --2- 172.21.15.42:0/3021284959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f1c070a70 0x7f2f1c0c5890 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.264 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.273+0000 7f2f22d2a700 1 --2- 172.21.15.42:0/3021284959 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f1c0b0b20 0x7f2f1c070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.264 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.273+0000 7f2f22d2a700 1 -- 172.21.15.42:0/3021284959 >> 172.21.15.42:0/3021284959 conn(0x7f2f1c0cae90 msgr2=0x7f2f1c0cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:43.265 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.273+0000 7f2f22d2a700 1 -- 172.21.15.42:0/3021284959 shutdown_connections 2023-07-29T02:00:43.265 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.273+0000 7f2f22d2a700 1 -- 172.21.15.42:0/3021284959 wait complete. 2023-07-29T02:00:43.267 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.275+0000 7f2f22d2a700 1 Processor -- start 2023-07-29T02:00:43.267 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.275+0000 7f2f22d2a700 1 -- start start 2023-07-29T02:00:43.267 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.275+0000 7f2f22d2a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f1c06b860 0x7f2f1c0aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:43.267 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.275+0000 7f2f22d2a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f1c070a70 0x7f2f1c14f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:43.267 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.275+0000 7f2f22d2a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f1c0b0b20 0x7f2f1c0c15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:43.267 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.275+0000 7f2f22d2a700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c0ae410 con 0x7f2f1c0b0b20 2023-07-29T02:00:43.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.276+0000 7f2f22d2a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c0af870 con 0x7f2f1c06b860 2023-07-29T02:00:43.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.276+0000 7f2f22d2a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1c0afaa0 con 0x7f2f1c070a70 2023-07-29T02:00:43.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.276+0000 7f2f212c7700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f1c0b0b20 0x7f2f1c0c15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:43.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.276+0000 7f2f212c7700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f1c0b0b20 0x7f2f1c0c15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56948/0 (socket says 172.21.15.42:56948) 2023-07-29T02:00:43.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.276+0000 7f2f212c7700 1 -- 172.21.15.42:0/2812619999 learned_addr learned my addr 172.21.15.42:0/2812619999 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:43.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.276+0000 7f2f1bfff700 1 --2- 172.21.15.42:0/2812619999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f1c070a70 0x7f2f1c14f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:43.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.276+0000 7f2f20ac6700 1 --2- 172.21.15.42:0/2812619999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f1c06b860 0x7f2f1c0aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:43.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.276+0000 7f2f212c7700 1 -- 172.21.15.42:0/2812619999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f1c070a70 msgr2=0x7f2f1c14f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:43.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.276+0000 7f2f212c7700 1 --2- 172.21.15.42:0/2812619999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f1c070a70 0x7f2f1c14f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.276+0000 7f2f212c7700 1 -- 172.21.15.42:0/2812619999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f1c06b860 msgr2=0x7f2f1c0aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:43.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.276+0000 7f2f212c7700 1 --2- 172.21.15.42:0/2812619999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f1c06b860 0x7f2f1c0aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.276+0000 7f2f212c7700 1 -- 172.21.15.42:0/2812619999 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f080094a0 con 0x7f2f1c0b0b20 2023-07-29T02:00:43.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.276+0000 7f2f20ac6700 1 --2- 172.21.15.42:0/2812619999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f1c06b860 0x7f2f1c0aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:43.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.276+0000 7f2f212c7700 1 --2- 172.21.15.42:0/2812619999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f1c0b0b20 0x7f2f1c0c15d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2f14001890 tx=0x7f2f1400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:43.270 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.276+0000 7f2f197fa700 1 -- 172.21.15.42:0/2812619999 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1400ad60 con 0x7f2f1c0b0b20 2023-07-29T02:00:43.270 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.276+0000 7f2f197fa700 1 -- 172.21.15.42:0/2812619999 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f140070d0 con 0x7f2f1c0b0b20 2023-07-29T02:00:43.270 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.276+0000 7f2f197fa700 1 -- 172.21.15.42:0/2812619999 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f14007440 con 0x7f2f1c0b0b20 2023-07-29T02:00:43.270 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.276+0000 7f2f22d2a700 1 -- 172.21.15.42:0/2812619999 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f100094a0 con 0x7f2f1c0b0b20 2023-07-29T02:00:43.270 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.276+0000 7f2f22d2a700 1 -- 172.21.15.42:0/2812619999 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1c0b0060 con 0x7f2f1c0b0b20 2023-07-29T02:00:43.270 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.277+0000 7f2f22d2a700 1 -- 172.21.15.42:0/2812619999 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1c06e350 con 0x7f2f1c0b0b20 2023-07-29T02:00:43.270 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.278+0000 7f2f197fa700 1 -- 172.21.15.42:0/2812619999 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f2f140075a0 con 0x7f2f1c0b0b20 2023-07-29T02:00:43.270 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.278+0000 7f2f197fa700 1 --2- 172.21.15.42:0/2812619999 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2f0006a660 0x7f2f0006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.278+0000 7f2f197fa700 1 -- 172.21.15.42:0/2812619999 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2f14088a90 con 0x7f2f1c0b0b20 2023-07-29T02:00:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.278+0000 7f2f20ac6700 1 --2- 172.21.15.42:0/2812619999 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2f0006a660 0x7f2f0006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.279+0000 7f2f20ac6700 1 --2- 172.21.15.42:0/2812619999 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2f0006a660 0x7f2f0006cb10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2f10000c00 tx=0x7f2f10008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:43.271 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.282+0000 7f2f197fa700 1 -- 172.21.15.42:0/2812619999 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f2f14053cf0 con 0x7f2f1c0b0b20 2023-07-29T02:00:43.469 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.481+0000 7f2f22d2a700 1 -- 172.21.15.42:0/2812619999 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2f1c06fb70 con 0x7f2f1c0b0b20 2023-07-29T02:00:43.469 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.482+0000 7f2f197fa700 1 -- 172.21.15.42:0/2812619999 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2f14018020 con 0x7f2f1c0b0b20 2023-07-29T02:00:43.469 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2023-07-29T02:00:43.471 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.483+0000 7f2f22d2a700 1 -- 172.21.15.42:0/2812619999 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2f0006a660 msgr2=0x7f2f0006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:43.471 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.483+0000 7f2f22d2a700 1 --2- 172.21.15.42:0/2812619999 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2f0006a660 0x7f2f0006cb10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2f10000c00 tx=0x7f2f10008030 comp rx=0 tx=0).stop 2023-07-29T02:00:43.471 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.483+0000 7f2f22d2a700 1 -- 172.21.15.42:0/2812619999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f1c0b0b20 msgr2=0x7f2f1c0c15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:43.471 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.483+0000 7f2f22d2a700 1 --2- 172.21.15.42:0/2812619999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f1c0b0b20 0x7f2f1c0c15d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2f14001890 tx=0x7f2f1400a340 comp rx=0 tx=0).stop 2023-07-29T02:00:43.472 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.483+0000 7f2f22d2a700 1 -- 172.21.15.42:0/2812619999 shutdown_connections 2023-07-29T02:00:43.472 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.483+0000 7f2f22d2a700 1 --2- 172.21.15.42:0/2812619999 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2f0006a660 0x7f2f0006cb10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.472 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.483+0000 7f2f22d2a700 1 --2- 172.21.15.42:0/2812619999 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2f1c0b0b20 0x7f2f1c0c15d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.472 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.483+0000 7f2f22d2a700 1 --2- 172.21.15.42:0/2812619999 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f1c06b860 0x7f2f1c0aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.472 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.483+0000 7f2f22d2a700 1 --2- 172.21.15.42:0/2812619999 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2f1c070a70 0x7f2f1c14f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.472 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.483+0000 7f2f22d2a700 1 -- 172.21.15.42:0/2812619999 >> 172.21.15.42:0/2812619999 conn(0x7f2f1c0cae90 msgr2=0x7f2f1c0cb260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:43.473 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.484+0000 7f2f22d2a700 1 -- 172.21.15.42:0/2812619999 shutdown_connections 2023-07-29T02:00:43.473 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.484+0000 7f2f22d2a700 1 -- 172.21.15.42:0/2812619999 wait complete. 2023-07-29T02:00:43.483 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-29T02:00:43.611 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.624+0000 7f2596f33700 1 Processor -- start 2023-07-29T02:00:43.612 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.624+0000 7f2596f33700 1 -- start start 2023-07-29T02:00:43.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.625+0000 7f2596f33700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f25900c8580 0x7f259006f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:43.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.625+0000 7f2596f33700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2590071840 0x7f259006a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:43.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.625+0000 7f2596f33700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f259006c870 con 0x7f25901531a0 2023-07-29T02:00:43.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.625+0000 7f2596f33700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25900c74a0 con 0x7f25900c8580 2023-07-29T02:00:43.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.625+0000 7f2596f33700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f259006fa50 con 0x7f2590071840 2023-07-29T02:00:43.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.625+0000 7f258ffff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f25900c8580 0x7f259006f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:43.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.625+0000 7f2594ccf700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f25901531a0 0x7f259015c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50756/0 (socket says 172.21.15.42:50756) 2023-07-29T02:00:43.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.625+0000 7f2594ccf700 1 -- 172.21.15.42:0/3003129197 learned_addr learned my addr 172.21.15.42:0/3003129197 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:43.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.625+0000 7f25954d0700 1 --2- 172.21.15.42:0/3003129197 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2590071840 0x7f259006a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:43.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.625+0000 7f258ffff700 1 -- 172.21.15.42:0/3003129197 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2590071840 msgr2=0x7f259006a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:43.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.625+0000 7f258ffff700 1 --2- 172.21.15.42:0/3003129197 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2590071840 0x7f259006a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.625+0000 7f258ffff700 1 -- 172.21.15.42:0/3003129197 >> v1:172.21.15.42:6789/0 conn(0x7f25901531a0 legacy=0x7f259015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:43.616 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.625+0000 7f258ffff700 1 -- 172.21.15.42:0/3003129197 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259006d450 con 0x7f25900c8580 2023-07-29T02:00:43.616 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.625+0000 7f258f7fe700 1 -- 172.21.15.42:0/3003129197 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1486747117 0 0) 0x7f259006c870 con 0x7f25901531a0 2023-07-29T02:00:43.616 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.626+0000 7f258ffff700 1 --2- 172.21.15.42:0/3003129197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25900c8580 0x7f259006f510 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f257c009840 tx=0x7f257c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a203503e8b045 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:43.616 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.626+0000 7f258f7fe700 1 -- 172.21.15.42:0/3003129197 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c011830 con 0x7f25900c8580 2023-07-29T02:00:43.616 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.626+0000 7f258f7fe700 1 -- 172.21.15.42:0/3003129197 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257c011990 con 0x7f25900c8580 2023-07-29T02:00:43.616 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.626+0000 7f258f7fe700 1 -- 172.21.15.42:0/3003129197 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c011d20 con 0x7f25900c8580 2023-07-29T02:00:43.616 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.626+0000 7f2596f33700 1 -- 172.21.15.42:0/3003129197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25900c8580 msgr2=0x7f259006f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:43.617 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.626+0000 7f2596f33700 1 --2- 172.21.15.42:0/3003129197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25900c8580 0x7f259006f510 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f257c009840 tx=0x7f257c009b50 comp rx=0 tx=0).stop 2023-07-29T02:00:43.617 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.626+0000 7f2596f33700 1 -- 172.21.15.42:0/3003129197 shutdown_connections 2023-07-29T02:00:43.617 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.626+0000 7f2596f33700 1 --2- 172.21.15.42:0/3003129197 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2590071840 0x7f259006a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.617 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.626+0000 7f2596f33700 1 --2- 172.21.15.42:0/3003129197 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25900c8580 0x7f259006f510 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.617 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.626+0000 7f2596f33700 1 -- 172.21.15.42:0/3003129197 >> 172.21.15.42:0/3003129197 conn(0x7f25900cbf10 msgr2=0x7f25900cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:43.617 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.626+0000 7f2596f33700 1 -- 172.21.15.42:0/3003129197 shutdown_connections 2023-07-29T02:00:43.617 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.626+0000 7f2596f33700 1 -- 172.21.15.42:0/3003129197 wait complete. 2023-07-29T02:00:43.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.627+0000 7f2596f33700 1 Processor -- start 2023-07-29T02:00:43.620 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.628+0000 7f2596f33700 1 -- start start 2023-07-29T02:00:43.620 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.628+0000 7f2596f33700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2590071840 0x7f259014e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:43.620 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.628+0000 7f2596f33700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f25900c8580 0x7f25901553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:43.620 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.628+0000 7f2596f33700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25901531a0 0x7f25901f1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:43.620 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.628+0000 7f2596f33700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f259014deb0 con 0x7f25901531a0 2023-07-29T02:00:43.620 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.628+0000 7f2596f33700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2590149460 con 0x7f2590071840 2023-07-29T02:00:43.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.628+0000 7f2596f33700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2590155120 con 0x7f25900c8580 2023-07-29T02:00:43.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.629+0000 7f25954d0700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25901531a0 0x7f25901f1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:43.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.629+0000 7f25954d0700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25901531a0 0x7f25901f1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56962/0 (socket says 172.21.15.42:56962) 2023-07-29T02:00:43.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.629+0000 7f25954d0700 1 -- 172.21.15.42:0/399583546 learned_addr learned my addr 172.21.15.42:0/399583546 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:43.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.629+0000 7f258ffff700 1 --2- 172.21.15.42:0/399583546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f25900c8580 0x7f25901553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:43.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.629+0000 7f2594ccf700 1 --2- 172.21.15.42:0/399583546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2590071840 0x7f259014e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:43.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.629+0000 7f25954d0700 1 -- 172.21.15.42:0/399583546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f25900c8580 msgr2=0x7f25901553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:43.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.629+0000 7f25954d0700 1 --2- 172.21.15.42:0/399583546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f25900c8580 0x7f25901553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.629+0000 7f25954d0700 1 -- 172.21.15.42:0/399583546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2590071840 msgr2=0x7f259014e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:43.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.629+0000 7f25954d0700 1 --2- 172.21.15.42:0/399583546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2590071840 0x7f259014e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.629+0000 7f25954d0700 1 -- 172.21.15.42:0/399583546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c0094a0 con 0x7f25901531a0 2023-07-29T02:00:43.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.629+0000 7f2594ccf700 1 --2- 172.21.15.42:0/399583546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2590071840 0x7f259014e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:43.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.629+0000 7f25954d0700 1 --2- 172.21.15.42:0/399583546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25901531a0 0x7f25901f1f20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2588007e40 tx=0x7f258800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:43.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.629+0000 7f258d7fa700 1 -- 172.21.15.42:0/399583546 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258800ee40 con 0x7f25901531a0 2023-07-29T02:00:43.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.629+0000 7f258d7fa700 1 -- 172.21.15.42:0/399583546 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2588014420 con 0x7f25901531a0 2023-07-29T02:00:43.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.629+0000 7f2596f33700 1 -- 172.21.15.42:0/399583546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f259014cea0 con 0x7f25901531a0 2023-07-29T02:00:43.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.629+0000 7f258d7fa700 1 -- 172.21.15.42:0/399583546 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25880147d0 con 0x7f25901531a0 2023-07-29T02:00:43.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.629+0000 7f2596f33700 1 -- 172.21.15.42:0/399583546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f259014d0f0 con 0x7f25901531a0 2023-07-29T02:00:43.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.630+0000 7f2596f33700 1 -- 172.21.15.42:0/399583546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f259004ea50 con 0x7f25901531a0 2023-07-29T02:00:43.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.631+0000 7f258d7fa700 1 -- 172.21.15.42:0/399583546 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f2588014930 con 0x7f25901531a0 2023-07-29T02:00:43.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.631+0000 7f258d7fa700 1 --2- 172.21.15.42:0/399583546 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f257406a660 0x7f257406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:43.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.631+0000 7f258d7fa700 1 -- 172.21.15.42:0/399583546 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2588089610 con 0x7f25901531a0 2023-07-29T02:00:43.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.631+0000 7f2594ccf700 1 --2- 172.21.15.42:0/399583546 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f257406a660 0x7f257406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:43.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.632+0000 7f2594ccf700 1 --2- 172.21.15.42:0/399583546 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f257406a660 0x7f257406cb10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2584007fd0 tx=0x7f2584009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:43.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.635+0000 7f258d7fa700 1 -- 172.21.15.42:0/399583546 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f2588054690 con 0x7f25901531a0 2023-07-29T02:00:43.821 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.834+0000 7f2596f33700 1 -- 172.21.15.42:0/399583546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f25901568f0 con 0x7f25901531a0 2023-07-29T02:00:43.822 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.834+0000 7f258d7fa700 1 -- 172.21.15.42:0/399583546 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2588057cb0 con 0x7f25901531a0 2023-07-29T02:00:43.822 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2023-07-29T02:00:43.824 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.836+0000 7f2596f33700 1 -- 172.21.15.42:0/399583546 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f257406a660 msgr2=0x7f257406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:43.824 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.836+0000 7f2596f33700 1 --2- 172.21.15.42:0/399583546 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f257406a660 0x7f257406cb10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2584007fd0 tx=0x7f2584009040 comp rx=0 tx=0).stop 2023-07-29T02:00:43.824 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.836+0000 7f2596f33700 1 -- 172.21.15.42:0/399583546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25901531a0 msgr2=0x7f25901f1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:43.824 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.836+0000 7f2596f33700 1 --2- 172.21.15.42:0/399583546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25901531a0 0x7f25901f1f20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2588007e40 tx=0x7f258800e3c0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.824 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.836+0000 7f2596f33700 1 -- 172.21.15.42:0/399583546 shutdown_connections 2023-07-29T02:00:43.824 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.836+0000 7f2596f33700 1 --2- 172.21.15.42:0/399583546 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f257406a660 0x7f257406cb10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.825 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.836+0000 7f2596f33700 1 --2- 172.21.15.42:0/399583546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f25901531a0 0x7f25901f1f20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.825 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.836+0000 7f2596f33700 1 --2- 172.21.15.42:0/399583546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2590071840 0x7f259014e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.825 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.836+0000 7f2596f33700 1 --2- 172.21.15.42:0/399583546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f25900c8580 0x7f25901553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.825 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.836+0000 7f2596f33700 1 -- 172.21.15.42:0/399583546 >> 172.21.15.42:0/399583546 conn(0x7f25900cbf10 msgr2=0x7f25900c8970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:43.825 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.836+0000 7f2596f33700 1 -- 172.21.15.42:0/399583546 shutdown_connections 2023-07-29T02:00:43.825 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.837+0000 7f2596f33700 1 -- 172.21.15.42:0/399583546 wait complete. 2023-07-29T02:00:43.836 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-29T02:00:43.963 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.976+0000 7f24c50da700 1 Processor -- start 2023-07-29T02:00:43.964 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.976+0000 7f24c50da700 1 -- start start 2023-07-29T02:00:43.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.977+0000 7f24c50da700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f24c01531a0 0x7f24c006f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:43.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.977+0000 7f24c50da700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f24c0071840 0x7f24c006a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:43.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.977+0000 7f24c50da700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c006c870 con 0x7f24c00c8580 2023-07-29T02:00:43.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.977+0000 7f24c50da700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c00c74a0 con 0x7f24c01531a0 2023-07-29T02:00:43.967 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.977+0000 7f24c50da700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c006fa50 con 0x7f24c0071840 2023-07-29T02:00:43.967 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.977+0000 7f24bed9d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f24c01531a0 0x7f24c006f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:43.967 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.977+0000 7f24be59c700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f24c00c8580 0x7f24c015c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50770/0 (socket says 172.21.15.42:50770) 2023-07-29T02:00:43.967 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.977+0000 7f24be59c700 1 -- 172.21.15.42:0/3962473429 learned_addr learned my addr 172.21.15.42:0/3962473429 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:43.967 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.977+0000 7f24bf59e700 1 --2- 172.21.15.42:0/3962473429 >> v2:172.21.15.144:3300/0 conn(0x7f24c0071840 0x7f24c006a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:43.967 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.978+0000 7f24bed9d700 1 -- 172.21.15.42:0/3962473429 >> v2:172.21.15.144:3300/0 conn(0x7f24c0071840 msgr2=0x7f24c006a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:43.968 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.978+0000 7f24bed9d700 1 --2- 172.21.15.42:0/3962473429 >> v2:172.21.15.144:3300/0 conn(0x7f24c0071840 0x7f24c006a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.968 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.978+0000 7f24bed9d700 1 -- 172.21.15.42:0/3962473429 >> v1:172.21.15.42:6789/0 conn(0x7f24c00c8580 legacy=0x7f24c015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:43.968 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.978+0000 7f24bed9d700 1 -- 172.21.15.42:0/3962473429 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c006d450 con 0x7f24c01531a0 2023-07-29T02:00:43.968 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.978+0000 7f24bdd9b700 1 -- 172.21.15.42:0/3962473429 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973813775 0 0) 0x7f24c006c870 con 0x7f24c00c8580 2023-07-29T02:00:43.968 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.978+0000 7f24bf59e700 1 --2- 172.21.15.42:0/3962473429 >> v2:172.21.15.144:3300/0 conn(0x7f24c0071840 0x7f24c006a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:43.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.978+0000 7f24bed9d700 1 --2- 172.21.15.42:0/3962473429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24c01531a0 0x7f24c006f510 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f24c00b1bc0 tx=0x7f24b4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956bdec3e42f1578 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:43.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.978+0000 7f24bdd9b700 1 -- 172.21.15.42:0/3962473429 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b4011830 con 0x7f24c01531a0 2023-07-29T02:00:43.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.978+0000 7f24bdd9b700 1 -- 172.21.15.42:0/3962473429 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b4011990 con 0x7f24c01531a0 2023-07-29T02:00:43.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.978+0000 7f24bdd9b700 1 -- 172.21.15.42:0/3962473429 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b4011d20 con 0x7f24c01531a0 2023-07-29T02:00:43.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.978+0000 7f24c50da700 1 -- 172.21.15.42:0/3962473429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24c01531a0 msgr2=0x7f24c006f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:43.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.978+0000 7f24c50da700 1 --2- 172.21.15.42:0/3962473429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24c01531a0 0x7f24c006f510 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f24c00b1bc0 tx=0x7f24b4009b20 comp rx=0 tx=0).stop 2023-07-29T02:00:43.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.978+0000 7f24c50da700 1 -- 172.21.15.42:0/3962473429 shutdown_connections 2023-07-29T02:00:43.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.978+0000 7f24c50da700 1 --2- 172.21.15.42:0/3962473429 >> v2:172.21.15.144:3300/0 conn(0x7f24c0071840 0x7f24c006a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.978+0000 7f24c50da700 1 --2- 172.21.15.42:0/3962473429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24c01531a0 0x7f24c006f510 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.978+0000 7f24c50da700 1 -- 172.21.15.42:0/3962473429 >> 172.21.15.42:0/3962473429 conn(0x7f24c00cbf10 msgr2=0x7f24c00cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:43.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.978+0000 7f24c50da700 1 -- 172.21.15.42:0/3962473429 shutdown_connections 2023-07-29T02:00:43.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.979+0000 7f24c50da700 1 -- 172.21.15.42:0/3962473429 wait complete. 2023-07-29T02:00:43.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.980+0000 7f24c50da700 1 Processor -- start 2023-07-29T02:00:43.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.980+0000 7f24c50da700 1 -- start start 2023-07-29T02:00:43.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.981+0000 7f24c50da700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24c0071840 0x7f24c0148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:43.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.981+0000 7f24c50da700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24c00c8580 0x7f24c01eed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:43.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.981+0000 7f24c50da700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24c01531a0 0x7f24c01ef240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:43.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.981+0000 7f24c50da700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c0154380 con 0x7f24c01531a0 2023-07-29T02:00:43.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.981+0000 7f24c50da700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c0153b20 con 0x7f24c00c8580 2023-07-29T02:00:43.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.981+0000 7f24c50da700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c01ee850 con 0x7f24c0071840 2023-07-29T02:00:43.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.981+0000 7f24bf59e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24c01531a0 0x7f24c01ef240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:43.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.981+0000 7f24bf59e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24c01531a0 0x7f24c01ef240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56976/0 (socket says 172.21.15.42:56976) 2023-07-29T02:00:43.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.981+0000 7f24bf59e700 1 -- 172.21.15.42:0/3596440880 learned_addr learned my addr 172.21.15.42:0/3596440880 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:43.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.981+0000 7f24bed9d700 1 --2- 172.21.15.42:0/3596440880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24c0071840 0x7f24c0148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:43.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.981+0000 7f24be59c700 1 --2- 172.21.15.42:0/3596440880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24c00c8580 0x7f24c01eed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:43.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.981+0000 7f24bf59e700 1 -- 172.21.15.42:0/3596440880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24c0071840 msgr2=0x7f24c0148eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:43.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.981+0000 7f24bf59e700 1 --2- 172.21.15.42:0/3596440880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24c0071840 0x7f24c0148eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.981+0000 7f24bf59e700 1 -- 172.21.15.42:0/3596440880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24c00c8580 msgr2=0x7f24c01eed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:43.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.981+0000 7f24bf59e700 1 --2- 172.21.15.42:0/3596440880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24c00c8580 0x7f24c01eed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:43.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.981+0000 7f24bf59e700 1 -- 172.21.15.42:0/3596440880 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b40094a0 con 0x7f24c01531a0 2023-07-29T02:00:43.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.981+0000 7f24bf59e700 1 --2- 172.21.15.42:0/3596440880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24c01531a0 0x7f24c01ef240 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f24b8007ef0 tx=0x7f24b800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:43.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.981+0000 7f24a77fe700 1 -- 172.21.15.42:0/3596440880 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b800dd80 con 0x7f24c01531a0 2023-07-29T02:00:43.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.982+0000 7f24a77fe700 1 -- 172.21.15.42:0/3596440880 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b800f040 con 0x7f24c01531a0 2023-07-29T02:00:43.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.982+0000 7f24c50da700 1 -- 172.21.15.42:0/3596440880 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c01e5160 con 0x7f24c01531a0 2023-07-29T02:00:43.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.982+0000 7f24a77fe700 1 -- 172.21.15.42:0/3596440880 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b8003c60 con 0x7f24c01531a0 2023-07-29T02:00:43.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.982+0000 7f24c50da700 1 -- 172.21.15.42:0/3596440880 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c01e2450 con 0x7f24c01531a0 2023-07-29T02:00:43.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.983+0000 7f24c50da700 1 -- 172.21.15.42:0/3596440880 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c01ee9c0 con 0x7f24c01531a0 2023-07-29T02:00:43.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.983+0000 7f24a77fe700 1 -- 172.21.15.42:0/3596440880 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f24b8004030 con 0x7f24c01531a0 2023-07-29T02:00:43.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.983+0000 7f24a77fe700 1 --2- 172.21.15.42:0/3596440880 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f24ac06a690 0x7f24ac06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:43.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.983+0000 7f24a77fe700 1 -- 172.21.15.42:0/3596440880 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f24b8088e60 con 0x7f24c01531a0 2023-07-29T02:00:43.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.984+0000 7f24bed9d700 1 --2- 172.21.15.42:0/3596440880 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f24ac06a690 0x7f24ac06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:43.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.984+0000 7f24bed9d700 1 --2- 172.21.15.42:0/3596440880 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f24ac06a690 0x7f24ac06cb40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f24b40090b0 tx=0x7f24b401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:43.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:43.988+0000 7f24a77fe700 1 -- 172.21.15.42:0/3596440880 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f24b8053ed0 con 0x7f24c01531a0 2023-07-29T02:00:44.173 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.185+0000 7f24c50da700 1 -- 172.21.15.42:0/3596440880 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f24c004ea50 con 0x7f24c01531a0 2023-07-29T02:00:44.173 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.186+0000 7f24a77fe700 1 -- 172.21.15.42:0/3596440880 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f24b80574f0 con 0x7f24c01531a0 2023-07-29T02:00:44.174 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2023-07-29T02:00:44.175 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.188+0000 7f24c50da700 1 -- 172.21.15.42:0/3596440880 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f24ac06a690 msgr2=0x7f24ac06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:44.175 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.188+0000 7f24c50da700 1 --2- 172.21.15.42:0/3596440880 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f24ac06a690 0x7f24ac06cb40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f24b40090b0 tx=0x7f24b401c040 comp rx=0 tx=0).stop 2023-07-29T02:00:44.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.188+0000 7f24c50da700 1 -- 172.21.15.42:0/3596440880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24c01531a0 msgr2=0x7f24c01ef240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:44.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.188+0000 7f24c50da700 1 --2- 172.21.15.42:0/3596440880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24c01531a0 0x7f24c01ef240 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f24b8007ef0 tx=0x7f24b800d3b0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.188+0000 7f24c50da700 1 -- 172.21.15.42:0/3596440880 shutdown_connections 2023-07-29T02:00:44.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.188+0000 7f24c50da700 1 --2- 172.21.15.42:0/3596440880 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f24ac06a690 0x7f24ac06cb40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.188+0000 7f24c50da700 1 --2- 172.21.15.42:0/3596440880 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f24c01531a0 0x7f24c01ef240 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.188+0000 7f24c50da700 1 --2- 172.21.15.42:0/3596440880 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f24c0071840 0x7f24c0148eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.188+0000 7f24c50da700 1 --2- 172.21.15.42:0/3596440880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f24c00c8580 0x7f24c01eed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.188+0000 7f24c50da700 1 -- 172.21.15.42:0/3596440880 >> 172.21.15.42:0/3596440880 conn(0x7f24c00cbf10 msgr2=0x7f24c014f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:44.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.188+0000 7f24c50da700 1 -- 172.21.15.42:0/3596440880 shutdown_connections 2023-07-29T02:00:44.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.188+0000 7f24c50da700 1 -- 172.21.15.42:0/3596440880 wait complete. 2023-07-29T02:00:44.187 INFO:tasks.mds_thrash:mds thrasher using random seed: 1690596044 2023-07-29T02:00:44.188 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T02:00:44.313 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.326+0000 7f31970f4700 1 Processor -- start 2023-07-29T02:00:44.313 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.326+0000 7f31970f4700 1 -- start start 2023-07-29T02:00:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.326+0000 7f31970f4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31901567d0 0x7f3190159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.326+0000 7f31970f4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f31900c7210 0x7f319006cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:44.315 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.326+0000 7f31970f4700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31900c7700 con 0x7f3190159e90 2023-07-29T02:00:44.316 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.326+0000 7f31970f4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319006b160 con 0x7f31900c7210 2023-07-29T02:00:44.316 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.326+0000 7f31970f4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3190159170 con 0x7f31901567d0 2023-07-29T02:00:44.316 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.327+0000 7f3195691700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f3190159e90 0x7f319015c6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50788/0 (socket says 172.21.15.42:50788) 2023-07-29T02:00:44.316 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.327+0000 7f3195691700 1 -- 172.21.15.42:0/787888718 learned_addr learned my addr 172.21.15.42:0/787888718 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:44.316 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.327+0000 7f3194e90700 1 --2- 172.21.15.42:0/787888718 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31901567d0 0x7f3190159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:44.316 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.327+0000 7f318ffff700 1 --2- 172.21.15.42:0/787888718 >> v2:172.21.15.144:3300/0 conn(0x7f31900c7210 0x7f319006cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:44.316 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.327+0000 7f318f7fe700 1 -- 172.21.15.42:0/787888718 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339071918 0 0) 0x7f31900c7700 con 0x7f3190159e90 2023-07-29T02:00:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.327+0000 7f318f7fe700 1 -- 172.21.15.42:0/787888718 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31800035b0 con 0x7f3190159e90 2023-07-29T02:00:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.327+0000 7f318ffff700 1 -- 172.21.15.42:0/787888718 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31901567d0 msgr2=0x7f3190159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.327+0000 7f318ffff700 1 --2- 172.21.15.42:0/787888718 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31901567d0 0x7f3190159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.327+0000 7f318ffff700 1 -- 172.21.15.42:0/787888718 >> v1:172.21.15.42:6789/0 conn(0x7f3190159e90 legacy=0x7f319015c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.327+0000 7f318ffff700 1 -- 172.21.15.42:0/787888718 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3190156ba0 con 0x7f31900c7210 2023-07-29T02:00:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.327+0000 7f3194e90700 1 --2- 172.21.15.42:0/787888718 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31901567d0 0x7f3190159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:00:44.317 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.327+0000 7f318ffff700 1 --2- 172.21.15.42:0/787888718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31900c7210 0x7f319006cd10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f317c009840 tx=0x7f317c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56f782c3cb777876 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.327+0000 7f318f7fe700 1 -- 172.21.15.42:0/787888718 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c011830 con 0x7f31900c7210 2023-07-29T02:00:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.327+0000 7f318f7fe700 1 -- 172.21.15.42:0/787888718 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c011990 con 0x7f31900c7210 2023-07-29T02:00:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.327+0000 7f318f7fe700 1 -- 172.21.15.42:0/787888718 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c011d00 con 0x7f31900c7210 2023-07-29T02:00:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.328+0000 7f31970f4700 1 -- 172.21.15.42:0/787888718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31900c7210 msgr2=0x7f319006cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.328+0000 7f31970f4700 1 --2- 172.21.15.42:0/787888718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31900c7210 0x7f319006cd10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f317c009840 tx=0x7f317c009b50 comp rx=0 tx=0).stop 2023-07-29T02:00:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.328+0000 7f31970f4700 1 -- 172.21.15.42:0/787888718 shutdown_connections 2023-07-29T02:00:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.328+0000 7f31970f4700 1 --2- 172.21.15.42:0/787888718 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f31901567d0 0x7f3190159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.318 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.328+0000 7f31970f4700 1 --2- 172.21.15.42:0/787888718 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31900c7210 0x7f319006cd10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.328+0000 7f31970f4700 1 -- 172.21.15.42:0/787888718 >> 172.21.15.42:0/787888718 conn(0x7f31900c8970 msgr2=0x7f31900c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.328+0000 7f31970f4700 1 -- 172.21.15.42:0/787888718 shutdown_connections 2023-07-29T02:00:44.319 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.328+0000 7f31970f4700 1 -- 172.21.15.42:0/787888718 wait complete. 2023-07-29T02:00:44.321 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.329+0000 7f31970f4700 1 Processor -- start 2023-07-29T02:00:44.321 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.329+0000 7f31970f4700 1 -- start start 2023-07-29T02:00:44.321 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.330+0000 7f31970f4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31900c7210 0x7f319015b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.330+0000 7f31970f4700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31901567d0 0x7f31901eec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.330+0000 7f31970f4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3190159e90 0x7f31901ef140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.330+0000 7f31970f4700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319015aaa0 con 0x7f31901567d0 2023-07-29T02:00:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.330+0000 7f31970f4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319015ad40 con 0x7f31900c7210 2023-07-29T02:00:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.330+0000 7f31970f4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319014cf60 con 0x7f3190159e90 2023-07-29T02:00:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.330+0000 7f318ffff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31901567d0 0x7f31901eec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:44.322 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.330+0000 7f318ffff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31901567d0 0x7f31901eec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:56988/0 (socket says 172.21.15.42:56988) 2023-07-29T02:00:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.330+0000 7f318ffff700 1 -- 172.21.15.42:0/2035180960 learned_addr learned my addr 172.21.15.42:0/2035180960 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.330+0000 7f3195691700 1 --2- 172.21.15.42:0/2035180960 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3190159e90 0x7f31901ef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.330+0000 7f3194e90700 1 --2- 172.21.15.42:0/2035180960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31900c7210 0x7f319015b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.331+0000 7f318ffff700 1 -- 172.21.15.42:0/2035180960 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3190159e90 msgr2=0x7f31901ef140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.331+0000 7f318ffff700 1 --2- 172.21.15.42:0/2035180960 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3190159e90 0x7f31901ef140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.323 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.331+0000 7f318ffff700 1 -- 172.21.15.42:0/2035180960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31900c7210 msgr2=0x7f319015b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.331+0000 7f318ffff700 1 --2- 172.21.15.42:0/2035180960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31900c7210 0x7f319015b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.331+0000 7f318ffff700 1 -- 172.21.15.42:0/2035180960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31840094a0 con 0x7f31901567d0 2023-07-29T02:00:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.331+0000 7f3195691700 1 --2- 172.21.15.42:0/2035180960 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3190159e90 0x7f31901ef140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.331+0000 7f318ffff700 1 --2- 172.21.15.42:0/2035180960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31901567d0 0x7f31901eec00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f317c0090b0 tx=0x7f317c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.331+0000 7f318d7fa700 1 -- 172.21.15.42:0/2035180960 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c0045d0 con 0x7f31901567d0 2023-07-29T02:00:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.331+0000 7f318d7fa700 1 -- 172.21.15.42:0/2035180960 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f317c01f070 con 0x7f31901567d0 2023-07-29T02:00:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.331+0000 7f318d7fa700 1 -- 172.21.15.42:0/2035180960 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f317c0038a0 con 0x7f31901567d0 2023-07-29T02:00:44.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.331+0000 7f31970f4700 1 -- 172.21.15.42:0/2035180960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317c0094a0 con 0x7f31901567d0 2023-07-29T02:00:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.331+0000 7f31970f4700 1 -- 172.21.15.42:0/2035180960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319015a6e0 con 0x7f31901567d0 2023-07-29T02:00:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.332+0000 7f31970f4700 1 -- 172.21.15.42:0/2035180960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3190074740 con 0x7f31901567d0 2023-07-29T02:00:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.332+0000 7f318d7fa700 1 -- 172.21.15.42:0/2035180960 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f317c003a00 con 0x7f31901567d0 2023-07-29T02:00:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.333+0000 7f318d7fa700 1 --2- 172.21.15.42:0/2035180960 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f317406a690 0x7f317406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.333+0000 7f318d7fa700 1 -- 172.21.15.42:0/2035180960 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f317c021070 con 0x7f31901567d0 2023-07-29T02:00:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.333+0000 7f3194e90700 1 --2- 172.21.15.42:0/2035180960 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f317406a690 0x7f317406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:44.325 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.333+0000 7f3194e90700 1 --2- 172.21.15.42:0/2035180960 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f317406a690 0x7f317406cb40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3184009c20 tx=0x7f3184008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:44.326 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.337+0000 7f318d7fa700 1 -- 172.21.15.42:0/2035180960 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f317c055900 con 0x7f31901567d0 2023-07-29T02:00:44.528 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.541+0000 7f31970f4700 1 -- 172.21.15.42:0/2035180960 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f319004ea50 con 0x7f31901567d0 2023-07-29T02:00:44.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.543+0000 7f318d7fa700 1 -- 172.21.15.42:0/2035180960 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19690 (secure 0 0 0) 0x7f317c003cb0 con 0x7f31901567d0 2023-07-29T02:00:44.530 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:44.531 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T02:00:02.394460+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T01:59:55.827461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T01:59:56.924040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-29T01:59:59.996470+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T02:00:44.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.545+0000 7f31970f4700 1 -- 172.21.15.42:0/2035180960 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f317406a690 msgr2=0x7f317406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:44.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.545+0000 7f31970f4700 1 --2- 172.21.15.42:0/2035180960 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f317406a690 0x7f317406cb40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3184009c20 tx=0x7f3184008040 comp rx=0 tx=0).stop 2023-07-29T02:00:44.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.545+0000 7f31970f4700 1 -- 172.21.15.42:0/2035180960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31901567d0 msgr2=0x7f31901eec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:44.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.545+0000 7f31970f4700 1 --2- 172.21.15.42:0/2035180960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31901567d0 0x7f31901eec00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f317c0090b0 tx=0x7f317c004750 comp rx=0 tx=0).stop 2023-07-29T02:00:44.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.545+0000 7f31970f4700 1 -- 172.21.15.42:0/2035180960 shutdown_connections 2023-07-29T02:00:44.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.545+0000 7f31970f4700 1 --2- 172.21.15.42:0/2035180960 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f317406a690 0x7f317406cb40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.545+0000 7f31970f4700 1 --2- 172.21.15.42:0/2035180960 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3190159e90 0x7f31901ef140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.545+0000 7f31970f4700 1 --2- 172.21.15.42:0/2035180960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31900c7210 0x7f319015b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.545+0000 7f31970f4700 1 --2- 172.21.15.42:0/2035180960 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f31901567d0 0x7f31901eec00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.545+0000 7f31970f4700 1 -- 172.21.15.42:0/2035180960 >> 172.21.15.42:0/2035180960 conn(0x7f31900c8970 msgr2=0x7f3190153250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:44.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.545+0000 7f31970f4700 1 -- 172.21.15.42:0/2035180960 shutdown_connections 2023-07-29T02:00:44.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.545+0000 7f31970f4700 1 -- 172.21.15.42:0/2035180960 wait complete. 2023-07-29T02:00:44.545 INFO:tasks.mds_thrash.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-29T01:59:50.906228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-29T01:59:51.290583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T01:59:55.827461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T01:59:56.924040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-29T01:59:59.996470+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-29T02:00:44.546 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-29T02:00:44.675 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.687+0000 7f112724e700 1 Processor -- start 2023-07-29T02:00:44.675 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.688+0000 7f112724e700 1 -- start start 2023-07-29T02:00:44.676 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.688+0000 7f112724e700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f11200b4250 0x7f112006b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:44.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.688+0000 7f112724e700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11201598a0 con 0x7f1120159d30 2023-07-29T02:00:44.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.688+0000 7f112724e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f112006c0c0 con 0x7f11200c6190 2023-07-29T02:00:44.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.688+0000 7f112724e700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f112006c680 con 0x7f11200b4250 2023-07-29T02:00:44.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.688+0000 7f1124fea700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f11200b4250 0x7f112006b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:44.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.688+0000 7f11257eb700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f1120159d30 0x7f11201639a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50802/0 (socket says 172.21.15.42:50802) 2023-07-29T02:00:44.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.688+0000 7f11257eb700 1 -- 172.21.15.42:0/1962718400 learned_addr learned my addr 172.21.15.42:0/1962718400 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:44.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.689+0000 7f1124fea700 1 -- 172.21.15.42:0/1962718400 >> v1:172.21.15.144:6789/0 conn(0x7f11200c6190 legacy=0x7f11200c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:44.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.689+0000 7f1124fea700 1 -- 172.21.15.42:0/1962718400 >> v1:172.21.15.42:6789/0 conn(0x7f1120159d30 legacy=0x7f11201639a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:44.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.689+0000 7f1124fea700 1 -- 172.21.15.42:0/1962718400 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112006c3a0 con 0x7f11200b4250 2023-07-29T02:00:44.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.689+0000 7f111f7fe700 1 -- 172.21.15.42:0/1962718400 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421502181 0 0) 0x7f11201598a0 con 0x7f1120159d30 2023-07-29T02:00:44.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.689+0000 7f1124fea700 1 --2- 172.21.15.42:0/1962718400 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11200b4250 0x7f112006b980 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1118009d90 tx=0x7f111800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2220db912ddb5138 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:44.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.689+0000 7f111f7fe700 1 -- 172.21.15.42:0/1962718400 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111800e070 con 0x7f11200b4250 2023-07-29T02:00:44.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.689+0000 7f111f7fe700 1 -- 172.21.15.42:0/1962718400 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111800bbd0 con 0x7f11200b4250 2023-07-29T02:00:44.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.689+0000 7f111f7fe700 1 -- 172.21.15.42:0/1962718400 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1118012430 con 0x7f11200b4250 2023-07-29T02:00:44.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.690+0000 7f112724e700 1 -- 172.21.15.42:0/1962718400 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11200b4250 msgr2=0x7f112006b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:44.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.690+0000 7f112724e700 1 --2- 172.21.15.42:0/1962718400 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11200b4250 0x7f112006b980 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1118009d90 tx=0x7f111800b330 comp rx=0 tx=0).stop 2023-07-29T02:00:44.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.690+0000 7f112724e700 1 -- 172.21.15.42:0/1962718400 shutdown_connections 2023-07-29T02:00:44.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.690+0000 7f112724e700 1 --2- 172.21.15.42:0/1962718400 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11200b4250 0x7f112006b980 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.690+0000 7f112724e700 1 -- 172.21.15.42:0/1962718400 >> 172.21.15.42:0/1962718400 conn(0x7f112006ca30 msgr2=0x7f112006ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:44.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.690+0000 7f112724e700 1 -- 172.21.15.42:0/1962718400 shutdown_connections 2023-07-29T02:00:44.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.690+0000 7f112724e700 1 -- 172.21.15.42:0/1962718400 wait complete. 2023-07-29T02:00:44.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.691+0000 7f112724e700 1 Processor -- start 2023-07-29T02:00:44.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.691+0000 7f112724e700 1 -- start start 2023-07-29T02:00:44.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.692+0000 7f112724e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11200b4250 0x7f11200cf660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:44.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.692+0000 7f112724e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11200c6190 0x7f11200ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:44.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.692+0000 7f112724e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1120159d30 0x7f11201539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:44.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.692+0000 7f112724e700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11200cfc50 con 0x7f11200c6190 2023-07-29T02:00:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.692+0000 7f112724e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11200cff10 con 0x7f11200b4250 2023-07-29T02:00:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.692+0000 7f112724e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11200c8b10 con 0x7f1120159d30 2023-07-29T02:00:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.692+0000 7f111ffff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11200c6190 0x7f11200ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.692+0000 7f111ffff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11200c6190 0x7f11200ceab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57002/0 (socket says 172.21.15.42:57002) 2023-07-29T02:00:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.692+0000 7f111ffff700 1 -- 172.21.15.42:0/3853711715 learned_addr learned my addr 172.21.15.42:0/3853711715 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.692+0000 7f11257eb700 1 --2- 172.21.15.42:0/3853711715 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1120159d30 0x7f11201539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:44.683 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.692+0000 7f1124fea700 1 --2- 172.21.15.42:0/3853711715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11200b4250 0x7f11200cf660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:44.684 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.692+0000 7f111ffff700 1 -- 172.21.15.42:0/3853711715 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1120159d30 msgr2=0x7f11201539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:44.684 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.692+0000 7f111ffff700 1 --2- 172.21.15.42:0/3853711715 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1120159d30 0x7f11201539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.684 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.692+0000 7f111ffff700 1 -- 172.21.15.42:0/3853711715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11200b4250 msgr2=0x7f11200cf660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:44.684 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.692+0000 7f111ffff700 1 --2- 172.21.15.42:0/3853711715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11200b4250 0x7f11200cf660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.684 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.692+0000 7f111ffff700 1 -- 172.21.15.42:0/3853711715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1118009a70 con 0x7f11200c6190 2023-07-29T02:00:44.684 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.692+0000 7f111ffff700 1 --2- 172.21.15.42:0/3853711715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11200c6190 0x7f11200ceab0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f110800c4b0 tx=0x7f110800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:44.684 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.693+0000 7f111d7fa700 1 -- 172.21.15.42:0/3853711715 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11080052d0 con 0x7f11200c6190 2023-07-29T02:00:44.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.693+0000 7f111d7fa700 1 -- 172.21.15.42:0/3853711715 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1108005430 con 0x7f11200c6190 2023-07-29T02:00:44.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.693+0000 7f111d7fa700 1 -- 172.21.15.42:0/3853711715 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11080038c0 con 0x7f11200c6190 2023-07-29T02:00:44.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.693+0000 7f112724e700 1 -- 172.21.15.42:0/3853711715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11200c8df0 con 0x7f11200c6190 2023-07-29T02:00:44.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.693+0000 7f112724e700 1 -- 172.21.15.42:0/3853711715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11200c93b0 con 0x7f11200c6190 2023-07-29T02:00:44.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.694+0000 7f112724e700 1 -- 172.21.15.42:0/3853711715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11200c95d0 con 0x7f11200c6190 2023-07-29T02:00:44.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.694+0000 7f111d7fa700 1 -- 172.21.15.42:0/3853711715 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f1108003a20 con 0x7f11200c6190 2023-07-29T02:00:44.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.694+0000 7f111d7fa700 1 --2- 172.21.15.42:0/3853711715 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f110006a660 0x7f110006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:44.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.695+0000 7f111d7fa700 1 -- 172.21.15.42:0/3853711715 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1108088300 con 0x7f11200c6190 2023-07-29T02:00:44.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.695+0000 7f1124fea700 1 --2- 172.21.15.42:0/3853711715 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f110006a660 0x7f110006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:44.687 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.695+0000 7f1124fea700 1 --2- 172.21.15.42:0/3853711715 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f110006a660 0x7f110006cb10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1118000f80 tx=0x7f1118011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:44.687 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.699+0000 7f111d7fa700 1 -- 172.21.15.42:0/3853711715 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f1108053380 con 0x7f11200c6190 2023-07-29T02:00:44.885 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.898+0000 7f112724e700 1 -- 172.21.15.42:0/3853711715 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f112006ce00 con 0x7f11200c6190 2023-07-29T02:00:44.886 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.898+0000 7f111d7fa700 1 -- 172.21.15.42:0/3853711715 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1108017020 con 0x7f11200c6190 2023-07-29T02:00:44.886 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 8 2023-07-29T02:00:44.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.900+0000 7f112724e700 1 -- 172.21.15.42:0/3853711715 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f110006a660 msgr2=0x7f110006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:44.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.900+0000 7f112724e700 1 --2- 172.21.15.42:0/3853711715 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f110006a660 0x7f110006cb10 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1118000f80 tx=0x7f1118011000 comp rx=0 tx=0).stop 2023-07-29T02:00:44.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.900+0000 7f112724e700 1 -- 172.21.15.42:0/3853711715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11200c6190 msgr2=0x7f11200ceab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:44.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.900+0000 7f112724e700 1 --2- 172.21.15.42:0/3853711715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11200c6190 0x7f11200ceab0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f110800c4b0 tx=0x7f110800c870 comp rx=0 tx=0).stop 2023-07-29T02:00:44.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.900+0000 7f112724e700 1 -- 172.21.15.42:0/3853711715 shutdown_connections 2023-07-29T02:00:44.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.900+0000 7f112724e700 1 --2- 172.21.15.42:0/3853711715 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f110006a660 0x7f110006cb10 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.889 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.900+0000 7f112724e700 1 --2- 172.21.15.42:0/3853711715 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1120159d30 0x7f11201539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.889 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.900+0000 7f112724e700 1 --2- 172.21.15.42:0/3853711715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11200b4250 0x7f11200cf660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.889 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.900+0000 7f112724e700 1 --2- 172.21.15.42:0/3853711715 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f11200c6190 0x7f11200ceab0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:44.889 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.900+0000 7f112724e700 1 -- 172.21.15.42:0/3853711715 >> 172.21.15.42:0/3853711715 conn(0x7f112006ca30 msgr2=0x7f11200b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:44.889 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.901+0000 7f112724e700 1 -- 172.21.15.42:0/3853711715 shutdown_connections 2023-07-29T02:00:44.889 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:44.901+0000 7f112724e700 1 -- 172.21.15.42:0/3853711715 wait complete. 2023-07-29T02:00:44.900 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-29T02:00:45.027 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.040+0000 7f494c06f700 1 Processor -- start 2023-07-29T02:00:45.028 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.040+0000 7f494c06f700 1 -- start start 2023-07-29T02:00:45.031 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.041+0000 7f494c06f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f49441531a0 0x7f494406f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.031 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.041+0000 7f494c06f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49440c8580 0x7f494415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.032 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.041+0000 7f494c06f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494406c870 con 0x7f4944071840 2023-07-29T02:00:45.032 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.041+0000 7f494c06f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49440c74a0 con 0x7f49441531a0 2023-07-29T02:00:45.032 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.041+0000 7f494c06f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494406fa50 con 0x7f49440c8580 2023-07-29T02:00:45.032 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.041+0000 7f494960a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49440c8580 0x7f494415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.033 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.041+0000 7f4949e0b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f49441531a0 0x7f494406f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.033 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.041+0000 7f4949e0b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f49441531a0 0x7f494406f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:40386/0 (socket says 172.21.15.42:40386) 2023-07-29T02:00:45.033 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.041+0000 7f494960a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49440c8580 0x7f494415c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:57522/0 (socket says 172.21.15.42:57522) 2023-07-29T02:00:45.033 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.041+0000 7f4949e0b700 1 -- 172.21.15.42:0/633147983 learned_addr learned my addr 172.21.15.42:0/633147983 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:45.034 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.042+0000 7f494960a700 1 -- 172.21.15.42:0/633147983 >> v2:172.21.15.144:3300/0 conn(0x7f49441531a0 msgr2=0x7f494406f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:45.034 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.042+0000 7f494960a700 1 --2- 172.21.15.42:0/633147983 >> v2:172.21.15.144:3300/0 conn(0x7f49441531a0 0x7f494406f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.034 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.042+0000 7f494960a700 1 -- 172.21.15.42:0/633147983 >> v1:172.21.15.144:6789/0 conn(0x7f4944071840 legacy=0x7f494406a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:45.034 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.042+0000 7f494960a700 1 -- 172.21.15.42:0/633147983 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494415ca00 con 0x7f49440c8580 2023-07-29T02:00:45.035 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.042+0000 7f4949e0b700 1 --2- 172.21.15.42:0/633147983 >> v2:172.21.15.144:3300/0 conn(0x7f49441531a0 0x7f494406f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:00:45.035 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.042+0000 7f494960a700 1 --2- 172.21.15.42:0/633147983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49440c8580 0x7f494415c4c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4940009840 tx=0x7f4940009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f5c0fceecb549b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:45.035 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.042+0000 7f4948e09700 1 -- 172.21.15.42:0/633147983 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940011830 con 0x7f49440c8580 2023-07-29T02:00:45.036 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.042+0000 7f4948e09700 1 -- 172.21.15.42:0/633147983 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4940011990 con 0x7f49440c8580 2023-07-29T02:00:45.036 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.042+0000 7f4948e09700 1 -- 172.21.15.42:0/633147983 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940011d20 con 0x7f49440c8580 2023-07-29T02:00:45.036 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.042+0000 7f494c06f700 1 -- 172.21.15.42:0/633147983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49440c8580 msgr2=0x7f494415c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:45.036 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.042+0000 7f494c06f700 1 --2- 172.21.15.42:0/633147983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49440c8580 0x7f494415c4c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4940009840 tx=0x7f4940009b50 comp rx=0 tx=0).stop 2023-07-29T02:00:45.037 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.043+0000 7f494c06f700 1 -- 172.21.15.42:0/633147983 shutdown_connections 2023-07-29T02:00:45.037 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.043+0000 7f494c06f700 1 --2- 172.21.15.42:0/633147983 >> v2:172.21.15.144:3300/0 conn(0x7f49441531a0 0x7f494406f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.037 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.043+0000 7f494c06f700 1 --2- 172.21.15.42:0/633147983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49440c8580 0x7f494415c4c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.037 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.043+0000 7f494c06f700 1 -- 172.21.15.42:0/633147983 >> 172.21.15.42:0/633147983 conn(0x7f49440cbf10 msgr2=0x7f49440cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:45.038 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.043+0000 7f494c06f700 1 -- 172.21.15.42:0/633147983 shutdown_connections 2023-07-29T02:00:45.038 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.043+0000 7f494c06f700 1 -- 172.21.15.42:0/633147983 wait complete. 2023-07-29T02:00:45.038 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.044+0000 7f494c06f700 1 Processor -- start 2023-07-29T02:00:45.038 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.044+0000 7f494c06f700 1 -- start start 2023-07-29T02:00:45.042 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.044+0000 7f494c06f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4944071840 0x7f49441ef230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.042 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f494c06f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49440c8580 0x7f494415b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.043 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f494c06f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49441531a0 0x7f4944150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.043 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f494c06f700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49441f2ad0 con 0x7f4944071840 2023-07-29T02:00:45.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f494c06f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49441ef770 con 0x7f49441531a0 2023-07-29T02:00:45.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f494c06f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494415c6e0 con 0x7f49440c8580 2023-07-29T02:00:45.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f4949e0b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4944071840 0x7f49441ef230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f4949e0b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4944071840 0x7f49441ef230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57014/0 (socket says 172.21.15.42:57014) 2023-07-29T02:00:45.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f4949e0b700 1 -- 172.21.15.42:0/1866122988 learned_addr learned my addr 172.21.15.42:0/1866122988 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:45.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f494960a700 1 --2- 172.21.15.42:0/1866122988 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49440c8580 0x7f494415b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f494a60c700 1 --2- 172.21.15.42:0/1866122988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49441531a0 0x7f4944150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f4949e0b700 1 -- 172.21.15.42:0/1866122988 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49440c8580 msgr2=0x7f494415b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:45.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f4949e0b700 1 --2- 172.21.15.42:0/1866122988 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49440c8580 0x7f494415b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f4949e0b700 1 -- 172.21.15.42:0/1866122988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49441531a0 msgr2=0x7f4944150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:45.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f4949e0b700 1 --2- 172.21.15.42:0/1866122988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49441531a0 0x7f4944150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f4949e0b700 1 -- 172.21.15.42:0/1866122988 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4934009550 con 0x7f4944071840 2023-07-29T02:00:45.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f494a60c700 1 --2- 172.21.15.42:0/1866122988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49441531a0 0x7f4944150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:45.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f4949e0b700 1 --2- 172.21.15.42:0/1866122988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4944071840 0x7f49441ef230 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f493400ec10 tx=0x7f493400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:45.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f493a7fc700 1 -- 172.21.15.42:0/1866122988 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400c7f0 con 0x7f4944071840 2023-07-29T02:00:45.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f493a7fc700 1 -- 172.21.15.42:0/1866122988 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493400c950 con 0x7f4944071840 2023-07-29T02:00:45.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f494c06f700 1 -- 172.21.15.42:0/1866122988 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49400094a0 con 0x7f4944071840 2023-07-29T02:00:45.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f493a7fc700 1 -- 172.21.15.42:0/1866122988 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400ccc0 con 0x7f4944071840 2023-07-29T02:00:45.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.045+0000 7f494c06f700 1 -- 172.21.15.42:0/1866122988 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494415bdb0 con 0x7f4944071840 2023-07-29T02:00:45.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.046+0000 7f494c06f700 1 -- 172.21.15.42:0/1866122988 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494404ea50 con 0x7f4944071840 2023-07-29T02:00:45.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.047+0000 7f493a7fc700 1 -- 172.21.15.42:0/1866122988 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f4934013470 con 0x7f4944071840 2023-07-29T02:00:45.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.047+0000 7f493a7fc700 1 --2- 172.21.15.42:0/1866122988 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f492806a660 0x7f492806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.047+0000 7f493a7fc700 1 -- 172.21.15.42:0/1866122988 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4934088e10 con 0x7f4944071840 2023-07-29T02:00:45.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.048+0000 7f494960a700 1 --2- 172.21.15.42:0/1866122988 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f492806a660 0x7f492806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.048+0000 7f494960a700 1 --2- 172.21.15.42:0/1866122988 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f492806a660 0x7f492806cb10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4940000c00 tx=0x7f4940008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:45.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.052+0000 7f493a7fc700 1 -- 172.21.15.42:0/1866122988 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f493408c030 con 0x7f4944071840 2023-07-29T02:00:45.239 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.251+0000 7f494c06f700 1 -- 172.21.15.42:0/1866122988 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f494406d0b0 con 0x7f4944071840 2023-07-29T02:00:45.239 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.251+0000 7f493a7fc700 1 -- 172.21.15.42:0/1866122988 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4934053f10 con 0x7f4944071840 2023-07-29T02:00:45.239 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2023-07-29T02:00:45.241 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.253+0000 7f494c06f700 1 -- 172.21.15.42:0/1866122988 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f492806a660 msgr2=0x7f492806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:45.241 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.253+0000 7f494c06f700 1 --2- 172.21.15.42:0/1866122988 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f492806a660 0x7f492806cb10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4940000c00 tx=0x7f4940008030 comp rx=0 tx=0).stop 2023-07-29T02:00:45.241 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.253+0000 7f494c06f700 1 -- 172.21.15.42:0/1866122988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4944071840 msgr2=0x7f49441ef230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:45.241 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.253+0000 7f494c06f700 1 --2- 172.21.15.42:0/1866122988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4944071840 0x7f49441ef230 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f493400ec10 tx=0x7f493400ef20 comp rx=0 tx=0).stop 2023-07-29T02:00:45.242 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.253+0000 7f494c06f700 1 -- 172.21.15.42:0/1866122988 shutdown_connections 2023-07-29T02:00:45.242 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.253+0000 7f494c06f700 1 --2- 172.21.15.42:0/1866122988 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f492806a660 0x7f492806cb10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.242 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.253+0000 7f494c06f700 1 --2- 172.21.15.42:0/1866122988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49441531a0 0x7f4944150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.242 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.253+0000 7f494c06f700 1 --2- 172.21.15.42:0/1866122988 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4944071840 0x7f49441ef230 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.242 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.253+0000 7f494c06f700 1 --2- 172.21.15.42:0/1866122988 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f49440c8580 0x7f494415b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.242 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.253+0000 7f494c06f700 1 -- 172.21.15.42:0/1866122988 >> 172.21.15.42:0/1866122988 conn(0x7f49440cbf10 msgr2=0x7f494406a750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:45.242 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.254+0000 7f494c06f700 1 -- 172.21.15.42:0/1866122988 shutdown_connections 2023-07-29T02:00:45.242 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.254+0000 7f494c06f700 1 -- 172.21.15.42:0/1866122988 wait complete. 2023-07-29T02:00:45.253 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-29T02:00:45.381 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.394+0000 7ff0e8e37700 1 Processor -- start 2023-07-29T02:00:45.381 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.394+0000 7ff0e8e37700 1 -- start start 2023-07-29T02:00:45.383 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.395+0000 7ff0e8e37700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff0e40b0f00 0x7ff0e40c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.395+0000 7ff0e8e37700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff0e40c0fa0 0x7ff0e4152da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.395+0000 7ff0e8e37700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e406d6f0 con 0x7ff0e40b12d0 2023-07-29T02:00:45.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.395+0000 7ff0e8e37700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e40c7450 con 0x7ff0e40b0f00 2023-07-29T02:00:45.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.395+0000 7ff0e8e37700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e40c7730 con 0x7ff0e40c0fa0 2023-07-29T02:00:45.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.395+0000 7ff0e259c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff0e40b0f00 0x7ff0e40c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.395+0000 7ff0e1d9b700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff0e40b12d0 0x7ff0e41590e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50826/0 (socket says 172.21.15.42:50826) 2023-07-29T02:00:45.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.395+0000 7ff0e1d9b700 1 -- 172.21.15.42:0/4128531250 learned_addr learned my addr 172.21.15.42:0/4128531250 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:45.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.395+0000 7ff0e259c700 1 -- 172.21.15.42:0/4128531250 >> v2:172.21.15.144:3300/0 conn(0x7ff0e40c0fa0 msgr2=0x7ff0e4152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:45.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.395+0000 7ff0e2d9d700 1 --2- 172.21.15.42:0/4128531250 >> v2:172.21.15.144:3300/0 conn(0x7ff0e40c0fa0 0x7ff0e4152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.395+0000 7ff0e259c700 1 --2- 172.21.15.42:0/4128531250 >> v2:172.21.15.144:3300/0 conn(0x7ff0e40c0fa0 0x7ff0e4152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.395+0000 7ff0e259c700 1 -- 172.21.15.42:0/4128531250 >> v1:172.21.15.42:6789/0 conn(0x7ff0e40b12d0 legacy=0x7ff0e41590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:45.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.395+0000 7ff0e159a700 1 -- 172.21.15.42:0/4128531250 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494801281 0 0) 0x7ff0e406d6f0 con 0x7ff0e40b12d0 2023-07-29T02:00:45.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.395+0000 7ff0e259c700 1 -- 172.21.15.42:0/4128531250 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e406cdc0 con 0x7ff0e40b0f00 2023-07-29T02:00:45.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.395+0000 7ff0e2d9d700 1 --2- 172.21.15.42:0/4128531250 >> v2:172.21.15.144:3300/0 conn(0x7ff0e40c0fa0 0x7ff0e4152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:45.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.395+0000 7ff0e259c700 1 --2- 172.21.15.42:0/4128531250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0e40b0f00 0x7ff0e40c6dc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff0e40b16e0 tx=0x7ff0d8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b398dadb2251701 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:45.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.395+0000 7ff0e159a700 1 -- 172.21.15.42:0/4128531250 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8011830 con 0x7ff0e40b0f00 2023-07-29T02:00:45.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.396+0000 7ff0e159a700 1 -- 172.21.15.42:0/4128531250 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d8011990 con 0x7ff0e40b0f00 2023-07-29T02:00:45.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.396+0000 7ff0e159a700 1 -- 172.21.15.42:0/4128531250 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8011d20 con 0x7ff0e40b0f00 2023-07-29T02:00:45.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.396+0000 7ff0e8e37700 1 -- 172.21.15.42:0/4128531250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0e40b0f00 msgr2=0x7ff0e40c6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:45.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.396+0000 7ff0e8e37700 1 --2- 172.21.15.42:0/4128531250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0e40b0f00 0x7ff0e40c6dc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff0e40b16e0 tx=0x7ff0d8009b20 comp rx=0 tx=0).stop 2023-07-29T02:00:45.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.396+0000 7ff0e8e37700 1 -- 172.21.15.42:0/4128531250 shutdown_connections 2023-07-29T02:00:45.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.396+0000 7ff0e8e37700 1 --2- 172.21.15.42:0/4128531250 >> v2:172.21.15.144:3300/0 conn(0x7ff0e40c0fa0 0x7ff0e4152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.396+0000 7ff0e8e37700 1 --2- 172.21.15.42:0/4128531250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0e40b0f00 0x7ff0e40c6dc0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.396+0000 7ff0e8e37700 1 -- 172.21.15.42:0/4128531250 >> 172.21.15.42:0/4128531250 conn(0x7ff0e40ccc50 msgr2=0x7ff0e406ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:45.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.396+0000 7ff0e8e37700 1 -- 172.21.15.42:0/4128531250 shutdown_connections 2023-07-29T02:00:45.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.396+0000 7ff0e8e37700 1 -- 172.21.15.42:0/4128531250 wait complete. 2023-07-29T02:00:45.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.397+0000 7ff0e8e37700 1 Processor -- start 2023-07-29T02:00:45.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.398+0000 7ff0e8e37700 1 -- start start 2023-07-29T02:00:45.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.398+0000 7ff0e8e37700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40b0f00 0x7ff0e40c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.398+0000 7ff0e8e37700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0e40b12d0 0x7ff0e40c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.398+0000 7ff0e8e37700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0e40c0fa0 0x7ff0e41f19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.398+0000 7ff0e8e37700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e40c8ae0 con 0x7ff0e40c0fa0 2023-07-29T02:00:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.398+0000 7ff0e8e37700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e40c8230 con 0x7ff0e40b0f00 2023-07-29T02:00:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.398+0000 7ff0e8e37700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e40c4640 con 0x7ff0e40b12d0 2023-07-29T02:00:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.398+0000 7ff0e2d9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0e40c0fa0 0x7ff0e41f19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.398+0000 7ff0e2d9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0e40c0fa0 0x7ff0e41f19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57032/0 (socket says 172.21.15.42:57032) 2023-07-29T02:00:45.391 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.398+0000 7ff0e2d9d700 1 -- 172.21.15.42:0/2799611502 learned_addr learned my addr 172.21.15.42:0/2799611502 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:45.391 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.399+0000 7ff0e1d9b700 1 --2- 172.21.15.42:0/2799611502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0e40b12d0 0x7ff0e40c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.391 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.399+0000 7ff0e259c700 1 --2- 172.21.15.42:0/2799611502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40b0f00 0x7ff0e40c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.391 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.399+0000 7ff0e2d9d700 1 -- 172.21.15.42:0/2799611502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0e40b12d0 msgr2=0x7ff0e40c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:45.391 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.399+0000 7ff0e2d9d700 1 --2- 172.21.15.42:0/2799611502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0e40b12d0 0x7ff0e40c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.391 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.399+0000 7ff0e2d9d700 1 -- 172.21.15.42:0/2799611502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40b0f00 msgr2=0x7ff0e40c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.399+0000 7ff0e2d9d700 1 --2- 172.21.15.42:0/2799611502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40b0f00 0x7ff0e40c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.399+0000 7ff0e2d9d700 1 -- 172.21.15.42:0/2799611502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d80094a0 con 0x7ff0e40c0fa0 2023-07-29T02:00:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.399+0000 7ff0e1d9b700 1 --2- 172.21.15.42:0/2799611502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0e40b12d0 0x7ff0e40c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.399+0000 7ff0e259c700 1 --2- 172.21.15.42:0/2799611502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40b0f00 0x7ff0e40c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.399+0000 7ff0e2d9d700 1 --2- 172.21.15.42:0/2799611502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0e40c0fa0 0x7ff0e41f19a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc00cd50 tx=0x7ff0dc00a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.399+0000 7ff0d2ffd700 1 -- 172.21.15.42:0/2799611502 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc00f480 con 0x7ff0e40c0fa0 2023-07-29T02:00:45.392 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.399+0000 7ff0d2ffd700 1 -- 172.21.15.42:0/2799611502 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0dc00f600 con 0x7ff0e40c0fa0 2023-07-29T02:00:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.399+0000 7ff0e8e37700 1 -- 172.21.15.42:0/2799611502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e40c4920 con 0x7ff0e40c0fa0 2023-07-29T02:00:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.399+0000 7ff0d2ffd700 1 -- 172.21.15.42:0/2799611502 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc00f9b0 con 0x7ff0e40c0fa0 2023-07-29T02:00:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.399+0000 7ff0e8e37700 1 -- 172.21.15.42:0/2799611502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e40c8700 con 0x7ff0e40c0fa0 2023-07-29T02:00:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.400+0000 7ff0e8e37700 1 -- 172.21.15.42:0/2799611502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e40c8c20 con 0x7ff0e40c0fa0 2023-07-29T02:00:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.401+0000 7ff0d2ffd700 1 -- 172.21.15.42:0/2799611502 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7ff0dc00b040 con 0x7ff0e40c0fa0 2023-07-29T02:00:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.401+0000 7ff0d2ffd700 1 --2- 172.21.15.42:0/2799611502 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff0c406a660 0x7ff0c406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.393 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.401+0000 7ff0d2ffd700 1 -- 172.21.15.42:0/2799611502 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff0dc089630 con 0x7ff0e40c0fa0 2023-07-29T02:00:45.394 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.401+0000 7ff0e259c700 1 --2- 172.21.15.42:0/2799611502 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff0c406a660 0x7ff0c406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.394 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.402+0000 7ff0e259c700 1 --2- 172.21.15.42:0/2799611502 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff0c406a660 0x7ff0c406cb10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80090b0 tx=0x7ff0d8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:45.394 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.405+0000 7ff0d2ffd700 1 -- 172.21.15.42:0/2799611502 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7ff0dc054740 con 0x7ff0e40c0fa0 2023-07-29T02:00:45.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.606+0000 7ff0e8e37700 1 -- 172.21.15.42:0/2799611502 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff0e406d070 con 0x7ff0e40c0fa0 2023-07-29T02:00:45.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.607+0000 7ff0d2ffd700 1 -- 172.21.15.42:0/2799611502 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff0dc057d60 con 0x7ff0e40c0fa0 2023-07-29T02:00:45.594 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2023-07-29T02:00:45.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.609+0000 7ff0e8e37700 1 -- 172.21.15.42:0/2799611502 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff0c406a660 msgr2=0x7ff0c406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:45.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.609+0000 7ff0e8e37700 1 --2- 172.21.15.42:0/2799611502 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff0c406a660 0x7ff0c406cb10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff0d80090b0 tx=0x7ff0d8008030 comp rx=0 tx=0).stop 2023-07-29T02:00:45.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.609+0000 7ff0e8e37700 1 -- 172.21.15.42:0/2799611502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0e40c0fa0 msgr2=0x7ff0e41f19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:45.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.609+0000 7ff0e8e37700 1 --2- 172.21.15.42:0/2799611502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0e40c0fa0 0x7ff0e41f19a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc00cd50 tx=0x7ff0dc00a560 comp rx=0 tx=0).stop 2023-07-29T02:00:45.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.609+0000 7ff0e8e37700 1 -- 172.21.15.42:0/2799611502 shutdown_connections 2023-07-29T02:00:45.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.609+0000 7ff0e8e37700 1 --2- 172.21.15.42:0/2799611502 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff0c406a660 0x7ff0c406cb10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.609+0000 7ff0e8e37700 1 --2- 172.21.15.42:0/2799611502 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff0e40c0fa0 0x7ff0e41f19a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.609+0000 7ff0e8e37700 1 --2- 172.21.15.42:0/2799611502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff0e40b0f00 0x7ff0e40c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.609+0000 7ff0e8e37700 1 --2- 172.21.15.42:0/2799611502 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff0e40b12d0 0x7ff0e40c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.609+0000 7ff0e8e37700 1 -- 172.21.15.42:0/2799611502 >> 172.21.15.42:0/2799611502 conn(0x7ff0e40ccc50 msgr2=0x7ff0e4071170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:45.598 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.609+0000 7ff0e8e37700 1 -- 172.21.15.42:0/2799611502 shutdown_connections 2023-07-29T02:00:45.598 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.609+0000 7ff0e8e37700 1 -- 172.21.15.42:0/2799611502 wait complete. 2023-07-29T02:00:45.608 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-29T02:00:45.737 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.749+0000 7f56e44d4700 1 Processor -- start 2023-07-29T02:00:45.737 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.749+0000 7f56e44d4700 1 -- start start 2023-07-29T02:00:45.740 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.750+0000 7f56e44d4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56dc155bd0 0x7f56dc14f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.740 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.750+0000 7f56e44d4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f56dc14fe60 0x7f56dc06f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.740 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.750+0000 7f56e44d4700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56dc06cb10 con 0x7f56dc06eda0 2023-07-29T02:00:45.740 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.750+0000 7f56e44d4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56dc156000 con 0x7f56dc14fe60 2023-07-29T02:00:45.740 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.750+0000 7f56e44d4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc1502e0 con 0x7f56dc155bd0 2023-07-29T02:00:45.741 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.750+0000 7f56e2270700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f56dc06eda0 0x7f56dc06cfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50840/0 (socket says 172.21.15.42:50840) 2023-07-29T02:00:45.741 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.750+0000 7f56e2270700 1 -- 172.21.15.42:0/3077073633 learned_addr learned my addr 172.21.15.42:0/3077073633 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:45.741 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e2a71700 1 --2- 172.21.15.42:0/3077073633 >> v2:172.21.15.144:3300/0 conn(0x7f56dc14fe60 0x7f56dc06f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.741 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e1a6f700 1 --2- 172.21.15.42:0/3077073633 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56dc155bd0 0x7f56dc14f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.741 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e126e700 1 -- 172.21.15.42:0/3077073633 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496967280 0 0) 0x7f56dc06cb10 con 0x7f56dc06eda0 2023-07-29T02:00:45.741 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e126e700 1 -- 172.21.15.42:0/3077073633 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56c80035b0 con 0x7f56dc06eda0 2023-07-29T02:00:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e126e700 1 -- 172.21.15.42:0/3077073633 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1103339777 0 0) 0x7f56c80035b0 con 0x7f56dc06eda0 2023-07-29T02:00:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e126e700 1 -- 172.21.15.42:0/3077073633 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56dc155bd0 msgr2=0x7f56dc14f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e126e700 1 --2- 172.21.15.42:0/3077073633 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56dc155bd0 0x7f56dc14f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e126e700 1 -- 172.21.15.42:0/3077073633 >> v2:172.21.15.144:3300/0 conn(0x7f56dc14fe60 msgr2=0x7f56dc06f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e126e700 1 --2- 172.21.15.42:0/3077073633 >> v2:172.21.15.144:3300/0 conn(0x7f56dc14fe60 0x7f56dc06f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e126e700 1 -- 172.21.15.42:0/3077073633 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc156280 con 0x7f56dc06eda0 2023-07-29T02:00:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e126e700 1 -- 172.21.15.42:0/3077073633 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7f56cc001670 con 0x7f56dc06eda0 2023-07-29T02:00:45.742 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e126e700 1 -- 172.21.15.42:0/3077073633 >> v1:172.21.15.42:6789/0 conn(0x7f56dc06eda0 legacy=0x7f56dc06cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e126e700 1 --2- 172.21.15.42:0/3077073633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56c8003a00 0x7f56c8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e126e700 1 --2- 172.21.15.42:0/3077073633 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56dc155bd0 0x7f56c8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e126e700 1 --2- 172.21.15.42:0/3077073633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56c8004d90 0x7f56c8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e126e700 1 -- 172.21.15.42:0/3077073633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc156000 con 0x7f56c8003a00 2023-07-29T02:00:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e126e700 1 -- 172.21.15.42:0/3077073633 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc1502e0 con 0x7f56c8004d90 2023-07-29T02:00:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e126e700 1 -- 172.21.15.42:0/3077073633 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c800ba10 con 0x7f56dc155bd0 2023-07-29T02:00:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e2270700 1 --2- 172.21.15.42:0/3077073633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56c8003a00 0x7f56c8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.743 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e1a6f700 1 --2- 172.21.15.42:0/3077073633 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56dc155bd0 0x7f56c8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.744 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e2a71700 1 --2- 172.21.15.42:0/3077073633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56c8004d90 0x7f56c8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.744 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e2270700 1 -- 172.21.15.42:0/3077073633 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56dc155bd0 msgr2=0x7f56c8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:45.744 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e2270700 1 --2- 172.21.15.42:0/3077073633 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56dc155bd0 0x7f56c8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.744 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e2270700 1 -- 172.21.15.42:0/3077073633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56c8004d90 msgr2=0x7f56c8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:45.744 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e2270700 1 --2- 172.21.15.42:0/3077073633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56c8004d90 0x7f56c8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.744 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.751+0000 7f56e2270700 1 -- 172.21.15.42:0/3077073633 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c80035b0 con 0x7f56c8003a00 2023-07-29T02:00:45.744 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.752+0000 7f56e2270700 1 --2- 172.21.15.42:0/3077073633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56c8003a00 0x7f56c8003e10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f56cc007d80 tx=0x7f56c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34811d07bf2e3578 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:45.745 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.752+0000 7f56e126e700 1 -- 172.21.15.42:0/3077073633 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc00ce10 con 0x7f56c8003a00 2023-07-29T02:00:45.745 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.752+0000 7f56e126e700 1 -- 172.21.15.42:0/3077073633 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56cc005960 con 0x7f56c8003a00 2023-07-29T02:00:45.745 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.752+0000 7f56e126e700 1 -- 172.21.15.42:0/3077073633 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc005d10 con 0x7f56c8003a00 2023-07-29T02:00:45.745 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.752+0000 7f56e44d4700 1 -- 172.21.15.42:0/3077073633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56c8003a00 msgr2=0x7f56c8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:45.745 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.752+0000 7f56e44d4700 1 --2- 172.21.15.42:0/3077073633 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56c8003a00 0x7f56c8003e10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f56cc007d80 tx=0x7f56c8005880 comp rx=0 tx=0).stop 2023-07-29T02:00:45.745 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.752+0000 7f56e2a71700 1 -- 172.21.15.42:0/3077073633 reap_dead start 2023-07-29T02:00:45.745 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.752+0000 7f56e44d4700 1 -- 172.21.15.42:0/3077073633 shutdown_connections 2023-07-29T02:00:45.746 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.752+0000 7f56e44d4700 1 -- 172.21.15.42:0/3077073633 >> 172.21.15.42:0/3077073633 conn(0x7f56dc0cbf10 msgr2=0x7f56dc0cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:45.746 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.752+0000 7f56e44d4700 1 -- 172.21.15.42:0/3077073633 shutdown_connections 2023-07-29T02:00:45.746 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.752+0000 7f56e44d4700 1 -- 172.21.15.42:0/3077073633 wait complete. 2023-07-29T02:00:45.748 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.754+0000 7f56e44d4700 1 Processor -- start 2023-07-29T02:00:45.748 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.754+0000 7f56e44d4700 1 -- start start 2023-07-29T02:00:45.748 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.754+0000 7f56e44d4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56c8003a00 0x7f56dc1539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.748 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.754+0000 7f56e44d4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56dc1ddd20 0x7f56dc0cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.748 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.754+0000 7f56e44d4700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56dc153040 0x7f56dc1457a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.749 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.754+0000 7f56e44d4700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc1de3a0 con 0x7f56dc153040 2023-07-29T02:00:45.749 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.754+0000 7f56e44d4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc0ca9b0 con 0x7f56dc1ddd20 2023-07-29T02:00:45.749 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.754+0000 7f56e44d4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56dc0cbc80 con 0x7f56c8003a00 2023-07-29T02:00:45.749 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.754+0000 7f56e2a71700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56dc153040 0x7f56dc1457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.749 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.755+0000 7f56e2a71700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56dc153040 0x7f56dc1457a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57052/0 (socket says 172.21.15.42:57052) 2023-07-29T02:00:45.749 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.755+0000 7f56e2a71700 1 -- 172.21.15.42:0/3846403652 learned_addr learned my addr 172.21.15.42:0/3846403652 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:45.749 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.755+0000 7f56e2270700 1 --2- 172.21.15.42:0/3846403652 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56c8003a00 0x7f56dc1539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.749 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.755+0000 7f56e1a6f700 1 --2- 172.21.15.42:0/3846403652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56dc1ddd20 0x7f56dc0cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.750 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.755+0000 7f56e2a71700 1 -- 172.21.15.42:0/3846403652 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56c8003a00 msgr2=0x7f56dc1539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:45.750 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.755+0000 7f56e2a71700 1 --2- 172.21.15.42:0/3846403652 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56c8003a00 0x7f56dc1539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.750 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.755+0000 7f56e2a71700 1 -- 172.21.15.42:0/3846403652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56dc1ddd20 msgr2=0x7f56dc0cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:45.750 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.755+0000 7f56e2a71700 1 --2- 172.21.15.42:0/3846403652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56dc1ddd20 0x7f56dc0cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.750 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.755+0000 7f56e2a71700 1 -- 172.21.15.42:0/3846403652 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc0cac70 con 0x7f56dc153040 2023-07-29T02:00:45.750 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.755+0000 7f56e2a71700 1 --2- 172.21.15.42:0/3846403652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56dc153040 0x7f56dc1457a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f56dc06e790 tx=0x7f56d4011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:45.750 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.755+0000 7f56d2ffd700 1 -- 172.21.15.42:0/3846403652 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d400e040 con 0x7f56dc153040 2023-07-29T02:00:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.755+0000 7f56d2ffd700 1 -- 172.21.15.42:0/3846403652 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d400f040 con 0x7f56dc153040 2023-07-29T02:00:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.755+0000 7f56e44d4700 1 -- 172.21.15.42:0/3846403652 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56dc0caf50 con 0x7f56dc153040 2023-07-29T02:00:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.755+0000 7f56d2ffd700 1 -- 172.21.15.42:0/3846403652 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d400fdb0 con 0x7f56dc153040 2023-07-29T02:00:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.755+0000 7f56e44d4700 1 -- 172.21.15.42:0/3846403652 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56dc1dd240 con 0x7f56dc153040 2023-07-29T02:00:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.756+0000 7f56e44d4700 1 -- 172.21.15.42:0/3846403652 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56dc04ea50 con 0x7f56dc153040 2023-07-29T02:00:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.757+0000 7f56d2ffd700 1 -- 172.21.15.42:0/3846403652 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f56d4022460 con 0x7f56dc153040 2023-07-29T02:00:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.757+0000 7f56d2ffd700 1 --2- 172.21.15.42:0/3846403652 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f56c006a690 0x7f56c006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:45.751 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.757+0000 7f56d2ffd700 1 -- 172.21.15.42:0/3846403652 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6850+0+0 (secure 0 0 0) 0x7f56d40892e0 con 0x7f56dc153040 2023-07-29T02:00:45.752 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.757+0000 7f56e2270700 1 --2- 172.21.15.42:0/3846403652 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f56c006a690 0x7f56c006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:45.752 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.758+0000 7f56e2270700 1 --2- 172.21.15.42:0/3846403652 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f56c006a690 0x7f56c006cb40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f56cc001930 tx=0x7f56cc00a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:45.752 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.761+0000 7f56d2ffd700 1 -- 172.21.15.42:0/3846403652 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f56d4054330 con 0x7f56dc153040 2023-07-29T02:00:45.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.961+0000 7f56e44d4700 1 -- 172.21.15.42:0/3846403652 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56dc067a00 con 0x7f56dc153040 2023-07-29T02:00:45.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.961+0000 7f56d2ffd700 1 -- 172.21.15.42:0/3846403652 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56d4057950 con 0x7f56dc153040 2023-07-29T02:00:45.949 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2023-07-29T02:00:45.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.963+0000 7f56e44d4700 1 -- 172.21.15.42:0/3846403652 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f56c006a690 msgr2=0x7f56c006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:45.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.964+0000 7f56e44d4700 1 --2- 172.21.15.42:0/3846403652 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f56c006a690 0x7f56c006cb40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f56cc001930 tx=0x7f56cc00a000 comp rx=0 tx=0).stop 2023-07-29T02:00:45.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.964+0000 7f56e44d4700 1 -- 172.21.15.42:0/3846403652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56dc153040 msgr2=0x7f56dc1457a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:45.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.964+0000 7f56e44d4700 1 --2- 172.21.15.42:0/3846403652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56dc153040 0x7f56dc1457a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f56dc06e790 tx=0x7f56d4011f80 comp rx=0 tx=0).stop 2023-07-29T02:00:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.964+0000 7f56e44d4700 1 -- 172.21.15.42:0/3846403652 shutdown_connections 2023-07-29T02:00:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.964+0000 7f56e44d4700 1 --2- 172.21.15.42:0/3846403652 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f56c006a690 0x7f56c006cb40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.964+0000 7f56e44d4700 1 --2- 172.21.15.42:0/3846403652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f56dc153040 0x7f56dc1457a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.964+0000 7f56e44d4700 1 --2- 172.21.15.42:0/3846403652 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f56c8003a00 0x7f56dc1539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.964+0000 7f56e44d4700 1 --2- 172.21.15.42:0/3846403652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f56dc1ddd20 0x7f56dc0cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.964+0000 7f56e44d4700 1 -- 172.21.15.42:0/3846403652 >> 172.21.15.42:0/3846403652 conn(0x7f56dc0cbf10 msgr2=0x7f56dc14d520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:45.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.964+0000 7f56e44d4700 1 -- 172.21.15.42:0/3846403652 shutdown_connections 2023-07-29T02:00:45.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:45.964+0000 7f56e44d4700 1 -- 172.21.15.42:0/3846403652 wait complete. 2023-07-29T02:00:45.964 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-29T02:00:46.092 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.105+0000 7f9b48805700 1 Processor -- start 2023-07-29T02:00:46.092 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.105+0000 7f9b48805700 1 -- start start 2023-07-29T02:00:46.094 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.106+0000 7f9b48805700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9b4413ed20 0x7f9b44156650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.094 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.106+0000 7f9b48805700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b44071d10 con 0x7f9b44071120 2023-07-29T02:00:46.094 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.106+0000 7f9b48805700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b44156b90 con 0x7f9b441574f0 2023-07-29T02:00:46.094 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.106+0000 7f9b48805700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b44072dc0 con 0x7f9b4413ed20 2023-07-29T02:00:46.094 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.106+0000 7f9b4259c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9b4413ed20 0x7f9b44156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.094 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.106+0000 7f9b41d9b700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f9b44071120 0x7f9b440c6980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50862/0 (socket says 172.21.15.42:50862) 2023-07-29T02:00:46.095 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.106+0000 7f9b41d9b700 1 -- 172.21.15.42:0/2883581914 learned_addr learned my addr 172.21.15.42:0/2883581914 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:46.095 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.106+0000 7f9b4259c700 1 -- 172.21.15.42:0/2883581914 >> v1:172.21.15.144:6789/0 conn(0x7f9b441574f0 legacy=0x7f9b44157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:46.095 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.106+0000 7f9b4259c700 1 -- 172.21.15.42:0/2883581914 >> v1:172.21.15.42:6789/0 conn(0x7f9b44071120 legacy=0x7f9b440c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:46.095 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.106+0000 7f9b4259c700 1 -- 172.21.15.42:0/2883581914 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b44071f60 con 0x7f9b4413ed20 2023-07-29T02:00:46.095 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.106+0000 7f9b4159a700 1 -- 172.21.15.42:0/2883581914 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716069800 0 0) 0x7f9b44071d10 con 0x7f9b44071120 2023-07-29T02:00:46.095 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.106+0000 7f9b4259c700 1 --2- 172.21.15.42:0/2883581914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b4413ed20 0x7f9b44156650 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009840 tx=0x7f9b34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4758c2ec0b686c00 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:46.095 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.107+0000 7f9b4159a700 1 -- 172.21.15.42:0/2883581914 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34011830 con 0x7f9b4413ed20 2023-07-29T02:00:46.096 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.107+0000 7f9b4159a700 1 -- 172.21.15.42:0/2883581914 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b34011990 con 0x7f9b4413ed20 2023-07-29T02:00:46.096 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.107+0000 7f9b4159a700 1 -- 172.21.15.42:0/2883581914 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34011d20 con 0x7f9b4413ed20 2023-07-29T02:00:46.098 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.107+0000 7f9b48805700 1 -- 172.21.15.42:0/2883581914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b4413ed20 msgr2=0x7f9b44156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:46.098 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.107+0000 7f9b48805700 1 --2- 172.21.15.42:0/2883581914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b4413ed20 0x7f9b44156650 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009840 tx=0x7f9b34009b50 comp rx=0 tx=0).stop 2023-07-29T02:00:46.098 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.107+0000 7f9b48805700 1 -- 172.21.15.42:0/2883581914 shutdown_connections 2023-07-29T02:00:46.098 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.107+0000 7f9b48805700 1 --2- 172.21.15.42:0/2883581914 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b4413ed20 0x7f9b44156650 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.098 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.107+0000 7f9b48805700 1 -- 172.21.15.42:0/2883581914 >> 172.21.15.42:0/2883581914 conn(0x7f9b440ccc50 msgr2=0x7f9b4406ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:46.098 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.107+0000 7f9b48805700 1 -- 172.21.15.42:0/2883581914 shutdown_connections 2023-07-29T02:00:46.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.107+0000 7f9b48805700 1 -- 172.21.15.42:0/2883581914 wait complete. 2023-07-29T02:00:46.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.109+0000 7f9b48805700 1 Processor -- start 2023-07-29T02:00:46.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.109+0000 7f9b48805700 1 -- start start 2023-07-29T02:00:46.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.109+0000 7f9b48805700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b44071120 0x7f9b44154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.109+0000 7f9b48805700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b4413ed20 0x7f9b44134da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.109+0000 7f9b48805700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b441574f0 0x7f9b4413d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.109+0000 7f9b48805700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b441ec720 con 0x7f9b441574f0 2023-07-29T02:00:46.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.109+0000 7f9b48805700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b441f0730 con 0x7f9b44071120 2023-07-29T02:00:46.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.109+0000 7f9b48805700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b441ec9c0 con 0x7f9b4413ed20 2023-07-29T02:00:46.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.109+0000 7f9b42d9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b441574f0 0x7f9b4413d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.109+0000 7f9b42d9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b441574f0 0x7f9b4413d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57066/0 (socket says 172.21.15.42:57066) 2023-07-29T02:00:46.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.109+0000 7f9b42d9d700 1 -- 172.21.15.42:0/2488714546 learned_addr learned my addr 172.21.15.42:0/2488714546 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:46.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.110+0000 7f9b41d9b700 1 --2- 172.21.15.42:0/2488714546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b4413ed20 0x7f9b44134da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.110+0000 7f9b4259c700 1 --2- 172.21.15.42:0/2488714546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b44071120 0x7f9b44154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.110+0000 7f9b42d9d700 1 -- 172.21.15.42:0/2488714546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b4413ed20 msgr2=0x7f9b44134da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:46.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.110+0000 7f9b42d9d700 1 --2- 172.21.15.42:0/2488714546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b4413ed20 0x7f9b44134da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.110+0000 7f9b42d9d700 1 -- 172.21.15.42:0/2488714546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b44071120 msgr2=0x7f9b44154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:46.102 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.110+0000 7f9b42d9d700 1 --2- 172.21.15.42:0/2488714546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b44071120 0x7f9b44154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.102 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.110+0000 7f9b42d9d700 1 -- 172.21.15.42:0/2488714546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b340094a0 con 0x7f9b441574f0 2023-07-29T02:00:46.102 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.110+0000 7f9b41d9b700 1 --2- 172.21.15.42:0/2488714546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b4413ed20 0x7f9b44134da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:46.102 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.110+0000 7f9b4259c700 1 --2- 172.21.15.42:0/2488714546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b44071120 0x7f9b44154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:46.102 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.110+0000 7f9b42d9d700 1 --2- 172.21.15.42:0/2488714546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b441574f0 0x7f9b4413d5c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00cbc0 tx=0x7f9b3c00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:46.102 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.110+0000 7f9b32ffd700 1 -- 172.21.15.42:0/2488714546 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c003c00 con 0x7f9b441574f0 2023-07-29T02:00:46.102 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.110+0000 7f9b32ffd700 1 -- 172.21.15.42:0/2488714546 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c003d60 con 0x7f9b441574f0 2023-07-29T02:00:46.103 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.110+0000 7f9b48805700 1 -- 172.21.15.42:0/2488714546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b441ecca0 con 0x7f9b441574f0 2023-07-29T02:00:46.103 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.110+0000 7f9b32ffd700 1 -- 172.21.15.42:0/2488714546 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c00ab90 con 0x7f9b441574f0 2023-07-29T02:00:46.103 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.110+0000 7f9b48805700 1 -- 172.21.15.42:0/2488714546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b441599b0 con 0x7f9b441574f0 2023-07-29T02:00:46.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.111+0000 7f9b48805700 1 -- 172.21.15.42:0/2488714546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b441ed1c0 con 0x7f9b441574f0 2023-07-29T02:00:46.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.111+0000 7f9b32ffd700 1 -- 172.21.15.42:0/2488714546 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f9b3c00acf0 con 0x7f9b441574f0 2023-07-29T02:00:46.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.112+0000 7f9b32ffd700 1 --2- 172.21.15.42:0/2488714546 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9b2406a660 0x7f9b2406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.112+0000 7f9b32ffd700 1 -- 172.21.15.42:0/2488714546 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6850+0+0 (secure 0 0 0) 0x7f9b3c088e20 con 0x7f9b441574f0 2023-07-29T02:00:46.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.112+0000 7f9b4259c700 1 --2- 172.21.15.42:0/2488714546 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9b2406a660 0x7f9b2406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.112+0000 7f9b4259c700 1 --2- 172.21.15.42:0/2488714546 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9b2406a660 0x7f9b2406cb10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9b34000c00 tx=0x7f9b3401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:46.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.116+0000 7f9b32ffd700 1 -- 172.21.15.42:0/2488714546 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f9b441ed1c0 con 0x7f9b441574f0 2023-07-29T02:00:46.302 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.315+0000 7f9b48805700 1 -- 172.21.15.42:0/2488714546 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9b441ed1c0 con 0x7f9b441574f0 2023-07-29T02:00:46.303 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.315+0000 7f9b32ffd700 1 -- 172.21.15.42:0/2488714546 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9b441ed1c0 con 0x7f9b441574f0 2023-07-29T02:00:46.303 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2023-07-29T02:00:46.305 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.317+0000 7f9b48805700 1 -- 172.21.15.42:0/2488714546 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9b2406a660 msgr2=0x7f9b2406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:46.305 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.317+0000 7f9b48805700 1 --2- 172.21.15.42:0/2488714546 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9b2406a660 0x7f9b2406cb10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9b34000c00 tx=0x7f9b3401c040 comp rx=0 tx=0).stop 2023-07-29T02:00:46.305 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.317+0000 7f9b48805700 1 -- 172.21.15.42:0/2488714546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b441574f0 msgr2=0x7f9b4413d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:46.305 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.317+0000 7f9b48805700 1 --2- 172.21.15.42:0/2488714546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b441574f0 0x7f9b4413d5c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00cbc0 tx=0x7f9b3c00cf80 comp rx=0 tx=0).stop 2023-07-29T02:00:46.305 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.317+0000 7f9b48805700 1 -- 172.21.15.42:0/2488714546 shutdown_connections 2023-07-29T02:00:46.305 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.317+0000 7f9b48805700 1 --2- 172.21.15.42:0/2488714546 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9b2406a660 0x7f9b2406cb10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.306 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.317+0000 7f9b48805700 1 --2- 172.21.15.42:0/2488714546 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9b441574f0 0x7f9b4413d5c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.306 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.317+0000 7f9b48805700 1 --2- 172.21.15.42:0/2488714546 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9b44071120 0x7f9b44154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.306 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.317+0000 7f9b48805700 1 --2- 172.21.15.42:0/2488714546 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9b4413ed20 0x7f9b44134da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.306 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.317+0000 7f9b48805700 1 -- 172.21.15.42:0/2488714546 >> 172.21.15.42:0/2488714546 conn(0x7f9b440ccc50 msgr2=0x7f9b440c8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:46.306 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.317+0000 7f9b48805700 1 -- 172.21.15.42:0/2488714546 shutdown_connections 2023-07-29T02:00:46.306 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.317+0000 7f9b48805700 1 -- 172.21.15.42:0/2488714546 wait complete. 2023-07-29T02:00:46.317 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2023-07-29T02:00:46.317 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:00:46.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.455+0000 7f00813a9700 1 Processor -- start 2023-07-29T02:00:46.443 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.455+0000 7f00813a9700 1 -- start start 2023-07-29T02:00:46.444 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.456+0000 7f00813a9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f007c0cf460 0x7f007c0b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.444 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.456+0000 7f00813a9700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f007c159cb0 0x7f007c15a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.444 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.456+0000 7f00813a9700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f007c0cf830 0x7f007c1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.444 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.456+0000 7f00813a9700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007c0b3660 con 0x7f007c0cf830 2023-07-29T02:00:46.445 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.456+0000 7f00813a9700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007c0b31d0 con 0x7f007c159cb0 2023-07-29T02:00:46.445 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.456+0000 7f00813a9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007c15a1a0 con 0x7f007c0cf460 2023-07-29T02:00:46.445 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.456+0000 7f007b7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f007c0cf830 0x7f007c1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.445 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.456+0000 7f007b7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f007c0cf830 0x7f007c1563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57074/0 (socket says 172.21.15.42:57074) 2023-07-29T02:00:46.445 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.456+0000 7f007b7fe700 1 -- 172.21.15.42:0/1069525440 learned_addr learned my addr 172.21.15.42:0/1069525440 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:46.445 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.456+0000 7f007a7fc700 1 --2- 172.21.15.42:0/1069525440 >> v2:172.21.15.144:3300/0 conn(0x7f007c159cb0 0x7f007c15a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.445 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.456+0000 7f007affd700 1 --2- 172.21.15.42:0/1069525440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f007c0cf460 0x7f007c0b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.456+0000 7f007b7fe700 1 -- 172.21.15.42:0/1069525440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f007c0cf460 msgr2=0x7f007c0b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:46.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.456+0000 7f007b7fe700 1 --2- 172.21.15.42:0/1069525440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f007c0cf460 0x7f007c0b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.456+0000 7f007b7fe700 1 -- 172.21.15.42:0/1069525440 >> v2:172.21.15.144:3300/0 conn(0x7f007c159cb0 msgr2=0x7f007c15a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:46.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.456+0000 7f007b7fe700 1 --2- 172.21.15.42:0/1069525440 >> v2:172.21.15.144:3300/0 conn(0x7f007c159cb0 0x7f007c15a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.456+0000 7f007b7fe700 1 -- 172.21.15.42:0/1069525440 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007c0b2600 con 0x7f007c0cf830 2023-07-29T02:00:46.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.456+0000 7f007a7fc700 1 --2- 172.21.15.42:0/1069525440 >> v2:172.21.15.144:3300/0 conn(0x7f007c159cb0 0x7f007c15a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:46.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.456+0000 7f007b7fe700 1 --2- 172.21.15.42:0/1069525440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f007c0cf830 0x7f007c1563e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f007c0ccd50 tx=0x7f007400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c853a9aebb46dc server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:46.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.457+0000 7f0079ffb700 1 -- 172.21.15.42:0/1069525440 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007400e070 con 0x7f007c0cf830 2023-07-29T02:00:46.447 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.457+0000 7f0079ffb700 1 -- 172.21.15.42:0/1069525440 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007400b910 con 0x7f007c0cf830 2023-07-29T02:00:46.447 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.457+0000 7f0079ffb700 1 -- 172.21.15.42:0/1069525440 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007400bcc0 con 0x7f007c0cf830 2023-07-29T02:00:46.449 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.457+0000 7f00813a9700 1 -- 172.21.15.42:0/1069525440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f007c0cf830 msgr2=0x7f007c1563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:46.449 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.457+0000 7f00813a9700 1 --2- 172.21.15.42:0/1069525440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f007c0cf830 0x7f007c1563e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f007c0ccd50 tx=0x7f007400b330 comp rx=0 tx=0).stop 2023-07-29T02:00:46.449 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.457+0000 7f00813a9700 1 -- 172.21.15.42:0/1069525440 shutdown_connections 2023-07-29T02:00:46.449 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.457+0000 7f00813a9700 1 --2- 172.21.15.42:0/1069525440 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f007c0cf460 0x7f007c0b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.450 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.457+0000 7f00813a9700 1 --2- 172.21.15.42:0/1069525440 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f007c0cf830 0x7f007c1563e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.450 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.457+0000 7f00813a9700 1 --2- 172.21.15.42:0/1069525440 >> v2:172.21.15.144:3300/0 conn(0x7f007c159cb0 0x7f007c15a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.450 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.457+0000 7f00813a9700 1 -- 172.21.15.42:0/1069525440 >> 172.21.15.42:0/1069525440 conn(0x7f007c06ca60 msgr2=0x7f007c06ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:46.450 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.457+0000 7f00813a9700 1 -- 172.21.15.42:0/1069525440 shutdown_connections 2023-07-29T02:00:46.450 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.457+0000 7f00813a9700 1 -- 172.21.15.42:0/1069525440 wait complete. 2023-07-29T02:00:46.450 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.459+0000 7f00813a9700 1 Processor -- start 2023-07-29T02:00:46.450 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.459+0000 7f00813a9700 1 -- start start 2023-07-29T02:00:46.450 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.460+0000 7f00813a9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f007c0cf460 0x7f007c1f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.460+0000 7f00813a9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f007c0cf830 0x7f007c0cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.460+0000 7f00813a9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f007c159cb0 0x7f007c1eee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.460+0000 7f00813a9700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c1ee990 con 0x7f007c159cb0 2023-07-29T02:00:46.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.460+0000 7f00813a9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c1f2c20 con 0x7f007c0cf830 2023-07-29T02:00:46.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.460+0000 7f00813a9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007c1e2e60 con 0x7f007c0cf460 2023-07-29T02:00:46.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.460+0000 7f007b7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f007c159cb0 0x7f007c1eee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.460+0000 7f007b7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f007c159cb0 0x7f007c1eee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57080/0 (socket says 172.21.15.42:57080) 2023-07-29T02:00:46.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.460+0000 7f007b7fe700 1 -- 172.21.15.42:0/3174125818 learned_addr learned my addr 172.21.15.42:0/3174125818 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:46.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.460+0000 7f007affd700 1 --2- 172.21.15.42:0/3174125818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f007c0cf460 0x7f007c1f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.460+0000 7f007a7fc700 1 --2- 172.21.15.42:0/3174125818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f007c0cf830 0x7f007c0cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.460+0000 7f007b7fe700 1 -- 172.21.15.42:0/3174125818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f007c0cf460 msgr2=0x7f007c1f26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:46.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.460+0000 7f007b7fe700 1 --2- 172.21.15.42:0/3174125818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f007c0cf460 0x7f007c1f26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.460+0000 7f007b7fe700 1 -- 172.21.15.42:0/3174125818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f007c0cf830 msgr2=0x7f007c0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:46.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.460+0000 7f007b7fe700 1 --2- 172.21.15.42:0/3174125818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f007c0cf830 0x7f007c0cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.460+0000 7f007b7fe700 1 -- 172.21.15.42:0/3174125818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0074009b30 con 0x7f007c159cb0 2023-07-29T02:00:46.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.461+0000 7f007b7fe700 1 --2- 172.21.15.42:0/3174125818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f007c159cb0 0x7f007c1eee20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0074012000 tx=0x7f0074004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:46.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.461+0000 7f00637fe700 1 -- 172.21.15.42:0/3174125818 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00740099b0 con 0x7f007c159cb0 2023-07-29T02:00:46.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.461+0000 7f00637fe700 1 -- 172.21.15.42:0/3174125818 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0074004250 con 0x7f007c159cb0 2023-07-29T02:00:46.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.461+0000 7f00813a9700 1 -- 172.21.15.42:0/3174125818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007c1e2380 con 0x7f007c159cb0 2023-07-29T02:00:46.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.461+0000 7f00637fe700 1 -- 172.21.15.42:0/3174125818 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0074004600 con 0x7f007c159cb0 2023-07-29T02:00:46.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.461+0000 7f00813a9700 1 -- 172.21.15.42:0/3174125818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007c1e3390 con 0x7f007c159cb0 2023-07-29T02:00:46.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.462+0000 7f00617fa700 1 -- 172.21.15.42:0/3174125818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007c1eeb40 con 0x7f007c159cb0 2023-07-29T02:00:46.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.462+0000 7f00637fe700 1 -- 172.21.15.42:0/3174125818 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f0074004760 con 0x7f007c159cb0 2023-07-29T02:00:46.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.463+0000 7f00637fe700 1 --2- 172.21.15.42:0/3174125818 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f006806a660 0x7f006806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.463+0000 7f00637fe700 1 -- 172.21.15.42:0/3174125818 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6850+0+0 (secure 0 0 0) 0x7f0074089ed0 con 0x7f007c159cb0 2023-07-29T02:00:46.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.463+0000 7f007affd700 1 --2- 172.21.15.42:0/3174125818 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f006806a660 0x7f006806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.463+0000 7f007affd700 1 --2- 172.21.15.42:0/3174125818 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f006806a660 0x7f006806cb10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f006c009a50 tx=0x7f006c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:46.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.467+0000 7f00637fe700 1 -- 172.21.15.42:0/3174125818 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f007c1eeb40 con 0x7f007c159cb0 2023-07-29T02:00:46.703 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.716+0000 7f00617fa700 1 -- 172.21.15.42:0/3174125818 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f007c1eeb40 con 0x7f007c159cb0 2023-07-29T02:00:46.704 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.717+0000 7f00637fe700 1 -- 172.21.15.42:0/3174125818 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6165 (secure 0 0 0) 0x7f007c1eeb40 con 0x7f007c159cb0 2023-07-29T02:00:46.704 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:46.705 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:00:26.432410+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6837/1851767861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1851767861},{"type":"v1","addr":"172.21.15.42:6837","nonce":1851767861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:00:46.706 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.719+0000 7f00617fa700 1 -- 172.21.15.42:0/3174125818 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f006806a660 msgr2=0x7f006806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:46.706 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.719+0000 7f00617fa700 1 --2- 172.21.15.42:0/3174125818 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f006806a660 0x7f006806cb10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f006c009a50 tx=0x7f006c008040 comp rx=0 tx=0).stop 2023-07-29T02:00:46.706 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.719+0000 7f00617fa700 1 -- 172.21.15.42:0/3174125818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f007c159cb0 msgr2=0x7f007c1eee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:46.706 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.719+0000 7f00617fa700 1 --2- 172.21.15.42:0/3174125818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f007c159cb0 0x7f007c1eee20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0074012000 tx=0x7f0074004ad0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.707 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.719+0000 7f00617fa700 1 -- 172.21.15.42:0/3174125818 shutdown_connections 2023-07-29T02:00:46.707 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.719+0000 7f00617fa700 1 --2- 172.21.15.42:0/3174125818 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f006806a660 0x7f006806cb10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.707 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.719+0000 7f00617fa700 1 --2- 172.21.15.42:0/3174125818 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f007c159cb0 0x7f007c1eee20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.707 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.719+0000 7f00617fa700 1 --2- 172.21.15.42:0/3174125818 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f007c0cf460 0x7f007c1f26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.707 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.719+0000 7f00617fa700 1 --2- 172.21.15.42:0/3174125818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f007c0cf830 0x7f007c0cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.707 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.719+0000 7f00617fa700 1 -- 172.21.15.42:0/3174125818 >> 172.21.15.42:0/3174125818 conn(0x7f007c06ca60 msgr2=0x7f007c1e3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:46.707 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.719+0000 7f00617fa700 1 -- 172.21.15.42:0/3174125818 shutdown_connections 2023-07-29T02:00:46.708 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.719+0000 7f00617fa700 1 -- 172.21.15.42:0/3174125818 wait complete. 2023-07-29T02:00:46.708 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 10 2023-07-29T02:00:46.718 INFO:tasks.mds_thrash:Ready to start thrashing 2023-07-29T02:00:46.718 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2023-07-29T02:00:46.719 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T02:00:46.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.855+0000 7fcb288aa700 1 Processor -- start 2023-07-29T02:00:46.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.856+0000 7fcb288aa700 1 -- start start 2023-07-29T02:00:46.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.856+0000 7fcb288aa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb2414c630 0x7fcb2406c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.856+0000 7fcb288aa700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcb240c7270 0x7fcb2406d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.856+0000 7fcb288aa700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2406ce40 con 0x7fcb2414ca00 2023-07-29T02:00:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.856+0000 7fcb288aa700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb24155d50 con 0x7fcb240c7270 2023-07-29T02:00:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.856+0000 7fcb288aa700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb24156010 con 0x7fcb2414c630 2023-07-29T02:00:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb21d9b700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fcb2414ca00 0x7fcb240c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50890/0 (socket says 172.21.15.42:50890) 2023-07-29T02:00:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb21d9b700 1 -- 172.21.15.42:0/3569691983 learned_addr learned my addr 172.21.15.42:0/3569691983 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb2259c700 1 --2- 172.21.15.42:0/3569691983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb2414c630 0x7fcb2406c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb2159a700 1 -- 172.21.15.42:0/3569691983 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380729318 0 0) 0x7fcb2406ce40 con 0x7fcb2414ca00 2023-07-29T02:00:46.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb22d9d700 1 --2- 172.21.15.42:0/3569691983 >> v2:172.21.15.144:3300/0 conn(0x7fcb240c7270 0x7fcb2406d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb2159a700 1 -- 172.21.15.42:0/3569691983 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb0c0035b0 con 0x7fcb2414ca00 2023-07-29T02:00:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb2159a700 1 -- 172.21.15.42:0/3569691983 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1068153285 0 0) 0x7fcb0c0035b0 con 0x7fcb2414ca00 2023-07-29T02:00:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb2159a700 1 -- 172.21.15.42:0/3569691983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb2414c630 msgr2=0x7fcb2406c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb2159a700 1 --2- 172.21.15.42:0/3569691983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb2414c630 0x7fcb2406c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb2159a700 1 -- 172.21.15.42:0/3569691983 >> v2:172.21.15.144:3300/0 conn(0x7fcb240c7270 msgr2=0x7fcb2406d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb2159a700 1 --2- 172.21.15.42:0/3569691983 >> v2:172.21.15.144:3300/0 conn(0x7fcb240c7270 0x7fcb2406d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.847 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb2159a700 1 -- 172.21.15.42:0/3569691983 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb241562f0 con 0x7fcb2414ca00 2023-07-29T02:00:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb2159a700 1 -- 172.21.15.42:0/3569691983 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7fcb18001670 con 0x7fcb2414ca00 2023-07-29T02:00:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb2159a700 1 -- 172.21.15.42:0/3569691983 >> v1:172.21.15.42:6789/0 conn(0x7fcb2414ca00 legacy=0x7fcb240c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb2159a700 1 --2- 172.21.15.42:0/3569691983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb0c003a00 0x7fcb0c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb2159a700 1 --2- 172.21.15.42:0/3569691983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb2414c630 0x7fcb0c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb2159a700 1 --2- 172.21.15.42:0/3569691983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb0c004d90 0x7fcb0c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb2159a700 1 -- 172.21.15.42:0/3569691983 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb24155d50 con 0x7fcb0c004d90 2023-07-29T02:00:46.848 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb2159a700 1 -- 172.21.15.42:0/3569691983 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb24156010 con 0x7fcb0c003a00 2023-07-29T02:00:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb2159a700 1 -- 172.21.15.42:0/3569691983 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c00ba10 con 0x7fcb2414c630 2023-07-29T02:00:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb22d9d700 1 --2- 172.21.15.42:0/3569691983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb0c004d90 0x7fcb0c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb2259c700 1 --2- 172.21.15.42:0/3569691983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb0c003a00 0x7fcb0c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.857+0000 7fcb21d9b700 1 --2- 172.21.15.42:0/3569691983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb2414c630 0x7fcb0c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.858+0000 7fcb22d9d700 1 -- 172.21.15.42:0/3569691983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb2414c630 msgr2=0x7fcb0c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.858+0000 7fcb22d9d700 1 --2- 172.21.15.42:0/3569691983 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb2414c630 0x7fcb0c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.858+0000 7fcb22d9d700 1 -- 172.21.15.42:0/3569691983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb0c003a00 msgr2=0x7fcb0c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:46.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.858+0000 7fcb22d9d700 1 --2- 172.21.15.42:0/3569691983 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb0c003a00 0x7fcb0c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.858+0000 7fcb22d9d700 1 -- 172.21.15.42:0/3569691983 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c0035b0 con 0x7fcb0c004d90 2023-07-29T02:00:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.858+0000 7fcb22d9d700 1 --2- 172.21.15.42:0/3569691983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb0c004d90 0x7fcb0c005200 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcb14009b30 tx=0x7fcb0c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0de7b5e398723f server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.858+0000 7fcb2159a700 1 -- 172.21.15.42:0/3569691983 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1400e660 con 0x7fcb0c004d90 2023-07-29T02:00:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.858+0000 7fcb2159a700 1 -- 172.21.15.42:0/3569691983 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1400e7c0 con 0x7fcb0c004d90 2023-07-29T02:00:46.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.858+0000 7fcb2159a700 1 -- 172.21.15.42:0/3569691983 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1400eb30 con 0x7fcb0c004d90 2023-07-29T02:00:46.852 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.858+0000 7fcb288aa700 1 -- 172.21.15.42:0/3569691983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb0c004d90 msgr2=0x7fcb0c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:46.852 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.858+0000 7fcb288aa700 1 --2- 172.21.15.42:0/3569691983 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb0c004d90 0x7fcb0c005200 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fcb14009b30 tx=0x7fcb0c005880 comp rx=0 tx=0).stop 2023-07-29T02:00:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.858+0000 7fcb22d9d700 1 -- 172.21.15.42:0/3569691983 reap_dead start 2023-07-29T02:00:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.859+0000 7fcb288aa700 1 -- 172.21.15.42:0/3569691983 shutdown_connections 2023-07-29T02:00:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.859+0000 7fcb288aa700 1 -- 172.21.15.42:0/3569691983 >> 172.21.15.42:0/3569691983 conn(0x7fcb240c8970 msgr2=0x7fcb240c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.859+0000 7fcb288aa700 1 -- 172.21.15.42:0/3569691983 shutdown_connections 2023-07-29T02:00:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.859+0000 7fcb288aa700 1 -- 172.21.15.42:0/3569691983 wait complete. 2023-07-29T02:00:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.860+0000 7fcb288aa700 1 Processor -- start 2023-07-29T02:00:46.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.860+0000 7fcb288aa700 1 -- start start 2023-07-29T02:00:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb288aa700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb0c004d90 0x7fcb24158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb288aa700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb240c4c30 0x7fcb240c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb288aa700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb24154c10 0x7fcb24155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb288aa700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb240c47e0 con 0x7fcb240c4c30 2023-07-29T02:00:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb288aa700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb24158570 con 0x7fcb0c004d90 2023-07-29T02:00:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb288aa700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2415a1d0 con 0x7fcb24154c10 2023-07-29T02:00:46.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb21d9b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb240c4c30 0x7fcb240c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb21d9b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb240c4c30 0x7fcb240c50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57098/0 (socket says 172.21.15.42:57098) 2023-07-29T02:00:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb21d9b700 1 -- 172.21.15.42:0/1947551843 learned_addr learned my addr 172.21.15.42:0/1947551843 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb2259c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb0c004d90 0x7fcb24158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb22d9d700 1 --2- 172.21.15.42:0/1947551843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb24154c10 0x7fcb24155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb21d9b700 1 -- 172.21.15.42:0/1947551843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb24154c10 msgr2=0x7fcb24155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb21d9b700 1 --2- 172.21.15.42:0/1947551843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb24154c10 0x7fcb24155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb21d9b700 1 -- 172.21.15.42:0/1947551843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb0c004d90 msgr2=0x7fcb24158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:46.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb21d9b700 1 --2- 172.21.15.42:0/1947551843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb0c004d90 0x7fcb24158030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:46.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb21d9b700 1 -- 172.21.15.42:0/1947551843 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb24155aa0 con 0x7fcb240c4c30 2023-07-29T02:00:46.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb21d9b700 1 --2- 172.21.15.42:0/1947551843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb240c4c30 0x7fcb240c50a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcb180072c0 tx=0x7fcb180075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:46.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb12ffd700 1 -- 172.21.15.42:0/1947551843 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18007d10 con 0x7fcb240c4c30 2023-07-29T02:00:46.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb12ffd700 1 -- 172.21.15.42:0/1947551843 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1800f620 con 0x7fcb240c4c30 2023-07-29T02:00:46.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb288aa700 1 -- 172.21.15.42:0/1947551843 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb24157040 con 0x7fcb240c4c30 2023-07-29T02:00:46.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb12ffd700 1 -- 172.21.15.42:0/1947551843 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1800f9b0 con 0x7fcb240c4c30 2023-07-29T02:00:46.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.861+0000 7fcb288aa700 1 -- 172.21.15.42:0/1947551843 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb240c3bb0 con 0x7fcb240c4c30 2023-07-29T02:00:46.857 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.863+0000 7fcb288aa700 1 -- 172.21.15.42:0/1947551843 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb24074740 con 0x7fcb240c4c30 2023-07-29T02:00:46.857 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.863+0000 7fcb12ffd700 1 -- 172.21.15.42:0/1947551843 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fcb1800fb10 con 0x7fcb240c4c30 2023-07-29T02:00:46.857 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.863+0000 7fcb12ffd700 1 --2- 172.21.15.42:0/1947551843 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcb0406a660 0x7fcb0406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:46.857 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.864+0000 7fcb12ffd700 1 -- 172.21.15.42:0/1947551843 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6850+0+0 (secure 0 0 0) 0x7fcb180888b0 con 0x7fcb240c4c30 2023-07-29T02:00:46.857 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.864+0000 7fcb2259c700 1 --2- 172.21.15.42:0/1947551843 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcb0406a660 0x7fcb0406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:46.857 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.864+0000 7fcb2259c700 1 --2- 172.21.15.42:0/1947551843 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcb0406a660 0x7fcb0406cb10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c014450 tx=0x7fcb1c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:46.858 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:46.868+0000 7fcb12ffd700 1 -- 172.21.15.42:0/1947551843 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fcb18053980 con 0x7fcb240c4c30 2023-07-29T02:00:47.049 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.062+0000 7fcb288aa700 1 -- 172.21.15.42:0/1947551843 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb241568b0 con 0x7fcb0406a660 2023-07-29T02:00:47.060 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.073+0000 7fcb12ffd700 1 -- 172.21.15.42:0/1947551843 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367628 (secure 0 0 0) 0x7fcb1c00f040 con 0x7fcb0406a660 2023-07-29T02:00:47.064 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:47.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.076+0000 7fcb288aa700 1 -- 172.21.15.42:0/1947551843 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcb0406a660 msgr2=0x7fcb0406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:47.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.076+0000 7fcb288aa700 1 --2- 172.21.15.42:0/1947551843 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcb0406a660 0x7fcb0406cb10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c014450 tx=0x7fcb1c00b040 comp rx=0 tx=0).stop 2023-07-29T02:00:47.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.076+0000 7fcb288aa700 1 -- 172.21.15.42:0/1947551843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb240c4c30 msgr2=0x7fcb240c50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:47.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.076+0000 7fcb288aa700 1 --2- 172.21.15.42:0/1947551843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb240c4c30 0x7fcb240c50a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcb180072c0 tx=0x7fcb180075d0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.076+0000 7fcb288aa700 1 -- 172.21.15.42:0/1947551843 shutdown_connections 2023-07-29T02:00:47.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.076+0000 7fcb288aa700 1 --2- 172.21.15.42:0/1947551843 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcb0406a660 0x7fcb0406cb10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.067 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.076+0000 7fcb288aa700 1 --2- 172.21.15.42:0/1947551843 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcb24154c10 0x7fcb24155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.067 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.076+0000 7fcb288aa700 1 --2- 172.21.15.42:0/1947551843 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb0c004d90 0x7fcb24158030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.067 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.076+0000 7fcb288aa700 1 --2- 172.21.15.42:0/1947551843 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcb240c4c30 0x7fcb240c50a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.067 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.076+0000 7fcb288aa700 1 -- 172.21.15.42:0/1947551843 >> 172.21.15.42:0/1947551843 conn(0x7fcb240c8970 msgr2=0x7fcb240c58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:47.067 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.076+0000 7fcb288aa700 1 -- 172.21.15.42:0/1947551843 shutdown_connections 2023-07-29T02:00:47.067 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.076+0000 7fcb288aa700 1 -- 172.21.15.42:0/1947551843 wait complete. 2023-07-29T02:00:47.067 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2023-07-29T02:00:47.076 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":48,"stamp":"2023-07-29T02:00:46.520752+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595217,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":209,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217884,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756836,"statfs":{"total":773094113280,"available":772871000064,"internally_reserved":0,"allocated":2322432,"data_stored":2064681,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":260,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.279213"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972736+0000","last_change":"2023-07-29T01:59:57.958129+0000","last_active":"2023-07-29T02:00:01.972736+0000","last_peered":"2023-07-29T02:00:01.972736+0000","last_clean":"2023-07-29T02:00:01.972736+0000","last_became_active":"2023-07-29T01:59:57.957742+0000","last_became_peered":"2023-07-29T01:59:57.957742+0000","last_unstale":"2023-07-29T02:00:01.972736+0000","last_undegraded":"2023-07-29T02:00:01.972736+0000","last_fullsized":"2023-07-29T02:00:01.972736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:32.550358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975520+0000","last_change":"2023-07-29T01:59:57.974652+0000","last_active":"2023-07-29T02:00:01.975520+0000","last_peered":"2023-07-29T02:00:01.975520+0000","last_clean":"2023-07-29T02:00:01.975520+0000","last_became_active":"2023-07-29T01:59:57.974338+0000","last_became_peered":"2023-07-29T01:59:57.974338+0000","last_unstale":"2023-07-29T02:00:01.975520+0000","last_undegraded":"2023-07-29T02:00:01.975520+0000","last_fullsized":"2023-07-29T02:00:01.975520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978265+0000","last_change":"2023-07-29T01:59:57.973621+0000","last_active":"2023-07-29T02:00:01.978265+0000","last_peered":"2023-07-29T02:00:01.978265+0000","last_clean":"2023-07-29T02:00:01.978265+0000","last_became_active":"2023-07-29T01:59:57.973406+0000","last_became_peered":"2023-07-29T01:59:57.973406+0000","last_unstale":"2023-07-29T02:00:01.978265+0000","last_undegraded":"2023-07-29T02:00:01.978265+0000","last_fullsized":"2023-07-29T02:00:01.978265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:08:23.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968045+0000","last_change":"2023-07-29T01:59:57.965192+0000","last_active":"2023-07-29T02:00:01.968045+0000","last_peered":"2023-07-29T02:00:01.968045+0000","last_clean":"2023-07-29T02:00:01.968045+0000","last_became_active":"2023-07-29T01:59:57.964865+0000","last_became_peered":"2023-07-29T01:59:57.964865+0000","last_unstale":"2023-07-29T02:00:01.968045+0000","last_undegraded":"2023-07-29T02:00:01.968045+0000","last_fullsized":"2023-07-29T02:00:01.968045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:32.905717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967106+0000","last_change":"2023-07-29T01:59:57.971026+0000","last_active":"2023-07-29T02:00:01.967106+0000","last_peered":"2023-07-29T02:00:01.967106+0000","last_clean":"2023-07-29T02:00:01.967106+0000","last_became_active":"2023-07-29T01:59:57.970733+0000","last_became_peered":"2023-07-29T01:59:57.970733+0000","last_unstale":"2023-07-29T02:00:01.967106+0000","last_undegraded":"2023-07-29T02:00:01.967106+0000","last_fullsized":"2023-07-29T02:00:01.967106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971129+0000","last_change":"2023-07-29T01:59:57.965729+0000","last_active":"2023-07-29T02:00:01.971129+0000","last_peered":"2023-07-29T02:00:01.971129+0000","last_clean":"2023-07-29T02:00:01.971129+0000","last_became_active":"2023-07-29T01:59:57.964993+0000","last_became_peered":"2023-07-29T01:59:57.964993+0000","last_unstale":"2023-07-29T02:00:01.971129+0000","last_undegraded":"2023-07-29T02:00:01.971129+0000","last_fullsized":"2023-07-29T02:00:01.971129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974411+0000","last_change":"2023-07-29T01:59:57.970481+0000","last_active":"2023-07-29T02:00:01.974411+0000","last_peered":"2023-07-29T02:00:01.974411+0000","last_clean":"2023-07-29T02:00:01.974411+0000","last_became_active":"2023-07-29T01:59:57.970232+0000","last_became_peered":"2023-07-29T01:59:57.970232+0000","last_unstale":"2023-07-29T02:00:01.974411+0000","last_undegraded":"2023-07-29T02:00:01.974411+0000","last_fullsized":"2023-07-29T02:00:01.974411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974000+0000","last_change":"2023-07-29T01:59:57.963201+0000","last_active":"2023-07-29T02:00:01.974000+0000","last_peered":"2023-07-29T02:00:01.974000+0000","last_clean":"2023-07-29T02:00:01.974000+0000","last_became_active":"2023-07-29T01:59:57.962884+0000","last_became_peered":"2023-07-29T01:59:57.962884+0000","last_unstale":"2023-07-29T02:00:01.974000+0000","last_undegraded":"2023-07-29T02:00:01.974000+0000","last_fullsized":"2023-07-29T02:00:01.974000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967238+0000","last_change":"2023-07-29T01:59:57.971916+0000","last_active":"2023-07-29T02:00:01.967238+0000","last_peered":"2023-07-29T02:00:01.967238+0000","last_clean":"2023-07-29T02:00:01.967238+0000","last_became_active":"2023-07-29T01:59:57.971640+0000","last_became_peered":"2023-07-29T01:59:57.971640+0000","last_unstale":"2023-07-29T02:00:01.967238+0000","last_undegraded":"2023-07-29T02:00:01.967238+0000","last_fullsized":"2023-07-29T02:00:01.967238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975619+0000","last_change":"2023-07-29T01:59:57.963080+0000","last_active":"2023-07-29T02:00:01.975619+0000","last_peered":"2023-07-29T02:00:01.975619+0000","last_clean":"2023-07-29T02:00:01.975619+0000","last_became_active":"2023-07-29T01:59:57.962799+0000","last_became_peered":"2023-07-29T01:59:57.962799+0000","last_unstale":"2023-07-29T02:00:01.975619+0000","last_undegraded":"2023-07-29T02:00:01.975619+0000","last_fullsized":"2023-07-29T02:00:01.975619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978173+0000","last_change":"2023-07-29T01:59:57.970172+0000","last_active":"2023-07-29T02:00:01.978173+0000","last_peered":"2023-07-29T02:00:01.978173+0000","last_clean":"2023-07-29T02:00:01.978173+0000","last_became_active":"2023-07-29T01:59:57.969868+0000","last_became_peered":"2023-07-29T01:59:57.969868+0000","last_unstale":"2023-07-29T02:00:01.978173+0000","last_undegraded":"2023-07-29T02:00:01.978173+0000","last_fullsized":"2023-07-29T02:00:01.978173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972765+0000","last_change":"2023-07-29T01:59:57.964171+0000","last_active":"2023-07-29T02:00:01.972765+0000","last_peered":"2023-07-29T02:00:01.972765+0000","last_clean":"2023-07-29T02:00:01.972765+0000","last_became_active":"2023-07-29T01:59:57.963902+0000","last_became_peered":"2023-07-29T01:59:57.963902+0000","last_unstale":"2023-07-29T02:00:01.972765+0000","last_undegraded":"2023-07-29T02:00:01.972765+0000","last_fullsized":"2023-07-29T02:00:01.972765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:51.691001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972884+0000","last_change":"2023-07-29T01:59:57.963492+0000","last_active":"2023-07-29T02:00:01.972884+0000","last_peered":"2023-07-29T02:00:01.972884+0000","last_clean":"2023-07-29T02:00:01.972884+0000","last_became_active":"2023-07-29T01:59:57.963239+0000","last_became_peered":"2023-07-29T01:59:57.963239+0000","last_unstale":"2023-07-29T02:00:01.972884+0000","last_undegraded":"2023-07-29T02:00:01.972884+0000","last_fullsized":"2023-07-29T02:00:01.972884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:08.001986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974742+0000","last_change":"2023-07-29T01:59:57.961369+0000","last_active":"2023-07-29T02:00:01.974742+0000","last_peered":"2023-07-29T02:00:01.974742+0000","last_clean":"2023-07-29T02:00:01.974742+0000","last_became_active":"2023-07-29T01:59:57.960709+0000","last_became_peered":"2023-07-29T01:59:57.960709+0000","last_unstale":"2023-07-29T02:00:01.974742+0000","last_undegraded":"2023-07-29T02:00:01.974742+0000","last_fullsized":"2023-07-29T02:00:01.974742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974229+0000","last_change":"2023-07-29T01:59:57.970498+0000","last_active":"2023-07-29T02:00:01.974229+0000","last_peered":"2023-07-29T02:00:01.974229+0000","last_clean":"2023-07-29T02:00:01.974229+0000","last_became_active":"2023-07-29T01:59:57.970263+0000","last_became_peered":"2023-07-29T01:59:57.970263+0000","last_unstale":"2023-07-29T02:00:01.974229+0000","last_undegraded":"2023-07-29T02:00:01.974229+0000","last_fullsized":"2023-07-29T02:00:01.974229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975567+0000","last_change":"2023-07-29T01:59:57.965648+0000","last_active":"2023-07-29T02:00:01.975567+0000","last_peered":"2023-07-29T02:00:01.975567+0000","last_clean":"2023-07-29T02:00:01.975567+0000","last_became_active":"2023-07-29T01:59:57.964696+0000","last_became_peered":"2023-07-29T01:59:57.964696+0000","last_unstale":"2023-07-29T02:00:01.975567+0000","last_undegraded":"2023-07-29T02:00:01.975567+0000","last_fullsized":"2023-07-29T02:00:01.975567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:19:14.641252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967346+0000","last_change":"2023-07-29T01:59:57.969148+0000","last_active":"2023-07-29T02:00:01.967346+0000","last_peered":"2023-07-29T02:00:01.967346+0000","last_clean":"2023-07-29T02:00:01.967346+0000","last_became_active":"2023-07-29T01:59:57.968885+0000","last_became_peered":"2023-07-29T01:59:57.968885+0000","last_unstale":"2023-07-29T02:00:01.967346+0000","last_undegraded":"2023-07-29T02:00:01.967346+0000","last_fullsized":"2023-07-29T02:00:01.967346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977442+0000","last_change":"2023-07-29T01:59:57.963189+0000","last_active":"2023-07-29T02:00:01.977442+0000","last_peered":"2023-07-29T02:00:01.977442+0000","last_clean":"2023-07-29T02:00:01.977442+0000","last_became_active":"2023-07-29T01:59:57.962919+0000","last_became_peered":"2023-07-29T01:59:57.962919+0000","last_unstale":"2023-07-29T02:00:01.977442+0000","last_undegraded":"2023-07-29T02:00:01.977442+0000","last_fullsized":"2023-07-29T02:00:01.977442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:16:58.718803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973218+0000","last_change":"2023-07-29T01:59:57.960380+0000","last_active":"2023-07-29T02:00:01.973218+0000","last_peered":"2023-07-29T02:00:01.973218+0000","last_clean":"2023-07-29T02:00:01.973218+0000","last_became_active":"2023-07-29T01:59:57.960111+0000","last_became_peered":"2023-07-29T01:59:57.960111+0000","last_unstale":"2023-07-29T02:00:01.973218+0000","last_undegraded":"2023-07-29T02:00:01.973218+0000","last_fullsized":"2023-07-29T02:00:01.973218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:45.956813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977046+0000","last_change":"2023-07-29T01:59:57.961945+0000","last_active":"2023-07-29T02:00:01.977046+0000","last_peered":"2023-07-29T02:00:01.977046+0000","last_clean":"2023-07-29T02:00:01.977046+0000","last_became_active":"2023-07-29T01:59:57.961655+0000","last_became_peered":"2023-07-29T01:59:57.961655+0000","last_unstale":"2023-07-29T02:00:01.977046+0000","last_undegraded":"2023-07-29T02:00:01.977046+0000","last_fullsized":"2023-07-29T02:00:01.977046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.203628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974482+0000","last_change":"2023-07-29T01:59:57.971030+0000","last_active":"2023-07-29T02:00:01.974482+0000","last_peered":"2023-07-29T02:00:01.974482+0000","last_clean":"2023-07-29T02:00:01.974482+0000","last_became_active":"2023-07-29T01:59:57.970757+0000","last_became_peered":"2023-07-29T01:59:57.970757+0000","last_unstale":"2023-07-29T02:00:01.974482+0000","last_undegraded":"2023-07-29T02:00:01.974482+0000","last_fullsized":"2023-07-29T02:00:01.974482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966509+0000","last_change":"2023-07-29T01:59:57.974734+0000","last_active":"2023-07-29T02:00:01.966509+0000","last_peered":"2023-07-29T02:00:01.966509+0000","last_clean":"2023-07-29T02:00:01.966509+0000","last_became_active":"2023-07-29T01:59:57.974436+0000","last_became_peered":"2023-07-29T01:59:57.974436+0000","last_unstale":"2023-07-29T02:00:01.966509+0000","last_undegraded":"2023-07-29T02:00:01.966509+0000","last_fullsized":"2023-07-29T02:00:01.966509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979698+0000","last_change":"2023-07-29T01:59:57.967259+0000","last_active":"2023-07-29T02:00:01.979698+0000","last_peered":"2023-07-29T02:00:01.979698+0000","last_clean":"2023-07-29T02:00:01.979698+0000","last_became_active":"2023-07-29T01:59:57.966987+0000","last_became_peered":"2023-07-29T01:59:57.966987+0000","last_unstale":"2023-07-29T02:00:01.979698+0000","last_undegraded":"2023-07-29T02:00:01.979698+0000","last_fullsized":"2023-07-29T02:00:01.979698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973494+0000","last_change":"2023-07-29T01:59:57.971976+0000","last_active":"2023-07-29T02:00:01.973494+0000","last_peered":"2023-07-29T02:00:01.973494+0000","last_clean":"2023-07-29T02:00:01.973494+0000","last_became_active":"2023-07-29T01:59:57.971733+0000","last_became_peered":"2023-07-29T01:59:57.971733+0000","last_unstale":"2023-07-29T02:00:01.973494+0000","last_undegraded":"2023-07-29T02:00:01.973494+0000","last_fullsized":"2023-07-29T02:00:01.973494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972112+0000","last_change":"2023-07-29T01:59:57.973644+0000","last_active":"2023-07-29T02:00:01.972112+0000","last_peered":"2023-07-29T02:00:01.972112+0000","last_clean":"2023-07-29T02:00:01.972112+0000","last_became_active":"2023-07-29T01:59:57.969742+0000","last_became_peered":"2023-07-29T01:59:57.969742+0000","last_unstale":"2023-07-29T02:00:01.972112+0000","last_undegraded":"2023-07-29T02:00:01.972112+0000","last_fullsized":"2023-07-29T02:00:01.972112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975642+0000","last_change":"2023-07-29T01:59:57.969779+0000","last_active":"2023-07-29T02:00:01.975642+0000","last_peered":"2023-07-29T02:00:01.975642+0000","last_clean":"2023-07-29T02:00:01.975642+0000","last_became_active":"2023-07-29T01:59:57.969409+0000","last_became_peered":"2023-07-29T01:59:57.969409+0000","last_unstale":"2023-07-29T02:00:01.975642+0000","last_undegraded":"2023-07-29T02:00:01.975642+0000","last_fullsized":"2023-07-29T02:00:01.975642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977989+0000","last_change":"2023-07-29T01:59:57.965799+0000","last_active":"2023-07-29T02:00:01.977989+0000","last_peered":"2023-07-29T02:00:01.977989+0000","last_clean":"2023-07-29T02:00:01.977989+0000","last_became_active":"2023-07-29T01:59:57.963774+0000","last_became_peered":"2023-07-29T01:59:57.963774+0000","last_unstale":"2023-07-29T02:00:01.977989+0000","last_undegraded":"2023-07-29T02:00:01.977989+0000","last_fullsized":"2023-07-29T02:00:01.977989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399488+0000","last_change":"2023-07-29T02:00:01.994114+0000","last_active":"2023-07-29T02:00:02.399488+0000","last_peered":"2023-07-29T02:00:02.399488+0000","last_clean":"2023-07-29T02:00:02.399488+0000","last_became_active":"2023-07-29T02:00:01.993731+0000","last_became_peered":"2023-07-29T02:00:01.993731+0000","last_unstale":"2023-07-29T02:00:02.399488+0000","last_undegraded":"2023-07-29T02:00:02.399488+0000","last_fullsized":"2023-07-29T02:00:02.399488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:14:25.422754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399152+0000","last_change":"2023-07-29T01:59:57.552913+0000","last_active":"2023-07-29T02:00:02.399152+0000","last_peered":"2023-07-29T02:00:02.399152+0000","last_clean":"2023-07-29T02:00:02.399152+0000","last_became_active":"2023-07-29T01:59:57.552673+0000","last_became_peered":"2023-07-29T01:59:57.552673+0000","last_unstale":"2023-07-29T02:00:02.399152+0000","last_undegraded":"2023-07-29T02:00:02.399152+0000","last_fullsized":"2023-07-29T02:00:02.399152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:49:56.335019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978862+0000","last_change":"2023-07-29T01:59:57.970140+0000","last_active":"2023-07-29T02:00:01.978862+0000","last_peered":"2023-07-29T02:00:01.978862+0000","last_clean":"2023-07-29T02:00:01.978862+0000","last_became_active":"2023-07-29T01:59:57.969821+0000","last_became_peered":"2023-07-29T01:59:57.969821+0000","last_unstale":"2023-07-29T02:00:01.978862+0000","last_undegraded":"2023-07-29T02:00:01.978862+0000","last_fullsized":"2023-07-29T02:00:01.978862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439205+0000","last_change":"2023-07-29T02:00:01.992728+0000","last_active":"2023-07-29T02:00:02.439205+0000","last_peered":"2023-07-29T02:00:02.439205+0000","last_clean":"2023-07-29T02:00:02.439205+0000","last_became_active":"2023-07-29T02:00:01.992338+0000","last_became_peered":"2023-07-29T02:00:01.992338+0000","last_unstale":"2023-07-29T02:00:02.439205+0000","last_undegraded":"2023-07-29T02:00:02.439205+0000","last_fullsized":"2023-07-29T02:00:02.439205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:37.968145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972242+0000","last_change":"2023-07-29T01:59:57.547793+0000","last_active":"2023-07-29T02:00:01.972242+0000","last_peered":"2023-07-29T02:00:01.972242+0000","last_clean":"2023-07-29T02:00:01.972242+0000","last_became_active":"2023-07-29T01:59:57.547455+0000","last_became_peered":"2023-07-29T01:59:57.547455+0000","last_unstale":"2023-07-29T02:00:01.972242+0000","last_undegraded":"2023-07-29T02:00:01.972242+0000","last_fullsized":"2023-07-29T02:00:01.972242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967048+0000","last_change":"2023-07-29T01:59:57.964646+0000","last_active":"2023-07-29T02:00:01.967048+0000","last_peered":"2023-07-29T02:00:01.967048+0000","last_clean":"2023-07-29T02:00:01.967048+0000","last_became_active":"2023-07-29T01:59:57.964393+0000","last_became_peered":"2023-07-29T01:59:57.964393+0000","last_unstale":"2023-07-29T02:00:01.967048+0000","last_undegraded":"2023-07-29T02:00:01.967048+0000","last_fullsized":"2023-07-29T02:00:01.967048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440161+0000","last_change":"2023-07-29T02:00:01.982883+0000","last_active":"2023-07-29T02:00:02.440161+0000","last_peered":"2023-07-29T02:00:02.440161+0000","last_clean":"2023-07-29T02:00:02.440161+0000","last_became_active":"2023-07-29T02:00:01.982042+0000","last_became_peered":"2023-07-29T02:00:01.982042+0000","last_unstale":"2023-07-29T02:00:02.440161+0000","last_undegraded":"2023-07-29T02:00:02.440161+0000","last_fullsized":"2023-07-29T02:00:02.440161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977952+0000","last_change":"2023-07-29T01:59:57.535286+0000","last_active":"2023-07-29T02:00:01.977952+0000","last_peered":"2023-07-29T02:00:01.977952+0000","last_clean":"2023-07-29T02:00:01.977952+0000","last_became_active":"2023-07-29T01:59:57.533523+0000","last_became_peered":"2023-07-29T01:59:57.533523+0000","last_unstale":"2023-07-29T02:00:01.977952+0000","last_undegraded":"2023-07-29T02:00:01.977952+0000","last_fullsized":"2023-07-29T02:00:01.977952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968772+0000","last_change":"2023-07-29T01:59:57.963792+0000","last_active":"2023-07-29T02:00:01.968772+0000","last_peered":"2023-07-29T02:00:01.968772+0000","last_clean":"2023-07-29T02:00:01.968772+0000","last_became_active":"2023-07-29T01:59:57.963466+0000","last_became_peered":"2023-07-29T01:59:57.963466+0000","last_unstale":"2023-07-29T02:00:01.968772+0000","last_undegraded":"2023-07-29T02:00:01.968772+0000","last_fullsized":"2023-07-29T02:00:01.968772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:28.048947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.438720+0000","last_change":"2023-07-29T02:00:01.984458+0000","last_active":"2023-07-29T02:00:02.438720+0000","last_peered":"2023-07-29T02:00:02.438720+0000","last_clean":"2023-07-29T02:00:02.438720+0000","last_became_active":"2023-07-29T02:00:01.984000+0000","last_became_peered":"2023-07-29T02:00:01.984000+0000","last_unstale":"2023-07-29T02:00:02.438720+0000","last_undegraded":"2023-07-29T02:00:02.438720+0000","last_fullsized":"2023-07-29T02:00:02.438720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967445+0000","last_change":"2023-07-29T01:59:57.537082+0000","last_active":"2023-07-29T02:00:01.967445+0000","last_peered":"2023-07-29T02:00:01.967445+0000","last_clean":"2023-07-29T02:00:01.967445+0000","last_became_active":"2023-07-29T01:59:57.536732+0000","last_became_peered":"2023-07-29T01:59:57.536732+0000","last_unstale":"2023-07-29T02:00:01.967445+0000","last_undegraded":"2023-07-29T02:00:01.967445+0000","last_fullsized":"2023-07-29T02:00:01.967445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977852+0000","last_change":"2023-07-29T01:59:57.971203+0000","last_active":"2023-07-29T02:00:01.977852+0000","last_peered":"2023-07-29T02:00:01.977852+0000","last_clean":"2023-07-29T02:00:01.977852+0000","last_became_active":"2023-07-29T01:59:57.970902+0000","last_became_peered":"2023-07-29T01:59:57.970902+0000","last_unstale":"2023-07-29T02:00:01.977852+0000","last_undegraded":"2023-07-29T02:00:01.977852+0000","last_fullsized":"2023-07-29T02:00:01.977852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399530+0000","last_change":"2023-07-29T02:00:01.991435+0000","last_active":"2023-07-29T02:00:02.399530+0000","last_peered":"2023-07-29T02:00:02.399530+0000","last_clean":"2023-07-29T02:00:02.399530+0000","last_became_active":"2023-07-29T02:00:01.989456+0000","last_became_peered":"2023-07-29T02:00:01.989456+0000","last_unstale":"2023-07-29T02:00:02.399530+0000","last_undegraded":"2023-07-29T02:00:02.399530+0000","last_fullsized":"2023-07-29T02:00:02.399530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975677+0000","last_change":"2023-07-29T01:59:57.540572+0000","last_active":"2023-07-29T02:00:01.975677+0000","last_peered":"2023-07-29T02:00:01.975677+0000","last_clean":"2023-07-29T02:00:01.975677+0000","last_became_active":"2023-07-29T01:59:57.540113+0000","last_became_peered":"2023-07-29T01:59:57.540113+0000","last_unstale":"2023-07-29T02:00:01.975677+0000","last_undegraded":"2023-07-29T02:00:01.975677+0000","last_fullsized":"2023-07-29T02:00:01.975677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979625+0000","last_change":"2023-07-29T01:59:57.967343+0000","last_active":"2023-07-29T02:00:01.979625+0000","last_peered":"2023-07-29T02:00:01.979625+0000","last_clean":"2023-07-29T02:00:01.979625+0000","last_became_active":"2023-07-29T01:59:57.967083+0000","last_became_peered":"2023-07-29T01:59:57.967083+0000","last_unstale":"2023-07-29T02:00:01.979625+0000","last_undegraded":"2023-07-29T02:00:01.979625+0000","last_fullsized":"2023-07-29T02:00:01.979625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441217+0000","last_change":"2023-07-29T02:00:01.996761+0000","last_active":"2023-07-29T02:00:02.441217+0000","last_peered":"2023-07-29T02:00:02.441217+0000","last_clean":"2023-07-29T02:00:02.441217+0000","last_became_active":"2023-07-29T02:00:01.996035+0000","last_became_peered":"2023-07-29T02:00:01.996035+0000","last_unstale":"2023-07-29T02:00:02.441217+0000","last_undegraded":"2023-07-29T02:00:02.441217+0000","last_fullsized":"2023-07-29T02:00:02.441217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"25'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958140+0000","last_change":"2023-07-29T01:59:57.548665+0000","last_active":"2023-07-29T02:00:02.958140+0000","last_peered":"2023-07-29T02:00:02.958140+0000","last_clean":"2023-07-29T02:00:02.958140+0000","last_became_active":"2023-07-29T01:59:57.547803+0000","last_became_peered":"2023-07-29T01:59:57.547803+0000","last_unstale":"2023-07-29T02:00:02.958140+0000","last_undegraded":"2023-07-29T02:00:02.958140+0000","last_fullsized":"2023-07-29T02:00:02.958140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971561+0000","last_change":"2023-07-29T01:59:57.969319+0000","last_active":"2023-07-29T02:00:01.971561+0000","last_peered":"2023-07-29T02:00:01.971561+0000","last_clean":"2023-07-29T02:00:01.971561+0000","last_became_active":"2023-07-29T01:59:57.969006+0000","last_became_peered":"2023-07-29T01:59:57.969006+0000","last_unstale":"2023-07-29T02:00:01.971561+0000","last_undegraded":"2023-07-29T02:00:01.971561+0000","last_fullsized":"2023-07-29T02:00:01.971561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:30:28.393515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440217+0000","last_change":"2023-07-29T02:00:01.996124+0000","last_active":"2023-07-29T02:00:02.440217+0000","last_peered":"2023-07-29T02:00:02.440217+0000","last_clean":"2023-07-29T02:00:02.440217+0000","last_became_active":"2023-07-29T02:00:01.995757+0000","last_became_peered":"2023-07-29T02:00:01.995757+0000","last_unstale":"2023-07-29T02:00:02.440217+0000","last_undegraded":"2023-07-29T02:00:02.440217+0000","last_fullsized":"2023-07-29T02:00:02.440217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:24:03.881006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'11","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:41.635077+0000","last_change":"2023-07-29T01:59:57.541936+0000","last_active":"2023-07-29T02:00:41.635077+0000","last_peered":"2023-07-29T02:00:41.635077+0000","last_clean":"2023-07-29T02:00:41.635077+0000","last_became_active":"2023-07-29T01:59:57.541434+0000","last_became_peered":"2023-07-29T01:59:57.541434+0000","last_unstale":"2023-07-29T02:00:41.635077+0000","last_undegraded":"2023-07-29T02:00:41.635077+0000","last_fullsized":"2023-07-29T02:00:41.635077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4051,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976628+0000","last_change":"2023-07-29T01:59:57.962725+0000","last_active":"2023-07-29T02:00:01.976628+0000","last_peered":"2023-07-29T02:00:01.976628+0000","last_clean":"2023-07-29T02:00:01.976628+0000","last_became_active":"2023-07-29T01:59:57.962459+0000","last_became_peered":"2023-07-29T01:59:57.962459+0000","last_unstale":"2023-07-29T02:00:01.976628+0000","last_undegraded":"2023-07-29T02:00:01.976628+0000","last_fullsized":"2023-07-29T02:00:01.976628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401186+0000","last_change":"2023-07-29T02:00:01.996160+0000","last_active":"2023-07-29T02:00:02.401186+0000","last_peered":"2023-07-29T02:00:02.401186+0000","last_clean":"2023-07-29T02:00:02.401186+0000","last_became_active":"2023-07-29T02:00:01.995827+0000","last_became_peered":"2023-07-29T02:00:01.995827+0000","last_unstale":"2023-07-29T02:00:02.401186+0000","last_undegraded":"2023-07-29T02:00:02.401186+0000","last_fullsized":"2023-07-29T02:00:02.401186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958252+0000","last_change":"2023-07-29T01:59:57.545705+0000","last_active":"2023-07-29T02:00:02.958252+0000","last_peered":"2023-07-29T02:00:02.958252+0000","last_clean":"2023-07-29T02:00:02.958252+0000","last_became_active":"2023-07-29T01:59:57.545406+0000","last_became_peered":"2023-07-29T01:59:57.545406+0000","last_unstale":"2023-07-29T02:00:02.958252+0000","last_undegraded":"2023-07-29T02:00:02.958252+0000","last_fullsized":"2023-07-29T02:00:02.958252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:31.903601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.980027+0000","last_change":"2023-07-29T01:59:57.970072+0000","last_active":"2023-07-29T02:00:01.980027+0000","last_peered":"2023-07-29T02:00:01.980027+0000","last_clean":"2023-07-29T02:00:01.980027+0000","last_became_active":"2023-07-29T01:59:57.969809+0000","last_became_peered":"2023-07-29T01:59:57.969809+0000","last_unstale":"2023-07-29T02:00:01.980027+0000","last_undegraded":"2023-07-29T02:00:01.980027+0000","last_fullsized":"2023-07-29T02:00:01.980027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440272+0000","last_change":"2023-07-29T02:00:01.997402+0000","last_active":"2023-07-29T02:00:02.440272+0000","last_peered":"2023-07-29T02:00:02.440272+0000","last_clean":"2023-07-29T02:00:02.440272+0000","last_became_active":"2023-07-29T02:00:01.996969+0000","last_became_peered":"2023-07-29T02:00:01.996969+0000","last_unstale":"2023-07-29T02:00:02.440272+0000","last_undegraded":"2023-07-29T02:00:02.440272+0000","last_fullsized":"2023-07-29T02:00:02.440272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:46:37.088979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966653+0000","last_change":"2023-07-29T01:59:57.541115+0000","last_active":"2023-07-29T02:00:01.966653+0000","last_peered":"2023-07-29T02:00:01.966653+0000","last_clean":"2023-07-29T02:00:01.966653+0000","last_became_active":"2023-07-29T01:59:57.540800+0000","last_became_peered":"2023-07-29T01:59:57.540800+0000","last_unstale":"2023-07-29T02:00:01.966653+0000","last_undegraded":"2023-07-29T02:00:01.966653+0000","last_fullsized":"2023-07-29T02:00:01.966653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977902+0000","last_change":"2023-07-29T01:59:57.964198+0000","last_active":"2023-07-29T02:00:01.977902+0000","last_peered":"2023-07-29T02:00:01.977902+0000","last_clean":"2023-07-29T02:00:01.977902+0000","last_became_active":"2023-07-29T01:59:57.963510+0000","last_became_peered":"2023-07-29T01:59:57.963510+0000","last_unstale":"2023-07-29T02:00:01.977902+0000","last_undegraded":"2023-07-29T02:00:01.977902+0000","last_fullsized":"2023-07-29T02:00:01.977902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441378+0000","last_change":"2023-07-29T02:00:01.996496+0000","last_active":"2023-07-29T02:00:02.441378+0000","last_peered":"2023-07-29T02:00:02.441378+0000","last_clean":"2023-07-29T02:00:02.441378+0000","last_became_active":"2023-07-29T02:00:01.996084+0000","last_became_peered":"2023-07-29T02:00:01.996084+0000","last_unstale":"2023-07-29T02:00:02.441378+0000","last_undegraded":"2023-07-29T02:00:02.441378+0000","last_fullsized":"2023-07-29T02:00:02.441378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:59:57.581952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974316+0000","last_change":"2023-07-29T01:59:57.548464+0000","last_active":"2023-07-29T02:00:01.974316+0000","last_peered":"2023-07-29T02:00:01.974316+0000","last_clean":"2023-07-29T02:00:01.974316+0000","last_became_active":"2023-07-29T01:59:57.548109+0000","last_became_peered":"2023-07-29T01:59:57.548109+0000","last_unstale":"2023-07-29T02:00:01.974316+0000","last_undegraded":"2023-07-29T02:00:01.974316+0000","last_fullsized":"2023-07-29T02:00:01.974316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:13.433053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967896+0000","last_change":"2023-07-29T01:59:57.962096+0000","last_active":"2023-07-29T02:00:01.967896+0000","last_peered":"2023-07-29T02:00:01.967896+0000","last_clean":"2023-07-29T02:00:01.967896+0000","last_became_active":"2023-07-29T01:59:57.961759+0000","last_became_peered":"2023-07-29T01:59:57.961759+0000","last_unstale":"2023-07-29T02:00:01.967896+0000","last_undegraded":"2023-07-29T02:00:01.967896+0000","last_fullsized":"2023-07-29T02:00:01.967896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400737+0000","last_change":"2023-07-29T02:00:01.993066+0000","last_active":"2023-07-29T02:00:02.400737+0000","last_peered":"2023-07-29T02:00:02.400737+0000","last_clean":"2023-07-29T02:00:02.400737+0000","last_became_active":"2023-07-29T02:00:01.992592+0000","last_became_peered":"2023-07-29T02:00:01.992592+0000","last_unstale":"2023-07-29T02:00:02.400737+0000","last_undegraded":"2023-07-29T02:00:02.400737+0000","last_fullsized":"2023-07-29T02:00:02.400737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:14:06.353802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958759+0000","last_change":"2023-07-29T01:59:57.543707+0000","last_active":"2023-07-29T02:00:02.958759+0000","last_peered":"2023-07-29T02:00:02.958759+0000","last_clean":"2023-07-29T02:00:02.958759+0000","last_became_active":"2023-07-29T01:59:57.543398+0000","last_became_peered":"2023-07-29T01:59:57.543398+0000","last_unstale":"2023-07-29T02:00:02.958759+0000","last_undegraded":"2023-07-29T02:00:02.958759+0000","last_fullsized":"2023-07-29T02:00:02.958759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977853+0000","last_change":"2023-07-29T01:59:57.966269+0000","last_active":"2023-07-29T02:00:01.977853+0000","last_peered":"2023-07-29T02:00:01.977853+0000","last_clean":"2023-07-29T02:00:01.977853+0000","last_became_active":"2023-07-29T01:59:57.965962+0000","last_became_peered":"2023-07-29T01:59:57.965962+0000","last_unstale":"2023-07-29T02:00:01.977853+0000","last_undegraded":"2023-07-29T02:00:01.977853+0000","last_fullsized":"2023-07-29T02:00:01.977853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400336+0000","last_change":"2023-07-29T02:00:01.992987+0000","last_active":"2023-07-29T02:00:02.400336+0000","last_peered":"2023-07-29T02:00:02.400336+0000","last_clean":"2023-07-29T02:00:02.400336+0000","last_became_active":"2023-07-29T02:00:01.992384+0000","last_became_peered":"2023-07-29T02:00:01.992384+0000","last_unstale":"2023-07-29T02:00:02.400336+0000","last_undegraded":"2023-07-29T02:00:02.400336+0000","last_fullsized":"2023-07-29T02:00:02.400336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400080+0000","last_change":"2023-07-29T01:59:57.548392+0000","last_active":"2023-07-29T02:00:02.400080+0000","last_peered":"2023-07-29T02:00:02.400080+0000","last_clean":"2023-07-29T02:00:02.400080+0000","last_became_active":"2023-07-29T01:59:57.548084+0000","last_became_peered":"2023-07-29T01:59:57.548084+0000","last_unstale":"2023-07-29T02:00:02.400080+0000","last_undegraded":"2023-07-29T02:00:02.400080+0000","last_fullsized":"2023-07-29T02:00:02.400080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973873+0000","last_change":"2023-07-29T01:59:57.965613+0000","last_active":"2023-07-29T02:00:01.973873+0000","last_peered":"2023-07-29T02:00:01.973873+0000","last_clean":"2023-07-29T02:00:01.973873+0000","last_became_active":"2023-07-29T01:59:57.964626+0000","last_became_peered":"2023-07-29T01:59:57.964626+0000","last_unstale":"2023-07-29T02:00:01.973873+0000","last_undegraded":"2023-07-29T02:00:01.973873+0000","last_fullsized":"2023-07-29T02:00:01.973873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442405+0000","last_change":"2023-07-29T02:00:01.990978+0000","last_active":"2023-07-29T02:00:02.442405+0000","last_peered":"2023-07-29T02:00:02.442405+0000","last_clean":"2023-07-29T02:00:02.442405+0000","last_became_active":"2023-07-29T02:00:01.990579+0000","last_became_peered":"2023-07-29T02:00:01.990579+0000","last_unstale":"2023-07-29T02:00:02.442405+0000","last_undegraded":"2023-07-29T02:00:02.442405+0000","last_fullsized":"2023-07-29T02:00:02.442405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:11:53.398210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957642+0000","last_change":"2023-07-29T01:59:57.549270+0000","last_active":"2023-07-29T02:00:02.957642+0000","last_peered":"2023-07-29T02:00:02.957642+0000","last_clean":"2023-07-29T02:00:02.957642+0000","last_became_active":"2023-07-29T01:59:57.548981+0000","last_became_peered":"2023-07-29T01:59:57.548981+0000","last_unstale":"2023-07-29T02:00:02.957642+0000","last_undegraded":"2023-07-29T02:00:02.957642+0000","last_fullsized":"2023-07-29T02:00:02.957642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:05.783369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972647+0000","last_change":"2023-07-29T01:59:57.969851+0000","last_active":"2023-07-29T02:00:01.972647+0000","last_peered":"2023-07-29T02:00:01.972647+0000","last_clean":"2023-07-29T02:00:01.972647+0000","last_became_active":"2023-07-29T01:59:57.969501+0000","last_became_peered":"2023-07-29T01:59:57.969501+0000","last_unstale":"2023-07-29T02:00:01.972647+0000","last_undegraded":"2023-07-29T02:00:01.972647+0000","last_fullsized":"2023-07-29T02:00:01.972647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442608+0000","last_change":"2023-07-29T02:00:01.989766+0000","last_active":"2023-07-29T02:00:02.442608+0000","last_peered":"2023-07-29T02:00:02.442608+0000","last_clean":"2023-07-29T02:00:02.442608+0000","last_became_active":"2023-07-29T02:00:01.989364+0000","last_became_peered":"2023-07-29T02:00:01.989364+0000","last_unstale":"2023-07-29T02:00:02.442608+0000","last_undegraded":"2023-07-29T02:00:02.442608+0000","last_fullsized":"2023-07-29T02:00:02.442608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:01:14.849757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400580+0000","last_change":"2023-07-29T01:59:57.541329+0000","last_active":"2023-07-29T02:00:02.400580+0000","last_peered":"2023-07-29T02:00:02.400580+0000","last_clean":"2023-07-29T02:00:02.400580+0000","last_became_active":"2023-07-29T01:59:57.541056+0000","last_became_peered":"2023-07-29T01:59:57.541056+0000","last_unstale":"2023-07-29T02:00:02.400580+0000","last_undegraded":"2023-07-29T02:00:02.400580+0000","last_fullsized":"2023-07-29T02:00:02.400580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968261+0000","last_change":"2023-07-29T01:59:57.975244+0000","last_active":"2023-07-29T02:00:01.968261+0000","last_peered":"2023-07-29T02:00:01.968261+0000","last_clean":"2023-07-29T02:00:01.968261+0000","last_became_active":"2023-07-29T01:59:57.974998+0000","last_became_peered":"2023-07-29T01:59:57.974998+0000","last_unstale":"2023-07-29T02:00:01.968261+0000","last_undegraded":"2023-07-29T02:00:01.968261+0000","last_fullsized":"2023-07-29T02:00:01.968261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:14.435169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442656+0000","last_change":"2023-07-29T02:00:01.990823+0000","last_active":"2023-07-29T02:00:02.442656+0000","last_peered":"2023-07-29T02:00:02.442656+0000","last_clean":"2023-07-29T02:00:02.442656+0000","last_became_active":"2023-07-29T02:00:01.990276+0000","last_became_peered":"2023-07-29T02:00:01.990276+0000","last_unstale":"2023-07-29T02:00:02.442656+0000","last_undegraded":"2023-07-29T02:00:02.442656+0000","last_fullsized":"2023-07-29T02:00:02.442656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974632+0000","last_change":"2023-07-29T01:59:57.544524+0000","last_active":"2023-07-29T02:00:01.974632+0000","last_peered":"2023-07-29T02:00:01.974632+0000","last_clean":"2023-07-29T02:00:01.974632+0000","last_became_active":"2023-07-29T01:59:57.544231+0000","last_became_peered":"2023-07-29T01:59:57.544231+0000","last_unstale":"2023-07-29T02:00:01.974632+0000","last_undegraded":"2023-07-29T02:00:01.974632+0000","last_fullsized":"2023-07-29T02:00:01.974632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966682+0000","last_change":"2023-07-29T01:59:57.974773+0000","last_active":"2023-07-29T02:00:01.966682+0000","last_peered":"2023-07-29T02:00:01.966682+0000","last_clean":"2023-07-29T02:00:01.966682+0000","last_became_active":"2023-07-29T01:59:57.974525+0000","last_became_peered":"2023-07-29T01:59:57.974525+0000","last_unstale":"2023-07-29T02:00:01.966682+0000","last_undegraded":"2023-07-29T02:00:01.966682+0000","last_fullsized":"2023-07-29T02:00:01.966682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442650+0000","last_change":"2023-07-29T02:00:01.988872+0000","last_active":"2023-07-29T02:00:02.442650+0000","last_peered":"2023-07-29T02:00:02.442650+0000","last_clean":"2023-07-29T02:00:02.442650+0000","last_became_active":"2023-07-29T02:00:01.988486+0000","last_became_peered":"2023-07-29T02:00:01.988486+0000","last_unstale":"2023-07-29T02:00:02.442650+0000","last_undegraded":"2023-07-29T02:00:02.442650+0000","last_fullsized":"2023-07-29T02:00:02.442650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:07.842328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.954789+0000","last_change":"2023-07-29T01:59:57.535498+0000","last_active":"2023-07-29T02:00:02.954789+0000","last_peered":"2023-07-29T02:00:02.954789+0000","last_clean":"2023-07-29T02:00:02.954789+0000","last_became_active":"2023-07-29T01:59:57.534813+0000","last_became_peered":"2023-07-29T01:59:57.534813+0000","last_unstale":"2023-07-29T02:00:02.954789+0000","last_undegraded":"2023-07-29T02:00:02.954789+0000","last_fullsized":"2023-07-29T02:00:02.954789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976870+0000","last_change":"2023-07-29T01:59:57.962897+0000","last_active":"2023-07-29T02:00:01.976870+0000","last_peered":"2023-07-29T02:00:01.976870+0000","last_clean":"2023-07-29T02:00:01.976870+0000","last_became_active":"2023-07-29T01:59:57.962184+0000","last_became_peered":"2023-07-29T01:59:57.962184+0000","last_unstale":"2023-07-29T02:00:01.976870+0000","last_undegraded":"2023-07-29T02:00:01.976870+0000","last_fullsized":"2023-07-29T02:00:01.976870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440114+0000","last_change":"2023-07-29T02:00:01.989538+0000","last_active":"2023-07-29T02:00:02.440114+0000","last_peered":"2023-07-29T02:00:02.440114+0000","last_clean":"2023-07-29T02:00:02.440114+0000","last_became_active":"2023-07-29T02:00:01.989151+0000","last_became_peered":"2023-07-29T02:00:01.989151+0000","last_unstale":"2023-07-29T02:00:02.440114+0000","last_undegraded":"2023-07-29T02:00:02.440114+0000","last_fullsized":"2023-07-29T02:00:02.440114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:21:35.031304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968357+0000","last_change":"2023-07-29T01:59:57.544466+0000","last_active":"2023-07-29T02:00:01.968357+0000","last_peered":"2023-07-29T02:00:01.968357+0000","last_clean":"2023-07-29T02:00:01.968357+0000","last_became_active":"2023-07-29T01:59:57.544120+0000","last_became_peered":"2023-07-29T01:59:57.544120+0000","last_unstale":"2023-07-29T02:00:01.968357+0000","last_undegraded":"2023-07-29T02:00:01.968357+0000","last_fullsized":"2023-07-29T02:00:01.968357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977082+0000","last_change":"2023-07-29T01:59:57.962277+0000","last_active":"2023-07-29T02:00:01.977082+0000","last_peered":"2023-07-29T02:00:01.977082+0000","last_clean":"2023-07-29T02:00:01.977082+0000","last_became_active":"2023-07-29T01:59:57.961975+0000","last_became_peered":"2023-07-29T01:59:57.961975+0000","last_unstale":"2023-07-29T02:00:01.977082+0000","last_undegraded":"2023-07-29T02:00:01.977082+0000","last_fullsized":"2023-07-29T02:00:01.977082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:27:01.059953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400809+0000","last_change":"2023-07-29T02:00:01.988563+0000","last_active":"2023-07-29T02:00:02.400809+0000","last_peered":"2023-07-29T02:00:02.400809+0000","last_clean":"2023-07-29T02:00:02.400809+0000","last_became_active":"2023-07-29T02:00:01.988155+0000","last_became_peered":"2023-07-29T02:00:01.988155+0000","last_unstale":"2023-07-29T02:00:02.400809+0000","last_undegraded":"2023-07-29T02:00:02.400809+0000","last_fullsized":"2023-07-29T02:00:02.400809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972477+0000","last_change":"2023-07-29T01:59:57.549764+0000","last_active":"2023-07-29T02:00:01.972477+0000","last_peered":"2023-07-29T02:00:01.972477+0000","last_clean":"2023-07-29T02:00:01.972477+0000","last_became_active":"2023-07-29T01:59:57.549470+0000","last_became_peered":"2023-07-29T01:59:57.549470+0000","last_unstale":"2023-07-29T02:00:01.972477+0000","last_undegraded":"2023-07-29T02:00:01.972477+0000","last_fullsized":"2023-07-29T02:00:01.972477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976948+0000","last_change":"2023-07-29T01:59:57.962303+0000","last_active":"2023-07-29T02:00:01.976948+0000","last_peered":"2023-07-29T02:00:01.976948+0000","last_clean":"2023-07-29T02:00:01.976948+0000","last_became_active":"2023-07-29T01:59:57.962016+0000","last_became_peered":"2023-07-29T01:59:57.962016+0000","last_unstale":"2023-07-29T02:00:01.976948+0000","last_undegraded":"2023-07-29T02:00:01.976948+0000","last_fullsized":"2023-07-29T02:00:01.976948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:08.813083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399334+0000","last_change":"2023-07-29T02:00:01.992380+0000","last_active":"2023-07-29T02:00:02.399334+0000","last_peered":"2023-07-29T02:00:02.399334+0000","last_clean":"2023-07-29T02:00:02.399334+0000","last_became_active":"2023-07-29T02:00:01.992042+0000","last_became_peered":"2023-07-29T02:00:01.992042+0000","last_unstale":"2023-07-29T02:00:02.399334+0000","last_undegraded":"2023-07-29T02:00:02.399334+0000","last_fullsized":"2023-07-29T02:00:02.399334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:24:44.331640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977747+0000","last_change":"2023-07-29T01:59:57.537045+0000","last_active":"2023-07-29T02:00:01.977747+0000","last_peered":"2023-07-29T02:00:01.977747+0000","last_clean":"2023-07-29T02:00:01.977747+0000","last_became_active":"2023-07-29T01:59:57.535762+0000","last_became_peered":"2023-07-29T01:59:57.535762+0000","last_unstale":"2023-07-29T02:00:01.977747+0000","last_undegraded":"2023-07-29T02:00:01.977747+0000","last_fullsized":"2023-07-29T02:00:01.977747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972302+0000","last_change":"2023-07-29T01:59:57.975103+0000","last_active":"2023-07-29T02:00:01.972302+0000","last_peered":"2023-07-29T02:00:01.972302+0000","last_clean":"2023-07-29T02:00:01.972302+0000","last_became_active":"2023-07-29T01:59:57.974834+0000","last_became_peered":"2023-07-29T01:59:57.974834+0000","last_unstale":"2023-07-29T02:00:01.972302+0000","last_undegraded":"2023-07-29T02:00:01.972302+0000","last_fullsized":"2023-07-29T02:00:01.972302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401174+0000","last_change":"2023-07-29T02:00:01.990813+0000","last_active":"2023-07-29T02:00:02.401174+0000","last_peered":"2023-07-29T02:00:02.401174+0000","last_clean":"2023-07-29T02:00:02.401174+0000","last_became_active":"2023-07-29T02:00:01.990464+0000","last_became_peered":"2023-07-29T02:00:01.990464+0000","last_unstale":"2023-07-29T02:00:02.401174+0000","last_undegraded":"2023-07-29T02:00:02.401174+0000","last_fullsized":"2023-07-29T02:00:02.401174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:16:46.676860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958405+0000","last_change":"2023-07-29T01:59:57.540561+0000","last_active":"2023-07-29T02:00:02.958405+0000","last_peered":"2023-07-29T02:00:02.958405+0000","last_clean":"2023-07-29T02:00:02.958405+0000","last_became_active":"2023-07-29T01:59:57.540292+0000","last_became_peered":"2023-07-29T01:59:57.540292+0000","last_unstale":"2023-07-29T02:00:02.958405+0000","last_undegraded":"2023-07-29T02:00:02.958405+0000","last_fullsized":"2023-07-29T02:00:02.958405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978068+0000","last_change":"2023-07-29T01:59:52.448098+0000","last_active":"2023-07-29T02:00:01.978068+0000","last_peered":"2023-07-29T02:00:01.978068+0000","last_clean":"2023-07-29T02:00:01.978068+0000","last_became_active":"2023-07-29T01:59:52.447782+0000","last_became_peered":"2023-07-29T01:59:52.447782+0000","last_unstale":"2023-07-29T02:00:01.978068+0000","last_undegraded":"2023-07-29T02:00:01.978068+0000","last_fullsized":"2023-07-29T02:00:01.978068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:31.981804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977648+0000","last_change":"2023-07-29T01:59:57.967845+0000","last_active":"2023-07-29T02:00:01.977648+0000","last_peered":"2023-07-29T02:00:01.977648+0000","last_clean":"2023-07-29T02:00:01.977648+0000","last_became_active":"2023-07-29T01:59:57.966065+0000","last_became_peered":"2023-07-29T01:59:57.966065+0000","last_unstale":"2023-07-29T02:00:01.977648+0000","last_undegraded":"2023-07-29T02:00:01.977648+0000","last_fullsized":"2023-07-29T02:00:01.977648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439054+0000","last_change":"2023-07-29T02:00:01.996414+0000","last_active":"2023-07-29T02:00:02.439054+0000","last_peered":"2023-07-29T02:00:02.439054+0000","last_clean":"2023-07-29T02:00:02.439054+0000","last_became_active":"2023-07-29T02:00:01.995963+0000","last_became_peered":"2023-07-29T02:00:01.995963+0000","last_unstale":"2023-07-29T02:00:02.439054+0000","last_undegraded":"2023-07-29T02:00:02.439054+0000","last_fullsized":"2023-07-29T02:00:02.439054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:06:19.130853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.980059+0000","last_change":"2023-07-29T01:59:52.445649+0000","last_active":"2023-07-29T02:00:01.980059+0000","last_peered":"2023-07-29T02:00:01.980059+0000","last_clean":"2023-07-29T02:00:01.980059+0000","last_became_active":"2023-07-29T01:59:52.445337+0000","last_became_peered":"2023-07-29T01:59:52.445337+0000","last_unstale":"2023-07-29T02:00:01.980059+0000","last_undegraded":"2023-07-29T02:00:01.980059+0000","last_fullsized":"2023-07-29T02:00:01.980059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439989+0000","last_change":"2023-07-29T01:59:57.537863+0000","last_active":"2023-07-29T02:00:02.439989+0000","last_peered":"2023-07-29T02:00:02.439989+0000","last_clean":"2023-07-29T02:00:02.439989+0000","last_became_active":"2023-07-29T01:59:57.537581+0000","last_became_peered":"2023-07-29T01:59:57.537581+0000","last_unstale":"2023-07-29T02:00:02.439989+0000","last_undegraded":"2023-07-29T02:00:02.439989+0000","last_fullsized":"2023-07-29T02:00:02.439989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:02:57.137574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972545+0000","last_change":"2023-07-29T01:59:57.961598+0000","last_active":"2023-07-29T02:00:01.972545+0000","last_peered":"2023-07-29T02:00:01.972545+0000","last_clean":"2023-07-29T02:00:01.972545+0000","last_became_active":"2023-07-29T01:59:57.961298+0000","last_became_peered":"2023-07-29T01:59:57.961298+0000","last_unstale":"2023-07-29T02:00:01.972545+0000","last_undegraded":"2023-07-29T02:00:01.972545+0000","last_fullsized":"2023-07-29T02:00:01.972545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:11:49.956637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400459+0000","last_change":"2023-07-29T02:00:01.987452+0000","last_active":"2023-07-29T02:00:02.400459+0000","last_peered":"2023-07-29T02:00:02.400459+0000","last_clean":"2023-07-29T02:00:02.400459+0000","last_became_active":"2023-07-29T02:00:01.986915+0000","last_became_peered":"2023-07-29T02:00:01.986915+0000","last_unstale":"2023-07-29T02:00:02.400459+0000","last_undegraded":"2023-07-29T02:00:02.400459+0000","last_fullsized":"2023-07-29T02:00:02.400459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:35:48.256508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973327+0000","last_change":"2023-07-29T01:59:52.448423+0000","last_active":"2023-07-29T02:00:01.973327+0000","last_peered":"2023-07-29T02:00:01.973327+0000","last_clean":"2023-07-29T02:00:01.973327+0000","last_became_active":"2023-07-29T01:59:52.448052+0000","last_became_peered":"2023-07-29T01:59:52.448052+0000","last_unstale":"2023-07-29T02:00:01.973327+0000","last_undegraded":"2023-07-29T02:00:01.973327+0000","last_fullsized":"2023-07-29T02:00:01.973327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:31.981804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973579+0000","last_change":"2023-07-29T01:59:52.450730+0000","last_active":"2023-07-29T02:00:01.973579+0000","last_peered":"2023-07-29T02:00:01.973579+0000","last_clean":"2023-07-29T02:00:01.973579+0000","last_became_active":"2023-07-29T01:59:52.449582+0000","last_became_peered":"2023-07-29T01:59:52.449582+0000","last_unstale":"2023-07-29T02:00:01.973579+0000","last_undegraded":"2023-07-29T02:00:01.973579+0000","last_fullsized":"2023-07-29T02:00:01.973579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:01:27.099648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966496+0000","last_change":"2023-07-29T01:59:57.546474+0000","last_active":"2023-07-29T02:00:01.966496+0000","last_peered":"2023-07-29T02:00:01.966496+0000","last_clean":"2023-07-29T02:00:01.966496+0000","last_became_active":"2023-07-29T01:59:57.546179+0000","last_became_peered":"2023-07-29T01:59:57.546179+0000","last_unstale":"2023-07-29T02:00:01.966496+0000","last_undegraded":"2023-07-29T02:00:01.966496+0000","last_fullsized":"2023-07-29T02:00:01.966496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967788+0000","last_change":"2023-07-29T01:59:57.975316+0000","last_active":"2023-07-29T02:00:01.967788+0000","last_peered":"2023-07-29T02:00:01.967788+0000","last_clean":"2023-07-29T02:00:01.967788+0000","last_became_active":"2023-07-29T01:59:57.975078+0000","last_became_peered":"2023-07-29T01:59:57.975078+0000","last_unstale":"2023-07-29T02:00:01.967788+0000","last_undegraded":"2023-07-29T02:00:01.967788+0000","last_fullsized":"2023-07-29T02:00:01.967788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442819+0000","last_change":"2023-07-29T02:00:01.987385+0000","last_active":"2023-07-29T02:00:02.442819+0000","last_peered":"2023-07-29T02:00:02.442819+0000","last_clean":"2023-07-29T02:00:02.442819+0000","last_became_active":"2023-07-29T02:00:01.986937+0000","last_became_peered":"2023-07-29T02:00:01.986937+0000","last_unstale":"2023-07-29T02:00:02.442819+0000","last_undegraded":"2023-07-29T02:00:02.442819+0000","last_fullsized":"2023-07-29T02:00:02.442819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:53.580244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974915+0000","last_change":"2023-07-29T01:59:53.171806+0000","last_active":"2023-07-29T02:00:01.974915+0000","last_peered":"2023-07-29T02:00:01.974915+0000","last_clean":"2023-07-29T02:00:01.974915+0000","last_became_active":"2023-07-29T01:59:53.171467+0000","last_became_peered":"2023-07-29T01:59:53.171467+0000","last_unstale":"2023-07-29T02:00:01.974915+0000","last_undegraded":"2023-07-29T02:00:01.974915+0000","last_fullsized":"2023-07-29T02:00:01.974915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972796+0000","last_change":"2023-07-29T01:59:57.549442+0000","last_active":"2023-07-29T02:00:01.972796+0000","last_peered":"2023-07-29T02:00:01.972796+0000","last_clean":"2023-07-29T02:00:01.972796+0000","last_became_active":"2023-07-29T01:59:57.549151+0000","last_became_peered":"2023-07-29T01:59:57.549151+0000","last_unstale":"2023-07-29T02:00:01.972796+0000","last_undegraded":"2023-07-29T02:00:01.972796+0000","last_fullsized":"2023-07-29T02:00:01.972796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972211+0000","last_change":"2023-07-29T01:59:57.973471+0000","last_active":"2023-07-29T02:00:01.972211+0000","last_peered":"2023-07-29T02:00:01.972211+0000","last_clean":"2023-07-29T02:00:01.972211+0000","last_became_active":"2023-07-29T01:59:57.969273+0000","last_became_peered":"2023-07-29T01:59:57.969273+0000","last_unstale":"2023-07-29T02:00:01.972211+0000","last_undegraded":"2023-07-29T02:00:01.972211+0000","last_fullsized":"2023-07-29T02:00:01.972211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:56:07.949649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400121+0000","last_change":"2023-07-29T02:00:01.993242+0000","last_active":"2023-07-29T02:00:02.400121+0000","last_peered":"2023-07-29T02:00:02.400121+0000","last_clean":"2023-07-29T02:00:02.400121+0000","last_became_active":"2023-07-29T02:00:01.992406+0000","last_became_peered":"2023-07-29T02:00:01.992406+0000","last_unstale":"2023-07-29T02:00:02.400121+0000","last_undegraded":"2023-07-29T02:00:02.400121+0000","last_fullsized":"2023-07-29T02:00:02.400121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:12.254656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973406+0000","last_change":"2023-07-29T01:59:53.171746+0000","last_active":"2023-07-29T02:00:01.973406+0000","last_peered":"2023-07-29T02:00:01.973406+0000","last_clean":"2023-07-29T02:00:01.973406+0000","last_became_active":"2023-07-29T01:59:53.171440+0000","last_became_peered":"2023-07-29T01:59:53.171440+0000","last_unstale":"2023-07-29T02:00:01.973406+0000","last_undegraded":"2023-07-29T02:00:01.973406+0000","last_fullsized":"2023-07-29T02:00:01.973406+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:17:56.960611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976818+0000","last_change":"2023-07-29T01:59:57.537970+0000","last_active":"2023-07-29T02:00:01.976818+0000","last_peered":"2023-07-29T02:00:01.976818+0000","last_clean":"2023-07-29T02:00:01.976818+0000","last_became_active":"2023-07-29T01:59:57.537665+0000","last_became_peered":"2023-07-29T01:59:57.537665+0000","last_unstale":"2023-07-29T02:00:01.976818+0000","last_undegraded":"2023-07-29T02:00:01.976818+0000","last_fullsized":"2023-07-29T02:00:01.976818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968235+0000","last_change":"2023-07-29T01:59:57.968655+0000","last_active":"2023-07-29T02:00:01.968235+0000","last_peered":"2023-07-29T02:00:01.968235+0000","last_clean":"2023-07-29T02:00:01.968235+0000","last_became_active":"2023-07-29T01:59:57.968373+0000","last_became_peered":"2023-07-29T01:59:57.968373+0000","last_unstale":"2023-07-29T02:00:01.968235+0000","last_undegraded":"2023-07-29T02:00:01.968235+0000","last_fullsized":"2023-07-29T02:00:01.968235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:06.785485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439797+0000","last_change":"2023-07-29T02:00:01.984885+0000","last_active":"2023-07-29T02:00:02.439797+0000","last_peered":"2023-07-29T02:00:02.439797+0000","last_clean":"2023-07-29T02:00:02.439797+0000","last_became_active":"2023-07-29T02:00:01.984476+0000","last_became_peered":"2023-07-29T02:00:01.984476+0000","last_unstale":"2023-07-29T02:00:02.439797+0000","last_undegraded":"2023-07-29T02:00:02.439797+0000","last_fullsized":"2023-07-29T02:00:02.439797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973534+0000","last_change":"2023-07-29T01:59:53.172039+0000","last_active":"2023-07-29T02:00:01.973534+0000","last_peered":"2023-07-29T02:00:01.973534+0000","last_clean":"2023-07-29T02:00:01.973534+0000","last_became_active":"2023-07-29T01:59:53.171617+0000","last_became_peered":"2023-07-29T01:59:53.171617+0000","last_unstale":"2023-07-29T02:00:01.973534+0000","last_undegraded":"2023-07-29T02:00:01.973534+0000","last_fullsized":"2023-07-29T02:00:01.973534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976735+0000","last_change":"2023-07-29T01:59:57.540888+0000","last_active":"2023-07-29T02:00:01.976735+0000","last_peered":"2023-07-29T02:00:01.976735+0000","last_clean":"2023-07-29T02:00:01.976735+0000","last_became_active":"2023-07-29T01:59:57.540449+0000","last_became_peered":"2023-07-29T01:59:57.540449+0000","last_unstale":"2023-07-29T02:00:01.976735+0000","last_undegraded":"2023-07-29T02:00:01.976735+0000","last_fullsized":"2023-07-29T02:00:01.976735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974278+0000","last_change":"2023-07-29T01:59:57.968216+0000","last_active":"2023-07-29T02:00:01.974278+0000","last_peered":"2023-07-29T02:00:01.974278+0000","last_clean":"2023-07-29T02:00:01.974278+0000","last_became_active":"2023-07-29T01:59:57.967933+0000","last_became_peered":"2023-07-29T01:59:57.967933+0000","last_unstale":"2023-07-29T02:00:01.974278+0000","last_undegraded":"2023-07-29T02:00:01.974278+0000","last_fullsized":"2023-07-29T02:00:01.974278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439338+0000","last_change":"2023-07-29T02:00:01.985121+0000","last_active":"2023-07-29T02:00:02.439338+0000","last_peered":"2023-07-29T02:00:02.439338+0000","last_clean":"2023-07-29T02:00:02.439338+0000","last_became_active":"2023-07-29T02:00:01.984691+0000","last_became_peered":"2023-07-29T02:00:01.984691+0000","last_unstale":"2023-07-29T02:00:02.439338+0000","last_undegraded":"2023-07-29T02:00:02.439338+0000","last_fullsized":"2023-07-29T02:00:02.439338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:54.400954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967930+0000","last_change":"2023-07-29T01:59:53.171808+0000","last_active":"2023-07-29T02:00:01.967930+0000","last_peered":"2023-07-29T02:00:01.967930+0000","last_clean":"2023-07-29T02:00:01.967930+0000","last_became_active":"2023-07-29T01:59:53.171463+0000","last_became_peered":"2023-07-29T01:59:53.171463+0000","last_unstale":"2023-07-29T02:00:01.967930+0000","last_undegraded":"2023-07-29T02:00:01.967930+0000","last_fullsized":"2023-07-29T02:00:01.967930+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:07:59.559814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973914+0000","last_change":"2023-07-29T01:59:57.549468+0000","last_active":"2023-07-29T02:00:01.973914+0000","last_peered":"2023-07-29T02:00:01.973914+0000","last_clean":"2023-07-29T02:00:01.973914+0000","last_became_active":"2023-07-29T01:59:57.549181+0000","last_became_peered":"2023-07-29T01:59:57.549181+0000","last_unstale":"2023-07-29T02:00:01.973914+0000","last_undegraded":"2023-07-29T02:00:01.973914+0000","last_fullsized":"2023-07-29T02:00:01.973914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966982+0000","last_change":"2023-07-29T01:59:57.963908+0000","last_active":"2023-07-29T02:00:01.966982+0000","last_peered":"2023-07-29T02:00:01.966982+0000","last_clean":"2023-07-29T02:00:01.966982+0000","last_became_active":"2023-07-29T01:59:57.963659+0000","last_became_peered":"2023-07-29T01:59:57.963659+0000","last_unstale":"2023-07-29T02:00:01.966982+0000","last_undegraded":"2023-07-29T02:00:01.966982+0000","last_fullsized":"2023-07-29T02:00:01.966982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440428+0000","last_change":"2023-07-29T02:00:01.984197+0000","last_active":"2023-07-29T02:00:02.440428+0000","last_peered":"2023-07-29T02:00:02.440428+0000","last_clean":"2023-07-29T02:00:02.440428+0000","last_became_active":"2023-07-29T02:00:01.983744+0000","last_became_peered":"2023-07-29T02:00:01.983744+0000","last_unstale":"2023-07-29T02:00:02.440428+0000","last_undegraded":"2023-07-29T02:00:02.440428+0000","last_fullsized":"2023-07-29T02:00:02.440428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968731+0000","last_change":"2023-07-29T01:59:52.449102+0000","last_active":"2023-07-29T02:00:01.968731+0000","last_peered":"2023-07-29T02:00:01.968731+0000","last_clean":"2023-07-29T02:00:01.968731+0000","last_became_active":"2023-07-29T01:59:52.448814+0000","last_became_peered":"2023-07-29T01:59:52.448814+0000","last_unstale":"2023-07-29T02:00:01.968731+0000","last_undegraded":"2023-07-29T02:00:01.968731+0000","last_fullsized":"2023-07-29T02:00:01.968731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977814+0000","last_change":"2023-07-29T01:59:57.544590+0000","last_active":"2023-07-29T02:00:01.977814+0000","last_peered":"2023-07-29T02:00:01.977814+0000","last_clean":"2023-07-29T02:00:01.977814+0000","last_became_active":"2023-07-29T01:59:57.544317+0000","last_became_peered":"2023-07-29T01:59:57.544317+0000","last_unstale":"2023-07-29T02:00:01.977814+0000","last_undegraded":"2023-07-29T02:00:01.977814+0000","last_fullsized":"2023-07-29T02:00:01.977814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971685+0000","last_change":"2023-07-29T01:59:57.973912+0000","last_active":"2023-07-29T02:00:01.971685+0000","last_peered":"2023-07-29T02:00:01.971685+0000","last_clean":"2023-07-29T02:00:01.971685+0000","last_became_active":"2023-07-29T01:59:57.969642+0000","last_became_peered":"2023-07-29T01:59:57.969642+0000","last_unstale":"2023-07-29T02:00:01.971685+0000","last_undegraded":"2023-07-29T02:00:01.971685+0000","last_fullsized":"2023-07-29T02:00:01.971685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440741+0000","last_change":"2023-07-29T02:00:01.999117+0000","last_active":"2023-07-29T02:00:02.440741+0000","last_peered":"2023-07-29T02:00:02.440741+0000","last_clean":"2023-07-29T02:00:02.440741+0000","last_became_active":"2023-07-29T02:00:01.998715+0000","last_became_peered":"2023-07-29T02:00:01.998715+0000","last_unstale":"2023-07-29T02:00:02.440741+0000","last_undegraded":"2023-07-29T02:00:02.440741+0000","last_fullsized":"2023-07-29T02:00:02.440741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440569+0000","last_change":"2023-07-29T01:59:57.545933+0000","last_active":"2023-07-29T02:00:02.440569+0000","last_peered":"2023-07-29T02:00:02.440569+0000","last_clean":"2023-07-29T02:00:02.440569+0000","last_became_active":"2023-07-29T01:59:57.545744+0000","last_became_peered":"2023-07-29T01:59:57.545744+0000","last_unstale":"2023-07-29T02:00:02.440569+0000","last_undegraded":"2023-07-29T02:00:02.440569+0000","last_fullsized":"2023-07-29T02:00:02.440569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972541+0000","last_change":"2023-07-29T01:59:57.970577+0000","last_active":"2023-07-29T02:00:01.972541+0000","last_peered":"2023-07-29T02:00:01.972541+0000","last_clean":"2023-07-29T02:00:01.972541+0000","last_became_active":"2023-07-29T01:59:57.970252+0000","last_became_peered":"2023-07-29T01:59:57.970252+0000","last_unstale":"2023-07-29T02:00:01.972541+0000","last_undegraded":"2023-07-29T02:00:01.972541+0000","last_fullsized":"2023-07-29T02:00:01.972541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:09.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399784+0000","last_change":"2023-07-29T02:00:01.989885+0000","last_active":"2023-07-29T02:00:02.399784+0000","last_peered":"2023-07-29T02:00:02.399784+0000","last_clean":"2023-07-29T02:00:02.399784+0000","last_became_active":"2023-07-29T02:00:01.989481+0000","last_became_peered":"2023-07-29T02:00:01.989481+0000","last_unstale":"2023-07-29T02:00:02.399784+0000","last_undegraded":"2023-07-29T02:00:02.399784+0000","last_fullsized":"2023-07-29T02:00:02.399784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957691+0000","last_change":"2023-07-29T01:59:57.543782+0000","last_active":"2023-07-29T02:00:02.957691+0000","last_peered":"2023-07-29T02:00:02.957691+0000","last_clean":"2023-07-29T02:00:02.957691+0000","last_became_active":"2023-07-29T01:59:57.543445+0000","last_became_peered":"2023-07-29T01:59:57.543445+0000","last_unstale":"2023-07-29T02:00:02.957691+0000","last_undegraded":"2023-07-29T02:00:02.957691+0000","last_fullsized":"2023-07-29T02:00:02.957691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.970956+0000","last_change":"2023-07-29T01:59:57.965177+0000","last_active":"2023-07-29T02:00:01.970956+0000","last_peered":"2023-07-29T02:00:01.970956+0000","last_clean":"2023-07-29T02:00:01.970956+0000","last_became_active":"2023-07-29T01:59:57.964925+0000","last_became_peered":"2023-07-29T01:59:57.964925+0000","last_unstale":"2023-07-29T02:00:01.970956+0000","last_undegraded":"2023-07-29T02:00:01.970956+0000","last_fullsized":"2023-07-29T02:00:01.970956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401320+0000","last_change":"2023-07-29T02:00:01.985786+0000","last_active":"2023-07-29T02:00:02.401320+0000","last_peered":"2023-07-29T02:00:02.401320+0000","last_clean":"2023-07-29T02:00:02.401320+0000","last_became_active":"2023-07-29T02:00:01.985310+0000","last_became_peered":"2023-07-29T02:00:01.985310+0000","last_unstale":"2023-07-29T02:00:02.401320+0000","last_undegraded":"2023-07-29T02:00:02.401320+0000","last_fullsized":"2023-07-29T02:00:02.401320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957725+0000","last_change":"2023-07-29T01:59:57.541908+0000","last_active":"2023-07-29T02:00:02.957725+0000","last_peered":"2023-07-29T02:00:02.957725+0000","last_clean":"2023-07-29T02:00:02.957725+0000","last_became_active":"2023-07-29T01:59:57.541633+0000","last_became_peered":"2023-07-29T01:59:57.541633+0000","last_unstale":"2023-07-29T02:00:02.957725+0000","last_undegraded":"2023-07-29T02:00:02.957725+0000","last_fullsized":"2023-07-29T02:00:02.957725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.970785+0000","last_change":"2023-07-29T01:59:57.965915+0000","last_active":"2023-07-29T02:00:01.970785+0000","last_peered":"2023-07-29T02:00:01.970785+0000","last_clean":"2023-07-29T02:00:01.970785+0000","last_became_active":"2023-07-29T01:59:57.965383+0000","last_became_peered":"2023-07-29T01:59:57.965383+0000","last_unstale":"2023-07-29T02:00:01.970785+0000","last_undegraded":"2023-07-29T02:00:01.970785+0000","last_fullsized":"2023-07-29T02:00:01.970785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.398445+0000","last_change":"2023-07-29T02:00:01.994436+0000","last_active":"2023-07-29T02:00:02.398445+0000","last_peered":"2023-07-29T02:00:02.398445+0000","last_clean":"2023-07-29T02:00:02.398445+0000","last_became_active":"2023-07-29T02:00:01.993454+0000","last_became_peered":"2023-07-29T02:00:01.993454+0000","last_unstale":"2023-07-29T02:00:02.398445+0000","last_undegraded":"2023-07-29T02:00:02.398445+0000","last_fullsized":"2023-07-29T02:00:02.398445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:46.998657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441131+0000","last_change":"2023-07-29T01:59:57.539625+0000","last_active":"2023-07-29T02:00:02.441131+0000","last_peered":"2023-07-29T02:00:02.441131+0000","last_clean":"2023-07-29T02:00:02.441131+0000","last_became_active":"2023-07-29T01:59:57.539181+0000","last_became_peered":"2023-07-29T01:59:57.539181+0000","last_unstale":"2023-07-29T02:00:02.441131+0000","last_undegraded":"2023-07-29T02:00:02.441131+0000","last_fullsized":"2023-07-29T02:00:02.441131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:02:57.137574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979518+0000","last_change":"2023-07-29T01:59:57.966812+0000","last_active":"2023-07-29T02:00:01.979518+0000","last_peered":"2023-07-29T02:00:01.979518+0000","last_clean":"2023-07-29T02:00:01.979518+0000","last_became_active":"2023-07-29T01:59:57.966580+0000","last_became_peered":"2023-07-29T01:59:57.966580+0000","last_unstale":"2023-07-29T02:00:01.979518+0000","last_undegraded":"2023-07-29T02:00:01.979518+0000","last_fullsized":"2023-07-29T02:00:01.979518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.203628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439475+0000","last_change":"2023-07-29T02:00:01.985984+0000","last_active":"2023-07-29T02:00:02.439475+0000","last_peered":"2023-07-29T02:00:02.439475+0000","last_clean":"2023-07-29T02:00:02.439475+0000","last_became_active":"2023-07-29T02:00:01.985554+0000","last_became_peered":"2023-07-29T02:00:01.985554+0000","last_unstale":"2023-07-29T02:00:02.439475+0000","last_undegraded":"2023-07-29T02:00:02.439475+0000","last_fullsized":"2023-07-29T02:00:02.439475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:50:50.164635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957483+0000","last_change":"2023-07-29T01:59:57.537754+0000","last_active":"2023-07-29T02:00:02.957483+0000","last_peered":"2023-07-29T02:00:02.957483+0000","last_clean":"2023-07-29T02:00:02.957483+0000","last_became_active":"2023-07-29T01:59:57.537457+0000","last_became_peered":"2023-07-29T01:59:57.537457+0000","last_unstale":"2023-07-29T02:00:02.957483+0000","last_undegraded":"2023-07-29T02:00:02.957483+0000","last_fullsized":"2023-07-29T02:00:02.957483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975481+0000","last_change":"2023-07-29T01:59:57.960633+0000","last_active":"2023-07-29T02:00:01.975481+0000","last_peered":"2023-07-29T02:00:01.975481+0000","last_clean":"2023-07-29T02:00:01.975481+0000","last_became_active":"2023-07-29T01:59:57.960318+0000","last_became_peered":"2023-07-29T01:59:57.960318+0000","last_unstale":"2023-07-29T02:00:01.975481+0000","last_undegraded":"2023-07-29T02:00:01.975481+0000","last_fullsized":"2023-07-29T02:00:01.975481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:01:11.408184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967878+0000","last_change":"2023-07-29T01:59:57.960826+0000","last_active":"2023-07-29T02:00:01.967878+0000","last_peered":"2023-07-29T02:00:01.967878+0000","last_clean":"2023-07-29T02:00:01.967878+0000","last_became_active":"2023-07-29T01:59:57.959960+0000","last_became_peered":"2023-07-29T01:59:57.959960+0000","last_unstale":"2023-07-29T02:00:01.967878+0000","last_undegraded":"2023-07-29T02:00:01.967878+0000","last_fullsized":"2023-07-29T02:00:01.967878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979718+0000","last_change":"2023-07-29T01:59:57.976560+0000","last_active":"2023-07-29T02:00:01.979718+0000","last_peered":"2023-07-29T02:00:01.979718+0000","last_clean":"2023-07-29T02:00:01.979718+0000","last_became_active":"2023-07-29T01:59:57.975384+0000","last_became_peered":"2023-07-29T01:59:57.975384+0000","last_unstale":"2023-07-29T02:00:01.979718+0000","last_undegraded":"2023-07-29T02:00:01.979718+0000","last_fullsized":"2023-07-29T02:00:01.979718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971237+0000","last_change":"2023-07-29T01:59:57.967891+0000","last_active":"2023-07-29T02:00:01.971237+0000","last_peered":"2023-07-29T02:00:01.971237+0000","last_clean":"2023-07-29T02:00:01.971237+0000","last_became_active":"2023-07-29T01:59:57.967603+0000","last_became_peered":"2023-07-29T01:59:57.967603+0000","last_unstale":"2023-07-29T02:00:01.971237+0000","last_undegraded":"2023-07-29T02:00:01.971237+0000","last_fullsized":"2023-07-29T02:00:01.971237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:24:00.439433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978571+0000","last_change":"2023-07-29T01:59:57.966922+0000","last_active":"2023-07-29T02:00:01.978571+0000","last_peered":"2023-07-29T02:00:01.978571+0000","last_clean":"2023-07-29T02:00:01.978571+0000","last_became_active":"2023-07-29T01:59:57.966672+0000","last_became_peered":"2023-07-29T01:59:57.966672+0000","last_unstale":"2023-07-29T02:00:01.978571+0000","last_undegraded":"2023-07-29T02:00:01.978571+0000","last_fullsized":"2023-07-29T02:00:01.978571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972636+0000","last_change":"2023-07-29T01:59:57.968727+0000","last_active":"2023-07-29T02:00:01.972636+0000","last_peered":"2023-07-29T02:00:01.972636+0000","last_clean":"2023-07-29T02:00:01.972636+0000","last_became_active":"2023-07-29T01:59:57.968449+0000","last_became_peered":"2023-07-29T01:59:57.968449+0000","last_unstale":"2023-07-29T02:00:01.972636+0000","last_undegraded":"2023-07-29T02:00:01.972636+0000","last_fullsized":"2023-07-29T02:00:01.972636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4849,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":704036,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":331776,"data_stored":699769,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":109983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":108530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":113508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":110053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T02:00:47.083 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T02:00:47.241 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.254+0000 7facda8b8700 1 Processor -- start 2023-07-29T02:00:47.241 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.254+0000 7facda8b8700 1 -- start start 2023-07-29T02:00:47.244 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facda8b8700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7facd4153210 0x7facd40c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:47.244 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facda8b8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7facd40c6980 0x7facd415cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:47.244 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facda8b8700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd40c7b00 con 0x7facd40cc820 2023-07-29T02:00:47.245 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facda8b8700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd4159be0 con 0x7facd4153210 2023-07-29T02:00:47.245 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facda8b8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd4159ec0 con 0x7facd40c6980 2023-07-29T02:00:47.245 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facd37fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7facd40cc820 0x7facd415c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50908/0 (socket says 172.21.15.42:50908) 2023-07-29T02:00:47.245 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facd37fe700 1 -- 172.21.15.42:0/339382620 learned_addr learned my addr 172.21.15.42:0/339382620 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:47.245 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facd8e55700 1 --2- 172.21.15.42:0/339382620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7facd40c6980 0x7facd415cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:47.245 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facd2ffd700 1 -- 172.21.15.42:0/339382620 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2529551087 0 0) 0x7facd40c7b00 con 0x7facd40cc820 2023-07-29T02:00:47.245 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facd3fff700 1 --2- 172.21.15.42:0/339382620 >> v2:172.21.15.144:3300/0 conn(0x7facd4153210 0x7facd40c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:47.246 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facd2ffd700 1 -- 172.21.15.42:0/339382620 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facc00035b0 con 0x7facd40cc820 2023-07-29T02:00:47.246 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facd2ffd700 1 -- 172.21.15.42:0/339382620 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1476239299 0 0) 0x7facc00035b0 con 0x7facd40cc820 2023-07-29T02:00:47.246 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facd2ffd700 1 -- 172.21.15.42:0/339382620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7facd40c6980 msgr2=0x7facd415cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:47.246 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facd2ffd700 1 --2- 172.21.15.42:0/339382620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7facd40c6980 0x7facd415cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.246 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facd2ffd700 1 -- 172.21.15.42:0/339382620 >> v2:172.21.15.144:3300/0 conn(0x7facd4153210 msgr2=0x7facd40c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:47.246 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facd2ffd700 1 --2- 172.21.15.42:0/339382620 >> v2:172.21.15.144:3300/0 conn(0x7facd4153210 0x7facd40c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.246 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facd2ffd700 1 -- 172.21.15.42:0/339382620 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd40c71d0 con 0x7facd40cc820 2023-07-29T02:00:47.246 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facd2ffd700 1 -- 172.21.15.42:0/339382620 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7facbc001670 con 0x7facd40cc820 2023-07-29T02:00:47.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facd2ffd700 1 -- 172.21.15.42:0/339382620 >> v1:172.21.15.42:6789/0 conn(0x7facd40cc820 legacy=0x7facd415c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:47.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facd2ffd700 1 --2- 172.21.15.42:0/339382620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facc0003a00 0x7facc0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:47.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.255+0000 7facd2ffd700 1 --2- 172.21.15.42:0/339382620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc0004430 0x7facc00048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:47.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.256+0000 7facd2ffd700 1 --2- 172.21.15.42:0/339382620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7facd40c6980 0x7facc0004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:47.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.256+0000 7facd2ffd700 1 -- 172.21.15.42:0/339382620 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd4159be0 con 0x7facc0004430 2023-07-29T02:00:47.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.256+0000 7facd2ffd700 1 -- 172.21.15.42:0/339382620 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd4159ec0 con 0x7facc0003a00 2023-07-29T02:00:47.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.256+0000 7facd2ffd700 1 -- 172.21.15.42:0/339382620 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc000ba10 con 0x7facd40c6980 2023-07-29T02:00:47.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.256+0000 7facd37fe700 1 --2- 172.21.15.42:0/339382620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc0004430 0x7facc00048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:47.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.256+0000 7facd3fff700 1 --2- 172.21.15.42:0/339382620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facc0003a00 0x7facc0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:47.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.256+0000 7facd8e55700 1 --2- 172.21.15.42:0/339382620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7facd40c6980 0x7facc0004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:47.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.256+0000 7facd37fe700 1 -- 172.21.15.42:0/339382620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7facd40c6980 msgr2=0x7facc0004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:47.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.256+0000 7facd37fe700 1 --2- 172.21.15.42:0/339382620 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7facd40c6980 0x7facc0004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.256+0000 7facd37fe700 1 -- 172.21.15.42:0/339382620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facc0003a00 msgr2=0x7facc0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:47.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.256+0000 7facd37fe700 1 --2- 172.21.15.42:0/339382620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facc0003a00 0x7facc0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.254 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.256+0000 7facd37fe700 1 -- 172.21.15.42:0/339382620 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc00035b0 con 0x7facc0004430 2023-07-29T02:00:47.254 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.256+0000 7facd37fe700 1 --2- 172.21.15.42:0/339382620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc0004430 0x7facc00048f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7facbc00c370 tx=0x7facc0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a566a4cb562390e server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:47.254 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.256+0000 7facd2ffd700 1 -- 172.21.15.42:0/339382620 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc007c60 con 0x7facc0004430 2023-07-29T02:00:47.254 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.256+0000 7facd2ffd700 1 -- 172.21.15.42:0/339382620 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc005960 con 0x7facc0004430 2023-07-29T02:00:47.254 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.256+0000 7facd2ffd700 1 -- 172.21.15.42:0/339382620 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc005d10 con 0x7facc0004430 2023-07-29T02:00:47.254 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.257+0000 7facda8b8700 1 -- 172.21.15.42:0/339382620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc0004430 msgr2=0x7facc00048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:47.254 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.257+0000 7facda8b8700 1 --2- 172.21.15.42:0/339382620 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc0004430 0x7facc00048f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7facbc00c370 tx=0x7facc0005880 comp rx=0 tx=0).stop 2023-07-29T02:00:47.255 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.257+0000 7facd8e55700 1 -- 172.21.15.42:0/339382620 reap_dead start 2023-07-29T02:00:47.255 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.257+0000 7facda8b8700 1 -- 172.21.15.42:0/339382620 shutdown_connections 2023-07-29T02:00:47.255 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.257+0000 7facda8b8700 1 -- 172.21.15.42:0/339382620 >> 172.21.15.42:0/339382620 conn(0x7facd406f850 msgr2=0x7facd40cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:47.255 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.257+0000 7facda8b8700 1 -- 172.21.15.42:0/339382620 shutdown_connections 2023-07-29T02:00:47.255 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.257+0000 7facda8b8700 1 -- 172.21.15.42:0/339382620 wait complete. 2023-07-29T02:00:47.257 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.258+0000 7facda8b8700 1 Processor -- start 2023-07-29T02:00:47.257 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.258+0000 7facda8b8700 1 -- start start 2023-07-29T02:00:47.257 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.259+0000 7facda8b8700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc0004430 0x7facd41f28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:47.258 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.259+0000 7facda8b8700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7facd40ca8d0 0x7facd415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:47.258 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.259+0000 7facda8b8700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facd40cb000 0x7facd41ef170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:47.258 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.259+0000 7facda8b8700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd41f24d0 con 0x7facc0004430 2023-07-29T02:00:47.258 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.259+0000 7facda8b8700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd40cc280 con 0x7facd40cb000 2023-07-29T02:00:47.258 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.259+0000 7facda8b8700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd41ef6b0 con 0x7facd40ca8d0 2023-07-29T02:00:47.258 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.259+0000 7facd3fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc0004430 0x7facd41f28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:47.258 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.259+0000 7facd3fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc0004430 0x7facd41f28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57116/0 (socket says 172.21.15.42:57116) 2023-07-29T02:00:47.259 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.259+0000 7facd3fff700 1 -- 172.21.15.42:0/904700261 learned_addr learned my addr 172.21.15.42:0/904700261 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:47.259 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.259+0000 7facd37fe700 1 --2- 172.21.15.42:0/904700261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7facd40ca8d0 0x7facd415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:47.259 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.259+0000 7facd8e55700 1 --2- 172.21.15.42:0/904700261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facd40cb000 0x7facd41ef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:47.259 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.259+0000 7facd3fff700 1 -- 172.21.15.42:0/904700261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7facd40ca8d0 msgr2=0x7facd415a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:47.259 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.259+0000 7facd3fff700 1 --2- 172.21.15.42:0/904700261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7facd40ca8d0 0x7facd415a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.259 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.259+0000 7facd3fff700 1 -- 172.21.15.42:0/904700261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facd40cb000 msgr2=0x7facd41ef170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:47.260 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.259+0000 7facd3fff700 1 --2- 172.21.15.42:0/904700261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facd40cb000 0x7facd41ef170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.260 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.259+0000 7facd3fff700 1 -- 172.21.15.42:0/904700261 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd40cbcc0 con 0x7facc0004430 2023-07-29T02:00:47.260 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.259+0000 7facd37fe700 1 --2- 172.21.15.42:0/904700261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7facd40ca8d0 0x7facd415a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:47.260 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.259+0000 7facd3fff700 1 --2- 172.21.15.42:0/904700261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc0004430 0x7facd41f28f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7facc4011aa0 tx=0x7facc4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:47.260 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.260+0000 7facd0ff9700 1 -- 172.21.15.42:0/904700261 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc400f980 con 0x7facc0004430 2023-07-29T02:00:47.260 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.260+0000 7facd0ff9700 1 -- 172.21.15.42:0/904700261 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc400fb00 con 0x7facc0004430 2023-07-29T02:00:47.260 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.260+0000 7facda8b8700 1 -- 172.21.15.42:0/904700261 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd40cbfa0 con 0x7facc0004430 2023-07-29T02:00:47.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.260+0000 7facd0ff9700 1 -- 172.21.15.42:0/904700261 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc400feb0 con 0x7facc0004430 2023-07-29T02:00:47.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.260+0000 7facda8b8700 1 -- 172.21.15.42:0/904700261 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd41f20f0 con 0x7facc0004430 2023-07-29T02:00:47.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.261+0000 7facda8b8700 1 -- 172.21.15.42:0/904700261 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd404ea50 con 0x7facc0004430 2023-07-29T02:00:47.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.261+0000 7facd0ff9700 1 -- 172.21.15.42:0/904700261 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7facc4014440 con 0x7facc0004430 2023-07-29T02:00:47.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.261+0000 7facd0ff9700 1 --2- 172.21.15.42:0/904700261 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7facb406a690 0x7facb406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:47.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.262+0000 7facd0ff9700 1 -- 172.21.15.42:0/904700261 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6850+0+0 (secure 0 0 0) 0x7facc40895d0 con 0x7facc0004430 2023-07-29T02:00:47.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.262+0000 7facd37fe700 1 --2- 172.21.15.42:0/904700261 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7facb406a690 0x7facb406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:47.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.262+0000 7facd37fe700 1 --2- 172.21.15.42:0/904700261 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7facb406a690 0x7facb406cb40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7facbc015040 tx=0x7facbc00a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:47.262 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.266+0000 7facd0ff9700 1 -- 172.21.15.42:0/904700261 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7facc40582b0 con 0x7facc0004430 2023-07-29T02:00:47.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.458+0000 7facda8b8700 1 -- 172.21.15.42:0/904700261 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7facd40c7790 con 0x7facb406a690 2023-07-29T02:00:47.456 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.469+0000 7facd0ff9700 1 -- 172.21.15.42:0/904700261 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367628 (secure 0 0 0) 0x7facbc00cd30 con 0x7facb406a690 2023-07-29T02:00:47.462 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:47.465 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.473+0000 7facda8b8700 1 -- 172.21.15.42:0/904700261 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7facb406a690 msgr2=0x7facb406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:47.466 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.473+0000 7facda8b8700 1 --2- 172.21.15.42:0/904700261 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7facb406a690 0x7facb406cb40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7facbc015040 tx=0x7facbc00a000 comp rx=0 tx=0).stop 2023-07-29T02:00:47.466 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.473+0000 7facda8b8700 1 -- 172.21.15.42:0/904700261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc0004430 msgr2=0x7facd41f28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:47.466 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.473+0000 7facda8b8700 1 --2- 172.21.15.42:0/904700261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc0004430 0x7facd41f28f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7facc4011aa0 tx=0x7facc4011e60 comp rx=0 tx=0).stop 2023-07-29T02:00:47.466 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.473+0000 7facda8b8700 1 -- 172.21.15.42:0/904700261 shutdown_connections 2023-07-29T02:00:47.467 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.473+0000 7facda8b8700 1 --2- 172.21.15.42:0/904700261 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7facb406a690 0x7facb406cb40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.467 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.473+0000 7facda8b8700 1 --2- 172.21.15.42:0/904700261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7facd40cb000 0x7facd41ef170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.467 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.473+0000 7facda8b8700 1 --2- 172.21.15.42:0/904700261 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7facc0004430 0x7facd41f28f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.468 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.473+0000 7facda8b8700 1 --2- 172.21.15.42:0/904700261 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7facd40ca8d0 0x7facd415a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.468 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.473+0000 7facda8b8700 1 -- 172.21.15.42:0/904700261 >> 172.21.15.42:0/904700261 conn(0x7facd406f850 msgr2=0x7facd40b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:47.468 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.473+0000 7facda8b8700 1 -- 172.21.15.42:0/904700261 shutdown_connections 2023-07-29T02:00:47.468 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.473+0000 7facda8b8700 1 -- 172.21.15.42:0/904700261 wait complete. 2023-07-29T02:00:47.469 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2023-07-29T02:00:47.472 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2023-07-29T02:00:47.244465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595217,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":209,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217884,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756836,"statfs":{"total":773094113280,"available":772871000064,"internally_reserved":0,"allocated":2322432,"data_stored":2064681,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":260,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002477"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972736+0000","last_change":"2023-07-29T01:59:57.958129+0000","last_active":"2023-07-29T02:00:01.972736+0000","last_peered":"2023-07-29T02:00:01.972736+0000","last_clean":"2023-07-29T02:00:01.972736+0000","last_became_active":"2023-07-29T01:59:57.957742+0000","last_became_peered":"2023-07-29T01:59:57.957742+0000","last_unstale":"2023-07-29T02:00:01.972736+0000","last_undegraded":"2023-07-29T02:00:01.972736+0000","last_fullsized":"2023-07-29T02:00:01.972736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:32.550358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975520+0000","last_change":"2023-07-29T01:59:57.974652+0000","last_active":"2023-07-29T02:00:01.975520+0000","last_peered":"2023-07-29T02:00:01.975520+0000","last_clean":"2023-07-29T02:00:01.975520+0000","last_became_active":"2023-07-29T01:59:57.974338+0000","last_became_peered":"2023-07-29T01:59:57.974338+0000","last_unstale":"2023-07-29T02:00:01.975520+0000","last_undegraded":"2023-07-29T02:00:01.975520+0000","last_fullsized":"2023-07-29T02:00:01.975520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978265+0000","last_change":"2023-07-29T01:59:57.973621+0000","last_active":"2023-07-29T02:00:01.978265+0000","last_peered":"2023-07-29T02:00:01.978265+0000","last_clean":"2023-07-29T02:00:01.978265+0000","last_became_active":"2023-07-29T01:59:57.973406+0000","last_became_peered":"2023-07-29T01:59:57.973406+0000","last_unstale":"2023-07-29T02:00:01.978265+0000","last_undegraded":"2023-07-29T02:00:01.978265+0000","last_fullsized":"2023-07-29T02:00:01.978265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:08:23.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968045+0000","last_change":"2023-07-29T01:59:57.965192+0000","last_active":"2023-07-29T02:00:01.968045+0000","last_peered":"2023-07-29T02:00:01.968045+0000","last_clean":"2023-07-29T02:00:01.968045+0000","last_became_active":"2023-07-29T01:59:57.964865+0000","last_became_peered":"2023-07-29T01:59:57.964865+0000","last_unstale":"2023-07-29T02:00:01.968045+0000","last_undegraded":"2023-07-29T02:00:01.968045+0000","last_fullsized":"2023-07-29T02:00:01.968045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:32.905717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967106+0000","last_change":"2023-07-29T01:59:57.971026+0000","last_active":"2023-07-29T02:00:01.967106+0000","last_peered":"2023-07-29T02:00:01.967106+0000","last_clean":"2023-07-29T02:00:01.967106+0000","last_became_active":"2023-07-29T01:59:57.970733+0000","last_became_peered":"2023-07-29T01:59:57.970733+0000","last_unstale":"2023-07-29T02:00:01.967106+0000","last_undegraded":"2023-07-29T02:00:01.967106+0000","last_fullsized":"2023-07-29T02:00:01.967106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971129+0000","last_change":"2023-07-29T01:59:57.965729+0000","last_active":"2023-07-29T02:00:01.971129+0000","last_peered":"2023-07-29T02:00:01.971129+0000","last_clean":"2023-07-29T02:00:01.971129+0000","last_became_active":"2023-07-29T01:59:57.964993+0000","last_became_peered":"2023-07-29T01:59:57.964993+0000","last_unstale":"2023-07-29T02:00:01.971129+0000","last_undegraded":"2023-07-29T02:00:01.971129+0000","last_fullsized":"2023-07-29T02:00:01.971129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974411+0000","last_change":"2023-07-29T01:59:57.970481+0000","last_active":"2023-07-29T02:00:01.974411+0000","last_peered":"2023-07-29T02:00:01.974411+0000","last_clean":"2023-07-29T02:00:01.974411+0000","last_became_active":"2023-07-29T01:59:57.970232+0000","last_became_peered":"2023-07-29T01:59:57.970232+0000","last_unstale":"2023-07-29T02:00:01.974411+0000","last_undegraded":"2023-07-29T02:00:01.974411+0000","last_fullsized":"2023-07-29T02:00:01.974411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974000+0000","last_change":"2023-07-29T01:59:57.963201+0000","last_active":"2023-07-29T02:00:01.974000+0000","last_peered":"2023-07-29T02:00:01.974000+0000","last_clean":"2023-07-29T02:00:01.974000+0000","last_became_active":"2023-07-29T01:59:57.962884+0000","last_became_peered":"2023-07-29T01:59:57.962884+0000","last_unstale":"2023-07-29T02:00:01.974000+0000","last_undegraded":"2023-07-29T02:00:01.974000+0000","last_fullsized":"2023-07-29T02:00:01.974000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967238+0000","last_change":"2023-07-29T01:59:57.971916+0000","last_active":"2023-07-29T02:00:01.967238+0000","last_peered":"2023-07-29T02:00:01.967238+0000","last_clean":"2023-07-29T02:00:01.967238+0000","last_became_active":"2023-07-29T01:59:57.971640+0000","last_became_peered":"2023-07-29T01:59:57.971640+0000","last_unstale":"2023-07-29T02:00:01.967238+0000","last_undegraded":"2023-07-29T02:00:01.967238+0000","last_fullsized":"2023-07-29T02:00:01.967238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975619+0000","last_change":"2023-07-29T01:59:57.963080+0000","last_active":"2023-07-29T02:00:01.975619+0000","last_peered":"2023-07-29T02:00:01.975619+0000","last_clean":"2023-07-29T02:00:01.975619+0000","last_became_active":"2023-07-29T01:59:57.962799+0000","last_became_peered":"2023-07-29T01:59:57.962799+0000","last_unstale":"2023-07-29T02:00:01.975619+0000","last_undegraded":"2023-07-29T02:00:01.975619+0000","last_fullsized":"2023-07-29T02:00:01.975619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978173+0000","last_change":"2023-07-29T01:59:57.970172+0000","last_active":"2023-07-29T02:00:01.978173+0000","last_peered":"2023-07-29T02:00:01.978173+0000","last_clean":"2023-07-29T02:00:01.978173+0000","last_became_active":"2023-07-29T01:59:57.969868+0000","last_became_peered":"2023-07-29T01:59:57.969868+0000","last_unstale":"2023-07-29T02:00:01.978173+0000","last_undegraded":"2023-07-29T02:00:01.978173+0000","last_fullsized":"2023-07-29T02:00:01.978173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972765+0000","last_change":"2023-07-29T01:59:57.964171+0000","last_active":"2023-07-29T02:00:01.972765+0000","last_peered":"2023-07-29T02:00:01.972765+0000","last_clean":"2023-07-29T02:00:01.972765+0000","last_became_active":"2023-07-29T01:59:57.963902+0000","last_became_peered":"2023-07-29T01:59:57.963902+0000","last_unstale":"2023-07-29T02:00:01.972765+0000","last_undegraded":"2023-07-29T02:00:01.972765+0000","last_fullsized":"2023-07-29T02:00:01.972765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:51.691001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972884+0000","last_change":"2023-07-29T01:59:57.963492+0000","last_active":"2023-07-29T02:00:01.972884+0000","last_peered":"2023-07-29T02:00:01.972884+0000","last_clean":"2023-07-29T02:00:01.972884+0000","last_became_active":"2023-07-29T01:59:57.963239+0000","last_became_peered":"2023-07-29T01:59:57.963239+0000","last_unstale":"2023-07-29T02:00:01.972884+0000","last_undegraded":"2023-07-29T02:00:01.972884+0000","last_fullsized":"2023-07-29T02:00:01.972884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:08.001986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974742+0000","last_change":"2023-07-29T01:59:57.961369+0000","last_active":"2023-07-29T02:00:01.974742+0000","last_peered":"2023-07-29T02:00:01.974742+0000","last_clean":"2023-07-29T02:00:01.974742+0000","last_became_active":"2023-07-29T01:59:57.960709+0000","last_became_peered":"2023-07-29T01:59:57.960709+0000","last_unstale":"2023-07-29T02:00:01.974742+0000","last_undegraded":"2023-07-29T02:00:01.974742+0000","last_fullsized":"2023-07-29T02:00:01.974742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974229+0000","last_change":"2023-07-29T01:59:57.970498+0000","last_active":"2023-07-29T02:00:01.974229+0000","last_peered":"2023-07-29T02:00:01.974229+0000","last_clean":"2023-07-29T02:00:01.974229+0000","last_became_active":"2023-07-29T01:59:57.970263+0000","last_became_peered":"2023-07-29T01:59:57.970263+0000","last_unstale":"2023-07-29T02:00:01.974229+0000","last_undegraded":"2023-07-29T02:00:01.974229+0000","last_fullsized":"2023-07-29T02:00:01.974229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975567+0000","last_change":"2023-07-29T01:59:57.965648+0000","last_active":"2023-07-29T02:00:01.975567+0000","last_peered":"2023-07-29T02:00:01.975567+0000","last_clean":"2023-07-29T02:00:01.975567+0000","last_became_active":"2023-07-29T01:59:57.964696+0000","last_became_peered":"2023-07-29T01:59:57.964696+0000","last_unstale":"2023-07-29T02:00:01.975567+0000","last_undegraded":"2023-07-29T02:00:01.975567+0000","last_fullsized":"2023-07-29T02:00:01.975567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:19:14.641252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967346+0000","last_change":"2023-07-29T01:59:57.969148+0000","last_active":"2023-07-29T02:00:01.967346+0000","last_peered":"2023-07-29T02:00:01.967346+0000","last_clean":"2023-07-29T02:00:01.967346+0000","last_became_active":"2023-07-29T01:59:57.968885+0000","last_became_peered":"2023-07-29T01:59:57.968885+0000","last_unstale":"2023-07-29T02:00:01.967346+0000","last_undegraded":"2023-07-29T02:00:01.967346+0000","last_fullsized":"2023-07-29T02:00:01.967346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977442+0000","last_change":"2023-07-29T01:59:57.963189+0000","last_active":"2023-07-29T02:00:01.977442+0000","last_peered":"2023-07-29T02:00:01.977442+0000","last_clean":"2023-07-29T02:00:01.977442+0000","last_became_active":"2023-07-29T01:59:57.962919+0000","last_became_peered":"2023-07-29T01:59:57.962919+0000","last_unstale":"2023-07-29T02:00:01.977442+0000","last_undegraded":"2023-07-29T02:00:01.977442+0000","last_fullsized":"2023-07-29T02:00:01.977442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:16:58.718803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973218+0000","last_change":"2023-07-29T01:59:57.960380+0000","last_active":"2023-07-29T02:00:01.973218+0000","last_peered":"2023-07-29T02:00:01.973218+0000","last_clean":"2023-07-29T02:00:01.973218+0000","last_became_active":"2023-07-29T01:59:57.960111+0000","last_became_peered":"2023-07-29T01:59:57.960111+0000","last_unstale":"2023-07-29T02:00:01.973218+0000","last_undegraded":"2023-07-29T02:00:01.973218+0000","last_fullsized":"2023-07-29T02:00:01.973218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:45.956813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977046+0000","last_change":"2023-07-29T01:59:57.961945+0000","last_active":"2023-07-29T02:00:01.977046+0000","last_peered":"2023-07-29T02:00:01.977046+0000","last_clean":"2023-07-29T02:00:01.977046+0000","last_became_active":"2023-07-29T01:59:57.961655+0000","last_became_peered":"2023-07-29T01:59:57.961655+0000","last_unstale":"2023-07-29T02:00:01.977046+0000","last_undegraded":"2023-07-29T02:00:01.977046+0000","last_fullsized":"2023-07-29T02:00:01.977046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.203628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974482+0000","last_change":"2023-07-29T01:59:57.971030+0000","last_active":"2023-07-29T02:00:01.974482+0000","last_peered":"2023-07-29T02:00:01.974482+0000","last_clean":"2023-07-29T02:00:01.974482+0000","last_became_active":"2023-07-29T01:59:57.970757+0000","last_became_peered":"2023-07-29T01:59:57.970757+0000","last_unstale":"2023-07-29T02:00:01.974482+0000","last_undegraded":"2023-07-29T02:00:01.974482+0000","last_fullsized":"2023-07-29T02:00:01.974482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966509+0000","last_change":"2023-07-29T01:59:57.974734+0000","last_active":"2023-07-29T02:00:01.966509+0000","last_peered":"2023-07-29T02:00:01.966509+0000","last_clean":"2023-07-29T02:00:01.966509+0000","last_became_active":"2023-07-29T01:59:57.974436+0000","last_became_peered":"2023-07-29T01:59:57.974436+0000","last_unstale":"2023-07-29T02:00:01.966509+0000","last_undegraded":"2023-07-29T02:00:01.966509+0000","last_fullsized":"2023-07-29T02:00:01.966509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979698+0000","last_change":"2023-07-29T01:59:57.967259+0000","last_active":"2023-07-29T02:00:01.979698+0000","last_peered":"2023-07-29T02:00:01.979698+0000","last_clean":"2023-07-29T02:00:01.979698+0000","last_became_active":"2023-07-29T01:59:57.966987+0000","last_became_peered":"2023-07-29T01:59:57.966987+0000","last_unstale":"2023-07-29T02:00:01.979698+0000","last_undegraded":"2023-07-29T02:00:01.979698+0000","last_fullsized":"2023-07-29T02:00:01.979698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973494+0000","last_change":"2023-07-29T01:59:57.971976+0000","last_active":"2023-07-29T02:00:01.973494+0000","last_peered":"2023-07-29T02:00:01.973494+0000","last_clean":"2023-07-29T02:00:01.973494+0000","last_became_active":"2023-07-29T01:59:57.971733+0000","last_became_peered":"2023-07-29T01:59:57.971733+0000","last_unstale":"2023-07-29T02:00:01.973494+0000","last_undegraded":"2023-07-29T02:00:01.973494+0000","last_fullsized":"2023-07-29T02:00:01.973494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972112+0000","last_change":"2023-07-29T01:59:57.973644+0000","last_active":"2023-07-29T02:00:01.972112+0000","last_peered":"2023-07-29T02:00:01.972112+0000","last_clean":"2023-07-29T02:00:01.972112+0000","last_became_active":"2023-07-29T01:59:57.969742+0000","last_became_peered":"2023-07-29T01:59:57.969742+0000","last_unstale":"2023-07-29T02:00:01.972112+0000","last_undegraded":"2023-07-29T02:00:01.972112+0000","last_fullsized":"2023-07-29T02:00:01.972112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975642+0000","last_change":"2023-07-29T01:59:57.969779+0000","last_active":"2023-07-29T02:00:01.975642+0000","last_peered":"2023-07-29T02:00:01.975642+0000","last_clean":"2023-07-29T02:00:01.975642+0000","last_became_active":"2023-07-29T01:59:57.969409+0000","last_became_peered":"2023-07-29T01:59:57.969409+0000","last_unstale":"2023-07-29T02:00:01.975642+0000","last_undegraded":"2023-07-29T02:00:01.975642+0000","last_fullsized":"2023-07-29T02:00:01.975642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977989+0000","last_change":"2023-07-29T01:59:57.965799+0000","last_active":"2023-07-29T02:00:01.977989+0000","last_peered":"2023-07-29T02:00:01.977989+0000","last_clean":"2023-07-29T02:00:01.977989+0000","last_became_active":"2023-07-29T01:59:57.963774+0000","last_became_peered":"2023-07-29T01:59:57.963774+0000","last_unstale":"2023-07-29T02:00:01.977989+0000","last_undegraded":"2023-07-29T02:00:01.977989+0000","last_fullsized":"2023-07-29T02:00:01.977989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399488+0000","last_change":"2023-07-29T02:00:01.994114+0000","last_active":"2023-07-29T02:00:02.399488+0000","last_peered":"2023-07-29T02:00:02.399488+0000","last_clean":"2023-07-29T02:00:02.399488+0000","last_became_active":"2023-07-29T02:00:01.993731+0000","last_became_peered":"2023-07-29T02:00:01.993731+0000","last_unstale":"2023-07-29T02:00:02.399488+0000","last_undegraded":"2023-07-29T02:00:02.399488+0000","last_fullsized":"2023-07-29T02:00:02.399488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:14:25.422754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399152+0000","last_change":"2023-07-29T01:59:57.552913+0000","last_active":"2023-07-29T02:00:02.399152+0000","last_peered":"2023-07-29T02:00:02.399152+0000","last_clean":"2023-07-29T02:00:02.399152+0000","last_became_active":"2023-07-29T01:59:57.552673+0000","last_became_peered":"2023-07-29T01:59:57.552673+0000","last_unstale":"2023-07-29T02:00:02.399152+0000","last_undegraded":"2023-07-29T02:00:02.399152+0000","last_fullsized":"2023-07-29T02:00:02.399152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:49:56.335019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978862+0000","last_change":"2023-07-29T01:59:57.970140+0000","last_active":"2023-07-29T02:00:01.978862+0000","last_peered":"2023-07-29T02:00:01.978862+0000","last_clean":"2023-07-29T02:00:01.978862+0000","last_became_active":"2023-07-29T01:59:57.969821+0000","last_became_peered":"2023-07-29T01:59:57.969821+0000","last_unstale":"2023-07-29T02:00:01.978862+0000","last_undegraded":"2023-07-29T02:00:01.978862+0000","last_fullsized":"2023-07-29T02:00:01.978862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439205+0000","last_change":"2023-07-29T02:00:01.992728+0000","last_active":"2023-07-29T02:00:02.439205+0000","last_peered":"2023-07-29T02:00:02.439205+0000","last_clean":"2023-07-29T02:00:02.439205+0000","last_became_active":"2023-07-29T02:00:01.992338+0000","last_became_peered":"2023-07-29T02:00:01.992338+0000","last_unstale":"2023-07-29T02:00:02.439205+0000","last_undegraded":"2023-07-29T02:00:02.439205+0000","last_fullsized":"2023-07-29T02:00:02.439205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:37.968145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972242+0000","last_change":"2023-07-29T01:59:57.547793+0000","last_active":"2023-07-29T02:00:01.972242+0000","last_peered":"2023-07-29T02:00:01.972242+0000","last_clean":"2023-07-29T02:00:01.972242+0000","last_became_active":"2023-07-29T01:59:57.547455+0000","last_became_peered":"2023-07-29T01:59:57.547455+0000","last_unstale":"2023-07-29T02:00:01.972242+0000","last_undegraded":"2023-07-29T02:00:01.972242+0000","last_fullsized":"2023-07-29T02:00:01.972242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967048+0000","last_change":"2023-07-29T01:59:57.964646+0000","last_active":"2023-07-29T02:00:01.967048+0000","last_peered":"2023-07-29T02:00:01.967048+0000","last_clean":"2023-07-29T02:00:01.967048+0000","last_became_active":"2023-07-29T01:59:57.964393+0000","last_became_peered":"2023-07-29T01:59:57.964393+0000","last_unstale":"2023-07-29T02:00:01.967048+0000","last_undegraded":"2023-07-29T02:00:01.967048+0000","last_fullsized":"2023-07-29T02:00:01.967048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440161+0000","last_change":"2023-07-29T02:00:01.982883+0000","last_active":"2023-07-29T02:00:02.440161+0000","last_peered":"2023-07-29T02:00:02.440161+0000","last_clean":"2023-07-29T02:00:02.440161+0000","last_became_active":"2023-07-29T02:00:01.982042+0000","last_became_peered":"2023-07-29T02:00:01.982042+0000","last_unstale":"2023-07-29T02:00:02.440161+0000","last_undegraded":"2023-07-29T02:00:02.440161+0000","last_fullsized":"2023-07-29T02:00:02.440161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977952+0000","last_change":"2023-07-29T01:59:57.535286+0000","last_active":"2023-07-29T02:00:01.977952+0000","last_peered":"2023-07-29T02:00:01.977952+0000","last_clean":"2023-07-29T02:00:01.977952+0000","last_became_active":"2023-07-29T01:59:57.533523+0000","last_became_peered":"2023-07-29T01:59:57.533523+0000","last_unstale":"2023-07-29T02:00:01.977952+0000","last_undegraded":"2023-07-29T02:00:01.977952+0000","last_fullsized":"2023-07-29T02:00:01.977952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968772+0000","last_change":"2023-07-29T01:59:57.963792+0000","last_active":"2023-07-29T02:00:01.968772+0000","last_peered":"2023-07-29T02:00:01.968772+0000","last_clean":"2023-07-29T02:00:01.968772+0000","last_became_active":"2023-07-29T01:59:57.963466+0000","last_became_peered":"2023-07-29T01:59:57.963466+0000","last_unstale":"2023-07-29T02:00:01.968772+0000","last_undegraded":"2023-07-29T02:00:01.968772+0000","last_fullsized":"2023-07-29T02:00:01.968772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:28.048947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.438720+0000","last_change":"2023-07-29T02:00:01.984458+0000","last_active":"2023-07-29T02:00:02.438720+0000","last_peered":"2023-07-29T02:00:02.438720+0000","last_clean":"2023-07-29T02:00:02.438720+0000","last_became_active":"2023-07-29T02:00:01.984000+0000","last_became_peered":"2023-07-29T02:00:01.984000+0000","last_unstale":"2023-07-29T02:00:02.438720+0000","last_undegraded":"2023-07-29T02:00:02.438720+0000","last_fullsized":"2023-07-29T02:00:02.438720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967445+0000","last_change":"2023-07-29T01:59:57.537082+0000","last_active":"2023-07-29T02:00:01.967445+0000","last_peered":"2023-07-29T02:00:01.967445+0000","last_clean":"2023-07-29T02:00:01.967445+0000","last_became_active":"2023-07-29T01:59:57.536732+0000","last_became_peered":"2023-07-29T01:59:57.536732+0000","last_unstale":"2023-07-29T02:00:01.967445+0000","last_undegraded":"2023-07-29T02:00:01.967445+0000","last_fullsized":"2023-07-29T02:00:01.967445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977852+0000","last_change":"2023-07-29T01:59:57.971203+0000","last_active":"2023-07-29T02:00:01.977852+0000","last_peered":"2023-07-29T02:00:01.977852+0000","last_clean":"2023-07-29T02:00:01.977852+0000","last_became_active":"2023-07-29T01:59:57.970902+0000","last_became_peered":"2023-07-29T01:59:57.970902+0000","last_unstale":"2023-07-29T02:00:01.977852+0000","last_undegraded":"2023-07-29T02:00:01.977852+0000","last_fullsized":"2023-07-29T02:00:01.977852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399530+0000","last_change":"2023-07-29T02:00:01.991435+0000","last_active":"2023-07-29T02:00:02.399530+0000","last_peered":"2023-07-29T02:00:02.399530+0000","last_clean":"2023-07-29T02:00:02.399530+0000","last_became_active":"2023-07-29T02:00:01.989456+0000","last_became_peered":"2023-07-29T02:00:01.989456+0000","last_unstale":"2023-07-29T02:00:02.399530+0000","last_undegraded":"2023-07-29T02:00:02.399530+0000","last_fullsized":"2023-07-29T02:00:02.399530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975677+0000","last_change":"2023-07-29T01:59:57.540572+0000","last_active":"2023-07-29T02:00:01.975677+0000","last_peered":"2023-07-29T02:00:01.975677+0000","last_clean":"2023-07-29T02:00:01.975677+0000","last_became_active":"2023-07-29T01:59:57.540113+0000","last_became_peered":"2023-07-29T01:59:57.540113+0000","last_unstale":"2023-07-29T02:00:01.975677+0000","last_undegraded":"2023-07-29T02:00:01.975677+0000","last_fullsized":"2023-07-29T02:00:01.975677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979625+0000","last_change":"2023-07-29T01:59:57.967343+0000","last_active":"2023-07-29T02:00:01.979625+0000","last_peered":"2023-07-29T02:00:01.979625+0000","last_clean":"2023-07-29T02:00:01.979625+0000","last_became_active":"2023-07-29T01:59:57.967083+0000","last_became_peered":"2023-07-29T01:59:57.967083+0000","last_unstale":"2023-07-29T02:00:01.979625+0000","last_undegraded":"2023-07-29T02:00:01.979625+0000","last_fullsized":"2023-07-29T02:00:01.979625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441217+0000","last_change":"2023-07-29T02:00:01.996761+0000","last_active":"2023-07-29T02:00:02.441217+0000","last_peered":"2023-07-29T02:00:02.441217+0000","last_clean":"2023-07-29T02:00:02.441217+0000","last_became_active":"2023-07-29T02:00:01.996035+0000","last_became_peered":"2023-07-29T02:00:01.996035+0000","last_unstale":"2023-07-29T02:00:02.441217+0000","last_undegraded":"2023-07-29T02:00:02.441217+0000","last_fullsized":"2023-07-29T02:00:02.441217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"25'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958140+0000","last_change":"2023-07-29T01:59:57.548665+0000","last_active":"2023-07-29T02:00:02.958140+0000","last_peered":"2023-07-29T02:00:02.958140+0000","last_clean":"2023-07-29T02:00:02.958140+0000","last_became_active":"2023-07-29T01:59:57.547803+0000","last_became_peered":"2023-07-29T01:59:57.547803+0000","last_unstale":"2023-07-29T02:00:02.958140+0000","last_undegraded":"2023-07-29T02:00:02.958140+0000","last_fullsized":"2023-07-29T02:00:02.958140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971561+0000","last_change":"2023-07-29T01:59:57.969319+0000","last_active":"2023-07-29T02:00:01.971561+0000","last_peered":"2023-07-29T02:00:01.971561+0000","last_clean":"2023-07-29T02:00:01.971561+0000","last_became_active":"2023-07-29T01:59:57.969006+0000","last_became_peered":"2023-07-29T01:59:57.969006+0000","last_unstale":"2023-07-29T02:00:01.971561+0000","last_undegraded":"2023-07-29T02:00:01.971561+0000","last_fullsized":"2023-07-29T02:00:01.971561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:30:28.393515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440217+0000","last_change":"2023-07-29T02:00:01.996124+0000","last_active":"2023-07-29T02:00:02.440217+0000","last_peered":"2023-07-29T02:00:02.440217+0000","last_clean":"2023-07-29T02:00:02.440217+0000","last_became_active":"2023-07-29T02:00:01.995757+0000","last_became_peered":"2023-07-29T02:00:01.995757+0000","last_unstale":"2023-07-29T02:00:02.440217+0000","last_undegraded":"2023-07-29T02:00:02.440217+0000","last_fullsized":"2023-07-29T02:00:02.440217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:24:03.881006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'11","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:41.635077+0000","last_change":"2023-07-29T01:59:57.541936+0000","last_active":"2023-07-29T02:00:41.635077+0000","last_peered":"2023-07-29T02:00:41.635077+0000","last_clean":"2023-07-29T02:00:41.635077+0000","last_became_active":"2023-07-29T01:59:57.541434+0000","last_became_peered":"2023-07-29T01:59:57.541434+0000","last_unstale":"2023-07-29T02:00:41.635077+0000","last_undegraded":"2023-07-29T02:00:41.635077+0000","last_fullsized":"2023-07-29T02:00:41.635077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4051,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976628+0000","last_change":"2023-07-29T01:59:57.962725+0000","last_active":"2023-07-29T02:00:01.976628+0000","last_peered":"2023-07-29T02:00:01.976628+0000","last_clean":"2023-07-29T02:00:01.976628+0000","last_became_active":"2023-07-29T01:59:57.962459+0000","last_became_peered":"2023-07-29T01:59:57.962459+0000","last_unstale":"2023-07-29T02:00:01.976628+0000","last_undegraded":"2023-07-29T02:00:01.976628+0000","last_fullsized":"2023-07-29T02:00:01.976628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401186+0000","last_change":"2023-07-29T02:00:01.996160+0000","last_active":"2023-07-29T02:00:02.401186+0000","last_peered":"2023-07-29T02:00:02.401186+0000","last_clean":"2023-07-29T02:00:02.401186+0000","last_became_active":"2023-07-29T02:00:01.995827+0000","last_became_peered":"2023-07-29T02:00:01.995827+0000","last_unstale":"2023-07-29T02:00:02.401186+0000","last_undegraded":"2023-07-29T02:00:02.401186+0000","last_fullsized":"2023-07-29T02:00:02.401186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958252+0000","last_change":"2023-07-29T01:59:57.545705+0000","last_active":"2023-07-29T02:00:02.958252+0000","last_peered":"2023-07-29T02:00:02.958252+0000","last_clean":"2023-07-29T02:00:02.958252+0000","last_became_active":"2023-07-29T01:59:57.545406+0000","last_became_peered":"2023-07-29T01:59:57.545406+0000","last_unstale":"2023-07-29T02:00:02.958252+0000","last_undegraded":"2023-07-29T02:00:02.958252+0000","last_fullsized":"2023-07-29T02:00:02.958252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:31.903601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.980027+0000","last_change":"2023-07-29T01:59:57.970072+0000","last_active":"2023-07-29T02:00:01.980027+0000","last_peered":"2023-07-29T02:00:01.980027+0000","last_clean":"2023-07-29T02:00:01.980027+0000","last_became_active":"2023-07-29T01:59:57.969809+0000","last_became_peered":"2023-07-29T01:59:57.969809+0000","last_unstale":"2023-07-29T02:00:01.980027+0000","last_undegraded":"2023-07-29T02:00:01.980027+0000","last_fullsized":"2023-07-29T02:00:01.980027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440272+0000","last_change":"2023-07-29T02:00:01.997402+0000","last_active":"2023-07-29T02:00:02.440272+0000","last_peered":"2023-07-29T02:00:02.440272+0000","last_clean":"2023-07-29T02:00:02.440272+0000","last_became_active":"2023-07-29T02:00:01.996969+0000","last_became_peered":"2023-07-29T02:00:01.996969+0000","last_unstale":"2023-07-29T02:00:02.440272+0000","last_undegraded":"2023-07-29T02:00:02.440272+0000","last_fullsized":"2023-07-29T02:00:02.440272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:46:37.088979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966653+0000","last_change":"2023-07-29T01:59:57.541115+0000","last_active":"2023-07-29T02:00:01.966653+0000","last_peered":"2023-07-29T02:00:01.966653+0000","last_clean":"2023-07-29T02:00:01.966653+0000","last_became_active":"2023-07-29T01:59:57.540800+0000","last_became_peered":"2023-07-29T01:59:57.540800+0000","last_unstale":"2023-07-29T02:00:01.966653+0000","last_undegraded":"2023-07-29T02:00:01.966653+0000","last_fullsized":"2023-07-29T02:00:01.966653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977902+0000","last_change":"2023-07-29T01:59:57.964198+0000","last_active":"2023-07-29T02:00:01.977902+0000","last_peered":"2023-07-29T02:00:01.977902+0000","last_clean":"2023-07-29T02:00:01.977902+0000","last_became_active":"2023-07-29T01:59:57.963510+0000","last_became_peered":"2023-07-29T01:59:57.963510+0000","last_unstale":"2023-07-29T02:00:01.977902+0000","last_undegraded":"2023-07-29T02:00:01.977902+0000","last_fullsized":"2023-07-29T02:00:01.977902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441378+0000","last_change":"2023-07-29T02:00:01.996496+0000","last_active":"2023-07-29T02:00:02.441378+0000","last_peered":"2023-07-29T02:00:02.441378+0000","last_clean":"2023-07-29T02:00:02.441378+0000","last_became_active":"2023-07-29T02:00:01.996084+0000","last_became_peered":"2023-07-29T02:00:01.996084+0000","last_unstale":"2023-07-29T02:00:02.441378+0000","last_undegraded":"2023-07-29T02:00:02.441378+0000","last_fullsized":"2023-07-29T02:00:02.441378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:59:57.581952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974316+0000","last_change":"2023-07-29T01:59:57.548464+0000","last_active":"2023-07-29T02:00:01.974316+0000","last_peered":"2023-07-29T02:00:01.974316+0000","last_clean":"2023-07-29T02:00:01.974316+0000","last_became_active":"2023-07-29T01:59:57.548109+0000","last_became_peered":"2023-07-29T01:59:57.548109+0000","last_unstale":"2023-07-29T02:00:01.974316+0000","last_undegraded":"2023-07-29T02:00:01.974316+0000","last_fullsized":"2023-07-29T02:00:01.974316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:13.433053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967896+0000","last_change":"2023-07-29T01:59:57.962096+0000","last_active":"2023-07-29T02:00:01.967896+0000","last_peered":"2023-07-29T02:00:01.967896+0000","last_clean":"2023-07-29T02:00:01.967896+0000","last_became_active":"2023-07-29T01:59:57.961759+0000","last_became_peered":"2023-07-29T01:59:57.961759+0000","last_unstale":"2023-07-29T02:00:01.967896+0000","last_undegraded":"2023-07-29T02:00:01.967896+0000","last_fullsized":"2023-07-29T02:00:01.967896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400737+0000","last_change":"2023-07-29T02:00:01.993066+0000","last_active":"2023-07-29T02:00:02.400737+0000","last_peered":"2023-07-29T02:00:02.400737+0000","last_clean":"2023-07-29T02:00:02.400737+0000","last_became_active":"2023-07-29T02:00:01.992592+0000","last_became_peered":"2023-07-29T02:00:01.992592+0000","last_unstale":"2023-07-29T02:00:02.400737+0000","last_undegraded":"2023-07-29T02:00:02.400737+0000","last_fullsized":"2023-07-29T02:00:02.400737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:14:06.353802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958759+0000","last_change":"2023-07-29T01:59:57.543707+0000","last_active":"2023-07-29T02:00:02.958759+0000","last_peered":"2023-07-29T02:00:02.958759+0000","last_clean":"2023-07-29T02:00:02.958759+0000","last_became_active":"2023-07-29T01:59:57.543398+0000","last_became_peered":"2023-07-29T01:59:57.543398+0000","last_unstale":"2023-07-29T02:00:02.958759+0000","last_undegraded":"2023-07-29T02:00:02.958759+0000","last_fullsized":"2023-07-29T02:00:02.958759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977853+0000","last_change":"2023-07-29T01:59:57.966269+0000","last_active":"2023-07-29T02:00:01.977853+0000","last_peered":"2023-07-29T02:00:01.977853+0000","last_clean":"2023-07-29T02:00:01.977853+0000","last_became_active":"2023-07-29T01:59:57.965962+0000","last_became_peered":"2023-07-29T01:59:57.965962+0000","last_unstale":"2023-07-29T02:00:01.977853+0000","last_undegraded":"2023-07-29T02:00:01.977853+0000","last_fullsized":"2023-07-29T02:00:01.977853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400336+0000","last_change":"2023-07-29T02:00:01.992987+0000","last_active":"2023-07-29T02:00:02.400336+0000","last_peered":"2023-07-29T02:00:02.400336+0000","last_clean":"2023-07-29T02:00:02.400336+0000","last_became_active":"2023-07-29T02:00:01.992384+0000","last_became_peered":"2023-07-29T02:00:01.992384+0000","last_unstale":"2023-07-29T02:00:02.400336+0000","last_undegraded":"2023-07-29T02:00:02.400336+0000","last_fullsized":"2023-07-29T02:00:02.400336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400080+0000","last_change":"2023-07-29T01:59:57.548392+0000","last_active":"2023-07-29T02:00:02.400080+0000","last_peered":"2023-07-29T02:00:02.400080+0000","last_clean":"2023-07-29T02:00:02.400080+0000","last_became_active":"2023-07-29T01:59:57.548084+0000","last_became_peered":"2023-07-29T01:59:57.548084+0000","last_unstale":"2023-07-29T02:00:02.400080+0000","last_undegraded":"2023-07-29T02:00:02.400080+0000","last_fullsized":"2023-07-29T02:00:02.400080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973873+0000","last_change":"2023-07-29T01:59:57.965613+0000","last_active":"2023-07-29T02:00:01.973873+0000","last_peered":"2023-07-29T02:00:01.973873+0000","last_clean":"2023-07-29T02:00:01.973873+0000","last_became_active":"2023-07-29T01:59:57.964626+0000","last_became_peered":"2023-07-29T01:59:57.964626+0000","last_unstale":"2023-07-29T02:00:01.973873+0000","last_undegraded":"2023-07-29T02:00:01.973873+0000","last_fullsized":"2023-07-29T02:00:01.973873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442405+0000","last_change":"2023-07-29T02:00:01.990978+0000","last_active":"2023-07-29T02:00:02.442405+0000","last_peered":"2023-07-29T02:00:02.442405+0000","last_clean":"2023-07-29T02:00:02.442405+0000","last_became_active":"2023-07-29T02:00:01.990579+0000","last_became_peered":"2023-07-29T02:00:01.990579+0000","last_unstale":"2023-07-29T02:00:02.442405+0000","last_undegraded":"2023-07-29T02:00:02.442405+0000","last_fullsized":"2023-07-29T02:00:02.442405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:11:53.398210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957642+0000","last_change":"2023-07-29T01:59:57.549270+0000","last_active":"2023-07-29T02:00:02.957642+0000","last_peered":"2023-07-29T02:00:02.957642+0000","last_clean":"2023-07-29T02:00:02.957642+0000","last_became_active":"2023-07-29T01:59:57.548981+0000","last_became_peered":"2023-07-29T01:59:57.548981+0000","last_unstale":"2023-07-29T02:00:02.957642+0000","last_undegraded":"2023-07-29T02:00:02.957642+0000","last_fullsized":"2023-07-29T02:00:02.957642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:05.783369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972647+0000","last_change":"2023-07-29T01:59:57.969851+0000","last_active":"2023-07-29T02:00:01.972647+0000","last_peered":"2023-07-29T02:00:01.972647+0000","last_clean":"2023-07-29T02:00:01.972647+0000","last_became_active":"2023-07-29T01:59:57.969501+0000","last_became_peered":"2023-07-29T01:59:57.969501+0000","last_unstale":"2023-07-29T02:00:01.972647+0000","last_undegraded":"2023-07-29T02:00:01.972647+0000","last_fullsized":"2023-07-29T02:00:01.972647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442608+0000","last_change":"2023-07-29T02:00:01.989766+0000","last_active":"2023-07-29T02:00:02.442608+0000","last_peered":"2023-07-29T02:00:02.442608+0000","last_clean":"2023-07-29T02:00:02.442608+0000","last_became_active":"2023-07-29T02:00:01.989364+0000","last_became_peered":"2023-07-29T02:00:01.989364+0000","last_unstale":"2023-07-29T02:00:02.442608+0000","last_undegraded":"2023-07-29T02:00:02.442608+0000","last_fullsized":"2023-07-29T02:00:02.442608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:01:14.849757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400580+0000","last_change":"2023-07-29T01:59:57.541329+0000","last_active":"2023-07-29T02:00:02.400580+0000","last_peered":"2023-07-29T02:00:02.400580+0000","last_clean":"2023-07-29T02:00:02.400580+0000","last_became_active":"2023-07-29T01:59:57.541056+0000","last_became_peered":"2023-07-29T01:59:57.541056+0000","last_unstale":"2023-07-29T02:00:02.400580+0000","last_undegraded":"2023-07-29T02:00:02.400580+0000","last_fullsized":"2023-07-29T02:00:02.400580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968261+0000","last_change":"2023-07-29T01:59:57.975244+0000","last_active":"2023-07-29T02:00:01.968261+0000","last_peered":"2023-07-29T02:00:01.968261+0000","last_clean":"2023-07-29T02:00:01.968261+0000","last_became_active":"2023-07-29T01:59:57.974998+0000","last_became_peered":"2023-07-29T01:59:57.974998+0000","last_unstale":"2023-07-29T02:00:01.968261+0000","last_undegraded":"2023-07-29T02:00:01.968261+0000","last_fullsized":"2023-07-29T02:00:01.968261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:14.435169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442656+0000","last_change":"2023-07-29T02:00:01.990823+0000","last_active":"2023-07-29T02:00:02.442656+0000","last_peered":"2023-07-29T02:00:02.442656+0000","last_clean":"2023-07-29T02:00:02.442656+0000","last_became_active":"2023-07-29T02:00:01.990276+0000","last_became_peered":"2023-07-29T02:00:01.990276+0000","last_unstale":"2023-07-29T02:00:02.442656+0000","last_undegraded":"2023-07-29T02:00:02.442656+0000","last_fullsized":"2023-07-29T02:00:02.442656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974632+0000","last_change":"2023-07-29T01:59:57.544524+0000","last_active":"2023-07-29T02:00:01.974632+0000","last_peered":"2023-07-29T02:00:01.974632+0000","last_clean":"2023-07-29T02:00:01.974632+0000","last_became_active":"2023-07-29T01:59:57.544231+0000","last_became_peered":"2023-07-29T01:59:57.544231+0000","last_unstale":"2023-07-29T02:00:01.974632+0000","last_undegraded":"2023-07-29T02:00:01.974632+0000","last_fullsized":"2023-07-29T02:00:01.974632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966682+0000","last_change":"2023-07-29T01:59:57.974773+0000","last_active":"2023-07-29T02:00:01.966682+0000","last_peered":"2023-07-29T02:00:01.966682+0000","last_clean":"2023-07-29T02:00:01.966682+0000","last_became_active":"2023-07-29T01:59:57.974525+0000","last_became_peered":"2023-07-29T01:59:57.974525+0000","last_unstale":"2023-07-29T02:00:01.966682+0000","last_undegraded":"2023-07-29T02:00:01.966682+0000","last_fullsized":"2023-07-29T02:00:01.966682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442650+0000","last_change":"2023-07-29T02:00:01.988872+0000","last_active":"2023-07-29T02:00:02.442650+0000","last_peered":"2023-07-29T02:00:02.442650+0000","last_clean":"2023-07-29T02:00:02.442650+0000","last_became_active":"2023-07-29T02:00:01.988486+0000","last_became_peered":"2023-07-29T02:00:01.988486+0000","last_unstale":"2023-07-29T02:00:02.442650+0000","last_undegraded":"2023-07-29T02:00:02.442650+0000","last_fullsized":"2023-07-29T02:00:02.442650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:07.842328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.954789+0000","last_change":"2023-07-29T01:59:57.535498+0000","last_active":"2023-07-29T02:00:02.954789+0000","last_peered":"2023-07-29T02:00:02.954789+0000","last_clean":"2023-07-29T02:00:02.954789+0000","last_became_active":"2023-07-29T01:59:57.534813+0000","last_became_peered":"2023-07-29T01:59:57.534813+0000","last_unstale":"2023-07-29T02:00:02.954789+0000","last_undegraded":"2023-07-29T02:00:02.954789+0000","last_fullsized":"2023-07-29T02:00:02.954789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976870+0000","last_change":"2023-07-29T01:59:57.962897+0000","last_active":"2023-07-29T02:00:01.976870+0000","last_peered":"2023-07-29T02:00:01.976870+0000","last_clean":"2023-07-29T02:00:01.976870+0000","last_became_active":"2023-07-29T01:59:57.962184+0000","last_became_peered":"2023-07-29T01:59:57.962184+0000","last_unstale":"2023-07-29T02:00:01.976870+0000","last_undegraded":"2023-07-29T02:00:01.976870+0000","last_fullsized":"2023-07-29T02:00:01.976870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440114+0000","last_change":"2023-07-29T02:00:01.989538+0000","last_active":"2023-07-29T02:00:02.440114+0000","last_peered":"2023-07-29T02:00:02.440114+0000","last_clean":"2023-07-29T02:00:02.440114+0000","last_became_active":"2023-07-29T02:00:01.989151+0000","last_became_peered":"2023-07-29T02:00:01.989151+0000","last_unstale":"2023-07-29T02:00:02.440114+0000","last_undegraded":"2023-07-29T02:00:02.440114+0000","last_fullsized":"2023-07-29T02:00:02.440114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:21:35.031304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968357+0000","last_change":"2023-07-29T01:59:57.544466+0000","last_active":"2023-07-29T02:00:01.968357+0000","last_peered":"2023-07-29T02:00:01.968357+0000","last_clean":"2023-07-29T02:00:01.968357+0000","last_became_active":"2023-07-29T01:59:57.544120+0000","last_became_peered":"2023-07-29T01:59:57.544120+0000","last_unstale":"2023-07-29T02:00:01.968357+0000","last_undegraded":"2023-07-29T02:00:01.968357+0000","last_fullsized":"2023-07-29T02:00:01.968357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977082+0000","last_change":"2023-07-29T01:59:57.962277+0000","last_active":"2023-07-29T02:00:01.977082+0000","last_peered":"2023-07-29T02:00:01.977082+0000","last_clean":"2023-07-29T02:00:01.977082+0000","last_became_active":"2023-07-29T01:59:57.961975+0000","last_became_peered":"2023-07-29T01:59:57.961975+0000","last_unstale":"2023-07-29T02:00:01.977082+0000","last_undegraded":"2023-07-29T02:00:01.977082+0000","last_fullsized":"2023-07-29T02:00:01.977082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:27:01.059953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400809+0000","last_change":"2023-07-29T02:00:01.988563+0000","last_active":"2023-07-29T02:00:02.400809+0000","last_peered":"2023-07-29T02:00:02.400809+0000","last_clean":"2023-07-29T02:00:02.400809+0000","last_became_active":"2023-07-29T02:00:01.988155+0000","last_became_peered":"2023-07-29T02:00:01.988155+0000","last_unstale":"2023-07-29T02:00:02.400809+0000","last_undegraded":"2023-07-29T02:00:02.400809+0000","last_fullsized":"2023-07-29T02:00:02.400809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972477+0000","last_change":"2023-07-29T01:59:57.549764+0000","last_active":"2023-07-29T02:00:01.972477+0000","last_peered":"2023-07-29T02:00:01.972477+0000","last_clean":"2023-07-29T02:00:01.972477+0000","last_became_active":"2023-07-29T01:59:57.549470+0000","last_became_peered":"2023-07-29T01:59:57.549470+0000","last_unstale":"2023-07-29T02:00:01.972477+0000","last_undegraded":"2023-07-29T02:00:01.972477+0000","last_fullsized":"2023-07-29T02:00:01.972477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976948+0000","last_change":"2023-07-29T01:59:57.962303+0000","last_active":"2023-07-29T02:00:01.976948+0000","last_peered":"2023-07-29T02:00:01.976948+0000","last_clean":"2023-07-29T02:00:01.976948+0000","last_became_active":"2023-07-29T01:59:57.962016+0000","last_became_peered":"2023-07-29T01:59:57.962016+0000","last_unstale":"2023-07-29T02:00:01.976948+0000","last_undegraded":"2023-07-29T02:00:01.976948+0000","last_fullsized":"2023-07-29T02:00:01.976948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:08.813083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399334+0000","last_change":"2023-07-29T02:00:01.992380+0000","last_active":"2023-07-29T02:00:02.399334+0000","last_peered":"2023-07-29T02:00:02.399334+0000","last_clean":"2023-07-29T02:00:02.399334+0000","last_became_active":"2023-07-29T02:00:01.992042+0000","last_became_peered":"2023-07-29T02:00:01.992042+0000","last_unstale":"2023-07-29T02:00:02.399334+0000","last_undegraded":"2023-07-29T02:00:02.399334+0000","last_fullsized":"2023-07-29T02:00:02.399334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:24:44.331640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977747+0000","last_change":"2023-07-29T01:59:57.537045+0000","last_active":"2023-07-29T02:00:01.977747+0000","last_peered":"2023-07-29T02:00:01.977747+0000","last_clean":"2023-07-29T02:00:01.977747+0000","last_became_active":"2023-07-29T01:59:57.535762+0000","last_became_peered":"2023-07-29T01:59:57.535762+0000","last_unstale":"2023-07-29T02:00:01.977747+0000","last_undegraded":"2023-07-29T02:00:01.977747+0000","last_fullsized":"2023-07-29T02:00:01.977747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972302+0000","last_change":"2023-07-29T01:59:57.975103+0000","last_active":"2023-07-29T02:00:01.972302+0000","last_peered":"2023-07-29T02:00:01.972302+0000","last_clean":"2023-07-29T02:00:01.972302+0000","last_became_active":"2023-07-29T01:59:57.974834+0000","last_became_peered":"2023-07-29T01:59:57.974834+0000","last_unstale":"2023-07-29T02:00:01.972302+0000","last_undegraded":"2023-07-29T02:00:01.972302+0000","last_fullsized":"2023-07-29T02:00:01.972302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401174+0000","last_change":"2023-07-29T02:00:01.990813+0000","last_active":"2023-07-29T02:00:02.401174+0000","last_peered":"2023-07-29T02:00:02.401174+0000","last_clean":"2023-07-29T02:00:02.401174+0000","last_became_active":"2023-07-29T02:00:01.990464+0000","last_became_peered":"2023-07-29T02:00:01.990464+0000","last_unstale":"2023-07-29T02:00:02.401174+0000","last_undegraded":"2023-07-29T02:00:02.401174+0000","last_fullsized":"2023-07-29T02:00:02.401174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:16:46.676860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958405+0000","last_change":"2023-07-29T01:59:57.540561+0000","last_active":"2023-07-29T02:00:02.958405+0000","last_peered":"2023-07-29T02:00:02.958405+0000","last_clean":"2023-07-29T02:00:02.958405+0000","last_became_active":"2023-07-29T01:59:57.540292+0000","last_became_peered":"2023-07-29T01:59:57.540292+0000","last_unstale":"2023-07-29T02:00:02.958405+0000","last_undegraded":"2023-07-29T02:00:02.958405+0000","last_fullsized":"2023-07-29T02:00:02.958405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978068+0000","last_change":"2023-07-29T01:59:52.448098+0000","last_active":"2023-07-29T02:00:01.978068+0000","last_peered":"2023-07-29T02:00:01.978068+0000","last_clean":"2023-07-29T02:00:01.978068+0000","last_became_active":"2023-07-29T01:59:52.447782+0000","last_became_peered":"2023-07-29T01:59:52.447782+0000","last_unstale":"2023-07-29T02:00:01.978068+0000","last_undegraded":"2023-07-29T02:00:01.978068+0000","last_fullsized":"2023-07-29T02:00:01.978068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:31.981804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977648+0000","last_change":"2023-07-29T01:59:57.967845+0000","last_active":"2023-07-29T02:00:01.977648+0000","last_peered":"2023-07-29T02:00:01.977648+0000","last_clean":"2023-07-29T02:00:01.977648+0000","last_became_active":"2023-07-29T01:59:57.966065+0000","last_became_peered":"2023-07-29T01:59:57.966065+0000","last_unstale":"2023-07-29T02:00:01.977648+0000","last_undegraded":"2023-07-29T02:00:01.977648+0000","last_fullsized":"2023-07-29T02:00:01.977648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439054+0000","last_change":"2023-07-29T02:00:01.996414+0000","last_active":"2023-07-29T02:00:02.439054+0000","last_peered":"2023-07-29T02:00:02.439054+0000","last_clean":"2023-07-29T02:00:02.439054+0000","last_became_active":"2023-07-29T02:00:01.995963+0000","last_became_peered":"2023-07-29T02:00:01.995963+0000","last_unstale":"2023-07-29T02:00:02.439054+0000","last_undegraded":"2023-07-29T02:00:02.439054+0000","last_fullsized":"2023-07-29T02:00:02.439054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:06:19.130853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.980059+0000","last_change":"2023-07-29T01:59:52.445649+0000","last_active":"2023-07-29T02:00:01.980059+0000","last_peered":"2023-07-29T02:00:01.980059+0000","last_clean":"2023-07-29T02:00:01.980059+0000","last_became_active":"2023-07-29T01:59:52.445337+0000","last_became_peered":"2023-07-29T01:59:52.445337+0000","last_unstale":"2023-07-29T02:00:01.980059+0000","last_undegraded":"2023-07-29T02:00:01.980059+0000","last_fullsized":"2023-07-29T02:00:01.980059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439989+0000","last_change":"2023-07-29T01:59:57.537863+0000","last_active":"2023-07-29T02:00:02.439989+0000","last_peered":"2023-07-29T02:00:02.439989+0000","last_clean":"2023-07-29T02:00:02.439989+0000","last_became_active":"2023-07-29T01:59:57.537581+0000","last_became_peered":"2023-07-29T01:59:57.537581+0000","last_unstale":"2023-07-29T02:00:02.439989+0000","last_undegraded":"2023-07-29T02:00:02.439989+0000","last_fullsized":"2023-07-29T02:00:02.439989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:02:57.137574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972545+0000","last_change":"2023-07-29T01:59:57.961598+0000","last_active":"2023-07-29T02:00:01.972545+0000","last_peered":"2023-07-29T02:00:01.972545+0000","last_clean":"2023-07-29T02:00:01.972545+0000","last_became_active":"2023-07-29T01:59:57.961298+0000","last_became_peered":"2023-07-29T01:59:57.961298+0000","last_unstale":"2023-07-29T02:00:01.972545+0000","last_undegraded":"2023-07-29T02:00:01.972545+0000","last_fullsized":"2023-07-29T02:00:01.972545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:11:49.956637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400459+0000","last_change":"2023-07-29T02:00:01.987452+0000","last_active":"2023-07-29T02:00:02.400459+0000","last_peered":"2023-07-29T02:00:02.400459+0000","last_clean":"2023-07-29T02:00:02.400459+0000","last_became_active":"2023-07-29T02:00:01.986915+0000","last_became_peered":"2023-07-29T02:00:01.986915+0000","last_unstale":"2023-07-29T02:00:02.400459+0000","last_undegraded":"2023-07-29T02:00:02.400459+0000","last_fullsized":"2023-07-29T02:00:02.400459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:35:48.256508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973327+0000","last_change":"2023-07-29T01:59:52.448423+0000","last_active":"2023-07-29T02:00:01.973327+0000","last_peered":"2023-07-29T02:00:01.973327+0000","last_clean":"2023-07-29T02:00:01.973327+0000","last_became_active":"2023-07-29T01:59:52.448052+0000","last_became_peered":"2023-07-29T01:59:52.448052+0000","last_unstale":"2023-07-29T02:00:01.973327+0000","last_undegraded":"2023-07-29T02:00:01.973327+0000","last_fullsized":"2023-07-29T02:00:01.973327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:31.981804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973579+0000","last_change":"2023-07-29T01:59:52.450730+0000","last_active":"2023-07-29T02:00:01.973579+0000","last_peered":"2023-07-29T02:00:01.973579+0000","last_clean":"2023-07-29T02:00:01.973579+0000","last_became_active":"2023-07-29T01:59:52.449582+0000","last_became_peered":"2023-07-29T01:59:52.449582+0000","last_unstale":"2023-07-29T02:00:01.973579+0000","last_undegraded":"2023-07-29T02:00:01.973579+0000","last_fullsized":"2023-07-29T02:00:01.973579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:01:27.099648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966496+0000","last_change":"2023-07-29T01:59:57.546474+0000","last_active":"2023-07-29T02:00:01.966496+0000","last_peered":"2023-07-29T02:00:01.966496+0000","last_clean":"2023-07-29T02:00:01.966496+0000","last_became_active":"2023-07-29T01:59:57.546179+0000","last_became_peered":"2023-07-29T01:59:57.546179+0000","last_unstale":"2023-07-29T02:00:01.966496+0000","last_undegraded":"2023-07-29T02:00:01.966496+0000","last_fullsized":"2023-07-29T02:00:01.966496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967788+0000","last_change":"2023-07-29T01:59:57.975316+0000","last_active":"2023-07-29T02:00:01.967788+0000","last_peered":"2023-07-29T02:00:01.967788+0000","last_clean":"2023-07-29T02:00:01.967788+0000","last_became_active":"2023-07-29T01:59:57.975078+0000","last_became_peered":"2023-07-29T01:59:57.975078+0000","last_unstale":"2023-07-29T02:00:01.967788+0000","last_undegraded":"2023-07-29T02:00:01.967788+0000","last_fullsized":"2023-07-29T02:00:01.967788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442819+0000","last_change":"2023-07-29T02:00:01.987385+0000","last_active":"2023-07-29T02:00:02.442819+0000","last_peered":"2023-07-29T02:00:02.442819+0000","last_clean":"2023-07-29T02:00:02.442819+0000","last_became_active":"2023-07-29T02:00:01.986937+0000","last_became_peered":"2023-07-29T02:00:01.986937+0000","last_unstale":"2023-07-29T02:00:02.442819+0000","last_undegraded":"2023-07-29T02:00:02.442819+0000","last_fullsized":"2023-07-29T02:00:02.442819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:53.580244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974915+0000","last_change":"2023-07-29T01:59:53.171806+0000","last_active":"2023-07-29T02:00:01.974915+0000","last_peered":"2023-07-29T02:00:01.974915+0000","last_clean":"2023-07-29T02:00:01.974915+0000","last_became_active":"2023-07-29T01:59:53.171467+0000","last_became_peered":"2023-07-29T01:59:53.171467+0000","last_unstale":"2023-07-29T02:00:01.974915+0000","last_undegraded":"2023-07-29T02:00:01.974915+0000","last_fullsized":"2023-07-29T02:00:01.974915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972796+0000","last_change":"2023-07-29T01:59:57.549442+0000","last_active":"2023-07-29T02:00:01.972796+0000","last_peered":"2023-07-29T02:00:01.972796+0000","last_clean":"2023-07-29T02:00:01.972796+0000","last_became_active":"2023-07-29T01:59:57.549151+0000","last_became_peered":"2023-07-29T01:59:57.549151+0000","last_unstale":"2023-07-29T02:00:01.972796+0000","last_undegraded":"2023-07-29T02:00:01.972796+0000","last_fullsized":"2023-07-29T02:00:01.972796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972211+0000","last_change":"2023-07-29T01:59:57.973471+0000","last_active":"2023-07-29T02:00:01.972211+0000","last_peered":"2023-07-29T02:00:01.972211+0000","last_clean":"2023-07-29T02:00:01.972211+0000","last_became_active":"2023-07-29T01:59:57.969273+0000","last_became_peered":"2023-07-29T01:59:57.969273+0000","last_unstale":"2023-07-29T02:00:01.972211+0000","last_undegraded":"2023-07-29T02:00:01.972211+0000","last_fullsized":"2023-07-29T02:00:01.972211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:56:07.949649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400121+0000","last_change":"2023-07-29T02:00:01.993242+0000","last_active":"2023-07-29T02:00:02.400121+0000","last_peered":"2023-07-29T02:00:02.400121+0000","last_clean":"2023-07-29T02:00:02.400121+0000","last_became_active":"2023-07-29T02:00:01.992406+0000","last_became_peered":"2023-07-29T02:00:01.992406+0000","last_unstale":"2023-07-29T02:00:02.400121+0000","last_undegraded":"2023-07-29T02:00:02.400121+0000","last_fullsized":"2023-07-29T02:00:02.400121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:12.254656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973406+0000","last_change":"2023-07-29T01:59:53.171746+0000","last_active":"2023-07-29T02:00:01.973406+0000","last_peered":"2023-07-29T02:00:01.973406+0000","last_clean":"2023-07-29T02:00:01.973406+0000","last_became_active":"2023-07-29T01:59:53.171440+0000","last_became_peered":"2023-07-29T01:59:53.171440+0000","last_unstale":"2023-07-29T02:00:01.973406+0000","last_undegraded":"2023-07-29T02:00:01.973406+0000","last_fullsized":"2023-07-29T02:00:01.973406+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:17:56.960611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976818+0000","last_change":"2023-07-29T01:59:57.537970+0000","last_active":"2023-07-29T02:00:01.976818+0000","last_peered":"2023-07-29T02:00:01.976818+0000","last_clean":"2023-07-29T02:00:01.976818+0000","last_became_active":"2023-07-29T01:59:57.537665+0000","last_became_peered":"2023-07-29T01:59:57.537665+0000","last_unstale":"2023-07-29T02:00:01.976818+0000","last_undegraded":"2023-07-29T02:00:01.976818+0000","last_fullsized":"2023-07-29T02:00:01.976818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968235+0000","last_change":"2023-07-29T01:59:57.968655+0000","last_active":"2023-07-29T02:00:01.968235+0000","last_peered":"2023-07-29T02:00:01.968235+0000","last_clean":"2023-07-29T02:00:01.968235+0000","last_became_active":"2023-07-29T01:59:57.968373+0000","last_became_peered":"2023-07-29T01:59:57.968373+0000","last_unstale":"2023-07-29T02:00:01.968235+0000","last_undegraded":"2023-07-29T02:00:01.968235+0000","last_fullsized":"2023-07-29T02:00:01.968235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:06.785485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439797+0000","last_change":"2023-07-29T02:00:01.984885+0000","last_active":"2023-07-29T02:00:02.439797+0000","last_peered":"2023-07-29T02:00:02.439797+0000","last_clean":"2023-07-29T02:00:02.439797+0000","last_became_active":"2023-07-29T02:00:01.984476+0000","last_became_peered":"2023-07-29T02:00:01.984476+0000","last_unstale":"2023-07-29T02:00:02.439797+0000","last_undegraded":"2023-07-29T02:00:02.439797+0000","last_fullsized":"2023-07-29T02:00:02.439797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973534+0000","last_change":"2023-07-29T01:59:53.172039+0000","last_active":"2023-07-29T02:00:01.973534+0000","last_peered":"2023-07-29T02:00:01.973534+0000","last_clean":"2023-07-29T02:00:01.973534+0000","last_became_active":"2023-07-29T01:59:53.171617+0000","last_became_peered":"2023-07-29T01:59:53.171617+0000","last_unstale":"2023-07-29T02:00:01.973534+0000","last_undegraded":"2023-07-29T02:00:01.973534+0000","last_fullsized":"2023-07-29T02:00:01.973534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976735+0000","last_change":"2023-07-29T01:59:57.540888+0000","last_active":"2023-07-29T02:00:01.976735+0000","last_peered":"2023-07-29T02:00:01.976735+0000","last_clean":"2023-07-29T02:00:01.976735+0000","last_became_active":"2023-07-29T01:59:57.540449+0000","last_became_peered":"2023-07-29T01:59:57.540449+0000","last_unstale":"2023-07-29T02:00:01.976735+0000","last_undegraded":"2023-07-29T02:00:01.976735+0000","last_fullsized":"2023-07-29T02:00:01.976735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974278+0000","last_change":"2023-07-29T01:59:57.968216+0000","last_active":"2023-07-29T02:00:01.974278+0000","last_peered":"2023-07-29T02:00:01.974278+0000","last_clean":"2023-07-29T02:00:01.974278+0000","last_became_active":"2023-07-29T01:59:57.967933+0000","last_became_peered":"2023-07-29T01:59:57.967933+0000","last_unstale":"2023-07-29T02:00:01.974278+0000","last_undegraded":"2023-07-29T02:00:01.974278+0000","last_fullsized":"2023-07-29T02:00:01.974278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439338+0000","last_change":"2023-07-29T02:00:01.985121+0000","last_active":"2023-07-29T02:00:02.439338+0000","last_peered":"2023-07-29T02:00:02.439338+0000","last_clean":"2023-07-29T02:00:02.439338+0000","last_became_active":"2023-07-29T02:00:01.984691+0000","last_became_peered":"2023-07-29T02:00:01.984691+0000","last_unstale":"2023-07-29T02:00:02.439338+0000","last_undegraded":"2023-07-29T02:00:02.439338+0000","last_fullsized":"2023-07-29T02:00:02.439338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:54.400954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967930+0000","last_change":"2023-07-29T01:59:53.171808+0000","last_active":"2023-07-29T02:00:01.967930+0000","last_peered":"2023-07-29T02:00:01.967930+0000","last_clean":"2023-07-29T02:00:01.967930+0000","last_became_active":"2023-07-29T01:59:53.171463+0000","last_became_peered":"2023-07-29T01:59:53.171463+0000","last_unstale":"2023-07-29T02:00:01.967930+0000","last_undegraded":"2023-07-29T02:00:01.967930+0000","last_fullsized":"2023-07-29T02:00:01.967930+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:07:59.559814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973914+0000","last_change":"2023-07-29T01:59:57.549468+0000","last_active":"2023-07-29T02:00:01.973914+0000","last_peered":"2023-07-29T02:00:01.973914+0000","last_clean":"2023-07-29T02:00:01.973914+0000","last_became_active":"2023-07-29T01:59:57.549181+0000","last_became_peered":"2023-07-29T01:59:57.549181+0000","last_unstale":"2023-07-29T02:00:01.973914+0000","last_undegraded":"2023-07-29T02:00:01.973914+0000","last_fullsized":"2023-07-29T02:00:01.973914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966982+0000","last_change":"2023-07-29T01:59:57.963908+0000","last_active":"2023-07-29T02:00:01.966982+0000","last_peered":"2023-07-29T02:00:01.966982+0000","last_clean":"2023-07-29T02:00:01.966982+0000","last_became_active":"2023-07-29T01:59:57.963659+0000","last_became_peered":"2023-07-29T01:59:57.963659+0000","last_unstale":"2023-07-29T02:00:01.966982+0000","last_undegraded":"2023-07-29T02:00:01.966982+0000","last_fullsized":"2023-07-29T02:00:01.966982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440428+0000","last_change":"2023-07-29T02:00:01.984197+0000","last_active":"2023-07-29T02:00:02.440428+0000","last_peered":"2023-07-29T02:00:02.440428+0000","last_clean":"2023-07-29T02:00:02.440428+0000","last_became_active":"2023-07-29T02:00:01.983744+0000","last_became_peered":"2023-07-29T02:00:01.983744+0000","last_unstale":"2023-07-29T02:00:02.440428+0000","last_undegraded":"2023-07-29T02:00:02.440428+0000","last_fullsized":"2023-07-29T02:00:02.440428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968731+0000","last_change":"2023-07-29T01:59:52.449102+0000","last_active":"2023-07-29T02:00:01.968731+0000","last_peered":"2023-07-29T02:00:01.968731+0000","last_clean":"2023-07-29T02:00:01.968731+0000","last_became_active":"2023-07-29T01:59:52.448814+0000","last_became_peered":"2023-07-29T01:59:52.448814+0000","last_unstale":"2023-07-29T02:00:01.968731+0000","last_undegraded":"2023-07-29T02:00:01.968731+0000","last_fullsized":"2023-07-29T02:00:01.968731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977814+0000","last_change":"2023-07-29T01:59:57.544590+0000","last_active":"2023-07-29T02:00:01.977814+0000","last_peered":"2023-07-29T02:00:01.977814+0000","last_clean":"2023-07-29T02:00:01.977814+0000","last_became_active":"2023-07-29T01:59:57.544317+0000","last_became_peered":"2023-07-29T01:59:57.544317+0000","last_unstale":"2023-07-29T02:00:01.977814+0000","last_undegraded":"2023-07-29T02:00:01.977814+0000","last_fullsized":"2023-07-29T02:00:01.977814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971685+0000","last_change":"2023-07-29T01:59:57.973912+0000","last_active":"2023-07-29T02:00:01.971685+0000","last_peered":"2023-07-29T02:00:01.971685+0000","last_clean":"2023-07-29T02:00:01.971685+0000","last_became_active":"2023-07-29T01:59:57.969642+0000","last_became_peered":"2023-07-29T01:59:57.969642+0000","last_unstale":"2023-07-29T02:00:01.971685+0000","last_undegraded":"2023-07-29T02:00:01.971685+0000","last_fullsized":"2023-07-29T02:00:01.971685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440741+0000","last_change":"2023-07-29T02:00:01.999117+0000","last_active":"2023-07-29T02:00:02.440741+0000","last_peered":"2023-07-29T02:00:02.440741+0000","last_clean":"2023-07-29T02:00:02.440741+0000","last_became_active":"2023-07-29T02:00:01.998715+0000","last_became_peered":"2023-07-29T02:00:01.998715+0000","last_unstale":"2023-07-29T02:00:02.440741+0000","last_undegraded":"2023-07-29T02:00:02.440741+0000","last_fullsized":"2023-07-29T02:00:02.440741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440569+0000","last_change":"2023-07-29T01:59:57.545933+0000","last_active":"2023-07-29T02:00:02.440569+0000","last_peered":"2023-07-29T02:00:02.440569+0000","last_clean":"2023-07-29T02:00:02.440569+0000","last_became_active":"2023-07-29T01:59:57.545744+0000","last_became_peered":"2023-07-29T01:59:57.545744+0000","last_unstale":"2023-07-29T02:00:02.440569+0000","last_undegraded":"2023-07-29T02:00:02.440569+0000","last_fullsized":"2023-07-29T02:00:02.440569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972541+0000","last_change":"2023-07-29T01:59:57.970577+0000","last_active":"2023-07-29T02:00:01.972541+0000","last_peered":"2023-07-29T02:00:01.972541+0000","last_clean":"2023-07-29T02:00:01.972541+0000","last_became_active":"2023-07-29T01:59:57.970252+0000","last_became_peered":"2023-07-29T01:59:57.970252+0000","last_unstale":"2023-07-29T02:00:01.972541+0000","last_undegraded":"2023-07-29T02:00:01.972541+0000","last_fullsized":"2023-07-29T02:00:01.972541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:09.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399784+0000","last_change":"2023-07-29T02:00:01.989885+0000","last_active":"2023-07-29T02:00:02.399784+0000","last_peered":"2023-07-29T02:00:02.399784+0000","last_clean":"2023-07-29T02:00:02.399784+0000","last_became_active":"2023-07-29T02:00:01.989481+0000","last_became_peered":"2023-07-29T02:00:01.989481+0000","last_unstale":"2023-07-29T02:00:02.399784+0000","last_undegraded":"2023-07-29T02:00:02.399784+0000","last_fullsized":"2023-07-29T02:00:02.399784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957691+0000","last_change":"2023-07-29T01:59:57.543782+0000","last_active":"2023-07-29T02:00:02.957691+0000","last_peered":"2023-07-29T02:00:02.957691+0000","last_clean":"2023-07-29T02:00:02.957691+0000","last_became_active":"2023-07-29T01:59:57.543445+0000","last_became_peered":"2023-07-29T01:59:57.543445+0000","last_unstale":"2023-07-29T02:00:02.957691+0000","last_undegraded":"2023-07-29T02:00:02.957691+0000","last_fullsized":"2023-07-29T02:00:02.957691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.970956+0000","last_change":"2023-07-29T01:59:57.965177+0000","last_active":"2023-07-29T02:00:01.970956+0000","last_peered":"2023-07-29T02:00:01.970956+0000","last_clean":"2023-07-29T02:00:01.970956+0000","last_became_active":"2023-07-29T01:59:57.964925+0000","last_became_peered":"2023-07-29T01:59:57.964925+0000","last_unstale":"2023-07-29T02:00:01.970956+0000","last_undegraded":"2023-07-29T02:00:01.970956+0000","last_fullsized":"2023-07-29T02:00:01.970956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401320+0000","last_change":"2023-07-29T02:00:01.985786+0000","last_active":"2023-07-29T02:00:02.401320+0000","last_peered":"2023-07-29T02:00:02.401320+0000","last_clean":"2023-07-29T02:00:02.401320+0000","last_became_active":"2023-07-29T02:00:01.985310+0000","last_became_peered":"2023-07-29T02:00:01.985310+0000","last_unstale":"2023-07-29T02:00:02.401320+0000","last_undegraded":"2023-07-29T02:00:02.401320+0000","last_fullsized":"2023-07-29T02:00:02.401320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957725+0000","last_change":"2023-07-29T01:59:57.541908+0000","last_active":"2023-07-29T02:00:02.957725+0000","last_peered":"2023-07-29T02:00:02.957725+0000","last_clean":"2023-07-29T02:00:02.957725+0000","last_became_active":"2023-07-29T01:59:57.541633+0000","last_became_peered":"2023-07-29T01:59:57.541633+0000","last_unstale":"2023-07-29T02:00:02.957725+0000","last_undegraded":"2023-07-29T02:00:02.957725+0000","last_fullsized":"2023-07-29T02:00:02.957725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.970785+0000","last_change":"2023-07-29T01:59:57.965915+0000","last_active":"2023-07-29T02:00:01.970785+0000","last_peered":"2023-07-29T02:00:01.970785+0000","last_clean":"2023-07-29T02:00:01.970785+0000","last_became_active":"2023-07-29T01:59:57.965383+0000","last_became_peered":"2023-07-29T01:59:57.965383+0000","last_unstale":"2023-07-29T02:00:01.970785+0000","last_undegraded":"2023-07-29T02:00:01.970785+0000","last_fullsized":"2023-07-29T02:00:01.970785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.398445+0000","last_change":"2023-07-29T02:00:01.994436+0000","last_active":"2023-07-29T02:00:02.398445+0000","last_peered":"2023-07-29T02:00:02.398445+0000","last_clean":"2023-07-29T02:00:02.398445+0000","last_became_active":"2023-07-29T02:00:01.993454+0000","last_became_peered":"2023-07-29T02:00:01.993454+0000","last_unstale":"2023-07-29T02:00:02.398445+0000","last_undegraded":"2023-07-29T02:00:02.398445+0000","last_fullsized":"2023-07-29T02:00:02.398445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:46.998657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441131+0000","last_change":"2023-07-29T01:59:57.539625+0000","last_active":"2023-07-29T02:00:02.441131+0000","last_peered":"2023-07-29T02:00:02.441131+0000","last_clean":"2023-07-29T02:00:02.441131+0000","last_became_active":"2023-07-29T01:59:57.539181+0000","last_became_peered":"2023-07-29T01:59:57.539181+0000","last_unstale":"2023-07-29T02:00:02.441131+0000","last_undegraded":"2023-07-29T02:00:02.441131+0000","last_fullsized":"2023-07-29T02:00:02.441131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:02:57.137574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979518+0000","last_change":"2023-07-29T01:59:57.966812+0000","last_active":"2023-07-29T02:00:01.979518+0000","last_peered":"2023-07-29T02:00:01.979518+0000","last_clean":"2023-07-29T02:00:01.979518+0000","last_became_active":"2023-07-29T01:59:57.966580+0000","last_became_peered":"2023-07-29T01:59:57.966580+0000","last_unstale":"2023-07-29T02:00:01.979518+0000","last_undegraded":"2023-07-29T02:00:01.979518+0000","last_fullsized":"2023-07-29T02:00:01.979518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.203628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439475+0000","last_change":"2023-07-29T02:00:01.985984+0000","last_active":"2023-07-29T02:00:02.439475+0000","last_peered":"2023-07-29T02:00:02.439475+0000","last_clean":"2023-07-29T02:00:02.439475+0000","last_became_active":"2023-07-29T02:00:01.985554+0000","last_became_peered":"2023-07-29T02:00:01.985554+0000","last_unstale":"2023-07-29T02:00:02.439475+0000","last_undegraded":"2023-07-29T02:00:02.439475+0000","last_fullsized":"2023-07-29T02:00:02.439475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:50:50.164635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957483+0000","last_change":"2023-07-29T01:59:57.537754+0000","last_active":"2023-07-29T02:00:02.957483+0000","last_peered":"2023-07-29T02:00:02.957483+0000","last_clean":"2023-07-29T02:00:02.957483+0000","last_became_active":"2023-07-29T01:59:57.537457+0000","last_became_peered":"2023-07-29T01:59:57.537457+0000","last_unstale":"2023-07-29T02:00:02.957483+0000","last_undegraded":"2023-07-29T02:00:02.957483+0000","last_fullsized":"2023-07-29T02:00:02.957483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975481+0000","last_change":"2023-07-29T01:59:57.960633+0000","last_active":"2023-07-29T02:00:01.975481+0000","last_peered":"2023-07-29T02:00:01.975481+0000","last_clean":"2023-07-29T02:00:01.975481+0000","last_became_active":"2023-07-29T01:59:57.960318+0000","last_became_peered":"2023-07-29T01:59:57.960318+0000","last_unstale":"2023-07-29T02:00:01.975481+0000","last_undegraded":"2023-07-29T02:00:01.975481+0000","last_fullsized":"2023-07-29T02:00:01.975481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:01:11.408184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967878+0000","last_change":"2023-07-29T01:59:57.960826+0000","last_active":"2023-07-29T02:00:01.967878+0000","last_peered":"2023-07-29T02:00:01.967878+0000","last_clean":"2023-07-29T02:00:01.967878+0000","last_became_active":"2023-07-29T01:59:57.959960+0000","last_became_peered":"2023-07-29T01:59:57.959960+0000","last_unstale":"2023-07-29T02:00:01.967878+0000","last_undegraded":"2023-07-29T02:00:01.967878+0000","last_fullsized":"2023-07-29T02:00:01.967878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979718+0000","last_change":"2023-07-29T01:59:57.976560+0000","last_active":"2023-07-29T02:00:01.979718+0000","last_peered":"2023-07-29T02:00:01.979718+0000","last_clean":"2023-07-29T02:00:01.979718+0000","last_became_active":"2023-07-29T01:59:57.975384+0000","last_became_peered":"2023-07-29T01:59:57.975384+0000","last_unstale":"2023-07-29T02:00:01.979718+0000","last_undegraded":"2023-07-29T02:00:01.979718+0000","last_fullsized":"2023-07-29T02:00:01.979718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971237+0000","last_change":"2023-07-29T01:59:57.967891+0000","last_active":"2023-07-29T02:00:01.971237+0000","last_peered":"2023-07-29T02:00:01.971237+0000","last_clean":"2023-07-29T02:00:01.971237+0000","last_became_active":"2023-07-29T01:59:57.967603+0000","last_became_peered":"2023-07-29T01:59:57.967603+0000","last_unstale":"2023-07-29T02:00:01.971237+0000","last_undegraded":"2023-07-29T02:00:01.971237+0000","last_fullsized":"2023-07-29T02:00:01.971237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:24:00.439433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978571+0000","last_change":"2023-07-29T01:59:57.966922+0000","last_active":"2023-07-29T02:00:01.978571+0000","last_peered":"2023-07-29T02:00:01.978571+0000","last_clean":"2023-07-29T02:00:01.978571+0000","last_became_active":"2023-07-29T01:59:57.966672+0000","last_became_peered":"2023-07-29T01:59:57.966672+0000","last_unstale":"2023-07-29T02:00:01.978571+0000","last_undegraded":"2023-07-29T02:00:01.978571+0000","last_fullsized":"2023-07-29T02:00:01.978571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972636+0000","last_change":"2023-07-29T01:59:57.968727+0000","last_active":"2023-07-29T02:00:01.972636+0000","last_peered":"2023-07-29T02:00:01.972636+0000","last_clean":"2023-07-29T02:00:01.972636+0000","last_became_active":"2023-07-29T01:59:57.968449+0000","last_became_peered":"2023-07-29T01:59:57.968449+0000","last_unstale":"2023-07-29T02:00:01.972636+0000","last_undegraded":"2023-07-29T02:00:01.972636+0000","last_fullsized":"2023-07-29T02:00:01.972636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4849,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":704036,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":331776,"data_stored":699769,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":109983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":108530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":113508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":110053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T02:00:47.480 INFO:tasks.mds_thrash.ceph_manager:clean! 2023-07-29T02:00:47.480 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T02:00:47.637 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.650+0000 7f89626e9700 1 Processor -- start 2023-07-29T02:00:47.638 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.650+0000 7f89626e9700 1 -- start start 2023-07-29T02:00:47.639 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.651+0000 7f89626e9700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f895c156820 0x7f895c0727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:47.639 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.651+0000 7f89626e9700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895c06c9f0 con 0x7f895c14ff20 2023-07-29T02:00:47.639 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.651+0000 7f89626e9700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f895c06ccd0 con 0x7f895c0c90c0 2023-07-29T02:00:47.639 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.651+0000 7f89626e9700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f895c072d20 con 0x7f895c156820 2023-07-29T02:00:47.640 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.651+0000 7f8960c86700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f895c156820 0x7f895c0727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:47.640 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.651+0000 7f895bfff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f895c14ff20 0x7f895c0c89b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50928/0 (socket says 172.21.15.42:50928) 2023-07-29T02:00:47.640 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.651+0000 7f8960c86700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f895c156820 0x7f895c0727e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57128/0 (socket says 172.21.15.42:57128) 2023-07-29T02:00:47.640 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.651+0000 7f895bfff700 1 -- 172.21.15.42:0/3333890804 learned_addr learned my addr 172.21.15.42:0/3333890804 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:47.640 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.651+0000 7f8960c86700 1 -- 172.21.15.42:0/3333890804 >> v1:172.21.15.144:6789/0 conn(0x7f895c0c90c0 legacy=0x7f895c156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:47.640 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.651+0000 7f8960c86700 1 -- 172.21.15.42:0/3333890804 >> v1:172.21.15.42:6789/0 conn(0x7f895c14ff20 legacy=0x7f895c0c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:47.641 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.651+0000 7f8960c86700 1 -- 172.21.15.42:0/3333890804 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c06cfb0 con 0x7f895c156820 2023-07-29T02:00:47.641 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.651+0000 7f895affd700 1 -- 172.21.15.42:0/3333890804 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003062249 0 0) 0x7f895c06c9f0 con 0x7f895c14ff20 2023-07-29T02:00:47.641 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.652+0000 7f8960c86700 1 --2- 172.21.15.42:0/3333890804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f895c156820 0x7f895c0727e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8954009d90 tx=0x7f895400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e405d16be3dc479a server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:47.641 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.652+0000 7f895affd700 1 -- 172.21.15.42:0/3333890804 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895400e070 con 0x7f895c156820 2023-07-29T02:00:47.641 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.652+0000 7f895affd700 1 -- 172.21.15.42:0/3333890804 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895400bb90 con 0x7f895c156820 2023-07-29T02:00:47.641 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.652+0000 7f895affd700 1 -- 172.21.15.42:0/3333890804 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954003a20 con 0x7f895c156820 2023-07-29T02:00:47.643 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.652+0000 7f89626e9700 1 -- 172.21.15.42:0/3333890804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f895c156820 msgr2=0x7f895c0727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:47.643 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.652+0000 7f89626e9700 1 --2- 172.21.15.42:0/3333890804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f895c156820 0x7f895c0727e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8954009d90 tx=0x7f895400b330 comp rx=0 tx=0).stop 2023-07-29T02:00:47.643 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.652+0000 7f89626e9700 1 -- 172.21.15.42:0/3333890804 shutdown_connections 2023-07-29T02:00:47.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.652+0000 7f89626e9700 1 --2- 172.21.15.42:0/3333890804 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f895c156820 0x7f895c0727e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.652+0000 7f89626e9700 1 -- 172.21.15.42:0/3333890804 >> 172.21.15.42:0/3333890804 conn(0x7f895c06ec50 msgr2=0x7f895c06f020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:47.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.652+0000 7f89626e9700 1 -- 172.21.15.42:0/3333890804 shutdown_connections 2023-07-29T02:00:47.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.652+0000 7f89626e9700 1 -- 172.21.15.42:0/3333890804 wait complete. 2023-07-29T02:00:47.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.654+0000 7f89626e9700 1 Processor -- start 2023-07-29T02:00:47.644 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.654+0000 7f89626e9700 1 -- start start 2023-07-29T02:00:47.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.654+0000 7f89626e9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f895c14ff20 0x7f895c1e0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:47.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.654+0000 7f89626e9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f895c156820 0x7f895c1df380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:47.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.654+0000 7f89626e9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f895c158030 0x7f895c1eca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:47.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.654+0000 7f89626e9700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c1e0a70 con 0x7f895c156820 2023-07-29T02:00:47.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.654+0000 7f89626e9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895c1ec5d0 con 0x7f895c14ff20 2023-07-29T02:00:47.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.654+0000 7f89626e9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895c156e80 con 0x7f895c158030 2023-07-29T02:00:47.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.655+0000 7f895b7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f895c156820 0x7f895c1df380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:47.645 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.655+0000 7f895b7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f895c156820 0x7f895c1df380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57132/0 (socket says 172.21.15.42:57132) 2023-07-29T02:00:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.655+0000 7f895b7fe700 1 -- 172.21.15.42:0/208428506 learned_addr learned my addr 172.21.15.42:0/208428506 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.655+0000 7f8960c86700 1 --2- 172.21.15.42:0/208428506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f895c158030 0x7f895c1eca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.655+0000 7f895bfff700 1 --2- 172.21.15.42:0/208428506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f895c14ff20 0x7f895c1e0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.655+0000 7f895b7fe700 1 -- 172.21.15.42:0/208428506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f895c158030 msgr2=0x7f895c1eca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.655+0000 7f895b7fe700 1 --2- 172.21.15.42:0/208428506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f895c158030 0x7f895c1eca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.646 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.655+0000 7f895b7fe700 1 -- 172.21.15.42:0/208428506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f895c14ff20 msgr2=0x7f895c1e0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:47.647 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.655+0000 7f895b7fe700 1 --2- 172.21.15.42:0/208428506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f895c14ff20 0x7f895c1e0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.647 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.655+0000 7f895b7fe700 1 -- 172.21.15.42:0/208428506 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8954009a70 con 0x7f895c156820 2023-07-29T02:00:47.647 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.655+0000 7f895bfff700 1 --2- 172.21.15.42:0/208428506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f895c14ff20 0x7f895c1e0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:47.647 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.655+0000 7f895b7fe700 1 --2- 172.21.15.42:0/208428506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f895c156820 0x7f895c1df380 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f894400c4d0 tx=0x7f894400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:47.647 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.655+0000 7f8958ff9700 1 -- 172.21.15.42:0/208428506 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8944011790 con 0x7f895c156820 2023-07-29T02:00:47.647 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.655+0000 7f8958ff9700 1 -- 172.21.15.42:0/208428506 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89440118f0 con 0x7f895c156820 2023-07-29T02:00:47.647 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.655+0000 7f8958ff9700 1 -- 172.21.15.42:0/208428506 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8944011ca0 con 0x7f895c156820 2023-07-29T02:00:47.648 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.655+0000 7f89626e9700 1 -- 172.21.15.42:0/208428506 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895c1586e0 con 0x7f895c156820 2023-07-29T02:00:47.648 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.655+0000 7f89626e9700 1 -- 172.21.15.42:0/208428506 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895c158ca0 con 0x7f895c156820 2023-07-29T02:00:47.648 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.656+0000 7f89626e9700 1 -- 172.21.15.42:0/208428506 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f895c068210 con 0x7f895c156820 2023-07-29T02:00:47.649 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.657+0000 7f8958ff9700 1 -- 172.21.15.42:0/208428506 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f894401c460 con 0x7f895c156820 2023-07-29T02:00:47.649 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.657+0000 7f8958ff9700 1 --2- 172.21.15.42:0/208428506 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f893c06a660 0x7f893c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:47.649 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.657+0000 7f8958ff9700 1 -- 172.21.15.42:0/208428506 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6850+0+0 (secure 0 0 0) 0x7f8944088c50 con 0x7f895c156820 2023-07-29T02:00:47.649 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.657+0000 7f895bfff700 1 --2- 172.21.15.42:0/208428506 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f893c06a660 0x7f893c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:47.649 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.658+0000 7f895bfff700 1 --2- 172.21.15.42:0/208428506 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f893c06a660 0x7f893c06cb10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f894c000f60 tx=0x7f894c007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:47.650 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.661+0000 7f8958ff9700 1 -- 172.21.15.42:0/208428506 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f894408e020 con 0x7f895c156820 2023-07-29T02:00:47.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.855+0000 7f89626e9700 1 -- 172.21.15.42:0/208428506 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f895c06d290 con 0x7f893c06a660 2023-07-29T02:00:47.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.866+0000 7f8958ff9700 1 -- 172.21.15.42:0/208428506 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367628 (secure 0 0 0) 0x7f894c005bb0 con 0x7f893c06a660 2023-07-29T02:00:47.857 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:47.859 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.869+0000 7f89626e9700 1 -- 172.21.15.42:0/208428506 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f893c06a660 msgr2=0x7f893c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:47.859 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.869+0000 7f89626e9700 1 --2- 172.21.15.42:0/208428506 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f893c06a660 0x7f893c06cb10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f894c000f60 tx=0x7f894c007ca0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.859 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.869+0000 7f89626e9700 1 -- 172.21.15.42:0/208428506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f895c156820 msgr2=0x7f895c1df380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:47.859 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.869+0000 7f89626e9700 1 --2- 172.21.15.42:0/208428506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f895c156820 0x7f895c1df380 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f894400c4d0 tx=0x7f894400c890 comp rx=0 tx=0).stop 2023-07-29T02:00:47.860 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.869+0000 7f89626e9700 1 -- 172.21.15.42:0/208428506 shutdown_connections 2023-07-29T02:00:47.860 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.869+0000 7f89626e9700 1 --2- 172.21.15.42:0/208428506 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f893c06a660 0x7f893c06cb10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.860 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.869+0000 7f89626e9700 1 --2- 172.21.15.42:0/208428506 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f895c158030 0x7f895c1eca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.860 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.869+0000 7f89626e9700 1 --2- 172.21.15.42:0/208428506 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f895c14ff20 0x7f895c1e0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.860 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.869+0000 7f89626e9700 1 --2- 172.21.15.42:0/208428506 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f895c156820 0x7f895c1df380 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:47.860 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.870+0000 7f89626e9700 1 -- 172.21.15.42:0/208428506 >> 172.21.15.42:0/208428506 conn(0x7f895c06ec50 msgr2=0x7f895c0cbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:47.861 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.870+0000 7f89626e9700 1 -- 172.21.15.42:0/208428506 shutdown_connections 2023-07-29T02:00:47.861 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:47.870+0000 7f89626e9700 1 -- 172.21.15.42:0/208428506 wait complete. 2023-07-29T02:00:47.861 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2023-07-29T02:00:47.869 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2023-07-29T02:00:47.244465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595217,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":209,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217884,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756836,"statfs":{"total":773094113280,"available":772871000064,"internally_reserved":0,"allocated":2322432,"data_stored":2064681,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":260,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002477"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972736+0000","last_change":"2023-07-29T01:59:57.958129+0000","last_active":"2023-07-29T02:00:01.972736+0000","last_peered":"2023-07-29T02:00:01.972736+0000","last_clean":"2023-07-29T02:00:01.972736+0000","last_became_active":"2023-07-29T01:59:57.957742+0000","last_became_peered":"2023-07-29T01:59:57.957742+0000","last_unstale":"2023-07-29T02:00:01.972736+0000","last_undegraded":"2023-07-29T02:00:01.972736+0000","last_fullsized":"2023-07-29T02:00:01.972736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:32.550358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975520+0000","last_change":"2023-07-29T01:59:57.974652+0000","last_active":"2023-07-29T02:00:01.975520+0000","last_peered":"2023-07-29T02:00:01.975520+0000","last_clean":"2023-07-29T02:00:01.975520+0000","last_became_active":"2023-07-29T01:59:57.974338+0000","last_became_peered":"2023-07-29T01:59:57.974338+0000","last_unstale":"2023-07-29T02:00:01.975520+0000","last_undegraded":"2023-07-29T02:00:01.975520+0000","last_fullsized":"2023-07-29T02:00:01.975520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978265+0000","last_change":"2023-07-29T01:59:57.973621+0000","last_active":"2023-07-29T02:00:01.978265+0000","last_peered":"2023-07-29T02:00:01.978265+0000","last_clean":"2023-07-29T02:00:01.978265+0000","last_became_active":"2023-07-29T01:59:57.973406+0000","last_became_peered":"2023-07-29T01:59:57.973406+0000","last_unstale":"2023-07-29T02:00:01.978265+0000","last_undegraded":"2023-07-29T02:00:01.978265+0000","last_fullsized":"2023-07-29T02:00:01.978265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:08:23.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968045+0000","last_change":"2023-07-29T01:59:57.965192+0000","last_active":"2023-07-29T02:00:01.968045+0000","last_peered":"2023-07-29T02:00:01.968045+0000","last_clean":"2023-07-29T02:00:01.968045+0000","last_became_active":"2023-07-29T01:59:57.964865+0000","last_became_peered":"2023-07-29T01:59:57.964865+0000","last_unstale":"2023-07-29T02:00:01.968045+0000","last_undegraded":"2023-07-29T02:00:01.968045+0000","last_fullsized":"2023-07-29T02:00:01.968045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:32.905717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967106+0000","last_change":"2023-07-29T01:59:57.971026+0000","last_active":"2023-07-29T02:00:01.967106+0000","last_peered":"2023-07-29T02:00:01.967106+0000","last_clean":"2023-07-29T02:00:01.967106+0000","last_became_active":"2023-07-29T01:59:57.970733+0000","last_became_peered":"2023-07-29T01:59:57.970733+0000","last_unstale":"2023-07-29T02:00:01.967106+0000","last_undegraded":"2023-07-29T02:00:01.967106+0000","last_fullsized":"2023-07-29T02:00:01.967106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971129+0000","last_change":"2023-07-29T01:59:57.965729+0000","last_active":"2023-07-29T02:00:01.971129+0000","last_peered":"2023-07-29T02:00:01.971129+0000","last_clean":"2023-07-29T02:00:01.971129+0000","last_became_active":"2023-07-29T01:59:57.964993+0000","last_became_peered":"2023-07-29T01:59:57.964993+0000","last_unstale":"2023-07-29T02:00:01.971129+0000","last_undegraded":"2023-07-29T02:00:01.971129+0000","last_fullsized":"2023-07-29T02:00:01.971129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974411+0000","last_change":"2023-07-29T01:59:57.970481+0000","last_active":"2023-07-29T02:00:01.974411+0000","last_peered":"2023-07-29T02:00:01.974411+0000","last_clean":"2023-07-29T02:00:01.974411+0000","last_became_active":"2023-07-29T01:59:57.970232+0000","last_became_peered":"2023-07-29T01:59:57.970232+0000","last_unstale":"2023-07-29T02:00:01.974411+0000","last_undegraded":"2023-07-29T02:00:01.974411+0000","last_fullsized":"2023-07-29T02:00:01.974411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974000+0000","last_change":"2023-07-29T01:59:57.963201+0000","last_active":"2023-07-29T02:00:01.974000+0000","last_peered":"2023-07-29T02:00:01.974000+0000","last_clean":"2023-07-29T02:00:01.974000+0000","last_became_active":"2023-07-29T01:59:57.962884+0000","last_became_peered":"2023-07-29T01:59:57.962884+0000","last_unstale":"2023-07-29T02:00:01.974000+0000","last_undegraded":"2023-07-29T02:00:01.974000+0000","last_fullsized":"2023-07-29T02:00:01.974000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967238+0000","last_change":"2023-07-29T01:59:57.971916+0000","last_active":"2023-07-29T02:00:01.967238+0000","last_peered":"2023-07-29T02:00:01.967238+0000","last_clean":"2023-07-29T02:00:01.967238+0000","last_became_active":"2023-07-29T01:59:57.971640+0000","last_became_peered":"2023-07-29T01:59:57.971640+0000","last_unstale":"2023-07-29T02:00:01.967238+0000","last_undegraded":"2023-07-29T02:00:01.967238+0000","last_fullsized":"2023-07-29T02:00:01.967238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975619+0000","last_change":"2023-07-29T01:59:57.963080+0000","last_active":"2023-07-29T02:00:01.975619+0000","last_peered":"2023-07-29T02:00:01.975619+0000","last_clean":"2023-07-29T02:00:01.975619+0000","last_became_active":"2023-07-29T01:59:57.962799+0000","last_became_peered":"2023-07-29T01:59:57.962799+0000","last_unstale":"2023-07-29T02:00:01.975619+0000","last_undegraded":"2023-07-29T02:00:01.975619+0000","last_fullsized":"2023-07-29T02:00:01.975619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978173+0000","last_change":"2023-07-29T01:59:57.970172+0000","last_active":"2023-07-29T02:00:01.978173+0000","last_peered":"2023-07-29T02:00:01.978173+0000","last_clean":"2023-07-29T02:00:01.978173+0000","last_became_active":"2023-07-29T01:59:57.969868+0000","last_became_peered":"2023-07-29T01:59:57.969868+0000","last_unstale":"2023-07-29T02:00:01.978173+0000","last_undegraded":"2023-07-29T02:00:01.978173+0000","last_fullsized":"2023-07-29T02:00:01.978173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972765+0000","last_change":"2023-07-29T01:59:57.964171+0000","last_active":"2023-07-29T02:00:01.972765+0000","last_peered":"2023-07-29T02:00:01.972765+0000","last_clean":"2023-07-29T02:00:01.972765+0000","last_became_active":"2023-07-29T01:59:57.963902+0000","last_became_peered":"2023-07-29T01:59:57.963902+0000","last_unstale":"2023-07-29T02:00:01.972765+0000","last_undegraded":"2023-07-29T02:00:01.972765+0000","last_fullsized":"2023-07-29T02:00:01.972765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:51.691001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972884+0000","last_change":"2023-07-29T01:59:57.963492+0000","last_active":"2023-07-29T02:00:01.972884+0000","last_peered":"2023-07-29T02:00:01.972884+0000","last_clean":"2023-07-29T02:00:01.972884+0000","last_became_active":"2023-07-29T01:59:57.963239+0000","last_became_peered":"2023-07-29T01:59:57.963239+0000","last_unstale":"2023-07-29T02:00:01.972884+0000","last_undegraded":"2023-07-29T02:00:01.972884+0000","last_fullsized":"2023-07-29T02:00:01.972884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:08.001986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974742+0000","last_change":"2023-07-29T01:59:57.961369+0000","last_active":"2023-07-29T02:00:01.974742+0000","last_peered":"2023-07-29T02:00:01.974742+0000","last_clean":"2023-07-29T02:00:01.974742+0000","last_became_active":"2023-07-29T01:59:57.960709+0000","last_became_peered":"2023-07-29T01:59:57.960709+0000","last_unstale":"2023-07-29T02:00:01.974742+0000","last_undegraded":"2023-07-29T02:00:01.974742+0000","last_fullsized":"2023-07-29T02:00:01.974742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974229+0000","last_change":"2023-07-29T01:59:57.970498+0000","last_active":"2023-07-29T02:00:01.974229+0000","last_peered":"2023-07-29T02:00:01.974229+0000","last_clean":"2023-07-29T02:00:01.974229+0000","last_became_active":"2023-07-29T01:59:57.970263+0000","last_became_peered":"2023-07-29T01:59:57.970263+0000","last_unstale":"2023-07-29T02:00:01.974229+0000","last_undegraded":"2023-07-29T02:00:01.974229+0000","last_fullsized":"2023-07-29T02:00:01.974229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975567+0000","last_change":"2023-07-29T01:59:57.965648+0000","last_active":"2023-07-29T02:00:01.975567+0000","last_peered":"2023-07-29T02:00:01.975567+0000","last_clean":"2023-07-29T02:00:01.975567+0000","last_became_active":"2023-07-29T01:59:57.964696+0000","last_became_peered":"2023-07-29T01:59:57.964696+0000","last_unstale":"2023-07-29T02:00:01.975567+0000","last_undegraded":"2023-07-29T02:00:01.975567+0000","last_fullsized":"2023-07-29T02:00:01.975567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:19:14.641252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967346+0000","last_change":"2023-07-29T01:59:57.969148+0000","last_active":"2023-07-29T02:00:01.967346+0000","last_peered":"2023-07-29T02:00:01.967346+0000","last_clean":"2023-07-29T02:00:01.967346+0000","last_became_active":"2023-07-29T01:59:57.968885+0000","last_became_peered":"2023-07-29T01:59:57.968885+0000","last_unstale":"2023-07-29T02:00:01.967346+0000","last_undegraded":"2023-07-29T02:00:01.967346+0000","last_fullsized":"2023-07-29T02:00:01.967346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977442+0000","last_change":"2023-07-29T01:59:57.963189+0000","last_active":"2023-07-29T02:00:01.977442+0000","last_peered":"2023-07-29T02:00:01.977442+0000","last_clean":"2023-07-29T02:00:01.977442+0000","last_became_active":"2023-07-29T01:59:57.962919+0000","last_became_peered":"2023-07-29T01:59:57.962919+0000","last_unstale":"2023-07-29T02:00:01.977442+0000","last_undegraded":"2023-07-29T02:00:01.977442+0000","last_fullsized":"2023-07-29T02:00:01.977442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:16:58.718803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973218+0000","last_change":"2023-07-29T01:59:57.960380+0000","last_active":"2023-07-29T02:00:01.973218+0000","last_peered":"2023-07-29T02:00:01.973218+0000","last_clean":"2023-07-29T02:00:01.973218+0000","last_became_active":"2023-07-29T01:59:57.960111+0000","last_became_peered":"2023-07-29T01:59:57.960111+0000","last_unstale":"2023-07-29T02:00:01.973218+0000","last_undegraded":"2023-07-29T02:00:01.973218+0000","last_fullsized":"2023-07-29T02:00:01.973218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:45.956813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977046+0000","last_change":"2023-07-29T01:59:57.961945+0000","last_active":"2023-07-29T02:00:01.977046+0000","last_peered":"2023-07-29T02:00:01.977046+0000","last_clean":"2023-07-29T02:00:01.977046+0000","last_became_active":"2023-07-29T01:59:57.961655+0000","last_became_peered":"2023-07-29T01:59:57.961655+0000","last_unstale":"2023-07-29T02:00:01.977046+0000","last_undegraded":"2023-07-29T02:00:01.977046+0000","last_fullsized":"2023-07-29T02:00:01.977046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.203628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974482+0000","last_change":"2023-07-29T01:59:57.971030+0000","last_active":"2023-07-29T02:00:01.974482+0000","last_peered":"2023-07-29T02:00:01.974482+0000","last_clean":"2023-07-29T02:00:01.974482+0000","last_became_active":"2023-07-29T01:59:57.970757+0000","last_became_peered":"2023-07-29T01:59:57.970757+0000","last_unstale":"2023-07-29T02:00:01.974482+0000","last_undegraded":"2023-07-29T02:00:01.974482+0000","last_fullsized":"2023-07-29T02:00:01.974482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966509+0000","last_change":"2023-07-29T01:59:57.974734+0000","last_active":"2023-07-29T02:00:01.966509+0000","last_peered":"2023-07-29T02:00:01.966509+0000","last_clean":"2023-07-29T02:00:01.966509+0000","last_became_active":"2023-07-29T01:59:57.974436+0000","last_became_peered":"2023-07-29T01:59:57.974436+0000","last_unstale":"2023-07-29T02:00:01.966509+0000","last_undegraded":"2023-07-29T02:00:01.966509+0000","last_fullsized":"2023-07-29T02:00:01.966509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979698+0000","last_change":"2023-07-29T01:59:57.967259+0000","last_active":"2023-07-29T02:00:01.979698+0000","last_peered":"2023-07-29T02:00:01.979698+0000","last_clean":"2023-07-29T02:00:01.979698+0000","last_became_active":"2023-07-29T01:59:57.966987+0000","last_became_peered":"2023-07-29T01:59:57.966987+0000","last_unstale":"2023-07-29T02:00:01.979698+0000","last_undegraded":"2023-07-29T02:00:01.979698+0000","last_fullsized":"2023-07-29T02:00:01.979698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973494+0000","last_change":"2023-07-29T01:59:57.971976+0000","last_active":"2023-07-29T02:00:01.973494+0000","last_peered":"2023-07-29T02:00:01.973494+0000","last_clean":"2023-07-29T02:00:01.973494+0000","last_became_active":"2023-07-29T01:59:57.971733+0000","last_became_peered":"2023-07-29T01:59:57.971733+0000","last_unstale":"2023-07-29T02:00:01.973494+0000","last_undegraded":"2023-07-29T02:00:01.973494+0000","last_fullsized":"2023-07-29T02:00:01.973494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972112+0000","last_change":"2023-07-29T01:59:57.973644+0000","last_active":"2023-07-29T02:00:01.972112+0000","last_peered":"2023-07-29T02:00:01.972112+0000","last_clean":"2023-07-29T02:00:01.972112+0000","last_became_active":"2023-07-29T01:59:57.969742+0000","last_became_peered":"2023-07-29T01:59:57.969742+0000","last_unstale":"2023-07-29T02:00:01.972112+0000","last_undegraded":"2023-07-29T02:00:01.972112+0000","last_fullsized":"2023-07-29T02:00:01.972112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975642+0000","last_change":"2023-07-29T01:59:57.969779+0000","last_active":"2023-07-29T02:00:01.975642+0000","last_peered":"2023-07-29T02:00:01.975642+0000","last_clean":"2023-07-29T02:00:01.975642+0000","last_became_active":"2023-07-29T01:59:57.969409+0000","last_became_peered":"2023-07-29T01:59:57.969409+0000","last_unstale":"2023-07-29T02:00:01.975642+0000","last_undegraded":"2023-07-29T02:00:01.975642+0000","last_fullsized":"2023-07-29T02:00:01.975642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977989+0000","last_change":"2023-07-29T01:59:57.965799+0000","last_active":"2023-07-29T02:00:01.977989+0000","last_peered":"2023-07-29T02:00:01.977989+0000","last_clean":"2023-07-29T02:00:01.977989+0000","last_became_active":"2023-07-29T01:59:57.963774+0000","last_became_peered":"2023-07-29T01:59:57.963774+0000","last_unstale":"2023-07-29T02:00:01.977989+0000","last_undegraded":"2023-07-29T02:00:01.977989+0000","last_fullsized":"2023-07-29T02:00:01.977989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399488+0000","last_change":"2023-07-29T02:00:01.994114+0000","last_active":"2023-07-29T02:00:02.399488+0000","last_peered":"2023-07-29T02:00:02.399488+0000","last_clean":"2023-07-29T02:00:02.399488+0000","last_became_active":"2023-07-29T02:00:01.993731+0000","last_became_peered":"2023-07-29T02:00:01.993731+0000","last_unstale":"2023-07-29T02:00:02.399488+0000","last_undegraded":"2023-07-29T02:00:02.399488+0000","last_fullsized":"2023-07-29T02:00:02.399488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:14:25.422754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399152+0000","last_change":"2023-07-29T01:59:57.552913+0000","last_active":"2023-07-29T02:00:02.399152+0000","last_peered":"2023-07-29T02:00:02.399152+0000","last_clean":"2023-07-29T02:00:02.399152+0000","last_became_active":"2023-07-29T01:59:57.552673+0000","last_became_peered":"2023-07-29T01:59:57.552673+0000","last_unstale":"2023-07-29T02:00:02.399152+0000","last_undegraded":"2023-07-29T02:00:02.399152+0000","last_fullsized":"2023-07-29T02:00:02.399152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:49:56.335019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978862+0000","last_change":"2023-07-29T01:59:57.970140+0000","last_active":"2023-07-29T02:00:01.978862+0000","last_peered":"2023-07-29T02:00:01.978862+0000","last_clean":"2023-07-29T02:00:01.978862+0000","last_became_active":"2023-07-29T01:59:57.969821+0000","last_became_peered":"2023-07-29T01:59:57.969821+0000","last_unstale":"2023-07-29T02:00:01.978862+0000","last_undegraded":"2023-07-29T02:00:01.978862+0000","last_fullsized":"2023-07-29T02:00:01.978862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439205+0000","last_change":"2023-07-29T02:00:01.992728+0000","last_active":"2023-07-29T02:00:02.439205+0000","last_peered":"2023-07-29T02:00:02.439205+0000","last_clean":"2023-07-29T02:00:02.439205+0000","last_became_active":"2023-07-29T02:00:01.992338+0000","last_became_peered":"2023-07-29T02:00:01.992338+0000","last_unstale":"2023-07-29T02:00:02.439205+0000","last_undegraded":"2023-07-29T02:00:02.439205+0000","last_fullsized":"2023-07-29T02:00:02.439205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:37.968145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972242+0000","last_change":"2023-07-29T01:59:57.547793+0000","last_active":"2023-07-29T02:00:01.972242+0000","last_peered":"2023-07-29T02:00:01.972242+0000","last_clean":"2023-07-29T02:00:01.972242+0000","last_became_active":"2023-07-29T01:59:57.547455+0000","last_became_peered":"2023-07-29T01:59:57.547455+0000","last_unstale":"2023-07-29T02:00:01.972242+0000","last_undegraded":"2023-07-29T02:00:01.972242+0000","last_fullsized":"2023-07-29T02:00:01.972242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967048+0000","last_change":"2023-07-29T01:59:57.964646+0000","last_active":"2023-07-29T02:00:01.967048+0000","last_peered":"2023-07-29T02:00:01.967048+0000","last_clean":"2023-07-29T02:00:01.967048+0000","last_became_active":"2023-07-29T01:59:57.964393+0000","last_became_peered":"2023-07-29T01:59:57.964393+0000","last_unstale":"2023-07-29T02:00:01.967048+0000","last_undegraded":"2023-07-29T02:00:01.967048+0000","last_fullsized":"2023-07-29T02:00:01.967048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440161+0000","last_change":"2023-07-29T02:00:01.982883+0000","last_active":"2023-07-29T02:00:02.440161+0000","last_peered":"2023-07-29T02:00:02.440161+0000","last_clean":"2023-07-29T02:00:02.440161+0000","last_became_active":"2023-07-29T02:00:01.982042+0000","last_became_peered":"2023-07-29T02:00:01.982042+0000","last_unstale":"2023-07-29T02:00:02.440161+0000","last_undegraded":"2023-07-29T02:00:02.440161+0000","last_fullsized":"2023-07-29T02:00:02.440161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977952+0000","last_change":"2023-07-29T01:59:57.535286+0000","last_active":"2023-07-29T02:00:01.977952+0000","last_peered":"2023-07-29T02:00:01.977952+0000","last_clean":"2023-07-29T02:00:01.977952+0000","last_became_active":"2023-07-29T01:59:57.533523+0000","last_became_peered":"2023-07-29T01:59:57.533523+0000","last_unstale":"2023-07-29T02:00:01.977952+0000","last_undegraded":"2023-07-29T02:00:01.977952+0000","last_fullsized":"2023-07-29T02:00:01.977952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968772+0000","last_change":"2023-07-29T01:59:57.963792+0000","last_active":"2023-07-29T02:00:01.968772+0000","last_peered":"2023-07-29T02:00:01.968772+0000","last_clean":"2023-07-29T02:00:01.968772+0000","last_became_active":"2023-07-29T01:59:57.963466+0000","last_became_peered":"2023-07-29T01:59:57.963466+0000","last_unstale":"2023-07-29T02:00:01.968772+0000","last_undegraded":"2023-07-29T02:00:01.968772+0000","last_fullsized":"2023-07-29T02:00:01.968772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:28.048947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.438720+0000","last_change":"2023-07-29T02:00:01.984458+0000","last_active":"2023-07-29T02:00:02.438720+0000","last_peered":"2023-07-29T02:00:02.438720+0000","last_clean":"2023-07-29T02:00:02.438720+0000","last_became_active":"2023-07-29T02:00:01.984000+0000","last_became_peered":"2023-07-29T02:00:01.984000+0000","last_unstale":"2023-07-29T02:00:02.438720+0000","last_undegraded":"2023-07-29T02:00:02.438720+0000","last_fullsized":"2023-07-29T02:00:02.438720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967445+0000","last_change":"2023-07-29T01:59:57.537082+0000","last_active":"2023-07-29T02:00:01.967445+0000","last_peered":"2023-07-29T02:00:01.967445+0000","last_clean":"2023-07-29T02:00:01.967445+0000","last_became_active":"2023-07-29T01:59:57.536732+0000","last_became_peered":"2023-07-29T01:59:57.536732+0000","last_unstale":"2023-07-29T02:00:01.967445+0000","last_undegraded":"2023-07-29T02:00:01.967445+0000","last_fullsized":"2023-07-29T02:00:01.967445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977852+0000","last_change":"2023-07-29T01:59:57.971203+0000","last_active":"2023-07-29T02:00:01.977852+0000","last_peered":"2023-07-29T02:00:01.977852+0000","last_clean":"2023-07-29T02:00:01.977852+0000","last_became_active":"2023-07-29T01:59:57.970902+0000","last_became_peered":"2023-07-29T01:59:57.970902+0000","last_unstale":"2023-07-29T02:00:01.977852+0000","last_undegraded":"2023-07-29T02:00:01.977852+0000","last_fullsized":"2023-07-29T02:00:01.977852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399530+0000","last_change":"2023-07-29T02:00:01.991435+0000","last_active":"2023-07-29T02:00:02.399530+0000","last_peered":"2023-07-29T02:00:02.399530+0000","last_clean":"2023-07-29T02:00:02.399530+0000","last_became_active":"2023-07-29T02:00:01.989456+0000","last_became_peered":"2023-07-29T02:00:01.989456+0000","last_unstale":"2023-07-29T02:00:02.399530+0000","last_undegraded":"2023-07-29T02:00:02.399530+0000","last_fullsized":"2023-07-29T02:00:02.399530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975677+0000","last_change":"2023-07-29T01:59:57.540572+0000","last_active":"2023-07-29T02:00:01.975677+0000","last_peered":"2023-07-29T02:00:01.975677+0000","last_clean":"2023-07-29T02:00:01.975677+0000","last_became_active":"2023-07-29T01:59:57.540113+0000","last_became_peered":"2023-07-29T01:59:57.540113+0000","last_unstale":"2023-07-29T02:00:01.975677+0000","last_undegraded":"2023-07-29T02:00:01.975677+0000","last_fullsized":"2023-07-29T02:00:01.975677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979625+0000","last_change":"2023-07-29T01:59:57.967343+0000","last_active":"2023-07-29T02:00:01.979625+0000","last_peered":"2023-07-29T02:00:01.979625+0000","last_clean":"2023-07-29T02:00:01.979625+0000","last_became_active":"2023-07-29T01:59:57.967083+0000","last_became_peered":"2023-07-29T01:59:57.967083+0000","last_unstale":"2023-07-29T02:00:01.979625+0000","last_undegraded":"2023-07-29T02:00:01.979625+0000","last_fullsized":"2023-07-29T02:00:01.979625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441217+0000","last_change":"2023-07-29T02:00:01.996761+0000","last_active":"2023-07-29T02:00:02.441217+0000","last_peered":"2023-07-29T02:00:02.441217+0000","last_clean":"2023-07-29T02:00:02.441217+0000","last_became_active":"2023-07-29T02:00:01.996035+0000","last_became_peered":"2023-07-29T02:00:01.996035+0000","last_unstale":"2023-07-29T02:00:02.441217+0000","last_undegraded":"2023-07-29T02:00:02.441217+0000","last_fullsized":"2023-07-29T02:00:02.441217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"25'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958140+0000","last_change":"2023-07-29T01:59:57.548665+0000","last_active":"2023-07-29T02:00:02.958140+0000","last_peered":"2023-07-29T02:00:02.958140+0000","last_clean":"2023-07-29T02:00:02.958140+0000","last_became_active":"2023-07-29T01:59:57.547803+0000","last_became_peered":"2023-07-29T01:59:57.547803+0000","last_unstale":"2023-07-29T02:00:02.958140+0000","last_undegraded":"2023-07-29T02:00:02.958140+0000","last_fullsized":"2023-07-29T02:00:02.958140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971561+0000","last_change":"2023-07-29T01:59:57.969319+0000","last_active":"2023-07-29T02:00:01.971561+0000","last_peered":"2023-07-29T02:00:01.971561+0000","last_clean":"2023-07-29T02:00:01.971561+0000","last_became_active":"2023-07-29T01:59:57.969006+0000","last_became_peered":"2023-07-29T01:59:57.969006+0000","last_unstale":"2023-07-29T02:00:01.971561+0000","last_undegraded":"2023-07-29T02:00:01.971561+0000","last_fullsized":"2023-07-29T02:00:01.971561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:30:28.393515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440217+0000","last_change":"2023-07-29T02:00:01.996124+0000","last_active":"2023-07-29T02:00:02.440217+0000","last_peered":"2023-07-29T02:00:02.440217+0000","last_clean":"2023-07-29T02:00:02.440217+0000","last_became_active":"2023-07-29T02:00:01.995757+0000","last_became_peered":"2023-07-29T02:00:01.995757+0000","last_unstale":"2023-07-29T02:00:02.440217+0000","last_undegraded":"2023-07-29T02:00:02.440217+0000","last_fullsized":"2023-07-29T02:00:02.440217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:24:03.881006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'11","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:41.635077+0000","last_change":"2023-07-29T01:59:57.541936+0000","last_active":"2023-07-29T02:00:41.635077+0000","last_peered":"2023-07-29T02:00:41.635077+0000","last_clean":"2023-07-29T02:00:41.635077+0000","last_became_active":"2023-07-29T01:59:57.541434+0000","last_became_peered":"2023-07-29T01:59:57.541434+0000","last_unstale":"2023-07-29T02:00:41.635077+0000","last_undegraded":"2023-07-29T02:00:41.635077+0000","last_fullsized":"2023-07-29T02:00:41.635077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4051,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976628+0000","last_change":"2023-07-29T01:59:57.962725+0000","last_active":"2023-07-29T02:00:01.976628+0000","last_peered":"2023-07-29T02:00:01.976628+0000","last_clean":"2023-07-29T02:00:01.976628+0000","last_became_active":"2023-07-29T01:59:57.962459+0000","last_became_peered":"2023-07-29T01:59:57.962459+0000","last_unstale":"2023-07-29T02:00:01.976628+0000","last_undegraded":"2023-07-29T02:00:01.976628+0000","last_fullsized":"2023-07-29T02:00:01.976628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401186+0000","last_change":"2023-07-29T02:00:01.996160+0000","last_active":"2023-07-29T02:00:02.401186+0000","last_peered":"2023-07-29T02:00:02.401186+0000","last_clean":"2023-07-29T02:00:02.401186+0000","last_became_active":"2023-07-29T02:00:01.995827+0000","last_became_peered":"2023-07-29T02:00:01.995827+0000","last_unstale":"2023-07-29T02:00:02.401186+0000","last_undegraded":"2023-07-29T02:00:02.401186+0000","last_fullsized":"2023-07-29T02:00:02.401186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958252+0000","last_change":"2023-07-29T01:59:57.545705+0000","last_active":"2023-07-29T02:00:02.958252+0000","last_peered":"2023-07-29T02:00:02.958252+0000","last_clean":"2023-07-29T02:00:02.958252+0000","last_became_active":"2023-07-29T01:59:57.545406+0000","last_became_peered":"2023-07-29T01:59:57.545406+0000","last_unstale":"2023-07-29T02:00:02.958252+0000","last_undegraded":"2023-07-29T02:00:02.958252+0000","last_fullsized":"2023-07-29T02:00:02.958252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:31.903601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.980027+0000","last_change":"2023-07-29T01:59:57.970072+0000","last_active":"2023-07-29T02:00:01.980027+0000","last_peered":"2023-07-29T02:00:01.980027+0000","last_clean":"2023-07-29T02:00:01.980027+0000","last_became_active":"2023-07-29T01:59:57.969809+0000","last_became_peered":"2023-07-29T01:59:57.969809+0000","last_unstale":"2023-07-29T02:00:01.980027+0000","last_undegraded":"2023-07-29T02:00:01.980027+0000","last_fullsized":"2023-07-29T02:00:01.980027+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440272+0000","last_change":"2023-07-29T02:00:01.997402+0000","last_active":"2023-07-29T02:00:02.440272+0000","last_peered":"2023-07-29T02:00:02.440272+0000","last_clean":"2023-07-29T02:00:02.440272+0000","last_became_active":"2023-07-29T02:00:01.996969+0000","last_became_peered":"2023-07-29T02:00:01.996969+0000","last_unstale":"2023-07-29T02:00:02.440272+0000","last_undegraded":"2023-07-29T02:00:02.440272+0000","last_fullsized":"2023-07-29T02:00:02.440272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:46:37.088979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966653+0000","last_change":"2023-07-29T01:59:57.541115+0000","last_active":"2023-07-29T02:00:01.966653+0000","last_peered":"2023-07-29T02:00:01.966653+0000","last_clean":"2023-07-29T02:00:01.966653+0000","last_became_active":"2023-07-29T01:59:57.540800+0000","last_became_peered":"2023-07-29T01:59:57.540800+0000","last_unstale":"2023-07-29T02:00:01.966653+0000","last_undegraded":"2023-07-29T02:00:01.966653+0000","last_fullsized":"2023-07-29T02:00:01.966653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977902+0000","last_change":"2023-07-29T01:59:57.964198+0000","last_active":"2023-07-29T02:00:01.977902+0000","last_peered":"2023-07-29T02:00:01.977902+0000","last_clean":"2023-07-29T02:00:01.977902+0000","last_became_active":"2023-07-29T01:59:57.963510+0000","last_became_peered":"2023-07-29T01:59:57.963510+0000","last_unstale":"2023-07-29T02:00:01.977902+0000","last_undegraded":"2023-07-29T02:00:01.977902+0000","last_fullsized":"2023-07-29T02:00:01.977902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441378+0000","last_change":"2023-07-29T02:00:01.996496+0000","last_active":"2023-07-29T02:00:02.441378+0000","last_peered":"2023-07-29T02:00:02.441378+0000","last_clean":"2023-07-29T02:00:02.441378+0000","last_became_active":"2023-07-29T02:00:01.996084+0000","last_became_peered":"2023-07-29T02:00:01.996084+0000","last_unstale":"2023-07-29T02:00:02.441378+0000","last_undegraded":"2023-07-29T02:00:02.441378+0000","last_fullsized":"2023-07-29T02:00:02.441378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:59:57.581952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974316+0000","last_change":"2023-07-29T01:59:57.548464+0000","last_active":"2023-07-29T02:00:01.974316+0000","last_peered":"2023-07-29T02:00:01.974316+0000","last_clean":"2023-07-29T02:00:01.974316+0000","last_became_active":"2023-07-29T01:59:57.548109+0000","last_became_peered":"2023-07-29T01:59:57.548109+0000","last_unstale":"2023-07-29T02:00:01.974316+0000","last_undegraded":"2023-07-29T02:00:01.974316+0000","last_fullsized":"2023-07-29T02:00:01.974316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:13.433053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967896+0000","last_change":"2023-07-29T01:59:57.962096+0000","last_active":"2023-07-29T02:00:01.967896+0000","last_peered":"2023-07-29T02:00:01.967896+0000","last_clean":"2023-07-29T02:00:01.967896+0000","last_became_active":"2023-07-29T01:59:57.961759+0000","last_became_peered":"2023-07-29T01:59:57.961759+0000","last_unstale":"2023-07-29T02:00:01.967896+0000","last_undegraded":"2023-07-29T02:00:01.967896+0000","last_fullsized":"2023-07-29T02:00:01.967896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400737+0000","last_change":"2023-07-29T02:00:01.993066+0000","last_active":"2023-07-29T02:00:02.400737+0000","last_peered":"2023-07-29T02:00:02.400737+0000","last_clean":"2023-07-29T02:00:02.400737+0000","last_became_active":"2023-07-29T02:00:01.992592+0000","last_became_peered":"2023-07-29T02:00:01.992592+0000","last_unstale":"2023-07-29T02:00:02.400737+0000","last_undegraded":"2023-07-29T02:00:02.400737+0000","last_fullsized":"2023-07-29T02:00:02.400737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:14:06.353802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"25'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958759+0000","last_change":"2023-07-29T01:59:57.543707+0000","last_active":"2023-07-29T02:00:02.958759+0000","last_peered":"2023-07-29T02:00:02.958759+0000","last_clean":"2023-07-29T02:00:02.958759+0000","last_became_active":"2023-07-29T01:59:57.543398+0000","last_became_peered":"2023-07-29T01:59:57.543398+0000","last_unstale":"2023-07-29T02:00:02.958759+0000","last_undegraded":"2023-07-29T02:00:02.958759+0000","last_fullsized":"2023-07-29T02:00:02.958759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977853+0000","last_change":"2023-07-29T01:59:57.966269+0000","last_active":"2023-07-29T02:00:01.977853+0000","last_peered":"2023-07-29T02:00:01.977853+0000","last_clean":"2023-07-29T02:00:01.977853+0000","last_became_active":"2023-07-29T01:59:57.965962+0000","last_became_peered":"2023-07-29T01:59:57.965962+0000","last_unstale":"2023-07-29T02:00:01.977853+0000","last_undegraded":"2023-07-29T02:00:01.977853+0000","last_fullsized":"2023-07-29T02:00:01.977853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400336+0000","last_change":"2023-07-29T02:00:01.992987+0000","last_active":"2023-07-29T02:00:02.400336+0000","last_peered":"2023-07-29T02:00:02.400336+0000","last_clean":"2023-07-29T02:00:02.400336+0000","last_became_active":"2023-07-29T02:00:01.992384+0000","last_became_peered":"2023-07-29T02:00:01.992384+0000","last_unstale":"2023-07-29T02:00:02.400336+0000","last_undegraded":"2023-07-29T02:00:02.400336+0000","last_fullsized":"2023-07-29T02:00:02.400336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400080+0000","last_change":"2023-07-29T01:59:57.548392+0000","last_active":"2023-07-29T02:00:02.400080+0000","last_peered":"2023-07-29T02:00:02.400080+0000","last_clean":"2023-07-29T02:00:02.400080+0000","last_became_active":"2023-07-29T01:59:57.548084+0000","last_became_peered":"2023-07-29T01:59:57.548084+0000","last_unstale":"2023-07-29T02:00:02.400080+0000","last_undegraded":"2023-07-29T02:00:02.400080+0000","last_fullsized":"2023-07-29T02:00:02.400080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973873+0000","last_change":"2023-07-29T01:59:57.965613+0000","last_active":"2023-07-29T02:00:01.973873+0000","last_peered":"2023-07-29T02:00:01.973873+0000","last_clean":"2023-07-29T02:00:01.973873+0000","last_became_active":"2023-07-29T01:59:57.964626+0000","last_became_peered":"2023-07-29T01:59:57.964626+0000","last_unstale":"2023-07-29T02:00:01.973873+0000","last_undegraded":"2023-07-29T02:00:01.973873+0000","last_fullsized":"2023-07-29T02:00:01.973873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442405+0000","last_change":"2023-07-29T02:00:01.990978+0000","last_active":"2023-07-29T02:00:02.442405+0000","last_peered":"2023-07-29T02:00:02.442405+0000","last_clean":"2023-07-29T02:00:02.442405+0000","last_became_active":"2023-07-29T02:00:01.990579+0000","last_became_peered":"2023-07-29T02:00:01.990579+0000","last_unstale":"2023-07-29T02:00:02.442405+0000","last_undegraded":"2023-07-29T02:00:02.442405+0000","last_fullsized":"2023-07-29T02:00:02.442405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:11:53.398210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957642+0000","last_change":"2023-07-29T01:59:57.549270+0000","last_active":"2023-07-29T02:00:02.957642+0000","last_peered":"2023-07-29T02:00:02.957642+0000","last_clean":"2023-07-29T02:00:02.957642+0000","last_became_active":"2023-07-29T01:59:57.548981+0000","last_became_peered":"2023-07-29T01:59:57.548981+0000","last_unstale":"2023-07-29T02:00:02.957642+0000","last_undegraded":"2023-07-29T02:00:02.957642+0000","last_fullsized":"2023-07-29T02:00:02.957642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:05.783369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972647+0000","last_change":"2023-07-29T01:59:57.969851+0000","last_active":"2023-07-29T02:00:01.972647+0000","last_peered":"2023-07-29T02:00:01.972647+0000","last_clean":"2023-07-29T02:00:01.972647+0000","last_became_active":"2023-07-29T01:59:57.969501+0000","last_became_peered":"2023-07-29T01:59:57.969501+0000","last_unstale":"2023-07-29T02:00:01.972647+0000","last_undegraded":"2023-07-29T02:00:01.972647+0000","last_fullsized":"2023-07-29T02:00:01.972647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442608+0000","last_change":"2023-07-29T02:00:01.989766+0000","last_active":"2023-07-29T02:00:02.442608+0000","last_peered":"2023-07-29T02:00:02.442608+0000","last_clean":"2023-07-29T02:00:02.442608+0000","last_became_active":"2023-07-29T02:00:01.989364+0000","last_became_peered":"2023-07-29T02:00:01.989364+0000","last_unstale":"2023-07-29T02:00:02.442608+0000","last_undegraded":"2023-07-29T02:00:02.442608+0000","last_fullsized":"2023-07-29T02:00:02.442608+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:01:14.849757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400580+0000","last_change":"2023-07-29T01:59:57.541329+0000","last_active":"2023-07-29T02:00:02.400580+0000","last_peered":"2023-07-29T02:00:02.400580+0000","last_clean":"2023-07-29T02:00:02.400580+0000","last_became_active":"2023-07-29T01:59:57.541056+0000","last_became_peered":"2023-07-29T01:59:57.541056+0000","last_unstale":"2023-07-29T02:00:02.400580+0000","last_undegraded":"2023-07-29T02:00:02.400580+0000","last_fullsized":"2023-07-29T02:00:02.400580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968261+0000","last_change":"2023-07-29T01:59:57.975244+0000","last_active":"2023-07-29T02:00:01.968261+0000","last_peered":"2023-07-29T02:00:01.968261+0000","last_clean":"2023-07-29T02:00:01.968261+0000","last_became_active":"2023-07-29T01:59:57.974998+0000","last_became_peered":"2023-07-29T01:59:57.974998+0000","last_unstale":"2023-07-29T02:00:01.968261+0000","last_undegraded":"2023-07-29T02:00:01.968261+0000","last_fullsized":"2023-07-29T02:00:01.968261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:14.435169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442656+0000","last_change":"2023-07-29T02:00:01.990823+0000","last_active":"2023-07-29T02:00:02.442656+0000","last_peered":"2023-07-29T02:00:02.442656+0000","last_clean":"2023-07-29T02:00:02.442656+0000","last_became_active":"2023-07-29T02:00:01.990276+0000","last_became_peered":"2023-07-29T02:00:01.990276+0000","last_unstale":"2023-07-29T02:00:02.442656+0000","last_undegraded":"2023-07-29T02:00:02.442656+0000","last_fullsized":"2023-07-29T02:00:02.442656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974632+0000","last_change":"2023-07-29T01:59:57.544524+0000","last_active":"2023-07-29T02:00:01.974632+0000","last_peered":"2023-07-29T02:00:01.974632+0000","last_clean":"2023-07-29T02:00:01.974632+0000","last_became_active":"2023-07-29T01:59:57.544231+0000","last_became_peered":"2023-07-29T01:59:57.544231+0000","last_unstale":"2023-07-29T02:00:01.974632+0000","last_undegraded":"2023-07-29T02:00:01.974632+0000","last_fullsized":"2023-07-29T02:00:01.974632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966682+0000","last_change":"2023-07-29T01:59:57.974773+0000","last_active":"2023-07-29T02:00:01.966682+0000","last_peered":"2023-07-29T02:00:01.966682+0000","last_clean":"2023-07-29T02:00:01.966682+0000","last_became_active":"2023-07-29T01:59:57.974525+0000","last_became_peered":"2023-07-29T01:59:57.974525+0000","last_unstale":"2023-07-29T02:00:01.966682+0000","last_undegraded":"2023-07-29T02:00:01.966682+0000","last_fullsized":"2023-07-29T02:00:01.966682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442650+0000","last_change":"2023-07-29T02:00:01.988872+0000","last_active":"2023-07-29T02:00:02.442650+0000","last_peered":"2023-07-29T02:00:02.442650+0000","last_clean":"2023-07-29T02:00:02.442650+0000","last_became_active":"2023-07-29T02:00:01.988486+0000","last_became_peered":"2023-07-29T02:00:01.988486+0000","last_unstale":"2023-07-29T02:00:02.442650+0000","last_undegraded":"2023-07-29T02:00:02.442650+0000","last_fullsized":"2023-07-29T02:00:02.442650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:07.842328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.954789+0000","last_change":"2023-07-29T01:59:57.535498+0000","last_active":"2023-07-29T02:00:02.954789+0000","last_peered":"2023-07-29T02:00:02.954789+0000","last_clean":"2023-07-29T02:00:02.954789+0000","last_became_active":"2023-07-29T01:59:57.534813+0000","last_became_peered":"2023-07-29T01:59:57.534813+0000","last_unstale":"2023-07-29T02:00:02.954789+0000","last_undegraded":"2023-07-29T02:00:02.954789+0000","last_fullsized":"2023-07-29T02:00:02.954789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976870+0000","last_change":"2023-07-29T01:59:57.962897+0000","last_active":"2023-07-29T02:00:01.976870+0000","last_peered":"2023-07-29T02:00:01.976870+0000","last_clean":"2023-07-29T02:00:01.976870+0000","last_became_active":"2023-07-29T01:59:57.962184+0000","last_became_peered":"2023-07-29T01:59:57.962184+0000","last_unstale":"2023-07-29T02:00:01.976870+0000","last_undegraded":"2023-07-29T02:00:01.976870+0000","last_fullsized":"2023-07-29T02:00:01.976870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440114+0000","last_change":"2023-07-29T02:00:01.989538+0000","last_active":"2023-07-29T02:00:02.440114+0000","last_peered":"2023-07-29T02:00:02.440114+0000","last_clean":"2023-07-29T02:00:02.440114+0000","last_became_active":"2023-07-29T02:00:01.989151+0000","last_became_peered":"2023-07-29T02:00:01.989151+0000","last_unstale":"2023-07-29T02:00:02.440114+0000","last_undegraded":"2023-07-29T02:00:02.440114+0000","last_fullsized":"2023-07-29T02:00:02.440114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:21:35.031304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968357+0000","last_change":"2023-07-29T01:59:57.544466+0000","last_active":"2023-07-29T02:00:01.968357+0000","last_peered":"2023-07-29T02:00:01.968357+0000","last_clean":"2023-07-29T02:00:01.968357+0000","last_became_active":"2023-07-29T01:59:57.544120+0000","last_became_peered":"2023-07-29T01:59:57.544120+0000","last_unstale":"2023-07-29T02:00:01.968357+0000","last_undegraded":"2023-07-29T02:00:01.968357+0000","last_fullsized":"2023-07-29T02:00:01.968357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977082+0000","last_change":"2023-07-29T01:59:57.962277+0000","last_active":"2023-07-29T02:00:01.977082+0000","last_peered":"2023-07-29T02:00:01.977082+0000","last_clean":"2023-07-29T02:00:01.977082+0000","last_became_active":"2023-07-29T01:59:57.961975+0000","last_became_peered":"2023-07-29T01:59:57.961975+0000","last_unstale":"2023-07-29T02:00:01.977082+0000","last_undegraded":"2023-07-29T02:00:01.977082+0000","last_fullsized":"2023-07-29T02:00:01.977082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:27:01.059953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400809+0000","last_change":"2023-07-29T02:00:01.988563+0000","last_active":"2023-07-29T02:00:02.400809+0000","last_peered":"2023-07-29T02:00:02.400809+0000","last_clean":"2023-07-29T02:00:02.400809+0000","last_became_active":"2023-07-29T02:00:01.988155+0000","last_became_peered":"2023-07-29T02:00:01.988155+0000","last_unstale":"2023-07-29T02:00:02.400809+0000","last_undegraded":"2023-07-29T02:00:02.400809+0000","last_fullsized":"2023-07-29T02:00:02.400809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972477+0000","last_change":"2023-07-29T01:59:57.549764+0000","last_active":"2023-07-29T02:00:01.972477+0000","last_peered":"2023-07-29T02:00:01.972477+0000","last_clean":"2023-07-29T02:00:01.972477+0000","last_became_active":"2023-07-29T01:59:57.549470+0000","last_became_peered":"2023-07-29T01:59:57.549470+0000","last_unstale":"2023-07-29T02:00:01.972477+0000","last_undegraded":"2023-07-29T02:00:01.972477+0000","last_fullsized":"2023-07-29T02:00:01.972477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976948+0000","last_change":"2023-07-29T01:59:57.962303+0000","last_active":"2023-07-29T02:00:01.976948+0000","last_peered":"2023-07-29T02:00:01.976948+0000","last_clean":"2023-07-29T02:00:01.976948+0000","last_became_active":"2023-07-29T01:59:57.962016+0000","last_became_peered":"2023-07-29T01:59:57.962016+0000","last_unstale":"2023-07-29T02:00:01.976948+0000","last_undegraded":"2023-07-29T02:00:01.976948+0000","last_fullsized":"2023-07-29T02:00:01.976948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:08.813083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399334+0000","last_change":"2023-07-29T02:00:01.992380+0000","last_active":"2023-07-29T02:00:02.399334+0000","last_peered":"2023-07-29T02:00:02.399334+0000","last_clean":"2023-07-29T02:00:02.399334+0000","last_became_active":"2023-07-29T02:00:01.992042+0000","last_became_peered":"2023-07-29T02:00:01.992042+0000","last_unstale":"2023-07-29T02:00:02.399334+0000","last_undegraded":"2023-07-29T02:00:02.399334+0000","last_fullsized":"2023-07-29T02:00:02.399334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:24:44.331640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977747+0000","last_change":"2023-07-29T01:59:57.537045+0000","last_active":"2023-07-29T02:00:01.977747+0000","last_peered":"2023-07-29T02:00:01.977747+0000","last_clean":"2023-07-29T02:00:01.977747+0000","last_became_active":"2023-07-29T01:59:57.535762+0000","last_became_peered":"2023-07-29T01:59:57.535762+0000","last_unstale":"2023-07-29T02:00:01.977747+0000","last_undegraded":"2023-07-29T02:00:01.977747+0000","last_fullsized":"2023-07-29T02:00:01.977747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972302+0000","last_change":"2023-07-29T01:59:57.975103+0000","last_active":"2023-07-29T02:00:01.972302+0000","last_peered":"2023-07-29T02:00:01.972302+0000","last_clean":"2023-07-29T02:00:01.972302+0000","last_became_active":"2023-07-29T01:59:57.974834+0000","last_became_peered":"2023-07-29T01:59:57.974834+0000","last_unstale":"2023-07-29T02:00:01.972302+0000","last_undegraded":"2023-07-29T02:00:01.972302+0000","last_fullsized":"2023-07-29T02:00:01.972302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401174+0000","last_change":"2023-07-29T02:00:01.990813+0000","last_active":"2023-07-29T02:00:02.401174+0000","last_peered":"2023-07-29T02:00:02.401174+0000","last_clean":"2023-07-29T02:00:02.401174+0000","last_became_active":"2023-07-29T02:00:01.990464+0000","last_became_peered":"2023-07-29T02:00:01.990464+0000","last_unstale":"2023-07-29T02:00:02.401174+0000","last_undegraded":"2023-07-29T02:00:02.401174+0000","last_fullsized":"2023-07-29T02:00:02.401174+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:16:46.676860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.958405+0000","last_change":"2023-07-29T01:59:57.540561+0000","last_active":"2023-07-29T02:00:02.958405+0000","last_peered":"2023-07-29T02:00:02.958405+0000","last_clean":"2023-07-29T02:00:02.958405+0000","last_became_active":"2023-07-29T01:59:57.540292+0000","last_became_peered":"2023-07-29T01:59:57.540292+0000","last_unstale":"2023-07-29T02:00:02.958405+0000","last_undegraded":"2023-07-29T02:00:02.958405+0000","last_fullsized":"2023-07-29T02:00:02.958405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978068+0000","last_change":"2023-07-29T01:59:52.448098+0000","last_active":"2023-07-29T02:00:01.978068+0000","last_peered":"2023-07-29T02:00:01.978068+0000","last_clean":"2023-07-29T02:00:01.978068+0000","last_became_active":"2023-07-29T01:59:52.447782+0000","last_became_peered":"2023-07-29T01:59:52.447782+0000","last_unstale":"2023-07-29T02:00:01.978068+0000","last_undegraded":"2023-07-29T02:00:01.978068+0000","last_fullsized":"2023-07-29T02:00:01.978068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:31.981804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977648+0000","last_change":"2023-07-29T01:59:57.967845+0000","last_active":"2023-07-29T02:00:01.977648+0000","last_peered":"2023-07-29T02:00:01.977648+0000","last_clean":"2023-07-29T02:00:01.977648+0000","last_became_active":"2023-07-29T01:59:57.966065+0000","last_became_peered":"2023-07-29T01:59:57.966065+0000","last_unstale":"2023-07-29T02:00:01.977648+0000","last_undegraded":"2023-07-29T02:00:01.977648+0000","last_fullsized":"2023-07-29T02:00:01.977648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439054+0000","last_change":"2023-07-29T02:00:01.996414+0000","last_active":"2023-07-29T02:00:02.439054+0000","last_peered":"2023-07-29T02:00:02.439054+0000","last_clean":"2023-07-29T02:00:02.439054+0000","last_became_active":"2023-07-29T02:00:01.995963+0000","last_became_peered":"2023-07-29T02:00:01.995963+0000","last_unstale":"2023-07-29T02:00:02.439054+0000","last_undegraded":"2023-07-29T02:00:02.439054+0000","last_fullsized":"2023-07-29T02:00:02.439054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:06:19.130853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.980059+0000","last_change":"2023-07-29T01:59:52.445649+0000","last_active":"2023-07-29T02:00:01.980059+0000","last_peered":"2023-07-29T02:00:01.980059+0000","last_clean":"2023-07-29T02:00:01.980059+0000","last_became_active":"2023-07-29T01:59:52.445337+0000","last_became_peered":"2023-07-29T01:59:52.445337+0000","last_unstale":"2023-07-29T02:00:01.980059+0000","last_undegraded":"2023-07-29T02:00:01.980059+0000","last_fullsized":"2023-07-29T02:00:01.980059+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439989+0000","last_change":"2023-07-29T01:59:57.537863+0000","last_active":"2023-07-29T02:00:02.439989+0000","last_peered":"2023-07-29T02:00:02.439989+0000","last_clean":"2023-07-29T02:00:02.439989+0000","last_became_active":"2023-07-29T01:59:57.537581+0000","last_became_peered":"2023-07-29T01:59:57.537581+0000","last_unstale":"2023-07-29T02:00:02.439989+0000","last_undegraded":"2023-07-29T02:00:02.439989+0000","last_fullsized":"2023-07-29T02:00:02.439989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:02:57.137574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972545+0000","last_change":"2023-07-29T01:59:57.961598+0000","last_active":"2023-07-29T02:00:01.972545+0000","last_peered":"2023-07-29T02:00:01.972545+0000","last_clean":"2023-07-29T02:00:01.972545+0000","last_became_active":"2023-07-29T01:59:57.961298+0000","last_became_peered":"2023-07-29T01:59:57.961298+0000","last_unstale":"2023-07-29T02:00:01.972545+0000","last_undegraded":"2023-07-29T02:00:01.972545+0000","last_fullsized":"2023-07-29T02:00:01.972545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:11:49.956637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400459+0000","last_change":"2023-07-29T02:00:01.987452+0000","last_active":"2023-07-29T02:00:02.400459+0000","last_peered":"2023-07-29T02:00:02.400459+0000","last_clean":"2023-07-29T02:00:02.400459+0000","last_became_active":"2023-07-29T02:00:01.986915+0000","last_became_peered":"2023-07-29T02:00:01.986915+0000","last_unstale":"2023-07-29T02:00:02.400459+0000","last_undegraded":"2023-07-29T02:00:02.400459+0000","last_fullsized":"2023-07-29T02:00:02.400459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:35:48.256508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973327+0000","last_change":"2023-07-29T01:59:52.448423+0000","last_active":"2023-07-29T02:00:01.973327+0000","last_peered":"2023-07-29T02:00:01.973327+0000","last_clean":"2023-07-29T02:00:01.973327+0000","last_became_active":"2023-07-29T01:59:52.448052+0000","last_became_peered":"2023-07-29T01:59:52.448052+0000","last_unstale":"2023-07-29T02:00:01.973327+0000","last_undegraded":"2023-07-29T02:00:01.973327+0000","last_fullsized":"2023-07-29T02:00:01.973327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:31.981804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973579+0000","last_change":"2023-07-29T01:59:52.450730+0000","last_active":"2023-07-29T02:00:01.973579+0000","last_peered":"2023-07-29T02:00:01.973579+0000","last_clean":"2023-07-29T02:00:01.973579+0000","last_became_active":"2023-07-29T01:59:52.449582+0000","last_became_peered":"2023-07-29T01:59:52.449582+0000","last_unstale":"2023-07-29T02:00:01.973579+0000","last_undegraded":"2023-07-29T02:00:01.973579+0000","last_fullsized":"2023-07-29T02:00:01.973579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:01:27.099648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966496+0000","last_change":"2023-07-29T01:59:57.546474+0000","last_active":"2023-07-29T02:00:01.966496+0000","last_peered":"2023-07-29T02:00:01.966496+0000","last_clean":"2023-07-29T02:00:01.966496+0000","last_became_active":"2023-07-29T01:59:57.546179+0000","last_became_peered":"2023-07-29T01:59:57.546179+0000","last_unstale":"2023-07-29T02:00:01.966496+0000","last_undegraded":"2023-07-29T02:00:01.966496+0000","last_fullsized":"2023-07-29T02:00:01.966496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967788+0000","last_change":"2023-07-29T01:59:57.975316+0000","last_active":"2023-07-29T02:00:01.967788+0000","last_peered":"2023-07-29T02:00:01.967788+0000","last_clean":"2023-07-29T02:00:01.967788+0000","last_became_active":"2023-07-29T01:59:57.975078+0000","last_became_peered":"2023-07-29T01:59:57.975078+0000","last_unstale":"2023-07-29T02:00:01.967788+0000","last_undegraded":"2023-07-29T02:00:01.967788+0000","last_fullsized":"2023-07-29T02:00:01.967788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.442819+0000","last_change":"2023-07-29T02:00:01.987385+0000","last_active":"2023-07-29T02:00:02.442819+0000","last_peered":"2023-07-29T02:00:02.442819+0000","last_clean":"2023-07-29T02:00:02.442819+0000","last_became_active":"2023-07-29T02:00:01.986937+0000","last_became_peered":"2023-07-29T02:00:01.986937+0000","last_unstale":"2023-07-29T02:00:02.442819+0000","last_undegraded":"2023-07-29T02:00:02.442819+0000","last_fullsized":"2023-07-29T02:00:02.442819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:53.580244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974915+0000","last_change":"2023-07-29T01:59:53.171806+0000","last_active":"2023-07-29T02:00:01.974915+0000","last_peered":"2023-07-29T02:00:01.974915+0000","last_clean":"2023-07-29T02:00:01.974915+0000","last_became_active":"2023-07-29T01:59:53.171467+0000","last_became_peered":"2023-07-29T01:59:53.171467+0000","last_unstale":"2023-07-29T02:00:01.974915+0000","last_undegraded":"2023-07-29T02:00:01.974915+0000","last_fullsized":"2023-07-29T02:00:01.974915+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972796+0000","last_change":"2023-07-29T01:59:57.549442+0000","last_active":"2023-07-29T02:00:01.972796+0000","last_peered":"2023-07-29T02:00:01.972796+0000","last_clean":"2023-07-29T02:00:01.972796+0000","last_became_active":"2023-07-29T01:59:57.549151+0000","last_became_peered":"2023-07-29T01:59:57.549151+0000","last_unstale":"2023-07-29T02:00:01.972796+0000","last_undegraded":"2023-07-29T02:00:01.972796+0000","last_fullsized":"2023-07-29T02:00:01.972796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972211+0000","last_change":"2023-07-29T01:59:57.973471+0000","last_active":"2023-07-29T02:00:01.972211+0000","last_peered":"2023-07-29T02:00:01.972211+0000","last_clean":"2023-07-29T02:00:01.972211+0000","last_became_active":"2023-07-29T01:59:57.969273+0000","last_became_peered":"2023-07-29T01:59:57.969273+0000","last_unstale":"2023-07-29T02:00:01.972211+0000","last_undegraded":"2023-07-29T02:00:01.972211+0000","last_fullsized":"2023-07-29T02:00:01.972211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:56:07.949649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.400121+0000","last_change":"2023-07-29T02:00:01.993242+0000","last_active":"2023-07-29T02:00:02.400121+0000","last_peered":"2023-07-29T02:00:02.400121+0000","last_clean":"2023-07-29T02:00:02.400121+0000","last_became_active":"2023-07-29T02:00:01.992406+0000","last_became_peered":"2023-07-29T02:00:01.992406+0000","last_unstale":"2023-07-29T02:00:02.400121+0000","last_undegraded":"2023-07-29T02:00:02.400121+0000","last_fullsized":"2023-07-29T02:00:02.400121+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:12.254656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973406+0000","last_change":"2023-07-29T01:59:53.171746+0000","last_active":"2023-07-29T02:00:01.973406+0000","last_peered":"2023-07-29T02:00:01.973406+0000","last_clean":"2023-07-29T02:00:01.973406+0000","last_became_active":"2023-07-29T01:59:53.171440+0000","last_became_peered":"2023-07-29T01:59:53.171440+0000","last_unstale":"2023-07-29T02:00:01.973406+0000","last_undegraded":"2023-07-29T02:00:01.973406+0000","last_fullsized":"2023-07-29T02:00:01.973406+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:17:56.960611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976818+0000","last_change":"2023-07-29T01:59:57.537970+0000","last_active":"2023-07-29T02:00:01.976818+0000","last_peered":"2023-07-29T02:00:01.976818+0000","last_clean":"2023-07-29T02:00:01.976818+0000","last_became_active":"2023-07-29T01:59:57.537665+0000","last_became_peered":"2023-07-29T01:59:57.537665+0000","last_unstale":"2023-07-29T02:00:01.976818+0000","last_undegraded":"2023-07-29T02:00:01.976818+0000","last_fullsized":"2023-07-29T02:00:01.976818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968235+0000","last_change":"2023-07-29T01:59:57.968655+0000","last_active":"2023-07-29T02:00:01.968235+0000","last_peered":"2023-07-29T02:00:01.968235+0000","last_clean":"2023-07-29T02:00:01.968235+0000","last_became_active":"2023-07-29T01:59:57.968373+0000","last_became_peered":"2023-07-29T01:59:57.968373+0000","last_unstale":"2023-07-29T02:00:01.968235+0000","last_undegraded":"2023-07-29T02:00:01.968235+0000","last_fullsized":"2023-07-29T02:00:01.968235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:06.785485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439797+0000","last_change":"2023-07-29T02:00:01.984885+0000","last_active":"2023-07-29T02:00:02.439797+0000","last_peered":"2023-07-29T02:00:02.439797+0000","last_clean":"2023-07-29T02:00:02.439797+0000","last_became_active":"2023-07-29T02:00:01.984476+0000","last_became_peered":"2023-07-29T02:00:01.984476+0000","last_unstale":"2023-07-29T02:00:02.439797+0000","last_undegraded":"2023-07-29T02:00:02.439797+0000","last_fullsized":"2023-07-29T02:00:02.439797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973534+0000","last_change":"2023-07-29T01:59:53.172039+0000","last_active":"2023-07-29T02:00:01.973534+0000","last_peered":"2023-07-29T02:00:01.973534+0000","last_clean":"2023-07-29T02:00:01.973534+0000","last_became_active":"2023-07-29T01:59:53.171617+0000","last_became_peered":"2023-07-29T01:59:53.171617+0000","last_unstale":"2023-07-29T02:00:01.973534+0000","last_undegraded":"2023-07-29T02:00:01.973534+0000","last_fullsized":"2023-07-29T02:00:01.973534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.976735+0000","last_change":"2023-07-29T01:59:57.540888+0000","last_active":"2023-07-29T02:00:01.976735+0000","last_peered":"2023-07-29T02:00:01.976735+0000","last_clean":"2023-07-29T02:00:01.976735+0000","last_became_active":"2023-07-29T01:59:57.540449+0000","last_became_peered":"2023-07-29T01:59:57.540449+0000","last_unstale":"2023-07-29T02:00:01.976735+0000","last_undegraded":"2023-07-29T02:00:01.976735+0000","last_fullsized":"2023-07-29T02:00:01.976735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.974278+0000","last_change":"2023-07-29T01:59:57.968216+0000","last_active":"2023-07-29T02:00:01.974278+0000","last_peered":"2023-07-29T02:00:01.974278+0000","last_clean":"2023-07-29T02:00:01.974278+0000","last_became_active":"2023-07-29T01:59:57.967933+0000","last_became_peered":"2023-07-29T01:59:57.967933+0000","last_unstale":"2023-07-29T02:00:01.974278+0000","last_undegraded":"2023-07-29T02:00:01.974278+0000","last_fullsized":"2023-07-29T02:00:01.974278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439338+0000","last_change":"2023-07-29T02:00:01.985121+0000","last_active":"2023-07-29T02:00:02.439338+0000","last_peered":"2023-07-29T02:00:02.439338+0000","last_clean":"2023-07-29T02:00:02.439338+0000","last_became_active":"2023-07-29T02:00:01.984691+0000","last_became_peered":"2023-07-29T02:00:01.984691+0000","last_unstale":"2023-07-29T02:00:02.439338+0000","last_undegraded":"2023-07-29T02:00:02.439338+0000","last_fullsized":"2023-07-29T02:00:02.439338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:54.400954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967930+0000","last_change":"2023-07-29T01:59:53.171808+0000","last_active":"2023-07-29T02:00:01.967930+0000","last_peered":"2023-07-29T02:00:01.967930+0000","last_clean":"2023-07-29T02:00:01.967930+0000","last_became_active":"2023-07-29T01:59:53.171463+0000","last_became_peered":"2023-07-29T01:59:53.171463+0000","last_unstale":"2023-07-29T02:00:01.967930+0000","last_undegraded":"2023-07-29T02:00:01.967930+0000","last_fullsized":"2023-07-29T02:00:01.967930+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:07:59.559814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.973914+0000","last_change":"2023-07-29T01:59:57.549468+0000","last_active":"2023-07-29T02:00:01.973914+0000","last_peered":"2023-07-29T02:00:01.973914+0000","last_clean":"2023-07-29T02:00:01.973914+0000","last_became_active":"2023-07-29T01:59:57.549181+0000","last_became_peered":"2023-07-29T01:59:57.549181+0000","last_unstale":"2023-07-29T02:00:01.973914+0000","last_undegraded":"2023-07-29T02:00:01.973914+0000","last_fullsized":"2023-07-29T02:00:01.973914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.966982+0000","last_change":"2023-07-29T01:59:57.963908+0000","last_active":"2023-07-29T02:00:01.966982+0000","last_peered":"2023-07-29T02:00:01.966982+0000","last_clean":"2023-07-29T02:00:01.966982+0000","last_became_active":"2023-07-29T01:59:57.963659+0000","last_became_peered":"2023-07-29T01:59:57.963659+0000","last_unstale":"2023-07-29T02:00:01.966982+0000","last_undegraded":"2023-07-29T02:00:01.966982+0000","last_fullsized":"2023-07-29T02:00:01.966982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440428+0000","last_change":"2023-07-29T02:00:01.984197+0000","last_active":"2023-07-29T02:00:02.440428+0000","last_peered":"2023-07-29T02:00:02.440428+0000","last_clean":"2023-07-29T02:00:02.440428+0000","last_became_active":"2023-07-29T02:00:01.983744+0000","last_became_peered":"2023-07-29T02:00:01.983744+0000","last_unstale":"2023-07-29T02:00:02.440428+0000","last_undegraded":"2023-07-29T02:00:02.440428+0000","last_fullsized":"2023-07-29T02:00:02.440428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.968731+0000","last_change":"2023-07-29T01:59:52.449102+0000","last_active":"2023-07-29T02:00:01.968731+0000","last_peered":"2023-07-29T02:00:01.968731+0000","last_clean":"2023-07-29T02:00:01.968731+0000","last_became_active":"2023-07-29T01:59:52.448814+0000","last_became_peered":"2023-07-29T01:59:52.448814+0000","last_unstale":"2023-07-29T02:00:01.968731+0000","last_undegraded":"2023-07-29T02:00:01.968731+0000","last_fullsized":"2023-07-29T02:00:01.968731+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.977814+0000","last_change":"2023-07-29T01:59:57.544590+0000","last_active":"2023-07-29T02:00:01.977814+0000","last_peered":"2023-07-29T02:00:01.977814+0000","last_clean":"2023-07-29T02:00:01.977814+0000","last_became_active":"2023-07-29T01:59:57.544317+0000","last_became_peered":"2023-07-29T01:59:57.544317+0000","last_unstale":"2023-07-29T02:00:01.977814+0000","last_undegraded":"2023-07-29T02:00:01.977814+0000","last_fullsized":"2023-07-29T02:00:01.977814+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971685+0000","last_change":"2023-07-29T01:59:57.973912+0000","last_active":"2023-07-29T02:00:01.971685+0000","last_peered":"2023-07-29T02:00:01.971685+0000","last_clean":"2023-07-29T02:00:01.971685+0000","last_became_active":"2023-07-29T01:59:57.969642+0000","last_became_peered":"2023-07-29T01:59:57.969642+0000","last_unstale":"2023-07-29T02:00:01.971685+0000","last_undegraded":"2023-07-29T02:00:01.971685+0000","last_fullsized":"2023-07-29T02:00:01.971685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440741+0000","last_change":"2023-07-29T02:00:01.999117+0000","last_active":"2023-07-29T02:00:02.440741+0000","last_peered":"2023-07-29T02:00:02.440741+0000","last_clean":"2023-07-29T02:00:02.440741+0000","last_became_active":"2023-07-29T02:00:01.998715+0000","last_became_peered":"2023-07-29T02:00:01.998715+0000","last_unstale":"2023-07-29T02:00:02.440741+0000","last_undegraded":"2023-07-29T02:00:02.440741+0000","last_fullsized":"2023-07-29T02:00:02.440741+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.440569+0000","last_change":"2023-07-29T01:59:57.545933+0000","last_active":"2023-07-29T02:00:02.440569+0000","last_peered":"2023-07-29T02:00:02.440569+0000","last_clean":"2023-07-29T02:00:02.440569+0000","last_became_active":"2023-07-29T01:59:57.545744+0000","last_became_peered":"2023-07-29T01:59:57.545744+0000","last_unstale":"2023-07-29T02:00:02.440569+0000","last_undegraded":"2023-07-29T02:00:02.440569+0000","last_fullsized":"2023-07-29T02:00:02.440569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972541+0000","last_change":"2023-07-29T01:59:57.970577+0000","last_active":"2023-07-29T02:00:01.972541+0000","last_peered":"2023-07-29T02:00:01.972541+0000","last_clean":"2023-07-29T02:00:01.972541+0000","last_became_active":"2023-07-29T01:59:57.970252+0000","last_became_peered":"2023-07-29T01:59:57.970252+0000","last_unstale":"2023-07-29T02:00:01.972541+0000","last_undegraded":"2023-07-29T02:00:01.972541+0000","last_fullsized":"2023-07-29T02:00:01.972541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:09.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.399784+0000","last_change":"2023-07-29T02:00:01.989885+0000","last_active":"2023-07-29T02:00:02.399784+0000","last_peered":"2023-07-29T02:00:02.399784+0000","last_clean":"2023-07-29T02:00:02.399784+0000","last_became_active":"2023-07-29T02:00:01.989481+0000","last_became_peered":"2023-07-29T02:00:01.989481+0000","last_unstale":"2023-07-29T02:00:02.399784+0000","last_undegraded":"2023-07-29T02:00:02.399784+0000","last_fullsized":"2023-07-29T02:00:02.399784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957691+0000","last_change":"2023-07-29T01:59:57.543782+0000","last_active":"2023-07-29T02:00:02.957691+0000","last_peered":"2023-07-29T02:00:02.957691+0000","last_clean":"2023-07-29T02:00:02.957691+0000","last_became_active":"2023-07-29T01:59:57.543445+0000","last_became_peered":"2023-07-29T01:59:57.543445+0000","last_unstale":"2023-07-29T02:00:02.957691+0000","last_undegraded":"2023-07-29T02:00:02.957691+0000","last_fullsized":"2023-07-29T02:00:02.957691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.970956+0000","last_change":"2023-07-29T01:59:57.965177+0000","last_active":"2023-07-29T02:00:01.970956+0000","last_peered":"2023-07-29T02:00:01.970956+0000","last_clean":"2023-07-29T02:00:01.970956+0000","last_became_active":"2023-07-29T01:59:57.964925+0000","last_became_peered":"2023-07-29T01:59:57.964925+0000","last_unstale":"2023-07-29T02:00:01.970956+0000","last_undegraded":"2023-07-29T02:00:01.970956+0000","last_fullsized":"2023-07-29T02:00:01.970956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.401320+0000","last_change":"2023-07-29T02:00:01.985786+0000","last_active":"2023-07-29T02:00:02.401320+0000","last_peered":"2023-07-29T02:00:02.401320+0000","last_clean":"2023-07-29T02:00:02.401320+0000","last_became_active":"2023-07-29T02:00:01.985310+0000","last_became_peered":"2023-07-29T02:00:01.985310+0000","last_unstale":"2023-07-29T02:00:02.401320+0000","last_undegraded":"2023-07-29T02:00:02.401320+0000","last_fullsized":"2023-07-29T02:00:02.401320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"25'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957725+0000","last_change":"2023-07-29T01:59:57.541908+0000","last_active":"2023-07-29T02:00:02.957725+0000","last_peered":"2023-07-29T02:00:02.957725+0000","last_clean":"2023-07-29T02:00:02.957725+0000","last_became_active":"2023-07-29T01:59:57.541633+0000","last_became_peered":"2023-07-29T01:59:57.541633+0000","last_unstale":"2023-07-29T02:00:02.957725+0000","last_undegraded":"2023-07-29T02:00:02.957725+0000","last_fullsized":"2023-07-29T02:00:02.957725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.970785+0000","last_change":"2023-07-29T01:59:57.965915+0000","last_active":"2023-07-29T02:00:01.970785+0000","last_peered":"2023-07-29T02:00:01.970785+0000","last_clean":"2023-07-29T02:00:01.970785+0000","last_became_active":"2023-07-29T01:59:57.965383+0000","last_became_peered":"2023-07-29T01:59:57.965383+0000","last_unstale":"2023-07-29T02:00:01.970785+0000","last_undegraded":"2023-07-29T02:00:01.970785+0000","last_fullsized":"2023-07-29T02:00:01.970785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.398445+0000","last_change":"2023-07-29T02:00:01.994436+0000","last_active":"2023-07-29T02:00:02.398445+0000","last_peered":"2023-07-29T02:00:02.398445+0000","last_clean":"2023-07-29T02:00:02.398445+0000","last_became_active":"2023-07-29T02:00:01.993454+0000","last_became_peered":"2023-07-29T02:00:01.993454+0000","last_unstale":"2023-07-29T02:00:02.398445+0000","last_undegraded":"2023-07-29T02:00:02.398445+0000","last_fullsized":"2023-07-29T02:00:02.398445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:46.998657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"25'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.441131+0000","last_change":"2023-07-29T01:59:57.539625+0000","last_active":"2023-07-29T02:00:02.441131+0000","last_peered":"2023-07-29T02:00:02.441131+0000","last_clean":"2023-07-29T02:00:02.441131+0000","last_became_active":"2023-07-29T01:59:57.539181+0000","last_became_peered":"2023-07-29T01:59:57.539181+0000","last_unstale":"2023-07-29T02:00:02.441131+0000","last_undegraded":"2023-07-29T02:00:02.441131+0000","last_fullsized":"2023-07-29T02:00:02.441131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:02:57.137574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979518+0000","last_change":"2023-07-29T01:59:57.966812+0000","last_active":"2023-07-29T02:00:01.979518+0000","last_peered":"2023-07-29T02:00:01.979518+0000","last_clean":"2023-07-29T02:00:01.979518+0000","last_became_active":"2023-07-29T01:59:57.966580+0000","last_became_peered":"2023-07-29T01:59:57.966580+0000","last_unstale":"2023-07-29T02:00:01.979518+0000","last_undegraded":"2023-07-29T02:00:01.979518+0000","last_fullsized":"2023-07-29T02:00:01.979518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.203628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.439475+0000","last_change":"2023-07-29T02:00:01.985984+0000","last_active":"2023-07-29T02:00:02.439475+0000","last_peered":"2023-07-29T02:00:02.439475+0000","last_clean":"2023-07-29T02:00:02.439475+0000","last_became_active":"2023-07-29T02:00:01.985554+0000","last_became_peered":"2023-07-29T02:00:01.985554+0000","last_unstale":"2023-07-29T02:00:02.439475+0000","last_undegraded":"2023-07-29T02:00:02.439475+0000","last_fullsized":"2023-07-29T02:00:02.439475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:50:50.164635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"25'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-29T02:00:02.957483+0000","last_change":"2023-07-29T01:59:57.537754+0000","last_active":"2023-07-29T02:00:02.957483+0000","last_peered":"2023-07-29T02:00:02.957483+0000","last_clean":"2023-07-29T02:00:02.957483+0000","last_became_active":"2023-07-29T01:59:57.537457+0000","last_became_peered":"2023-07-29T01:59:57.537457+0000","last_unstale":"2023-07-29T02:00:02.957483+0000","last_undegraded":"2023-07-29T02:00:02.957483+0000","last_fullsized":"2023-07-29T02:00:02.957483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.975481+0000","last_change":"2023-07-29T01:59:57.960633+0000","last_active":"2023-07-29T02:00:01.975481+0000","last_peered":"2023-07-29T02:00:01.975481+0000","last_clean":"2023-07-29T02:00:01.975481+0000","last_became_active":"2023-07-29T01:59:57.960318+0000","last_became_peered":"2023-07-29T01:59:57.960318+0000","last_unstale":"2023-07-29T02:00:01.975481+0000","last_undegraded":"2023-07-29T02:00:01.975481+0000","last_fullsized":"2023-07-29T02:00:01.975481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:01:11.408184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.967878+0000","last_change":"2023-07-29T01:59:57.960826+0000","last_active":"2023-07-29T02:00:01.967878+0000","last_peered":"2023-07-29T02:00:01.967878+0000","last_clean":"2023-07-29T02:00:01.967878+0000","last_became_active":"2023-07-29T01:59:57.959960+0000","last_became_peered":"2023-07-29T01:59:57.959960+0000","last_unstale":"2023-07-29T02:00:01.967878+0000","last_undegraded":"2023-07-29T02:00:01.967878+0000","last_fullsized":"2023-07-29T02:00:01.967878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.979718+0000","last_change":"2023-07-29T01:59:57.976560+0000","last_active":"2023-07-29T02:00:01.979718+0000","last_peered":"2023-07-29T02:00:01.979718+0000","last_clean":"2023-07-29T02:00:01.979718+0000","last_became_active":"2023-07-29T01:59:57.975384+0000","last_became_peered":"2023-07-29T01:59:57.975384+0000","last_unstale":"2023-07-29T02:00:01.979718+0000","last_undegraded":"2023-07-29T02:00:01.979718+0000","last_fullsized":"2023-07-29T02:00:01.979718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.971237+0000","last_change":"2023-07-29T01:59:57.967891+0000","last_active":"2023-07-29T02:00:01.971237+0000","last_peered":"2023-07-29T02:00:01.971237+0000","last_clean":"2023-07-29T02:00:01.971237+0000","last_became_active":"2023-07-29T01:59:57.967603+0000","last_became_peered":"2023-07-29T01:59:57.967603+0000","last_unstale":"2023-07-29T02:00:01.971237+0000","last_undegraded":"2023-07-29T02:00:01.971237+0000","last_fullsized":"2023-07-29T02:00:01.971237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:24:00.439433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.978571+0000","last_change":"2023-07-29T01:59:57.966922+0000","last_active":"2023-07-29T02:00:01.978571+0000","last_peered":"2023-07-29T02:00:01.978571+0000","last_clean":"2023-07-29T02:00:01.978571+0000","last_became_active":"2023-07-29T01:59:57.966672+0000","last_became_peered":"2023-07-29T01:59:57.966672+0000","last_unstale":"2023-07-29T02:00:01.978571+0000","last_undegraded":"2023-07-29T02:00:01.978571+0000","last_fullsized":"2023-07-29T02:00:01.978571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-07-29T02:00:01.972636+0000","last_change":"2023-07-29T01:59:57.968727+0000","last_active":"2023-07-29T02:00:01.972636+0000","last_peered":"2023-07-29T02:00:01.972636+0000","last_clean":"2023-07-29T02:00:01.972636+0000","last_became_active":"2023-07-29T01:59:57.968449+0000","last_became_peered":"2023-07-29T01:59:57.968449+0000","last_unstale":"2023-07-29T02:00:01.972636+0000","last_undegraded":"2023-07-29T02:00:01.972636+0000","last_fullsized":"2023-07-29T02:00:01.972636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4849,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":360448,"data_stored":704036,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":331776,"data_stored":699769,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":270336,"data_stored":109983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":108530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":286720,"data_stored":113508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":274432,"data_stored":110053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T02:00:47.877 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T02:00:48.034 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.047+0000 7f6e2fa95700 1 Processor -- start 2023-07-29T02:00:48.035 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.047+0000 7f6e2fa95700 1 -- start start 2023-07-29T02:00:48.037 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.048+0000 7f6e2fa95700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f6e2814ca00 0x7f6e2806c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:48.037 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.048+0000 7f6e2fa95700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6e280c7270 0x7f6e2806d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:48.037 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.048+0000 7f6e2fa95700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e2806ce40 con 0x7f6e2814c630 2023-07-29T02:00:48.038 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.048+0000 7f6e2fa95700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e28155d50 con 0x7f6e280c7270 2023-07-29T02:00:48.038 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.048+0000 7f6e2fa95700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e28156010 con 0x7f6e2814ca00 2023-07-29T02:00:48.038 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.048+0000 7f6e2d831700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f6e2814c630 0x7f6e280c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50942/0 (socket says 172.21.15.42:50942) 2023-07-29T02:00:48.038 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.048+0000 7f6e2d831700 1 -- 172.21.15.42:0/1614808109 learned_addr learned my addr 172.21.15.42:0/1614808109 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:48.038 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.048+0000 7f6e2e032700 1 --2- 172.21.15.42:0/1614808109 >> v2:172.21.15.42:3300/0 conn(0x7f6e280c7270 0x7f6e2806d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:48.038 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.049+0000 7f6e2d030700 1 --2- 172.21.15.42:0/1614808109 >> v2:172.21.15.144:3300/0 conn(0x7f6e2814ca00 0x7f6e2806c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:48.039 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.049+0000 7f6e2c82f700 1 -- 172.21.15.42:0/1614808109 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799033604 0 0) 0x7f6e2806ce40 con 0x7f6e2814c630 2023-07-29T02:00:48.039 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.049+0000 7f6e2c82f700 1 -- 172.21.15.42:0/1614808109 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e140035b0 con 0x7f6e2814c630 2023-07-29T02:00:48.039 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.049+0000 7f6e2e032700 1 -- 172.21.15.42:0/1614808109 >> v2:172.21.15.144:3300/0 conn(0x7f6e2814ca00 msgr2=0x7f6e2806c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:48.039 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.049+0000 7f6e2e032700 1 --2- 172.21.15.42:0/1614808109 >> v2:172.21.15.144:3300/0 conn(0x7f6e2814ca00 0x7f6e2806c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.039 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.049+0000 7f6e2e032700 1 -- 172.21.15.42:0/1614808109 >> v1:172.21.15.42:6789/0 conn(0x7f6e2814c630 legacy=0x7f6e280c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:48.039 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.049+0000 7f6e2e032700 1 -- 172.21.15.42:0/1614808109 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e281562f0 con 0x7f6e280c7270 2023-07-29T02:00:48.040 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.049+0000 7f6e2e032700 1 --2- 172.21.15.42:0/1614808109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e280c7270 0x7f6e2806d2d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6e280c3200 tx=0x7f6e2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e7c6666786318f server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:48.040 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.049+0000 7f6e2c82f700 1 -- 172.21.15.42:0/1614808109 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2000e070 con 0x7f6e280c7270 2023-07-29T02:00:48.040 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.049+0000 7f6e2c82f700 1 -- 172.21.15.42:0/1614808109 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2000bb20 con 0x7f6e280c7270 2023-07-29T02:00:48.041 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.049+0000 7f6e2c82f700 1 -- 172.21.15.42:0/1614808109 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20012430 con 0x7f6e280c7270 2023-07-29T02:00:48.041 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.050+0000 7f6e2fa95700 1 -- 172.21.15.42:0/1614808109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e280c7270 msgr2=0x7f6e2806d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:48.041 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.050+0000 7f6e2fa95700 1 --2- 172.21.15.42:0/1614808109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e280c7270 0x7f6e2806d2d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6e280c3200 tx=0x7f6e2000b330 comp rx=0 tx=0).stop 2023-07-29T02:00:48.042 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.050+0000 7f6e2fa95700 1 -- 172.21.15.42:0/1614808109 shutdown_connections 2023-07-29T02:00:48.042 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.050+0000 7f6e2fa95700 1 --2- 172.21.15.42:0/1614808109 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e280c7270 0x7f6e2806d2d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.042 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.050+0000 7f6e2fa95700 1 --2- 172.21.15.42:0/1614808109 >> v2:172.21.15.144:3300/0 conn(0x7f6e2814ca00 0x7f6e2806c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.042 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.050+0000 7f6e2fa95700 1 -- 172.21.15.42:0/1614808109 >> 172.21.15.42:0/1614808109 conn(0x7f6e280c8970 msgr2=0x7f6e280c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:48.042 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.050+0000 7f6e2fa95700 1 -- 172.21.15.42:0/1614808109 shutdown_connections 2023-07-29T02:00:48.042 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.050+0000 7f6e2fa95700 1 -- 172.21.15.42:0/1614808109 wait complete. 2023-07-29T02:00:48.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.051+0000 7f6e2fa95700 1 Processor -- start 2023-07-29T02:00:48.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.052+0000 7f6e2fa95700 1 -- start start 2023-07-29T02:00:48.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.052+0000 7f6e2fa95700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e280c7270 0x7f6e28140c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:48.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.052+0000 7f6e2fa95700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e2814c630 0x7f6e28141140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:48.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.052+0000 7f6e2fa95700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e280c4b20 0x7f6e281465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:48.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.052+0000 7f6e2fa95700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e281ec330 con 0x7f6e280c4b20 2023-07-29T02:00:48.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.052+0000 7f6e2fa95700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e280c5420 con 0x7f6e2814c630 2023-07-29T02:00:48.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.052+0000 7f6e2fa95700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e281eb6b0 con 0x7f6e280c7270 2023-07-29T02:00:48.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.053+0000 7f6e2e032700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e280c4b20 0x7f6e281465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:48.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.053+0000 7f6e2e032700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e280c4b20 0x7f6e281465a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57148/0 (socket says 172.21.15.42:57148) 2023-07-29T02:00:48.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.053+0000 7f6e2e032700 1 -- 172.21.15.42:0/2517793140 learned_addr learned my addr 172.21.15.42:0/2517793140 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:48.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.053+0000 7f6e2d831700 1 --2- 172.21.15.42:0/2517793140 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e280c7270 0x7f6e28140c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:48.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.053+0000 7f6e2d030700 1 --2- 172.21.15.42:0/2517793140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e2814c630 0x7f6e28141140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:48.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.053+0000 7f6e2e032700 1 -- 172.21.15.42:0/2517793140 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e280c7270 msgr2=0x7f6e28140c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:48.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.053+0000 7f6e2e032700 1 --2- 172.21.15.42:0/2517793140 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e280c7270 0x7f6e28140c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.053+0000 7f6e2e032700 1 -- 172.21.15.42:0/2517793140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e2814c630 msgr2=0x7f6e28141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:48.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.053+0000 7f6e2e032700 1 --2- 172.21.15.42:0/2517793140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e2814c630 0x7f6e28141140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.053+0000 7f6e2e032700 1 -- 172.21.15.42:0/2517793140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e20009a70 con 0x7f6e280c4b20 2023-07-29T02:00:48.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.053+0000 7f6e2d030700 1 --2- 172.21.15.42:0/2517793140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e2814c630 0x7f6e28141140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:48.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.053+0000 7f6e2e032700 1 --2- 172.21.15.42:0/2517793140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e280c4b20 0x7f6e281465a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6e20014040 tx=0x7f6e20004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:48.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.053+0000 7f6e1e7fc700 1 -- 172.21.15.42:0/2517793140 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20020070 con 0x7f6e280c4b20 2023-07-29T02:00:48.048 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.053+0000 7f6e1e7fc700 1 -- 172.21.15.42:0/2517793140 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e200125e0 con 0x7f6e280c4b20 2023-07-29T02:00:48.048 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.053+0000 7f6e2fa95700 1 -- 172.21.15.42:0/2517793140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e281eb990 con 0x7f6e280c4b20 2023-07-29T02:00:48.048 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.053+0000 7f6e1e7fc700 1 -- 172.21.15.42:0/2517793140 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e20012970 con 0x7f6e280c4b20 2023-07-29T02:00:48.048 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.053+0000 7f6e2fa95700 1 -- 172.21.15.42:0/2517793140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e281ebf50 con 0x7f6e280c4b20 2023-07-29T02:00:48.048 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.054+0000 7f6e2fa95700 1 -- 172.21.15.42:0/2517793140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e28074740 con 0x7f6e280c4b20 2023-07-29T02:00:48.048 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.055+0000 7f6e1e7fc700 1 -- 172.21.15.42:0/2517793140 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f6e20024070 con 0x7f6e280c4b20 2023-07-29T02:00:48.049 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.055+0000 7f6e1e7fc700 1 --2- 172.21.15.42:0/2517793140 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6e0c06a690 0x7f6e0c06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:48.049 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.055+0000 7f6e1e7fc700 1 -- 172.21.15.42:0/2517793140 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6850+0+0 (secure 0 0 0) 0x7f6e2008bb20 con 0x7f6e280c4b20 2023-07-29T02:00:48.049 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.055+0000 7f6e2d831700 1 --2- 172.21.15.42:0/2517793140 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6e0c06a690 0x7f6e0c06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:48.049 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.056+0000 7f6e2d831700 1 --2- 172.21.15.42:0/2517793140 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6e0c06a690 0x7f6e0c06cb40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6e180011e0 tx=0x7f6e18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:48.050 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.059+0000 7f6e1e7fc700 1 -- 172.21.15.42:0/2517793140 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f6e2005a720 con 0x7f6e280c4b20 2023-07-29T02:00:48.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.260+0000 7f6e2fa95700 1 -- 172.21.15.42:0/2517793140 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e281ec470 con 0x7f6e280c4b20 2023-07-29T02:00:48.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.261+0000 7f6e1e7fc700 1 -- 172.21.15.42:0/2517793140 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19757 (secure 0 0 0) 0x7f6e281ec470 con 0x7f6e280c4b20 2023-07-29T02:00:48.249 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:48.249 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":27,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T02:00:46.516218+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T01:59:55.827461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T01:59:56.924040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-29T01:59:59.996470+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2},{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T02:00:48.251 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.264+0000 7f6e2fa95700 1 -- 172.21.15.42:0/2517793140 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6e0c06a690 msgr2=0x7f6e0c06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:48.251 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.264+0000 7f6e2fa95700 1 --2- 172.21.15.42:0/2517793140 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6e0c06a690 0x7f6e0c06cb40 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6e180011e0 tx=0x7f6e18009040 comp rx=0 tx=0).stop 2023-07-29T02:00:48.251 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.264+0000 7f6e2fa95700 1 -- 172.21.15.42:0/2517793140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e280c4b20 msgr2=0x7f6e281465a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:48.252 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.264+0000 7f6e2fa95700 1 --2- 172.21.15.42:0/2517793140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e280c4b20 0x7f6e281465a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6e20014040 tx=0x7f6e20004ad0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.252 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.264+0000 7f6e2fa95700 1 -- 172.21.15.42:0/2517793140 shutdown_connections 2023-07-29T02:00:48.252 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.264+0000 7f6e2fa95700 1 --2- 172.21.15.42:0/2517793140 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6e0c06a690 0x7f6e0c06cb40 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.252 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.264+0000 7f6e2fa95700 1 --2- 172.21.15.42:0/2517793140 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6e280c4b20 0x7f6e281465a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.252 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.264+0000 7f6e2fa95700 1 --2- 172.21.15.42:0/2517793140 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6e280c7270 0x7f6e28140c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.252 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.264+0000 7f6e2fa95700 1 --2- 172.21.15.42:0/2517793140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e2814c630 0x7f6e28141140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.253 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.264+0000 7f6e2fa95700 1 -- 172.21.15.42:0/2517793140 >> 172.21.15.42:0/2517793140 conn(0x7f6e280c8970 msgr2=0x7f6e28147ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:48.253 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.264+0000 7f6e2fa95700 1 -- 172.21.15.42:0/2517793140 shutdown_connections 2023-07-29T02:00:48.253 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.264+0000 7f6e2fa95700 1 -- 172.21.15.42:0/2517793140 wait complete. 2023-07-29T02:00:48.263 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-29T01:59:50.906228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-29T01:59:51.290583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T01:59:55.827461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T01:59:56.924040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-29T01:59:59.996470+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-29T02:00:48.264 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-29T02:00:48.392 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.405+0000 7fb956f1d700 1 Processor -- start 2023-07-29T02:00:48.393 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.405+0000 7fb956f1d700 1 -- start start 2023-07-29T02:00:48.394 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.406+0000 7fb956f1d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb9501531a0 0x7fb95006f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:48.395 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.406+0000 7fb956f1d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb9500c8580 0x7fb95015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:48.395 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.406+0000 7fb956f1d700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb95006c870 con 0x7fb950071840 2023-07-29T02:00:48.395 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.406+0000 7fb956f1d700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9500c74a0 con 0x7fb9500c8580 2023-07-29T02:00:48.395 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.406+0000 7fb956f1d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95006fa50 con 0x7fb9501531a0 2023-07-29T02:00:48.395 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.406+0000 7fb94ffff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb9500c8580 0x7fb95015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:48.395 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.406+0000 7fb9554ba700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb950071840 0x7fb95006a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50960/0 (socket says 172.21.15.42:50960) 2023-07-29T02:00:48.395 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.406+0000 7fb9554ba700 1 -- 172.21.15.42:0/244132823 learned_addr learned my addr 172.21.15.42:0/244132823 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:48.396 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.406+0000 7fb954cb9700 1 --2- 172.21.15.42:0/244132823 >> v2:172.21.15.144:3300/0 conn(0x7fb9501531a0 0x7fb95006f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:48.396 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.406+0000 7fb94f7fe700 1 -- 172.21.15.42:0/244132823 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025406380 0 0) 0x7fb95006c870 con 0x7fb950071840 2023-07-29T02:00:48.396 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.406+0000 7fb94f7fe700 1 -- 172.21.15.42:0/244132823 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9400035b0 con 0x7fb950071840 2023-07-29T02:00:48.396 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.406+0000 7fb94ffff700 1 -- 172.21.15.42:0/244132823 >> v2:172.21.15.144:3300/0 conn(0x7fb9501531a0 msgr2=0x7fb95006f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:48.396 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.406+0000 7fb94ffff700 1 --2- 172.21.15.42:0/244132823 >> v2:172.21.15.144:3300/0 conn(0x7fb9501531a0 0x7fb95006f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.396 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.406+0000 7fb94ffff700 1 -- 172.21.15.42:0/244132823 >> v1:172.21.15.42:6789/0 conn(0x7fb950071840 legacy=0x7fb95006a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:48.396 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.406+0000 7fb94ffff700 1 -- 172.21.15.42:0/244132823 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95015ca00 con 0x7fb9500c8580 2023-07-29T02:00:48.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.406+0000 7fb954cb9700 1 --2- 172.21.15.42:0/244132823 >> v2:172.21.15.144:3300/0 conn(0x7fb9501531a0 0x7fb95006f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:48.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.406+0000 7fb94ffff700 1 --2- 172.21.15.42:0/244132823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9500c8580 0x7fb95015c4c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb950072f50 tx=0x7fb93c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2acc347fdde55c33 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:48.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.407+0000 7fb94f7fe700 1 -- 172.21.15.42:0/244132823 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c011830 con 0x7fb9500c8580 2023-07-29T02:00:48.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.407+0000 7fb94f7fe700 1 -- 172.21.15.42:0/244132823 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93c011990 con 0x7fb9500c8580 2023-07-29T02:00:48.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.407+0000 7fb94f7fe700 1 -- 172.21.15.42:0/244132823 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c011d20 con 0x7fb9500c8580 2023-07-29T02:00:48.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.407+0000 7fb956f1d700 1 -- 172.21.15.42:0/244132823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9500c8580 msgr2=0x7fb95015c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:48.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.407+0000 7fb956f1d700 1 --2- 172.21.15.42:0/244132823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9500c8580 0x7fb95015c4c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb950072f50 tx=0x7fb93c009b20 comp rx=0 tx=0).stop 2023-07-29T02:00:48.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.407+0000 7fb956f1d700 1 -- 172.21.15.42:0/244132823 shutdown_connections 2023-07-29T02:00:48.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.407+0000 7fb956f1d700 1 --2- 172.21.15.42:0/244132823 >> v2:172.21.15.144:3300/0 conn(0x7fb9501531a0 0x7fb95006f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.407+0000 7fb956f1d700 1 --2- 172.21.15.42:0/244132823 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9500c8580 0x7fb95015c4c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.407+0000 7fb956f1d700 1 -- 172.21.15.42:0/244132823 >> 172.21.15.42:0/244132823 conn(0x7fb9500cbf10 msgr2=0x7fb9500cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:48.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.407+0000 7fb956f1d700 1 -- 172.21.15.42:0/244132823 shutdown_connections 2023-07-29T02:00:48.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.407+0000 7fb956f1d700 1 -- 172.21.15.42:0/244132823 wait complete. 2023-07-29T02:00:48.400 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.408+0000 7fb956f1d700 1 Processor -- start 2023-07-29T02:00:48.401 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.408+0000 7fb956f1d700 1 -- start start 2023-07-29T02:00:48.401 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.409+0000 7fb956f1d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb950071840 0x7fb95014ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:48.401 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.409+0000 7fb956f1d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9500c8580 0x7fb950153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:48.401 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.409+0000 7fb956f1d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9501531a0 0x7fb9501540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:48.401 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.409+0000 7fb956f1d700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9501e26f0 con 0x7fb950071840 2023-07-29T02:00:48.401 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.409+0000 7fb956f1d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9501e31f0 con 0x7fb9501531a0 2023-07-29T02:00:48.401 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.409+0000 7fb956f1d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95014b7d0 con 0x7fb9500c8580 2023-07-29T02:00:48.402 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.409+0000 7fb954cb9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb950071840 0x7fb95014ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:48.402 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.409+0000 7fb954cb9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb950071840 0x7fb95014ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57158/0 (socket says 172.21.15.42:57158) 2023-07-29T02:00:48.402 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.409+0000 7fb954cb9700 1 -- 172.21.15.42:0/1199216786 learned_addr learned my addr 172.21.15.42:0/1199216786 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:48.402 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.410+0000 7fb94ffff700 1 --2- 172.21.15.42:0/1199216786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9500c8580 0x7fb950153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:48.402 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.410+0000 7fb9554ba700 1 --2- 172.21.15.42:0/1199216786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9501531a0 0x7fb9501540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:48.402 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.410+0000 7fb954cb9700 1 -- 172.21.15.42:0/1199216786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9500c8580 msgr2=0x7fb950153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:48.402 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.410+0000 7fb954cb9700 1 --2- 172.21.15.42:0/1199216786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9500c8580 0x7fb950153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.403 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.410+0000 7fb954cb9700 1 -- 172.21.15.42:0/1199216786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9501531a0 msgr2=0x7fb9501540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:48.403 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.410+0000 7fb954cb9700 1 --2- 172.21.15.42:0/1199216786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9501531a0 0x7fb9501540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.403 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.410+0000 7fb954cb9700 1 -- 172.21.15.42:0/1199216786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c0094a0 con 0x7fb950071840 2023-07-29T02:00:48.403 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.410+0000 7fb9554ba700 1 --2- 172.21.15.42:0/1199216786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9501531a0 0x7fb9501540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:48.403 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.410+0000 7fb94ffff700 1 --2- 172.21.15.42:0/1199216786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9500c8580 0x7fb950153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:48.403 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.410+0000 7fb954cb9700 1 --2- 172.21.15.42:0/1199216786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb950071840 0x7fb95014ab60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb94400e840 tx=0x7fb94400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:48.403 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.410+0000 7fb94d7fa700 1 -- 172.21.15.42:0/1199216786 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94400c020 con 0x7fb950071840 2023-07-29T02:00:48.403 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.410+0000 7fb94d7fa700 1 -- 172.21.15.42:0/1199216786 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb944004250 con 0x7fb950071840 2023-07-29T02:00:48.404 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.410+0000 7fb956f1d700 1 -- 172.21.15.42:0/1199216786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9501e33e0 con 0x7fb950071840 2023-07-29T02:00:48.404 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.410+0000 7fb94d7fa700 1 -- 172.21.15.42:0/1199216786 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9440036a0 con 0x7fb950071840 2023-07-29T02:00:48.404 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.410+0000 7fb956f1d700 1 -- 172.21.15.42:0/1199216786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9501e39a0 con 0x7fb950071840 2023-07-29T02:00:48.404 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.411+0000 7fb956f1d700 1 -- 172.21.15.42:0/1199216786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb95004ea50 con 0x7fb950071840 2023-07-29T02:00:48.404 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.411+0000 7fb94d7fa700 1 -- 172.21.15.42:0/1199216786 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fb944003800 con 0x7fb950071840 2023-07-29T02:00:48.404 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.412+0000 7fb94d7fa700 1 --2- 172.21.15.42:0/1199216786 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb93406a690 0x7fb93406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:48.404 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.412+0000 7fb94d7fa700 1 -- 172.21.15.42:0/1199216786 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6850+0+0 (secure 0 0 0) 0x7fb944088a90 con 0x7fb950071840 2023-07-29T02:00:48.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.412+0000 7fb94ffff700 1 --2- 172.21.15.42:0/1199216786 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb93406a690 0x7fb93406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:48.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.412+0000 7fb94ffff700 1 --2- 172.21.15.42:0/1199216786 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb93406a690 0x7fb93406cb40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb9500caf80 tx=0x7fb93c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:48.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.416+0000 7fb94d7fa700 1 -- 172.21.15.42:0/1199216786 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fb944057570 con 0x7fb950071840 2023-07-29T02:00:48.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.616+0000 7fb956f1d700 1 -- 172.21.15.42:0/1199216786 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb9501537c0 con 0x7fb950071840 2023-07-29T02:00:48.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.616+0000 7fb94d7fa700 1 -- 172.21.15.42:0/1199216786 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb944057100 con 0x7fb950071840 2023-07-29T02:00:48.604 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 8 2023-07-29T02:00:48.605 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.618+0000 7fb956f1d700 1 -- 172.21.15.42:0/1199216786 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb93406a690 msgr2=0x7fb93406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:48.605 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.618+0000 7fb956f1d700 1 --2- 172.21.15.42:0/1199216786 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb93406a690 0x7fb93406cb40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb9500caf80 tx=0x7fb93c008030 comp rx=0 tx=0).stop 2023-07-29T02:00:48.605 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.618+0000 7fb956f1d700 1 -- 172.21.15.42:0/1199216786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb950071840 msgr2=0x7fb95014ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:48.606 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.618+0000 7fb956f1d700 1 --2- 172.21.15.42:0/1199216786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb950071840 0x7fb95014ab60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb94400e840 tx=0x7fb94400ec00 comp rx=0 tx=0).stop 2023-07-29T02:00:48.606 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.618+0000 7fb956f1d700 1 -- 172.21.15.42:0/1199216786 shutdown_connections 2023-07-29T02:00:48.606 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.618+0000 7fb956f1d700 1 --2- 172.21.15.42:0/1199216786 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb93406a690 0x7fb93406cb40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.606 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.618+0000 7fb956f1d700 1 --2- 172.21.15.42:0/1199216786 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9501531a0 0x7fb9501540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.606 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.618+0000 7fb956f1d700 1 --2- 172.21.15.42:0/1199216786 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb950071840 0x7fb95014ab60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.606 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.618+0000 7fb956f1d700 1 --2- 172.21.15.42:0/1199216786 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb9500c8580 0x7fb950153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.606 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.618+0000 7fb956f1d700 1 -- 172.21.15.42:0/1199216786 >> 172.21.15.42:0/1199216786 conn(0x7fb9500cbf10 msgr2=0x7fb95015c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:48.607 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.618+0000 7fb956f1d700 1 -- 172.21.15.42:0/1199216786 shutdown_connections 2023-07-29T02:00:48.607 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.618+0000 7fb956f1d700 1 -- 172.21.15.42:0/1199216786 wait complete. 2023-07-29T02:00:48.617 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-29T02:00:48.745 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.758+0000 7ff45a5ec700 1 Processor -- start 2023-07-29T02:00:48.745 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.758+0000 7ff45a5ec700 1 -- start start 2023-07-29T02:00:48.747 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.759+0000 7ff45a5ec700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4541531a0 0x7ff45406f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:48.747 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.759+0000 7ff45a5ec700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45406c870 con 0x7ff4540c8580 2023-07-29T02:00:48.747 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.759+0000 7ff45a5ec700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff45406fa50 con 0x7ff454071840 2023-07-29T02:00:48.747 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.759+0000 7ff45a5ec700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4540c74a0 con 0x7ff4541531a0 2023-07-29T02:00:48.748 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.759+0000 7ff4537fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff4540c8580 0x7ff45415c4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50970/0 (socket says 172.21.15.42:50970) 2023-07-29T02:00:48.748 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.759+0000 7ff4537fe700 1 -- 172.21.15.42:0/1333880929 learned_addr learned my addr 172.21.15.42:0/1333880929 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:48.748 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.759+0000 7ff453fff700 1 --2- 172.21.15.42:0/1333880929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4541531a0 0x7ff45406f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:48.748 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.759+0000 7ff452ffd700 1 -- 172.21.15.42:0/1333880929 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166220903 0 0) 0x7ff45406c870 con 0x7ff4540c8580 2023-07-29T02:00:48.748 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.759+0000 7ff452ffd700 1 -- 172.21.15.42:0/1333880929 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4400035b0 con 0x7ff4540c8580 2023-07-29T02:00:48.748 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.759+0000 7ff452ffd700 1 -- 172.21.15.42:0/1333880929 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2715982485 0 0) 0x7ff45406fa50 con 0x7ff454071840 2023-07-29T02:00:48.748 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.759+0000 7ff452ffd700 1 -- 172.21.15.42:0/1333880929 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff45406c870 con 0x7ff454071840 2023-07-29T02:00:48.749 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.760+0000 7ff453fff700 1 -- 172.21.15.42:0/1333880929 >> v1:172.21.15.144:6789/0 conn(0x7ff454071840 legacy=0x7ff45406a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:48.749 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.760+0000 7ff452ffd700 1 -- 172.21.15.42:0/1333880929 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3190153516 0 0) 0x7ff4400035b0 con 0x7ff4540c8580 2023-07-29T02:00:48.749 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.760+0000 7ff453fff700 1 -- 172.21.15.42:0/1333880929 >> v1:172.21.15.42:6789/0 conn(0x7ff4540c8580 legacy=0x7ff45415c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:48.749 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.760+0000 7ff453fff700 1 -- 172.21.15.42:0/1333880929 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45406d450 con 0x7ff4541531a0 2023-07-29T02:00:48.749 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.760+0000 7ff453fff700 1 --2- 172.21.15.42:0/1333880929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4541531a0 0x7ff45406f510 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff444009870 tx=0x7ff444009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4fbc086a44d4136 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:48.749 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.760+0000 7ff452ffd700 1 -- 172.21.15.42:0/1333880929 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43c001670 con 0x7ff4541531a0 2023-07-29T02:00:48.749 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.760+0000 7ff452ffd700 1 -- 172.21.15.42:0/1333880929 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff444004030 con 0x7ff4541531a0 2023-07-29T02:00:48.749 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.760+0000 7ff452ffd700 1 -- 172.21.15.42:0/1333880929 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4440043c0 con 0x7ff4541531a0 2023-07-29T02:00:48.752 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.760+0000 7ff45a5ec700 1 -- 172.21.15.42:0/1333880929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4541531a0 msgr2=0x7ff45406f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:48.752 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.760+0000 7ff45a5ec700 1 --2- 172.21.15.42:0/1333880929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4541531a0 0x7ff45406f510 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff444009870 tx=0x7ff444009b80 comp rx=0 tx=0).stop 2023-07-29T02:00:48.756 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.761+0000 7ff45a5ec700 1 -- 172.21.15.42:0/1333880929 shutdown_connections 2023-07-29T02:00:48.756 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.761+0000 7ff45a5ec700 1 --2- 172.21.15.42:0/1333880929 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4541531a0 0x7ff45406f510 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.757 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.761+0000 7ff45a5ec700 1 -- 172.21.15.42:0/1333880929 >> 172.21.15.42:0/1333880929 conn(0x7ff4540cbf10 msgr2=0x7ff4540cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:48.757 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.761+0000 7ff45a5ec700 1 -- 172.21.15.42:0/1333880929 shutdown_connections 2023-07-29T02:00:48.757 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.761+0000 7ff45a5ec700 1 -- 172.21.15.42:0/1333880929 wait complete. 2023-07-29T02:00:48.757 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.762+0000 7ff45a5ec700 1 Processor -- start 2023-07-29T02:00:48.757 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.762+0000 7ff45a5ec700 1 -- start start 2023-07-29T02:00:48.757 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff45a5ec700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff454071840 0x7ff454156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:48.757 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff45a5ec700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4540c8580 0x7ff4541585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:48.758 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff45a5ec700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4541531a0 0x7ff45414e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:48.758 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff45a5ec700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff454149910 con 0x7ff4541531a0 2023-07-29T02:00:48.758 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff45a5ec700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4541ef4f0 con 0x7ff454071840 2023-07-29T02:00:48.758 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff45a5ec700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45414d2e0 con 0x7ff4540c8580 2023-07-29T02:00:48.758 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff458b89700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4541531a0 0x7ff45414e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:48.758 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff458b89700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4541531a0 0x7ff45414e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57172/0 (socket says 172.21.15.42:57172) 2023-07-29T02:00:48.759 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff458b89700 1 -- 172.21.15.42:0/1046295366 learned_addr learned my addr 172.21.15.42:0/1046295366 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:48.759 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff4537fe700 1 --2- 172.21.15.42:0/1046295366 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4540c8580 0x7ff4541585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:48.759 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff453fff700 1 --2- 172.21.15.42:0/1046295366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff454071840 0x7ff454156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:48.759 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff458b89700 1 -- 172.21.15.42:0/1046295366 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4540c8580 msgr2=0x7ff4541585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:48.759 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff458b89700 1 --2- 172.21.15.42:0/1046295366 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4540c8580 0x7ff4541585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.759 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff458b89700 1 -- 172.21.15.42:0/1046295366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff454071840 msgr2=0x7ff454156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:48.760 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff458b89700 1 --2- 172.21.15.42:0/1046295366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff454071840 0x7ff454156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.760 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff458b89700 1 -- 172.21.15.42:0/1046295366 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4440094a0 con 0x7ff4541531a0 2023-07-29T02:00:48.760 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff453fff700 1 --2- 172.21.15.42:0/1046295366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff454071840 0x7ff454156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:48.760 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff458b89700 1 --2- 172.21.15.42:0/1046295366 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4541531a0 0x7ff45414e670 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00cc50 tx=0x7ff44c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:48.760 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff450ff9700 1 -- 172.21.15.42:0/1046295366 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c003c00 con 0x7ff4541531a0 2023-07-29T02:00:48.760 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff450ff9700 1 -- 172.21.15.42:0/1046295366 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44c003d60 con 0x7ff4541531a0 2023-07-29T02:00:48.760 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff45a5ec700 1 -- 172.21.15.42:0/1046295366 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4541511c0 con 0x7ff4541531a0 2023-07-29T02:00:48.761 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.763+0000 7ff450ff9700 1 -- 172.21.15.42:0/1046295366 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44c00ab80 con 0x7ff4541531a0 2023-07-29T02:00:48.761 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.764+0000 7ff45a5ec700 1 -- 172.21.15.42:0/1046295366 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff454151480 con 0x7ff4541531a0 2023-07-29T02:00:48.761 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.764+0000 7ff45a5ec700 1 -- 172.21.15.42:0/1046295366 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45414d450 con 0x7ff4541531a0 2023-07-29T02:00:48.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.765+0000 7ff450ff9700 1 -- 172.21.15.42:0/1046295366 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7ff44c00ace0 con 0x7ff4541531a0 2023-07-29T02:00:48.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.765+0000 7ff450ff9700 1 --2- 172.21.15.42:0/1046295366 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff43406a660 0x7ff43406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:48.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.765+0000 7ff450ff9700 1 -- 172.21.15.42:0/1046295366 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6850+0+0 (secure 0 0 0) 0x7ff44c088ef0 con 0x7ff4541531a0 2023-07-29T02:00:48.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.766+0000 7ff453fff700 1 --2- 172.21.15.42:0/1046295366 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff43406a660 0x7ff43406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:48.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.766+0000 7ff453fff700 1 --2- 172.21.15.42:0/1046295366 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff43406a660 0x7ff43406cb10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff4440090b0 tx=0x7ff444013040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:48.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.770+0000 7ff450ff9700 1 -- 172.21.15.42:0/1046295366 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7ff44c053fd0 con 0x7ff4541531a0 2023-07-29T02:00:48.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.965+0000 7ff45a5ec700 1 -- 172.21.15.42:0/1046295366 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff45404ea50 con 0x7ff4541531a0 2023-07-29T02:00:48.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.966+0000 7ff450ff9700 1 -- 172.21.15.42:0/1046295366 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff44c0575f0 con 0x7ff4541531a0 2023-07-29T02:00:48.954 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2023-07-29T02:00:48.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.968+0000 7ff45a5ec700 1 -- 172.21.15.42:0/1046295366 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff43406a660 msgr2=0x7ff43406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:48.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.968+0000 7ff45a5ec700 1 --2- 172.21.15.42:0/1046295366 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff43406a660 0x7ff43406cb10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff4440090b0 tx=0x7ff444013040 comp rx=0 tx=0).stop 2023-07-29T02:00:48.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.968+0000 7ff45a5ec700 1 -- 172.21.15.42:0/1046295366 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4541531a0 msgr2=0x7ff45414e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:48.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.968+0000 7ff45a5ec700 1 --2- 172.21.15.42:0/1046295366 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4541531a0 0x7ff45414e670 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00cc50 tx=0x7ff44c00cf60 comp rx=0 tx=0).stop 2023-07-29T02:00:48.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.968+0000 7ff45a5ec700 1 -- 172.21.15.42:0/1046295366 shutdown_connections 2023-07-29T02:00:48.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.968+0000 7ff45a5ec700 1 --2- 172.21.15.42:0/1046295366 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff43406a660 0x7ff43406cb10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.968+0000 7ff45a5ec700 1 --2- 172.21.15.42:0/1046295366 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff4541531a0 0x7ff45414e670 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.968+0000 7ff45a5ec700 1 --2- 172.21.15.42:0/1046295366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff454071840 0x7ff454156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.968+0000 7ff45a5ec700 1 --2- 172.21.15.42:0/1046295366 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff4540c8580 0x7ff4541585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:48.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.968+0000 7ff45a5ec700 1 -- 172.21.15.42:0/1046295366 >> 172.21.15.42:0/1046295366 conn(0x7ff4540cbf10 msgr2=0x7ff4540c89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:48.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.968+0000 7ff45a5ec700 1 -- 172.21.15.42:0/1046295366 shutdown_connections 2023-07-29T02:00:48.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:48.968+0000 7ff45a5ec700 1 -- 172.21.15.42:0/1046295366 wait complete. 2023-07-29T02:00:48.967 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-29T02:00:49.095 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.108+0000 7f07d13cc700 1 Processor -- start 2023-07-29T02:00:49.096 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.108+0000 7f07d13cc700 1 -- start start 2023-07-29T02:00:49.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.109+0000 7f07d13cc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07cc1532e0 0x7f07cc0cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:49.101 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.109+0000 7f07d13cc700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07cc0c68f0 con 0x7f07cc1597b0 2023-07-29T02:00:49.102 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.109+0000 7f07d13cc700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07cc1536b0 con 0x7f07cc0c9bd0 2023-07-29T02:00:49.102 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.109+0000 7f07d13cc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc0cb2e0 con 0x7f07cc1532e0 2023-07-29T02:00:49.102 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.109+0000 7f07cb7fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f07cc1597b0 0x7f07cc1638b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:50984/0 (socket says 172.21.15.42:50984) 2023-07-29T02:00:49.102 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.109+0000 7f07cb7fe700 1 -- 172.21.15.42:0/1266384912 learned_addr learned my addr 172.21.15.42:0/1266384912 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:49.102 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.109+0000 7f07caffd700 1 --2- 172.21.15.42:0/1266384912 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07cc1532e0 0x7f07cc0cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:49.102 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.109+0000 7f07c9ffb700 1 -- 172.21.15.42:0/1266384912 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205602738 0 0) 0x7f07cc0c68f0 con 0x7f07cc1597b0 2023-07-29T02:00:49.102 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.109+0000 7f07c9ffb700 1 -- 172.21.15.42:0/1266384912 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07b40035b0 con 0x7f07cc1597b0 2023-07-29T02:00:49.103 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.109+0000 7f07c9ffb700 1 -- 172.21.15.42:0/1266384912 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044765788 0 0) 0x7f07cc1536b0 con 0x7f07cc0c9bd0 2023-07-29T02:00:49.103 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.109+0000 7f07c9ffb700 1 -- 172.21.15.42:0/1266384912 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07cc0c68f0 con 0x7f07cc0c9bd0 2023-07-29T02:00:49.103 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.109+0000 7f07c9ffb700 1 -- 172.21.15.42:0/1266384912 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3036969577 0 0) 0x7f07b40035b0 con 0x7f07cc1597b0 2023-07-29T02:00:49.103 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.109+0000 7f07c9ffb700 1 -- 172.21.15.42:0/1266384912 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07cc1532e0 msgr2=0x7f07cc0cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:49.103 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.109+0000 7f07c9ffb700 1 --2- 172.21.15.42:0/1266384912 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07cc1532e0 0x7f07cc0cf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.103 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.109+0000 7f07c9ffb700 1 -- 172.21.15.42:0/1266384912 >> v1:172.21.15.144:6789/0 conn(0x7f07cc0c9bd0 legacy=0x7f07cc1590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:49.103 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.109+0000 7f07c9ffb700 1 -- 172.21.15.42:0/1266384912 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07cc0ca130 con 0x7f07cc1597b0 2023-07-29T02:00:49.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.109+0000 7f07c9ffb700 1 -- 172.21.15.42:0/1266384912 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7f07c40019f0 con 0x7f07cc1597b0 2023-07-29T02:00:49.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.110+0000 7f07caffd700 1 --2- 172.21.15.42:0/1266384912 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07cc1532e0 0x7f07cc0cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:00:49.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.110+0000 7f07c9ffb700 1 -- 172.21.15.42:0/1266384912 >> v1:172.21.15.42:6789/0 conn(0x7f07cc1597b0 legacy=0x7f07cc1638b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:49.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.110+0000 7f07c9ffb700 1 --2- 172.21.15.42:0/1266384912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4003bc0 0x7f07b4003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:49.104 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.110+0000 7f07c9ffb700 1 --2- 172.21.15.42:0/1266384912 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07cc1532e0 0x7f07b4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:49.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.110+0000 7f07c9ffb700 1 --2- 172.21.15.42:0/1266384912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07b4004d90 0x7f07b4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:49.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.110+0000 7f07c9ffb700 1 -- 172.21.15.42:0/1266384912 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc0cb2e0 con 0x7f07b4003bc0 2023-07-29T02:00:49.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.110+0000 7f07c9ffb700 1 -- 172.21.15.42:0/1266384912 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b400bac0 con 0x7f07b4004d90 2023-07-29T02:00:49.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.110+0000 7f07c9ffb700 1 -- 172.21.15.42:0/1266384912 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b400bc30 con 0x7f07cc1532e0 2023-07-29T02:00:49.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.110+0000 7f07caffd700 1 --2- 172.21.15.42:0/1266384912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4003bc0 0x7f07b4003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:49.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.110+0000 7f07cb7fe700 1 --2- 172.21.15.42:0/1266384912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07b4004d90 0x7f07b4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:49.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.110+0000 7f07ca7fc700 1 --2- 172.21.15.42:0/1266384912 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07cc1532e0 0x7f07b4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:49.105 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.110+0000 7f07caffd700 1 -- 172.21.15.42:0/1266384912 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07cc1532e0 msgr2=0x7f07b4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:49.106 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.110+0000 7f07caffd700 1 --2- 172.21.15.42:0/1266384912 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07cc1532e0 0x7f07b4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.106 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.110+0000 7f07caffd700 1 -- 172.21.15.42:0/1266384912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07b4004d90 msgr2=0x7f07b4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:49.106 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.110+0000 7f07caffd700 1 --2- 172.21.15.42:0/1266384912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07b4004d90 0x7f07b4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.106 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.110+0000 7f07caffd700 1 -- 172.21.15.42:0/1266384912 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c00094a0 con 0x7f07b4003bc0 2023-07-29T02:00:49.106 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.110+0000 7f07caffd700 1 --2- 172.21.15.42:0/1266384912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4003bc0 0x7f07b4003fb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f07c0009d30 tx=0x7f07b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ead8f5ece89c1a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:49.106 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.110+0000 7f07c9ffb700 1 -- 172.21.15.42:0/1266384912 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c0009e80 con 0x7f07b4003bc0 2023-07-29T02:00:49.106 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.110+0000 7f07c9ffb700 1 -- 172.21.15.42:0/1266384912 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c000e940 con 0x7f07b4003bc0 2023-07-29T02:00:49.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.110+0000 7f07c9ffb700 1 -- 172.21.15.42:0/1266384912 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c000ecb0 con 0x7f07b4003bc0 2023-07-29T02:00:49.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.111+0000 7f07d13cc700 1 -- 172.21.15.42:0/1266384912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4003bc0 msgr2=0x7f07b4003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:49.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.111+0000 7f07d13cc700 1 --2- 172.21.15.42:0/1266384912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4003bc0 0x7f07b4003fb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f07c0009d30 tx=0x7f07b4005880 comp rx=0 tx=0).stop 2023-07-29T02:00:49.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.111+0000 7f07cb7fe700 1 -- 172.21.15.42:0/1266384912 reap_dead start 2023-07-29T02:00:49.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.111+0000 7f07d13cc700 1 -- 172.21.15.42:0/1266384912 shutdown_connections 2023-07-29T02:00:49.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.111+0000 7f07d13cc700 1 -- 172.21.15.42:0/1266384912 >> 172.21.15.42:0/1266384912 conn(0x7f07cc061190 msgr2=0x7f07cc061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:49.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.111+0000 7f07d13cc700 1 -- 172.21.15.42:0/1266384912 shutdown_connections 2023-07-29T02:00:49.107 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.111+0000 7f07d13cc700 1 -- 172.21.15.42:0/1266384912 wait complete. 2023-07-29T02:00:49.108 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.112+0000 7f07d13cc700 1 Processor -- start 2023-07-29T02:00:49.108 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.112+0000 7f07d13cc700 1 -- start start 2023-07-29T02:00:49.108 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.113+0000 7f07d13cc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4003bc0 0x7f07cc0c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:49.108 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.113+0000 7f07d13cc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07cc0c8c50 0x7f07cc14f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:49.108 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.113+0000 7f07d13cc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07cc0c84b0 0x7f07cc14fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:49.109 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.113+0000 7f07d13cc700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc1f2e50 con 0x7f07b4003bc0 2023-07-29T02:00:49.109 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.113+0000 7f07d13cc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc1efdd0 con 0x7f07cc0c84b0 2023-07-29T02:00:49.109 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.113+0000 7f07d13cc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc0c7520 con 0x7f07cc0c8c50 2023-07-29T02:00:49.109 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.113+0000 7f07caffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4003bc0 0x7f07cc0c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:49.109 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.113+0000 7f07caffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4003bc0 0x7f07cc0c7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57188/0 (socket says 172.21.15.42:57188) 2023-07-29T02:00:49.109 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.113+0000 7f07caffd700 1 -- 172.21.15.42:0/259005799 learned_addr learned my addr 172.21.15.42:0/259005799 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:49.109 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.113+0000 7f07ca7fc700 1 --2- 172.21.15.42:0/259005799 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07cc0c8c50 0x7f07cc14f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:49.110 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.113+0000 7f07cb7fe700 1 --2- 172.21.15.42:0/259005799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07cc0c84b0 0x7f07cc14fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:49.110 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.113+0000 7f07caffd700 1 -- 172.21.15.42:0/259005799 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07cc0c8c50 msgr2=0x7f07cc14f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:49.110 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.113+0000 7f07caffd700 1 --2- 172.21.15.42:0/259005799 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07cc0c8c50 0x7f07cc14f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.110 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.113+0000 7f07caffd700 1 -- 172.21.15.42:0/259005799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07cc0c84b0 msgr2=0x7f07cc14fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:49.110 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.113+0000 7f07caffd700 1 --2- 172.21.15.42:0/259005799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07cc0c84b0 0x7f07cc14fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.110 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.113+0000 7f07caffd700 1 -- 172.21.15.42:0/259005799 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07cc0c7ae0 con 0x7f07b4003bc0 2023-07-29T02:00:49.111 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.113+0000 7f07caffd700 1 --2- 172.21.15.42:0/259005799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4003bc0 0x7f07cc0c7f70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f07b40047d0 tx=0x7f07c00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:49.111 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.114+0000 7f07b37fe700 1 -- 172.21.15.42:0/259005799 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c0003ab0 con 0x7f07b4003bc0 2023-07-29T02:00:49.111 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.114+0000 7f07b37fe700 1 -- 172.21.15.42:0/259005799 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07c0003c30 con 0x7f07b4003bc0 2023-07-29T02:00:49.111 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.114+0000 7f07b37fe700 1 -- 172.21.15.42:0/259005799 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07c000feb0 con 0x7f07b4003bc0 2023-07-29T02:00:49.112 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.114+0000 7f07d13cc700 1 -- 172.21.15.42:0/259005799 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07cc0b24c0 con 0x7f07b4003bc0 2023-07-29T02:00:49.112 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.114+0000 7f07d13cc700 1 -- 172.21.15.42:0/259005799 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07cc0c7770 con 0x7f07b4003bc0 2023-07-29T02:00:49.113 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.115+0000 7f07d13cc700 1 -- 172.21.15.42:0/259005799 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07cc0b29e0 con 0x7f07b4003bc0 2023-07-29T02:00:49.114 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.115+0000 7f07b37fe700 1 -- 172.21.15.42:0/259005799 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f07c0013470 con 0x7f07b4003bc0 2023-07-29T02:00:49.114 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.116+0000 7f07b37fe700 1 --2- 172.21.15.42:0/259005799 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f07b806a650 0x7f07b806cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:49.114 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.116+0000 7f07b37fe700 1 -- 172.21.15.42:0/259005799 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6850+0+0 (secure 0 0 0) 0x7f07c008a760 con 0x7f07b4003bc0 2023-07-29T02:00:49.115 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.116+0000 7f07ca7fc700 1 --2- 172.21.15.42:0/259005799 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f07b806a650 0x7f07b806cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:49.115 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.116+0000 7f07ca7fc700 1 --2- 172.21.15.42:0/259005799 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f07b806a650 0x7f07b806cb00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f07cc0b5400 tx=0x7f07bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:49.115 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.120+0000 7f07b37fe700 1 -- 172.21.15.42:0/259005799 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f07c0059360 con 0x7f07b4003bc0 2023-07-29T02:00:49.306 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.319+0000 7f07d13cc700 1 -- 172.21.15.42:0/259005799 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f07cc0c7930 con 0x7f07b4003bc0 2023-07-29T02:00:49.307 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.320+0000 7f07b37fe700 1 -- 172.21.15.42:0/259005799 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f07c0058ef0 con 0x7f07b4003bc0 2023-07-29T02:00:49.307 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2023-07-29T02:00:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.322+0000 7f07d13cc700 1 -- 172.21.15.42:0/259005799 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f07b806a650 msgr2=0x7f07b806cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.322+0000 7f07d13cc700 1 --2- 172.21.15.42:0/259005799 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f07b806a650 0x7f07b806cb00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f07cc0b5400 tx=0x7f07bc009040 comp rx=0 tx=0).stop 2023-07-29T02:00:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.322+0000 7f07d13cc700 1 -- 172.21.15.42:0/259005799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4003bc0 msgr2=0x7f07cc0c7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:49.309 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.322+0000 7f07d13cc700 1 --2- 172.21.15.42:0/259005799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4003bc0 0x7f07cc0c7f70 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f07b40047d0 tx=0x7f07c00047c0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.310 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.322+0000 7f07d13cc700 1 -- 172.21.15.42:0/259005799 shutdown_connections 2023-07-29T02:00:49.310 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.322+0000 7f07d13cc700 1 --2- 172.21.15.42:0/259005799 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f07b806a650 0x7f07b806cb00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.310 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.322+0000 7f07d13cc700 1 --2- 172.21.15.42:0/259005799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07cc0c84b0 0x7f07cc14fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.310 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.322+0000 7f07d13cc700 1 --2- 172.21.15.42:0/259005799 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f07b4003bc0 0x7f07cc0c7f70 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.310 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.322+0000 7f07d13cc700 1 --2- 172.21.15.42:0/259005799 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f07cc0c8c50 0x7f07cc14f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.310 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.322+0000 7f07d13cc700 1 -- 172.21.15.42:0/259005799 >> 172.21.15.42:0/259005799 conn(0x7f07cc061190 msgr2=0x7f07cc1575f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:49.310 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.322+0000 7f07d13cc700 1 -- 172.21.15.42:0/259005799 shutdown_connections 2023-07-29T02:00:49.311 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.322+0000 7f07d13cc700 1 -- 172.21.15.42:0/259005799 wait complete. 2023-07-29T02:00:49.321 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-29T02:00:49.450 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.463+0000 7f3e292f6700 1 Processor -- start 2023-07-29T02:00:49.450 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.463+0000 7f3e292f6700 1 -- start start 2023-07-29T02:00:49.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.464+0000 7f3e292f6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e241532e0 0x7f3e240cf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:49.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.464+0000 7f3e292f6700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3e241597b0 0x7f3e240cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:49.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.464+0000 7f3e292f6700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e240c68f0 con 0x7f3e240c9bd0 2023-07-29T02:00:49.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.464+0000 7f3e292f6700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e240cb2e0 con 0x7f3e241597b0 2023-07-29T02:00:49.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.464+0000 7f3e292f6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e241536b0 con 0x7f3e241532e0 2023-07-29T02:00:49.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.464+0000 7f3e237fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3e241597b0 0x7f3e240cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:49.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.464+0000 7f3e227fc700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f3e240c9bd0 0x7f3e241590a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51000/0 (socket says 172.21.15.42:51000) 2023-07-29T02:00:49.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.464+0000 7f3e227fc700 1 -- 172.21.15.42:0/1485517305 learned_addr learned my addr 172.21.15.42:0/1485517305 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:00:49.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.464+0000 7f3e22ffd700 1 --2- 172.21.15.42:0/1485517305 >> v2:172.21.15.144:3300/0 conn(0x7f3e241532e0 0x7f3e240cf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:49.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.464+0000 7f3e237fe700 1 -- 172.21.15.42:0/1485517305 >> v2:172.21.15.144:3300/0 conn(0x7f3e241532e0 msgr2=0x7f3e240cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:49.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.464+0000 7f3e237fe700 1 --2- 172.21.15.42:0/1485517305 >> v2:172.21.15.144:3300/0 conn(0x7f3e241532e0 0x7f3e240cf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.464+0000 7f3e237fe700 1 -- 172.21.15.42:0/1485517305 >> v1:172.21.15.42:6789/0 conn(0x7f3e240c9bd0 legacy=0x7f3e241590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:49.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.464+0000 7f3e237fe700 1 -- 172.21.15.42:0/1485517305 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e240ca130 con 0x7f3e241597b0 2023-07-29T02:00:49.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.464+0000 7f3e21ffb700 1 -- 172.21.15.42:0/1485517305 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808796169 0 0) 0x7f3e240c68f0 con 0x7f3e240c9bd0 2023-07-29T02:00:49.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.464+0000 7f3e22ffd700 1 --2- 172.21.15.42:0/1485517305 >> v2:172.21.15.144:3300/0 conn(0x7f3e241532e0 0x7f3e240cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:49.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.464+0000 7f3e237fe700 1 --2- 172.21.15.42:0/1485517305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e241597b0 0x7f3e240cf700 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3e2408d020 tx=0x7f3e1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f108959113c074 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:49.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.464+0000 7f3e21ffb700 1 -- 172.21.15.42:0/1485517305 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c00e070 con 0x7f3e241597b0 2023-07-29T02:00:49.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.465+0000 7f3e21ffb700 1 -- 172.21.15.42:0/1485517305 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c00bbd0 con 0x7f3e241597b0 2023-07-29T02:00:49.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.465+0000 7f3e21ffb700 1 -- 172.21.15.42:0/1485517305 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c012430 con 0x7f3e241597b0 2023-07-29T02:00:49.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.465+0000 7f3e292f6700 1 -- 172.21.15.42:0/1485517305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e241597b0 msgr2=0x7f3e240cf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:49.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.465+0000 7f3e292f6700 1 --2- 172.21.15.42:0/1485517305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e241597b0 0x7f3e240cf700 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3e2408d020 tx=0x7f3e1c00b330 comp rx=0 tx=0).stop 2023-07-29T02:00:49.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.465+0000 7f3e292f6700 1 -- 172.21.15.42:0/1485517305 shutdown_connections 2023-07-29T02:00:49.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.465+0000 7f3e292f6700 1 --2- 172.21.15.42:0/1485517305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e241597b0 0x7f3e240cf700 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.465+0000 7f3e292f6700 1 --2- 172.21.15.42:0/1485517305 >> v2:172.21.15.144:3300/0 conn(0x7f3e241532e0 0x7f3e240cf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.465+0000 7f3e292f6700 1 -- 172.21.15.42:0/1485517305 >> 172.21.15.42:0/1485517305 conn(0x7f3e24061190 msgr2=0x7f3e24061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:49.456 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.465+0000 7f3e292f6700 1 -- 172.21.15.42:0/1485517305 shutdown_connections 2023-07-29T02:00:49.456 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.465+0000 7f3e292f6700 1 -- 172.21.15.42:0/1485517305 wait complete. 2023-07-29T02:00:49.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.466+0000 7f3e292f6700 1 Processor -- start 2023-07-29T02:00:49.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.466+0000 7f3e292f6700 1 -- start start 2023-07-29T02:00:49.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.467+0000 7f3e292f6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e240c9bd0 0x7f3e241eea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:49.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.467+0000 7f3e292f6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e241532e0 0x7f3e241ef410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:49.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.467+0000 7f3e292f6700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e241597b0 0x7f3e2414ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:49.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.467+0000 7f3e292f6700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e241eef60 con 0x7f3e241597b0 2023-07-29T02:00:49.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.467+0000 7f3e292f6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240b3370 con 0x7f3e241532e0 2023-07-29T02:00:49.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.467+0000 7f3e292f6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e240b4a30 con 0x7f3e240c9bd0 2023-07-29T02:00:49.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.467+0000 7f3e237fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e241597b0 0x7f3e2414ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:49.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.467+0000 7f3e237fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e241597b0 0x7f3e2414ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57206/0 (socket says 172.21.15.42:57206) 2023-07-29T02:00:49.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.467+0000 7f3e237fe700 1 -- 172.21.15.42:0/1248944695 learned_addr learned my addr 172.21.15.42:0/1248944695 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:49.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.467+0000 7f3e227fc700 1 --2- 172.21.15.42:0/1248944695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e241532e0 0x7f3e241ef410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:49.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.467+0000 7f3e22ffd700 1 --2- 172.21.15.42:0/1248944695 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e240c9bd0 0x7f3e241eea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:49.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.468+0000 7f3e237fe700 1 -- 172.21.15.42:0/1248944695 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e240c9bd0 msgr2=0x7f3e241eea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:49.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.468+0000 7f3e237fe700 1 --2- 172.21.15.42:0/1248944695 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e240c9bd0 0x7f3e241eea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.468+0000 7f3e237fe700 1 -- 172.21.15.42:0/1248944695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e241532e0 msgr2=0x7f3e241ef410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:49.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.468+0000 7f3e237fe700 1 --2- 172.21.15.42:0/1248944695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e241532e0 0x7f3e241ef410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.468+0000 7f3e237fe700 1 -- 172.21.15.42:0/1248944695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c009a70 con 0x7f3e241597b0 2023-07-29T02:00:49.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.468+0000 7f3e22ffd700 1 --2- 172.21.15.42:0/1248944695 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e240c9bd0 0x7f3e241eea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:49.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.468+0000 7f3e227fc700 1 --2- 172.21.15.42:0/1248944695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e241532e0 0x7f3e241ef410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:49.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.468+0000 7f3e237fe700 1 --2- 172.21.15.42:0/1248944695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e241597b0 0x7f3e2414ff20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00b370 tx=0x7f3e1c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:49.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.468+0000 7f3e0b7fe700 1 -- 172.21.15.42:0/1248944695 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c012430 con 0x7f3e241597b0 2023-07-29T02:00:49.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.468+0000 7f3e0b7fe700 1 -- 172.21.15.42:0/1248944695 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c020070 con 0x7f3e241597b0 2023-07-29T02:00:49.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.468+0000 7f3e292f6700 1 -- 172.21.15.42:0/1248944695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e240b4d10 con 0x7f3e241597b0 2023-07-29T02:00:49.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.468+0000 7f3e0b7fe700 1 -- 172.21.15.42:0/1248944695 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c004280 con 0x7f3e241597b0 2023-07-29T02:00:49.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.468+0000 7f3e292f6700 1 -- 172.21.15.42:0/1248944695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e240b3910 con 0x7f3e241597b0 2023-07-29T02:00:49.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.469+0000 7f3e292f6700 1 -- 172.21.15.42:0/1248944695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e24151980 con 0x7f3e241597b0 2023-07-29T02:00:49.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.469+0000 7f3e0b7fe700 1 -- 172.21.15.42:0/1248944695 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f3e1c0043e0 con 0x7f3e241597b0 2023-07-29T02:00:49.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.470+0000 7f3e0b7fe700 1 --2- 172.21.15.42:0/1248944695 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3e1006a660 0x7f3e1006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:49.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.470+0000 7f3e0b7fe700 1 -- 172.21.15.42:0/1248944695 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6850+0+0 (secure 0 0 0) 0x7f3e1c022070 con 0x7f3e241597b0 2023-07-29T02:00:49.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.470+0000 7f3e22ffd700 1 --2- 172.21.15.42:0/1248944695 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3e1006a660 0x7f3e1006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:49.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.471+0000 7f3e22ffd700 1 --2- 172.21.15.42:0/1248944695 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3e1006a660 0x7f3e1006cb10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3e180089b0 tx=0x7f3e18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:49.463 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.475+0000 7f3e0b7fe700 1 -- 172.21.15.42:0/1248944695 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f3e1c0566d0 con 0x7f3e241597b0 2023-07-29T02:00:49.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.674+0000 7f3e292f6700 1 -- 172.21.15.42:0/1248944695 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3e2404ea50 con 0x7f3e241597b0 2023-07-29T02:00:49.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.675+0000 7f3e0b7fe700 1 -- 172.21.15.42:0/1248944695 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3e1c025380 con 0x7f3e241597b0 2023-07-29T02:00:49.662 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2023-07-29T02:00:49.664 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.677+0000 7f3e292f6700 1 -- 172.21.15.42:0/1248944695 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3e1006a660 msgr2=0x7f3e1006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:49.664 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.677+0000 7f3e292f6700 1 --2- 172.21.15.42:0/1248944695 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3e1006a660 0x7f3e1006cb10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3e180089b0 tx=0x7f3e18008040 comp rx=0 tx=0).stop 2023-07-29T02:00:49.664 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.677+0000 7f3e292f6700 1 -- 172.21.15.42:0/1248944695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e241597b0 msgr2=0x7f3e2414ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:49.664 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.677+0000 7f3e292f6700 1 --2- 172.21.15.42:0/1248944695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e241597b0 0x7f3e2414ff20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00b370 tx=0x7f3e1c004ad0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.677+0000 7f3e292f6700 1 -- 172.21.15.42:0/1248944695 shutdown_connections 2023-07-29T02:00:49.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.677+0000 7f3e292f6700 1 --2- 172.21.15.42:0/1248944695 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3e1006a660 0x7f3e1006cb10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.677+0000 7f3e292f6700 1 --2- 172.21.15.42:0/1248944695 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e241597b0 0x7f3e2414ff20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.677+0000 7f3e292f6700 1 --2- 172.21.15.42:0/1248944695 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e240c9bd0 0x7f3e241eea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.677+0000 7f3e292f6700 1 --2- 172.21.15.42:0/1248944695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e241532e0 0x7f3e241ef410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.677+0000 7f3e292f6700 1 -- 172.21.15.42:0/1248944695 >> 172.21.15.42:0/1248944695 conn(0x7f3e24061190 msgr2=0x7f3e240cc550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:49.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.677+0000 7f3e292f6700 1 -- 172.21.15.42:0/1248944695 shutdown_connections 2023-07-29T02:00:49.666 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.677+0000 7f3e292f6700 1 -- 172.21.15.42:0/1248944695 wait complete. 2023-07-29T02:00:49.676 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-29T02:00:49.803 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.816+0000 7fca9fed3700 1 Processor -- start 2023-07-29T02:00:49.804 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.816+0000 7fca9fed3700 1 -- start start 2023-07-29T02:00:49.807 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.817+0000 7fca9fed3700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fca9814fc20 0x7fca980c8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:49.807 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.817+0000 7fca9fed3700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fca9806b860 0x7fca9806bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:49.807 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.817+0000 7fca9fed3700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca980c91b0 con 0x7fca9814fff0 2023-07-29T02:00:49.807 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.817+0000 7fca9fed3700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca981592f0 con 0x7fca9806b860 2023-07-29T02:00:49.807 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.817+0000 7fca9fed3700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca981595d0 con 0x7fca9814fc20 2023-07-29T02:00:49.807 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.817+0000 7fca9e470700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fca9806b860 0x7fca9806bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:49.807 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.817+0000 7fca9e470700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fca9806b860 0x7fca9806bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57214/0 (socket says 172.21.15.42:57214) 2023-07-29T02:00:49.808 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.817+0000 7fca9e470700 1 -- 172.21.15.42:0/3352197663 learned_addr learned my addr 172.21.15.42:0/3352197663 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:49.808 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.817+0000 7fca9dc6f700 1 --2- 172.21.15.42:0/3352197663 >> v2:172.21.15.144:3300/0 conn(0x7fca9814fc20 0x7fca980c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:49.808 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.817+0000 7fca9e470700 1 -- 172.21.15.42:0/3352197663 >> v2:172.21.15.144:3300/0 conn(0x7fca9814fc20 msgr2=0x7fca980c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:49.808 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.817+0000 7fca9e470700 1 --2- 172.21.15.42:0/3352197663 >> v2:172.21.15.144:3300/0 conn(0x7fca9814fc20 0x7fca980c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.808 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.817+0000 7fca9e470700 1 -- 172.21.15.42:0/3352197663 >> v1:172.21.15.144:6789/0 conn(0x7fca9814fff0 legacy=0x7fca98070b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:49.808 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.817+0000 7fca9e470700 1 -- 172.21.15.42:0/3352197663 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca981598b0 con 0x7fca9806b860 2023-07-29T02:00:49.808 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.818+0000 7fca9e470700 1 --2- 172.21.15.42:0/3352197663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca9806b860 0x7fca9806bce0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fca9000d150 tx=0x7fca9000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05afa96888b3baf server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:49.809 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.818+0000 7fca9cc6d700 1 -- 172.21.15.42:0/3352197663 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca90010070 con 0x7fca9806b860 2023-07-29T02:00:49.809 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.818+0000 7fca9cc6d700 1 -- 172.21.15.42:0/3352197663 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9000dcd0 con 0x7fca9806b860 2023-07-29T02:00:49.809 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.818+0000 7fca9cc6d700 1 -- 172.21.15.42:0/3352197663 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9000b310 con 0x7fca9806b860 2023-07-29T02:00:49.809 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.818+0000 7fca9fed3700 1 -- 172.21.15.42:0/3352197663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca9806b860 msgr2=0x7fca9806bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:49.809 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.818+0000 7fca9fed3700 1 --2- 172.21.15.42:0/3352197663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca9806b860 0x7fca9806bce0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fca9000d150 tx=0x7fca9000d460 comp rx=0 tx=0).stop 2023-07-29T02:00:49.809 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.818+0000 7fca9fed3700 1 -- 172.21.15.42:0/3352197663 shutdown_connections 2023-07-29T02:00:49.809 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.818+0000 7fca9fed3700 1 --2- 172.21.15.42:0/3352197663 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca9806b860 0x7fca9806bce0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.810 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.818+0000 7fca9fed3700 1 --2- 172.21.15.42:0/3352197663 >> v2:172.21.15.144:3300/0 conn(0x7fca9814fc20 0x7fca980c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.810 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.818+0000 7fca9fed3700 1 -- 172.21.15.42:0/3352197663 >> 172.21.15.42:0/3352197663 conn(0x7fca980cc420 msgr2=0x7fca980c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:49.810 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.818+0000 7fca9fed3700 1 -- 172.21.15.42:0/3352197663 shutdown_connections 2023-07-29T02:00:49.810 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.818+0000 7fca9fed3700 1 -- 172.21.15.42:0/3352197663 wait complete. 2023-07-29T02:00:49.810 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.820+0000 7fca9fed3700 1 Processor -- start 2023-07-29T02:00:49.810 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.820+0000 7fca9fed3700 1 -- start start 2023-07-29T02:00:49.812 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.820+0000 7fca9fed3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca9806b860 0x7fca981540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:49.812 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.820+0000 7fca9fed3700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca9814fc20 0x7fca98158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:49.813 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.820+0000 7fca9fed3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca9814fff0 0x7fca981ead60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:49.813 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.820+0000 7fca9fed3700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca980cb2a0 con 0x7fca9814fc20 2023-07-29T02:00:49.813 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.820+0000 7fca9fed3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca980cb540 con 0x7fca9806b860 2023-07-29T02:00:49.813 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.820+0000 7fca9fed3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca98154ea0 con 0x7fca9814fff0 2023-07-29T02:00:49.813 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.820+0000 7fca9d46e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca9814fc20 0x7fca98158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:49.813 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.820+0000 7fca9d46e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca9814fc20 0x7fca98158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57218/0 (socket says 172.21.15.42:57218) 2023-07-29T02:00:49.813 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.820+0000 7fca9d46e700 1 -- 172.21.15.42:0/263855431 learned_addr learned my addr 172.21.15.42:0/263855431 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:49.814 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.821+0000 7fca9dc6f700 1 --2- 172.21.15.42:0/263855431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca9806b860 0x7fca981540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:49.814 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.821+0000 7fca9e470700 1 --2- 172.21.15.42:0/263855431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca9814fff0 0x7fca981ead60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:49.814 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.821+0000 7fca9d46e700 1 -- 172.21.15.42:0/263855431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca9814fff0 msgr2=0x7fca981ead60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:49.814 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.821+0000 7fca9d46e700 1 --2- 172.21.15.42:0/263855431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca9814fff0 0x7fca981ead60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.814 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.821+0000 7fca9d46e700 1 -- 172.21.15.42:0/263855431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca9806b860 msgr2=0x7fca981540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:49.814 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.821+0000 7fca9d46e700 1 --2- 172.21.15.42:0/263855431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca9806b860 0x7fca981540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:49.814 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.821+0000 7fca9d46e700 1 -- 172.21.15.42:0/263855431 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9000bd40 con 0x7fca9814fc20 2023-07-29T02:00:49.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.821+0000 7fca9d46e700 1 --2- 172.21.15.42:0/263855431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca9814fc20 0x7fca98158860 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fca9400c4e0 tx=0x7fca9400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:49.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.821+0000 7fca8e7fc700 1 -- 172.21.15.42:0/263855431 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca940052d0 con 0x7fca9814fc20 2023-07-29T02:00:49.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.821+0000 7fca8e7fc700 1 -- 172.21.15.42:0/263855431 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca94005430 con 0x7fca9814fc20 2023-07-29T02:00:49.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.821+0000 7fca8e7fc700 1 -- 172.21.15.42:0/263855431 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca940038c0 con 0x7fca9814fc20 2023-07-29T02:00:49.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.821+0000 7fca9fed3700 1 -- 172.21.15.42:0/263855431 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca98155180 con 0x7fca9814fc20 2023-07-29T02:00:49.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.821+0000 7fca9fed3700 1 -- 172.21.15.42:0/263855431 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca98155740 con 0x7fca9814fc20 2023-07-29T02:00:49.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.822+0000 7fca9fed3700 1 -- 172.21.15.42:0/263855431 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9804ea50 con 0x7fca9814fc20 2023-07-29T02:00:49.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.822+0000 7fca8e7fc700 1 -- 172.21.15.42:0/263855431 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fca94003a20 con 0x7fca9814fc20 2023-07-29T02:00:49.816 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.823+0000 7fca8e7fc700 1 --2- 172.21.15.42:0/263855431 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fca7c06a690 0x7fca7c06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:49.816 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.823+0000 7fca8e7fc700 1 -- 172.21.15.42:0/263855431 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6850+0+0 (secure 0 0 0) 0x7fca94088260 con 0x7fca9814fc20 2023-07-29T02:00:49.816 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.823+0000 7fca9dc6f700 1 --2- 172.21.15.42:0/263855431 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fca7c06a690 0x7fca7c06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:49.816 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.824+0000 7fca9dc6f700 1 --2- 172.21.15.42:0/263855431 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fca7c06a690 0x7fca7c06cb40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fca88009b70 tx=0x7fca88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:49.816 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:49.827+0000 7fca8e7fc700 1 -- 172.21.15.42:0/263855431 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fca940533d0 con 0x7fca9814fc20 2023-07-29T02:00:50.015 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.028+0000 7fca9fed3700 1 -- 172.21.15.42:0/263855431 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fca981559d0 con 0x7fca9814fc20 2023-07-29T02:00:50.016 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.029+0000 7fca8e7fc700 1 -- 172.21.15.42:0/263855431 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fca940569f0 con 0x7fca9814fc20 2023-07-29T02:00:50.016 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2023-07-29T02:00:50.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.031+0000 7fca9fed3700 1 -- 172.21.15.42:0/263855431 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fca7c06a690 msgr2=0x7fca7c06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:50.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.031+0000 7fca9fed3700 1 --2- 172.21.15.42:0/263855431 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fca7c06a690 0x7fca7c06cb40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fca88009b70 tx=0x7fca88008040 comp rx=0 tx=0).stop 2023-07-29T02:00:50.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.031+0000 7fca9fed3700 1 -- 172.21.15.42:0/263855431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca9814fc20 msgr2=0x7fca98158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:50.019 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.031+0000 7fca9fed3700 1 --2- 172.21.15.42:0/263855431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca9814fc20 0x7fca98158860 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fca9400c4e0 tx=0x7fca9400c8a0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.019 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.031+0000 7fca9fed3700 1 -- 172.21.15.42:0/263855431 shutdown_connections 2023-07-29T02:00:50.019 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.031+0000 7fca9fed3700 1 --2- 172.21.15.42:0/263855431 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fca7c06a690 0x7fca7c06cb40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.019 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.031+0000 7fca9fed3700 1 --2- 172.21.15.42:0/263855431 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fca9814fff0 0x7fca981ead60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.019 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.031+0000 7fca9fed3700 1 --2- 172.21.15.42:0/263855431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca9806b860 0x7fca981540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.019 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.031+0000 7fca9fed3700 1 --2- 172.21.15.42:0/263855431 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fca9814fc20 0x7fca98158860 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.019 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.031+0000 7fca9fed3700 1 -- 172.21.15.42:0/263855431 >> 172.21.15.42:0/263855431 conn(0x7fca980cc420 msgr2=0x7fca980c4300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:50.020 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.031+0000 7fca9fed3700 1 -- 172.21.15.42:0/263855431 shutdown_connections 2023-07-29T02:00:50.020 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.031+0000 7fca9fed3700 1 -- 172.21.15.42:0/263855431 wait complete. 2023-07-29T02:00:50.030 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:00:50.154 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.167+0000 7f3046388700 1 Processor -- start 2023-07-29T02:00:50.155 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.167+0000 7f3046388700 1 -- start start 2023-07-29T02:00:50.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.168+0000 7f3046388700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3040151400 0x7f30400c6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:50.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.168+0000 7f3046388700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f30400c5ee0 0x7f30400c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:50.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.168+0000 7f3046388700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3040157c70 con 0x7f3040151030 2023-07-29T02:00:50.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.168+0000 7f3046388700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30400c3c40 con 0x7f3040151400 2023-07-29T02:00:50.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.168+0000 7f3046388700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3040156e90 con 0x7f30400c5ee0 2023-07-29T02:00:50.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.168+0000 7f303f7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3040151400 0x7f30400c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:50.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.168+0000 7f303f7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3040151400 0x7f30400c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57224/0 (socket says 172.21.15.42:57224) 2023-07-29T02:00:50.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.168+0000 7f303f7fe700 1 -- 172.21.15.42:0/1806877162 learned_addr learned my addr 172.21.15.42:0/1806877162 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:50.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.168+0000 7f3044925700 1 --2- 172.21.15.42:0/1806877162 >> v2:172.21.15.144:3300/0 conn(0x7f30400c5ee0 0x7f30400c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:50.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.169+0000 7f303f7fe700 1 -- 172.21.15.42:0/1806877162 >> v2:172.21.15.144:3300/0 conn(0x7f30400c5ee0 msgr2=0x7f30400c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:50.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.169+0000 7f303f7fe700 1 --2- 172.21.15.42:0/1806877162 >> v2:172.21.15.144:3300/0 conn(0x7f30400c5ee0 0x7f30400c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.169+0000 7f303f7fe700 1 -- 172.21.15.42:0/1806877162 >> v1:172.21.15.144:6789/0 conn(0x7f3040151030 legacy=0x7f304006c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:50.158 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.169+0000 7f303f7fe700 1 -- 172.21.15.42:0/1806877162 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30401570a0 con 0x7f3040151400 2023-07-29T02:00:50.158 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.169+0000 7f303f7fe700 1 --2- 172.21.15.42:0/1806877162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3040151400 0x7f30400c6740 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3040072f10 tx=0x7f3030009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8a81b70c6a80c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:50.158 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.169+0000 7f303effd700 1 -- 172.21.15.42:0/1806877162 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3030004230 con 0x7f3040151400 2023-07-29T02:00:50.158 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.169+0000 7f303effd700 1 -- 172.21.15.42:0/1806877162 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3030004390 con 0x7f3040151400 2023-07-29T02:00:50.158 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.169+0000 7f303effd700 1 -- 172.21.15.42:0/1806877162 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30300036a0 con 0x7f3040151400 2023-07-29T02:00:50.160 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.169+0000 7f3046388700 1 -- 172.21.15.42:0/1806877162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3040151400 msgr2=0x7f30400c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:50.160 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.169+0000 7f3046388700 1 --2- 172.21.15.42:0/1806877162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3040151400 0x7f30400c6740 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3040072f10 tx=0x7f3030009bd0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.161 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.169+0000 7f3046388700 1 -- 172.21.15.42:0/1806877162 shutdown_connections 2023-07-29T02:00:50.161 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.169+0000 7f3046388700 1 --2- 172.21.15.42:0/1806877162 >> v2:172.21.15.144:3300/0 conn(0x7f30400c5ee0 0x7f30400c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.161 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.169+0000 7f3046388700 1 --2- 172.21.15.42:0/1806877162 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3040151400 0x7f30400c6740 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.161 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.169+0000 7f3046388700 1 -- 172.21.15.42:0/1806877162 >> 172.21.15.42:0/1806877162 conn(0x7f30400c80e0 msgr2=0x7f30400c84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:50.161 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.170+0000 7f3046388700 1 -- 172.21.15.42:0/1806877162 shutdown_connections 2023-07-29T02:00:50.161 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.170+0000 7f3046388700 1 -- 172.21.15.42:0/1806877162 wait complete. 2023-07-29T02:00:50.161 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.171+0000 7f3046388700 1 Processor -- start 2023-07-29T02:00:50.161 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.171+0000 7f3046388700 1 -- start start 2023-07-29T02:00:50.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.171+0000 7f3046388700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30400c5ee0 0x7f304006b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:50.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.171+0000 7f3046388700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3040151030 0x7f30401e1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:50.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f3046388700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3040151400 0x7f30401ef280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:50.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f3046388700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30401e1090 con 0x7f3040151400 2023-07-29T02:00:50.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f3046388700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30401ef7c0 con 0x7f30400c5ee0 2023-07-29T02:00:50.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f3046388700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304006a750 con 0x7f3040151030 2023-07-29T02:00:50.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f3044925700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3040151400 0x7f30401ef280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:50.163 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f3044925700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3040151400 0x7f30401ef280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57234/0 (socket says 172.21.15.42:57234) 2023-07-29T02:00:50.163 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f3044925700 1 -- 172.21.15.42:0/1296659274 learned_addr learned my addr 172.21.15.42:0/1296659274 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:50.163 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f303ffff700 1 --2- 172.21.15.42:0/1296659274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30400c5ee0 0x7f304006b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:50.163 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f303f7fe700 1 --2- 172.21.15.42:0/1296659274 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3040151030 0x7f30401e1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:50.163 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f3044925700 1 -- 172.21.15.42:0/1296659274 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3040151030 msgr2=0x7f30401e1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:50.163 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f3044925700 1 --2- 172.21.15.42:0/1296659274 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3040151030 0x7f30401e1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.163 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f3044925700 1 -- 172.21.15.42:0/1296659274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30400c5ee0 msgr2=0x7f304006b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:50.163 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f3044925700 1 --2- 172.21.15.42:0/1296659274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30400c5ee0 0x7f304006b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.164 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f3044925700 1 -- 172.21.15.42:0/1296659274 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3030009550 con 0x7f3040151400 2023-07-29T02:00:50.164 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f303ffff700 1 --2- 172.21.15.42:0/1296659274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30400c5ee0 0x7f304006b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:00:50.164 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f3044925700 1 --2- 172.21.15.42:0/1296659274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3040151400 0x7f30401ef280 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3038007e90 tx=0x7f303800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:50.164 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f303cff9700 1 -- 172.21.15.42:0/1296659274 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303800ed80 con 0x7f3040151400 2023-07-29T02:00:50.164 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f303cff9700 1 -- 172.21.15.42:0/1296659274 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3038014420 con 0x7f3040151400 2023-07-29T02:00:50.164 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f303cff9700 1 -- 172.21.15.42:0/1296659274 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30380147d0 con 0x7f3040151400 2023-07-29T02:00:50.164 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f3046388700 1 -- 172.21.15.42:0/1296659274 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304006bb70 con 0x7f3040151400 2023-07-29T02:00:50.165 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.172+0000 7f3046388700 1 -- 172.21.15.42:0/1296659274 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304006a9a0 con 0x7f3040151400 2023-07-29T02:00:50.165 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.173+0000 7f3046388700 1 -- 172.21.15.42:0/1296659274 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30400c6440 con 0x7f3040151400 2023-07-29T02:00:50.165 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.174+0000 7f303cff9700 1 -- 172.21.15.42:0/1296659274 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f3038014930 con 0x7f3040151400 2023-07-29T02:00:50.166 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.174+0000 7f303cff9700 1 --2- 172.21.15.42:0/1296659274 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f302006a660 0x7f302006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:50.166 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.174+0000 7f303cff9700 1 -- 172.21.15.42:0/1296659274 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6850+0+0 (secure 0 0 0) 0x7f3038089450 con 0x7f3040151400 2023-07-29T02:00:50.166 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.174+0000 7f303ffff700 1 --2- 172.21.15.42:0/1296659274 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f302006a660 0x7f302006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:50.166 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.175+0000 7f303ffff700 1 --2- 172.21.15.42:0/1296659274 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f302006a660 0x7f302006cb10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f30280017d0 tx=0x7f3028009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:50.166 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.178+0000 7f303cff9700 1 -- 172.21.15.42:0/1296659274 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f30380545c0 con 0x7f3040151400 2023-07-29T02:00:50.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.420+0000 7f3046388700 1 -- 172.21.15.42:0/1296659274 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f304004ea50 con 0x7f3040151400 2023-07-29T02:00:50.408 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.421+0000 7f303cff9700 1 -- 172.21.15.42:0/1296659274 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6165 (secure 0 0 0) 0x7f3038057be0 con 0x7f3040151400 2023-07-29T02:00:50.408 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:50.408 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:00:26.432410+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6837/1851767861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1851767861},{"type":"v1","addr":"172.21.15.42:6837","nonce":1851767861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:00:50.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.423+0000 7f3046388700 1 -- 172.21.15.42:0/1296659274 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f302006a660 msgr2=0x7f302006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:50.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.423+0000 7f3046388700 1 --2- 172.21.15.42:0/1296659274 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f302006a660 0x7f302006cb10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f30280017d0 tx=0x7f3028009040 comp rx=0 tx=0).stop 2023-07-29T02:00:50.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.423+0000 7f3046388700 1 -- 172.21.15.42:0/1296659274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3040151400 msgr2=0x7f30401ef280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:50.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.423+0000 7f3046388700 1 --2- 172.21.15.42:0/1296659274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3040151400 0x7f30401ef280 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3038007e90 tx=0x7f303800e3c0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.423+0000 7f3046388700 1 -- 172.21.15.42:0/1296659274 shutdown_connections 2023-07-29T02:00:50.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.423+0000 7f3046388700 1 --2- 172.21.15.42:0/1296659274 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f302006a660 0x7f302006cb10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.423+0000 7f3046388700 1 --2- 172.21.15.42:0/1296659274 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3040151400 0x7f30401ef280 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.423+0000 7f3046388700 1 --2- 172.21.15.42:0/1296659274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30400c5ee0 0x7f304006b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.423+0000 7f3046388700 1 --2- 172.21.15.42:0/1296659274 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3040151030 0x7f30401e1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.423+0000 7f3046388700 1 -- 172.21.15.42:0/1296659274 >> 172.21.15.42:0/1296659274 conn(0x7f30400c80e0 msgr2=0x7f30400c84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:50.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.423+0000 7f3046388700 1 -- 172.21.15.42:0/1296659274 shutdown_connections 2023-07-29T02:00:50.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.423+0000 7f3046388700 1 -- 172.21.15.42:0/1296659274 wait complete. 2023-07-29T02:00:50.412 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 10 2023-07-29T02:00:50.422 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T02:00:50.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.560+0000 7ffacc33b700 1 Processor -- start 2023-07-29T02:00:50.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.560+0000 7ffacc33b700 1 -- start start 2023-07-29T02:00:50.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.561+0000 7ffacc33b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ffac4153480 0x7ffac40707d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:50.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.561+0000 7ffacc33b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ffac40c66d0 0x7ffac4070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:50.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.561+0000 7ffacc33b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac4072bb0 con 0x7ffac40c5f50 2023-07-29T02:00:50.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.561+0000 7ffacc33b700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac40c7210 con 0x7ffac4153480 2023-07-29T02:00:50.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.561+0000 7ffacc33b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac4072940 con 0x7ffac40c66d0 2023-07-29T02:00:50.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.561+0000 7ffaca0d7700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ffac4153480 0x7ffac40707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:50.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.561+0000 7ffaca0d7700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ffac4153480 0x7ffac40707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57238/0 (socket says 172.21.15.42:57238) 2023-07-29T02:00:50.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.561+0000 7ffaca0d7700 1 -- 172.21.15.42:0/753322793 learned_addr learned my addr 172.21.15.42:0/753322793 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:50.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.561+0000 7ffac98d6700 1 --2- 172.21.15.42:0/753322793 >> v2:172.21.15.144:3300/0 conn(0x7ffac40c66d0 0x7ffac4070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:50.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.562+0000 7ffaca0d7700 1 -- 172.21.15.42:0/753322793 >> v2:172.21.15.144:3300/0 conn(0x7ffac40c66d0 msgr2=0x7ffac4070d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:00:50.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.562+0000 7ffaca0d7700 1 --2- 172.21.15.42:0/753322793 >> v2:172.21.15.144:3300/0 conn(0x7ffac40c66d0 0x7ffac4070d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.562+0000 7ffaca0d7700 1 -- 172.21.15.42:0/753322793 >> v1:172.21.15.144:6789/0 conn(0x7ffac40c5f50 legacy=0x7ffac40c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:50.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.562+0000 7ffaca0d7700 1 -- 172.21.15.42:0/753322793 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac4153850 con 0x7ffac4153480 2023-07-29T02:00:50.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.562+0000 7ffaca0d7700 1 --2- 172.21.15.42:0/753322793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffac4153480 0x7ffac40707d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffac406ff30 tx=0x7ffab4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93f8ffef312de1a server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:50.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.562+0000 7ffac90d5700 1 -- 172.21.15.42:0/753322793 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4011830 con 0x7ffac4153480 2023-07-29T02:00:50.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.562+0000 7ffac90d5700 1 -- 172.21.15.42:0/753322793 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab4011990 con 0x7ffac4153480 2023-07-29T02:00:50.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.562+0000 7ffac90d5700 1 -- 172.21.15.42:0/753322793 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4011d20 con 0x7ffac4153480 2023-07-29T02:00:50.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.563+0000 7ffacc33b700 1 -- 172.21.15.42:0/753322793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffac4153480 msgr2=0x7ffac40707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:50.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.563+0000 7ffacc33b700 1 --2- 172.21.15.42:0/753322793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffac4153480 0x7ffac40707d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ffac406ff30 tx=0x7ffab4009bd0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.563+0000 7ffacc33b700 1 -- 172.21.15.42:0/753322793 shutdown_connections 2023-07-29T02:00:50.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.563+0000 7ffacc33b700 1 --2- 172.21.15.42:0/753322793 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffac4153480 0x7ffac40707d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.563+0000 7ffacc33b700 1 --2- 172.21.15.42:0/753322793 >> v2:172.21.15.144:3300/0 conn(0x7ffac40c66d0 0x7ffac4070d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.563+0000 7ffacc33b700 1 -- 172.21.15.42:0/753322793 >> 172.21.15.42:0/753322793 conn(0x7ffac40cc360 msgr2=0x7ffac40c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:50.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.563+0000 7ffacc33b700 1 -- 172.21.15.42:0/753322793 shutdown_connections 2023-07-29T02:00:50.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.563+0000 7ffacc33b700 1 -- 172.21.15.42:0/753322793 wait complete. 2023-07-29T02:00:50.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.564+0000 7ffacc33b700 1 Processor -- start 2023-07-29T02:00:50.555 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.564+0000 7ffacc33b700 1 -- start start 2023-07-29T02:00:50.555 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffacc33b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffac40c5f50 0x7ffac41e4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:50.555 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffacc33b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffac40c66d0 0x7ffac40c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:50.555 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffacc33b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffac4153480 0x7ffac40c5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:50.555 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffacc33b700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac40c38f0 con 0x7ffac40c66d0 2023-07-29T02:00:50.555 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffacc33b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac41e3e50 con 0x7ffac4153480 2023-07-29T02:00:50.555 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffacc33b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac40cb390 con 0x7ffac40c5f50 2023-07-29T02:00:50.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffac98d6700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffac40c66d0 0x7ffac40c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:50.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffac98d6700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffac40c66d0 0x7ffac40c33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57244/0 (socket says 172.21.15.42:57244) 2023-07-29T02:00:50.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffac98d6700 1 -- 172.21.15.42:0/1930068408 learned_addr learned my addr 172.21.15.42:0/1930068408 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:00:50.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffaca8d8700 1 --2- 172.21.15.42:0/1930068408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffac4153480 0x7ffac40c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:50.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffaca0d7700 1 --2- 172.21.15.42:0/1930068408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffac40c5f50 0x7ffac41e4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:50.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffac98d6700 1 -- 172.21.15.42:0/1930068408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffac40c5f50 msgr2=0x7ffac41e4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:50.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffac98d6700 1 --2- 172.21.15.42:0/1930068408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffac40c5f50 0x7ffac41e4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffac98d6700 1 -- 172.21.15.42:0/1930068408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffac4153480 msgr2=0x7ffac40c5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:50.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffac98d6700 1 --2- 172.21.15.42:0/1930068408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffac4153480 0x7ffac40c5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffac98d6700 1 -- 172.21.15.42:0/1930068408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab4009550 con 0x7ffac40c66d0 2023-07-29T02:00:50.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffaca0d7700 1 --2- 172.21.15.42:0/1930068408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffac40c5f50 0x7ffac41e4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:00:50.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffac98d6700 1 --2- 172.21.15.42:0/1930068408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffac40c66d0 0x7ffac40c33b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ffac000e980 tx=0x7ffac000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:50.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffabaffd700 1 -- 172.21.15.42:0/1930068408 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0009710 con 0x7ffac40c66d0 2023-07-29T02:00:50.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffabaffd700 1 -- 172.21.15.42:0/1930068408 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac000c850 con 0x7ffac40c66d0 2023-07-29T02:00:50.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffacc33b700 1 -- 172.21.15.42:0/1930068408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac4158c70 con 0x7ffac40c66d0 2023-07-29T02:00:50.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.565+0000 7ffabaffd700 1 -- 172.21.15.42:0/1930068408 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac000cbe0 con 0x7ffac40c66d0 2023-07-29T02:00:50.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.566+0000 7ffacc33b700 1 -- 172.21.15.42:0/1930068408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac41591f0 con 0x7ffac40c66d0 2023-07-29T02:00:50.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.566+0000 7ffacc33b700 1 -- 172.21.15.42:0/1930068408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac4159410 con 0x7ffac40c66d0 2023-07-29T02:00:50.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.567+0000 7ffabaffd700 1 -- 172.21.15.42:0/1930068408 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7ffac000cd40 con 0x7ffac40c66d0 2023-07-29T02:00:50.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.567+0000 7ffabaffd700 1 --2- 172.21.15.42:0/1930068408 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ffaa806a660 0x7ffaa806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:00:50.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.567+0000 7ffabaffd700 1 -- 172.21.15.42:0/1930068408 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6850+0+0 (secure 0 0 0) 0x7ffac00892a0 con 0x7ffac40c66d0 2023-07-29T02:00:50.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.567+0000 7ffaca0d7700 1 --2- 172.21.15.42:0/1930068408 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ffaa806a660 0x7ffaa806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:00:50.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.568+0000 7ffaca0d7700 1 --2- 172.21.15.42:0/1930068408 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ffaa806a660 0x7ffaa806cb10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009fd0 tx=0x7ffab4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:00:50.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.571+0000 7ffabaffd700 1 -- 172.21.15.42:0/1930068408 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7ffac0057e40 con 0x7ffac40c66d0 2023-07-29T02:00:50.759 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.772+0000 7ffacc33b700 1 -- 172.21.15.42:0/1930068408 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffac404ea50 con 0x7ffac40c66d0 2023-07-29T02:00:50.760 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.773+0000 7ffabaffd700 1 -- 172.21.15.42:0/1930068408 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19757 (secure 0 0 0) 0x7ffac00579d0 con 0x7ffac40c66d0 2023-07-29T02:00:50.761 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:00:50.761 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":27,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T02:00:46.516218+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T01:59:55.827461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T01:59:56.924040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-29T01:59:59.996470+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2},{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T02:00:50.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.776+0000 7ffacc33b700 1 -- 172.21.15.42:0/1930068408 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ffaa806a660 msgr2=0x7ffaa806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:50.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.776+0000 7ffacc33b700 1 --2- 172.21.15.42:0/1930068408 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ffaa806a660 0x7ffaa806cb10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffab4009fd0 tx=0x7ffab4008030 comp rx=0 tx=0).stop 2023-07-29T02:00:50.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.776+0000 7ffacc33b700 1 -- 172.21.15.42:0/1930068408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffac40c66d0 msgr2=0x7ffac40c33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:00:50.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.776+0000 7ffacc33b700 1 --2- 172.21.15.42:0/1930068408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffac40c66d0 0x7ffac40c33b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ffac000e980 tx=0x7ffac000ed40 comp rx=0 tx=0).stop 2023-07-29T02:00:50.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.776+0000 7ffacc33b700 1 -- 172.21.15.42:0/1930068408 shutdown_connections 2023-07-29T02:00:50.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.776+0000 7ffacc33b700 1 --2- 172.21.15.42:0/1930068408 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ffaa806a660 0x7ffaa806cb10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.776+0000 7ffacc33b700 1 --2- 172.21.15.42:0/1930068408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffac4153480 0x7ffac40c5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.776+0000 7ffacc33b700 1 --2- 172.21.15.42:0/1930068408 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ffac40c5f50 0x7ffac41e4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.776+0000 7ffacc33b700 1 --2- 172.21.15.42:0/1930068408 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ffac40c66d0 0x7ffac40c33b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:00:50.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.776+0000 7ffacc33b700 1 -- 172.21.15.42:0/1930068408 >> 172.21.15.42:0/1930068408 conn(0x7ffac40cc360 msgr2=0x7ffac40c8080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:00:50.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.776+0000 7ffacc33b700 1 -- 172.21.15.42:0/1930068408 shutdown_connections 2023-07-29T02:00:50.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:00:50.776+0000 7ffacc33b700 1 -- 172.21.15.42:0/1930068408 wait complete. 2023-07-29T02:00:50.775 DEBUG:tasks.mds_thrash:Yielding 2023-07-29T02:00:50.776 INFO:teuthology.run_tasks:Running task workunit... 2023-07-29T02:00:50.787 INFO:tasks.workunit:Pulling workunits from ref 0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T02:00:50.788 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-07-29T02:00:50.788 INFO:tasks.workunit:timeout=6h 2023-07-29T02:00:50.788 INFO:tasks.workunit:cleanup=True 2023-07-29T02:00:50.789 DEBUG:teuthology.orchestra.run.smithi042:> stat -- /home/ubuntu/cephtest/mnt.0 2023-07-29T02:00:50.789 INFO:tasks.mds_thrash.fs.[cephfs]:starting mds_do_thrash for fs cephfs 2023-07-29T02:00:50.789 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 31 secs before thrashing 2023-07-29T02:00:50.806 INFO:teuthology.orchestra.run.smithi042.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-07-29T02:00:50.807 INFO:teuthology.orchestra.run.smithi042.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-07-29T02:00:50.807 INFO:teuthology.orchestra.run.smithi042.stdout:Device: 2fh/47d Inode: 1 Links: 2 2023-07-29T02:00:50.807 INFO:teuthology.orchestra.run.smithi042.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-29T02:00:50.807 INFO:teuthology.orchestra.run.smithi042.stdout:Context: system_u:object_r:cephfs_t:s0 2023-07-29T02:00:50.807 INFO:teuthology.orchestra.run.smithi042.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-07-29T02:00:50.807 INFO:teuthology.orchestra.run.smithi042.stdout:Modify: 2023-07-29 02:00:02.949690077 +0000 2023-07-29T02:00:50.808 INFO:teuthology.orchestra.run.smithi042.stdout:Change: 2023-07-29 02:00:11.049295119 +0000 2023-07-29T02:00:50.808 INFO:teuthology.orchestra.run.smithi042.stdout: Birth: 2023-07-29 02:00:02.949690077 +0000 2023-07-29T02:00:50.808 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-07-29T02:00:50.808 DEBUG:teuthology.orchestra.run.smithi042:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-07-29T02:00:50.878 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0484097b0572e96f42cf6402cbe0ac8dcb046577 2023-07-29T02:00:50.935 INFO:tasks.workunit.client.0.smithi042.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-07-29T02:01:05.961 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:01:05.965 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:01:21.790 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:01:21.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.940+0000 7f9c03cac700 1 Processor -- start 2023-07-29T02:01:21.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.940+0000 7f9c03cac700 1 -- start start 2023-07-29T02:01:21.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.941+0000 7f9c03cac700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bfc153610 0x7f9bfc06b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:21.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.941+0000 7f9c03cac700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9bfc072740 0x7f9bfc1594d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:21.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.941+0000 7f9c03cac700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bfc0722b0 con 0x7f9bfc0c8040 2023-07-29T02:01:21.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.941+0000 7f9c03cac700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bfc0c74d0 con 0x7f9bfc072740 2023-07-29T02:01:21.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.941+0000 7f9c03cac700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc0c6f10 con 0x7f9bfc153610 2023-07-29T02:01:21.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.941+0000 7f9c01247700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9bfc072740 0x7f9bfc1594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:21.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.941+0000 7f9c01247700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9bfc072740 0x7f9bfc1594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57252/0 (socket says 172.21.15.42:57252) 2023-07-29T02:01:21.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.941+0000 7f9c01247700 1 -- 172.21.15.42:0/3559247320 learned_addr learned my addr 172.21.15.42:0/3559247320 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:21.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.941+0000 7f9c01a48700 1 --2- 172.21.15.42:0/3559247320 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bfc153610 0x7f9bfc06b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:21.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.941+0000 7f9c01247700 1 -- 172.21.15.42:0/3559247320 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bfc153610 msgr2=0x7f9bfc06b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:21.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.941+0000 7f9c01247700 1 --2- 172.21.15.42:0/3559247320 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bfc153610 0x7f9bfc06b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:21.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.941+0000 7f9c01247700 1 -- 172.21.15.42:0/3559247320 >> v1:172.21.15.144:6789/0 conn(0x7f9bfc0c8040 legacy=0x7f9bfc159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:21.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.941+0000 7f9c01247700 1 -- 172.21.15.42:0/3559247320 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc0c71f0 con 0x7f9bfc072740 2023-07-29T02:01:21.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.941+0000 7f9c01247700 1 --2- 172.21.15.42:0/3559247320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bfc072740 0x7f9bfc1594d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0098f0 tx=0x7f9bec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc71632a7e9445c server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:21.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.942+0000 7f9c00a46700 1 -- 172.21.15.42:0/3559247320 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec011830 con 0x7f9bfc072740 2023-07-29T02:01:21.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.942+0000 7f9c00a46700 1 -- 172.21.15.42:0/3559247320 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bec011990 con 0x7f9bfc072740 2023-07-29T02:01:21.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.942+0000 7f9c00a46700 1 -- 172.21.15.42:0/3559247320 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec011d20 con 0x7f9bfc072740 2023-07-29T02:01:21.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.942+0000 7f9c03cac700 1 -- 172.21.15.42:0/3559247320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bfc072740 msgr2=0x7f9bfc1594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:21.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.942+0000 7f9c03cac700 1 --2- 172.21.15.42:0/3559247320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bfc072740 0x7f9bfc1594d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0098f0 tx=0x7f9bec009c00 comp rx=0 tx=0).stop 2023-07-29T02:01:21.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.942+0000 7f9c03cac700 1 -- 172.21.15.42:0/3559247320 shutdown_connections 2023-07-29T02:01:21.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.942+0000 7f9c03cac700 1 --2- 172.21.15.42:0/3559247320 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bfc153610 0x7f9bfc06b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:21.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.942+0000 7f9c03cac700 1 --2- 172.21.15.42:0/3559247320 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bfc072740 0x7f9bfc1594d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:21.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.942+0000 7f9c03cac700 1 -- 172.21.15.42:0/3559247320 >> 172.21.15.42:0/3559247320 conn(0x7f9bfc0c8970 msgr2=0x7f9bfc0c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:21.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.942+0000 7f9c03cac700 1 -- 172.21.15.42:0/3559247320 shutdown_connections 2023-07-29T02:01:21.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.942+0000 7f9c03cac700 1 -- 172.21.15.42:0/3559247320 wait complete. 2023-07-29T02:01:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.944+0000 7f9c03cac700 1 Processor -- start 2023-07-29T02:01:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.944+0000 7f9c03cac700 1 -- start start 2023-07-29T02:01:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.944+0000 7f9c03cac700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bfc072740 0x7f9bfc146d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.944+0000 7f9c03cac700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bfc0c8040 0x7f9bfc1630d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:21.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.944+0000 7f9c03cac700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bfc153610 0x7f9bfc148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.944+0000 7f9c03cac700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc1472a0 con 0x7f9bfc153610 2023-07-29T02:01:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.944+0000 7f9c03cac700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc147610 con 0x7f9bfc0c8040 2023-07-29T02:01:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.944+0000 7f9c03cac700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc163610 con 0x7f9bfc072740 2023-07-29T02:01:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.944+0000 7f9c02249700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bfc153610 0x7f9bfc148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:21.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.944+0000 7f9c02249700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bfc153610 0x7f9bfc148250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57262/0 (socket says 172.21.15.42:57262) 2023-07-29T02:01:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.944+0000 7f9c02249700 1 -- 172.21.15.42:0/1527228687 learned_addr learned my addr 172.21.15.42:0/1527228687 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.945+0000 7f9c01a48700 1 --2- 172.21.15.42:0/1527228687 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bfc072740 0x7f9bfc146d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.945+0000 7f9c01247700 1 --2- 172.21.15.42:0/1527228687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bfc0c8040 0x7f9bfc1630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.945+0000 7f9c02249700 1 -- 172.21.15.42:0/1527228687 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bfc072740 msgr2=0x7f9bfc146d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.945+0000 7f9c02249700 1 --2- 172.21.15.42:0/1527228687 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bfc072740 0x7f9bfc146d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.945+0000 7f9c02249700 1 -- 172.21.15.42:0/1527228687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bfc0c8040 msgr2=0x7f9bfc1630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.945+0000 7f9c02249700 1 --2- 172.21.15.42:0/1527228687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bfc0c8040 0x7f9bfc1630d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.945+0000 7f9c02249700 1 -- 172.21.15.42:0/1527228687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec009550 con 0x7f9bfc153610 2023-07-29T02:01:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.945+0000 7f9c02249700 1 --2- 172.21.15.42:0/1527228687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bfc153610 0x7f9bfc148250 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400cbf0 tx=0x7f9bf400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.945+0000 7f9bf27fc700 1 -- 172.21.15.42:0/1527228687 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4003c00 con 0x7f9bfc153610 2023-07-29T02:01:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.945+0000 7f9bf27fc700 1 -- 172.21.15.42:0/1527228687 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf4003d60 con 0x7f9bfc153610 2023-07-29T02:01:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.945+0000 7f9c03cac700 1 -- 172.21.15.42:0/1527228687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bfc162b30 con 0x7f9bfc153610 2023-07-29T02:01:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.945+0000 7f9bf27fc700 1 -- 172.21.15.42:0/1527228687 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf400ac20 con 0x7f9bfc153610 2023-07-29T02:01:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.945+0000 7f9c03cac700 1 -- 172.21.15.42:0/1527228687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bfc162df0 con 0x7f9bfc153610 2023-07-29T02:01:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.946+0000 7f9c03cac700 1 -- 172.21.15.42:0/1527228687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bfc1477e0 con 0x7f9bfc153610 2023-07-29T02:01:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.947+0000 7f9bf27fc700 1 -- 172.21.15.42:0/1527228687 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f9bf40050d0 con 0x7f9bfc153610 2023-07-29T02:01:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.947+0000 7f9bf27fc700 1 --2- 172.21.15.42:0/1527228687 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9be006a690 0x7f9be006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.947+0000 7f9bf27fc700 1 -- 172.21.15.42:0/1527228687 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6850+0+0 (secure 0 0 0) 0x7f9bf4088e00 con 0x7f9bfc153610 2023-07-29T02:01:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.947+0000 7f9c01a48700 1 --2- 172.21.15.42:0/1527228687 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9be006a690 0x7f9be006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.948+0000 7f9c01a48700 1 --2- 172.21.15.42:0/1527228687 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9be006a690 0x7f9be006cb40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8009ab0 tx=0x7f9bf8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:21.940 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:21.951+0000 7f9bf27fc700 1 -- 172.21.15.42:0/1527228687 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f9bf4053ee0 con 0x7f9bfc153610 2023-07-29T02:01:22.188 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.201+0000 7f9c03cac700 1 -- 172.21.15.42:0/1527228687 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9bfc0c79d0 con 0x7f9bfc153610 2023-07-29T02:01:22.189 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.202+0000 7f9bf27fc700 1 -- 172.21.15.42:0/1527228687 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6165 (secure 0 0 0) 0x7f9bf4057500 con 0x7f9bfc153610 2023-07-29T02:01:22.189 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:01:22.189 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:00:26.432410+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6837/1851767861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1851767861},{"type":"v1","addr":"172.21.15.42:6837","nonce":1851767861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:01:22.191 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.204+0000 7f9c03cac700 1 -- 172.21.15.42:0/1527228687 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9be006a690 msgr2=0x7f9be006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:22.191 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.204+0000 7f9c03cac700 1 --2- 172.21.15.42:0/1527228687 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9be006a690 0x7f9be006cb40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8009ab0 tx=0x7f9bf8008040 comp rx=0 tx=0).stop 2023-07-29T02:01:22.191 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.204+0000 7f9c03cac700 1 -- 172.21.15.42:0/1527228687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bfc153610 msgr2=0x7f9bfc148250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:22.191 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.204+0000 7f9c03cac700 1 --2- 172.21.15.42:0/1527228687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bfc153610 0x7f9bfc148250 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400cbf0 tx=0x7f9bf400a060 comp rx=0 tx=0).stop 2023-07-29T02:01:22.191 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.204+0000 7f9c03cac700 1 -- 172.21.15.42:0/1527228687 shutdown_connections 2023-07-29T02:01:22.192 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.204+0000 7f9c03cac700 1 --2- 172.21.15.42:0/1527228687 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9be006a690 0x7f9be006cb40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:22.192 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.204+0000 7f9c03cac700 1 --2- 172.21.15.42:0/1527228687 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bfc153610 0x7f9bfc148250 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:22.192 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.204+0000 7f9c03cac700 1 --2- 172.21.15.42:0/1527228687 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bfc072740 0x7f9bfc146d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:22.192 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.204+0000 7f9c03cac700 1 --2- 172.21.15.42:0/1527228687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bfc0c8040 0x7f9bfc1630d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:22.192 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.204+0000 7f9c03cac700 1 -- 172.21.15.42:0/1527228687 >> 172.21.15.42:0/1527228687 conn(0x7f9bfc0c8970 msgr2=0x7f9bfc0c3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:22.192 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.204+0000 7f9c03cac700 1 -- 172.21.15.42:0/1527228687 shutdown_connections 2023-07-29T02:01:22.192 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.204+0000 7f9c03cac700 1 -- 172.21.15.42:0/1527228687 wait complete. 2023-07-29T02:01:22.193 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 10 2023-07-29T02:01:22.203 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.e (rank=0) 2023-07-29T02:01:22.203 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2023-07-29T02:01:22.204 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:01:22.212 INFO:tasks.ceph.mds.e:Stopped 2023-07-29T02:01:22.212 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:01:22.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.411+0000 7fde5e948700 1 Processor -- start 2023-07-29T02:01:22.399 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.411+0000 7fde5e948700 1 -- start start 2023-07-29T02:01:22.399 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.411+0000 7fde5e948700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fde580c4260 0x7fde58159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:22.399 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.411+0000 7fde5e948700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fde5806d540 0x7fde5815a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:22.399 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.411+0000 7fde5e948700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5806d280 con 0x7fde580c3e90 2023-07-29T02:01:22.400 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.411+0000 7fde5e948700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5806bf40 con 0x7fde580c4260 2023-07-29T02:01:22.400 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.411+0000 7fde5e948700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde580c24d0 con 0x7fde5806d540 2023-07-29T02:01:22.400 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.411+0000 7fde577fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fde580c4260 0x7fde58159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:22.400 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.412+0000 7fde577fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fde580c4260 0x7fde58159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57270/0 (socket says 172.21.15.42:57270) 2023-07-29T02:01:22.401 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.412+0000 7fde577fe700 1 -- 172.21.15.42:0/1906324017 learned_addr learned my addr 172.21.15.42:0/1906324017 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:22.401 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.412+0000 7fde5cee5700 1 --2- 172.21.15.42:0/1906324017 >> v2:172.21.15.144:3300/0 conn(0x7fde5806d540 0x7fde5815a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:22.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.412+0000 7fde577fe700 1 -- 172.21.15.42:0/1906324017 >> v2:172.21.15.144:3300/0 conn(0x7fde5806d540 msgr2=0x7fde5815a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:22.406 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.412+0000 7fde577fe700 1 --2- 172.21.15.42:0/1906324017 >> v2:172.21.15.144:3300/0 conn(0x7fde5806d540 0x7fde5815a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:22.406 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.412+0000 7fde577fe700 1 -- 172.21.15.42:0/1906324017 >> v1:172.21.15.144:6789/0 conn(0x7fde580c3e90 legacy=0x7fde5815d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:22.406 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.412+0000 7fde577fe700 1 -- 172.21.15.42:0/1906324017 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5806bc80 con 0x7fde580c4260 2023-07-29T02:01:22.406 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.412+0000 7fde577fe700 1 --2- 172.21.15.42:0/1906324017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde580c4260 0x7fde58159ce0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fde580684c0 tx=0x7fde4c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7efb2f38bdc79bf9 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:22.406 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.412+0000 7fde56ffd700 1 -- 172.21.15.42:0/1906324017 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c011830 con 0x7fde580c4260 2023-07-29T02:01:22.406 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.412+0000 7fde56ffd700 1 -- 172.21.15.42:0/1906324017 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c011990 con 0x7fde580c4260 2023-07-29T02:01:22.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.412+0000 7fde56ffd700 1 -- 172.21.15.42:0/1906324017 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c011d20 con 0x7fde580c4260 2023-07-29T02:01:22.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.413+0000 7fde5e948700 1 -- 172.21.15.42:0/1906324017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde580c4260 msgr2=0x7fde58159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:22.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.413+0000 7fde5e948700 1 --2- 172.21.15.42:0/1906324017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde580c4260 0x7fde58159ce0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fde580684c0 tx=0x7fde4c009bd0 comp rx=0 tx=0).stop 2023-07-29T02:01:22.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.413+0000 7fde5e948700 1 -- 172.21.15.42:0/1906324017 shutdown_connections 2023-07-29T02:01:22.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.413+0000 7fde5e948700 1 --2- 172.21.15.42:0/1906324017 >> v2:172.21.15.144:3300/0 conn(0x7fde5806d540 0x7fde5815a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:22.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.413+0000 7fde5e948700 1 --2- 172.21.15.42:0/1906324017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde580c4260 0x7fde58159ce0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:22.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.413+0000 7fde5e948700 1 -- 172.21.15.42:0/1906324017 >> 172.21.15.42:0/1906324017 conn(0x7fde58061190 msgr2=0x7fde58061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.413+0000 7fde5e948700 1 -- 172.21.15.42:0/1906324017 shutdown_connections 2023-07-29T02:01:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.413+0000 7fde5e948700 1 -- 172.21.15.42:0/1906324017 wait complete. 2023-07-29T02:01:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.414+0000 7fde5e948700 1 Processor -- start 2023-07-29T02:01:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.414+0000 7fde5e948700 1 -- start start 2023-07-29T02:01:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.415+0000 7fde5e948700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde5806d540 0x7fde5815cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:22.408 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.415+0000 7fde5e948700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde580c3e90 0x7fde5815d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.415+0000 7fde5e948700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde580c4260 0x7fde581ef210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.415+0000 7fde5e948700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde581eed80 con 0x7fde580c3e90 2023-07-29T02:01:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.415+0000 7fde5e948700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde581f2ff0 con 0x7fde5806d540 2023-07-29T02:01:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.415+0000 7fde5e948700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde581f21d0 con 0x7fde580c4260 2023-07-29T02:01:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.415+0000 7fde577fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde580c3e90 0x7fde5815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.415+0000 7fde577fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde580c3e90 0x7fde5815d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57276/0 (socket says 172.21.15.42:57276) 2023-07-29T02:01:22.409 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.415+0000 7fde577fe700 1 -- 172.21.15.42:0/3354808311 learned_addr learned my addr 172.21.15.42:0/3354808311 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.415+0000 7fde5cee5700 1 --2- 172.21.15.42:0/3354808311 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde580c4260 0x7fde581ef210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.415+0000 7fde57fff700 1 --2- 172.21.15.42:0/3354808311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde5806d540 0x7fde5815cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.415+0000 7fde577fe700 1 -- 172.21.15.42:0/3354808311 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde580c4260 msgr2=0x7fde581ef210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.415+0000 7fde577fe700 1 --2- 172.21.15.42:0/3354808311 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde580c4260 0x7fde581ef210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.415+0000 7fde577fe700 1 -- 172.21.15.42:0/3354808311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde5806d540 msgr2=0x7fde5815cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.415+0000 7fde577fe700 1 --2- 172.21.15.42:0/3354808311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde5806d540 0x7fde5815cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:22.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.415+0000 7fde577fe700 1 -- 172.21.15.42:0/3354808311 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4c009550 con 0x7fde580c3e90 2023-07-29T02:01:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.416+0000 7fde577fe700 1 --2- 172.21.15.42:0/3354808311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde580c3e90 0x7fde5815d3e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fde4c000c00 tx=0x7fde4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.416+0000 7fde54ff9700 1 -- 172.21.15.42:0/3354808311 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c004400 con 0x7fde580c3e90 2023-07-29T02:01:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.416+0000 7fde54ff9700 1 -- 172.21.15.42:0/3354808311 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c01f070 con 0x7fde580c3e90 2023-07-29T02:01:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.416+0000 7fde5e948700 1 -- 172.21.15.42:0/3354808311 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde581f2470 con 0x7fde580c3e90 2023-07-29T02:01:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.416+0000 7fde54ff9700 1 -- 172.21.15.42:0/3354808311 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c0038e0 con 0x7fde580c3e90 2023-07-29T02:01:22.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.416+0000 7fde5e948700 1 -- 172.21.15.42:0/3354808311 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde581f2a30 con 0x7fde580c3e90 2023-07-29T02:01:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.417+0000 7fde5e948700 1 -- 172.21.15.42:0/3354808311 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde581eeef0 con 0x7fde580c3e90 2023-07-29T02:01:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.417+0000 7fde54ff9700 1 -- 172.21.15.42:0/3354808311 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fde4c021030 con 0x7fde580c3e90 2023-07-29T02:01:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.418+0000 7fde54ff9700 1 --2- 172.21.15.42:0/3354808311 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fde4406a690 0x7fde4406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.418+0000 7fde54ff9700 1 -- 172.21.15.42:0/3354808311 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6850+0+0 (secure 0 0 0) 0x7fde4c08a150 con 0x7fde580c3e90 2023-07-29T02:01:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.418+0000 7fde57fff700 1 --2- 172.21.15.42:0/3354808311 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fde4406a690 0x7fde4406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:22.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.418+0000 7fde57fff700 1 --2- 172.21.15.42:0/3354808311 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fde4406a690 0x7fde4406cb40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fde48007fd0 tx=0x7fde48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:22.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.422+0000 7fde54ff9700 1 -- 172.21.15.42:0/3354808311 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fde4c0552f0 con 0x7fde580c3e90 2023-07-29T02:01:22.676 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.689+0000 7fde5e948700 1 -- 172.21.15.42:0/3354808311 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde581eeb50 con 0x7fde580c3e90 2023-07-29T02:01:22.676 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.690+0000 7fde54ff9700 1 -- 172.21.15.42:0/3354808311 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6165 (secure 0 0 0) 0x7fde4c058910 con 0x7fde580c3e90 2023-07-29T02:01:22.677 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:01:22.677 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:00:26.432410+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6837/1851767861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1851767861},{"type":"v1","addr":"172.21.15.42:6837","nonce":1851767861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:01:22.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.692+0000 7fde5e948700 1 -- 172.21.15.42:0/3354808311 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fde4406a690 msgr2=0x7fde4406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:22.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.692+0000 7fde5e948700 1 --2- 172.21.15.42:0/3354808311 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fde4406a690 0x7fde4406cb40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fde48007fd0 tx=0x7fde48009040 comp rx=0 tx=0).stop 2023-07-29T02:01:22.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.692+0000 7fde5e948700 1 -- 172.21.15.42:0/3354808311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde580c3e90 msgr2=0x7fde5815d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:22.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.692+0000 7fde5e948700 1 --2- 172.21.15.42:0/3354808311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde580c3e90 0x7fde5815d3e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fde4c000c00 tx=0x7fde4c004750 comp rx=0 tx=0).stop 2023-07-29T02:01:22.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.692+0000 7fde5e948700 1 -- 172.21.15.42:0/3354808311 shutdown_connections 2023-07-29T02:01:22.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.692+0000 7fde5e948700 1 --2- 172.21.15.42:0/3354808311 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fde4406a690 0x7fde4406cb40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:22.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.692+0000 7fde5e948700 1 --2- 172.21.15.42:0/3354808311 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fde580c4260 0x7fde581ef210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:22.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.692+0000 7fde5e948700 1 --2- 172.21.15.42:0/3354808311 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fde5806d540 0x7fde5815cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:22.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.692+0000 7fde5e948700 1 --2- 172.21.15.42:0/3354808311 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fde580c3e90 0x7fde5815d3e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:22.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.692+0000 7fde5e948700 1 -- 172.21.15.42:0/3354808311 >> 172.21.15.42:0/3354808311 conn(0x7fde58061190 msgr2=0x7fde58159ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:22.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.692+0000 7fde5e948700 1 -- 172.21.15.42:0/3354808311 shutdown_connections 2023-07-29T02:01:22.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:22.692+0000 7fde5e948700 1 -- 172.21.15.42:0/3354808311 wait complete. 2023-07-29T02:01:22.681 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 10 2023-07-29T02:01:22.691 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2023-07-29T02:01:24.692 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:01:24.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.845+0000 7fdbc05d5700 1 Processor -- start 2023-07-29T02:01:24.832 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.845+0000 7fdbc05d5700 1 -- start start 2023-07-29T02:01:24.833 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.846+0000 7fdbc05d5700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fdbb814c630 0x7fdbb806c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:24.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.846+0000 7fdbc05d5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbb814ca00 0x7fdbb80c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:24.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.846+0000 7fdbc05d5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fdbb80c7270 0x7fdbb80c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:24.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.846+0000 7fdbc05d5700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb806ce40 con 0x7fdbb814c630 2023-07-29T02:01:24.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.846+0000 7fdbc05d5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb8155d50 con 0x7fdbb80c7270 2023-07-29T02:01:24.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.846+0000 7fdbc05d5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb8156010 con 0x7fdbb814ca00 2023-07-29T02:01:24.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.846+0000 7fdbbe371700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fdbb814c630 0x7fdbb806c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:24.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.846+0000 7fdbbe371700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fdbb814c630 0x7fdbb806c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57288/0 (socket says 172.21.15.42:57288) 2023-07-29T02:01:24.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.846+0000 7fdbbe371700 1 -- 172.21.15.42:0/813483291 learned_addr learned my addr 172.21.15.42:0/813483291 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:24.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.846+0000 7fdbbdb70700 1 --2- 172.21.15.42:0/813483291 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbb814ca00 0x7fdbb80c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:24.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.846+0000 7fdbbeb72700 1 --2- 172.21.15.42:0/813483291 >> v2:172.21.15.144:3300/0 conn(0x7fdbb80c7270 0x7fdbb80c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:24.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.846+0000 7fdbbe371700 1 -- 172.21.15.42:0/813483291 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbb814ca00 msgr2=0x7fdbb80c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:24.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.846+0000 7fdbbe371700 1 --2- 172.21.15.42:0/813483291 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbb814ca00 0x7fdbb80c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:24.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.846+0000 7fdbbe371700 1 -- 172.21.15.42:0/813483291 >> v2:172.21.15.144:3300/0 conn(0x7fdbb80c7270 msgr2=0x7fdbb80c6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:24.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.846+0000 7fdbbe371700 1 --2- 172.21.15.42:0/813483291 >> v2:172.21.15.144:3300/0 conn(0x7fdbb80c7270 0x7fdbb80c6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:24.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.846+0000 7fdbbe371700 1 -- 172.21.15.42:0/813483291 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb81562f0 con 0x7fdbb814c630 2023-07-29T02:01:24.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.846+0000 7fdbbeb72700 1 --2- 172.21.15.42:0/813483291 >> v2:172.21.15.144:3300/0 conn(0x7fdbb80c7270 0x7fdbb80c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:01:24.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.847+0000 7fdbbe371700 1 --2- 172.21.15.42:0/813483291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbb814c630 0x7fdbb806c270 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8153890 tx=0x7fdbb4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18be0893e55291d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:24.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.847+0000 7fdbbd36f700 1 -- 172.21.15.42:0/813483291 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb400b870 con 0x7fdbb814c630 2023-07-29T02:01:24.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.847+0000 7fdbbd36f700 1 -- 172.21.15.42:0/813483291 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb400b9d0 con 0x7fdbb814c630 2023-07-29T02:01:24.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.847+0000 7fdbbd36f700 1 -- 172.21.15.42:0/813483291 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb400bd60 con 0x7fdbb814c630 2023-07-29T02:01:24.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.847+0000 7fdbc05d5700 1 -- 172.21.15.42:0/813483291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbb814c630 msgr2=0x7fdbb806c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:24.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.847+0000 7fdbc05d5700 1 --2- 172.21.15.42:0/813483291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbb814c630 0x7fdbb806c270 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8153890 tx=0x7fdbb4009bd0 comp rx=0 tx=0).stop 2023-07-29T02:01:24.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.847+0000 7fdbc05d5700 1 -- 172.21.15.42:0/813483291 shutdown_connections 2023-07-29T02:01:24.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.847+0000 7fdbc05d5700 1 --2- 172.21.15.42:0/813483291 >> v2:172.21.15.144:3300/0 conn(0x7fdbb80c7270 0x7fdbb80c6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:24.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.847+0000 7fdbc05d5700 1 --2- 172.21.15.42:0/813483291 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbb814c630 0x7fdbb806c270 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:24.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.847+0000 7fdbc05d5700 1 --2- 172.21.15.42:0/813483291 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbb814ca00 0x7fdbb80c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:24.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.847+0000 7fdbc05d5700 1 -- 172.21.15.42:0/813483291 >> 172.21.15.42:0/813483291 conn(0x7fdbb80c8970 msgr2=0x7fdbb80c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:24.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.847+0000 7fdbc05d5700 1 -- 172.21.15.42:0/813483291 shutdown_connections 2023-07-29T02:01:24.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.847+0000 7fdbc05d5700 1 -- 172.21.15.42:0/813483291 wait complete. 2023-07-29T02:01:24.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.849+0000 7fdbc05d5700 1 Processor -- start 2023-07-29T02:01:24.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.849+0000 7fdbc05d5700 1 -- start start 2023-07-29T02:01:24.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.849+0000 7fdbc05d5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbb80c7270 0x7fdbb81ed660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:24.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.849+0000 7fdbc05d5700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbb814c630 0x7fdbb80c2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:24.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.849+0000 7fdbc05d5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbb80c53e0 0x7fdbb8154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:24.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.849+0000 7fdbc05d5700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb81ee640 con 0x7fdbb814c630 2023-07-29T02:01:24.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.849+0000 7fdbc05d5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb81edba0 con 0x7fdbb80c53e0 2023-07-29T02:01:24.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.849+0000 7fdbc05d5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb80bfca0 con 0x7fdbb80c7270 2023-07-29T02:01:24.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.850+0000 7fdbbdb70700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbb814c630 0x7fdbb80c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:24.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.850+0000 7fdbbdb70700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbb814c630 0x7fdbb80c2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57296/0 (socket says 172.21.15.42:57296) 2023-07-29T02:01:24.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.850+0000 7fdbbdb70700 1 -- 172.21.15.42:0/1423135363 learned_addr learned my addr 172.21.15.42:0/1423135363 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:24.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.850+0000 7fdbbeb72700 1 --2- 172.21.15.42:0/1423135363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbb80c53e0 0x7fdbb8154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.850+0000 7fdbbe371700 1 --2- 172.21.15.42:0/1423135363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbb80c7270 0x7fdbb81ed660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.850+0000 7fdbbdb70700 1 -- 172.21.15.42:0/1423135363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbb80c7270 msgr2=0x7fdbb81ed660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.850+0000 7fdbbdb70700 1 --2- 172.21.15.42:0/1423135363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbb80c7270 0x7fdbb81ed660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.850+0000 7fdbbdb70700 1 -- 172.21.15.42:0/1423135363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbb80c53e0 msgr2=0x7fdbb8154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.850+0000 7fdbbdb70700 1 --2- 172.21.15.42:0/1423135363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbb80c53e0 0x7fdbb8154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.850+0000 7fdbbdb70700 1 -- 172.21.15.42:0/1423135363 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb4009550 con 0x7fdbb814c630 2023-07-29T02:01:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.850+0000 7fdbbdb70700 1 --2- 172.21.15.42:0/1423135363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbb814c630 0x7fdbb80c2660 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdba800d800 tx=0x7fdba800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.850+0000 7fdbaeffd700 1 -- 172.21.15.42:0/1423135363 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba80125f0 con 0x7fdbb814c630 2023-07-29T02:01:24.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.850+0000 7fdbaeffd700 1 -- 172.21.15.42:0/1423135363 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba8012750 con 0x7fdbb814c630 2023-07-29T02:01:24.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.850+0000 7fdbaeffd700 1 -- 172.21.15.42:0/1423135363 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba8012ac0 con 0x7fdbb814c630 2023-07-29T02:01:24.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.850+0000 7fdbc05d5700 1 -- 172.21.15.42:0/1423135363 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb80c2ba0 con 0x7fdbb814c630 2023-07-29T02:01:24.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.850+0000 7fdbc05d5700 1 -- 172.21.15.42:0/1423135363 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb81ee080 con 0x7fdbb814c630 2023-07-29T02:01:24.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.851+0000 7fdbc05d5700 1 -- 172.21.15.42:0/1423135363 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb8074740 con 0x7fdbb814c630 2023-07-29T02:01:24.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.852+0000 7fdbaeffd700 1 -- 172.21.15.42:0/1423135363 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fdba8012c20 con 0x7fdbb814c630 2023-07-29T02:01:24.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.852+0000 7fdbaeffd700 1 --2- 172.21.15.42:0/1423135363 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fdb9c06a660 0x7fdb9c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:24.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.852+0000 7fdbaeffd700 1 -- 172.21.15.42:0/1423135363 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6850+0+0 (secure 0 0 0) 0x7fdba8088e00 con 0x7fdbb814c630 2023-07-29T02:01:24.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.852+0000 7fdbbe371700 1 --2- 172.21.15.42:0/1423135363 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fdb9c06a660 0x7fdb9c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:24.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.853+0000 7fdbbe371700 1 --2- 172.21.15.42:0/1423135363 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fdb9c06a660 0x7fdb9c06cb10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4000c00 tx=0x7fdbb4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:24.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:24.857+0000 7fdbaeffd700 1 -- 172.21.15.42:0/1423135363 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fdba8053ed0 con 0x7fdbb814c630 2023-07-29T02:01:25.089 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:25.102+0000 7fdbc05d5700 1 -- 172.21.15.42:0/1423135363 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbb804ea50 con 0x7fdbb814c630 2023-07-29T02:01:25.089 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:25.103+0000 7fdbaeffd700 1 -- 172.21.15.42:0/1423135363 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6165 (secure 0 0 0) 0x7fdba80574f0 con 0x7fdbb814c630 2023-07-29T02:01:25.090 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:01:25.090 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:00:26.432410+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6837/1851767861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1851767861},{"type":"v1","addr":"172.21.15.42:6837","nonce":1851767861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:01:25.092 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:25.105+0000 7fdbc05d5700 1 -- 172.21.15.42:0/1423135363 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fdb9c06a660 msgr2=0x7fdb9c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:25.092 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:25.105+0000 7fdbc05d5700 1 --2- 172.21.15.42:0/1423135363 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fdb9c06a660 0x7fdb9c06cb10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4000c00 tx=0x7fdbb4008030 comp rx=0 tx=0).stop 2023-07-29T02:01:25.092 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:25.105+0000 7fdbc05d5700 1 -- 172.21.15.42:0/1423135363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbb814c630 msgr2=0x7fdbb80c2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:25.092 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:25.105+0000 7fdbc05d5700 1 --2- 172.21.15.42:0/1423135363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbb814c630 0x7fdbb80c2660 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fdba800d800 tx=0x7fdba800db10 comp rx=0 tx=0).stop 2023-07-29T02:01:25.092 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:25.105+0000 7fdbc05d5700 1 -- 172.21.15.42:0/1423135363 shutdown_connections 2023-07-29T02:01:25.093 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:25.105+0000 7fdbc05d5700 1 --2- 172.21.15.42:0/1423135363 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fdb9c06a660 0x7fdb9c06cb10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:25.093 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:25.105+0000 7fdbc05d5700 1 --2- 172.21.15.42:0/1423135363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdbb80c53e0 0x7fdbb8154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:25.093 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:25.105+0000 7fdbc05d5700 1 --2- 172.21.15.42:0/1423135363 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fdbb80c7270 0x7fdbb81ed660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:25.093 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:25.105+0000 7fdbc05d5700 1 --2- 172.21.15.42:0/1423135363 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fdbb814c630 0x7fdbb80c2660 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:25.093 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:25.105+0000 7fdbc05d5700 1 -- 172.21.15.42:0/1423135363 >> 172.21.15.42:0/1423135363 conn(0x7fdbb80c8970 msgr2=0x7fdbb806c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:25.093 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:25.105+0000 7fdbc05d5700 1 -- 172.21.15.42:0/1423135363 shutdown_connections 2023-07-29T02:01:25.093 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:25.105+0000 7fdbc05d5700 1 -- 172.21.15.42:0/1423135363 wait complete. 2023-07-29T02:01:25.094 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 10 2023-07-29T02:01:25.104 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2023-07-29T02:01:27.104 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:01:27.241 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.254+0000 7fa207862700 1 Processor -- start 2023-07-29T02:01:27.241 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.254+0000 7fa207862700 1 -- start start 2023-07-29T02:01:27.242 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.255+0000 7fa207862700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa2000cf460 0x7fa2000b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.255+0000 7fa207862700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa200159cb0 0x7fa20015a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.255+0000 7fa207862700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2000b31d0 con 0x7fa2000cf830 2023-07-29T02:01:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.255+0000 7fa207862700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2000b3660 con 0x7fa2000cf460 2023-07-29T02:01:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.255+0000 7fa207862700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20015a1a0 con 0x7fa200159cb0 2023-07-29T02:01:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.255+0000 7fa2055fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa2000cf460 0x7fa2000b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.255+0000 7fa205dff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa2000cf830 0x7fa2001563e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51110/0 (socket says 172.21.15.42:51110) 2023-07-29T02:01:27.243 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.255+0000 7fa205dff700 1 -- 172.21.15.42:0/1069596480 learned_addr learned my addr 172.21.15.42:0/1069596480 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:01:27.244 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.255+0000 7fa204dfd700 1 --2- 172.21.15.42:0/1069596480 >> v2:172.21.15.144:3300/0 conn(0x7fa200159cb0 0x7fa20015a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:27.244 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.256+0000 7fa2055fe700 1 -- 172.21.15.42:0/1069596480 >> v2:172.21.15.144:3300/0 conn(0x7fa200159cb0 msgr2=0x7fa20015a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:27.244 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.256+0000 7fa2055fe700 1 --2- 172.21.15.42:0/1069596480 >> v2:172.21.15.144:3300/0 conn(0x7fa200159cb0 0x7fa20015a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:27.244 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.256+0000 7fa2055fe700 1 -- 172.21.15.42:0/1069596480 >> v1:172.21.15.42:6789/0 conn(0x7fa2000cf830 legacy=0x7fa2001563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:27.244 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.256+0000 7fa2055fe700 1 -- 172.21.15.42:0/1069596480 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2000b2600 con 0x7fa2000cf460 2023-07-29T02:01:27.244 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.256+0000 7fa2055fe700 1 --2- 172.21.15.42:0/1069596480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2000cf460 0x7fa2000b4c30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa2000c9090 tx=0x7fa1fc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bd028d8cf3da8c server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:27.244 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.256+0000 7fa1f7fff700 1 -- 172.21.15.42:0/1069596480 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc011830 con 0x7fa2000cf460 2023-07-29T02:01:27.245 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.256+0000 7fa1f7fff700 1 -- 172.21.15.42:0/1069596480 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1fc011990 con 0x7fa2000cf460 2023-07-29T02:01:27.245 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.256+0000 7fa1f7fff700 1 -- 172.21.15.42:0/1069596480 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc011d20 con 0x7fa2000cf460 2023-07-29T02:01:27.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.257+0000 7fa207862700 1 -- 172.21.15.42:0/1069596480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2000cf460 msgr2=0x7fa2000b4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:27.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.257+0000 7fa207862700 1 --2- 172.21.15.42:0/1069596480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2000cf460 0x7fa2000b4c30 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa2000c9090 tx=0x7fa1fc009b20 comp rx=0 tx=0).stop 2023-07-29T02:01:27.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.257+0000 7fa207862700 1 -- 172.21.15.42:0/1069596480 shutdown_connections 2023-07-29T02:01:27.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.257+0000 7fa207862700 1 --2- 172.21.15.42:0/1069596480 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2000cf460 0x7fa2000b4c30 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:27.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.257+0000 7fa207862700 1 --2- 172.21.15.42:0/1069596480 >> v2:172.21.15.144:3300/0 conn(0x7fa200159cb0 0x7fa20015a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:27.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.257+0000 7fa207862700 1 -- 172.21.15.42:0/1069596480 >> 172.21.15.42:0/1069596480 conn(0x7fa20006ca60 msgr2=0x7fa20006ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:27.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.257+0000 7fa207862700 1 -- 172.21.15.42:0/1069596480 shutdown_connections 2023-07-29T02:01:27.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.257+0000 7fa207862700 1 -- 172.21.15.42:0/1069596480 wait complete. 2023-07-29T02:01:27.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.258+0000 7fa207862700 1 Processor -- start 2023-07-29T02:01:27.249 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.258+0000 7fa207862700 1 -- start start 2023-07-29T02:01:27.249 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.259+0000 7fa207862700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2000cf460 0x7fa2001588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:27.249 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.259+0000 7fa207862700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa2000cf830 0x7fa200150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:27.249 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.259+0000 7fa207862700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa200159cb0 0x7fa2001e2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:27.249 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.259+0000 7fa207862700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2000ca380 con 0x7fa2000cf460 2023-07-29T02:01:27.249 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.259+0000 7fa207862700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa200150e60 con 0x7fa200159cb0 2023-07-29T02:01:27.249 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.259+0000 7fa207862700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2001e2d70 con 0x7fa2000cf830 2023-07-29T02:01:27.250 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.259+0000 7fa2055fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2000cf460 0x7fa2001588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:27.250 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.259+0000 7fa2055fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2000cf460 0x7fa2001588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57308/0 (socket says 172.21.15.42:57308) 2023-07-29T02:01:27.250 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.259+0000 7fa2055fe700 1 -- 172.21.15.42:0/2814489727 learned_addr learned my addr 172.21.15.42:0/2814489727 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:27.250 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.259+0000 7fa205dff700 1 --2- 172.21.15.42:0/2814489727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa200159cb0 0x7fa2001e2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:27.250 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.259+0000 7fa204dfd700 1 --2- 172.21.15.42:0/2814489727 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa2000cf830 0x7fa200150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:27.250 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.259+0000 7fa2055fe700 1 -- 172.21.15.42:0/2814489727 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa2000cf830 msgr2=0x7fa200150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:27.250 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.259+0000 7fa2055fe700 1 --2- 172.21.15.42:0/2814489727 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa2000cf830 0x7fa200150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.259+0000 7fa2055fe700 1 -- 172.21.15.42:0/2814489727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa200159cb0 msgr2=0x7fa2001e2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.259+0000 7fa2055fe700 1 --2- 172.21.15.42:0/2814489727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa200159cb0 0x7fa2001e2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.259+0000 7fa2055fe700 1 -- 172.21.15.42:0/2814489727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1fc0094a0 con 0x7fa2000cf460 2023-07-29T02:01:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.259+0000 7fa205dff700 1 --2- 172.21.15.42:0/2814489727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa200159cb0 0x7fa2001e2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:01:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.259+0000 7fa2055fe700 1 --2- 172.21.15.42:0/2814489727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2000cf460 0x7fa2001588d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc000c00 tx=0x7fa1fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.259+0000 7fa1f5ffb700 1 -- 172.21.15.42:0/2814489727 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc0036a0 con 0x7fa2000cf460 2023-07-29T02:01:27.251 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.259+0000 7fa1f5ffb700 1 -- 172.21.15.42:0/2814489727 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1fc01e070 con 0x7fa2000cf460 2023-07-29T02:01:27.252 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.260+0000 7fa1f5ffb700 1 -- 172.21.15.42:0/2814489727 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc003a60 con 0x7fa2000cf460 2023-07-29T02:01:27.252 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.260+0000 7fa207862700 1 -- 172.21.15.42:0/2814489727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2001f2010 con 0x7fa2000cf460 2023-07-29T02:01:27.252 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.260+0000 7fa207862700 1 -- 172.21.15.42:0/2814489727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2001f25d0 con 0x7fa2000cf460 2023-07-29T02:01:27.252 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.261+0000 7fa207862700 1 -- 172.21.15.42:0/2814489727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa20004ea50 con 0x7fa2000cf460 2023-07-29T02:01:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.261+0000 7fa1f5ffb700 1 -- 172.21.15.42:0/2814489727 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fa1fc003bc0 con 0x7fa2000cf460 2023-07-29T02:01:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.262+0000 7fa1f5ffb700 1 --2- 172.21.15.42:0/2814489727 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa1e406a660 0x7fa1e406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.262+0000 7fa1f5ffb700 1 -- 172.21.15.42:0/2814489727 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6850+0+0 (secure 0 0 0) 0x7fa1fc089f40 con 0x7fa2000cf460 2023-07-29T02:01:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.262+0000 7fa204dfd700 1 --2- 172.21.15.42:0/2814489727 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa1e406a660 0x7fa1e406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.262+0000 7fa204dfd700 1 --2- 172.21.15.42:0/2814489727 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa1e406a660 0x7fa1e406cb10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa2001e3900 tx=0x7fa1f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:27.254 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.266+0000 7fa1f5ffb700 1 -- 172.21.15.42:0/2814489727 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fa1fc055010 con 0x7fa2000cf460 2023-07-29T02:01:27.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.512+0000 7fa207862700 1 -- 172.21.15.42:0/2814489727 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2000b38d0 con 0x7fa2000cf460 2023-07-29T02:01:27.499 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.512+0000 7fa1f5ffb700 1 -- 172.21.15.42:0/2814489727 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6165 (secure 0 0 0) 0x7fa1fc020090 con 0x7fa2000cf460 2023-07-29T02:01:27.499 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:01:27.499 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:00:26.432410+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6837/1851767861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1851767861},{"type":"v1","addr":"172.21.15.42:6837","nonce":1851767861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:01:27.501 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.514+0000 7fa207862700 1 -- 172.21.15.42:0/2814489727 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa1e406a660 msgr2=0x7fa1e406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:27.501 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.514+0000 7fa207862700 1 --2- 172.21.15.42:0/2814489727 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa1e406a660 0x7fa1e406cb10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa2001e3900 tx=0x7fa1f0008040 comp rx=0 tx=0).stop 2023-07-29T02:01:27.502 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.514+0000 7fa207862700 1 -- 172.21.15.42:0/2814489727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2000cf460 msgr2=0x7fa2001588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:27.502 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.514+0000 7fa207862700 1 --2- 172.21.15.42:0/2814489727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2000cf460 0x7fa2001588d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc000c00 tx=0x7fa1fc004750 comp rx=0 tx=0).stop 2023-07-29T02:01:27.502 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.515+0000 7fa207862700 1 -- 172.21.15.42:0/2814489727 shutdown_connections 2023-07-29T02:01:27.502 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.515+0000 7fa207862700 1 --2- 172.21.15.42:0/2814489727 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa1e406a660 0x7fa1e406cb10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:27.502 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.515+0000 7fa207862700 1 --2- 172.21.15.42:0/2814489727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa200159cb0 0x7fa2001e2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:27.502 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.515+0000 7fa207862700 1 --2- 172.21.15.42:0/2814489727 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa2000cf460 0x7fa2001588d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:27.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.515+0000 7fa207862700 1 --2- 172.21.15.42:0/2814489727 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa2000cf830 0x7fa200150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:27.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.515+0000 7fa207862700 1 -- 172.21.15.42:0/2814489727 >> 172.21.15.42:0/2814489727 conn(0x7fa20006ca60 msgr2=0x7fa2001e41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:27.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.515+0000 7fa207862700 1 -- 172.21.15.42:0/2814489727 shutdown_connections 2023-07-29T02:01:27.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:27.515+0000 7fa207862700 1 -- 172.21.15.42:0/2814489727 wait complete. 2023-07-29T02:01:27.503 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 10 2023-07-29T02:01:27.513 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2023-07-29T02:01:29.514 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:01:29.653 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.667+0000 7fc438a43700 1 Processor -- start 2023-07-29T02:01:29.654 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.667+0000 7fc438a43700 1 -- start start 2023-07-29T02:01:29.655 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.668+0000 7fc438a43700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc434153210 0x7fc4340c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:29.655 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.668+0000 7fc438a43700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc4340c6980 0x7fc43415cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:29.655 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.668+0000 7fc438a43700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4340c7b00 con 0x7fc4340cc820 2023-07-29T02:01:29.655 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.668+0000 7fc438a43700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc434159be0 con 0x7fc4340c6980 2023-07-29T02:01:29.655 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.668+0000 7fc438a43700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc434159ec0 con 0x7fc434153210 2023-07-29T02:01:29.655 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.668+0000 7fc43259c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc434153210 0x7fc4340c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:29.656 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.668+0000 7fc43259c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc434153210 0x7fc4340c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:57830/0 (socket says 172.21.15.42:57830) 2023-07-29T02:01:29.656 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.668+0000 7fc432d9d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc4340c6980 0x7fc43415cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:29.656 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.668+0000 7fc43259c700 1 -- 172.21.15.42:0/1224060812 learned_addr learned my addr 172.21.15.42:0/1224060812 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:29.657 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.669+0000 7fc43259c700 1 -- 172.21.15.42:0/1224060812 >> v2:172.21.15.144:3300/0 conn(0x7fc4340c6980 msgr2=0x7fc43415cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:29.657 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.669+0000 7fc43259c700 1 --2- 172.21.15.42:0/1224060812 >> v2:172.21.15.144:3300/0 conn(0x7fc4340c6980 0x7fc43415cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:29.657 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.669+0000 7fc43259c700 1 -- 172.21.15.42:0/1224060812 >> v1:172.21.15.144:6789/0 conn(0x7fc4340cc820 legacy=0x7fc43415c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:29.657 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.669+0000 7fc43259c700 1 -- 172.21.15.42:0/1224060812 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4340c71d0 con 0x7fc434153210 2023-07-29T02:01:29.658 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.669+0000 7fc432d9d700 1 --2- 172.21.15.42:0/1224060812 >> v2:172.21.15.144:3300/0 conn(0x7fc4340c6980 0x7fc43415cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:01:29.658 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.669+0000 7fc43259c700 1 --2- 172.21.15.42:0/1224060812 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc434153210 0x7fc4340c7f90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc4240098f0 tx=0x7fc424009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de36e90b5523b440 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:29.658 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.669+0000 7fc43159a700 1 -- 172.21.15.42:0/1224060812 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424011830 con 0x7fc434153210 2023-07-29T02:01:29.658 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.669+0000 7fc43159a700 1 -- 172.21.15.42:0/1224060812 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc424011990 con 0x7fc434153210 2023-07-29T02:01:29.658 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.669+0000 7fc43159a700 1 -- 172.21.15.42:0/1224060812 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc424011d20 con 0x7fc434153210 2023-07-29T02:01:29.658 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.670+0000 7fc438a43700 1 -- 172.21.15.42:0/1224060812 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc434153210 msgr2=0x7fc4340c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:29.658 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.670+0000 7fc438a43700 1 --2- 172.21.15.42:0/1224060812 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc434153210 0x7fc4340c7f90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc4240098f0 tx=0x7fc424009c00 comp rx=0 tx=0).stop 2023-07-29T02:01:29.659 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.670+0000 7fc438a43700 1 -- 172.21.15.42:0/1224060812 shutdown_connections 2023-07-29T02:01:29.659 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.670+0000 7fc438a43700 1 --2- 172.21.15.42:0/1224060812 >> v2:172.21.15.144:3300/0 conn(0x7fc4340c6980 0x7fc43415cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:29.659 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.670+0000 7fc438a43700 1 --2- 172.21.15.42:0/1224060812 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc434153210 0x7fc4340c7f90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:29.659 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.670+0000 7fc438a43700 1 -- 172.21.15.42:0/1224060812 >> 172.21.15.42:0/1224060812 conn(0x7fc43406f850 msgr2=0x7fc4340cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:29.659 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.670+0000 7fc438a43700 1 -- 172.21.15.42:0/1224060812 shutdown_connections 2023-07-29T02:01:29.659 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.670+0000 7fc438a43700 1 -- 172.21.15.42:0/1224060812 wait complete. 2023-07-29T02:01:29.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.671+0000 7fc438a43700 1 Processor -- start 2023-07-29T02:01:29.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.671+0000 7fc438a43700 1 -- start start 2023-07-29T02:01:29.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.672+0000 7fc438a43700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4340c6980 0x7fc43415ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:29.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.672+0000 7fc438a43700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc434153210 0x7fc4340c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:29.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.672+0000 7fc438a43700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4340ca3c0 0x7fc43414b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:29.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.672+0000 7fc438a43700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43415a520 con 0x7fc4340ca3c0 2023-07-29T02:01:29.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.672+0000 7fc438a43700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43415a240 con 0x7fc4340c6980 2023-07-29T02:01:29.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.672+0000 7fc438a43700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43415b400 con 0x7fc434153210 2023-07-29T02:01:29.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.672+0000 7fc432d9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4340ca3c0 0x7fc43414b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:29.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.672+0000 7fc432d9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4340ca3c0 0x7fc43414b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57326/0 (socket says 172.21.15.42:57326) 2023-07-29T02:01:29.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.672+0000 7fc432d9d700 1 -- 172.21.15.42:0/1083117685 learned_addr learned my addr 172.21.15.42:0/1083117685 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:29.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.672+0000 7fc43259c700 1 --2- 172.21.15.42:0/1083117685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4340c6980 0x7fc43415ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:29.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.672+0000 7fc431d9b700 1 --2- 172.21.15.42:0/1083117685 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc434153210 0x7fc4340c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:29.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.673+0000 7fc432d9d700 1 -- 172.21.15.42:0/1083117685 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc434153210 msgr2=0x7fc4340c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:29.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.673+0000 7fc432d9d700 1 --2- 172.21.15.42:0/1083117685 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc434153210 0x7fc4340c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:29.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.673+0000 7fc432d9d700 1 -- 172.21.15.42:0/1083117685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4340c6980 msgr2=0x7fc43415ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:29.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.673+0000 7fc432d9d700 1 --2- 172.21.15.42:0/1083117685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4340c6980 0x7fc43415ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:29.664 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.673+0000 7fc432d9d700 1 -- 172.21.15.42:0/1083117685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c009a70 con 0x7fc4340ca3c0 2023-07-29T02:01:29.664 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.673+0000 7fc43259c700 1 --2- 172.21.15.42:0/1083117685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4340c6980 0x7fc43415ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:01:29.664 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.673+0000 7fc431d9b700 1 --2- 172.21.15.42:0/1083117685 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc434153210 0x7fc4340c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:01:29.664 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.673+0000 7fc432d9d700 1 --2- 172.21.15.42:0/1083117685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4340ca3c0 0x7fc43414b360 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00efc0 tx=0x7fc42c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:29.664 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.673+0000 7fc422ffd700 1 -- 172.21.15.42:0/1083117685 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c009d70 con 0x7fc4340ca3c0 2023-07-29T02:01:29.664 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.673+0000 7fc422ffd700 1 -- 172.21.15.42:0/1083117685 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42c00f040 con 0x7fc4340ca3c0 2023-07-29T02:01:29.664 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.673+0000 7fc438a43700 1 -- 172.21.15.42:0/1083117685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc424009550 con 0x7fc4340ca3c0 2023-07-29T02:01:29.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.673+0000 7fc422ffd700 1 -- 172.21.15.42:0/1083117685 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c00ce00 con 0x7fc4340ca3c0 2023-07-29T02:01:29.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.673+0000 7fc438a43700 1 -- 172.21.15.42:0/1083117685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43415b9c0 con 0x7fc4340ca3c0 2023-07-29T02:01:29.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.674+0000 7fc438a43700 1 -- 172.21.15.42:0/1083117685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc43415b150 con 0x7fc4340ca3c0 2023-07-29T02:01:29.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.674+0000 7fc422ffd700 1 -- 172.21.15.42:0/1083117685 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fc42c014480 con 0x7fc4340ca3c0 2023-07-29T02:01:29.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.675+0000 7fc422ffd700 1 --2- 172.21.15.42:0/1083117685 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc41406a660 0x7fc41406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:29.665 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.675+0000 7fc422ffd700 1 -- 172.21.15.42:0/1083117685 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6850+0+0 (secure 0 0 0) 0x7fc42c089520 con 0x7fc4340ca3c0 2023-07-29T02:01:29.666 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.675+0000 7fc43259c700 1 --2- 172.21.15.42:0/1083117685 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc41406a660 0x7fc41406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:29.666 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.676+0000 7fc43259c700 1 --2- 172.21.15.42:0/1083117685 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc41406a660 0x7fc41406cb10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc424000c00 tx=0x7fc424008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:29.666 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.679+0000 7fc422ffd700 1 -- 172.21.15.42:0/1083117685 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fc42c054690 con 0x7fc4340ca3c0 2023-07-29T02:01:29.920 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.933+0000 7fc438a43700 1 -- 172.21.15.42:0/1083117685 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc43404ea50 con 0x7fc4340ca3c0 2023-07-29T02:01:29.921 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.934+0000 7fc422ffd700 1 -- 172.21.15.42:0/1083117685 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6165 (secure 0 0 0) 0x7fc42c057cb0 con 0x7fc4340ca3c0 2023-07-29T02:01:29.921 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:01:29.921 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:00:26.432410+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6837/1851767861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1851767861},{"type":"v1","addr":"172.21.15.42:6837","nonce":1851767861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:01:29.923 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.936+0000 7fc438a43700 1 -- 172.21.15.42:0/1083117685 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc41406a660 msgr2=0x7fc41406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:29.923 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.936+0000 7fc438a43700 1 --2- 172.21.15.42:0/1083117685 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc41406a660 0x7fc41406cb10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc424000c00 tx=0x7fc424008030 comp rx=0 tx=0).stop 2023-07-29T02:01:29.923 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.936+0000 7fc438a43700 1 -- 172.21.15.42:0/1083117685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4340ca3c0 msgr2=0x7fc43414b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:29.923 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.936+0000 7fc438a43700 1 --2- 172.21.15.42:0/1083117685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4340ca3c0 0x7fc43414b360 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00efc0 tx=0x7fc42c00c3a0 comp rx=0 tx=0).stop 2023-07-29T02:01:29.923 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.936+0000 7fc438a43700 1 -- 172.21.15.42:0/1083117685 shutdown_connections 2023-07-29T02:01:29.923 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.936+0000 7fc438a43700 1 --2- 172.21.15.42:0/1083117685 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc41406a660 0x7fc41406cb10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:29.924 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.936+0000 7fc438a43700 1 --2- 172.21.15.42:0/1083117685 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc4340ca3c0 0x7fc43414b360 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:29.924 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.936+0000 7fc438a43700 1 --2- 172.21.15.42:0/1083117685 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc4340c6980 0x7fc43415ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:29.924 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.936+0000 7fc438a43700 1 --2- 172.21.15.42:0/1083117685 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc434153210 0x7fc4340c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:29.924 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.936+0000 7fc438a43700 1 -- 172.21.15.42:0/1083117685 >> 172.21.15.42:0/1083117685 conn(0x7fc43406f850 msgr2=0x7fc434071270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:29.924 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.936+0000 7fc438a43700 1 -- 172.21.15.42:0/1083117685 shutdown_connections 2023-07-29T02:01:29.924 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:29.936+0000 7fc438a43700 1 -- 172.21.15.42:0/1083117685 wait complete. 2023-07-29T02:01:29.925 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 10 2023-07-29T02:01:29.935 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2023-07-29T02:01:31.936 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:01:32.075 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.088+0000 7fe5f1c0e700 1 Processor -- start 2023-07-29T02:01:32.075 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.088+0000 7fe5f1c0e700 1 -- start start 2023-07-29T02:01:32.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.089+0000 7fe5f1c0e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe5ec156740 0x7fe5ec1597a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:32.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.089+0000 7fe5f1c0e700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe5ec06db60 0x7fe5ec159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:32.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.089+0000 7fe5f1c0e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ec159310 con 0x7fe5ec072a90 2023-07-29T02:01:32.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.089+0000 7fe5f1c0e700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5ec06a850 con 0x7fe5ec06db60 2023-07-29T02:01:32.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.089+0000 7fe5f1c0e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5ec06bea0 con 0x7fe5ec156740 2023-07-29T02:01:32.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.089+0000 7fe5ebfff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe5ec06db60 0x7fe5ec159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:32.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.089+0000 7fe5ebfff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe5ec06db60 0x7fe5ec159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57336/0 (socket says 172.21.15.42:57336) 2023-07-29T02:01:32.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.089+0000 7fe5ebfff700 1 -- 172.21.15.42:0/4271702591 learned_addr learned my addr 172.21.15.42:0/4271702591 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:32.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.089+0000 7fe5eb7fe700 1 --2- 172.21.15.42:0/4271702591 >> v2:172.21.15.144:3300/0 conn(0x7fe5ec156740 0x7fe5ec1597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:32.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.090+0000 7fe5ebfff700 1 -- 172.21.15.42:0/4271702591 >> v2:172.21.15.144:3300/0 conn(0x7fe5ec156740 msgr2=0x7fe5ec1597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:32.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.090+0000 7fe5ebfff700 1 --2- 172.21.15.42:0/4271702591 >> v2:172.21.15.144:3300/0 conn(0x7fe5ec156740 0x7fe5ec1597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.090+0000 7fe5ebfff700 1 -- 172.21.15.42:0/4271702591 >> v1:172.21.15.144:6789/0 conn(0x7fe5ec072a90 legacy=0x7fe5ec06cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.090+0000 7fe5ebfff700 1 -- 172.21.15.42:0/4271702591 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec06b5d0 con 0x7fe5ec06db60 2023-07-29T02:01:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.090+0000 7fe5eb7fe700 1 --2- 172.21.15.42:0/4271702591 >> v2:172.21.15.144:3300/0 conn(0x7fe5ec156740 0x7fe5ec1597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:01:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.090+0000 7fe5ebfff700 1 --2- 172.21.15.42:0/4271702591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5ec06db60 0x7fe5ec159ce0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec070920 tx=0x7fe5e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2543c472747c15 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.090+0000 7fe5ea7fc700 1 -- 172.21.15.42:0/4271702591 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e400e070 con 0x7fe5ec06db60 2023-07-29T02:01:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.090+0000 7fe5ea7fc700 1 -- 172.21.15.42:0/4271702591 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e4003a20 con 0x7fe5ec06db60 2023-07-29T02:01:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.090+0000 7fe5ea7fc700 1 -- 172.21.15.42:0/4271702591 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4003dd0 con 0x7fe5ec06db60 2023-07-29T02:01:32.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.090+0000 7fe5f1c0e700 1 -- 172.21.15.42:0/4271702591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5ec06db60 msgr2=0x7fe5ec159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:32.080 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.090+0000 7fe5f1c0e700 1 --2- 172.21.15.42:0/4271702591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5ec06db60 0x7fe5ec159ce0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec070920 tx=0x7fe5e400b330 comp rx=0 tx=0).stop 2023-07-29T02:01:32.080 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.090+0000 7fe5f1c0e700 1 -- 172.21.15.42:0/4271702591 shutdown_connections 2023-07-29T02:01:32.080 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.090+0000 7fe5f1c0e700 1 --2- 172.21.15.42:0/4271702591 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5ec06db60 0x7fe5ec159ce0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:32.080 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.090+0000 7fe5f1c0e700 1 --2- 172.21.15.42:0/4271702591 >> v2:172.21.15.144:3300/0 conn(0x7fe5ec156740 0x7fe5ec1597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:32.080 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.090+0000 7fe5f1c0e700 1 -- 172.21.15.42:0/4271702591 >> 172.21.15.42:0/4271702591 conn(0x7fe5ec0c8970 msgr2=0x7fe5ec0c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:32.080 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.091+0000 7fe5f1c0e700 1 -- 172.21.15.42:0/4271702591 shutdown_connections 2023-07-29T02:01:32.080 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.091+0000 7fe5f1c0e700 1 -- 172.21.15.42:0/4271702591 wait complete. 2023-07-29T02:01:32.083 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.092+0000 7fe5f1c0e700 1 Processor -- start 2023-07-29T02:01:32.083 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.092+0000 7fe5f1c0e700 1 -- start start 2023-07-29T02:01:32.083 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.093+0000 7fe5f1c0e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5ec06db60 0x7fe5ec1555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:32.083 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.093+0000 7fe5f1c0e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5ec072a90 0x7fe5ec1587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:32.083 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.093+0000 7fe5f1c0e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5ec156740 0x7fe5ec158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:32.083 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.093+0000 7fe5f1c0e700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec0cbbc0 con 0x7fe5ec072a90 2023-07-29T02:01:32.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.093+0000 7fe5f1c0e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec0c9cd0 con 0x7fe5ec156740 2023-07-29T02:01:32.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.093+0000 7fe5f1c0e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec157270 con 0x7fe5ec06db60 2023-07-29T02:01:32.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.093+0000 7fe5eaffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5ec072a90 0x7fe5ec1587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:32.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.093+0000 7fe5eaffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5ec072a90 0x7fe5ec1587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57340/0 (socket says 172.21.15.42:57340) 2023-07-29T02:01:32.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.093+0000 7fe5eaffd700 1 -- 172.21.15.42:0/3940390150 learned_addr learned my addr 172.21.15.42:0/3940390150 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:32.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.093+0000 7fe5eb7fe700 1 --2- 172.21.15.42:0/3940390150 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5ec06db60 0x7fe5ec1555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:32.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.093+0000 7fe5ebfff700 1 --2- 172.21.15.42:0/3940390150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5ec156740 0x7fe5ec158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:32.085 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.093+0000 7fe5eaffd700 1 -- 172.21.15.42:0/3940390150 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5ec06db60 msgr2=0x7fe5ec1555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:32.085 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.093+0000 7fe5eaffd700 1 --2- 172.21.15.42:0/3940390150 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5ec06db60 0x7fe5ec1555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:32.085 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.093+0000 7fe5eaffd700 1 -- 172.21.15.42:0/3940390150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5ec156740 msgr2=0x7fe5ec158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:32.085 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.093+0000 7fe5eaffd700 1 --2- 172.21.15.42:0/3940390150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5ec156740 0x7fe5ec158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:32.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.093+0000 7fe5eaffd700 1 -- 172.21.15.42:0/3940390150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e4009b30 con 0x7fe5ec072a90 2023-07-29T02:01:32.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.093+0000 7fe5ebfff700 1 --2- 172.21.15.42:0/3940390150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5ec156740 0x7fe5ec158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:01:32.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.093+0000 7fe5eaffd700 1 --2- 172.21.15.42:0/3940390150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5ec072a90 0x7fe5ec1587e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe5d400c500 tx=0x7fe5d400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:32.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.094+0000 7fe5e3fff700 1 -- 172.21.15.42:0/3940390150 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4011790 con 0x7fe5ec072a90 2023-07-29T02:01:32.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.094+0000 7fe5e3fff700 1 -- 172.21.15.42:0/3940390150 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d40118f0 con 0x7fe5ec072a90 2023-07-29T02:01:32.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.094+0000 7fe5f1c0e700 1 -- 172.21.15.42:0/3940390150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ec0c9f00 con 0x7fe5ec072a90 2023-07-29T02:01:32.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.094+0000 7fe5e3fff700 1 -- 172.21.15.42:0/3940390150 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4011ca0 con 0x7fe5ec072a90 2023-07-29T02:01:32.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.094+0000 7fe5f1c0e700 1 -- 172.21.15.42:0/3940390150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ec156cb0 con 0x7fe5ec072a90 2023-07-29T02:01:32.087 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.095+0000 7fe5f1c0e700 1 -- 172.21.15.42:0/3940390150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ec074740 con 0x7fe5ec072a90 2023-07-29T02:01:32.087 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.095+0000 7fe5e3fff700 1 -- 172.21.15.42:0/3940390150 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fe5d401c460 con 0x7fe5ec072a90 2023-07-29T02:01:32.087 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.096+0000 7fe5e3fff700 1 --2- 172.21.15.42:0/3940390150 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe5cc06a690 0x7fe5cc06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:32.087 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.096+0000 7fe5e3fff700 1 -- 172.21.15.42:0/3940390150 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6850+0+0 (secure 0 0 0) 0x7fe5d4088ae0 con 0x7fe5ec072a90 2023-07-29T02:01:32.087 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.096+0000 7fe5eb7fe700 1 --2- 172.21.15.42:0/3940390150 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe5cc06a690 0x7fe5cc06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:32.087 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.096+0000 7fe5eb7fe700 1 --2- 172.21.15.42:0/3940390150 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe5cc06a690 0x7fe5cc06cb40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc006fd0 tx=0x7fe5dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:32.088 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.100+0000 7fe5e3fff700 1 -- 172.21.15.42:0/3940390150 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fe5d4053bc0 con 0x7fe5ec072a90 2023-07-29T02:01:32.337 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.350+0000 7fe5f1c0e700 1 -- 172.21.15.42:0/3940390150 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5ec04ea50 con 0x7fe5ec072a90 2023-07-29T02:01:32.337 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.351+0000 7fe5e3fff700 1 -- 172.21.15.42:0/3940390150 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+6165 (secure 0 0 0) 0x7fe5d40571e0 con 0x7fe5ec072a90 2023-07-29T02:01:32.338 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:01:32.338 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:00:26.432410+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"e","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.42:6837/1851767861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":1851767861},{"type":"v1","addr":"172.21.15.42:6837","nonce":1851767861}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:01:32.340 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.353+0000 7fe5f1c0e700 1 -- 172.21.15.42:0/3940390150 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe5cc06a690 msgr2=0x7fe5cc06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:32.340 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.353+0000 7fe5f1c0e700 1 --2- 172.21.15.42:0/3940390150 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe5cc06a690 0x7fe5cc06cb40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc006fd0 tx=0x7fe5dc008040 comp rx=0 tx=0).stop 2023-07-29T02:01:32.340 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.353+0000 7fe5f1c0e700 1 -- 172.21.15.42:0/3940390150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5ec072a90 msgr2=0x7fe5ec1587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:32.340 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.353+0000 7fe5f1c0e700 1 --2- 172.21.15.42:0/3940390150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5ec072a90 0x7fe5ec1587e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe5d400c500 tx=0x7fe5d400c810 comp rx=0 tx=0).stop 2023-07-29T02:01:32.340 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.353+0000 7fe5f1c0e700 1 -- 172.21.15.42:0/3940390150 shutdown_connections 2023-07-29T02:01:32.341 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.353+0000 7fe5f1c0e700 1 --2- 172.21.15.42:0/3940390150 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe5cc06a690 0x7fe5cc06cb40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:32.341 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.353+0000 7fe5f1c0e700 1 --2- 172.21.15.42:0/3940390150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5ec156740 0x7fe5ec158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:32.341 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.353+0000 7fe5f1c0e700 1 --2- 172.21.15.42:0/3940390150 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe5ec06db60 0x7fe5ec1555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:32.341 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.353+0000 7fe5f1c0e700 1 --2- 172.21.15.42:0/3940390150 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe5ec072a90 0x7fe5ec1587e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:32.341 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.353+0000 7fe5f1c0e700 1 -- 172.21.15.42:0/3940390150 >> 172.21.15.42:0/3940390150 conn(0x7fe5ec0c8970 msgr2=0x7fe5ec1598a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:32.341 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.353+0000 7fe5f1c0e700 1 -- 172.21.15.42:0/3940390150 shutdown_connections 2023-07-29T02:01:32.341 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:32.353+0000 7fe5f1c0e700 1 -- 172.21.15.42:0/3940390150 wait complete. 2023-07-29T02:01:32.342 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 10 2023-07-29T02:01:32.352 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2023-07-29T02:01:34.354 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:01:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.510+0000 7f026fbfb700 1 Processor -- start 2023-07-29T02:01:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.510+0000 7f026fbfb700 1 -- start start 2023-07-29T02:01:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.510+0000 7f026fbfb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02680cf460 0x7f02680b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.510+0000 7f026fbfb700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0268159cb0 0x7f026815a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.511+0000 7f026fbfb700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02680b31d0 con 0x7f02680cf830 2023-07-29T02:01:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.511+0000 7f026fbfb700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02680b3660 con 0x7f0268159cb0 2023-07-29T02:01:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.511+0000 7f026fbfb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026815a1a0 con 0x7f02680cf460 2023-07-29T02:01:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.511+0000 7f026e198700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f02680cf830 0x7f02681563e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51154/0 (socket says 172.21.15.42:51154) 2023-07-29T02:01:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.511+0000 7f026e198700 1 -- 172.21.15.42:0/1336210038 learned_addr learned my addr 172.21.15.42:0/1336210038 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:01:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.511+0000 7f026d997700 1 --2- 172.21.15.42:0/1336210038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02680cf460 0x7f02680b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.511+0000 7f026d196700 1 --2- 172.21.15.42:0/1336210038 >> v2:172.21.15.144:3300/0 conn(0x7f0268159cb0 0x7f026815a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.511+0000 7f026c995700 1 -- 172.21.15.42:0/1336210038 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868784173 0 0) 0x7f02680b31d0 con 0x7f02680cf830 2023-07-29T02:01:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.511+0000 7f026c995700 1 -- 172.21.15.42:0/1336210038 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02540035b0 con 0x7f02680cf830 2023-07-29T02:01:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.511+0000 7f026d196700 1 -- 172.21.15.42:0/1336210038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02680cf460 msgr2=0x7f02680b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.511+0000 7f026d196700 1 --2- 172.21.15.42:0/1336210038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02680cf460 0x7f02680b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:34.499 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.511+0000 7f026d196700 1 -- 172.21.15.42:0/1336210038 >> v1:172.21.15.42:6789/0 conn(0x7f02680cf830 legacy=0x7f02681563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:34.500 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.511+0000 7f026d196700 1 -- 172.21.15.42:0/1336210038 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02680b2600 con 0x7f0268159cb0 2023-07-29T02:01:34.500 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.511+0000 7f026d997700 1 --2- 172.21.15.42:0/1336210038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02680cf460 0x7f02680b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:01:34.500 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.511+0000 7f026d196700 1 --2- 172.21.15.42:0/1336210038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0268159cb0 0x7f026815a6a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0264009840 tx=0x7f0264009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73fd54b72995e11e server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:34.502 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.512+0000 7f026c995700 1 -- 172.21.15.42:0/1336210038 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0264011830 con 0x7f0268159cb0 2023-07-29T02:01:34.502 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.512+0000 7f026c995700 1 -- 172.21.15.42:0/1336210038 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0264011990 con 0x7f0268159cb0 2023-07-29T02:01:34.502 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.512+0000 7f026c995700 1 -- 172.21.15.42:0/1336210038 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0264011d20 con 0x7f0268159cb0 2023-07-29T02:01:34.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.512+0000 7f026fbfb700 1 -- 172.21.15.42:0/1336210038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0268159cb0 msgr2=0x7f026815a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:34.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.512+0000 7f026fbfb700 1 --2- 172.21.15.42:0/1336210038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0268159cb0 0x7f026815a6a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0264009840 tx=0x7f0264009b50 comp rx=0 tx=0).stop 2023-07-29T02:01:34.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.512+0000 7f026fbfb700 1 -- 172.21.15.42:0/1336210038 shutdown_connections 2023-07-29T02:01:34.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.512+0000 7f026fbfb700 1 --2- 172.21.15.42:0/1336210038 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02680cf460 0x7f02680b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:34.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.512+0000 7f026fbfb700 1 --2- 172.21.15.42:0/1336210038 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0268159cb0 0x7f026815a6a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:34.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.512+0000 7f026fbfb700 1 -- 172.21.15.42:0/1336210038 >> 172.21.15.42:0/1336210038 conn(0x7f026806ca60 msgr2=0x7f026806ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:34.503 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.512+0000 7f026fbfb700 1 -- 172.21.15.42:0/1336210038 shutdown_connections 2023-07-29T02:01:34.504 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.512+0000 7f026fbfb700 1 -- 172.21.15.42:0/1336210038 wait complete. 2023-07-29T02:01:34.504 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.513+0000 7f026fbfb700 1 Processor -- start 2023-07-29T02:01:34.504 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.514+0000 7f026fbfb700 1 -- start start 2023-07-29T02:01:34.504 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.514+0000 7f026fbfb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02680cf460 0x7f0268158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:34.504 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.514+0000 7f026fbfb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02680cf830 0x7f02680c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:34.504 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.514+0000 7f026fbfb700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0268159cb0 0x7f02681f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:34.504 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.514+0000 7f026fbfb700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0268157e70 con 0x7f0268159cb0 2023-07-29T02:01:34.505 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.514+0000 7f026fbfb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0268159010 con 0x7f02680cf460 2023-07-29T02:01:34.505 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.514+0000 7f026fbfb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02680c6890 con 0x7f02680cf830 2023-07-29T02:01:34.505 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.514+0000 7f026e198700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0268159cb0 0x7f02681f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:34.505 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.514+0000 7f026e198700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0268159cb0 0x7f02681f18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57356/0 (socket says 172.21.15.42:57356) 2023-07-29T02:01:34.505 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.514+0000 7f026e198700 1 -- 172.21.15.42:0/3623298939 learned_addr learned my addr 172.21.15.42:0/3623298939 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:34.505 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.514+0000 7f026d196700 1 --2- 172.21.15.42:0/3623298939 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02680cf830 0x7f02680c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:34.505 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.515+0000 7f026d997700 1 --2- 172.21.15.42:0/3623298939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02680cf460 0x7f0268158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:34.505 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.515+0000 7f026e198700 1 -- 172.21.15.42:0/3623298939 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02680cf830 msgr2=0x7f02680c7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:34.506 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.515+0000 7f026e198700 1 --2- 172.21.15.42:0/3623298939 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02680cf830 0x7f02680c7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:34.506 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.515+0000 7f026e198700 1 -- 172.21.15.42:0/3623298939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02680cf460 msgr2=0x7f0268158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:34.506 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.515+0000 7f026e198700 1 --2- 172.21.15.42:0/3623298939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02680cf460 0x7f0268158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:34.506 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.515+0000 7f026e198700 1 -- 172.21.15.42:0/3623298939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c0094a0 con 0x7f0268159cb0 2023-07-29T02:01:34.506 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.515+0000 7f026d997700 1 --2- 172.21.15.42:0/3623298939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02680cf460 0x7f0268158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:01:34.506 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.515+0000 7f026e198700 1 --2- 172.21.15.42:0/3623298939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0268159cb0 0x7f02681f18e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f026000caa0 tx=0x7f026000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:34.506 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.515+0000 7f025a7fc700 1 -- 172.21.15.42:0/3623298939 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026000a980 con 0x7f0268159cb0 2023-07-29T02:01:34.507 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.515+0000 7f025a7fc700 1 -- 172.21.15.42:0/3623298939 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026000aae0 con 0x7f0268159cb0 2023-07-29T02:01:34.507 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.515+0000 7f026fbfb700 1 -- 172.21.15.42:0/3623298939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02640094a0 con 0x7f0268159cb0 2023-07-29T02:01:34.507 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.515+0000 7f025a7fc700 1 -- 172.21.15.42:0/3623298939 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026000ae90 con 0x7f0268159cb0 2023-07-29T02:01:34.507 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.515+0000 7f026fbfb700 1 -- 172.21.15.42:0/3623298939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0268157b00 con 0x7f0268159cb0 2023-07-29T02:01:34.508 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.516+0000 7f026fbfb700 1 -- 172.21.15.42:0/3623298939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02680b3c80 con 0x7f0268159cb0 2023-07-29T02:01:34.508 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.516+0000 7f025a7fc700 1 -- 172.21.15.42:0/3623298939 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f026001b3b0 con 0x7f0268159cb0 2023-07-29T02:01:34.508 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.517+0000 7f025a7fc700 1 --2- 172.21.15.42:0/3623298939 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f024c06a660 0x7f024c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:34.508 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.517+0000 7f025a7fc700 1 -- 172.21.15.42:0/3623298939 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6936+0+0 (secure 0 0 0) 0x7f0260088b10 con 0x7f0268159cb0 2023-07-29T02:01:34.508 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.517+0000 7f026d997700 1 --2- 172.21.15.42:0/3623298939 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f024c06a660 0x7f024c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:34.509 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.517+0000 7f026d997700 1 --2- 172.21.15.42:0/3623298939 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f024c06a660 0x7f024c06cb10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f025c009d20 tx=0x7f025c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:34.509 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.521+0000 7f025a7fc700 1 -- 172.21.15.42:0/3623298939 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f02600576c0 con 0x7f0268159cb0 2023-07-29T02:01:34.755 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.769+0000 7f026fbfb700 1 -- 172.21.15.42:0/3623298939 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f026804ea50 con 0x7f0268159cb0 2023-07-29T02:01:34.756 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.769+0000 7f025a7fc700 1 -- 172.21.15.42:0/3623298939 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+5411 (secure 0 0 0) 0x7f0260057250 con 0x7f0268159cb0 2023-07-29T02:01:34.756 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:01:34.756 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:01:34.406696+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":11,"state":"up:replay","state_seq":1,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:01:34.758 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.771+0000 7f026fbfb700 1 -- 172.21.15.42:0/3623298939 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f024c06a660 msgr2=0x7f024c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:34.758 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.771+0000 7f026fbfb700 1 --2- 172.21.15.42:0/3623298939 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f024c06a660 0x7f024c06cb10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f025c009d20 tx=0x7f025c008040 comp rx=0 tx=0).stop 2023-07-29T02:01:34.758 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.771+0000 7f026fbfb700 1 -- 172.21.15.42:0/3623298939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0268159cb0 msgr2=0x7f02681f18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:34.758 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.771+0000 7f026fbfb700 1 --2- 172.21.15.42:0/3623298939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0268159cb0 0x7f02681f18e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f026000caa0 tx=0x7f026000cdb0 comp rx=0 tx=0).stop 2023-07-29T02:01:34.758 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.771+0000 7f026fbfb700 1 -- 172.21.15.42:0/3623298939 shutdown_connections 2023-07-29T02:01:34.758 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.771+0000 7f026fbfb700 1 --2- 172.21.15.42:0/3623298939 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f024c06a660 0x7f024c06cb10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:34.759 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.771+0000 7f026fbfb700 1 --2- 172.21.15.42:0/3623298939 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0268159cb0 0x7f02681f18e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:34.759 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.771+0000 7f026fbfb700 1 --2- 172.21.15.42:0/3623298939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f02680cf460 0x7f0268158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:34.759 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.771+0000 7f026fbfb700 1 --2- 172.21.15.42:0/3623298939 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f02680cf830 0x7f02680c7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:34.759 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.771+0000 7f026fbfb700 1 -- 172.21.15.42:0/3623298939 >> 172.21.15.42:0/3623298939 conn(0x7f026806ca60 msgr2=0x7f02681e3540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:34.759 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.771+0000 7f026fbfb700 1 -- 172.21.15.42:0/3623298939 shutdown_connections 2023-07-29T02:01:34.759 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.771+0000 7f026fbfb700 1 -- 172.21.15.42:0/3623298939 wait complete. 2023-07-29T02:01:34.760 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 11 2023-07-29T02:01:34.769 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e down, removed from mdsmap 2023-07-29T02:01:34.770 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2023-07-29T02:01:34.770 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:01:34.894 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.907+0000 7ff7367f0700 1 Processor -- start 2023-07-29T02:01:34.894 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.907+0000 7ff7367f0700 1 -- start start 2023-07-29T02:01:34.896 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.908+0000 7ff7367f0700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff730151030 0x7ff73006c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:34.896 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.908+0000 7ff7367f0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff730151400 0x7ff73006cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:34.896 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.908+0000 7ff7367f0700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff730157c70 con 0x7ff7300c5ee0 2023-07-29T02:01:34.896 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.908+0000 7ff7367f0700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7300c3c40 con 0x7ff730151030 2023-07-29T02:01:34.897 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.908+0000 7ff7367f0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff730156e90 con 0x7ff730151400 2023-07-29T02:01:34.897 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.908+0000 7ff72ffff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff730151030 0x7ff73006c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:34.897 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.908+0000 7ff72ffff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff730151030 0x7ff73006c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57360/0 (socket says 172.21.15.42:57360) 2023-07-29T02:01:34.897 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.908+0000 7ff72ffff700 1 -- 172.21.15.42:0/3075870989 learned_addr learned my addr 172.21.15.42:0/3075870989 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:34.897 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.908+0000 7ff72f7fe700 1 --2- 172.21.15.42:0/3075870989 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff730151400 0x7ff73006cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:34.897 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.908+0000 7ff72ffff700 1 -- 172.21.15.42:0/3075870989 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff730151400 msgr2=0x7ff73006cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:34.897 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.908+0000 7ff72ffff700 1 --2- 172.21.15.42:0/3075870989 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff730151400 0x7ff73006cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:34.898 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.908+0000 7ff72ffff700 1 -- 172.21.15.42:0/3075870989 >> v1:172.21.15.144:6789/0 conn(0x7ff7300c5ee0 legacy=0x7ff7300c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:34.898 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.909+0000 7ff72ffff700 1 -- 172.21.15.42:0/3075870989 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7301570a0 con 0x7ff730151030 2023-07-29T02:01:34.898 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.909+0000 7ff72f7fe700 1 --2- 172.21.15.42:0/3075870989 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff730151400 0x7ff73006cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:01:34.898 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.909+0000 7ff72ffff700 1 --2- 172.21.15.42:0/3075870989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff730151030 0x7ff73006c960 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff7200098f0 tx=0x7ff720009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e83d1f7a68daf2d server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:34.898 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.909+0000 7ff72effd700 1 -- 172.21.15.42:0/3075870989 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff720004230 con 0x7ff730151030 2023-07-29T02:01:34.898 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.909+0000 7ff72effd700 1 -- 172.21.15.42:0/3075870989 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff720004390 con 0x7ff730151030 2023-07-29T02:01:34.898 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.909+0000 7ff72effd700 1 -- 172.21.15.42:0/3075870989 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7200036a0 con 0x7ff730151030 2023-07-29T02:01:34.898 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.909+0000 7ff7367f0700 1 -- 172.21.15.42:0/3075870989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff730151030 msgr2=0x7ff73006c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:34.899 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.909+0000 7ff7367f0700 1 --2- 172.21.15.42:0/3075870989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff730151030 0x7ff73006c960 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff7200098f0 tx=0x7ff720009c00 comp rx=0 tx=0).stop 2023-07-29T02:01:34.899 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.910+0000 7ff7367f0700 1 -- 172.21.15.42:0/3075870989 shutdown_connections 2023-07-29T02:01:34.899 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.910+0000 7ff7367f0700 1 --2- 172.21.15.42:0/3075870989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff730151030 0x7ff73006c960 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:34.899 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.910+0000 7ff7367f0700 1 --2- 172.21.15.42:0/3075870989 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff730151400 0x7ff73006cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:34.899 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.910+0000 7ff7367f0700 1 -- 172.21.15.42:0/3075870989 >> 172.21.15.42:0/3075870989 conn(0x7ff7300c80e0 msgr2=0x7ff7300c84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:34.899 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.910+0000 7ff7367f0700 1 -- 172.21.15.42:0/3075870989 shutdown_connections 2023-07-29T02:01:34.899 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.910+0000 7ff7367f0700 1 -- 172.21.15.42:0/3075870989 wait complete. 2023-07-29T02:01:34.901 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.911+0000 7ff7367f0700 1 Processor -- start 2023-07-29T02:01:34.902 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.911+0000 7ff7367f0700 1 -- start start 2023-07-29T02:01:34.902 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff7367f0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7300c5ee0 0x7ff7301f2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:34.902 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff7367f0700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff730151030 0x7ff7301ef130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:34.902 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff7367f0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff730151400 0x7ff7301ef670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:34.902 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff7367f0700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff73014df70 con 0x7ff730151030 2023-07-29T02:01:34.902 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff7367f0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7301f1fc0 con 0x7ff730151400 2023-07-29T02:01:34.902 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff7367f0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7301f22a0 con 0x7ff7300c5ee0 2023-07-29T02:01:34.903 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff72f7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff730151030 0x7ff7301ef130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:34.903 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff72f7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff730151030 0x7ff7301ef130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57366/0 (socket says 172.21.15.42:57366) 2023-07-29T02:01:34.903 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff72f7fe700 1 -- 172.21.15.42:0/729329841 learned_addr learned my addr 172.21.15.42:0/729329841 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:34.903 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff734d8d700 1 --2- 172.21.15.42:0/729329841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff730151400 0x7ff7301ef670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:34.903 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff72ffff700 1 --2- 172.21.15.42:0/729329841 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7300c5ee0 0x7ff7301f2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:34.903 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff72f7fe700 1 -- 172.21.15.42:0/729329841 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7300c5ee0 msgr2=0x7ff7301f2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:34.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff72f7fe700 1 --2- 172.21.15.42:0/729329841 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7300c5ee0 0x7ff7301f2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:34.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff72f7fe700 1 -- 172.21.15.42:0/729329841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff730151400 msgr2=0x7ff7301ef670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:34.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff72f7fe700 1 --2- 172.21.15.42:0/729329841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff730151400 0x7ff7301ef670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:34.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff72f7fe700 1 -- 172.21.15.42:0/729329841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff720009550 con 0x7ff730151030 2023-07-29T02:01:34.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff72f7fe700 1 --2- 172.21.15.42:0/729329841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff730151030 0x7ff7301ef130 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff72400c7f0 tx=0x7ff72400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:34.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff72cff9700 1 -- 172.21.15.42:0/729329841 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff724011800 con 0x7ff730151030 2023-07-29T02:01:34.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff72cff9700 1 -- 172.21.15.42:0/729329841 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff724011960 con 0x7ff730151030 2023-07-29T02:01:34.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff7367f0700 1 -- 172.21.15.42:0/729329841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff73014e160 con 0x7ff730151030 2023-07-29T02:01:34.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff72cff9700 1 -- 172.21.15.42:0/729329841 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff724011d10 con 0x7ff730151030 2023-07-29T02:01:34.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.912+0000 7ff7367f0700 1 -- 172.21.15.42:0/729329841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff73014ea60 con 0x7ff730151030 2023-07-29T02:01:34.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.913+0000 7ff7367f0700 1 -- 172.21.15.42:0/729329841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7300c75d0 con 0x7ff730151030 2023-07-29T02:01:34.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.914+0000 7ff72cff9700 1 -- 172.21.15.42:0/729329841 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7ff72401a450 con 0x7ff730151030 2023-07-29T02:01:34.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.914+0000 7ff72cff9700 1 --2- 172.21.15.42:0/729329841 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff71c06a690 0x7ff71c06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:34.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.914+0000 7ff72cff9700 1 -- 172.21.15.42:0/729329841 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6936+0+0 (secure 0 0 0) 0x7ff724088f70 con 0x7ff730151030 2023-07-29T02:01:34.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.914+0000 7ff72ffff700 1 --2- 172.21.15.42:0/729329841 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff71c06a690 0x7ff71c06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:34.906 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.915+0000 7ff72ffff700 1 --2- 172.21.15.42:0/729329841 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff71c06a690 0x7ff71c06cb40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff720009130 tx=0x7ff720008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:34.906 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:34.919+0000 7ff72cff9700 1 -- 172.21.15.42:0/729329841 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7ff724057b70 con 0x7ff730151030 2023-07-29T02:01:35.155 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:35.169+0000 7ff7367f0700 1 -- 172.21.15.42:0/729329841 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7300c6440 con 0x7ff730151030 2023-07-29T02:01:35.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:35.169+0000 7ff72cff9700 1 -- 172.21.15.42:0/729329841 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+5411 (secure 0 0 0) 0x7ff724057700 con 0x7ff730151030 2023-07-29T02:01:35.156 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:01:35.156 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:01:34.406696+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":11,"state":"up:replay","state_seq":1,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:01:35.158 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:35.171+0000 7ff7367f0700 1 -- 172.21.15.42:0/729329841 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff71c06a690 msgr2=0x7ff71c06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:35.158 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:35.171+0000 7ff7367f0700 1 --2- 172.21.15.42:0/729329841 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff71c06a690 0x7ff71c06cb40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff720009130 tx=0x7ff720008030 comp rx=0 tx=0).stop 2023-07-29T02:01:35.158 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:35.171+0000 7ff7367f0700 1 -- 172.21.15.42:0/729329841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff730151030 msgr2=0x7ff7301ef130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:35.158 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:35.171+0000 7ff7367f0700 1 --2- 172.21.15.42:0/729329841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff730151030 0x7ff7301ef130 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff72400c7f0 tx=0x7ff72400cb00 comp rx=0 tx=0).stop 2023-07-29T02:01:35.158 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:35.171+0000 7ff7367f0700 1 -- 172.21.15.42:0/729329841 shutdown_connections 2023-07-29T02:01:35.159 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:35.171+0000 7ff7367f0700 1 --2- 172.21.15.42:0/729329841 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff71c06a690 0x7ff71c06cb40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:35.159 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:35.171+0000 7ff7367f0700 1 --2- 172.21.15.42:0/729329841 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff730151400 0x7ff7301ef670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:35.159 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:35.171+0000 7ff7367f0700 1 --2- 172.21.15.42:0/729329841 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7300c5ee0 0x7ff7301f2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:35.159 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:35.171+0000 7ff7367f0700 1 --2- 172.21.15.42:0/729329841 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff730151030 0x7ff7301ef130 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:35.159 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:35.171+0000 7ff7367f0700 1 -- 172.21.15.42:0/729329841 >> 172.21.15.42:0/729329841 conn(0x7ff7300c80e0 msgr2=0x7ff7300c4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:35.159 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:35.171+0000 7ff7367f0700 1 -- 172.21.15.42:0/729329841 shutdown_connections 2023-07-29T02:01:35.160 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:35.171+0000 7ff7367f0700 1 -- 172.21.15.42:0/729329841 wait complete. 2023-07-29T02:01:35.160 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 11 2023-07-29T02:01:35.170 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 11, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-07-29T01:59:57.946839+0000", "damaged": [], "data_pools": [ 4, 5 ], "enabled": true, "epoch": 11, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4297": { "addr": "172.21.15.144:6839/3824722756", "addrs": { "addrvec": [ { "addr": "172.21.15.144:6837", "nonce": 3824722756, "type": "v2" }, { "addr": "172.21.15.144:6839", "nonce": 3824722756, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4297, "incarnation": 11, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 3, "modified": "2023-07-29T02:01:34.406696+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4297 } } } ], "standbys": [ { "addr": "172.21.15.42:6833/3242692321", "addrs": { "addrvec": [ { "addr": "172.21.15.42:6832", "nonce": 3242692321, "type": "v2" }, { "addr": "172.21.15.42:6833", "nonce": 3242692321, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4263, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.42:6835/1860885615", "addrs": { "addrvec": [ { "addr": "172.21.15.42:6834", "nonce": 1860885615, "type": "v2" }, { "addr": "172.21.15.42:6835", "nonce": 1860885615, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4266, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.144:6835/400694688", "addrs": { "addrvec": [ { "addr": "172.21.15.144:6834", "nonce": 400694688, "type": "v2" }, { "addr": "172.21.15.144:6835", "nonce": 400694688, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4291, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.144:6838/2604441175", "addrs": { "addrvec": [ { "addr": "172.21.15.144:6836", "nonce": 2604441175, "type": "v2" }, { "addr": "172.21.15.144:6838", "nonce": 2604441175, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4294, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-07-29T02:01:36.040 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:01:36.043 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:01:37.172 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:01:37.299 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.312+0000 7f7cac4c0700 1 Processor -- start 2023-07-29T02:01:37.299 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.312+0000 7f7cac4c0700 1 -- start start 2023-07-29T02:01:37.301 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.313+0000 7f7cac4c0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ca414c630 0x7f7ca406c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:37.301 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.313+0000 7f7cac4c0700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca406ce40 con 0x7f7ca40c7270 2023-07-29T02:01:37.301 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.313+0000 7f7cac4c0700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca4155d50 con 0x7f7ca414ca00 2023-07-29T02:01:37.301 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.313+0000 7f7cac4c0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca4156010 con 0x7f7ca414c630 2023-07-29T02:01:37.301 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.313+0000 7f7caaa5d700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f7ca40c7270 0x7f7ca406d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51180/0 (socket says 172.21.15.42:51180) 2023-07-29T02:01:37.302 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.313+0000 7f7caaa5d700 1 -- 172.21.15.42:0/3779634419 learned_addr learned my addr 172.21.15.42:0/3779634419 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:01:37.302 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.314+0000 7f7caa25c700 1 --2- 172.21.15.42:0/3779634419 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ca414c630 0x7f7ca406c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:37.302 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.314+0000 7f7ca925a700 1 -- 172.21.15.42:0/3779634419 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397306391 0 0) 0x7f7ca406ce40 con 0x7f7ca40c7270 2023-07-29T02:01:37.302 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.314+0000 7f7ca925a700 1 -- 172.21.15.42:0/3779634419 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c900035b0 con 0x7f7ca40c7270 2023-07-29T02:01:37.302 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.314+0000 7f7ca925a700 1 -- 172.21.15.42:0/3779634419 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953643876 0 0) 0x7f7ca4155d50 con 0x7f7ca414ca00 2023-07-29T02:01:37.302 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.314+0000 7f7ca925a700 1 -- 172.21.15.42:0/3779634419 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ca406ce40 con 0x7f7ca414ca00 2023-07-29T02:01:37.302 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.314+0000 7f7ca925a700 1 -- 172.21.15.42:0/3779634419 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2694076825 0 0) 0x7f7c900035b0 con 0x7f7ca40c7270 2023-07-29T02:01:37.303 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.314+0000 7f7caa25c700 1 -- 172.21.15.42:0/3779634419 >> v1:172.21.15.144:6789/0 conn(0x7f7ca414ca00 legacy=0x7f7ca40c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:37.303 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.314+0000 7f7caa25c700 1 -- 172.21.15.42:0/3779634419 >> v1:172.21.15.42:6789/0 conn(0x7f7ca40c7270 legacy=0x7f7ca406d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:37.303 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.314+0000 7f7caa25c700 1 -- 172.21.15.42:0/3779634419 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca41562f0 con 0x7f7ca414c630 2023-07-29T02:01:37.303 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.314+0000 7f7caa25c700 1 --2- 172.21.15.42:0/3779634419 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ca414c630 0x7f7ca406c270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009870 tx=0x7f7ca0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a66c23fd71afd7ad server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:37.303 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.314+0000 7f7ca925a700 1 -- 172.21.15.42:0/3779634419 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c0019f0 con 0x7f7ca414c630 2023-07-29T02:01:37.303 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.314+0000 7f7ca925a700 1 -- 172.21.15.42:0/3779634419 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca0004030 con 0x7f7ca414c630 2023-07-29T02:01:37.303 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.314+0000 7f7ca925a700 1 -- 172.21.15.42:0/3779634419 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca00043c0 con 0x7f7ca414c630 2023-07-29T02:01:37.305 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.315+0000 7f7cac4c0700 1 -- 172.21.15.42:0/3779634419 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ca414c630 msgr2=0x7f7ca406c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:37.306 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.315+0000 7f7cac4c0700 1 --2- 172.21.15.42:0/3779634419 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ca414c630 0x7f7ca406c270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009870 tx=0x7f7ca0009b80 comp rx=0 tx=0).stop 2023-07-29T02:01:37.306 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.315+0000 7f7cac4c0700 1 -- 172.21.15.42:0/3779634419 shutdown_connections 2023-07-29T02:01:37.306 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.315+0000 7f7cac4c0700 1 --2- 172.21.15.42:0/3779634419 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ca414c630 0x7f7ca406c270 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:37.306 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.315+0000 7f7cac4c0700 1 -- 172.21.15.42:0/3779634419 >> 172.21.15.42:0/3779634419 conn(0x7f7ca40c8970 msgr2=0x7f7ca40c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:37.306 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.315+0000 7f7cac4c0700 1 -- 172.21.15.42:0/3779634419 shutdown_connections 2023-07-29T02:01:37.306 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.315+0000 7f7cac4c0700 1 -- 172.21.15.42:0/3779634419 wait complete. 2023-07-29T02:01:37.306 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.316+0000 7f7cac4c0700 1 Processor -- start 2023-07-29T02:01:37.307 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.316+0000 7f7cac4c0700 1 -- start start 2023-07-29T02:01:37.307 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.317+0000 7f7cac4c0700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ca40c7270 0x7f7ca41531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:37.307 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.317+0000 7f7cac4c0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ca414c630 0x7f7ca406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:37.307 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.317+0000 7f7cac4c0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ca4152c80 0x7f7ca41eabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:37.307 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.317+0000 7f7cac4c0700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca40c5760 con 0x7f7ca40c7270 2023-07-29T02:01:37.307 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.317+0000 7f7cac4c0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca40c0890 con 0x7f7ca414c630 2023-07-29T02:01:37.307 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.317+0000 7f7cac4c0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca40c5a00 con 0x7f7ca4152c80 2023-07-29T02:01:37.308 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.317+0000 7f7caa25c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ca40c7270 0x7f7ca41531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:37.308 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.317+0000 7f7caa25c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ca40c7270 0x7f7ca41531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57378/0 (socket says 172.21.15.42:57378) 2023-07-29T02:01:37.308 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.317+0000 7f7caa25c700 1 -- 172.21.15.42:0/841553746 learned_addr learned my addr 172.21.15.42:0/841553746 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:37.308 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.317+0000 7f7caaa5d700 1 --2- 172.21.15.42:0/841553746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ca4152c80 0x7f7ca41eabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:37.308 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.317+0000 7f7ca9a5b700 1 --2- 172.21.15.42:0/841553746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ca414c630 0x7f7ca406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:37.308 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.317+0000 7f7caa25c700 1 -- 172.21.15.42:0/841553746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ca4152c80 msgr2=0x7f7ca41eabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:37.308 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.317+0000 7f7caa25c700 1 --2- 172.21.15.42:0/841553746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ca4152c80 0x7f7ca41eabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:37.309 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.317+0000 7f7caa25c700 1 -- 172.21.15.42:0/841553746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ca414c630 msgr2=0x7f7ca406d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:37.309 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.317+0000 7f7caa25c700 1 --2- 172.21.15.42:0/841553746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ca414c630 0x7f7ca406d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:37.309 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.317+0000 7f7caa25c700 1 -- 172.21.15.42:0/841553746 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca00094a0 con 0x7f7ca40c7270 2023-07-29T02:01:37.309 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.317+0000 7f7caa25c700 1 --2- 172.21.15.42:0/841553746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ca40c7270 0x7f7ca41531d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0000c00 tx=0x7f7ca0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:37.309 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.318+0000 7f7c96ffd700 1 -- 172.21.15.42:0/841553746 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0003e60 con 0x7f7ca40c7270 2023-07-29T02:01:37.309 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.318+0000 7f7c96ffd700 1 -- 172.21.15.42:0/841553746 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca001f070 con 0x7f7ca40c7270 2023-07-29T02:01:37.309 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.318+0000 7f7cac4c0700 1 -- 172.21.15.42:0/841553746 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca40c4e70 con 0x7f7ca40c7270 2023-07-29T02:01:37.309 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.318+0000 7f7c96ffd700 1 -- 172.21.15.42:0/841553746 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0011850 con 0x7f7ca40c7270 2023-07-29T02:01:37.310 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.318+0000 7f7cac4c0700 1 -- 172.21.15.42:0/841553746 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca41ea6a0 con 0x7f7ca40c7270 2023-07-29T02:01:37.310 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.319+0000 7f7cac4c0700 1 -- 172.21.15.42:0/841553746 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca4074740 con 0x7f7ca40c7270 2023-07-29T02:01:37.310 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.319+0000 7f7c96ffd700 1 -- 172.21.15.42:0/841553746 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f7ca00119b0 con 0x7f7ca40c7270 2023-07-29T02:01:37.310 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.319+0000 7f7c96ffd700 1 --2- 172.21.15.42:0/841553746 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7c8806a660 0x7f7c8806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:37.311 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.320+0000 7f7c96ffd700 1 -- 172.21.15.42:0/841553746 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6936+0+0 (secure 0 0 0) 0x7f7ca0021070 con 0x7f7ca40c7270 2023-07-29T02:01:37.311 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.320+0000 7f7ca9a5b700 1 --2- 172.21.15.42:0/841553746 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7c8806a660 0x7f7c8806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:37.311 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.320+0000 7f7ca9a5b700 1 --2- 172.21.15.42:0/841553746 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7c8806a660 0x7f7c8806cb10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40c4e00 tx=0x7f7c98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:37.311 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.324+0000 7f7c96ffd700 1 -- 172.21.15.42:0/841553746 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f7ca0055880 con 0x7f7ca40c7270 2023-07-29T02:01:37.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.569+0000 7f7cac4c0700 1 -- 172.21.15.42:0/841553746 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ca404ea50 con 0x7f7ca40c7270 2023-07-29T02:01:37.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.569+0000 7f7c96ffd700 1 -- 172.21.15.42:0/841553746 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+5411 (secure 0 0 0) 0x7f7ca0058ea0 con 0x7f7ca40c7270 2023-07-29T02:01:37.558 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:01:37.558 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:01:34.406696+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":11,"state":"up:replay","state_seq":1,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:01:37.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.571+0000 7f7cac4c0700 1 -- 172.21.15.42:0/841553746 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7c8806a660 msgr2=0x7f7c8806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:37.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.571+0000 7f7cac4c0700 1 --2- 172.21.15.42:0/841553746 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7c8806a660 0x7f7c8806cb10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40c4e00 tx=0x7f7c98009040 comp rx=0 tx=0).stop 2023-07-29T02:01:37.559 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.571+0000 7f7cac4c0700 1 -- 172.21.15.42:0/841553746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ca40c7270 msgr2=0x7f7ca41531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:37.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.571+0000 7f7cac4c0700 1 --2- 172.21.15.42:0/841553746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ca40c7270 0x7f7ca41531d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0000c00 tx=0x7f7ca0004750 comp rx=0 tx=0).stop 2023-07-29T02:01:37.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.571+0000 7f7cac4c0700 1 -- 172.21.15.42:0/841553746 shutdown_connections 2023-07-29T02:01:37.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.571+0000 7f7cac4c0700 1 --2- 172.21.15.42:0/841553746 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7c8806a660 0x7f7c8806cb10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:37.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.571+0000 7f7cac4c0700 1 --2- 172.21.15.42:0/841553746 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ca4152c80 0x7f7ca41eabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:37.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.571+0000 7f7cac4c0700 1 --2- 172.21.15.42:0/841553746 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ca40c7270 0x7f7ca41531d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:37.560 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.571+0000 7f7cac4c0700 1 --2- 172.21.15.42:0/841553746 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ca414c630 0x7f7ca406d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:37.561 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.571+0000 7f7cac4c0700 1 -- 172.21.15.42:0/841553746 >> 172.21.15.42:0/841553746 conn(0x7f7ca40c8970 msgr2=0x7f7ca406c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:37.561 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.571+0000 7f7cac4c0700 1 -- 172.21.15.42:0/841553746 shutdown_connections 2023-07-29T02:01:37.561 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:37.571+0000 7f7cac4c0700 1 -- 172.21.15.42:0/841553746 wait complete. 2023-07-29T02:01:37.561 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 11 2023-07-29T02:01:37.570 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2023-07-29T02:01:39.570 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:01:39.702 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.716+0000 7fe0ff25d700 1 Processor -- start 2023-07-29T02:01:39.703 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.716+0000 7fe0ff25d700 1 -- start start 2023-07-29T02:01:39.704 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.717+0000 7fe0ff25d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe0f81535c0 0x7fe0f80c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:39.704 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.717+0000 7fe0ff25d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe0f8159820 0x7fe0f8159c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:39.704 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.717+0000 7fe0ff25d700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f8153990 con 0x7fe0f80ca060 2023-07-29T02:01:39.704 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.717+0000 7fe0ff25d700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f815a180 con 0x7fe0f81535c0 2023-07-29T02:01:39.705 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.717+0000 7fe0ff25d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f80c5a10 con 0x7fe0f8159820 2023-07-29T02:01:39.705 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.717+0000 7fe0fcff9700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe0f81535c0 0x7fe0f80c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:39.705 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.717+0000 7fe0f7fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe0f80ca060 0x7fe0f80cf170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51190/0 (socket says 172.21.15.42:51190) 2023-07-29T02:01:39.705 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.717+0000 7fe0f7fff700 1 -- 172.21.15.42:0/3200042298 learned_addr learned my addr 172.21.15.42:0/3200042298 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:01:39.705 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.717+0000 7fe0fd7fa700 1 --2- 172.21.15.42:0/3200042298 >> v2:172.21.15.144:3300/0 conn(0x7fe0f8159820 0x7fe0f8159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:39.705 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.717+0000 7fe0fcff9700 1 -- 172.21.15.42:0/3200042298 >> v2:172.21.15.144:3300/0 conn(0x7fe0f8159820 msgr2=0x7fe0f8159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:39.705 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.717+0000 7fe0fcff9700 1 --2- 172.21.15.42:0/3200042298 >> v2:172.21.15.144:3300/0 conn(0x7fe0f8159820 0x7fe0f8159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:39.706 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.717+0000 7fe0fcff9700 1 -- 172.21.15.42:0/3200042298 >> v1:172.21.15.42:6789/0 conn(0x7fe0f80ca060 legacy=0x7fe0f80cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:39.706 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.717+0000 7fe0fcff9700 1 -- 172.21.15.42:0/3200042298 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f815c760 con 0x7fe0f81535c0 2023-07-29T02:01:39.706 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.718+0000 7fe0fcff9700 1 --2- 172.21.15.42:0/3200042298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0f81535c0 0x7fe0f80c54d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80c42d0 tx=0x7fe0ec009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b0b07fd3648ce3c server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:39.706 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.718+0000 7fe0f77fe700 1 -- 172.21.15.42:0/3200042298 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec011830 con 0x7fe0f81535c0 2023-07-29T02:01:39.706 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.718+0000 7fe0f77fe700 1 -- 172.21.15.42:0/3200042298 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec011990 con 0x7fe0f81535c0 2023-07-29T02:01:39.706 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.718+0000 7fe0f77fe700 1 -- 172.21.15.42:0/3200042298 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec011d20 con 0x7fe0f81535c0 2023-07-29T02:01:39.708 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.718+0000 7fe0ff25d700 1 -- 172.21.15.42:0/3200042298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0f81535c0 msgr2=0x7fe0f80c54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:39.709 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.718+0000 7fe0ff25d700 1 --2- 172.21.15.42:0/3200042298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0f81535c0 0x7fe0f80c54d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80c42d0 tx=0x7fe0ec009b20 comp rx=0 tx=0).stop 2023-07-29T02:01:39.709 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.718+0000 7fe0ff25d700 1 -- 172.21.15.42:0/3200042298 shutdown_connections 2023-07-29T02:01:39.709 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.718+0000 7fe0ff25d700 1 --2- 172.21.15.42:0/3200042298 >> v2:172.21.15.144:3300/0 conn(0x7fe0f8159820 0x7fe0f8159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:39.709 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.718+0000 7fe0ff25d700 1 --2- 172.21.15.42:0/3200042298 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0f81535c0 0x7fe0f80c54d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:39.709 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.718+0000 7fe0ff25d700 1 -- 172.21.15.42:0/3200042298 >> 172.21.15.42:0/3200042298 conn(0x7fe0f806cac0 msgr2=0x7fe0f806cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:39.709 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.718+0000 7fe0ff25d700 1 -- 172.21.15.42:0/3200042298 shutdown_connections 2023-07-29T02:01:39.709 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.718+0000 7fe0ff25d700 1 -- 172.21.15.42:0/3200042298 wait complete. 2023-07-29T02:01:39.710 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.720+0000 7fe0ff25d700 1 Processor -- start 2023-07-29T02:01:39.710 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.720+0000 7fe0ff25d700 1 -- start start 2023-07-29T02:01:39.710 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.721+0000 7fe0ff25d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0f80ca060 0x7fe0f81ee920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:39.710 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.721+0000 7fe0ff25d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0f81535c0 0x7fe0f81578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:39.710 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.721+0000 7fe0ff25d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0f8159820 0x7fe0f815bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:39.710 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.721+0000 7fe0ff25d700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f81574d0 con 0x7fe0f80ca060 2023-07-29T02:01:39.710 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.721+0000 7fe0ff25d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f80c6f00 con 0x7fe0f81535c0 2023-07-29T02:01:39.710 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.721+0000 7fe0ff25d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f81ef870 con 0x7fe0f8159820 2023-07-29T02:01:39.711 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.721+0000 7fe0fcff9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0f80ca060 0x7fe0f81ee920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:39.711 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.721+0000 7fe0fcff9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0f80ca060 0x7fe0f81ee920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57392/0 (socket says 172.21.15.42:57392) 2023-07-29T02:01:39.711 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.721+0000 7fe0fcff9700 1 -- 172.21.15.42:0/2805399603 learned_addr learned my addr 172.21.15.42:0/2805399603 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:39.711 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.721+0000 7fe0fd7fa700 1 --2- 172.21.15.42:0/2805399603 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0f8159820 0x7fe0f815bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:39.711 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.721+0000 7fe0f7fff700 1 --2- 172.21.15.42:0/2805399603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0f81535c0 0x7fe0f81578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:39.711 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.721+0000 7fe0fcff9700 1 -- 172.21.15.42:0/2805399603 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0f8159820 msgr2=0x7fe0f815bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:39.711 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.721+0000 7fe0fcff9700 1 --2- 172.21.15.42:0/2805399603 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0f8159820 0x7fe0f815bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:39.712 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.721+0000 7fe0fcff9700 1 -- 172.21.15.42:0/2805399603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0f81535c0 msgr2=0x7fe0f81578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:39.712 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.721+0000 7fe0fcff9700 1 --2- 172.21.15.42:0/2805399603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0f81535c0 0x7fe0f81578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:39.712 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.721+0000 7fe0fcff9700 1 -- 172.21.15.42:0/2805399603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec0094a0 con 0x7fe0f80ca060 2023-07-29T02:01:39.712 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.721+0000 7fe0fd7fa700 1 --2- 172.21.15.42:0/2805399603 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0f8159820 0x7fe0f815bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:01:39.712 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.721+0000 7fe0f7fff700 1 --2- 172.21.15.42:0/2805399603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0f81535c0 0x7fe0f81578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:01:39.712 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.722+0000 7fe0fcff9700 1 --2- 172.21.15.42:0/2805399603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0f80ca060 0x7fe0f81ee920 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec000c00 tx=0x7fe0ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:39.712 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.722+0000 7fe0f57fa700 1 -- 172.21.15.42:0/2805399603 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0036a0 con 0x7fe0f80ca060 2023-07-29T02:01:39.713 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.722+0000 7fe0f57fa700 1 -- 172.21.15.42:0/2805399603 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec01e070 con 0x7fe0f80ca060 2023-07-29T02:01:39.713 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.722+0000 7fe0ff25d700 1 -- 172.21.15.42:0/2805399603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f81eefd0 con 0x7fe0f80ca060 2023-07-29T02:01:39.713 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.722+0000 7fe0f57fa700 1 -- 172.21.15.42:0/2805399603 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec003a60 con 0x7fe0f80ca060 2023-07-29T02:01:39.713 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.722+0000 7fe0ff25d700 1 -- 172.21.15.42:0/2805399603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f81ef590 con 0x7fe0f80ca060 2023-07-29T02:01:39.714 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.723+0000 7fe0ff25d700 1 -- 172.21.15.42:0/2805399603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f80c6260 con 0x7fe0f80ca060 2023-07-29T02:01:39.714 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.723+0000 7fe0f57fa700 1 -- 172.21.15.42:0/2805399603 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fe0ec003bc0 con 0x7fe0f80ca060 2023-07-29T02:01:39.714 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.724+0000 7fe0f57fa700 1 --2- 172.21.15.42:0/2805399603 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe0dc06a660 0x7fe0dc06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:39.714 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.724+0000 7fe0f57fa700 1 -- 172.21.15.42:0/2805399603 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6936+0+0 (secure 0 0 0) 0x7fe0ec08a020 con 0x7fe0f80ca060 2023-07-29T02:01:39.714 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.724+0000 7fe0f7fff700 1 --2- 172.21.15.42:0/2805399603 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe0dc06a660 0x7fe0dc06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:39.714 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.724+0000 7fe0f7fff700 1 --2- 172.21.15.42:0/2805399603 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe0dc06a660 0x7fe0dc06cb10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40010e0 tx=0x7fe0e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:39.715 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.728+0000 7fe0f57fa700 1 -- 172.21.15.42:0/2805399603 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fe0ec0550b0 con 0x7fe0f80ca060 2023-07-29T02:01:39.971 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.984+0000 7fe0ff25d700 1 -- 172.21.15.42:0/2805399603 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0f8068030 con 0x7fe0f80ca060 2023-07-29T02:01:39.971 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.985+0000 7fe0f57fa700 1 -- 172.21.15.42:0/2805399603 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+5411 (secure 0 0 0) 0x7fe0ec020090 con 0x7fe0f80ca060 2023-07-29T02:01:39.972 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:01:39.972 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:01:34.406696+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":11,"state":"up:replay","state_seq":1,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:01:39.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.987+0000 7fe0ff25d700 1 -- 172.21.15.42:0/2805399603 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe0dc06a660 msgr2=0x7fe0dc06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:39.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.987+0000 7fe0ff25d700 1 --2- 172.21.15.42:0/2805399603 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe0dc06a660 0x7fe0dc06cb10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40010e0 tx=0x7fe0e4009040 comp rx=0 tx=0).stop 2023-07-29T02:01:39.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.987+0000 7fe0ff25d700 1 -- 172.21.15.42:0/2805399603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0f80ca060 msgr2=0x7fe0f81ee920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:39.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.987+0000 7fe0ff25d700 1 --2- 172.21.15.42:0/2805399603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0f80ca060 0x7fe0f81ee920 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec000c00 tx=0x7fe0ec004750 comp rx=0 tx=0).stop 2023-07-29T02:01:39.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.987+0000 7fe0ff25d700 1 -- 172.21.15.42:0/2805399603 shutdown_connections 2023-07-29T02:01:39.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.987+0000 7fe0ff25d700 1 --2- 172.21.15.42:0/2805399603 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe0dc06a660 0x7fe0dc06cb10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:39.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.987+0000 7fe0ff25d700 1 --2- 172.21.15.42:0/2805399603 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe0f8159820 0x7fe0f815bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:39.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.987+0000 7fe0ff25d700 1 --2- 172.21.15.42:0/2805399603 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe0f80ca060 0x7fe0f81ee920 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:39.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.987+0000 7fe0ff25d700 1 --2- 172.21.15.42:0/2805399603 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe0f81535c0 0x7fe0f81578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:39.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.987+0000 7fe0ff25d700 1 -- 172.21.15.42:0/2805399603 >> 172.21.15.42:0/2805399603 conn(0x7fe0f806cac0 msgr2=0x7fe0f80cf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:39.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.987+0000 7fe0ff25d700 1 -- 172.21.15.42:0/2805399603 shutdown_connections 2023-07-29T02:01:39.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:39.987+0000 7fe0ff25d700 1 -- 172.21.15.42:0/2805399603 wait complete. 2023-07-29T02:01:39.975 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 11 2023-07-29T02:01:39.985 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2023-07-29T02:01:41.987 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:01:42.121 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.135+0000 7f83891ed700 1 Processor -- start 2023-07-29T02:01:42.122 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.135+0000 7f83891ed700 1 -- start start 2023-07-29T02:01:42.123 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.136+0000 7f83891ed700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f83841535c0 0x7f83840c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:42.124 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.136+0000 7f83891ed700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8384159820 0x7f8384159c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:42.124 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.136+0000 7f83891ed700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8384153990 con 0x7f83840ca060 2023-07-29T02:01:42.124 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.136+0000 7f83891ed700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838415a180 con 0x7f8384159820 2023-07-29T02:01:42.124 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.136+0000 7f83891ed700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83840c5a10 con 0x7f83841535c0 2023-07-29T02:01:42.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.136+0000 7f838359e700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8384159820 0x7f8384159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:42.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.136+0000 7f838259c700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f83840ca060 0x7f83840cf170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51208/0 (socket says 172.21.15.42:51208) 2023-07-29T02:01:42.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.136+0000 7f838259c700 1 -- 172.21.15.42:0/2639724515 learned_addr learned my addr 172.21.15.42:0/2639724515 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:01:42.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.136+0000 7f8382d9d700 1 --2- 172.21.15.42:0/2639724515 >> v2:172.21.15.144:3300/0 conn(0x7f83841535c0 0x7f83840c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:42.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.136+0000 7f838359e700 1 -- 172.21.15.42:0/2639724515 >> v2:172.21.15.144:3300/0 conn(0x7f83841535c0 msgr2=0x7f83840c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:42.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.136+0000 7f838359e700 1 --2- 172.21.15.42:0/2639724515 >> v2:172.21.15.144:3300/0 conn(0x7f83841535c0 0x7f83840c54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:42.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.136+0000 7f838359e700 1 -- 172.21.15.42:0/2639724515 >> v1:172.21.15.42:6789/0 conn(0x7f83840ca060 legacy=0x7f83840cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:42.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.136+0000 7f838359e700 1 -- 172.21.15.42:0/2639724515 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838415c760 con 0x7f8384159820 2023-07-29T02:01:42.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.136+0000 7f838359e700 1 --2- 172.21.15.42:0/2639724515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8384159820 0x7f8384159c40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8384067f70 tx=0x7f837c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7874d4d41aafc515 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:42.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.136+0000 7f8381d9b700 1 -- 172.21.15.42:0/2639724515 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c011830 con 0x7f8384159820 2023-07-29T02:01:42.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.137+0000 7f8381d9b700 1 -- 172.21.15.42:0/2639724515 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c011990 con 0x7f8384159820 2023-07-29T02:01:42.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.137+0000 7f8381d9b700 1 -- 172.21.15.42:0/2639724515 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c011d20 con 0x7f8384159820 2023-07-29T02:01:42.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.137+0000 7f83891ed700 1 -- 172.21.15.42:0/2639724515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8384159820 msgr2=0x7f8384159c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:42.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.137+0000 7f83891ed700 1 --2- 172.21.15.42:0/2639724515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8384159820 0x7f8384159c40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8384067f70 tx=0x7f837c009b20 comp rx=0 tx=0).stop 2023-07-29T02:01:42.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.137+0000 7f83891ed700 1 -- 172.21.15.42:0/2639724515 shutdown_connections 2023-07-29T02:01:42.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.137+0000 7f83891ed700 1 --2- 172.21.15.42:0/2639724515 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8384159820 0x7f8384159c40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:42.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.137+0000 7f83891ed700 1 --2- 172.21.15.42:0/2639724515 >> v2:172.21.15.144:3300/0 conn(0x7f83841535c0 0x7f83840c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:42.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.137+0000 7f83891ed700 1 -- 172.21.15.42:0/2639724515 >> 172.21.15.42:0/2639724515 conn(0x7f838406cac0 msgr2=0x7f838406cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:42.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.137+0000 7f83891ed700 1 -- 172.21.15.42:0/2639724515 shutdown_connections 2023-07-29T02:01:42.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.137+0000 7f83891ed700 1 -- 172.21.15.42:0/2639724515 wait complete. 2023-07-29T02:01:42.130 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.139+0000 7f83891ed700 1 Processor -- start 2023-07-29T02:01:42.130 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.139+0000 7f83891ed700 1 -- start start 2023-07-29T02:01:42.130 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.139+0000 7f83891ed700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83840ca060 0x7f83841e5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:42.130 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.139+0000 7f83891ed700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83841535c0 0x7f838415bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:42.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.139+0000 7f83891ed700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8384159820 0x7f838414c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:42.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.139+0000 7f83891ed700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83840b4d70 con 0x7f83841535c0 2023-07-29T02:01:42.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.139+0000 7f83891ed700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83840b4860 con 0x7f83840ca060 2023-07-29T02:01:42.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.139+0000 7f83891ed700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83840b4a90 con 0x7f8384159820 2023-07-29T02:01:42.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.139+0000 7f838259c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83841535c0 0x7f838415bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:42.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.139+0000 7f838259c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83841535c0 0x7f838415bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57410/0 (socket says 172.21.15.42:57410) 2023-07-29T02:01:42.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.139+0000 7f838259c700 1 -- 172.21.15.42:0/3426179081 learned_addr learned my addr 172.21.15.42:0/3426179081 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:42.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.140+0000 7f8382d9d700 1 --2- 172.21.15.42:0/3426179081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83840ca060 0x7f83841e5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:42.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.140+0000 7f838359e700 1 --2- 172.21.15.42:0/3426179081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8384159820 0x7f838414c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:42.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.140+0000 7f838259c700 1 -- 172.21.15.42:0/3426179081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8384159820 msgr2=0x7f838414c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:42.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.140+0000 7f838259c700 1 --2- 172.21.15.42:0/3426179081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8384159820 0x7f838414c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:42.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.140+0000 7f838259c700 1 -- 172.21.15.42:0/3426179081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83840ca060 msgr2=0x7f83841e5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:42.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.140+0000 7f838259c700 1 --2- 172.21.15.42:0/3426179081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83840ca060 0x7f83841e5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:42.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.140+0000 7f838259c700 1 -- 172.21.15.42:0/3426179081 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c0094a0 con 0x7f83841535c0 2023-07-29T02:01:42.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.140+0000 7f838259c700 1 --2- 172.21.15.42:0/3426179081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83841535c0 0x7f838415bec0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8378007fd0 tx=0x7f837800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:42.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.140+0000 7f836b7fe700 1 -- 172.21.15.42:0/3426179081 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83780074e0 con 0x7f83841535c0 2023-07-29T02:01:42.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.140+0000 7f836b7fe700 1 -- 172.21.15.42:0/3426179081 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8378007640 con 0x7f83841535c0 2023-07-29T02:01:42.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.140+0000 7f83891ed700 1 -- 172.21.15.42:0/3426179081 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83840b3470 con 0x7f83841535c0 2023-07-29T02:01:42.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.140+0000 7f836b7fe700 1 -- 172.21.15.42:0/3426179081 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378005a50 con 0x7f83841535c0 2023-07-29T02:01:42.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.140+0000 7f83891ed700 1 -- 172.21.15.42:0/3426179081 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83840b3a30 con 0x7f83841535c0 2023-07-29T02:01:42.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.141+0000 7f83891ed700 1 -- 172.21.15.42:0/3426179081 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83840c6260 con 0x7f83841535c0 2023-07-29T02:01:42.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.142+0000 7f836b7fe700 1 -- 172.21.15.42:0/3426179081 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f8378005bb0 con 0x7f83841535c0 2023-07-29T02:01:42.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.142+0000 7f836b7fe700 1 --2- 172.21.15.42:0/3426179081 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f837006a660 0x7f837006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:42.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.142+0000 7f836b7fe700 1 -- 172.21.15.42:0/3426179081 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6936+0+0 (secure 0 0 0) 0x7f83780882f0 con 0x7f83841535c0 2023-07-29T02:01:42.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.142+0000 7f8382d9d700 1 --2- 172.21.15.42:0/3426179081 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f837006a660 0x7f837006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:42.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.143+0000 7f8382d9d700 1 --2- 172.21.15.42:0/3426179081 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f837006a660 0x7f837006cb10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8374009e90 tx=0x7f837400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:42.135 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.146+0000 7f836b7fe700 1 -- 172.21.15.42:0/3426179081 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f83780533b0 con 0x7f83841535c0 2023-07-29T02:01:42.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.398+0000 7f83891ed700 1 -- 172.21.15.42:0/3426179081 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f838404ea50 con 0x7f83841535c0 2023-07-29T02:01:42.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.398+0000 7f836b7fe700 1 -- 172.21.15.42:0/3426179081 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+5415 (secure 0 0 0) 0x7f8378017090 con 0x7f83841535c0 2023-07-29T02:01:42.385 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:01:42.385 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:01:40.408922+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":11,"state":"up:reconnect","state_seq":28,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:01:42.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.400+0000 7f83891ed700 1 -- 172.21.15.42:0/3426179081 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f837006a660 msgr2=0x7f837006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:42.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.400+0000 7f83891ed700 1 --2- 172.21.15.42:0/3426179081 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f837006a660 0x7f837006cb10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8374009e90 tx=0x7f837400b040 comp rx=0 tx=0).stop 2023-07-29T02:01:42.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.400+0000 7f83891ed700 1 -- 172.21.15.42:0/3426179081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83841535c0 msgr2=0x7f838415bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:42.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.400+0000 7f83891ed700 1 --2- 172.21.15.42:0/3426179081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83841535c0 0x7f838415bec0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8378007fd0 tx=0x7f837800c790 comp rx=0 tx=0).stop 2023-07-29T02:01:42.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.400+0000 7f83891ed700 1 -- 172.21.15.42:0/3426179081 shutdown_connections 2023-07-29T02:01:42.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.400+0000 7f83891ed700 1 --2- 172.21.15.42:0/3426179081 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f837006a660 0x7f837006cb10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:42.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.400+0000 7f83891ed700 1 --2- 172.21.15.42:0/3426179081 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8384159820 0x7f838414c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:42.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.400+0000 7f83891ed700 1 --2- 172.21.15.42:0/3426179081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83840ca060 0x7f83841e5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:42.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.400+0000 7f83891ed700 1 --2- 172.21.15.42:0/3426179081 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83841535c0 0x7f838415bec0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:42.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.400+0000 7f83891ed700 1 -- 172.21.15.42:0/3426179081 >> 172.21.15.42:0/3426179081 conn(0x7f838406cac0 msgr2=0x7f8384151540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:42.390 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.400+0000 7f83891ed700 1 -- 172.21.15.42:0/3426179081 shutdown_connections 2023-07-29T02:01:42.391 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:42.401+0000 7f83891ed700 1 -- 172.21.15.42:0/3426179081 wait complete. 2023-07-29T02:01:42.391 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 12 2023-07-29T02:01:42.399 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2023-07-29T02:01:44.400 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:01:44.539 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.553+0000 7f9d52c85700 1 Processor -- start 2023-07-29T02:01:44.540 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.553+0000 7f9d52c85700 1 -- start start 2023-07-29T02:01:44.542 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.554+0000 7f9d52c85700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9d4c151230 0x7f9d4c156f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:44.542 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.554+0000 7f9d52c85700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4c072d70 con 0x7f9d4c0c70a0 2023-07-29T02:01:44.543 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.554+0000 7f9d52c85700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4c0724d0 con 0x7f9d4c071d20 2023-07-29T02:01:44.543 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.554+0000 7f9d52c85700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4c0727b0 con 0x7f9d4c151230 2023-07-29T02:01:44.543 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.554+0000 7f9d51222700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f9d4c0c70a0 0x7f9d4c1618e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51224/0 (socket says 172.21.15.42:51224) 2023-07-29T02:01:44.543 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.554+0000 7f9d51222700 1 -- 172.21.15.42:0/4292895359 learned_addr learned my addr 172.21.15.42:0/4292895359 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:01:44.543 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.554+0000 7f9d50a21700 1 --2- 172.21.15.42:0/4292895359 >> v2:172.21.15.144:3300/0 conn(0x7f9d4c151230 0x7f9d4c156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:44.543 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.554+0000 7f9d4b7fe700 1 -- 172.21.15.42:0/4292895359 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923927612 0 0) 0x7f9d4c072d70 con 0x7f9d4c0c70a0 2023-07-29T02:01:44.543 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.554+0000 7f9d4b7fe700 1 -- 172.21.15.42:0/4292895359 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d3c0035b0 con 0x7f9d4c0c70a0 2023-07-29T02:01:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.554+0000 7f9d4b7fe700 1 -- 172.21.15.42:0/4292895359 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4113513531 0 0) 0x7f9d3c0035b0 con 0x7f9d4c0c70a0 2023-07-29T02:01:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.554+0000 7f9d4b7fe700 1 -- 172.21.15.42:0/4292895359 >> v2:172.21.15.144:3300/0 conn(0x7f9d4c151230 msgr2=0x7f9d4c156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.554+0000 7f9d4b7fe700 1 --2- 172.21.15.42:0/4292895359 >> v2:172.21.15.144:3300/0 conn(0x7f9d4c151230 0x7f9d4c156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.554+0000 7f9d4b7fe700 1 -- 172.21.15.42:0/4292895359 >> v1:172.21.15.144:6789/0 conn(0x7f9d4c071d20 legacy=0x7f9d4c0c5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.554+0000 7f9d4b7fe700 1 -- 172.21.15.42:0/4292895359 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c072a90 con 0x7f9d4c0c70a0 2023-07-29T02:01:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.554+0000 7f9d4b7fe700 1 -- 172.21.15.42:0/4292895359 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7f9d440019f0 con 0x7f9d4c0c70a0 2023-07-29T02:01:44.544 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.554+0000 7f9d4b7fe700 1 -- 172.21.15.42:0/4292895359 >> v1:172.21.15.42:6789/0 conn(0x7f9d4c0c70a0 legacy=0x7f9d4c1618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.555+0000 7f9d4b7fe700 1 --2- 172.21.15.42:0/4292895359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d3c003a00 0x7f9d3c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.555+0000 7f9d4b7fe700 1 --2- 172.21.15.42:0/4292895359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d3c004850 0x7f9d3c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.555+0000 7f9d4b7fe700 1 --2- 172.21.15.42:0/4292895359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d3c005200 0x7f9d3c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.555+0000 7f9d4b7fe700 1 -- 172.21.15.42:0/4292895359 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c0727b0 con 0x7f9d3c004850 2023-07-29T02:01:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.555+0000 7f9d4b7fe700 1 -- 172.21.15.42:0/4292895359 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c00c080 con 0x7f9d3c003a00 2023-07-29T02:01:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.555+0000 7f9d4b7fe700 1 -- 172.21.15.42:0/4292895359 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c00c240 con 0x7f9d3c005200 2023-07-29T02:01:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.555+0000 7f9d4bfff700 1 --2- 172.21.15.42:0/4292895359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d3c004850 0x7f9d3c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:44.545 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.555+0000 7f9d50a21700 1 --2- 172.21.15.42:0/4292895359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d3c003a00 0x7f9d3c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.555+0000 7f9d51222700 1 --2- 172.21.15.42:0/4292895359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d3c005200 0x7f9d3c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.555+0000 7f9d4bfff700 1 -- 172.21.15.42:0/4292895359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d3c005200 msgr2=0x7f9d3c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.555+0000 7f9d4bfff700 1 --2- 172.21.15.42:0/4292895359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d3c005200 0x7f9d3c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.555+0000 7f9d4bfff700 1 -- 172.21.15.42:0/4292895359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d3c003a00 msgr2=0x7f9d3c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.555+0000 7f9d4bfff700 1 --2- 172.21.15.42:0/4292895359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d3c003a00 0x7f9d3c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.555+0000 7f9d4bfff700 1 -- 172.21.15.42:0/4292895359 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c0035b0 con 0x7f9d3c004850 2023-07-29T02:01:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.555+0000 7f9d51222700 1 --2- 172.21.15.42:0/4292895359 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d3c005200 0x7f9d3c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:01:44.546 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.555+0000 7f9d51222700 1 -- 172.21.15.42:0/4292895359 reap_dead start 2023-07-29T02:01:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.555+0000 7f9d4bfff700 1 --2- 172.21.15.42:0/4292895359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d3c004850 0x7f9d3c004cc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9d380017c0 tx=0x7f9d3c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb47d886e6947951 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.555+0000 7f9d4b7fe700 1 -- 172.21.15.42:0/4292895359 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d380052d0 con 0x7f9d3c004850 2023-07-29T02:01:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.555+0000 7f9d4b7fe700 1 -- 172.21.15.42:0/4292895359 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d38005430 con 0x7f9d3c004850 2023-07-29T02:01:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.555+0000 7f9d4b7fe700 1 -- 172.21.15.42:0/4292895359 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d380038c0 con 0x7f9d3c004850 2023-07-29T02:01:44.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.556+0000 7f9d52c85700 1 -- 172.21.15.42:0/4292895359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d3c004850 msgr2=0x7f9d3c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.556+0000 7f9d52c85700 1 --2- 172.21.15.42:0/4292895359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d3c004850 0x7f9d3c004cc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9d380017c0 tx=0x7f9d3c005880 comp rx=0 tx=0).stop 2023-07-29T02:01:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.556+0000 7f9d52c85700 1 -- 172.21.15.42:0/4292895359 shutdown_connections 2023-07-29T02:01:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.556+0000 7f9d52c85700 1 --2- 172.21.15.42:0/4292895359 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d3c004850 0x7f9d3c004cc0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.556+0000 7f9d52c85700 1 -- 172.21.15.42:0/4292895359 >> 172.21.15.42:0/4292895359 conn(0x7f9d4c0c8970 msgr2=0x7f9d4c0c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.556+0000 7f9d52c85700 1 -- 172.21.15.42:0/4292895359 shutdown_connections 2023-07-29T02:01:44.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.556+0000 7f9d52c85700 1 -- 172.21.15.42:0/4292895359 wait complete. 2023-07-29T02:01:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.557+0000 7f9d52c85700 1 Processor -- start 2023-07-29T02:01:44.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.557+0000 7f9d52c85700 1 -- start start 2023-07-29T02:01:44.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.558+0000 7f9d52c85700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d3c004850 0x7f9d4c159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:44.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.558+0000 7f9d52c85700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d4c15ad80 0x7f9d4c153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:44.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.558+0000 7f9d52c85700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d4c1efb80 0x7f9d4c1efff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:44.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.558+0000 7f9d52c85700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c0ca570 con 0x7f9d3c004850 2023-07-29T02:01:44.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.558+0000 7f9d52c85700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c1f0530 con 0x7f9d4c1efb80 2023-07-29T02:01:44.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.558+0000 7f9d52c85700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c15a640 con 0x7f9d4c15ad80 2023-07-29T02:01:44.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.558+0000 7f9d50a21700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d3c004850 0x7f9d4c159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.558+0000 7f9d50a21700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d3c004850 0x7f9d4c159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57428/0 (socket says 172.21.15.42:57428) 2023-07-29T02:01:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.558+0000 7f9d50a21700 1 -- 172.21.15.42:0/4003632247 learned_addr learned my addr 172.21.15.42:0/4003632247 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.558+0000 7f9d4bfff700 1 --2- 172.21.15.42:0/4003632247 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d4c15ad80 0x7f9d4c153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.558+0000 7f9d51222700 1 --2- 172.21.15.42:0/4003632247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d4c1efb80 0x7f9d4c1efff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.558+0000 7f9d50a21700 1 -- 172.21.15.42:0/4003632247 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d4c15ad80 msgr2=0x7f9d4c153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.558+0000 7f9d50a21700 1 --2- 172.21.15.42:0/4003632247 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d4c15ad80 0x7f9d4c153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:44.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.558+0000 7f9d50a21700 1 -- 172.21.15.42:0/4003632247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d4c1efb80 msgr2=0x7f9d4c1efff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:44.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.558+0000 7f9d50a21700 1 --2- 172.21.15.42:0/4003632247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d4c1efb80 0x7f9d4c1efff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:44.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.558+0000 7f9d50a21700 1 -- 172.21.15.42:0/4003632247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c158bd0 con 0x7f9d3c004850 2023-07-29T02:01:44.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.558+0000 7f9d4bfff700 1 --2- 172.21.15.42:0/4003632247 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d4c15ad80 0x7f9d4c153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:01:44.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.559+0000 7f9d50a21700 1 --2- 172.21.15.42:0/4003632247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d3c004850 0x7f9d4c159c20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9d40011aa0 tx=0x7f9d40011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:44.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.559+0000 7f9d497fa700 1 -- 172.21.15.42:0/4003632247 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4000f9e0 con 0x7f9d3c004850 2023-07-29T02:01:44.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.559+0000 7f9d497fa700 1 -- 172.21.15.42:0/4003632247 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4000fb40 con 0x7f9d3c004850 2023-07-29T02:01:44.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.559+0000 7f9d52c85700 1 -- 172.21.15.42:0/4003632247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4c158eb0 con 0x7f9d3c004850 2023-07-29T02:01:44.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.559+0000 7f9d497fa700 1 -- 172.21.15.42:0/4003632247 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d40014440 con 0x7f9d3c004850 2023-07-29T02:01:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.559+0000 7f9d52c85700 1 -- 172.21.15.42:0/4003632247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4c15a920 con 0x7f9d3c004850 2023-07-29T02:01:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.560+0000 7f9d52c85700 1 -- 172.21.15.42:0/4003632247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4c074740 con 0x7f9d3c004850 2023-07-29T02:01:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.560+0000 7f9d497fa700 1 -- 172.21.15.42:0/4003632247 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f9d400145a0 con 0x7f9d3c004850 2023-07-29T02:01:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.561+0000 7f9d497fa700 1 --2- 172.21.15.42:0/4003632247 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9d3006a660 0x7f9d3006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.561+0000 7f9d497fa700 1 -- 172.21.15.42:0/4003632247 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6936+0+0 (secure 0 0 0) 0x7f9d40089710 con 0x7f9d3c004850 2023-07-29T02:01:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.561+0000 7f9d4bfff700 1 --2- 172.21.15.42:0/4003632247 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9d3006a660 0x7f9d3006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:44.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.561+0000 7f9d4bfff700 1 --2- 172.21.15.42:0/4003632247 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9d3006a660 0x7f9d3006cb10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9d38000c00 tx=0x7f9d38009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:44.555 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.565+0000 7f9d497fa700 1 -- 172.21.15.42:0/4003632247 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f9d400547a0 con 0x7f9d3c004850 2023-07-29T02:01:44.797 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.811+0000 7f9d52c85700 1 -- 172.21.15.42:0/4003632247 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d4c1ef960 con 0x7f9d3c004850 2023-07-29T02:01:44.798 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.812+0000 7f9d497fa700 1 -- 172.21.15.42:0/4003632247 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+5415 (secure 0 0 0) 0x7f9d40057dc0 con 0x7f9d3c004850 2023-07-29T02:01:44.798 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:01:44.799 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:01:40.408922+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":11,"state":"up:reconnect","state_seq":28,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:01:44.801 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.814+0000 7f9d52c85700 1 -- 172.21.15.42:0/4003632247 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9d3006a660 msgr2=0x7f9d3006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:44.801 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.814+0000 7f9d52c85700 1 --2- 172.21.15.42:0/4003632247 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9d3006a660 0x7f9d3006cb10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9d38000c00 tx=0x7f9d38009030 comp rx=0 tx=0).stop 2023-07-29T02:01:44.801 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.814+0000 7f9d52c85700 1 -- 172.21.15.42:0/4003632247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d3c004850 msgr2=0x7f9d4c159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:44.801 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.814+0000 7f9d52c85700 1 --2- 172.21.15.42:0/4003632247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d3c004850 0x7f9d4c159c20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9d40011aa0 tx=0x7f9d40011e60 comp rx=0 tx=0).stop 2023-07-29T02:01:44.801 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.815+0000 7f9d52c85700 1 -- 172.21.15.42:0/4003632247 shutdown_connections 2023-07-29T02:01:44.802 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.815+0000 7f9d52c85700 1 --2- 172.21.15.42:0/4003632247 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9d3006a660 0x7f9d3006cb10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:44.802 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.815+0000 7f9d52c85700 1 --2- 172.21.15.42:0/4003632247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d4c1efb80 0x7f9d4c1efff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:44.802 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.815+0000 7f9d52c85700 1 --2- 172.21.15.42:0/4003632247 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9d3c004850 0x7f9d4c159c20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:44.802 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.815+0000 7f9d52c85700 1 --2- 172.21.15.42:0/4003632247 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9d4c15ad80 0x7f9d4c153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:44.802 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.815+0000 7f9d52c85700 1 -- 172.21.15.42:0/4003632247 >> 172.21.15.42:0/4003632247 conn(0x7f9d4c0c8970 msgr2=0x7f9d4c0caa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:44.802 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.815+0000 7f9d52c85700 1 -- 172.21.15.42:0/4003632247 shutdown_connections 2023-07-29T02:01:44.802 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:44.815+0000 7f9d52c85700 1 -- 172.21.15.42:0/4003632247 wait complete. 2023-07-29T02:01:44.803 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 12 2023-07-29T02:01:44.815 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2023-07-29T02:01:46.816 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:01:46.941 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.955+0000 7ff9b084e700 1 Processor -- start 2023-07-29T02:01:46.941 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.955+0000 7ff9b084e700 1 -- start start 2023-07-29T02:01:46.944 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.956+0000 7ff9b084e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9ac1567d0 0x7ff9ac159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:46.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.956+0000 7ff9b084e700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ac0c7700 con 0x7ff9ac0c7210 2023-07-29T02:01:46.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.956+0000 7ff9b084e700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ac159170 con 0x7ff9ac159e90 2023-07-29T02:01:46.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.956+0000 7ff9b084e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac06b160 con 0x7ff9ac1567d0 2023-07-29T02:01:46.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.956+0000 7ff9a9d9b700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff9ac0c7210 0x7ff9ac06cd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51240/0 (socket says 172.21.15.42:51240) 2023-07-29T02:01:46.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.956+0000 7ff9a9d9b700 1 -- 172.21.15.42:0/1652846970 learned_addr learned my addr 172.21.15.42:0/1652846970 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:01:46.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.956+0000 7ff9a959a700 1 -- 172.21.15.42:0/1652846970 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371687705 0 0) 0x7ff9ac0c7700 con 0x7ff9ac0c7210 2023-07-29T02:01:46.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.956+0000 7ff9aa59c700 1 --2- 172.21.15.42:0/1652846970 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9ac1567d0 0x7ff9ac159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:46.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.956+0000 7ff9a959a700 1 -- 172.21.15.42:0/1652846970 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9940035b0 con 0x7ff9ac0c7210 2023-07-29T02:01:46.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.956+0000 7ff9a959a700 1 -- 172.21.15.42:0/1652846970 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2844713670 0 0) 0x7ff9940035b0 con 0x7ff9ac0c7210 2023-07-29T02:01:46.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.956+0000 7ff9a959a700 1 -- 172.21.15.42:0/1652846970 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9ac1567d0 msgr2=0x7ff9ac159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:46.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.956+0000 7ff9a959a700 1 --2- 172.21.15.42:0/1652846970 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9ac1567d0 0x7ff9ac159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:46.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.956+0000 7ff9a959a700 1 -- 172.21.15.42:0/1652846970 >> v1:172.21.15.144:6789/0 conn(0x7ff9ac159e90 legacy=0x7ff9ac163a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:46.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.956+0000 7ff9a959a700 1 -- 172.21.15.42:0/1652846970 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac156ba0 con 0x7ff9ac0c7210 2023-07-29T02:01:46.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.956+0000 7ff9a959a700 1 -- 172.21.15.42:0/1652846970 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7ff9a0001670 con 0x7ff9ac0c7210 2023-07-29T02:01:46.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.956+0000 7ff9a959a700 1 -- 172.21.15.42:0/1652846970 >> v1:172.21.15.42:6789/0 conn(0x7ff9ac0c7210 legacy=0x7ff9ac06cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:46.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.957+0000 7ff9a959a700 1 --2- 172.21.15.42:0/1652846970 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9ac1567d0 0x7ff994003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:46.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.957+0000 7ff9a959a700 1 --2- 172.21.15.42:0/1652846970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff994003fb0 0x7ff994004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:46.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.957+0000 7ff9a959a700 1 --2- 172.21.15.42:0/1652846970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff994004d90 0x7ff994005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:46.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.957+0000 7ff9a959a700 1 -- 172.21.15.42:0/1652846970 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99400bac0 con 0x7ff994004d90 2023-07-29T02:01:46.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.957+0000 7ff9a959a700 1 -- 172.21.15.42:0/1652846970 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99400bc30 con 0x7ff994003fb0 2023-07-29T02:01:46.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.957+0000 7ff9a959a700 1 -- 172.21.15.42:0/1652846970 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99400bdf0 con 0x7ff9ac1567d0 2023-07-29T02:01:46.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.957+0000 7ff9aad9d700 1 --2- 172.21.15.42:0/1652846970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff994004d90 0x7ff994005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:46.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.957+0000 7ff9aa59c700 1 --2- 172.21.15.42:0/1652846970 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9ac1567d0 0x7ff994003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:46.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.957+0000 7ff9a9d9b700 1 --2- 172.21.15.42:0/1652846970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff994003fb0 0x7ff994004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:46.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.957+0000 7ff9aad9d700 1 -- 172.21.15.42:0/1652846970 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9ac1567d0 msgr2=0x7ff994003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:46.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.957+0000 7ff9aad9d700 1 --2- 172.21.15.42:0/1652846970 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9ac1567d0 0x7ff994003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:46.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.957+0000 7ff9aad9d700 1 -- 172.21.15.42:0/1652846970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff994003fb0 msgr2=0x7ff994004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:46.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.957+0000 7ff9aad9d700 1 --2- 172.21.15.42:0/1652846970 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff994003fb0 0x7ff994004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:46.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.957+0000 7ff9aad9d700 1 -- 172.21.15.42:0/1652846970 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9940035b0 con 0x7ff994004d90 2023-07-29T02:01:46.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.957+0000 7ff9aad9d700 1 --2- 172.21.15.42:0/1652846970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff994004d90 0x7ff994005200 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac074200 tx=0x7ff994005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f6ed33bcc54b0a server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:46.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.957+0000 7ff9a959a700 1 -- 172.21.15.42:0/1652846970 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4001db0 con 0x7ff994004d90 2023-07-29T02:01:46.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.957+0000 7ff9a959a700 1 -- 172.21.15.42:0/1652846970 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a400cc40 con 0x7ff994004d90 2023-07-29T02:01:46.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.957+0000 7ff9a959a700 1 -- 172.21.15.42:0/1652846970 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4003a00 con 0x7ff994004d90 2023-07-29T02:01:46.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.958+0000 7ff9b084e700 1 -- 172.21.15.42:0/1652846970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff994004d90 msgr2=0x7ff994005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:46.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.958+0000 7ff9b084e700 1 --2- 172.21.15.42:0/1652846970 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff994004d90 0x7ff994005200 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac074200 tx=0x7ff994005880 comp rx=0 tx=0).stop 2023-07-29T02:01:46.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.958+0000 7ff9aad9d700 1 -- 172.21.15.42:0/1652846970 reap_dead start 2023-07-29T02:01:46.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.958+0000 7ff9b084e700 1 -- 172.21.15.42:0/1652846970 shutdown_connections 2023-07-29T02:01:46.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.958+0000 7ff9b084e700 1 -- 172.21.15.42:0/1652846970 >> 172.21.15.42:0/1652846970 conn(0x7ff9ac0c8970 msgr2=0x7ff9ac0c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:46.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.958+0000 7ff9b084e700 1 -- 172.21.15.42:0/1652846970 shutdown_connections 2023-07-29T02:01:46.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.958+0000 7ff9b084e700 1 -- 172.21.15.42:0/1652846970 wait complete. 2023-07-29T02:01:46.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.959+0000 7ff9b084e700 1 Processor -- start 2023-07-29T02:01:46.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.959+0000 7ff9b084e700 1 -- start start 2023-07-29T02:01:46.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.960+0000 7ff9b084e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff994004d90 0x7ff9ac158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:46.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.960+0000 7ff9b084e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9ac0ae830 0x7ff9ac0c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:46.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.960+0000 7ff9b084e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9ac0af060 0x7ff9ac0af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:46.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.960+0000 7ff9b084e700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0afa10 con 0x7ff9ac0af060 2023-07-29T02:01:46.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.960+0000 7ff9b084e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac1ee5d0 con 0x7ff9ac0ae830 2023-07-29T02:01:46.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.960+0000 7ff9b084e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac1ee8b0 con 0x7ff994004d90 2023-07-29T02:01:46.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.960+0000 7ff9aad9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9ac0af060 0x7ff9ac0af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:46.954 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.960+0000 7ff9aad9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9ac0af060 0x7ff9ac0af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57450/0 (socket says 172.21.15.42:57450) 2023-07-29T02:01:46.954 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.960+0000 7ff9aad9d700 1 -- 172.21.15.42:0/1706656324 learned_addr learned my addr 172.21.15.42:0/1706656324 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:46.954 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.960+0000 7ff9a9d9b700 1 --2- 172.21.15.42:0/1706656324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9ac0ae830 0x7ff9ac0c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:46.954 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.960+0000 7ff9aa59c700 1 --2- 172.21.15.42:0/1706656324 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff994004d90 0x7ff9ac158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:46.954 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.960+0000 7ff9aad9d700 1 -- 172.21.15.42:0/1706656324 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff994004d90 msgr2=0x7ff9ac158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:46.954 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.960+0000 7ff9aad9d700 1 --2- 172.21.15.42:0/1706656324 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff994004d90 0x7ff9ac158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:46.954 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.960+0000 7ff9aad9d700 1 -- 172.21.15.42:0/1706656324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9ac0ae830 msgr2=0x7ff9ac0c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:46.954 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.960+0000 7ff9aad9d700 1 --2- 172.21.15.42:0/1706656324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9ac0ae830 0x7ff9ac0c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:46.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.960+0000 7ff9aad9d700 1 -- 172.21.15.42:0/1706656324 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac1eeb90 con 0x7ff9ac0af060 2023-07-29T02:01:46.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.960+0000 7ff9a9d9b700 1 --2- 172.21.15.42:0/1706656324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9ac0ae830 0x7ff9ac0c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:01:46.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.961+0000 7ff9aad9d700 1 --2- 172.21.15.42:0/1706656324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9ac0af060 0x7ff9ac0af4d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4005040 tx=0x7ff9a40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:46.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.961+0000 7ff99affd700 1 -- 172.21.15.42:0/1706656324 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4003c10 con 0x7ff9ac0af060 2023-07-29T02:01:46.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.961+0000 7ff99affd700 1 -- 172.21.15.42:0/1706656324 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a4003d70 con 0x7ff9ac0af060 2023-07-29T02:01:46.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.961+0000 7ff9b084e700 1 -- 172.21.15.42:0/1706656324 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ac1eee70 con 0x7ff9ac0af060 2023-07-29T02:01:46.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.961+0000 7ff99affd700 1 -- 172.21.15.42:0/1706656324 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4005310 con 0x7ff9ac0af060 2023-07-29T02:01:46.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.961+0000 7ff9b084e700 1 -- 172.21.15.42:0/1706656324 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ac1ee2a0 con 0x7ff9ac0af060 2023-07-29T02:01:46.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.962+0000 7ff9b084e700 1 -- 172.21.15.42:0/1706656324 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ac074740 con 0x7ff9ac0af060 2023-07-29T02:01:46.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.962+0000 7ff99affd700 1 -- 172.21.15.42:0/1706656324 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7ff9a4019070 con 0x7ff9ac0af060 2023-07-29T02:01:46.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.963+0000 7ff99affd700 1 --2- 172.21.15.42:0/1706656324 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff98c06a660 0x7ff98c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:46.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.963+0000 7ff99affd700 1 -- 172.21.15.42:0/1706656324 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6936+0+0 (secure 0 0 0) 0x7ff9a4089930 con 0x7ff9ac0af060 2023-07-29T02:01:46.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.963+0000 7ff9aa59c700 1 --2- 172.21.15.42:0/1706656324 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff98c06a660 0x7ff98c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:46.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.963+0000 7ff9aa59c700 1 --2- 172.21.15.42:0/1706656324 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff98c06a660 0x7ff98c06cb10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009c60 tx=0x7ff99c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:46.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:46.967+0000 7ff99affd700 1 -- 172.21.15.42:0/1706656324 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7ff9a4054a50 con 0x7ff9ac0af060 2023-07-29T02:01:47.198 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:47.212+0000 7ff9b084e700 1 -- 172.21.15.42:0/1706656324 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9ac04ea50 con 0x7ff9ac0af060 2023-07-29T02:01:47.199 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:47.212+0000 7ff99affd700 1 -- 172.21.15.42:0/1706656324 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+5412 (secure 0 0 0) 0x7ff9a4058070 con 0x7ff9ac0af060 2023-07-29T02:01:47.200 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:01:47.200 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:01:45.635336+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":11,"state":"up:rejoin","state_seq":30,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:01:47.201 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:47.215+0000 7ff9b084e700 1 -- 172.21.15.42:0/1706656324 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff98c06a660 msgr2=0x7ff98c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:47.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:47.215+0000 7ff9b084e700 1 --2- 172.21.15.42:0/1706656324 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff98c06a660 0x7ff98c06cb10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009c60 tx=0x7ff99c009210 comp rx=0 tx=0).stop 2023-07-29T02:01:47.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:47.215+0000 7ff9b084e700 1 -- 172.21.15.42:0/1706656324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9ac0af060 msgr2=0x7ff9ac0af4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:47.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:47.215+0000 7ff9b084e700 1 --2- 172.21.15.42:0/1706656324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9ac0af060 0x7ff9ac0af4d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4005040 tx=0x7ff9a40014a0 comp rx=0 tx=0).stop 2023-07-29T02:01:47.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:47.215+0000 7ff9b084e700 1 -- 172.21.15.42:0/1706656324 shutdown_connections 2023-07-29T02:01:47.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:47.215+0000 7ff9b084e700 1 --2- 172.21.15.42:0/1706656324 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff98c06a660 0x7ff98c06cb10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:47.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:47.215+0000 7ff9b084e700 1 --2- 172.21.15.42:0/1706656324 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9ac0af060 0x7ff9ac0af4d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:47.202 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:47.215+0000 7ff9b084e700 1 --2- 172.21.15.42:0/1706656324 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff994004d90 0x7ff9ac158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:47.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:47.215+0000 7ff9b084e700 1 --2- 172.21.15.42:0/1706656324 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9ac0ae830 0x7ff9ac0c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:47.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:47.215+0000 7ff9b084e700 1 -- 172.21.15.42:0/1706656324 >> 172.21.15.42:0/1706656324 conn(0x7ff9ac0c8970 msgr2=0x7ff9ac0727f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:47.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:47.215+0000 7ff9b084e700 1 -- 172.21.15.42:0/1706656324 shutdown_connections 2023-07-29T02:01:47.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:47.215+0000 7ff9b084e700 1 -- 172.21.15.42:0/1706656324 wait complete. 2023-07-29T02:01:47.203 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 13 2023-07-29T02:01:47.213 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 13, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-07-29T01:59:57.946839+0000", "damaged": [], "data_pools": [ 4, 5 ], "enabled": true, "epoch": 13, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4297": { "addr": "172.21.15.144:6839/3824722756", "addrs": { "addrvec": [ { "addr": "172.21.15.144:6837", "nonce": 3824722756, "type": "v2" }, { "addr": "172.21.15.144:6839", "nonce": 3824722756, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4297, "incarnation": 11, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:rejoin", "state_seq": 30 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 3, "modified": "2023-07-29T02:01:45.635336+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4297 } } } ], "standbys": [ { "addr": "172.21.15.42:6833/3242692321", "addrs": { "addrvec": [ { "addr": "172.21.15.42:6832", "nonce": 3242692321, "type": "v2" }, { "addr": "172.21.15.42:6833", "nonce": 3242692321, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4263, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.42:6835/1860885615", "addrs": { "addrvec": [ { "addr": "172.21.15.42:6834", "nonce": 1860885615, "type": "v2" }, { "addr": "172.21.15.42:6835", "nonce": 1860885615, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4266, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.144:6835/400694688", "addrs": { "addrvec": [ { "addr": "172.21.15.144:6834", "nonce": 400694688, "type": "v2" }, { "addr": "172.21.15.144:6835", "nonce": 400694688, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4291, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.144:6838/2604441175", "addrs": { "addrvec": [ { "addr": "172.21.15.144:6836", "nonce": 2604441175, "type": "v2" }, { "addr": "172.21.15.144:6838", "nonce": 2604441175, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4294, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-07-29T02:01:49.214 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:01:49.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.421+0000 7f576a439700 1 Processor -- start 2023-07-29T02:01:49.408 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.421+0000 7f576a439700 1 -- start start 2023-07-29T02:01:49.408 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.422+0000 7f576a439700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5764153480 0x7f57640707d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:49.409 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.422+0000 7f576a439700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f57640c66d0 0x7f5764070d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:49.409 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.422+0000 7f576a439700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5764072bb0 con 0x7f57640c5f50 2023-07-29T02:01:49.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.422+0000 7f576a439700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57640c7210 con 0x7f5764153480 2023-07-29T02:01:49.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.422+0000 7f576a439700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5764072940 con 0x7f57640c66d0 2023-07-29T02:01:49.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.423+0000 7f5763fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5764153480 0x7f57640707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:49.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.423+0000 7f575bfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f57640c66d0 0x7f5764070d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:49.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.423+0000 7f575bfff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f57640c66d0 0x7f5764070d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:57970/0 (socket says 172.21.15.42:57970) 2023-07-29T02:01:49.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.423+0000 7f5763fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5764153480 0x7f57640707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:40832/0 (socket says 172.21.15.42:40832) 2023-07-29T02:01:49.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.423+0000 7f575bfff700 1 -- 172.21.15.42:0/739106557 learned_addr learned my addr 172.21.15.42:0/739106557 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:49.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.423+0000 7f57637fe700 1 -- 172.21.15.42:0/739106557 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137757740 0 0) 0x7f5764072bb0 con 0x7f57640c5f50 2023-07-29T02:01:49.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.423+0000 7f575bfff700 1 -- 172.21.15.42:0/739106557 >> v2:172.21.15.144:3300/0 conn(0x7f5764153480 msgr2=0x7f57640707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:49.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.423+0000 7f575bfff700 1 --2- 172.21.15.42:0/739106557 >> v2:172.21.15.144:3300/0 conn(0x7f5764153480 0x7f57640707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:49.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.423+0000 7f575bfff700 1 -- 172.21.15.42:0/739106557 >> v1:172.21.15.144:6789/0 conn(0x7f57640c5f50 legacy=0x7f57640c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:49.411 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.423+0000 7f575bfff700 1 -- 172.21.15.42:0/739106557 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5764153850 con 0x7f57640c66d0 2023-07-29T02:01:49.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.424+0000 7f575bfff700 1 --2- 172.21.15.42:0/739106557 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f57640c66d0 0x7f5764070d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f574c0098f0 tx=0x7f574c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7b1dd7b7dc3f7ff server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:49.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.424+0000 7f57637fe700 1 -- 172.21.15.42:0/739106557 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c011830 con 0x7f57640c66d0 2023-07-29T02:01:49.412 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.424+0000 7f57637fe700 1 -- 172.21.15.42:0/739106557 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574c011990 con 0x7f57640c66d0 2023-07-29T02:01:49.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.424+0000 7f57637fe700 1 -- 172.21.15.42:0/739106557 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c011d20 con 0x7f57640c66d0 2023-07-29T02:01:49.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.425+0000 7f576a439700 1 -- 172.21.15.42:0/739106557 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f57640c66d0 msgr2=0x7f5764070d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:49.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.425+0000 7f576a439700 1 --2- 172.21.15.42:0/739106557 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f57640c66d0 0x7f5764070d10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f574c0098f0 tx=0x7f574c009c00 comp rx=0 tx=0).stop 2023-07-29T02:01:49.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.425+0000 7f576a439700 1 -- 172.21.15.42:0/739106557 shutdown_connections 2023-07-29T02:01:49.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.425+0000 7f576a439700 1 --2- 172.21.15.42:0/739106557 >> v2:172.21.15.144:3300/0 conn(0x7f5764153480 0x7f57640707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:49.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.425+0000 7f576a439700 1 --2- 172.21.15.42:0/739106557 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f57640c66d0 0x7f5764070d10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:49.413 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.425+0000 7f576a439700 1 -- 172.21.15.42:0/739106557 >> 172.21.15.42:0/739106557 conn(0x7f57640cc360 msgr2=0x7f57640c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:49.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.425+0000 7f576a439700 1 -- 172.21.15.42:0/739106557 shutdown_connections 2023-07-29T02:01:49.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.425+0000 7f576a439700 1 -- 172.21.15.42:0/739106557 wait complete. 2023-07-29T02:01:49.414 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.427+0000 7f576a439700 1 Processor -- start 2023-07-29T02:01:49.415 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.427+0000 7f576a439700 1 -- start start 2023-07-29T02:01:49.415 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.428+0000 7f576a439700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57640c5f50 0x7f5764156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:49.415 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.428+0000 7f576a439700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57640c66d0 0x7f576415aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:49.415 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.428+0000 7f576a439700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5764153480 0x7f576415bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:49.415 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.428+0000 7f576a439700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576415b950 con 0x7f57640c5f50 2023-07-29T02:01:49.415 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.428+0000 7f576a439700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576415a380 con 0x7f57640c66d0 2023-07-29T02:01:49.416 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.428+0000 7f576a439700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57640c1e30 con 0x7f5764153480 2023-07-29T02:01:49.416 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.428+0000 7f5763fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57640c5f50 0x7f5764156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:49.416 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.428+0000 7f5763fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57640c5f50 0x7f5764156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57460/0 (socket says 172.21.15.42:57460) 2023-07-29T02:01:49.416 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.428+0000 7f5763fff700 1 -- 172.21.15.42:0/2969629229 learned_addr learned my addr 172.21.15.42:0/2969629229 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:49.416 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.428+0000 7f57689d6700 1 --2- 172.21.15.42:0/2969629229 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5764153480 0x7f576415bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:49.417 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.428+0000 7f575bfff700 1 --2- 172.21.15.42:0/2969629229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57640c66d0 0x7f576415aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:49.418 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.429+0000 7f5763fff700 1 -- 172.21.15.42:0/2969629229 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5764153480 msgr2=0x7f576415bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:49.418 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.429+0000 7f5763fff700 1 --2- 172.21.15.42:0/2969629229 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5764153480 0x7f576415bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:49.418 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.429+0000 7f5763fff700 1 -- 172.21.15.42:0/2969629229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57640c66d0 msgr2=0x7f576415aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:49.418 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.429+0000 7f5763fff700 1 --2- 172.21.15.42:0/2969629229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57640c66d0 0x7f576415aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:49.418 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.429+0000 7f5763fff700 1 -- 172.21.15.42:0/2969629229 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574c009550 con 0x7f57640c5f50 2023-07-29T02:01:49.418 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.429+0000 7f575bfff700 1 --2- 172.21.15.42:0/2969629229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57640c66d0 0x7f576415aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:01:49.418 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.429+0000 7f5763fff700 1 --2- 172.21.15.42:0/2969629229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57640c5f50 0x7f5764156270 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f575400e870 tx=0x7f575400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:49.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.429+0000 7f57617fa700 1 -- 172.21.15.42:0/2969629229 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5754009590 con 0x7f57640c5f50 2023-07-29T02:01:49.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.429+0000 7f57617fa700 1 -- 172.21.15.42:0/2969629229 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5754013680 con 0x7f57640c5f50 2023-07-29T02:01:49.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.429+0000 7f576a439700 1 -- 172.21.15.42:0/2969629229 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57640c2110 con 0x7f57640c5f50 2023-07-29T02:01:49.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.429+0000 7f57617fa700 1 -- 172.21.15.42:0/2969629229 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57540139f0 con 0x7f57640c5f50 2023-07-29T02:01:49.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.429+0000 7f576a439700 1 -- 172.21.15.42:0/2969629229 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576415b5e0 con 0x7f57640c5f50 2023-07-29T02:01:49.419 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.430+0000 7f576a439700 1 -- 172.21.15.42:0/2969629229 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576404ea50 con 0x7f57640c5f50 2023-07-29T02:01:49.421 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.435+0000 7f57617fa700 1 -- 172.21.15.42:0/2969629229 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f5754013b50 con 0x7f57640c5f50 2023-07-29T02:01:49.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.436+0000 7f57617fa700 1 --2- 172.21.15.42:0/2969629229 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f574406a660 0x7f574406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:49.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.436+0000 7f57617fa700 1 -- 172.21.15.42:0/2969629229 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6936+0+0 (secure 0 0 0) 0x7f5754089550 con 0x7f57640c5f50 2023-07-29T02:01:49.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.436+0000 7f575bfff700 1 --2- 172.21.15.42:0/2969629229 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f574406a660 0x7f574406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:49.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.437+0000 7f575bfff700 1 --2- 172.21.15.42:0/2969629229 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f574406a660 0x7f574406cb10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f574c0098f0 tx=0x7f574c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:49.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.443+0000 7f57617fa700 1 -- 172.21.15.42:0/2969629229 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f5754057fe0 con 0x7f57640c5f50 2023-07-29T02:01:49.714 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.728+0000 7f576a439700 1 -- 172.21.15.42:0/2969629229 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57640c8f90 con 0x7f57640c5f50 2023-07-29T02:01:49.715 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.728+0000 7f57617fa700 1 -- 172.21.15.42:0/2969629229 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+5412 (secure 0 0 0) 0x7f5754021090 con 0x7f57640c5f50 2023-07-29T02:01:49.715 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:01:49.715 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:01:45.635336+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":11,"state":"up:rejoin","state_seq":30,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:01:49.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.730+0000 7f576a439700 1 -- 172.21.15.42:0/2969629229 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f574406a660 msgr2=0x7f574406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:49.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.730+0000 7f576a439700 1 --2- 172.21.15.42:0/2969629229 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f574406a660 0x7f574406cb10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f574c0098f0 tx=0x7f574c008030 comp rx=0 tx=0).stop 2023-07-29T02:01:49.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.730+0000 7f576a439700 1 -- 172.21.15.42:0/2969629229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57640c5f50 msgr2=0x7f5764156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:49.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.730+0000 7f576a439700 1 --2- 172.21.15.42:0/2969629229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57640c5f50 0x7f5764156270 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f575400e870 tx=0x7f575400eb80 comp rx=0 tx=0).stop 2023-07-29T02:01:49.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.730+0000 7f576a439700 1 -- 172.21.15.42:0/2969629229 shutdown_connections 2023-07-29T02:01:49.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.730+0000 7f576a439700 1 --2- 172.21.15.42:0/2969629229 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f574406a660 0x7f574406cb10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:49.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.730+0000 7f576a439700 1 --2- 172.21.15.42:0/2969629229 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5764153480 0x7f576415bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:49.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.730+0000 7f576a439700 1 --2- 172.21.15.42:0/2969629229 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f57640c5f50 0x7f5764156270 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:49.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.730+0000 7f576a439700 1 --2- 172.21.15.42:0/2969629229 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f57640c66d0 0x7f576415aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:49.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.730+0000 7f576a439700 1 -- 172.21.15.42:0/2969629229 >> 172.21.15.42:0/2969629229 conn(0x7f57640cc360 msgr2=0x7f57640ca6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:49.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.731+0000 7f576a439700 1 -- 172.21.15.42:0/2969629229 shutdown_connections 2023-07-29T02:01:49.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:49.731+0000 7f576a439700 1 -- 172.21.15.42:0/2969629229 wait complete. 2023-07-29T02:01:49.719 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 13 2023-07-29T02:01:49.729 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2023-07-29T02:01:51.730 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:01:51.925 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.938+0000 7f17b1503700 1 Processor -- start 2023-07-29T02:01:51.925 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.939+0000 7f17b1503700 1 -- start start 2023-07-29T02:01:51.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.940+0000 7f17b1503700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f17ac156740 0x7f17ac1597a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:51.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.940+0000 7f17b1503700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17ac06db60 0x7f17ac159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:51.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.940+0000 7f17b1503700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17ac159310 con 0x7f17ac072a90 2023-07-29T02:01:51.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.940+0000 7f17b1503700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17ac06a850 con 0x7f17ac156740 2023-07-29T02:01:51.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.940+0000 7f17b1503700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac06bea0 con 0x7f17ac06db60 2023-07-29T02:01:51.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.940+0000 7f17aaffd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f17ac156740 0x7f17ac1597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:51.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.940+0000 7f17aa7fc700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f17ac072a90 0x7f17ac06cd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51276/0 (socket says 172.21.15.42:51276) 2023-07-29T02:01:51.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.940+0000 7f17aa7fc700 1 -- 172.21.15.42:0/136641835 learned_addr learned my addr 172.21.15.42:0/136641835 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:01:51.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.940+0000 7f17ab7fe700 1 --2- 172.21.15.42:0/136641835 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17ac06db60 0x7f17ac159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:51.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.940+0000 7f17aaffd700 1 -- 172.21.15.42:0/136641835 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17ac06db60 msgr2=0x7f17ac159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:01:51.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.940+0000 7f17aaffd700 1 --2- 172.21.15.42:0/136641835 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17ac06db60 0x7f17ac159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:51.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.940+0000 7f17a9ffb700 1 -- 172.21.15.42:0/136641835 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1390799700 0 0) 0x7f17ac159310 con 0x7f17ac072a90 2023-07-29T02:01:51.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.940+0000 7f17aaffd700 1 -- 172.21.15.42:0/136641835 >> v1:172.21.15.42:6789/0 conn(0x7f17ac072a90 legacy=0x7f17ac06cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:51.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.940+0000 7f17aaffd700 1 -- 172.21.15.42:0/136641835 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ac06b5d0 con 0x7f17ac156740 2023-07-29T02:01:51.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.941+0000 7f17aaffd700 1 --2- 172.21.15.42:0/136641835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17ac156740 0x7f17ac1597a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f179c009840 tx=0x7f179c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57be5948c4b78ab4 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:51.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.941+0000 7f17a9ffb700 1 -- 172.21.15.42:0/136641835 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c011830 con 0x7f17ac156740 2023-07-29T02:01:51.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.941+0000 7f17a9ffb700 1 -- 172.21.15.42:0/136641835 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179c011990 con 0x7f17ac156740 2023-07-29T02:01:51.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.941+0000 7f17a9ffb700 1 -- 172.21.15.42:0/136641835 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c011d20 con 0x7f17ac156740 2023-07-29T02:01:51.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.942+0000 7f17b1503700 1 -- 172.21.15.42:0/136641835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17ac156740 msgr2=0x7f17ac1597a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:51.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.942+0000 7f17b1503700 1 --2- 172.21.15.42:0/136641835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17ac156740 0x7f17ac1597a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f179c009840 tx=0x7f179c009b50 comp rx=0 tx=0).stop 2023-07-29T02:01:51.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.942+0000 7f17b1503700 1 -- 172.21.15.42:0/136641835 shutdown_connections 2023-07-29T02:01:51.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.942+0000 7f17b1503700 1 --2- 172.21.15.42:0/136641835 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17ac06db60 0x7f17ac159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:51.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.942+0000 7f17b1503700 1 --2- 172.21.15.42:0/136641835 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17ac156740 0x7f17ac1597a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:51.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.942+0000 7f17b1503700 1 -- 172.21.15.42:0/136641835 >> 172.21.15.42:0/136641835 conn(0x7f17ac0c8970 msgr2=0x7f17ac0c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:51.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.942+0000 7f17b1503700 1 -- 172.21.15.42:0/136641835 shutdown_connections 2023-07-29T02:01:51.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.942+0000 7f17b1503700 1 -- 172.21.15.42:0/136641835 wait complete. 2023-07-29T02:01:51.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.944+0000 7f17b1503700 1 Processor -- start 2023-07-29T02:01:51.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.944+0000 7f17b1503700 1 -- start start 2023-07-29T02:01:51.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.945+0000 7f17b1503700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17ac06db60 0x7f17ac0c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:51.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.945+0000 7f17b1503700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17ac072a90 0x7f17ac154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:51.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.945+0000 7f17b1503700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ac156740 0x7f17ac1ef9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:51.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.945+0000 7f17b1503700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac158cc0 con 0x7f17ac06db60 2023-07-29T02:01:51.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.945+0000 7f17b1503700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac158a40 con 0x7f17ac156740 2023-07-29T02:01:51.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.945+0000 7f17b1503700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17ac1f1a90 con 0x7f17ac072a90 2023-07-29T02:01:51.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.946+0000 7f17aaffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17ac06db60 0x7f17ac0c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:51.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.946+0000 7f17aaffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17ac06db60 0x7f17ac0c5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57474/0 (socket says 172.21.15.42:57474) 2023-07-29T02:01:51.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.946+0000 7f17aaffd700 1 -- 172.21.15.42:0/963870179 learned_addr learned my addr 172.21.15.42:0/963870179 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:51.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.946+0000 7f17aa7fc700 1 --2- 172.21.15.42:0/963870179 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17ac072a90 0x7f17ac154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:51.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.946+0000 7f17ab7fe700 1 --2- 172.21.15.42:0/963870179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ac156740 0x7f17ac1ef9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:51.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.946+0000 7f17aaffd700 1 -- 172.21.15.42:0/963870179 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17ac072a90 msgr2=0x7f17ac154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:51.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.946+0000 7f17aaffd700 1 --2- 172.21.15.42:0/963870179 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17ac072a90 0x7f17ac154320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:51.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.946+0000 7f17aaffd700 1 -- 172.21.15.42:0/963870179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ac156740 msgr2=0x7f17ac1ef9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:51.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.946+0000 7f17aaffd700 1 --2- 172.21.15.42:0/963870179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ac156740 0x7f17ac1ef9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:51.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.946+0000 7f17aaffd700 1 -- 172.21.15.42:0/963870179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c0094a0 con 0x7f17ac06db60 2023-07-29T02:01:51.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.946+0000 7f17aaffd700 1 --2- 172.21.15.42:0/963870179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17ac06db60 0x7f17ac0c5850 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f179c009fd0 tx=0x7f179c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:51.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.946+0000 7f17937fe700 1 -- 172.21.15.42:0/963870179 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c004550 con 0x7f17ac06db60 2023-07-29T02:01:51.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.947+0000 7f17937fe700 1 -- 172.21.15.42:0/963870179 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179c01e070 con 0x7f17ac06db60 2023-07-29T02:01:51.935 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.947+0000 7f17937fe700 1 -- 172.21.15.42:0/963870179 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c0038e0 con 0x7f17ac06db60 2023-07-29T02:01:51.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.947+0000 7f17b1503700 1 -- 172.21.15.42:0/963870179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17ac1f1d70 con 0x7f17ac06db60 2023-07-29T02:01:51.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.947+0000 7f17b1503700 1 -- 172.21.15.42:0/963870179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17ac1f2330 con 0x7f17ac06db60 2023-07-29T02:01:51.936 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.948+0000 7f17b1503700 1 -- 172.21.15.42:0/963870179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17ac074740 con 0x7f17ac06db60 2023-07-29T02:01:51.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.950+0000 7f17937fe700 1 -- 172.21.15.42:0/963870179 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f179c003a40 con 0x7f17ac06db60 2023-07-29T02:01:51.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.950+0000 7f17937fe700 1 --2- 172.21.15.42:0/963870179 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f179806a660 0x7f179806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:51.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.950+0000 7f17937fe700 1 -- 172.21.15.42:0/963870179 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6936+0+0 (secure 0 0 0) 0x7f179c08a1e0 con 0x7f17ac06db60 2023-07-29T02:01:51.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.950+0000 7f17aa7fc700 1 --2- 172.21.15.42:0/963870179 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f179806a660 0x7f179806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:51.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.951+0000 7f17aa7fc700 1 --2- 172.21.15.42:0/963870179 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f179806a660 0x7f179806cb10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f17a0007b10 tx=0x7f17a0007a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:51.943 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:51.957+0000 7f17937fe700 1 -- 172.21.15.42:0/963870179 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f179c055350 con 0x7f17ac06db60 2023-07-29T02:01:52.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:52.442+0000 7f17b1503700 1 -- 172.21.15.42:0/963870179 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17ac04ea50 con 0x7f17ac06db60 2023-07-29T02:01:52.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:52.443+0000 7f17937fe700 1 -- 172.21.15.42:0/963870179 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+5412 (secure 0 0 0) 0x7f179c020090 con 0x7f17ac06db60 2023-07-29T02:01:52.430 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:01:52.431 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:01:50.646610+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":32,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:01:52.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:52.445+0000 7f17b1503700 1 -- 172.21.15.42:0/963870179 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f179806a660 msgr2=0x7f179806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:52.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:52.445+0000 7f17b1503700 1 --2- 172.21.15.42:0/963870179 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f179806a660 0x7f179806cb10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f17a0007b10 tx=0x7f17a0007a60 comp rx=0 tx=0).stop 2023-07-29T02:01:52.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:52.446+0000 7f17b1503700 1 -- 172.21.15.42:0/963870179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17ac06db60 msgr2=0x7f17ac0c5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:52.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:52.446+0000 7f17b1503700 1 --2- 172.21.15.42:0/963870179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17ac06db60 0x7f17ac0c5850 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f179c009fd0 tx=0x7f179c004750 comp rx=0 tx=0).stop 2023-07-29T02:01:52.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:52.446+0000 7f17b1503700 1 -- 172.21.15.42:0/963870179 shutdown_connections 2023-07-29T02:01:52.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:52.446+0000 7f17b1503700 1 --2- 172.21.15.42:0/963870179 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f179806a660 0x7f179806cb10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:52.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:52.446+0000 7f17b1503700 1 --2- 172.21.15.42:0/963870179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f17ac156740 0x7f17ac1ef9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:52.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:52.446+0000 7f17b1503700 1 --2- 172.21.15.42:0/963870179 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f17ac06db60 0x7f17ac0c5850 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:52.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:52.446+0000 7f17b1503700 1 --2- 172.21.15.42:0/963870179 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f17ac072a90 0x7f17ac154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:52.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:52.446+0000 7f17b1503700 1 -- 172.21.15.42:0/963870179 >> 172.21.15.42:0/963870179 conn(0x7f17ac0c8970 msgr2=0x7f17ac0c7600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:52.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:52.446+0000 7f17b1503700 1 -- 172.21.15.42:0/963870179 shutdown_connections 2023-07-29T02:01:52.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:52.446+0000 7f17b1503700 1 -- 172.21.15.42:0/963870179 wait complete. 2023-07-29T02:01:52.434 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 14 2023-07-29T02:01:52.448 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d has gained rank=0, replacing gid=4300 2023-07-29T02:01:52.449 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 3 secs before reviving mds.e 2023-07-29T02:01:55.449 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.e 2023-07-29T02:01:55.450 INFO:tasks.ceph.mds.e:Restarting daemon 2023-07-29T02:01:55.450 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2023-07-29T02:01:55.452 INFO:tasks.ceph.mds.e:Started 2023-07-29T02:01:55.453 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:01:55.549 INFO:tasks.ceph.mds.e.smithi042.stdout:starting mds.e at 2023-07-29T02:01:55.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.605+0000 7f829b496700 1 Processor -- start 2023-07-29T02:01:55.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.606+0000 7f829b496700 1 -- start start 2023-07-29T02:01:55.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.607+0000 7f829b496700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f82940c9f70 0x7f82940ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:55.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.607+0000 7f829b496700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f829415d750 con 0x7f82941591b0 2023-07-29T02:01:55.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.607+0000 7f829b496700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82941536c0 con 0x7f82941532f0 2023-07-29T02:01:55.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.607+0000 7f829b496700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82940ca910 con 0x7f82940c9f70 2023-07-29T02:01:55.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.607+0000 7f8299a33700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f82940c9f70 0x7f82940ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:55.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.607+0000 7f8299a33700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f82940c9f70 0x7f82940ca3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57498/0 (socket says 172.21.15.42:57498) 2023-07-29T02:01:55.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.607+0000 7f8299a33700 1 -- 172.21.15.42:0/3596595253 learned_addr learned my addr 172.21.15.42:0/3596595253 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:55.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.607+0000 7f8298a31700 1 --1- 172.21.15.42:0/3596595253 >> v1:172.21.15.42:6789/0 conn(0x7f82941591b0 0x7f829406fe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51298/0 (socket says 172.21.15.42:51298) 2023-07-29T02:01:55.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.607+0000 7f8299a33700 1 -- 172.21.15.42:0/3596595253 >> v1:172.21.15.144:6789/0 conn(0x7f82941532f0 legacy=0x7f829415d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:55.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.607+0000 7f8299a33700 1 -- 172.21.15.42:0/3596595253 >> v1:172.21.15.42:6789/0 conn(0x7f82941591b0 legacy=0x7f829406fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.607+0000 7f828bfff700 1 -- 172.21.15.42:0/3596595253 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364832002 0 0) 0x7f8284001110 con 0x7f82941591b0 2023-07-29T02:01:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.607+0000 7f8299a33700 1 -- 172.21.15.42:0/3596595253 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82941597f0 con 0x7f82940c9f70 2023-07-29T02:01:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.607+0000 7f8299a33700 1 --2- 172.21.15.42:0/3596595253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82940c9f70 0x7f82940ca3d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f828c009e50 tx=0x7f828c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e76a8fa66c76596 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.608+0000 7f828bfff700 1 -- 172.21.15.42:0/3596595253 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c00e070 con 0x7f82940c9f70 2023-07-29T02:01:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.608+0000 7f828bfff700 1 -- 172.21.15.42:0/3596595253 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c00b9c0 con 0x7f82940c9f70 2023-07-29T02:01:55.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.608+0000 7f828bfff700 1 -- 172.21.15.42:0/3596595253 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c00bd70 con 0x7f82940c9f70 2023-07-29T02:01:55.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.608+0000 7f829b496700 1 -- 172.21.15.42:0/3596595253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82940c9f70 msgr2=0x7f82940ca3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:55.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.608+0000 7f829b496700 1 --2- 172.21.15.42:0/3596595253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82940c9f70 0x7f82940ca3d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f828c009e50 tx=0x7f828c00b330 comp rx=0 tx=0).stop 2023-07-29T02:01:55.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.608+0000 7f829b496700 1 -- 172.21.15.42:0/3596595253 shutdown_connections 2023-07-29T02:01:55.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.608+0000 7f829b496700 1 --2- 172.21.15.42:0/3596595253 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82940c9f70 0x7f82940ca3d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:55.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.608+0000 7f829b496700 1 -- 172.21.15.42:0/3596595253 >> 172.21.15.42:0/3596595253 conn(0x7f829406a750 msgr2=0x7f829406ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:55.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.608+0000 7f829b496700 1 -- 172.21.15.42:0/3596595253 shutdown_connections 2023-07-29T02:01:55.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.609+0000 7f829b496700 1 -- 172.21.15.42:0/3596595253 wait complete. 2023-07-29T02:01:55.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.610+0000 7f829b496700 1 Processor -- start 2023-07-29T02:01:55.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.610+0000 7f829b496700 1 -- start start 2023-07-29T02:01:55.599 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.610+0000 7f829b496700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82940c9f70 0x7f829414eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:55.599 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.610+0000 7f829b496700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82941532f0 0x7f82941e5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:55.599 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.611+0000 7f829b496700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82941591b0 0x7f82940c2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:55.599 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.611+0000 7f829b496700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82941e6630 con 0x7f82941532f0 2023-07-29T02:01:55.599 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.611+0000 7f829b496700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82940c3670 con 0x7f82941591b0 2023-07-29T02:01:55.600 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.611+0000 7f829b496700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82940c3f90 con 0x7f82940c9f70 2023-07-29T02:01:55.600 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.611+0000 7f8298a31700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82941532f0 0x7f82941e5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:55.600 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.611+0000 7f8298a31700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82941532f0 0x7f82941e5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57504/0 (socket says 172.21.15.42:57504) 2023-07-29T02:01:55.600 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.611+0000 7f8298a31700 1 -- 172.21.15.42:0/938410413 learned_addr learned my addr 172.21.15.42:0/938410413 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:01:55.600 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.611+0000 7f8299232700 1 --2- 172.21.15.42:0/938410413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82940c9f70 0x7f829414eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:55.600 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.611+0000 7f8299a33700 1 --2- 172.21.15.42:0/938410413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82941591b0 0x7f82940c2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:55.600 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.611+0000 7f8298a31700 1 -- 172.21.15.42:0/938410413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82940c9f70 msgr2=0x7f829414eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:55.600 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.611+0000 7f8298a31700 1 --2- 172.21.15.42:0/938410413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82940c9f70 0x7f829414eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:55.601 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.611+0000 7f8298a31700 1 -- 172.21.15.42:0/938410413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82941591b0 msgr2=0x7f82940c2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:55.601 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.611+0000 7f8298a31700 1 --2- 172.21.15.42:0/938410413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82941591b0 0x7f82940c2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:55.601 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.611+0000 7f8298a31700 1 -- 172.21.15.42:0/938410413 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c009b30 con 0x7f82941532f0 2023-07-29T02:01:55.601 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.611+0000 7f8299232700 1 --2- 172.21.15.42:0/938410413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82940c9f70 0x7f829414eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:01:55.601 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.611+0000 7f8298a31700 1 --2- 172.21.15.42:0/938410413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82941532f0 0x7f82941e5ab0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f828400c520 tx=0x7f828400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:55.601 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.612+0000 7f8289ffb700 1 -- 172.21.15.42:0/938410413 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284004c80 con 0x7f82941532f0 2023-07-29T02:01:55.601 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.612+0000 7f8289ffb700 1 -- 172.21.15.42:0/938410413 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8284004de0 con 0x7f82941532f0 2023-07-29T02:01:55.602 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.612+0000 7f8289ffb700 1 -- 172.21.15.42:0/938410413 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284007310 con 0x7f82941532f0 2023-07-29T02:01:55.602 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.612+0000 7f829b496700 1 -- 172.21.15.42:0/938410413 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82940cd9d0 con 0x7f82941532f0 2023-07-29T02:01:55.602 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.612+0000 7f829b496700 1 -- 172.21.15.42:0/938410413 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82940c3cb0 con 0x7f82941532f0 2023-07-29T02:01:55.602 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.613+0000 7f829b496700 1 -- 172.21.15.42:0/938410413 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82940c1fb0 con 0x7f82941532f0 2023-07-29T02:01:55.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.614+0000 7f8289ffb700 1 -- 172.21.15.42:0/938410413 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f8284007470 con 0x7f82941532f0 2023-07-29T02:01:55.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.615+0000 7f8289ffb700 1 --2- 172.21.15.42:0/938410413 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f827806a660 0x7f827806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:01:55.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.615+0000 7f8289ffb700 1 -- 172.21.15.42:0/938410413 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6936+0+0 (secure 0 0 0) 0x7f8284088cd0 con 0x7f82941532f0 2023-07-29T02:01:55.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.615+0000 7f8299232700 1 --2- 172.21.15.42:0/938410413 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f827806a660 0x7f827806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:01:55.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.616+0000 7f8299232700 1 --2- 172.21.15.42:0/938410413 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f827806a660 0x7f827806cb10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8290007fd0 tx=0x7f8290009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:01:55.604 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.618+0000 7f8289ffb700 1 -- 172.21.15.42:0/938410413 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f8284053dd0 con 0x7f82941532f0 2023-07-29T02:01:55.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.868+0000 7f829b496700 1 -- 172.21.15.42:0/938410413 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f829415d750 con 0x7f82941532f0 2023-07-29T02:01:55.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.868+0000 7f8289ffb700 1 -- 172.21.15.42:0/938410413 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6169 (secure 0 0 0) 0x7f829415d750 con 0x7f82941532f0 2023-07-29T02:01:55.855 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:01:55.855 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5142,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:01:50.646610+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":32,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:01:55.858 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.871+0000 7f829b496700 1 -- 172.21.15.42:0/938410413 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f827806a660 msgr2=0x7f827806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:55.858 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.871+0000 7f829b496700 1 --2- 172.21.15.42:0/938410413 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f827806a660 0x7f827806cb10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8290007fd0 tx=0x7f8290009040 comp rx=0 tx=0).stop 2023-07-29T02:01:55.858 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.871+0000 7f829b496700 1 -- 172.21.15.42:0/938410413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82941532f0 msgr2=0x7f82941e5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:01:55.859 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.871+0000 7f829b496700 1 --2- 172.21.15.42:0/938410413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82941532f0 0x7f82941e5ab0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f828400c520 tx=0x7f828400c830 comp rx=0 tx=0).stop 2023-07-29T02:01:55.859 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.872+0000 7f829b496700 1 -- 172.21.15.42:0/938410413 shutdown_connections 2023-07-29T02:01:55.859 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.872+0000 7f829b496700 1 --2- 172.21.15.42:0/938410413 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f827806a660 0x7f827806cb10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:55.859 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.872+0000 7f829b496700 1 --2- 172.21.15.42:0/938410413 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f82941591b0 0x7f82940c2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:55.859 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.872+0000 7f829b496700 1 --2- 172.21.15.42:0/938410413 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f82940c9f70 0x7f829414eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:55.859 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.872+0000 7f829b496700 1 --2- 172.21.15.42:0/938410413 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f82941532f0 0x7f82941e5ab0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:01:55.859 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.872+0000 7f829b496700 1 -- 172.21.15.42:0/938410413 >> 172.21.15.42:0/938410413 conn(0x7f829406a750 msgr2=0x7f829415cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:01:55.859 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.872+0000 7f829b496700 1 -- 172.21.15.42:0/938410413 shutdown_connections 2023-07-29T02:01:55.860 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:01:55.872+0000 7f829b496700 1 -- 172.21.15.42:0/938410413 wait complete. 2023-07-29T02:01:55.860 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2023-07-29T02:01:55.874 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e reported in up:standby state 2023-07-29T02:01:55.874 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 13 secs before thrashing 2023-07-29T02:01:57.575 INFO:tasks.ceph.mds.d.smithi144.stderr:2023-07-29T02:01:57.589+0000 7f0f51f60700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-29T02:02:06.102 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:02:06.105 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:02:08.875 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:02:09.065 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.079+0000 7fa48bd2f700 1 Processor -- start 2023-07-29T02:02:09.065 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.079+0000 7fa48bd2f700 1 -- start start 2023-07-29T02:02:09.067 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.080+0000 7fa48bd2f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa48414c630 0x7fa48406c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:09.067 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.080+0000 7fa48bd2f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa48414ca00 0x7fa4840c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:09.067 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.080+0000 7fa48bd2f700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa4840c7270 0x7fa4840c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:09.067 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.080+0000 7fa48bd2f700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48406ce40 con 0x7fa4840c7270 2023-07-29T02:02:09.068 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.080+0000 7fa48bd2f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa484155d50 con 0x7fa48414c630 2023-07-29T02:02:09.068 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.080+0000 7fa48bd2f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa484156010 con 0x7fa48414ca00 2023-07-29T02:02:09.068 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.080+0000 7fa48a2cc700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa4840c7270 0x7fa4840c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:09.068 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.080+0000 7fa48a2cc700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fa4840c7270 0x7fa4840c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57512/0 (socket says 172.21.15.42:57512) 2023-07-29T02:02:09.068 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.080+0000 7fa48a2cc700 1 -- 172.21.15.42:0/3857369467 learned_addr learned my addr 172.21.15.42:0/3857369467 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:09.068 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.080+0000 7fa489acb700 1 --2- 172.21.15.42:0/3857369467 >> v2:172.21.15.144:3300/0 conn(0x7fa48414c630 0x7fa48406c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:09.068 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.080+0000 7fa4892ca700 1 --2- 172.21.15.42:0/3857369467 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa48414ca00 0x7fa4840c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:09.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.081+0000 7fa48a2cc700 1 -- 172.21.15.42:0/3857369467 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa48414ca00 msgr2=0x7fa4840c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:09.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.081+0000 7fa48a2cc700 1 --2- 172.21.15.42:0/3857369467 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa48414ca00 0x7fa4840c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.081+0000 7fa48a2cc700 1 -- 172.21.15.42:0/3857369467 >> v2:172.21.15.144:3300/0 conn(0x7fa48414c630 msgr2=0x7fa48406c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:09.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.081+0000 7fa48a2cc700 1 --2- 172.21.15.42:0/3857369467 >> v2:172.21.15.144:3300/0 conn(0x7fa48414c630 0x7fa48406c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.081+0000 7fa48a2cc700 1 -- 172.21.15.42:0/3857369467 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4841562f0 con 0x7fa4840c7270 2023-07-29T02:02:09.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.081+0000 7fa4892ca700 1 --2- 172.21.15.42:0/3857369467 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa48414ca00 0x7fa4840c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:02:09.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.081+0000 7fa48a2cc700 1 --2- 172.21.15.42:0/3857369467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4840c7270 0x7fa4840c6cb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa484070da0 tx=0x7fa47c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953b13c45e33a8eb server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:09.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.081+0000 7fa488ac9700 1 -- 172.21.15.42:0/3857369467 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00e070 con 0x7fa4840c7270 2023-07-29T02:02:09.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.081+0000 7fa488ac9700 1 -- 172.21.15.42:0/3857369467 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c00b9c0 con 0x7fa4840c7270 2023-07-29T02:02:09.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.081+0000 7fa488ac9700 1 -- 172.21.15.42:0/3857369467 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c00bd70 con 0x7fa4840c7270 2023-07-29T02:02:09.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.082+0000 7fa48bd2f700 1 -- 172.21.15.42:0/3857369467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4840c7270 msgr2=0x7fa4840c6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:09.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.082+0000 7fa48bd2f700 1 --2- 172.21.15.42:0/3857369467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4840c7270 0x7fa4840c6cb0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa484070da0 tx=0x7fa47c00b330 comp rx=0 tx=0).stop 2023-07-29T02:02:09.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.082+0000 7fa48bd2f700 1 -- 172.21.15.42:0/3857369467 shutdown_connections 2023-07-29T02:02:09.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.082+0000 7fa48bd2f700 1 --2- 172.21.15.42:0/3857369467 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa4840c7270 0x7fa4840c6cb0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.082+0000 7fa48bd2f700 1 --2- 172.21.15.42:0/3857369467 >> v2:172.21.15.144:3300/0 conn(0x7fa48414c630 0x7fa48406c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.082+0000 7fa48bd2f700 1 --2- 172.21.15.42:0/3857369467 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa48414ca00 0x7fa4840c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.082+0000 7fa48bd2f700 1 -- 172.21.15.42:0/3857369467 >> 172.21.15.42:0/3857369467 conn(0x7fa4840c8970 msgr2=0x7fa4840c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:09.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.082+0000 7fa48bd2f700 1 -- 172.21.15.42:0/3857369467 shutdown_connections 2023-07-29T02:02:09.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.082+0000 7fa48bd2f700 1 -- 172.21.15.42:0/3857369467 wait complete. 2023-07-29T02:02:09.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.083+0000 7fa48bd2f700 1 Processor -- start 2023-07-29T02:02:09.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.084+0000 7fa48bd2f700 1 -- start start 2023-07-29T02:02:09.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.085+0000 7fa48bd2f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4840c7270 0x7fa484160660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:09.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.085+0000 7fa48bd2f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa48414c630 0x7fa484161200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:09.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.085+0000 7fa48bd2f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa484160ba0 0x7fa484161740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:09.074 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.085+0000 7fa48bd2f700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa484143c30 con 0x7fa484160ba0 2023-07-29T02:02:09.074 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.085+0000 7fa48bd2f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4841621d0 con 0x7fa4840c7270 2023-07-29T02:02:09.074 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.085+0000 7fa48bd2f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa484151260 con 0x7fa48414c630 2023-07-29T02:02:09.074 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.085+0000 7fa48a2cc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa484160ba0 0x7fa484161740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:09.074 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.085+0000 7fa48a2cc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa484160ba0 0x7fa484161740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57520/0 (socket says 172.21.15.42:57520) 2023-07-29T02:02:09.074 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.085+0000 7fa48a2cc700 1 -- 172.21.15.42:0/1392817820 learned_addr learned my addr 172.21.15.42:0/1392817820 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:09.074 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.085+0000 7fa489acb700 1 --2- 172.21.15.42:0/1392817820 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4840c7270 0x7fa484160660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:09.074 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.085+0000 7fa4892ca700 1 --2- 172.21.15.42:0/1392817820 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa48414c630 0x7fa484161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:09.075 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.085+0000 7fa48a2cc700 1 -- 172.21.15.42:0/1392817820 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa48414c630 msgr2=0x7fa484161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:09.075 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.085+0000 7fa48a2cc700 1 --2- 172.21.15.42:0/1392817820 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa48414c630 0x7fa484161200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.075 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.085+0000 7fa48a2cc700 1 -- 172.21.15.42:0/1392817820 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4840c7270 msgr2=0x7fa484160660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:09.075 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.085+0000 7fa48a2cc700 1 --2- 172.21.15.42:0/1392817820 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4840c7270 0x7fa484160660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.075 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.085+0000 7fa48a2cc700 1 -- 172.21.15.42:0/1392817820 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c009b30 con 0x7fa484160ba0 2023-07-29T02:02:09.075 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.085+0000 7fa48a2cc700 1 --2- 172.21.15.42:0/1392817820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa484160ba0 0x7fa484161740 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa47c012000 tx=0x7fa47c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:09.075 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.086+0000 7fa47a7fc700 1 -- 172.21.15.42:0/1392817820 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0099b0 con 0x7fa484160ba0 2023-07-29T02:02:09.076 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.086+0000 7fa47a7fc700 1 -- 172.21.15.42:0/1392817820 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c004250 con 0x7fa484160ba0 2023-07-29T02:02:09.076 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.086+0000 7fa48bd2f700 1 -- 172.21.15.42:0/1392817820 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa484161ef0 con 0x7fa484160ba0 2023-07-29T02:02:09.076 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.086+0000 7fa47a7fc700 1 -- 172.21.15.42:0/1392817820 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c004600 con 0x7fa484160ba0 2023-07-29T02:02:09.076 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.086+0000 7fa48bd2f700 1 -- 172.21.15.42:0/1392817820 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa484153320 con 0x7fa484160ba0 2023-07-29T02:02:09.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.087+0000 7fa467fff700 1 -- 172.21.15.42:0/1392817820 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4600052f0 con 0x7fa484160ba0 2023-07-29T02:02:09.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.088+0000 7fa47a7fc700 1 -- 172.21.15.42:0/1392817820 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fa47c004760 con 0x7fa484160ba0 2023-07-29T02:02:09.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.088+0000 7fa47a7fc700 1 --2- 172.21.15.42:0/1392817820 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa46806a660 0x7fa46806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:09.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.088+0000 7fa47a7fc700 1 -- 172.21.15.42:0/1392817820 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6936+0+0 (secure 0 0 0) 0x7fa47c08a1f0 con 0x7fa484160ba0 2023-07-29T02:02:09.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.088+0000 7fa489acb700 1 --2- 172.21.15.42:0/1392817820 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa46806a660 0x7fa46806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:09.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.089+0000 7fa489acb700 1 --2- 172.21.15.42:0/1392817820 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa46806a660 0x7fa46806cb10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa480009950 tx=0x7fa480008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:09.081 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.095+0000 7fa47a7fc700 1 -- 172.21.15.42:0/1392817820 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fa47c055310 con 0x7fa484160ba0 2023-07-29T02:02:09.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.446+0000 7fa467fff700 1 -- 172.21.15.42:0/1392817820 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4600055a0 con 0x7fa484160ba0 2023-07-29T02:02:09.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.447+0000 7fa47a7fc700 1 -- 172.21.15.42:0/1392817820 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6169 (secure 0 0 0) 0x7fa47c058930 con 0x7fa484160ba0 2023-07-29T02:02:09.433 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:02:09.433 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5142,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:01:50.646610+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":32,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:02:09.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.449+0000 7fa467fff700 1 -- 172.21.15.42:0/1392817820 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa46806a660 msgr2=0x7fa46806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:09.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.449+0000 7fa467fff700 1 --2- 172.21.15.42:0/1392817820 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa46806a660 0x7fa46806cb10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa480009950 tx=0x7fa480008040 comp rx=0 tx=0).stop 2023-07-29T02:02:09.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.449+0000 7fa467fff700 1 -- 172.21.15.42:0/1392817820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa484160ba0 msgr2=0x7fa484161740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:09.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.449+0000 7fa467fff700 1 --2- 172.21.15.42:0/1392817820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa484160ba0 0x7fa484161740 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa47c012000 tx=0x7fa47c004ad0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.449+0000 7fa467fff700 1 -- 172.21.15.42:0/1392817820 shutdown_connections 2023-07-29T02:02:09.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.449+0000 7fa467fff700 1 --2- 172.21.15.42:0/1392817820 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa46806a660 0x7fa46806cb10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.449+0000 7fa467fff700 1 --2- 172.21.15.42:0/1392817820 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa484160ba0 0x7fa484161740 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.449+0000 7fa467fff700 1 --2- 172.21.15.42:0/1392817820 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4840c7270 0x7fa484160660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.449+0000 7fa467fff700 1 --2- 172.21.15.42:0/1392817820 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa48414c630 0x7fa484161200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.449+0000 7fa467fff700 1 -- 172.21.15.42:0/1392817820 >> 172.21.15.42:0/1392817820 conn(0x7fa4840c8970 msgr2=0x7fa48406c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:09.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.449+0000 7fa467fff700 1 -- 172.21.15.42:0/1392817820 shutdown_connections 2023-07-29T02:02:09.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.449+0000 7fa467fff700 1 -- 172.21.15.42:0/1392817820 wait complete. 2023-07-29T02:02:09.437 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2023-07-29T02:02:09.451 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.d (rank=0) 2023-07-29T02:02:09.452 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-29T02:02:09.452 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:02:09.463 INFO:tasks.ceph.mds.d:Stopped 2023-07-29T02:02:09.463 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:02:09.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.629+0000 7fcc03e6a700 1 Processor -- start 2023-07-29T02:02:09.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.629+0000 7fcc03e6a700 1 -- start start 2023-07-29T02:02:09.616 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.630+0000 7fcc03e6a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcbfc15c880 0x7fcbfc0c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:09.616 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.631+0000 7fcc03e6a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbfc061520 0x7fcbfc152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:09.617 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.631+0000 7fcc03e6a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbfc0c6fb0 con 0x7fcbfc0c73b0 2023-07-29T02:02:09.617 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.631+0000 7fcc03e6a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbfc06b110 con 0x7fcbfc15c880 2023-07-29T02:02:09.617 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.631+0000 7fcc03e6a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc06ce20 con 0x7fcbfc061520 2023-07-29T02:02:09.618 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.631+0000 7fcc02407700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbfc061520 0x7fcbfc152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:09.618 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.631+0000 7fcc01c06700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcbfc15c880 0x7fcbfc0c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:09.618 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.631+0000 7fcc01c06700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fcbfc15c880 0x7fcbfc0c5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:40902/0 (socket says 172.21.15.42:40902) 2023-07-29T02:02:09.618 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.631+0000 7fcc02407700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbfc061520 0x7fcbfc152ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:58040/0 (socket says 172.21.15.42:58040) 2023-07-29T02:02:09.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.631+0000 7fcc01c06700 1 -- 172.21.15.42:0/2725900987 learned_addr learned my addr 172.21.15.42:0/2725900987 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:09.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.631+0000 7fcc01405700 1 --1- 172.21.15.42:0/2725900987 >> v1:172.21.15.144:6789/0 conn(0x7fcbfc0c73b0 0x7fcbfc15cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.42:53824/0 (socket says 172.21.15.42:53824) 2023-07-29T02:02:09.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.631+0000 7fcc02407700 1 -- 172.21.15.42:0/2725900987 >> v2:172.21.15.144:3300/0 conn(0x7fcbfc15c880 msgr2=0x7fcbfc0c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:09.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.631+0000 7fcc02407700 1 --2- 172.21.15.42:0/2725900987 >> v2:172.21.15.144:3300/0 conn(0x7fcbfc15c880 0x7fcbfc0c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.631+0000 7fcc02407700 1 -- 172.21.15.42:0/2725900987 >> v1:172.21.15.144:6789/0 conn(0x7fcbfc0c73b0 legacy=0x7fcbfc15cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:09.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.631+0000 7fcc02407700 1 -- 172.21.15.42:0/2725900987 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbfc06d0e0 con 0x7fcbfc061520 2023-07-29T02:02:09.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.631+0000 7fcc01c06700 1 --2- 172.21.15.42:0/2725900987 >> v2:172.21.15.144:3300/0 conn(0x7fcbfc15c880 0x7fcbfc0c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:02:09.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.632+0000 7fcc02407700 1 --2- 172.21.15.42:0/2725900987 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbfc061520 0x7fcbfc152ee0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4009d90 tx=0x7fcbf400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c41c4022a4ff8b1f server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:09.620 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.632+0000 7fcc00c04700 1 -- 172.21.15.42:0/2725900987 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf400e070 con 0x7fcbfc061520 2023-07-29T02:02:09.620 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.632+0000 7fcc00c04700 1 -- 172.21.15.42:0/2725900987 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf400bb20 con 0x7fcbfc061520 2023-07-29T02:02:09.620 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.632+0000 7fcc00c04700 1 -- 172.21.15.42:0/2725900987 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4012430 con 0x7fcbfc061520 2023-07-29T02:02:09.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.633+0000 7fcc03e6a700 1 -- 172.21.15.42:0/2725900987 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbfc061520 msgr2=0x7fcbfc152ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:09.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.633+0000 7fcc03e6a700 1 --2- 172.21.15.42:0/2725900987 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbfc061520 0x7fcbfc152ee0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4009d90 tx=0x7fcbf400b330 comp rx=0 tx=0).stop 2023-07-29T02:02:09.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.633+0000 7fcc03e6a700 1 -- 172.21.15.42:0/2725900987 shutdown_connections 2023-07-29T02:02:09.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.633+0000 7fcc03e6a700 1 --2- 172.21.15.42:0/2725900987 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbfc061520 0x7fcbfc152ee0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.633+0000 7fcc03e6a700 1 --2- 172.21.15.42:0/2725900987 >> v2:172.21.15.144:3300/0 conn(0x7fcbfc15c880 0x7fcbfc0c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.633+0000 7fcc03e6a700 1 -- 172.21.15.42:0/2725900987 >> 172.21.15.42:0/2725900987 conn(0x7fcbfc0c80e0 msgr2=0x7fcbfc0c84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:09.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.633+0000 7fcc03e6a700 1 -- 172.21.15.42:0/2725900987 shutdown_connections 2023-07-29T02:02:09.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.633+0000 7fcc03e6a700 1 -- 172.21.15.42:0/2725900987 wait complete. 2023-07-29T02:02:09.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.635+0000 7fcc03e6a700 1 Processor -- start 2023-07-29T02:02:09.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.635+0000 7fcc03e6a700 1 -- start start 2023-07-29T02:02:09.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.636+0000 7fcc03e6a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbfc061520 0x7fcbfc1f28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:09.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.636+0000 7fcc03e6a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbfc0c73b0 0x7fcbfc1ef300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:09.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.636+0000 7fcc03e6a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbfc15c880 0x7fcbfc070e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:09.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.636+0000 7fcc03e6a700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc1eee70 con 0x7fcbfc15c880 2023-07-29T02:02:09.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.636+0000 7fcc03e6a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc15c3b0 con 0x7fcbfc061520 2023-07-29T02:02:09.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.636+0000 7fcc03e6a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbfc1eeb40 con 0x7fcbfc0c73b0 2023-07-29T02:02:09.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.636+0000 7fcc02407700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbfc15c880 0x7fcbfc070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:09.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.636+0000 7fcc02407700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbfc15c880 0x7fcbfc070e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57532/0 (socket says 172.21.15.42:57532) 2023-07-29T02:02:09.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.636+0000 7fcc02407700 1 -- 172.21.15.42:0/2094697578 learned_addr learned my addr 172.21.15.42:0/2094697578 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:09.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.636+0000 7fcc01c06700 1 --2- 172.21.15.42:0/2094697578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbfc061520 0x7fcbfc1f28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:09.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.636+0000 7fcc01405700 1 --2- 172.21.15.42:0/2094697578 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbfc0c73b0 0x7fcbfc1ef300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:09.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.637+0000 7fcc02407700 1 -- 172.21.15.42:0/2094697578 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbfc0c73b0 msgr2=0x7fcbfc1ef300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:09.626 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.637+0000 7fcc02407700 1 --2- 172.21.15.42:0/2094697578 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbfc0c73b0 0x7fcbfc1ef300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.626 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.637+0000 7fcc02407700 1 -- 172.21.15.42:0/2094697578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbfc061520 msgr2=0x7fcbfc1f28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:09.626 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.637+0000 7fcc02407700 1 --2- 172.21.15.42:0/2094697578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbfc061520 0x7fcbfc1f28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.626 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.637+0000 7fcc02407700 1 -- 172.21.15.42:0/2094697578 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf8009550 con 0x7fcbfc15c880 2023-07-29T02:02:09.626 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.637+0000 7fcc01c06700 1 --2- 172.21.15.42:0/2094697578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbfc061520 0x7fcbfc1f28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:02:09.626 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.637+0000 7fcc02407700 1 --2- 172.21.15.42:0/2094697578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbfc15c880 0x7fcbfc070e60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4014040 tx=0x7fcbf4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:09.626 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.637+0000 7fcbf27fc700 1 -- 172.21.15.42:0/2094697578 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4012430 con 0x7fcbfc15c880 2023-07-29T02:02:09.626 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.637+0000 7fcbf27fc700 1 -- 172.21.15.42:0/2094697578 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf4020070 con 0x7fcbfc15c880 2023-07-29T02:02:09.627 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.637+0000 7fcc03e6a700 1 -- 172.21.15.42:0/2094697578 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf4009a70 con 0x7fcbfc15c880 2023-07-29T02:02:09.627 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.637+0000 7fcbf27fc700 1 -- 172.21.15.42:0/2094697578 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf4003ea0 con 0x7fcbfc15c880 2023-07-29T02:02:09.627 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.638+0000 7fcc03e6a700 1 -- 172.21.15.42:0/2094697578 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbfc15c0d0 con 0x7fcbfc15c880 2023-07-29T02:02:09.628 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.639+0000 7fcc03e6a700 1 -- 172.21.15.42:0/2094697578 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbfc1ee9a0 con 0x7fcbfc15c880 2023-07-29T02:02:09.628 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.640+0000 7fcbf27fc700 1 -- 172.21.15.42:0/2094697578 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fcbf4004040 con 0x7fcbfc15c880 2023-07-29T02:02:09.628 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.641+0000 7fcbf27fc700 1 --2- 172.21.15.42:0/2094697578 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcbe006a660 0x7fcbe006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:09.628 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.641+0000 7fcbf27fc700 1 -- 172.21.15.42:0/2094697578 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6936+0+0 (secure 0 0 0) 0x7fcbf4022070 con 0x7fcbfc15c880 2023-07-29T02:02:09.628 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.641+0000 7fcc01c06700 1 --2- 172.21.15.42:0/2094697578 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcbe006a660 0x7fcbe006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:09.629 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.642+0000 7fcc01c06700 1 --2- 172.21.15.42:0/2094697578 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcbe006a660 0x7fcbe006cb10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8006d30 tx=0x7fcbf80092c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:09.631 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.645+0000 7fcbf27fc700 1 -- 172.21.15.42:0/2094697578 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fcbfc1ee9a0 con 0x7fcbfc15c880 2023-07-29T02:02:09.961 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.975+0000 7fcc03e6a700 1 -- 172.21.15.42:0/2094697578 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbfc1ef020 con 0x7fcbfc15c880 2023-07-29T02:02:09.961 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.976+0000 7fcbf27fc700 1 -- 172.21.15.42:0/2094697578 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6169 (secure 0 0 0) 0x7fcbfc1ef020 con 0x7fcbfc15c880 2023-07-29T02:02:09.962 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:02:09.962 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5142,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:01:50.646610+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":32,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:02:09.964 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.978+0000 7fcc03e6a700 1 -- 172.21.15.42:0/2094697578 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcbe006a660 msgr2=0x7fcbe006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:09.965 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.978+0000 7fcc03e6a700 1 --2- 172.21.15.42:0/2094697578 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcbe006a660 0x7fcbe006cb10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8006d30 tx=0x7fcbf80092c0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.965 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.978+0000 7fcc03e6a700 1 -- 172.21.15.42:0/2094697578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbfc15c880 msgr2=0x7fcbfc070e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:09.965 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.978+0000 7fcc03e6a700 1 --2- 172.21.15.42:0/2094697578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbfc15c880 0x7fcbfc070e60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4014040 tx=0x7fcbf4004ad0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.965 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.978+0000 7fcc03e6a700 1 -- 172.21.15.42:0/2094697578 shutdown_connections 2023-07-29T02:02:09.965 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.978+0000 7fcc03e6a700 1 --2- 172.21.15.42:0/2094697578 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fcbe006a660 0x7fcbe006cb10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.965 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.978+0000 7fcc03e6a700 1 --2- 172.21.15.42:0/2094697578 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fcbfc15c880 0x7fcbfc070e60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.965 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.978+0000 7fcc03e6a700 1 --2- 172.21.15.42:0/2094697578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbfc061520 0x7fcbfc1f28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.978+0000 7fcc03e6a700 1 --2- 172.21.15.42:0/2094697578 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fcbfc0c73b0 0x7fcbfc1ef300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:09.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.978+0000 7fcc03e6a700 1 -- 172.21.15.42:0/2094697578 >> 172.21.15.42:0/2094697578 conn(0x7fcbfc0c80e0 msgr2=0x7fcbfc06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:09.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.979+0000 7fcc03e6a700 1 -- 172.21.15.42:0/2094697578 shutdown_connections 2023-07-29T02:02:09.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:09.979+0000 7fcc03e6a700 1 -- 172.21.15.42:0/2094697578 wait complete. 2023-07-29T02:02:09.966 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2023-07-29T02:02:09.981 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2023-07-29T02:02:11.983 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:02:12.108 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.122+0000 7f7ed1c5e700 1 Processor -- start 2023-07-29T02:02:12.108 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.122+0000 7f7ed1c5e700 1 -- start start 2023-07-29T02:02:12.110 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.123+0000 7f7ed1c5e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f7ecc1535c0 0x7f7ecc0c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:12.110 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.123+0000 7f7ed1c5e700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7ecc0ca060 0x7f7ecc0cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:12.110 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.123+0000 7f7ed1c5e700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ecc153990 con 0x7f7ecc0cf6b0 2023-07-29T02:02:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.123+0000 7f7ed1c5e700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ecc0c5a10 con 0x7f7ecc0ca060 2023-07-29T02:02:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.123+0000 7f7ed1c5e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ecc15c760 con 0x7f7ecc1535c0 2023-07-29T02:02:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.123+0000 7f7ecaffd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7ecc0ca060 0x7f7ecc0cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.123+0000 7f7ecbfff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f7ecc0cf6b0 0x7f7ecc159820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51352/0 (socket says 172.21.15.42:51352) 2023-07-29T02:02:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.123+0000 7f7ecbfff700 1 -- 172.21.15.42:0/4121529314 learned_addr learned my addr 172.21.15.42:0/4121529314 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:02:12.111 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.123+0000 7f7ecaffd700 1 -- 172.21.15.42:0/4121529314 >> v2:172.21.15.144:3300/0 conn(0x7f7ecc1535c0 msgr2=0x7f7ecc0c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.123+0000 7f7ecb7fe700 1 --2- 172.21.15.42:0/4121529314 >> v2:172.21.15.144:3300/0 conn(0x7f7ecc1535c0 0x7f7ecc0c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.123+0000 7f7eca7fc700 1 -- 172.21.15.42:0/4121529314 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476399769 0 0) 0x7f7ecc153990 con 0x7f7ecc0cf6b0 2023-07-29T02:02:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.123+0000 7f7ecaffd700 1 --2- 172.21.15.42:0/4121529314 >> v2:172.21.15.144:3300/0 conn(0x7f7ecc1535c0 0x7f7ecc0c54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.123+0000 7f7ecaffd700 1 -- 172.21.15.42:0/4121529314 >> v1:172.21.15.42:6789/0 conn(0x7f7ecc0cf6b0 legacy=0x7f7ecc159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.123+0000 7f7ecaffd700 1 -- 172.21.15.42:0/4121529314 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc15ca00 con 0x7f7ecc0ca060 2023-07-29T02:02:12.112 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.123+0000 7f7ecb7fe700 1 --2- 172.21.15.42:0/4121529314 >> v2:172.21.15.144:3300/0 conn(0x7f7ecc1535c0 0x7f7ecc0c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:02:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.124+0000 7f7ecaffd700 1 --2- 172.21.15.42:0/4121529314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ecc0ca060 0x7f7ecc0cf170 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc067f70 tx=0x7f7eb4009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee8c7ddad93e5b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.124+0000 7f7eca7fc700 1 -- 172.21.15.42:0/4121529314 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4005e30 con 0x7f7ecc0ca060 2023-07-29T02:02:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.124+0000 7f7eca7fc700 1 -- 172.21.15.42:0/4121529314 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb4006030 con 0x7f7ecc0ca060 2023-07-29T02:02:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.124+0000 7f7eca7fc700 1 -- 172.21.15.42:0/4121529314 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb40063c0 con 0x7f7ecc0ca060 2023-07-29T02:02:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.124+0000 7f7ed1c5e700 1 -- 172.21.15.42:0/4121529314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ecc0ca060 msgr2=0x7f7ecc0cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.124+0000 7f7ed1c5e700 1 --2- 172.21.15.42:0/4121529314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ecc0ca060 0x7f7ecc0cf170 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc067f70 tx=0x7f7eb4009b00 comp rx=0 tx=0).stop 2023-07-29T02:02:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.124+0000 7f7ed1c5e700 1 -- 172.21.15.42:0/4121529314 shutdown_connections 2023-07-29T02:02:12.113 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.124+0000 7f7ed1c5e700 1 --2- 172.21.15.42:0/4121529314 >> v2:172.21.15.144:3300/0 conn(0x7f7ecc1535c0 0x7f7ecc0c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:12.114 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.124+0000 7f7ed1c5e700 1 --2- 172.21.15.42:0/4121529314 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ecc0ca060 0x7f7ecc0cf170 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:12.114 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.124+0000 7f7ed1c5e700 1 -- 172.21.15.42:0/4121529314 >> 172.21.15.42:0/4121529314 conn(0x7f7ecc06cac0 msgr2=0x7f7ecc06cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:12.114 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.124+0000 7f7ed1c5e700 1 -- 172.21.15.42:0/4121529314 shutdown_connections 2023-07-29T02:02:12.114 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.124+0000 7f7ed1c5e700 1 -- 172.21.15.42:0/4121529314 wait complete. 2023-07-29T02:02:12.116 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.125+0000 7f7ed1c5e700 1 Processor -- start 2023-07-29T02:02:12.116 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.126+0000 7f7ed1c5e700 1 -- start start 2023-07-29T02:02:12.116 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.126+0000 7f7ed1c5e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ecc0ca060 0x7f7ecc0cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:12.117 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.126+0000 7f7ed1c5e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ecc0cf6b0 0x7f7ecc1e4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:12.117 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.126+0000 7f7ed1c5e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ecc1535c0 0x7f7ecc14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:12.117 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.126+0000 7f7ed1c5e700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc0cd3a0 con 0x7f7ecc0cf6b0 2023-07-29T02:02:12.117 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.126+0000 7f7ed1c5e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc0ce270 con 0x7f7ecc1535c0 2023-07-29T02:02:12.117 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.126+0000 7f7ed1c5e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ecc1e2ca0 con 0x7f7ecc0ca060 2023-07-29T02:02:12.117 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.126+0000 7f7ecaffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ecc0cf6b0 0x7f7ecc1e4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:12.117 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.126+0000 7f7ecaffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ecc0cf6b0 0x7f7ecc1e4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57552/0 (socket says 172.21.15.42:57552) 2023-07-29T02:02:12.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.126+0000 7f7ecaffd700 1 -- 172.21.15.42:0/421769430 learned_addr learned my addr 172.21.15.42:0/421769430 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:12.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.127+0000 7f7ecbfff700 1 --2- 172.21.15.42:0/421769430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ecc1535c0 0x7f7ecc14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:12.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.127+0000 7f7ecb7fe700 1 --2- 172.21.15.42:0/421769430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ecc0ca060 0x7f7ecc0cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:12.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.127+0000 7f7ecaffd700 1 -- 172.21.15.42:0/421769430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ecc0ca060 msgr2=0x7f7ecc0cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:12.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.127+0000 7f7ecaffd700 1 --2- 172.21.15.42:0/421769430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ecc0ca060 0x7f7ecc0cdd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:12.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.127+0000 7f7ecaffd700 1 -- 172.21.15.42:0/421769430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ecc1535c0 msgr2=0x7f7ecc14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:12.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.127+0000 7f7ecaffd700 1 --2- 172.21.15.42:0/421769430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ecc1535c0 0x7f7ecc14ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:12.118 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.127+0000 7f7ecaffd700 1 -- 172.21.15.42:0/421769430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb4009430 con 0x7f7ecc0cf6b0 2023-07-29T02:02:12.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.127+0000 7f7ecb7fe700 1 --2- 172.21.15.42:0/421769430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ecc0ca060 0x7f7ecc0cdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:02:12.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.127+0000 7f7ecbfff700 1 --2- 172.21.15.42:0/421769430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ecc1535c0 0x7f7ecc14ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:02:12.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.127+0000 7f7ecaffd700 1 --2- 172.21.15.42:0/421769430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ecc0cf6b0 0x7f7ecc1e4820 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc068090 tx=0x7f7eb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:12.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.127+0000 7f7ec3fff700 1 -- 172.21.15.42:0/421769430 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4004240 con 0x7f7ecc0cf6b0 2023-07-29T02:02:12.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.127+0000 7f7ec3fff700 1 -- 172.21.15.42:0/421769430 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb40043c0 con 0x7f7ecc0cf6b0 2023-07-29T02:02:12.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.127+0000 7f7ec3fff700 1 -- 172.21.15.42:0/421769430 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb40036a0 con 0x7f7ecc0cf6b0 2023-07-29T02:02:12.119 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.127+0000 7f7ed1c5e700 1 -- 172.21.15.42:0/421769430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ecc0cd0c0 con 0x7f7ecc0cf6b0 2023-07-29T02:02:12.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.127+0000 7f7ed1c5e700 1 -- 172.21.15.42:0/421769430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ecc1f2b70 con 0x7f7ecc0cf6b0 2023-07-29T02:02:12.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.128+0000 7f7ed1c5e700 1 -- 172.21.15.42:0/421769430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ecc0c6260 con 0x7f7ecc0cf6b0 2023-07-29T02:02:12.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.129+0000 7f7ec3fff700 1 -- 172.21.15.42:0/421769430 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f7eb4022070 con 0x7f7ecc0cf6b0 2023-07-29T02:02:12.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.129+0000 7f7ec3fff700 1 --2- 172.21.15.42:0/421769430 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7eac072e70 0x7f7eac075320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:12.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.129+0000 7f7ec3fff700 1 -- 172.21.15.42:0/421769430 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6936+0+0 (secure 0 0 0) 0x7f7eb408a980 con 0x7f7ecc0cf6b0 2023-07-29T02:02:12.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.129+0000 7f7ecb7fe700 1 --2- 172.21.15.42:0/421769430 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7eac072e70 0x7f7eac075320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:12.120 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.130+0000 7f7ecb7fe700 1 --2- 172.21.15.42:0/421769430 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7eac072e70 0x7f7eac075320 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc008910 tx=0x7f7ebc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:12.121 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.133+0000 7f7ec3fff700 1 -- 172.21.15.42:0/421769430 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f7eb4055980 con 0x7f7ecc0cf6b0 2023-07-29T02:02:12.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.387+0000 7f7ed1c5e700 1 -- 172.21.15.42:0/421769430 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ecc1f26f0 con 0x7f7ecc0cf6b0 2023-07-29T02:02:12.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.388+0000 7f7ec3fff700 1 -- 172.21.15.42:0/421769430 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6169 (secure 0 0 0) 0x7f7ecc1f26f0 con 0x7f7ecc0cf6b0 2023-07-29T02:02:12.374 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:02:12.374 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5142,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:01:50.646610+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":32,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:02:12.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.390+0000 7f7ed1c5e700 1 -- 172.21.15.42:0/421769430 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7eac072e70 msgr2=0x7f7eac075320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:12.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.390+0000 7f7ed1c5e700 1 --2- 172.21.15.42:0/421769430 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7eac072e70 0x7f7eac075320 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc008910 tx=0x7f7ebc008040 comp rx=0 tx=0).stop 2023-07-29T02:02:12.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.390+0000 7f7ed1c5e700 1 -- 172.21.15.42:0/421769430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ecc0cf6b0 msgr2=0x7f7ecc1e4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:12.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.390+0000 7f7ed1c5e700 1 --2- 172.21.15.42:0/421769430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ecc0cf6b0 0x7f7ecc1e4820 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc068090 tx=0x7f7eb4004750 comp rx=0 tx=0).stop 2023-07-29T02:02:12.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.390+0000 7f7ed1c5e700 1 -- 172.21.15.42:0/421769430 shutdown_connections 2023-07-29T02:02:12.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.390+0000 7f7ed1c5e700 1 --2- 172.21.15.42:0/421769430 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7eac072e70 0x7f7eac075320 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:12.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.390+0000 7f7ed1c5e700 1 --2- 172.21.15.42:0/421769430 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ecc1535c0 0x7f7ecc14ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:12.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.390+0000 7f7ed1c5e700 1 --2- 172.21.15.42:0/421769430 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ecc0ca060 0x7f7ecc0cdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:12.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.390+0000 7f7ed1c5e700 1 --2- 172.21.15.42:0/421769430 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ecc0cf6b0 0x7f7ecc1e4820 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:12.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.390+0000 7f7ed1c5e700 1 -- 172.21.15.42:0/421769430 >> 172.21.15.42:0/421769430 conn(0x7f7ecc06cac0 msgr2=0x7f7ecc150100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:12.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.390+0000 7f7ed1c5e700 1 -- 172.21.15.42:0/421769430 shutdown_connections 2023-07-29T02:02:12.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:12.390+0000 7f7ed1c5e700 1 -- 172.21.15.42:0/421769430 wait complete. 2023-07-29T02:02:12.378 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2023-07-29T02:02:12.388 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2023-07-29T02:02:13.352 INFO:tasks.workunit.client.0.smithi042.stderr:Updating files: 99% (11535/11620) Updating files: 100% (11620/11620) Updating files: 100% (11620/11620), done. 2023-07-29T02:02:13.934 INFO:tasks.workunit.client.0.smithi042.stderr:Note: switching to '0484097b0572e96f42cf6402cbe0ac8dcb046577'. 2023-07-29T02:02:13.934 INFO:tasks.workunit.client.0.smithi042.stderr: 2023-07-29T02:02:13.935 INFO:tasks.workunit.client.0.smithi042.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-07-29T02:02:13.935 INFO:tasks.workunit.client.0.smithi042.stderr:changes and commit them, and you can discard any commits you make in this 2023-07-29T02:02:13.935 INFO:tasks.workunit.client.0.smithi042.stderr:state without impacting any branches by switching back to a branch. 2023-07-29T02:02:13.935 INFO:tasks.workunit.client.0.smithi042.stderr: 2023-07-29T02:02:13.935 INFO:tasks.workunit.client.0.smithi042.stderr:If you want to create a new branch to retain commits you create, you may 2023-07-29T02:02:13.935 INFO:tasks.workunit.client.0.smithi042.stderr:do so (now or later) by using -c with the switch command. Example: 2023-07-29T02:02:13.935 INFO:tasks.workunit.client.0.smithi042.stderr: 2023-07-29T02:02:13.936 INFO:tasks.workunit.client.0.smithi042.stderr: git switch -c 2023-07-29T02:02:13.936 INFO:tasks.workunit.client.0.smithi042.stderr: 2023-07-29T02:02:13.936 INFO:tasks.workunit.client.0.smithi042.stderr:Or undo this operation with: 2023-07-29T02:02:13.936 INFO:tasks.workunit.client.0.smithi042.stderr: 2023-07-29T02:02:13.936 INFO:tasks.workunit.client.0.smithi042.stderr: git switch - 2023-07-29T02:02:13.936 INFO:tasks.workunit.client.0.smithi042.stderr: 2023-07-29T02:02:13.936 INFO:tasks.workunit.client.0.smithi042.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-07-29T02:02:13.937 INFO:tasks.workunit.client.0.smithi042.stderr: 2023-07-29T02:02:13.937 INFO:tasks.workunit.client.0.smithi042.stderr:HEAD is now at 0484097b057 Merge pull request #52618 from vshankar/tr-62147 2023-07-29T02:02:13.940 DEBUG:teuthology.orchestra.run.smithi042:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-07-29T02:02:13.968 INFO:tasks.workunit.client.0.smithi042.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-07-29T02:02:13.971 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-07-29T02:02:13.971 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-07-29T02:02:14.389 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:02:14.512 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-07-29T02:02:14.520 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.533+0000 7f987611d700 1 Processor -- start 2023-07-29T02:02:14.520 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.533+0000 7f987611d700 1 -- start start 2023-07-29T02:02:14.524 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.534+0000 7f987611d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f987006ecd0 0x7f9870071190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:14.524 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.534+0000 7f987611d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f987006f0a0 0x7f987014fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:14.525 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.534+0000 7f987611d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98701592d0 con 0x7f98700c68a0 2023-07-29T02:02:14.525 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.534+0000 7f987611d700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f987006d7c0 con 0x7f987006ecd0 2023-07-29T02:02:14.525 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.534+0000 7f987611d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98700c6fd0 con 0x7f987006f0a0 2023-07-29T02:02:14.526 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.534+0000 7f986f7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f987006ecd0 0x7f9870071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:14.526 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.534+0000 7f986f7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f987006ecd0 0x7f9870071190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57562/0 (socket says 172.21.15.42:57562) 2023-07-29T02:02:14.526 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.534+0000 7f986f7fe700 1 -- 172.21.15.42:0/3342577355 learned_addr learned my addr 172.21.15.42:0/3342577355 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:14.527 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.535+0000 7f986effd700 1 --2- 172.21.15.42:0/3342577355 >> v2:172.21.15.144:3300/0 conn(0x7f987006f0a0 0x7f987014fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:14.527 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.535+0000 7f986f7fe700 1 -- 172.21.15.42:0/3342577355 >> v2:172.21.15.144:3300/0 conn(0x7f987006f0a0 msgr2=0x7f987014fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:14.527 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.535+0000 7f986f7fe700 1 --2- 172.21.15.42:0/3342577355 >> v2:172.21.15.144:3300/0 conn(0x7f987006f0a0 0x7f987014fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:14.528 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.535+0000 7f986f7fe700 1 -- 172.21.15.42:0/3342577355 >> v1:172.21.15.144:6789/0 conn(0x7f98700c68a0 legacy=0x7f9870159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:14.528 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.535+0000 7f986f7fe700 1 -- 172.21.15.42:0/3342577355 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987006cc40 con 0x7f987006ecd0 2023-07-29T02:02:14.529 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.535+0000 7f986f7fe700 1 --2- 172.21.15.42:0/3342577355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f987006ecd0 0x7f9870071190 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f98700c14d0 tx=0x7f986000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db42db7297a2b9a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:14.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.535+0000 7f986e7fc700 1 -- 172.21.15.42:0/3342577355 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986000dcf0 con 0x7f987006ecd0 2023-07-29T02:02:14.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.535+0000 7f986e7fc700 1 -- 172.21.15.42:0/3342577355 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986000de50 con 0x7f987006ecd0 2023-07-29T02:02:14.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.535+0000 7f986e7fc700 1 -- 172.21.15.42:0/3342577355 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860004250 con 0x7f987006ecd0 2023-07-29T02:02:14.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.536+0000 7f987611d700 1 -- 172.21.15.42:0/3342577355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f987006ecd0 msgr2=0x7f9870071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:14.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.536+0000 7f987611d700 1 --2- 172.21.15.42:0/3342577355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f987006ecd0 0x7f9870071190 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f98700c14d0 tx=0x7f986000be70 comp rx=0 tx=0).stop 2023-07-29T02:02:14.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.536+0000 7f987611d700 1 -- 172.21.15.42:0/3342577355 shutdown_connections 2023-07-29T02:02:14.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.536+0000 7f987611d700 1 --2- 172.21.15.42:0/3342577355 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f987006ecd0 0x7f9870071190 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:14.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.536+0000 7f987611d700 1 --2- 172.21.15.42:0/3342577355 >> v2:172.21.15.144:3300/0 conn(0x7f987006f0a0 0x7f987014fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:14.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.536+0000 7f987611d700 1 -- 172.21.15.42:0/3342577355 >> 172.21.15.42:0/3342577355 conn(0x7f98700c8930 msgr2=0x7f98700c8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:14.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.536+0000 7f987611d700 1 -- 172.21.15.42:0/3342577355 shutdown_connections 2023-07-29T02:02:14.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.536+0000 7f987611d700 1 -- 172.21.15.42:0/3342577355 wait complete. 2023-07-29T02:02:14.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.538+0000 7f987611d700 1 Processor -- start 2023-07-29T02:02:14.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.538+0000 7f987611d700 1 -- start start 2023-07-29T02:02:14.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.539+0000 7f987611d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f987006ecd0 0x7f98701472d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:14.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.539+0000 7f987611d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f987006f0a0 0x7f98700724e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:14.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.539+0000 7f987611d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98700c68a0 0x7f98701574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:14.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.539+0000 7f987611d700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9870146d70 con 0x7f987006f0a0 2023-07-29T02:02:14.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.539+0000 7f987611d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9870147980 con 0x7f98700c68a0 2023-07-29T02:02:14.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.539+0000 7f987611d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9870147c60 con 0x7f987006ecd0 2023-07-29T02:02:14.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.539+0000 7f986effd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f987006f0a0 0x7f98700724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:14.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.539+0000 7f986effd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f987006f0a0 0x7f98700724e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57570/0 (socket says 172.21.15.42:57570) 2023-07-29T02:02:14.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.539+0000 7f986effd700 1 -- 172.21.15.42:0/2189963007 learned_addr learned my addr 172.21.15.42:0/2189963007 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:14.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.540+0000 7f986f7fe700 1 --2- 172.21.15.42:0/2189963007 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f987006ecd0 0x7f98701472d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:14.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.540+0000 7f986ffff700 1 --2- 172.21.15.42:0/2189963007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98700c68a0 0x7f98701574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:14.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.540+0000 7f986effd700 1 -- 172.21.15.42:0/2189963007 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f987006ecd0 msgr2=0x7f98701472d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:14.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.540+0000 7f986effd700 1 --2- 172.21.15.42:0/2189963007 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f987006ecd0 0x7f98701472d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:14.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.540+0000 7f986effd700 1 -- 172.21.15.42:0/2189963007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98700c68a0 msgr2=0x7f98701574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:14.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.540+0000 7f986effd700 1 --2- 172.21.15.42:0/2189963007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98700c68a0 0x7f98701574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:14.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.540+0000 7f986effd700 1 -- 172.21.15.42:0/2189963007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986000b7f0 con 0x7f987006f0a0 2023-07-29T02:02:14.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.540+0000 7f986effd700 1 --2- 172.21.15.42:0/2189963007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f987006f0a0 0x7f98700724e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f985800e810 tx=0x7f985800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:14.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.540+0000 7f9867fff700 1 -- 172.21.15.42:0/2189963007 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9858013610 con 0x7f987006f0a0 2023-07-29T02:02:14.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.540+0000 7f9867fff700 1 -- 172.21.15.42:0/2189963007 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9858013770 con 0x7f987006f0a0 2023-07-29T02:02:14.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.540+0000 7f987611d700 1 -- 172.21.15.42:0/2189963007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9870147f40 con 0x7f987006f0a0 2023-07-29T02:02:14.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.540+0000 7f9867fff700 1 -- 172.21.15.42:0/2189963007 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9858013b00 con 0x7f987006f0a0 2023-07-29T02:02:14.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.540+0000 7f987611d700 1 -- 172.21.15.42:0/2189963007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9870156fc0 con 0x7f987006f0a0 2023-07-29T02:02:14.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.541+0000 7f987611d700 1 -- 172.21.15.42:0/2189963007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987004ea50 con 0x7f987006f0a0 2023-07-29T02:02:14.537 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.541+0000 7f9867fff700 1 -- 172.21.15.42:0/2189963007 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f9858013c60 con 0x7f987006f0a0 2023-07-29T02:02:14.538 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.542+0000 7f9867fff700 1 --2- 172.21.15.42:0/2189963007 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f985006a660 0x7f985006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:14.538 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.542+0000 7f9867fff700 1 -- 172.21.15.42:0/2189963007 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6936+0+0 (secure 0 0 0) 0x7f9858088c60 con 0x7f987006f0a0 2023-07-29T02:02:14.538 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.542+0000 7f986f7fe700 1 --2- 172.21.15.42:0/2189963007 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f985006a660 0x7f985006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:14.538 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.543+0000 7f986f7fe700 1 --2- 172.21.15.42:0/2189963007 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f985006a660 0x7f985006cb10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9860000c00 tx=0x7f9860012000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:14.538 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.546+0000 7f9867fff700 1 -- 172.21.15.42:0/2189963007 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f9858053c60 con 0x7f987006f0a0 2023-07-29T02:02:14.573 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-07-29T02:02:14.612 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-07-29T02:02:14.613 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-07-29T02:02:14.613 INFO:tasks.workunit.client.0.smithi042.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-07-29T02:02:14.651 INFO:tasks.workunit.client.0.smithi042.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-07-29T02:02:14.654 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T02:02:14.654 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-07-29T02:02:14.671 INFO:tasks.workunit:Running workunits matching fs/snaps on client.0... 2023-07-29T02:02:14.672 INFO:tasks.workunit:Running workunit fs/snaps/snap-rm-diff.sh... 2023-07-29T02:02:14.672 DEBUG:teuthology.orchestra.run.smithi042:workunit test fs/snaps/snap-rm-diff.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0484097b0572e96f42cf6402cbe0ac8dcb046577 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snap-rm-diff.sh 2023-07-29T02:02:14.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.803+0000 7f987611d700 1 -- 172.21.15.42:0/2189963007 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98700c3010 con 0x7f987006f0a0 2023-07-29T02:02:14.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.804+0000 7f9867fff700 1 -- 172.21.15.42:0/2189963007 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6169 (secure 0 0 0) 0x7f9858021090 con 0x7f987006f0a0 2023-07-29T02:02:14.790 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:02:14.790 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5142,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:01:50.646610+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":32,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:02:14.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.806+0000 7f987611d700 1 -- 172.21.15.42:0/2189963007 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f985006a660 msgr2=0x7f985006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:14.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.806+0000 7f987611d700 1 --2- 172.21.15.42:0/2189963007 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f985006a660 0x7f985006cb10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9860000c00 tx=0x7f9860012000 comp rx=0 tx=0).stop 2023-07-29T02:02:14.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.806+0000 7f987611d700 1 -- 172.21.15.42:0/2189963007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f987006f0a0 msgr2=0x7f98700724e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:14.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.806+0000 7f987611d700 1 --2- 172.21.15.42:0/2189963007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f987006f0a0 0x7f98700724e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f985800e810 tx=0x7f985800ebd0 comp rx=0 tx=0).stop 2023-07-29T02:02:14.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.806+0000 7f987611d700 1 -- 172.21.15.42:0/2189963007 shutdown_connections 2023-07-29T02:02:14.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.806+0000 7f987611d700 1 --2- 172.21.15.42:0/2189963007 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f985006a660 0x7f985006cb10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:14.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.806+0000 7f987611d700 1 --2- 172.21.15.42:0/2189963007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98700c68a0 0x7f98701574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:14.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.806+0000 7f987611d700 1 --2- 172.21.15.42:0/2189963007 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f987006ecd0 0x7f98701472d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:14.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.806+0000 7f987611d700 1 --2- 172.21.15.42:0/2189963007 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f987006f0a0 0x7f98700724e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:14.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.806+0000 7f987611d700 1 -- 172.21.15.42:0/2189963007 >> 172.21.15.42:0/2189963007 conn(0x7f98700c8930 msgr2=0x7f98700cc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:14.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.806+0000 7f987611d700 1 -- 172.21.15.42:0/2189963007 shutdown_connections 2023-07-29T02:02:14.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:14.806+0000 7f987611d700 1 -- 172.21.15.42:0/2189963007 wait complete. 2023-07-29T02:02:14.794 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2023-07-29T02:02:14.804 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2023-07-29T02:02:16.805 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:02:16.944 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.958+0000 7f0a2ef0d700 1 Processor -- start 2023-07-29T02:02:16.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.959+0000 7f0a2ef0d700 1 -- start start 2023-07-29T02:02:16.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.959+0000 7f0a2ef0d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f0a28153660 0x7f0a2806d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:16.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.959+0000 7f0a2ef0d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2815a780 0x7f0a28159d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:16.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.959+0000 7f0a2ef0d700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2815abe0 con 0x7f0a2806b860 2023-07-29T02:02:16.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.959+0000 7f0a2ef0d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2815a2d0 con 0x7f0a28153660 2023-07-29T02:02:16.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.959+0000 7f0a2ef0d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2806ed10 con 0x7f0a2815a780 2023-07-29T02:02:16.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.959+0000 7f0a27fff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f0a2806b860 0x7f0a280cd140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51380/0 (socket says 172.21.15.42:51380) 2023-07-29T02:02:16.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.959+0000 7f0a27fff700 1 -- 172.21.15.42:0/2592744405 learned_addr learned my addr 172.21.15.42:0/2592744405 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:02:16.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a2d4aa700 1 --2- 172.21.15.42:0/2592744405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2815a780 0x7f0a28159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:16.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a2cca9700 1 --2- 172.21.15.42:0/2592744405 >> v2:172.21.15.144:3300/0 conn(0x7f0a28153660 0x7f0a2806d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:16.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a277fe700 1 -- 172.21.15.42:0/2592744405 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414370696 0 0) 0x7f0a2815abe0 con 0x7f0a2806b860 2023-07-29T02:02:16.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a277fe700 1 -- 172.21.15.42:0/2592744405 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a180035b0 con 0x7f0a2806b860 2023-07-29T02:02:16.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a277fe700 1 -- 172.21.15.42:0/2592744405 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3632700508 0 0) 0x7f0a180035b0 con 0x7f0a2806b860 2023-07-29T02:02:16.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a277fe700 1 -- 172.21.15.42:0/2592744405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2815a780 msgr2=0x7f0a28159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:16.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a277fe700 1 --2- 172.21.15.42:0/2592744405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2815a780 0x7f0a28159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:16.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a277fe700 1 -- 172.21.15.42:0/2592744405 >> v2:172.21.15.144:3300/0 conn(0x7f0a28153660 msgr2=0x7f0a2806d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:16.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a277fe700 1 --2- 172.21.15.42:0/2592744405 >> v2:172.21.15.144:3300/0 conn(0x7f0a28153660 0x7f0a2806d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:16.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a277fe700 1 -- 172.21.15.42:0/2592744405 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a280b28b0 con 0x7f0a2806b860 2023-07-29T02:02:16.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a277fe700 1 -- 172.21.15.42:0/2592744405 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7f0a14001670 con 0x7f0a2806b860 2023-07-29T02:02:16.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a277fe700 1 -- 172.21.15.42:0/2592744405 >> v1:172.21.15.42:6789/0 conn(0x7f0a2806b860 legacy=0x7f0a280cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:16.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a277fe700 1 --2- 172.21.15.42:0/2592744405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a18003a00 0x7f0a18003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:16.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a277fe700 1 --2- 172.21.15.42:0/2592744405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a18004430 0x7f0a180048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:16.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a277fe700 1 --2- 172.21.15.42:0/2592744405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2815a780 0x7f0a18004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:16.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a277fe700 1 -- 172.21.15.42:0/2592744405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2815a2d0 con 0x7f0a18004430 2023-07-29T02:02:16.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a277fe700 1 -- 172.21.15.42:0/2592744405 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2806ed10 con 0x7f0a18003a00 2023-07-29T02:02:16.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a277fe700 1 -- 172.21.15.42:0/2592744405 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1800ba10 con 0x7f0a2815a780 2023-07-29T02:02:16.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a27fff700 1 --2- 172.21.15.42:0/2592744405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a18004430 0x7f0a180048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:16.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a2cca9700 1 --2- 172.21.15.42:0/2592744405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a18003a00 0x7f0a18003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:16.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.960+0000 7f0a2d4aa700 1 --2- 172.21.15.42:0/2592744405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2815a780 0x7f0a18004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:16.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.961+0000 7f0a27fff700 1 -- 172.21.15.42:0/2592744405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2815a780 msgr2=0x7f0a18004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:16.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.961+0000 7f0a27fff700 1 --2- 172.21.15.42:0/2592744405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2815a780 0x7f0a18004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:16.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.961+0000 7f0a27fff700 1 -- 172.21.15.42:0/2592744405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a18003a00 msgr2=0x7f0a18003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:16.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.961+0000 7f0a27fff700 1 --2- 172.21.15.42:0/2592744405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a18003a00 0x7f0a18003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:16.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.961+0000 7f0a27fff700 1 -- 172.21.15.42:0/2592744405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a180035b0 con 0x7f0a18004430 2023-07-29T02:02:16.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.961+0000 7f0a27fff700 1 --2- 172.21.15.42:0/2592744405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a18004430 0x7f0a180048f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400c370 tx=0x7f0a18005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8052e80704b4f632 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:16.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.961+0000 7f0a277fe700 1 -- 172.21.15.42:0/2592744405 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14007c60 con 0x7f0a18004430 2023-07-29T02:02:16.951 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.961+0000 7f0a277fe700 1 -- 172.21.15.42:0/2592744405 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a14005960 con 0x7f0a18004430 2023-07-29T02:02:16.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.961+0000 7f0a277fe700 1 -- 172.21.15.42:0/2592744405 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14005d10 con 0x7f0a18004430 2023-07-29T02:02:16.954 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.961+0000 7f0a2ef0d700 1 -- 172.21.15.42:0/2592744405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a18004430 msgr2=0x7f0a180048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:16.954 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.961+0000 7f0a2ef0d700 1 --2- 172.21.15.42:0/2592744405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a18004430 0x7f0a180048f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400c370 tx=0x7f0a18005880 comp rx=0 tx=0).stop 2023-07-29T02:02:16.954 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.962+0000 7f0a2d4aa700 1 -- 172.21.15.42:0/2592744405 reap_dead start 2023-07-29T02:02:16.954 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.962+0000 7f0a2ef0d700 1 -- 172.21.15.42:0/2592744405 shutdown_connections 2023-07-29T02:02:16.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.962+0000 7f0a2ef0d700 1 -- 172.21.15.42:0/2592744405 >> 172.21.15.42:0/2592744405 conn(0x7f0a28061190 msgr2=0x7f0a28061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:16.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.962+0000 7f0a2ef0d700 1 -- 172.21.15.42:0/2592744405 shutdown_connections 2023-07-29T02:02:16.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.962+0000 7f0a2ef0d700 1 -- 172.21.15.42:0/2592744405 wait complete. 2023-07-29T02:02:16.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.963+0000 7f0a2ef0d700 1 Processor -- start 2023-07-29T02:02:16.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.963+0000 7f0a2ef0d700 1 -- start start 2023-07-29T02:02:16.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.964+0000 7f0a2ef0d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a18004430 0x7f0a280aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:16.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.964+0000 7f0a2ef0d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2814e6f0 0x7f0a2814eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:16.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.964+0000 7f0a2ef0d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a2814a960 0x7f0a2814add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:16.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.964+0000 7f0a2ef0d700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a281ef800 con 0x7f0a18004430 2023-07-29T02:02:16.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.964+0000 7f0a2ef0d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a281efd30 con 0x7f0a2814a960 2023-07-29T02:02:16.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.964+0000 7f0a2ef0d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2814e260 con 0x7f0a2814e6f0 2023-07-29T02:02:16.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.964+0000 7f0a2cca9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a18004430 0x7f0a280aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:16.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.964+0000 7f0a2cca9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a18004430 0x7f0a280aeb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57588/0 (socket says 172.21.15.42:57588) 2023-07-29T02:02:16.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.964+0000 7f0a2cca9700 1 -- 172.21.15.42:0/520933916 learned_addr learned my addr 172.21.15.42:0/520933916 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:16.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.964+0000 7f0a2d4aa700 1 --2- 172.21.15.42:0/520933916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a2814a960 0x7f0a2814add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:16.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.964+0000 7f0a27fff700 1 --2- 172.21.15.42:0/520933916 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2814e6f0 0x7f0a2814eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:16.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.964+0000 7f0a2cca9700 1 -- 172.21.15.42:0/520933916 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2814e6f0 msgr2=0x7f0a2814eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:16.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.964+0000 7f0a2cca9700 1 --2- 172.21.15.42:0/520933916 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2814e6f0 0x7f0a2814eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:16.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.964+0000 7f0a2cca9700 1 -- 172.21.15.42:0/520933916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a2814a960 msgr2=0x7f0a2814add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:16.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.964+0000 7f0a2cca9700 1 --2- 172.21.15.42:0/520933916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a2814a960 0x7f0a2814add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:16.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.964+0000 7f0a2cca9700 1 -- 172.21.15.42:0/520933916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a280c3d40 con 0x7f0a18004430 2023-07-29T02:02:16.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.964+0000 7f0a2cca9700 1 --2- 172.21.15.42:0/520933916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a18004430 0x7f0a280aeb10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0119c0 tx=0x7f0a1c011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.965+0000 7f0a257fa700 1 -- 172.21.15.42:0/520933916 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c00f940 con 0x7f0a18004430 2023-07-29T02:02:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.965+0000 7f0a257fa700 1 -- 172.21.15.42:0/520933916 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1c00faa0 con 0x7f0a18004430 2023-07-29T02:02:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.965+0000 7f0a2ef0d700 1 -- 172.21.15.42:0/520933916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a28159c90 con 0x7f0a18004430 2023-07-29T02:02:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.965+0000 7f0a257fa700 1 -- 172.21.15.42:0/520933916 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c00fe50 con 0x7f0a18004430 2023-07-29T02:02:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.965+0000 7f0a2ef0d700 1 -- 172.21.15.42:0/520933916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2814def0 con 0x7f0a18004430 2023-07-29T02:02:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.966+0000 7f0a2ef0d700 1 -- 172.21.15.42:0/520933916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2814e0b0 con 0x7f0a18004430 2023-07-29T02:02:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.966+0000 7f0a257fa700 1 -- 172.21.15.42:0/520933916 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f0a1c014440 con 0x7f0a18004430 2023-07-29T02:02:16.958 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.966+0000 7f0a257fa700 1 --2- 172.21.15.42:0/520933916 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f0a0c06a690 0x7f0a0c06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:16.959 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.966+0000 7f0a257fa700 1 -- 172.21.15.42:0/520933916 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6936+0+0 (secure 0 0 0) 0x7f0a1c0894e0 con 0x7f0a18004430 2023-07-29T02:02:16.959 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.967+0000 7f0a27fff700 1 --2- 172.21.15.42:0/520933916 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f0a0c06a690 0x7f0a0c06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:16.959 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.967+0000 7f0a27fff700 1 --2- 172.21.15.42:0/520933916 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f0a0c06a690 0x7f0a0c06cb40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0a280c3f90 tx=0x7f0a1400a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:16.959 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:16.971+0000 7f0a257fa700 1 -- 172.21.15.42:0/520933916 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f0a1c058090 con 0x7f0a18004430 2023-07-29T02:02:17.200 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:17.215+0000 7f0a2ef0d700 1 -- 172.21.15.42:0/520933916 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a2814e540 con 0x7f0a18004430 2023-07-29T02:02:17.201 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:17.215+0000 7f0a257fa700 1 -- 172.21.15.42:0/520933916 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6169 (secure 0 0 0) 0x7f0a1c057c20 con 0x7f0a18004430 2023-07-29T02:02:17.201 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:02:17.201 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5142,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:01:50.646610+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":32,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:02:17.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:17.217+0000 7f0a2ef0d700 1 -- 172.21.15.42:0/520933916 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f0a0c06a690 msgr2=0x7f0a0c06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:17.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:17.217+0000 7f0a2ef0d700 1 --2- 172.21.15.42:0/520933916 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f0a0c06a690 0x7f0a0c06cb40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0a280c3f90 tx=0x7f0a1400a000 comp rx=0 tx=0).stop 2023-07-29T02:02:17.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:17.217+0000 7f0a2ef0d700 1 -- 172.21.15.42:0/520933916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a18004430 msgr2=0x7f0a280aeb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:17.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:17.217+0000 7f0a2ef0d700 1 --2- 172.21.15.42:0/520933916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a18004430 0x7f0a280aeb10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0119c0 tx=0x7f0a1c011d80 comp rx=0 tx=0).stop 2023-07-29T02:02:17.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:17.218+0000 7f0a2ef0d700 1 -- 172.21.15.42:0/520933916 shutdown_connections 2023-07-29T02:02:17.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:17.218+0000 7f0a2ef0d700 1 --2- 172.21.15.42:0/520933916 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f0a0c06a690 0x7f0a0c06cb40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:17.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:17.218+0000 7f0a2ef0d700 1 --2- 172.21.15.42:0/520933916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0a2814a960 0x7f0a2814add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:17.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:17.218+0000 7f0a2ef0d700 1 --2- 172.21.15.42:0/520933916 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0a18004430 0x7f0a280aeb10 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:17.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:17.218+0000 7f0a2ef0d700 1 --2- 172.21.15.42:0/520933916 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0a2814e6f0 0x7f0a2814eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:17.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:17.218+0000 7f0a2ef0d700 1 -- 172.21.15.42:0/520933916 >> 172.21.15.42:0/520933916 conn(0x7f0a28061190 msgr2=0x7f0a28061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:17.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:17.218+0000 7f0a2ef0d700 1 -- 172.21.15.42:0/520933916 shutdown_connections 2023-07-29T02:02:17.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:17.218+0000 7f0a2ef0d700 1 -- 172.21.15.42:0/520933916 wait complete. 2023-07-29T02:02:17.205 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2023-07-29T02:02:17.216 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2023-07-29T02:02:19.217 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:02:19.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.370+0000 7f76a8c7a700 1 Processor -- start 2023-07-29T02:02:19.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.370+0000 7f76a8c7a700 1 -- start start 2023-07-29T02:02:19.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.371+0000 7f76a8c7a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76a414ca00 0x7f76a406c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:19.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.371+0000 7f76a8c7a700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a406ce40 con 0x7f76a40c7270 2023-07-29T02:02:19.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.371+0000 7f76a8c7a700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a4155d50 con 0x7f76a414c630 2023-07-29T02:02:19.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.371+0000 7f76a8c7a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a4156010 con 0x7f76a414ca00 2023-07-29T02:02:19.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.371+0000 7f76a2d9d700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f76a40c7270 0x7f76a406d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51406/0 (socket says 172.21.15.42:51406) 2023-07-29T02:02:19.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.371+0000 7f76a2d9d700 1 -- 172.21.15.42:0/2764655487 learned_addr learned my addr 172.21.15.42:0/2764655487 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:02:19.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.372+0000 7f76a1d9b700 1 --2- 172.21.15.42:0/2764655487 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76a414ca00 0x7f76a406c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:19.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.372+0000 7f76a159a700 1 -- 172.21.15.42:0/2764655487 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621417382 0 0) 0x7f76a406ce40 con 0x7f76a40c7270 2023-07-29T02:02:19.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.372+0000 7f76a159a700 1 -- 172.21.15.42:0/2764655487 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76900035b0 con 0x7f76a40c7270 2023-07-29T02:02:19.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.372+0000 7f76a159a700 1 -- 172.21.15.42:0/2764655487 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515861149 0 0) 0x7f76a4155d50 con 0x7f76a414c630 2023-07-29T02:02:19.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.372+0000 7f76a159a700 1 -- 172.21.15.42:0/2764655487 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76a406ce40 con 0x7f76a414c630 2023-07-29T02:02:19.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.372+0000 7f76a1d9b700 1 -- 172.21.15.42:0/2764655487 >> v1:172.21.15.144:6789/0 conn(0x7f76a414c630 legacy=0x7f76a40c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:19.360 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.372+0000 7f76a1d9b700 1 -- 172.21.15.42:0/2764655487 >> v1:172.21.15.42:6789/0 conn(0x7f76a40c7270 legacy=0x7f76a406d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:19.360 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.372+0000 7f76a1d9b700 1 -- 172.21.15.42:0/2764655487 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a41562f0 con 0x7f76a414ca00 2023-07-29T02:02:19.360 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.372+0000 7f76a1d9b700 1 --2- 172.21.15.42:0/2764655487 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76a414ca00 0x7f76a406c270 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f768c009870 tx=0x7f768c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65402b861ad3d6d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:19.360 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.372+0000 7f76a159a700 1 -- 172.21.15.42:0/2764655487 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c011830 con 0x7f76a414ca00 2023-07-29T02:02:19.360 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.372+0000 7f76a159a700 1 -- 172.21.15.42:0/2764655487 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c011990 con 0x7f76a414ca00 2023-07-29T02:02:19.360 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.372+0000 7f76a159a700 1 -- 172.21.15.42:0/2764655487 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c011d00 con 0x7f76a414ca00 2023-07-29T02:02:19.362 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.373+0000 7f76a8c7a700 1 -- 172.21.15.42:0/2764655487 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76a414ca00 msgr2=0x7f76a406c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:19.362 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.373+0000 7f76a8c7a700 1 --2- 172.21.15.42:0/2764655487 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76a414ca00 0x7f76a406c270 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f768c009870 tx=0x7f768c009b80 comp rx=0 tx=0).stop 2023-07-29T02:02:19.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.373+0000 7f76a8c7a700 1 -- 172.21.15.42:0/2764655487 shutdown_connections 2023-07-29T02:02:19.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.373+0000 7f76a8c7a700 1 --2- 172.21.15.42:0/2764655487 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76a414ca00 0x7f76a406c270 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:19.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.373+0000 7f76a8c7a700 1 -- 172.21.15.42:0/2764655487 >> 172.21.15.42:0/2764655487 conn(0x7f76a40c8970 msgr2=0x7f76a40c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:19.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.373+0000 7f76a8c7a700 1 -- 172.21.15.42:0/2764655487 shutdown_connections 2023-07-29T02:02:19.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.373+0000 7f76a8c7a700 1 -- 172.21.15.42:0/2764655487 wait complete. 2023-07-29T02:02:19.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.374+0000 7f76a8c7a700 1 Processor -- start 2023-07-29T02:02:19.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.374+0000 7f76a8c7a700 1 -- start start 2023-07-29T02:02:19.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.375+0000 7f76a8c7a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76a40c7270 0x7f76a4151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:19.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.375+0000 7f76a8c7a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76a414c630 0x7f76a40c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:19.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.375+0000 7f76a8c7a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76a414b4e0 0x7f76a41eebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:19.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.375+0000 7f76a8c7a700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a41ee790 con 0x7f76a40c7270 2023-07-29T02:02:19.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.375+0000 7f76a8c7a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a4155cf0 con 0x7f76a414c630 2023-07-29T02:02:19.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.375+0000 7f76a8c7a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a4154260 con 0x7f76a414b4e0 2023-07-29T02:02:19.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.375+0000 7f76a259c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76a40c7270 0x7f76a4151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:19.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.375+0000 7f76a259c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76a40c7270 0x7f76a4151390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57604/0 (socket says 172.21.15.42:57604) 2023-07-29T02:02:19.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.375+0000 7f76a259c700 1 -- 172.21.15.42:0/3701540776 learned_addr learned my addr 172.21.15.42:0/3701540776 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:19.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.375+0000 7f76a2d9d700 1 --2- 172.21.15.42:0/3701540776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76a414b4e0 0x7f76a41eebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:19.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.375+0000 7f76a1d9b700 1 --2- 172.21.15.42:0/3701540776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76a414c630 0x7f76a40c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:19.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.376+0000 7f76a259c700 1 -- 172.21.15.42:0/3701540776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76a414b4e0 msgr2=0x7f76a41eebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:19.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.376+0000 7f76a259c700 1 --2- 172.21.15.42:0/3701540776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76a414b4e0 0x7f76a41eebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:19.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.376+0000 7f76a259c700 1 -- 172.21.15.42:0/3701540776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76a414c630 msgr2=0x7f76a40c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:19.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.376+0000 7f76a259c700 1 --2- 172.21.15.42:0/3701540776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76a414c630 0x7f76a40c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:19.366 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.376+0000 7f76a259c700 1 -- 172.21.15.42:0/3701540776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c0094a0 con 0x7f76a40c7270 2023-07-29T02:02:19.366 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.376+0000 7f76a259c700 1 --2- 172.21.15.42:0/3701540776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76a40c7270 0x7f76a4151390 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f769400c500 tx=0x7f769400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:19.366 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.376+0000 7f769affd700 1 -- 172.21.15.42:0/3701540776 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76940052d0 con 0x7f76a40c7270 2023-07-29T02:02:19.366 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.376+0000 7f769affd700 1 -- 172.21.15.42:0/3701540776 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7694005430 con 0x7f76a40c7270 2023-07-29T02:02:19.366 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.376+0000 7f76a8c7a700 1 -- 172.21.15.42:0/3701540776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a4154520 con 0x7f76a40c7270 2023-07-29T02:02:19.366 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.376+0000 7f769affd700 1 -- 172.21.15.42:0/3701540776 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76940038c0 con 0x7f76a40c7270 2023-07-29T02:02:19.366 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.376+0000 7f76a8c7a700 1 -- 172.21.15.42:0/3701540776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a4155a10 con 0x7f76a40c7270 2023-07-29T02:02:19.367 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.377+0000 7f76a8c7a700 1 -- 172.21.15.42:0/3701540776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a4074740 con 0x7f76a40c7270 2023-07-29T02:02:19.367 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.377+0000 7f769affd700 1 -- 172.21.15.42:0/3701540776 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f7694003a20 con 0x7f76a40c7270 2023-07-29T02:02:19.367 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.378+0000 7f769affd700 1 --2- 172.21.15.42:0/3701540776 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f768406a690 0x7f768406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:19.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.378+0000 7f769affd700 1 -- 172.21.15.42:0/3701540776 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6936+0+0 (secure 0 0 0) 0x7f76940882a0 con 0x7f76a40c7270 2023-07-29T02:02:19.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.378+0000 7f76a1d9b700 1 --2- 172.21.15.42:0/3701540776 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f768406a690 0x7f768406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:19.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.379+0000 7f76a1d9b700 1 --2- 172.21.15.42:0/3701540776 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f768406a690 0x7f768406cb40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f768c009870 tx=0x7f768c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:19.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.382+0000 7f769affd700 1 -- 172.21.15.42:0/3701540776 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f76940533c0 con 0x7f76a40c7270 2023-07-29T02:02:19.611 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.625+0000 7f76a8c7a700 1 -- 172.21.15.42:0/3701540776 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76a4159f70 con 0x7f76a40c7270 2023-07-29T02:02:19.611 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.625+0000 7f769affd700 1 -- 172.21.15.42:0/3701540776 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6169 (secure 0 0 0) 0x7f76940569e0 con 0x7f76a40c7270 2023-07-29T02:02:19.612 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:02:19.612 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5142,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:01:50.646610+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":32,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:02:19.613 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.628+0000 7f76a8c7a700 1 -- 172.21.15.42:0/3701540776 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f768406a690 msgr2=0x7f768406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:19.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.628+0000 7f76a8c7a700 1 --2- 172.21.15.42:0/3701540776 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f768406a690 0x7f768406cb40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f768c009870 tx=0x7f768c01c040 comp rx=0 tx=0).stop 2023-07-29T02:02:19.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.628+0000 7f76a8c7a700 1 -- 172.21.15.42:0/3701540776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76a40c7270 msgr2=0x7f76a4151390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:19.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.628+0000 7f76a8c7a700 1 --2- 172.21.15.42:0/3701540776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76a40c7270 0x7f76a4151390 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f769400c500 tx=0x7f769400c8c0 comp rx=0 tx=0).stop 2023-07-29T02:02:19.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.628+0000 7f76a8c7a700 1 -- 172.21.15.42:0/3701540776 shutdown_connections 2023-07-29T02:02:19.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.628+0000 7f76a8c7a700 1 --2- 172.21.15.42:0/3701540776 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f768406a690 0x7f768406cb40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:19.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.628+0000 7f76a8c7a700 1 --2- 172.21.15.42:0/3701540776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f76a414b4e0 0x7f76a41eebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:19.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.628+0000 7f76a8c7a700 1 --2- 172.21.15.42:0/3701540776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f76a40c7270 0x7f76a4151390 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:19.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.628+0000 7f76a8c7a700 1 --2- 172.21.15.42:0/3701540776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f76a414c630 0x7f76a40c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:19.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.628+0000 7f76a8c7a700 1 -- 172.21.15.42:0/3701540776 >> 172.21.15.42:0/3701540776 conn(0x7f76a40c8970 msgr2=0x7f76a414a660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:19.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.628+0000 7f76a8c7a700 1 -- 172.21.15.42:0/3701540776 shutdown_connections 2023-07-29T02:02:19.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:19.628+0000 7f76a8c7a700 1 -- 172.21.15.42:0/3701540776 wait complete. 2023-07-29T02:02:19.615 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2023-07-29T02:02:19.625 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2023-07-29T02:02:21.626 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:02:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.780+0000 7f9a3eddd700 1 Processor -- start 2023-07-29T02:02:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.780+0000 7f9a3eddd700 1 -- start start 2023-07-29T02:02:21.767 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.781+0000 7f9a3eddd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9a38155de0 0x7f9a3814fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.781+0000 7f9a3eddd700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3806ce40 con 0x7f9a380c69e0 2023-07-29T02:02:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.781+0000 7f9a3eddd700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3806bc10 con 0x7f9a38150110 2023-07-29T02:02:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.781+0000 7f9a3eddd700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a38150570 con 0x7f9a38155de0 2023-07-29T02:02:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.781+0000 7f9a37fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9a38155de0 0x7f9a3814fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.781+0000 7f9a3cb79700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f9a380c69e0 0x7f9a380c6db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51416/0 (socket says 172.21.15.42:51416) 2023-07-29T02:02:21.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.781+0000 7f9a3cb79700 1 -- 172.21.15.42:0/2654191429 learned_addr learned my addr 172.21.15.42:0/2654191429 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:02:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.782+0000 7f9a37fff700 1 -- 172.21.15.42:0/2654191429 >> v1:172.21.15.144:6789/0 conn(0x7f9a38150110 legacy=0x7f9a3806d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.782+0000 7f9a37fff700 1 -- 172.21.15.42:0/2654191429 >> v1:172.21.15.42:6789/0 conn(0x7f9a380c69e0 legacy=0x7f9a380c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.782+0000 7f9a377fe700 1 -- 172.21.15.42:0/2654191429 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3585530960 0 0) 0x7f9a3806ce40 con 0x7f9a380c69e0 2023-07-29T02:02:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.782+0000 7f9a37fff700 1 -- 172.21.15.42:0/2654191429 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3806bef0 con 0x7f9a38155de0 2023-07-29T02:02:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.782+0000 7f9a37fff700 1 --2- 172.21.15.42:0/2654191429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a38155de0 0x7f9a3814fbd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009840 tx=0x7f9a24009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c55778f4ce973e server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.782+0000 7f9a377fe700 1 -- 172.21.15.42:0/2654191429 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24011830 con 0x7f9a38155de0 2023-07-29T02:02:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.782+0000 7f9a377fe700 1 -- 172.21.15.42:0/2654191429 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a24011990 con 0x7f9a38155de0 2023-07-29T02:02:21.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.782+0000 7f9a377fe700 1 -- 172.21.15.42:0/2654191429 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24011d20 con 0x7f9a38155de0 2023-07-29T02:02:21.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.782+0000 7f9a3eddd700 1 -- 172.21.15.42:0/2654191429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a38155de0 msgr2=0x7f9a3814fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:21.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.782+0000 7f9a3eddd700 1 --2- 172.21.15.42:0/2654191429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a38155de0 0x7f9a3814fbd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009840 tx=0x7f9a24009b50 comp rx=0 tx=0).stop 2023-07-29T02:02:21.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.783+0000 7f9a3eddd700 1 -- 172.21.15.42:0/2654191429 shutdown_connections 2023-07-29T02:02:21.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.783+0000 7f9a3eddd700 1 --2- 172.21.15.42:0/2654191429 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a38155de0 0x7f9a3814fbd0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:21.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.783+0000 7f9a3eddd700 1 -- 172.21.15.42:0/2654191429 >> 172.21.15.42:0/2654191429 conn(0x7f9a380c8970 msgr2=0x7f9a380c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:21.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.783+0000 7f9a3eddd700 1 -- 172.21.15.42:0/2654191429 shutdown_connections 2023-07-29T02:02:21.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.783+0000 7f9a3eddd700 1 -- 172.21.15.42:0/2654191429 wait complete. 2023-07-29T02:02:21.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.784+0000 7f9a3eddd700 1 Processor -- start 2023-07-29T02:02:21.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.784+0000 7f9a3eddd700 1 -- start start 2023-07-29T02:02:21.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a3eddd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a380c69e0 0x7f9a380bf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:21.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a3eddd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a38150110 0x7f9a38161770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:21.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a3eddd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a38155de0 0x7f9a38162b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:21.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a3eddd700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a380c4b30 con 0x7f9a38150110 2023-07-29T02:02:21.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a3eddd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a380c6050 con 0x7f9a38155de0 2023-07-29T02:02:21.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a3eddd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a38161cb0 con 0x7f9a380c69e0 2023-07-29T02:02:21.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a37fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a38150110 0x7f9a38161770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:21.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a37fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a38150110 0x7f9a38161770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57620/0 (socket says 172.21.15.42:57620) 2023-07-29T02:02:21.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a37fff700 1 -- 172.21.15.42:0/3139657652 learned_addr learned my addr 172.21.15.42:0/3139657652 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a3d37a700 1 --2- 172.21.15.42:0/3139657652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a38155de0 0x7f9a38162b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a3cb79700 1 --2- 172.21.15.42:0/3139657652 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a380c69e0 0x7f9a380bf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a37fff700 1 -- 172.21.15.42:0/3139657652 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a380c69e0 msgr2=0x7f9a380bf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a37fff700 1 --2- 172.21.15.42:0/3139657652 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a380c69e0 0x7f9a380bf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a37fff700 1 -- 172.21.15.42:0/3139657652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a38155de0 msgr2=0x7f9a38162b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a37fff700 1 --2- 172.21.15.42:0/3139657652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a38155de0 0x7f9a38162b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a37fff700 1 -- 172.21.15.42:0/3139657652 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a240094a0 con 0x7f9a38150110 2023-07-29T02:02:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a37fff700 1 --2- 172.21.15.42:0/3139657652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a38150110 0x7f9a38161770 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9a24014040 tx=0x7f9a24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a357fa700 1 -- 172.21.15.42:0/3139657652 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2401a860 con 0x7f9a38150110 2023-07-29T02:02:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a357fa700 1 -- 172.21.15.42:0/3139657652 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2401a9c0 con 0x7f9a38150110 2023-07-29T02:02:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a3eddd700 1 -- 172.21.15.42:0/3139657652 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a380c62f0 con 0x7f9a38150110 2023-07-29T02:02:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.785+0000 7f9a357fa700 1 -- 172.21.15.42:0/3139657652 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2401ad50 con 0x7f9a38150110 2023-07-29T02:02:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.786+0000 7f9a3eddd700 1 -- 172.21.15.42:0/3139657652 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3814cd50 con 0x7f9a38150110 2023-07-29T02:02:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.786+0000 7f9a3eddd700 1 -- 172.21.15.42:0/3139657652 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a38074740 con 0x7f9a38150110 2023-07-29T02:02:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.787+0000 7f9a357fa700 1 -- 172.21.15.42:0/3139657652 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f9a24022070 con 0x7f9a38150110 2023-07-29T02:02:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.787+0000 7f9a357fa700 1 --2- 172.21.15.42:0/3139657652 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a1c06a690 0x7f9a1c06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.787+0000 7f9a357fa700 1 -- 172.21.15.42:0/3139657652 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6936+0+0 (secure 0 0 0) 0x7f9a24089f20 con 0x7f9a38150110 2023-07-29T02:02:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.787+0000 7f9a3cb79700 1 --2- 172.21.15.42:0/3139657652 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a1c06a690 0x7f9a1c06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.788+0000 7f9a3cb79700 1 --2- 172.21.15.42:0/3139657652 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a1c06a690 0x7f9a1c06cb40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c007b10 tx=0x7f9a2c007a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:21.792+0000 7f9a357fa700 1 -- 172.21.15.42:0/3139657652 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f9a24055040 con 0x7f9a38150110 2023-07-29T02:02:22.021 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:22.036+0000 7f9a3eddd700 1 -- 172.21.15.42:0/3139657652 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a3806c490 con 0x7f9a38150110 2023-07-29T02:02:22.022 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:22.036+0000 7f9a357fa700 1 -- 172.21.15.42:0/3139657652 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6169 (secure 0 0 0) 0x7f9a3806c490 con 0x7f9a38150110 2023-07-29T02:02:22.022 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:02:22.023 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5142,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:01:50.646610+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":11,"state":"up:active","state_seq":32,"addr":"172.21.15.144:6839/3824722756","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":3824722756},{"type":"v1","addr":"172.21.15.144:6839","nonce":3824722756}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:02:22.024 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:22.039+0000 7f9a3eddd700 1 -- 172.21.15.42:0/3139657652 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a1c06a690 msgr2=0x7f9a1c06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:22.039+0000 7f9a3eddd700 1 --2- 172.21.15.42:0/3139657652 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a1c06a690 0x7f9a1c06cb40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c007b10 tx=0x7f9a2c007a60 comp rx=0 tx=0).stop 2023-07-29T02:02:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:22.039+0000 7f9a3eddd700 1 -- 172.21.15.42:0/3139657652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a38150110 msgr2=0x7f9a38161770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:22.039+0000 7f9a3eddd700 1 --2- 172.21.15.42:0/3139657652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a38150110 0x7f9a38161770 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9a24014040 tx=0x7f9a24004750 comp rx=0 tx=0).stop 2023-07-29T02:02:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:22.039+0000 7f9a3eddd700 1 -- 172.21.15.42:0/3139657652 shutdown_connections 2023-07-29T02:02:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:22.039+0000 7f9a3eddd700 1 --2- 172.21.15.42:0/3139657652 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a1c06a690 0x7f9a1c06cb40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:22.039+0000 7f9a3eddd700 1 --2- 172.21.15.42:0/3139657652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a38155de0 0x7f9a38162b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:22.025 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:22.039+0000 7f9a3eddd700 1 --2- 172.21.15.42:0/3139657652 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a380c69e0 0x7f9a380bf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:22.026 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:22.039+0000 7f9a3eddd700 1 --2- 172.21.15.42:0/3139657652 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a38150110 0x7f9a38161770 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:22.026 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:22.039+0000 7f9a3eddd700 1 -- 172.21.15.42:0/3139657652 >> 172.21.15.42:0/3139657652 conn(0x7f9a380c8970 msgr2=0x7f9a38072290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:22.026 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:22.039+0000 7f9a3eddd700 1 -- 172.21.15.42:0/3139657652 shutdown_connections 2023-07-29T02:02:22.026 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:22.039+0000 7f9a3eddd700 1 -- 172.21.15.42:0/3139657652 wait complete. 2023-07-29T02:02:22.026 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 15 2023-07-29T02:02:22.037 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2023-07-29T02:02:24.038 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:02:24.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.191+0000 7f20ce6d4700 1 Processor -- start 2023-07-29T02:02:24.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.191+0000 7f20ce6d4700 1 -- start start 2023-07-29T02:02:24.180 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.192+0000 7f20ce6d4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20c81545b0 0x7f20c806a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:24.180 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.192+0000 7f20ce6d4700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c80c6770 con 0x7f20c80c84c0 2023-07-29T02:02:24.180 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.192+0000 7f20ce6d4700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20c806e420 con 0x7f20c80bf750 2023-07-29T02:02:24.180 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.192+0000 7f20ce6d4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c806dea0 con 0x7f20c81545b0 2023-07-29T02:02:24.180 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.192+0000 7f20ccc71700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f20c80c84c0 0x7f20c8161880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51430/0 (socket says 172.21.15.42:51430) 2023-07-29T02:02:24.181 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.192+0000 7f20ccc71700 1 -- 172.21.15.42:0/1992456551 learned_addr learned my addr 172.21.15.42:0/1992456551 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:02:24.181 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.192+0000 7f20c7fff700 1 --2- 172.21.15.42:0/1992456551 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20c81545b0 0x7f20c806a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:24.181 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.192+0000 7f20c6ffd700 1 -- 172.21.15.42:0/1992456551 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883227943 0 0) 0x7f20c80c6770 con 0x7f20c80c84c0 2023-07-29T02:02:24.181 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.192+0000 7f20c6ffd700 1 -- 172.21.15.42:0/1992456551 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20b00035b0 con 0x7f20c80c84c0 2023-07-29T02:02:24.181 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.192+0000 7f20c6ffd700 1 -- 172.21.15.42:0/1992456551 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3417924267 0 0) 0x7f20b00035b0 con 0x7f20c80c84c0 2023-07-29T02:02:24.181 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20c6ffd700 1 -- 172.21.15.42:0/1992456551 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20c81545b0 msgr2=0x7f20c806a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:24.181 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20c6ffd700 1 --2- 172.21.15.42:0/1992456551 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20c81545b0 0x7f20c806a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:24.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20c6ffd700 1 -- 172.21.15.42:0/1992456551 >> v1:172.21.15.144:6789/0 conn(0x7f20c80bf750 legacy=0x7f20c81573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:24.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20c6ffd700 1 -- 172.21.15.42:0/1992456551 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c80c69c0 con 0x7f20c80c84c0 2023-07-29T02:02:24.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20c6ffd700 1 -- 172.21.15.42:0/1992456551 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7f20c00019f0 con 0x7f20c80c84c0 2023-07-29T02:02:24.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20c6ffd700 1 -- 172.21.15.42:0/1992456551 >> v1:172.21.15.42:6789/0 conn(0x7f20c80c84c0 legacy=0x7f20c8161880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:24.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20c6ffd700 1 --2- 172.21.15.42:0/1992456551 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20c81545b0 0x7f20b0003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:24.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20c6ffd700 1 --2- 172.21.15.42:0/1992456551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20b0003fb0 0x7f20b0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:24.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20c6ffd700 1 --2- 172.21.15.42:0/1992456551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20b0004d90 0x7f20b0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:24.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20c6ffd700 1 -- 172.21.15.42:0/1992456551 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c806dea0 con 0x7f20b0004d90 2023-07-29T02:02:24.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20c6ffd700 1 -- 172.21.15.42:0/1992456551 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b000bb80 con 0x7f20b0003fb0 2023-07-29T02:02:24.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20c6ffd700 1 -- 172.21.15.42:0/1992456551 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b000bd40 con 0x7f20c81545b0 2023-07-29T02:02:24.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20ccc71700 1 --2- 172.21.15.42:0/1992456551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20b0004d90 0x7f20b0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:24.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20c7fff700 1 --2- 172.21.15.42:0/1992456551 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20c81545b0 0x7f20b0003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:24.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20c77fe700 1 --2- 172.21.15.42:0/1992456551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20b0003fb0 0x7f20b0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:24.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20ccc71700 1 -- 172.21.15.42:0/1992456551 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20c81545b0 msgr2=0x7f20b0003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:24.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20ccc71700 1 --2- 172.21.15.42:0/1992456551 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20c81545b0 0x7f20b0003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:24.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20ccc71700 1 -- 172.21.15.42:0/1992456551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20b0003fb0 msgr2=0x7f20b0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:24.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20ccc71700 1 --2- 172.21.15.42:0/1992456551 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20b0003fb0 0x7f20b0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:24.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20ccc71700 1 -- 172.21.15.42:0/1992456551 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b00035b0 con 0x7f20b0004d90 2023-07-29T02:02:24.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20ccc71700 1 --2- 172.21.15.42:0/1992456551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20b0004d90 0x7f20b0005200 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f20c000a800 tx=0x7f20b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16cbbc28582d763e server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:24.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20c6ffd700 1 -- 172.21.15.42:0/1992456551 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c000a2f0 con 0x7f20b0004d90 2023-07-29T02:02:24.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20c6ffd700 1 -- 172.21.15.42:0/1992456551 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c0012600 con 0x7f20b0004d90 2023-07-29T02:02:24.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.193+0000 7f20c6ffd700 1 -- 172.21.15.42:0/1992456551 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c00129b0 con 0x7f20b0004d90 2023-07-29T02:02:24.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.194+0000 7f20ce6d4700 1 -- 172.21.15.42:0/1992456551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20b0004d90 msgr2=0x7f20b0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:24.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.194+0000 7f20ce6d4700 1 --2- 172.21.15.42:0/1992456551 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20b0004d90 0x7f20b0005200 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f20c000a800 tx=0x7f20b0005880 comp rx=0 tx=0).stop 2023-07-29T02:02:24.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.194+0000 7f20ccc71700 1 -- 172.21.15.42:0/1992456551 reap_dead start 2023-07-29T02:02:24.186 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.194+0000 7f20ce6d4700 1 -- 172.21.15.42:0/1992456551 shutdown_connections 2023-07-29T02:02:24.186 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.194+0000 7f20ce6d4700 1 -- 172.21.15.42:0/1992456551 >> 172.21.15.42:0/1992456551 conn(0x7f20c80c8970 msgr2=0x7f20c80c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:24.186 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.194+0000 7f20ce6d4700 1 -- 172.21.15.42:0/1992456551 shutdown_connections 2023-07-29T02:02:24.186 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.194+0000 7f20ce6d4700 1 -- 172.21.15.42:0/1992456551 wait complete. 2023-07-29T02:02:24.188 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.195+0000 7f20ce6d4700 1 Processor -- start 2023-07-29T02:02:24.188 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.196+0000 7f20ce6d4700 1 -- start start 2023-07-29T02:02:24.188 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.196+0000 7f20ce6d4700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c80bfeb0 0x7f20c80c0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:24.189 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.196+0000 7f20ce6d4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c81ec0b0 0x7f20c81561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:24.189 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.196+0000 7f20ce6d4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20c80c1e60 0x7f20c8156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:24.189 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.196+0000 7f20ce6d4700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c81ed0c0 con 0x7f20c80bfeb0 2023-07-29T02:02:24.189 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.196+0000 7f20ce6d4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c80c1a40 con 0x7f20c81ec0b0 2023-07-29T02:02:24.189 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.196+0000 7f20ce6d4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c80c7370 con 0x7f20c80c1e60 2023-07-29T02:02:24.189 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.196+0000 7f20c7fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c80bfeb0 0x7f20c80c0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:24.189 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.196+0000 7f20c7fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c80bfeb0 0x7f20c80c0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57638/0 (socket says 172.21.15.42:57638) 2023-07-29T02:02:24.190 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.196+0000 7f20c7fff700 1 -- 172.21.15.42:0/1812218117 learned_addr learned my addr 172.21.15.42:0/1812218117 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:24.190 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.197+0000 7f20ccc71700 1 --2- 172.21.15.42:0/1812218117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20c80c1e60 0x7f20c8156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:24.190 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.197+0000 7f20c77fe700 1 --2- 172.21.15.42:0/1812218117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c81ec0b0 0x7f20c81561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:24.190 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.197+0000 7f20c7fff700 1 -- 172.21.15.42:0/1812218117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20c80c1e60 msgr2=0x7f20c8156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:24.190 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.197+0000 7f20c7fff700 1 --2- 172.21.15.42:0/1812218117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20c80c1e60 0x7f20c8156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:24.190 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.197+0000 7f20c7fff700 1 -- 172.21.15.42:0/1812218117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c81ec0b0 msgr2=0x7f20c81561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:24.190 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.197+0000 7f20c7fff700 1 --2- 172.21.15.42:0/1812218117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c81ec0b0 0x7f20c81561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:24.191 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.197+0000 7f20c7fff700 1 -- 172.21.15.42:0/1812218117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c81ec540 con 0x7f20c80bfeb0 2023-07-29T02:02:24.191 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.197+0000 7f20c7fff700 1 --2- 172.21.15.42:0/1812218117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c80bfeb0 0x7f20c80c0280 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f20b80119f0 tx=0x7f20b8011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:24.191 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.197+0000 7f20c4ff9700 1 -- 172.21.15.42:0/1812218117 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b8011e90 con 0x7f20c80bfeb0 2023-07-29T02:02:24.191 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.197+0000 7f20c4ff9700 1 -- 172.21.15.42:0/1812218117 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b8005c30 con 0x7f20c80bfeb0 2023-07-29T02:02:24.191 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.197+0000 7f20ce6d4700 1 -- 172.21.15.42:0/1812218117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c81ec820 con 0x7f20c80bfeb0 2023-07-29T02:02:24.191 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.197+0000 7f20c4ff9700 1 -- 172.21.15.42:0/1812218117 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b800f730 con 0x7f20c80bfeb0 2023-07-29T02:02:24.191 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.197+0000 7f20ce6d4700 1 -- 172.21.15.42:0/1812218117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c81ecde0 con 0x7f20c80bfeb0 2023-07-29T02:02:24.191 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.198+0000 7f20ce6d4700 1 -- 172.21.15.42:0/1812218117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c80726f0 con 0x7f20c80bfeb0 2023-07-29T02:02:24.192 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.198+0000 7f20c4ff9700 1 -- 172.21.15.42:0/1812218117 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f20b800f890 con 0x7f20c80bfeb0 2023-07-29T02:02:24.192 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.199+0000 7f20c4ff9700 1 --2- 172.21.15.42:0/1812218117 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f20b406a660 0x7f20b406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:24.192 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.199+0000 7f20c4ff9700 1 -- 172.21.15.42:0/1812218117 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6936+0+0 (secure 0 0 0) 0x7f20b80894f0 con 0x7f20c80bfeb0 2023-07-29T02:02:24.192 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.199+0000 7f20c77fe700 1 --2- 172.21.15.42:0/1812218117 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f20b406a660 0x7f20b406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:24.192 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.200+0000 7f20c77fe700 1 --2- 172.21.15.42:0/1812218117 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f20b406a660 0x7f20b406cb10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f20bc007fd0 tx=0x7f20bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:24.193 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.203+0000 7f20c4ff9700 1 -- 172.21.15.42:0/1812218117 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f20b80580d0 con 0x7f20c80bfeb0 2023-07-29T02:02:24.440 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.454+0000 7f20ce6d4700 1 -- 172.21.15.42:0/1812218117 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20c806e110 con 0x7f20c80bfeb0 2023-07-29T02:02:24.440 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.454+0000 7f20c4ff9700 1 -- 172.21.15.42:0/1812218117 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+5408 (secure 0 0 0) 0x7f20b8057c60 con 0x7f20c80bfeb0 2023-07-29T02:02:24.441 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:02:24.441 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:02:24.416245+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5142":{"gid":5142,"name":"e","rank":0,"incarnation":16,"state":"up:replay","state_seq":1,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:02:24.443 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.457+0000 7f20ce6d4700 1 -- 172.21.15.42:0/1812218117 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f20b406a660 msgr2=0x7f20b406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:24.443 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.457+0000 7f20ce6d4700 1 --2- 172.21.15.42:0/1812218117 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f20b406a660 0x7f20b406cb10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f20bc007fd0 tx=0x7f20bc009040 comp rx=0 tx=0).stop 2023-07-29T02:02:24.443 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.457+0000 7f20ce6d4700 1 -- 172.21.15.42:0/1812218117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c80bfeb0 msgr2=0x7f20c80c0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:24.443 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.457+0000 7f20ce6d4700 1 --2- 172.21.15.42:0/1812218117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c80bfeb0 0x7f20c80c0280 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f20b80119f0 tx=0x7f20b8011d00 comp rx=0 tx=0).stop 2023-07-29T02:02:24.443 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.457+0000 7f20ce6d4700 1 -- 172.21.15.42:0/1812218117 shutdown_connections 2023-07-29T02:02:24.443 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.457+0000 7f20ce6d4700 1 --2- 172.21.15.42:0/1812218117 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f20b406a660 0x7f20b406cb10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:24.444 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.457+0000 7f20ce6d4700 1 --2- 172.21.15.42:0/1812218117 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f20c80c1e60 0x7f20c8156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:24.444 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.457+0000 7f20ce6d4700 1 --2- 172.21.15.42:0/1812218117 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f20c80bfeb0 0x7f20c80c0280 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:24.444 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.457+0000 7f20ce6d4700 1 --2- 172.21.15.42:0/1812218117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20c81ec0b0 0x7f20c81561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:24.444 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.457+0000 7f20ce6d4700 1 -- 172.21.15.42:0/1812218117 >> 172.21.15.42:0/1812218117 conn(0x7f20c80c8970 msgr2=0x7f20c8153630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:24.444 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.457+0000 7f20ce6d4700 1 -- 172.21.15.42:0/1812218117 shutdown_connections 2023-07-29T02:02:24.444 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.457+0000 7f20ce6d4700 1 -- 172.21.15.42:0/1812218117 wait complete. 2023-07-29T02:02:24.445 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 16 2023-07-29T02:02:24.454 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d down, removed from mdsmap 2023-07-29T02:02:24.455 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2023-07-29T02:02:24.455 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:02:24.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.594+0000 7f52f16ab700 1 Processor -- start 2023-07-29T02:02:24.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.594+0000 7f52f16ab700 1 -- start start 2023-07-29T02:02:24.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.595+0000 7f52f16ab700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f52ec0c2100 0x7f52ec156920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:24.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.595+0000 7f52f16ab700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52ec0c24d0 0x7f52ec070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:24.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.595+0000 7f52f16ab700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52ec156e60 con 0x7f52ec072900 2023-07-29T02:02:24.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.595+0000 7f52f16ab700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52ec06c8f0 con 0x7f52ec0c2100 2023-07-29T02:02:24.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.595+0000 7f52f16ab700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec06ba00 con 0x7f52ec0c24d0 2023-07-29T02:02:24.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.595+0000 7f52eaffd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f52ec0c2100 0x7f52ec156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:24.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.595+0000 7f52eaffd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f52ec0c2100 0x7f52ec156920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57646/0 (socket says 172.21.15.42:57646) 2023-07-29T02:02:24.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.595+0000 7f52eb7fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f52ec072900 0x7f52ec0b17f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51454/0 (socket says 172.21.15.42:51454) 2023-07-29T02:02:24.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.595+0000 7f52eaffd700 1 -- 172.21.15.42:0/84990074 learned_addr learned my addr 172.21.15.42:0/84990074 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:24.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.596+0000 7f52ea7fc700 1 --2- 172.21.15.42:0/84990074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52ec0c24d0 0x7f52ec070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:24.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.596+0000 7f52eaffd700 1 -- 172.21.15.42:0/84990074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52ec0c24d0 msgr2=0x7f52ec070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:24.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.596+0000 7f52eaffd700 1 --2- 172.21.15.42:0/84990074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52ec0c24d0 0x7f52ec070fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:24.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.596+0000 7f52eaffd700 1 -- 172.21.15.42:0/84990074 >> v1:172.21.15.42:6789/0 conn(0x7f52ec072900 legacy=0x7f52ec0b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:24.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.596+0000 7f52eaffd700 1 -- 172.21.15.42:0/84990074 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52ec06bce0 con 0x7f52ec0c2100 2023-07-29T02:02:24.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.596+0000 7f52e9ffb700 1 -- 172.21.15.42:0/84990074 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869634555 0 0) 0x7f52e4001490 con 0x7f52ec072900 2023-07-29T02:02:24.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.596+0000 7f52ea7fc700 1 --2- 172.21.15.42:0/84990074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52ec0c24d0 0x7f52ec070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:02:24.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.596+0000 7f52eaffd700 1 --2- 172.21.15.42:0/84990074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52ec0c2100 0x7f52ec156920 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f52e000bb90 tx=0x7f52e000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f752333e0dff59bf server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:24.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.596+0000 7f52e9ffb700 1 -- 172.21.15.42:0/84990074 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e000dd50 con 0x7f52ec0c2100 2023-07-29T02:02:24.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.596+0000 7f52e9ffb700 1 -- 172.21.15.42:0/84990074 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e0010470 con 0x7f52ec0c2100 2023-07-29T02:02:24.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.596+0000 7f52e9ffb700 1 -- 172.21.15.42:0/84990074 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e0010800 con 0x7f52ec0c2100 2023-07-29T02:02:24.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.597+0000 7f52f16ab700 1 -- 172.21.15.42:0/84990074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52ec0c2100 msgr2=0x7f52ec156920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:24.586 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.597+0000 7f52f16ab700 1 --2- 172.21.15.42:0/84990074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52ec0c2100 0x7f52ec156920 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f52e000bb90 tx=0x7f52e000bea0 comp rx=0 tx=0).stop 2023-07-29T02:02:24.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.597+0000 7f52f16ab700 1 -- 172.21.15.42:0/84990074 shutdown_connections 2023-07-29T02:02:24.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.597+0000 7f52f16ab700 1 --2- 172.21.15.42:0/84990074 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52ec0c2100 0x7f52ec156920 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:24.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.597+0000 7f52f16ab700 1 --2- 172.21.15.42:0/84990074 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52ec0c24d0 0x7f52ec070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:24.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.597+0000 7f52f16ab700 1 -- 172.21.15.42:0/84990074 >> 172.21.15.42:0/84990074 conn(0x7f52ec06f850 msgr2=0x7f52ec0cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:24.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.597+0000 7f52f16ab700 1 -- 172.21.15.42:0/84990074 shutdown_connections 2023-07-29T02:02:24.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.597+0000 7f52f16ab700 1 -- 172.21.15.42:0/84990074 wait complete. 2023-07-29T02:02:24.587 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.598+0000 7f52f16ab700 1 Processor -- start 2023-07-29T02:02:24.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.598+0000 7f52f16ab700 1 -- start start 2023-07-29T02:02:24.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.599+0000 7f52f16ab700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52ec072900 0x7f52ec1e16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:24.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.599+0000 7f52f16ab700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52ec0c2100 0x7f52ec0c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:24.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.599+0000 7f52f16ab700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52ec0c24d0 0x7f52ec1499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:24.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.599+0000 7f52f16ab700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec1dda40 con 0x7f52ec0c2100 2023-07-29T02:02:24.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.599+0000 7f52f16ab700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec0c6470 con 0x7f52ec0c24d0 2023-07-29T02:02:24.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.599+0000 7f52f16ab700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52ec071710 con 0x7f52ec072900 2023-07-29T02:02:24.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.599+0000 7f52ea7fc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52ec0c2100 0x7f52ec0c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:24.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.599+0000 7f52ea7fc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52ec0c2100 0x7f52ec0c5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57654/0 (socket says 172.21.15.42:57654) 2023-07-29T02:02:24.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.599+0000 7f52ea7fc700 1 -- 172.21.15.42:0/1861656491 learned_addr learned my addr 172.21.15.42:0/1861656491 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:24.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.599+0000 7f52eaffd700 1 --2- 172.21.15.42:0/1861656491 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52ec072900 0x7f52ec1e16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:24.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.599+0000 7f52eb7fe700 1 --2- 172.21.15.42:0/1861656491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52ec0c24d0 0x7f52ec1499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:24.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.599+0000 7f52ea7fc700 1 -- 172.21.15.42:0/1861656491 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52ec072900 msgr2=0x7f52ec1e16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:24.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.599+0000 7f52ea7fc700 1 --2- 172.21.15.42:0/1861656491 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52ec072900 0x7f52ec1e16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:24.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.599+0000 7f52ea7fc700 1 -- 172.21.15.42:0/1861656491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52ec0c24d0 msgr2=0x7f52ec1499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:24.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.599+0000 7f52ea7fc700 1 --2- 172.21.15.42:0/1861656491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52ec0c24d0 0x7f52ec1499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:24.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.599+0000 7f52ea7fc700 1 -- 172.21.15.42:0/1861656491 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e000b7f0 con 0x7f52ec0c2100 2023-07-29T02:02:24.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.599+0000 7f52eb7fe700 1 --2- 172.21.15.42:0/1861656491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52ec0c24d0 0x7f52ec1499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:02:24.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.599+0000 7f52ea7fc700 1 --2- 172.21.15.42:0/1861656491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52ec0c2100 0x7f52ec0c5ac0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00e810 tx=0x7f52dc00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:24.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.600+0000 7f52d37fe700 1 -- 172.21.15.42:0/1861656491 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc00c020 con 0x7f52ec0c2100 2023-07-29T02:02:24.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.600+0000 7f52d37fe700 1 -- 172.21.15.42:0/1861656491 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc004250 con 0x7f52ec0c2100 2023-07-29T02:02:24.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.600+0000 7f52f16ab700 1 -- 172.21.15.42:0/1861656491 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ec0c45c0 con 0x7f52ec0c2100 2023-07-29T02:02:24.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.600+0000 7f52d37fe700 1 -- 172.21.15.42:0/1861656491 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc0036a0 con 0x7f52ec0c2100 2023-07-29T02:02:24.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.600+0000 7f52f16ab700 1 -- 172.21.15.42:0/1861656491 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52ec0c4b80 con 0x7f52ec0c2100 2023-07-29T02:02:24.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.601+0000 7f52f16ab700 1 -- 172.21.15.42:0/1861656491 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52ec04ea50 con 0x7f52ec0c2100 2023-07-29T02:02:24.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.601+0000 7f52d37fe700 1 -- 172.21.15.42:0/1861656491 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f52dc003800 con 0x7f52ec0c2100 2023-07-29T02:02:24.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.601+0000 7f52d37fe700 1 --2- 172.21.15.42:0/1861656491 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f52d806a660 0x7f52d806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:24.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.602+0000 7f52d37fe700 1 -- 172.21.15.42:0/1861656491 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7022+0+0 (secure 0 0 0) 0x7f52dc088d10 con 0x7f52ec0c2100 2023-07-29T02:02:24.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.602+0000 7f52eaffd700 1 --2- 172.21.15.42:0/1861656491 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f52d806a660 0x7f52d806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:24.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.602+0000 7f52eaffd700 1 --2- 172.21.15.42:0/1861656491 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f52d806a660 0x7f52d806cb10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f52e0000c00 tx=0x7f52e001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:24.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.606+0000 7f52d37fe700 1 -- 172.21.15.42:0/1861656491 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f52dc053cc0 con 0x7f52ec0c2100 2023-07-29T02:02:24.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.853+0000 7f52f16ab700 1 -- 172.21.15.42:0/1861656491 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52ec0c2df0 con 0x7f52ec0c2100 2023-07-29T02:02:24.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.853+0000 7f52d37fe700 1 -- 172.21.15.42:0/1861656491 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+5408 (secure 0 0 0) 0x7f52dc0572e0 con 0x7f52ec0c2100 2023-07-29T02:02:24.839 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:02:24.839 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:02:24.416245+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5142":{"gid":5142,"name":"e","rank":0,"incarnation":16,"state":"up:replay","state_seq":1,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:02:24.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.855+0000 7f52f16ab700 1 -- 172.21.15.42:0/1861656491 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f52d806a660 msgr2=0x7f52d806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:24.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.855+0000 7f52f16ab700 1 --2- 172.21.15.42:0/1861656491 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f52d806a660 0x7f52d806cb10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f52e0000c00 tx=0x7f52e001c040 comp rx=0 tx=0).stop 2023-07-29T02:02:24.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.855+0000 7f52f16ab700 1 -- 172.21.15.42:0/1861656491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52ec0c2100 msgr2=0x7f52ec0c5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.855+0000 7f52f16ab700 1 --2- 172.21.15.42:0/1861656491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52ec0c2100 0x7f52ec0c5ac0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00e810 tx=0x7f52dc00eb20 comp rx=0 tx=0).stop 2023-07-29T02:02:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.855+0000 7f52f16ab700 1 -- 172.21.15.42:0/1861656491 shutdown_connections 2023-07-29T02:02:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.855+0000 7f52f16ab700 1 --2- 172.21.15.42:0/1861656491 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f52d806a660 0x7f52d806cb10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.855+0000 7f52f16ab700 1 --2- 172.21.15.42:0/1861656491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52ec0c24d0 0x7f52ec1499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.855+0000 7f52f16ab700 1 --2- 172.21.15.42:0/1861656491 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52ec072900 0x7f52ec1e16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.855+0000 7f52f16ab700 1 --2- 172.21.15.42:0/1861656491 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52ec0c2100 0x7f52ec0c5ac0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:24.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.855+0000 7f52f16ab700 1 -- 172.21.15.42:0/1861656491 >> 172.21.15.42:0/1861656491 conn(0x7f52ec06f850 msgr2=0x7f52ec0cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:24.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.855+0000 7f52f16ab700 1 -- 172.21.15.42:0/1861656491 shutdown_connections 2023-07-29T02:02:24.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:24.856+0000 7f52f16ab700 1 -- 172.21.15.42:0/1861656491 wait complete. 2023-07-29T02:02:24.843 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 16 2023-07-29T02:02:24.854 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 16, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-07-29T01:59:57.946839+0000", "damaged": [], "data_pools": [ 4, 5 ], "enabled": true, "epoch": 16, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_5142": { "addr": "172.21.15.42:6837/2695599859", "addrs": { "addrvec": [ { "addr": "172.21.15.42:6836", "nonce": 2695599859, "type": "v2" }, { "addr": "172.21.15.42:6837", "nonce": 2695599859, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5142, "incarnation": 16, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 3, "modified": "2023-07-29T02:02:24.416245+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5142 } } } ], "standbys": [ { "addr": "172.21.15.42:6833/3242692321", "addrs": { "addrvec": [ { "addr": "172.21.15.42:6832", "nonce": 3242692321, "type": "v2" }, { "addr": "172.21.15.42:6833", "nonce": 3242692321, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4263, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.42:6835/1860885615", "addrs": { "addrvec": [ { "addr": "172.21.15.42:6834", "nonce": 1860885615, "type": "v2" }, { "addr": "172.21.15.42:6835", "nonce": 1860885615, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4266, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.144:6835/400694688", "addrs": { "addrvec": [ { "addr": "172.21.15.144:6834", "nonce": 400694688, "type": "v2" }, { "addr": "172.21.15.144:6835", "nonce": 400694688, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4291, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.144:6838/2604441175", "addrs": { "addrvec": [ { "addr": "172.21.15.144:6836", "nonce": 2604441175, "type": "v2" }, { "addr": "172.21.15.144:6838", "nonce": 2604441175, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4294, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-07-29T02:02:26.855 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:02:26.995 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.009+0000 7f166201b700 1 Processor -- start 2023-07-29T02:02:26.995 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.009+0000 7f166201b700 1 -- start start 2023-07-29T02:02:26.998 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f166201b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f165c14ca00 0x7f165c06c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:26.998 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f166201b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f165c0c7270 0x7f165c06d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:26.998 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f166201b700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f165c06ce40 con 0x7f165c14c630 2023-07-29T02:02:26.998 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f166201b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165c155d50 con 0x7f165c0c7270 2023-07-29T02:02:26.998 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f166201b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165c156010 con 0x7f165c14ca00 2023-07-29T02:02:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f165b7fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f165c14c630 0x7f165c0c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51464/0 (socket says 172.21.15.42:51464) 2023-07-29T02:02:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f165b7fe700 1 -- 172.21.15.42:0/1948441508 learned_addr learned my addr 172.21.15.42:0/1948441508 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:02:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f165affd700 1 --2- 172.21.15.42:0/1948441508 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f165c14ca00 0x7f165c06c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f165bfff700 1 --2- 172.21.15.42:0/1948441508 >> v2:172.21.15.144:3300/0 conn(0x7f165c0c7270 0x7f165c06d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f165a7fc700 1 -- 172.21.15.42:0/1948441508 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982949352 0 0) 0x7f165c06ce40 con 0x7f165c14c630 2023-07-29T02:02:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f165a7fc700 1 -- 172.21.15.42:0/1948441508 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16440035b0 con 0x7f165c14c630 2023-07-29T02:02:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f165a7fc700 1 -- 172.21.15.42:0/1948441508 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2355066064 0 0) 0x7f16440035b0 con 0x7f165c14c630 2023-07-29T02:02:26.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f165a7fc700 1 -- 172.21.15.42:0/1948441508 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f165c14ca00 msgr2=0x7f165c06c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f165a7fc700 1 --2- 172.21.15.42:0/1948441508 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f165c14ca00 0x7f165c06c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f165a7fc700 1 -- 172.21.15.42:0/1948441508 >> v2:172.21.15.144:3300/0 conn(0x7f165c0c7270 msgr2=0x7f165c06d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f165a7fc700 1 --2- 172.21.15.42:0/1948441508 >> v2:172.21.15.144:3300/0 conn(0x7f165c0c7270 0x7f165c06d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f165a7fc700 1 -- 172.21.15.42:0/1948441508 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c1562f0 con 0x7f165c14c630 2023-07-29T02:02:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f165a7fc700 1 -- 172.21.15.42:0/1948441508 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7f1650001670 con 0x7f165c14c630 2023-07-29T02:02:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f165a7fc700 1 -- 172.21.15.42:0/1948441508 >> v1:172.21.15.42:6789/0 conn(0x7f165c14c630 legacy=0x7f165c0c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:27.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f165a7fc700 1 --2- 172.21.15.42:0/1948441508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1644003a00 0x7f1644003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f165a7fc700 1 --2- 172.21.15.42:0/1948441508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1644004430 0x7f16440048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f165a7fc700 1 --2- 172.21.15.42:0/1948441508 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1644004f60 0x7f164400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f165a7fc700 1 -- 172.21.15.42:0/1948441508 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c155d50 con 0x7f1644003a00 2023-07-29T02:02:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f165a7fc700 1 -- 172.21.15.42:0/1948441508 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c156010 con 0x7f1644004430 2023-07-29T02:02:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.010+0000 7f165a7fc700 1 -- 172.21.15.42:0/1948441508 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1644005610 con 0x7f1644004f60 2023-07-29T02:02:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.011+0000 7f165b7fe700 1 --2- 172.21.15.42:0/1948441508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1644003a00 0x7f1644003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.011+0000 7f165affd700 1 --2- 172.21.15.42:0/1948441508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1644004430 0x7f16440048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:27.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.011+0000 7f165bfff700 1 --2- 172.21.15.42:0/1948441508 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1644004f60 0x7f164400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.011+0000 7f165b7fe700 1 -- 172.21.15.42:0/1948441508 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1644004f60 msgr2=0x7f164400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.011+0000 7f165b7fe700 1 --2- 172.21.15.42:0/1948441508 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f1644004f60 0x7f164400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.011+0000 7f165b7fe700 1 -- 172.21.15.42:0/1948441508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1644004430 msgr2=0x7f16440048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.011+0000 7f165b7fe700 1 --2- 172.21.15.42:0/1948441508 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1644004430 0x7f16440048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.011+0000 7f165b7fe700 1 -- 172.21.15.42:0/1948441508 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16440035b0 con 0x7f1644003a00 2023-07-29T02:02:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.011+0000 7f165b7fe700 1 --2- 172.21.15.42:0/1948441508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1644003a00 0x7f1644003e10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f165000c320 tx=0x7f1644005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ec23ab4486dc5d server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:27.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.011+0000 7f165a7fc700 1 -- 172.21.15.42:0/1948441508 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165000ce60 con 0x7f1644003a00 2023-07-29T02:02:27.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.011+0000 7f165a7fc700 1 -- 172.21.15.42:0/1948441508 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1650005960 con 0x7f1644003a00 2023-07-29T02:02:27.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.011+0000 7f165a7fc700 1 -- 172.21.15.42:0/1948441508 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650005d10 con 0x7f1644003a00 2023-07-29T02:02:27.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.012+0000 7f166201b700 1 -- 172.21.15.42:0/1948441508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1644003a00 msgr2=0x7f1644003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:27.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.012+0000 7f166201b700 1 --2- 172.21.15.42:0/1948441508 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1644003a00 0x7f1644003e10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f165000c320 tx=0x7f1644005880 comp rx=0 tx=0).stop 2023-07-29T02:02:27.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.012+0000 7f165bfff700 1 -- 172.21.15.42:0/1948441508 reap_dead start 2023-07-29T02:02:27.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.012+0000 7f166201b700 1 -- 172.21.15.42:0/1948441508 shutdown_connections 2023-07-29T02:02:27.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.012+0000 7f166201b700 1 -- 172.21.15.42:0/1948441508 >> 172.21.15.42:0/1948441508 conn(0x7f165c0c8970 msgr2=0x7f165c0c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:27.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.012+0000 7f166201b700 1 -- 172.21.15.42:0/1948441508 shutdown_connections 2023-07-29T02:02:27.004 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.012+0000 7f166201b700 1 -- 172.21.15.42:0/1948441508 wait complete. 2023-07-29T02:02:27.006 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.013+0000 7f166201b700 1 Processor -- start 2023-07-29T02:02:27.006 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.013+0000 7f166201b700 1 -- start start 2023-07-29T02:02:27.006 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.014+0000 7f166201b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1644003a00 0x7f165c1f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:27.006 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.014+0000 7f166201b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f165c1df9f0 0x7f165c1ef290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:27.006 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.014+0000 7f166201b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f165c0c3f40 0x7f165c0ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:27.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.014+0000 7f166201b700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c155760 con 0x7f1644003a00 2023-07-29T02:02:27.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.014+0000 7f166201b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165c155a40 con 0x7f165c0c3f40 2023-07-29T02:02:27.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.014+0000 7f166201b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165c1eea90 con 0x7f165c1df9f0 2023-07-29T02:02:27.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.014+0000 7f165b7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1644003a00 0x7f165c1f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:27.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.014+0000 7f165b7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1644003a00 0x7f165c1f2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57672/0 (socket says 172.21.15.42:57672) 2023-07-29T02:02:27.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.014+0000 7f165b7fe700 1 -- 172.21.15.42:0/255245336 learned_addr learned my addr 172.21.15.42:0/255245336 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:27.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.014+0000 7f165bfff700 1 --2- 172.21.15.42:0/255245336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f165c0c3f40 0x7f165c0ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:27.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.014+0000 7f165affd700 1 --2- 172.21.15.42:0/255245336 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f165c1df9f0 0x7f165c1ef290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:27.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.014+0000 7f165b7fe700 1 -- 172.21.15.42:0/255245336 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f165c1df9f0 msgr2=0x7f165c1ef290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:27.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.014+0000 7f165b7fe700 1 --2- 172.21.15.42:0/255245336 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f165c1df9f0 0x7f165c1ef290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:27.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.014+0000 7f165b7fe700 1 -- 172.21.15.42:0/255245336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f165c0c3f40 msgr2=0x7f165c0ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:27.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.014+0000 7f165b7fe700 1 --2- 172.21.15.42:0/255245336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f165c0c3f40 0x7f165c0ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:27.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.015+0000 7f165b7fe700 1 -- 172.21.15.42:0/255245336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c1eed70 con 0x7f1644003a00 2023-07-29T02:02:27.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.015+0000 7f165bfff700 1 --2- 172.21.15.42:0/255245336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f165c0c3f40 0x7f165c0ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:02:27.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.015+0000 7f165b7fe700 1 --2- 172.21.15.42:0/255245336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1644003a00 0x7f165c1f2690 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1644005560 tx=0x7f1650001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:27.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.015+0000 7f1643fff700 1 -- 172.21.15.42:0/255245336 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650001680 con 0x7f1644003a00 2023-07-29T02:02:27.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.015+0000 7f1643fff700 1 -- 172.21.15.42:0/255245336 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1650004a80 con 0x7f1644003a00 2023-07-29T02:02:27.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.015+0000 7f166201b700 1 -- 172.21.15.42:0/255245336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f165c1ee740 con 0x7f1644003a00 2023-07-29T02:02:27.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.015+0000 7f1643fff700 1 -- 172.21.15.42:0/255245336 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650004e30 con 0x7f1644003a00 2023-07-29T02:02:27.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.015+0000 7f166201b700 1 -- 172.21.15.42:0/255245336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165c0ca1b0 con 0x7f1644003a00 2023-07-29T02:02:27.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.016+0000 7f166201b700 1 -- 172.21.15.42:0/255245336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f165c1ee900 con 0x7f1644003a00 2023-07-29T02:02:27.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.016+0000 7f1643fff700 1 -- 172.21.15.42:0/255245336 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f16500070d0 con 0x7f1644003a00 2023-07-29T02:02:27.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.017+0000 7f1643fff700 1 --2- 172.21.15.42:0/255245336 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f164806a690 0x7f164806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:27.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.017+0000 7f1643fff700 1 -- 172.21.15.42:0/255245336 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7022+0+0 (secure 0 0 0) 0x7f165008a120 con 0x7f1644003a00 2023-07-29T02:02:27.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.017+0000 7f165affd700 1 --2- 172.21.15.42:0/255245336 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f164806a690 0x7f164806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:27.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.017+0000 7f165affd700 1 --2- 172.21.15.42:0/255245336 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f164806a690 0x7f164806cb40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f165c0c5c40 tx=0x7f164c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:27.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.021+0000 7f1643fff700 1 -- 172.21.15.42:0/255245336 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f16500552b0 con 0x7f1644003a00 2023-07-29T02:02:27.252 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.267+0000 7f166201b700 1 -- 172.21.15.42:0/255245336 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f165c074740 con 0x7f1644003a00 2023-07-29T02:02:27.253 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.267+0000 7f1643fff700 1 -- 172.21.15.42:0/255245336 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+5408 (secure 0 0 0) 0x7f1650007da0 con 0x7f1644003a00 2023-07-29T02:02:27.253 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:02:27.253 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:02:24.416245+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5142":{"gid":5142,"name":"e","rank":0,"incarnation":16,"state":"up:replay","state_seq":1,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:02:27.255 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.270+0000 7f166201b700 1 -- 172.21.15.42:0/255245336 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f164806a690 msgr2=0x7f164806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:27.255 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.270+0000 7f166201b700 1 --2- 172.21.15.42:0/255245336 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f164806a690 0x7f164806cb40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f165c0c5c40 tx=0x7f164c008040 comp rx=0 tx=0).stop 2023-07-29T02:02:27.256 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.270+0000 7f166201b700 1 -- 172.21.15.42:0/255245336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1644003a00 msgr2=0x7f165c1f2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:27.256 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.270+0000 7f166201b700 1 --2- 172.21.15.42:0/255245336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1644003a00 0x7f165c1f2690 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1644005560 tx=0x7f1650001a00 comp rx=0 tx=0).stop 2023-07-29T02:02:27.256 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.270+0000 7f166201b700 1 -- 172.21.15.42:0/255245336 shutdown_connections 2023-07-29T02:02:27.256 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.270+0000 7f166201b700 1 --2- 172.21.15.42:0/255245336 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f164806a690 0x7f164806cb40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:27.256 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.270+0000 7f166201b700 1 --2- 172.21.15.42:0/255245336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f165c0c3f40 0x7f165c0ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:27.256 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.270+0000 7f166201b700 1 --2- 172.21.15.42:0/255245336 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f1644003a00 0x7f165c1f2690 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:27.257 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.270+0000 7f166201b700 1 --2- 172.21.15.42:0/255245336 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f165c1df9f0 0x7f165c1ef290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:27.257 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.270+0000 7f166201b700 1 -- 172.21.15.42:0/255245336 >> 172.21.15.42:0/255245336 conn(0x7f165c0c8970 msgr2=0x7f165c0c5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:27.257 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.270+0000 7f166201b700 1 -- 172.21.15.42:0/255245336 shutdown_connections 2023-07-29T02:02:27.258 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:27.270+0000 7f166201b700 1 -- 172.21.15.42:0/255245336 wait complete. 2023-07-29T02:02:27.258 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 16 2023-07-29T02:02:27.267 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2023-07-29T02:02:29.269 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:02:29.409 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.423+0000 7f48a65a9700 1 Processor -- start 2023-07-29T02:02:29.418 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.423+0000 7f48a65a9700 1 -- start start 2023-07-29T02:02:29.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.424+0000 7f48a65a9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48a0153410 0x7f48a00c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:29.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.424+0000 7f48a65a9700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a01537e0 con 0x7f48a0061520 2023-07-29T02:02:29.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.424+0000 7f48a65a9700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a006b220 con 0x7f48a00c73b0 2023-07-29T02:02:29.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.424+0000 7f48a65a9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a015d5d0 con 0x7f48a0153410 2023-07-29T02:02:29.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.424+0000 7f48a4b46700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f48a0061520 0x7f48a01639a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51496/0 (socket says 172.21.15.42:51496) 2023-07-29T02:02:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.425+0000 7f48a4b46700 1 -- 172.21.15.42:0/4256250452 learned_addr learned my addr 172.21.15.42:0/4256250452 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:02:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.425+0000 7f489ffff700 1 --2- 172.21.15.42:0/4256250452 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48a0153410 0x7f48a00c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.425+0000 7f489effd700 1 -- 172.21.15.42:0/4256250452 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 489109543 0 0) 0x7f48a01537e0 con 0x7f48a0061520 2023-07-29T02:02:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.425+0000 7f489effd700 1 -- 172.21.15.42:0/4256250452 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48880035b0 con 0x7f48a0061520 2023-07-29T02:02:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.425+0000 7f489effd700 1 -- 172.21.15.42:0/4256250452 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492305219 0 0) 0x7f48a006b220 con 0x7f48a00c73b0 2023-07-29T02:02:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.425+0000 7f489effd700 1 -- 172.21.15.42:0/4256250452 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48a01537e0 con 0x7f48a00c73b0 2023-07-29T02:02:29.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.425+0000 7f489ffff700 1 -- 172.21.15.42:0/4256250452 >> v1:172.21.15.144:6789/0 conn(0x7f48a00c73b0 legacy=0x7f48a015c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.425+0000 7f489ffff700 1 -- 172.21.15.42:0/4256250452 >> v1:172.21.15.42:6789/0 conn(0x7f48a0061520 legacy=0x7f48a01639a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.425+0000 7f489ffff700 1 -- 172.21.15.42:0/4256250452 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a015d2f0 con 0x7f48a0153410 2023-07-29T02:02:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.425+0000 7f489ffff700 1 --2- 172.21.15.42:0/4256250452 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48a0153410 0x7f48a00c5ee0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4890009870 tx=0x7f4890009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69a95e3bb62f6453 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.425+0000 7f489effd700 1 -- 172.21.15.42:0/4256250452 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890011830 con 0x7f48a0153410 2023-07-29T02:02:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.425+0000 7f489effd700 1 -- 172.21.15.42:0/4256250452 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4890011990 con 0x7f48a0153410 2023-07-29T02:02:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.425+0000 7f489effd700 1 -- 172.21.15.42:0/4256250452 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890011d20 con 0x7f48a0153410 2023-07-29T02:02:29.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.426+0000 7f48a65a9700 1 -- 172.21.15.42:0/4256250452 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48a0153410 msgr2=0x7f48a00c5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:29.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.426+0000 7f48a65a9700 1 --2- 172.21.15.42:0/4256250452 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48a0153410 0x7f48a00c5ee0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4890009870 tx=0x7f4890009b80 comp rx=0 tx=0).stop 2023-07-29T02:02:29.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.426+0000 7f48a65a9700 1 -- 172.21.15.42:0/4256250452 shutdown_connections 2023-07-29T02:02:29.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.426+0000 7f48a65a9700 1 --2- 172.21.15.42:0/4256250452 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48a0153410 0x7f48a00c5ee0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:29.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.426+0000 7f48a65a9700 1 -- 172.21.15.42:0/4256250452 >> 172.21.15.42:0/4256250452 conn(0x7f48a00c80e0 msgr2=0x7f48a00c84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:29.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.426+0000 7f48a65a9700 1 -- 172.21.15.42:0/4256250452 shutdown_connections 2023-07-29T02:02:29.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.426+0000 7f48a65a9700 1 -- 172.21.15.42:0/4256250452 wait complete. 2023-07-29T02:02:29.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.428+0000 7f48a65a9700 1 Processor -- start 2023-07-29T02:02:29.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.428+0000 7f48a65a9700 1 -- start start 2023-07-29T02:02:29.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.429+0000 7f48a65a9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48a0061520 0x7f48a01f6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:29.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.429+0000 7f48a65a9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48a00c73b0 0x7f48a00c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:29.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.429+0000 7f48a65a9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48a0153410 0x7f48a00bf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:29.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.429+0000 7f48a65a9700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a00bdfd0 con 0x7f48a0061520 2023-07-29T02:02:29.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.429+0000 7f48a65a9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a00c5a00 con 0x7f48a0153410 2023-07-29T02:02:29.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.429+0000 7f48a65a9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a00c4ea0 con 0x7f48a00c73b0 2023-07-29T02:02:29.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.430+0000 7f489ffff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48a0061520 0x7f48a01f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:29.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.430+0000 7f489ffff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48a0061520 0x7f48a01f6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57694/0 (socket says 172.21.15.42:57694) 2023-07-29T02:02:29.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.430+0000 7f489ffff700 1 -- 172.21.15.42:0/1402585370 learned_addr learned my addr 172.21.15.42:0/1402585370 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:29.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.430+0000 7f489f7fe700 1 --2- 172.21.15.42:0/1402585370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48a00c73b0 0x7f48a00c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:29.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.430+0000 7f48a4b46700 1 --2- 172.21.15.42:0/1402585370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48a0153410 0x7f48a00bf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:29.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.430+0000 7f489ffff700 1 -- 172.21.15.42:0/1402585370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48a00c73b0 msgr2=0x7f48a00c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:29.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.430+0000 7f489ffff700 1 --2- 172.21.15.42:0/1402585370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48a00c73b0 0x7f48a00c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:29.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.430+0000 7f489ffff700 1 -- 172.21.15.42:0/1402585370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48a0153410 msgr2=0x7f48a00bf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:29.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.430+0000 7f489ffff700 1 --2- 172.21.15.42:0/1402585370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48a0153410 0x7f48a00bf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:29.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.430+0000 7f489ffff700 1 -- 172.21.15.42:0/1402585370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48900094a0 con 0x7f48a0061520 2023-07-29T02:02:29.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.430+0000 7f489ffff700 1 --2- 172.21.15.42:0/1402585370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48a0061520 0x7f48a01f6990 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f48900090b0 tx=0x7f4890004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:29.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.430+0000 7f489cff9700 1 -- 172.21.15.42:0/1402585370 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890024620 con 0x7f48a0061520 2023-07-29T02:02:29.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.430+0000 7f489cff9700 1 -- 172.21.15.42:0/1402585370 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4890024780 con 0x7f48a0061520 2023-07-29T02:02:29.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.430+0000 7f489cff9700 1 -- 172.21.15.42:0/1402585370 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890024b10 con 0x7f48a0061520 2023-07-29T02:02:29.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.430+0000 7f48a65a9700 1 -- 172.21.15.42:0/1402585370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a00c5160 con 0x7f48a0061520 2023-07-29T02:02:29.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.430+0000 7f48a65a9700 1 -- 172.21.15.42:0/1402585370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a00c5720 con 0x7f48a0061520 2023-07-29T02:02:29.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.432+0000 7f48a65a9700 1 -- 172.21.15.42:0/1402585370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a004ea50 con 0x7f48a0061520 2023-07-29T02:02:29.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.432+0000 7f489cff9700 1 -- 172.21.15.42:0/1402585370 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f4890022070 con 0x7f48a0061520 2023-07-29T02:02:29.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.432+0000 7f489cff9700 1 --2- 172.21.15.42:0/1402585370 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f488c06a660 0x7f488c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:29.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.432+0000 7f489cff9700 1 -- 172.21.15.42:0/1402585370 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7022+0+0 (secure 0 0 0) 0x7f489008a100 con 0x7f48a0061520 2023-07-29T02:02:29.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.432+0000 7f489f7fe700 1 --2- 172.21.15.42:0/1402585370 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f488c06a660 0x7f488c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:29.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.433+0000 7f489f7fe700 1 --2- 172.21.15.42:0/1402585370 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f488c06a660 0x7f488c06cb10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f48a00cb5b0 tx=0x7f4894009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:29.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.437+0000 7f489cff9700 1 -- 172.21.15.42:0/1402585370 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f48900551d0 con 0x7f48a0061520 2023-07-29T02:02:29.670 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.684+0000 7f48a65a9700 1 -- 172.21.15.42:0/1402585370 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48a0071f10 con 0x7f48a0061520 2023-07-29T02:02:29.671 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.685+0000 7f489cff9700 1 -- 172.21.15.42:0/1402585370 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+5408 (secure 0 0 0) 0x7f4890029090 con 0x7f48a0061520 2023-07-29T02:02:29.671 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:02:29.671 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:02:24.416245+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5142":{"gid":5142,"name":"e","rank":0,"incarnation":16,"state":"up:replay","state_seq":1,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:02:29.673 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.687+0000 7f48a65a9700 1 -- 172.21.15.42:0/1402585370 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f488c06a660 msgr2=0x7f488c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:29.673 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.687+0000 7f48a65a9700 1 --2- 172.21.15.42:0/1402585370 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f488c06a660 0x7f488c06cb10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f48a00cb5b0 tx=0x7f4894009040 comp rx=0 tx=0).stop 2023-07-29T02:02:29.673 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.687+0000 7f48a65a9700 1 -- 172.21.15.42:0/1402585370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48a0061520 msgr2=0x7f48a01f6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:29.673 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.687+0000 7f48a65a9700 1 --2- 172.21.15.42:0/1402585370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48a0061520 0x7f48a01f6990 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f48900090b0 tx=0x7f4890004750 comp rx=0 tx=0).stop 2023-07-29T02:02:29.673 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.687+0000 7f48a65a9700 1 -- 172.21.15.42:0/1402585370 shutdown_connections 2023-07-29T02:02:29.674 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.687+0000 7f48a65a9700 1 --2- 172.21.15.42:0/1402585370 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f488c06a660 0x7f488c06cb10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:29.674 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.687+0000 7f48a65a9700 1 --2- 172.21.15.42:0/1402585370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48a0153410 0x7f48a00bf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:29.674 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.687+0000 7f48a65a9700 1 --2- 172.21.15.42:0/1402585370 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f48a0061520 0x7f48a01f6990 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:29.674 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.687+0000 7f48a65a9700 1 --2- 172.21.15.42:0/1402585370 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f48a00c73b0 0x7f48a00c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:29.674 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.687+0000 7f48a65a9700 1 -- 172.21.15.42:0/1402585370 >> 172.21.15.42:0/1402585370 conn(0x7f48a00c80e0 msgr2=0x7f48a00706e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:29.674 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.687+0000 7f48a65a9700 1 -- 172.21.15.42:0/1402585370 shutdown_connections 2023-07-29T02:02:29.675 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:29.687+0000 7f48a65a9700 1 -- 172.21.15.42:0/1402585370 wait complete. 2023-07-29T02:02:29.675 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 16 2023-07-29T02:02:29.685 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2023-07-29T02:02:31.687 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:02:31.827 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.841+0000 7f7ac69f1700 1 Processor -- start 2023-07-29T02:02:31.827 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.841+0000 7f7ac69f1700 1 -- start start 2023-07-29T02:02:31.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.842+0000 7f7ac69f1700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7ac0151500 0x7f7ac006dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:31.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.842+0000 7f7ac69f1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ac00c7f40 0x7f7ac006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:31.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.842+0000 7f7ac69f1700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac00cd140 con 0x7f7ac006e950 2023-07-29T02:02:31.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.842+0000 7f7ac69f1700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac00c2370 con 0x7f7ac0151500 2023-07-29T02:02:31.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.842+0000 7f7ac69f1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac0156f90 con 0x7f7ac00c7f40 2023-07-29T02:02:31.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.842+0000 7f7abffff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7ac0151500 0x7f7ac006dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:31.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.842+0000 7f7abffff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7ac0151500 0x7f7ac006dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57704/0 (socket says 172.21.15.42:57704) 2023-07-29T02:02:31.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.842+0000 7f7abffff700 1 -- 172.21.15.42:0/493668989 learned_addr learned my addr 172.21.15.42:0/493668989 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:31.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.843+0000 7f7abf7fe700 1 --2- 172.21.15.42:0/493668989 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ac00c7f40 0x7f7ac006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:31.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.843+0000 7f7abffff700 1 -- 172.21.15.42:0/493668989 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ac00c7f40 msgr2=0x7f7ac006e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:31.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.843+0000 7f7abffff700 1 --2- 172.21.15.42:0/493668989 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ac00c7f40 0x7f7ac006e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:31.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.843+0000 7f7abffff700 1 -- 172.21.15.42:0/493668989 >> v1:172.21.15.144:6789/0 conn(0x7f7ac006e950 legacy=0x7f7ac0157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:31.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.843+0000 7f7abffff700 1 -- 172.21.15.42:0/493668989 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac00cd390 con 0x7f7ac0151500 2023-07-29T02:02:31.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.843+0000 7f7abffff700 1 --2- 172.21.15.42:0/493668989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac0151500 0x7f7ac006dc60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00098f0 tx=0x7f7ab0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491d418a1affe17c server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:31.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.843+0000 7f7abeffd700 1 -- 172.21.15.42:0/493668989 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab000b8a0 con 0x7f7ac0151500 2023-07-29T02:02:31.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.843+0000 7f7abeffd700 1 -- 172.21.15.42:0/493668989 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab000ba00 con 0x7f7ac0151500 2023-07-29T02:02:31.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.843+0000 7f7abeffd700 1 -- 172.21.15.42:0/493668989 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab000bd90 con 0x7f7ac0151500 2023-07-29T02:02:31.833 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.844+0000 7f7ac69f1700 1 -- 172.21.15.42:0/493668989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac0151500 msgr2=0x7f7ac006dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:31.833 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.844+0000 7f7ac69f1700 1 --2- 172.21.15.42:0/493668989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac0151500 0x7f7ac006dc60 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00098f0 tx=0x7f7ab0009c00 comp rx=0 tx=0).stop 2023-07-29T02:02:31.833 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.844+0000 7f7ac69f1700 1 -- 172.21.15.42:0/493668989 shutdown_connections 2023-07-29T02:02:31.833 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.844+0000 7f7ac69f1700 1 --2- 172.21.15.42:0/493668989 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac0151500 0x7f7ac006dc60 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:31.833 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.844+0000 7f7ac69f1700 1 --2- 172.21.15.42:0/493668989 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ac00c7f40 0x7f7ac006e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:31.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.844+0000 7f7ac69f1700 1 -- 172.21.15.42:0/493668989 >> 172.21.15.42:0/493668989 conn(0x7f7ac0061190 msgr2=0x7f7ac0061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:31.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.844+0000 7f7ac69f1700 1 -- 172.21.15.42:0/493668989 shutdown_connections 2023-07-29T02:02:31.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.844+0000 7f7ac69f1700 1 -- 172.21.15.42:0/493668989 wait complete. 2023-07-29T02:02:31.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.845+0000 7f7ac69f1700 1 Processor -- start 2023-07-29T02:02:31.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.845+0000 7f7ac69f1700 1 -- start start 2023-07-29T02:02:31.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.846+0000 7f7ac69f1700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac006e950 0x7f7ac0153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:31.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.846+0000 7f7ac69f1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ac00c7f40 0x7f7ac0159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:31.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.846+0000 7f7ac69f1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ac0151500 0x7f7ac0146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:31.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.846+0000 7f7ac69f1700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac0158df0 con 0x7f7ac006e950 2023-07-29T02:02:31.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.846+0000 7f7ac69f1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac0159b00 con 0x7f7ac0151500 2023-07-29T02:02:31.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.846+0000 7f7ac69f1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac01ef770 con 0x7f7ac00c7f40 2023-07-29T02:02:31.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.846+0000 7f7abffff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac006e950 0x7f7ac0153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:31.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.846+0000 7f7abffff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac006e950 0x7f7ac0153d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57710/0 (socket says 172.21.15.42:57710) 2023-07-29T02:02:31.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.846+0000 7f7abffff700 1 -- 172.21.15.42:0/4155355292 learned_addr learned my addr 172.21.15.42:0/4155355292 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:31.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.846+0000 7f7abf7fe700 1 --2- 172.21.15.42:0/4155355292 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ac00c7f40 0x7f7ac0159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:31.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.846+0000 7f7ac4f8e700 1 --2- 172.21.15.42:0/4155355292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ac0151500 0x7f7ac0146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:31.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.846+0000 7f7abffff700 1 -- 172.21.15.42:0/4155355292 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ac00c7f40 msgr2=0x7f7ac0159f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:31.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.846+0000 7f7abffff700 1 --2- 172.21.15.42:0/4155355292 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ac00c7f40 0x7f7ac0159f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:31.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.846+0000 7f7abffff700 1 -- 172.21.15.42:0/4155355292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ac0151500 msgr2=0x7f7ac0146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:31.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.846+0000 7f7abffff700 1 --2- 172.21.15.42:0/4155355292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ac0151500 0x7f7ac0146990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:31.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.846+0000 7f7abffff700 1 -- 172.21.15.42:0/4155355292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab0009550 con 0x7f7ac006e950 2023-07-29T02:02:31.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.846+0000 7f7ac4f8e700 1 --2- 172.21.15.42:0/4155355292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ac0151500 0x7f7ac0146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:02:31.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.846+0000 7f7abffff700 1 --2- 172.21.15.42:0/4155355292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac006e950 0x7f7ac0153d40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0009c40 tx=0x7f7ab0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:31.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.847+0000 7f7abcff9700 1 -- 172.21.15.42:0/4155355292 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00044d0 con 0x7f7ac006e950 2023-07-29T02:02:31.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.847+0000 7f7abcff9700 1 -- 172.21.15.42:0/4155355292 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab001e070 con 0x7f7ac006e950 2023-07-29T02:02:31.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.847+0000 7f7ac69f1700 1 -- 172.21.15.42:0/4155355292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac0158870 con 0x7f7ac006e950 2023-07-29T02:02:31.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.847+0000 7f7abcff9700 1 -- 172.21.15.42:0/4155355292 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab00038e0 con 0x7f7ac006e950 2023-07-29T02:02:31.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.847+0000 7f7ac69f1700 1 -- 172.21.15.42:0/4155355292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac0159790 con 0x7f7ac006e950 2023-07-29T02:02:31.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.848+0000 7f7ac69f1700 1 -- 172.21.15.42:0/4155355292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac01595f0 con 0x7f7ac006e950 2023-07-29T02:02:31.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.848+0000 7f7abcff9700 1 -- 172.21.15.42:0/4155355292 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f7ab0003a40 con 0x7f7ac006e950 2023-07-29T02:02:31.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.848+0000 7f7abcff9700 1 --2- 172.21.15.42:0/4155355292 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7aa006a660 0x7f7aa006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:31.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.849+0000 7f7abcff9700 1 -- 172.21.15.42:0/4155355292 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7022+0+0 (secure 0 0 0) 0x7f7ab0020070 con 0x7f7ac006e950 2023-07-29T02:02:31.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.849+0000 7f7abf7fe700 1 --2- 172.21.15.42:0/4155355292 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7aa006a660 0x7f7aa006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:31.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.850+0000 7f7abf7fe700 1 --2- 172.21.15.42:0/4155355292 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7aa006a660 0x7f7aa006cb10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00cb710 tx=0x7f7aa8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:31.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:31.853+0000 7f7abcff9700 1 -- 172.21.15.42:0/4155355292 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f7ac01595f0 con 0x7f7ac006e950 2023-07-29T02:02:32.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:32.096+0000 7f7ac69f1700 1 -- 172.21.15.42:0/4155355292 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ac01595f0 con 0x7f7ac006e950 2023-07-29T02:02:32.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:32.096+0000 7f7abcff9700 1 -- 172.21.15.42:0/4155355292 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5412 (secure 0 0 0) 0x7f7ac01595f0 con 0x7f7ac006e950 2023-07-29T02:02:32.084 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:02:32.085 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:02:30.418288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5142":{"gid":5142,"name":"e","rank":0,"incarnation":16,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:02:32.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:32.098+0000 7f7ac69f1700 1 -- 172.21.15.42:0/4155355292 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7aa006a660 msgr2=0x7f7aa006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:32.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:32.098+0000 7f7ac69f1700 1 --2- 172.21.15.42:0/4155355292 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7aa006a660 0x7f7aa006cb10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00cb710 tx=0x7f7aa8008040 comp rx=0 tx=0).stop 2023-07-29T02:02:32.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:32.098+0000 7f7ac69f1700 1 -- 172.21.15.42:0/4155355292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac006e950 msgr2=0x7f7ac0153d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:32.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:32.098+0000 7f7ac69f1700 1 --2- 172.21.15.42:0/4155355292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac006e950 0x7f7ac0153d40 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0009c40 tx=0x7f7ab0004750 comp rx=0 tx=0).stop 2023-07-29T02:02:32.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:32.098+0000 7f7ac69f1700 1 -- 172.21.15.42:0/4155355292 shutdown_connections 2023-07-29T02:02:32.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:32.098+0000 7f7ac69f1700 1 --2- 172.21.15.42:0/4155355292 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7aa006a660 0x7f7aa006cb10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:32.086 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:32.098+0000 7f7ac69f1700 1 --2- 172.21.15.42:0/4155355292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7ac0151500 0x7f7ac0146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:32.087 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:32.098+0000 7f7ac69f1700 1 --2- 172.21.15.42:0/4155355292 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7ac006e950 0x7f7ac0153d40 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:32.087 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:32.098+0000 7f7ac69f1700 1 --2- 172.21.15.42:0/4155355292 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7ac00c7f40 0x7f7ac0159f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:32.087 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:32.098+0000 7f7ac69f1700 1 -- 172.21.15.42:0/4155355292 >> 172.21.15.42:0/4155355292 conn(0x7f7ac0061190 msgr2=0x7f7ac00ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:32.087 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:32.098+0000 7f7ac69f1700 1 -- 172.21.15.42:0/4155355292 shutdown_connections 2023-07-29T02:02:32.087 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:32.098+0000 7f7ac69f1700 1 -- 172.21.15.42:0/4155355292 wait complete. 2023-07-29T02:02:32.087 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 17 2023-07-29T02:02:32.096 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2023-07-29T02:02:34.099 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:02:34.239 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.253+0000 7f62e6ae0700 1 Processor -- start 2023-07-29T02:02:34.239 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.253+0000 7f62e6ae0700 1 -- start start 2023-07-29T02:02:34.241 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.254+0000 7f62e6ae0700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f62e0153660 0x7f62e006d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:34.241 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.254+0000 7f62e6ae0700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f62e015a780 0x7f62e0159d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:34.241 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.254+0000 7f62e6ae0700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e015a2d0 con 0x7f62e006b860 2023-07-29T02:02:34.242 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.254+0000 7f62e6ae0700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e015aba0 con 0x7f62e0153660 2023-07-29T02:02:34.242 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.254+0000 7f62e6ae0700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e006ed10 con 0x7f62e015a780 2023-07-29T02:02:34.242 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.254+0000 7f62e487c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f62e0153660 0x7f62e006d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:34.242 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.254+0000 7f62e487c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f62e0153660 0x7f62e006d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57718/0 (socket says 172.21.15.42:57718) 2023-07-29T02:02:34.242 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.254+0000 7f62e487c700 1 -- 172.21.15.42:0/3337281041 learned_addr learned my addr 172.21.15.42:0/3337281041 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:34.242 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.255+0000 7f62e487c700 1 -- 172.21.15.42:0/3337281041 >> v2:172.21.15.144:3300/0 conn(0x7f62e015a780 msgr2=0x7f62e0159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:34.242 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.255+0000 7f62e507d700 1 --2- 172.21.15.42:0/3337281041 >> v2:172.21.15.144:3300/0 conn(0x7f62e015a780 0x7f62e0159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:34.243 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.255+0000 7f62e487c700 1 --2- 172.21.15.42:0/3337281041 >> v2:172.21.15.144:3300/0 conn(0x7f62e015a780 0x7f62e0159d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:34.243 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.255+0000 7f62e487c700 1 -- 172.21.15.42:0/3337281041 >> v1:172.21.15.144:6789/0 conn(0x7f62e006b860 legacy=0x7f62e00cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:34.243 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.255+0000 7f62e487c700 1 -- 172.21.15.42:0/3337281041 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e00b28b0 con 0x7f62e0153660 2023-07-29T02:02:34.243 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.255+0000 7f62e487c700 1 --2- 172.21.15.42:0/3337281041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62e0153660 0x7f62e006d590 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f62e00cdc60 tx=0x7f62d4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204452d7ca24dd30 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:34.243 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.255+0000 7f62df7fe700 1 -- 172.21.15.42:0/3337281041 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d4004230 con 0x7f62e0153660 2023-07-29T02:02:34.243 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.255+0000 7f62df7fe700 1 -- 172.21.15.42:0/3337281041 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d4004390 con 0x7f62e0153660 2023-07-29T02:02:34.243 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.255+0000 7f62df7fe700 1 -- 172.21.15.42:0/3337281041 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d40036a0 con 0x7f62e0153660 2023-07-29T02:02:34.243 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.256+0000 7f62e6ae0700 1 -- 172.21.15.42:0/3337281041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62e0153660 msgr2=0x7f62e006d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:34.244 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.256+0000 7f62e6ae0700 1 --2- 172.21.15.42:0/3337281041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62e0153660 0x7f62e006d590 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f62e00cdc60 tx=0x7f62d4009bd0 comp rx=0 tx=0).stop 2023-07-29T02:02:34.244 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.256+0000 7f62e6ae0700 1 -- 172.21.15.42:0/3337281041 shutdown_connections 2023-07-29T02:02:34.244 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.256+0000 7f62e6ae0700 1 --2- 172.21.15.42:0/3337281041 >> v2:172.21.15.144:3300/0 conn(0x7f62e015a780 0x7f62e0159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:34.244 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.256+0000 7f62e6ae0700 1 --2- 172.21.15.42:0/3337281041 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62e0153660 0x7f62e006d590 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:34.244 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.256+0000 7f62e6ae0700 1 -- 172.21.15.42:0/3337281041 >> 172.21.15.42:0/3337281041 conn(0x7f62e0061190 msgr2=0x7f62e0061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:34.244 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.256+0000 7f62e6ae0700 1 -- 172.21.15.42:0/3337281041 shutdown_connections 2023-07-29T02:02:34.244 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.256+0000 7f62e6ae0700 1 -- 172.21.15.42:0/3337281041 wait complete. 2023-07-29T02:02:34.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.257+0000 7f62e6ae0700 1 Processor -- start 2023-07-29T02:02:34.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.257+0000 7f62e6ae0700 1 -- start start 2023-07-29T02:02:34.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.258+0000 7f62e6ae0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62e006b860 0x7f62e00aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:34.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.258+0000 7f62e6ae0700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62e0153660 0x7f62e0154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:34.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.258+0000 7f62e6ae0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62e015a780 0x7f62e01546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:34.247 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.258+0000 7f62e6ae0700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e0155620 con 0x7f62e0153660 2023-07-29T02:02:34.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.258+0000 7f62e6ae0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e014cc90 con 0x7f62e006b860 2023-07-29T02:02:34.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.258+0000 7f62e6ae0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e015c3f0 con 0x7f62e015a780 2023-07-29T02:02:34.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.258+0000 7f62dffff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62e0153660 0x7f62e0154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:34.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.258+0000 7f62dffff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62e0153660 0x7f62e0154170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57726/0 (socket says 172.21.15.42:57726) 2023-07-29T02:02:34.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.258+0000 7f62dffff700 1 -- 172.21.15.42:0/1421003639 learned_addr learned my addr 172.21.15.42:0/1421003639 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:34.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.258+0000 7f62e507d700 1 --2- 172.21.15.42:0/1421003639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62e015a780 0x7f62e01546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:34.248 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.258+0000 7f62e487c700 1 --2- 172.21.15.42:0/1421003639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62e006b860 0x7f62e00aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:34.249 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.258+0000 7f62dffff700 1 -- 172.21.15.42:0/1421003639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62e015a780 msgr2=0x7f62e01546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:34.249 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.258+0000 7f62dffff700 1 --2- 172.21.15.42:0/1421003639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62e015a780 0x7f62e01546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:34.249 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.258+0000 7f62dffff700 1 -- 172.21.15.42:0/1421003639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62e006b860 msgr2=0x7f62e00aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:34.249 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.258+0000 7f62dffff700 1 --2- 172.21.15.42:0/1421003639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62e006b860 0x7f62e00aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:34.249 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.258+0000 7f62dffff700 1 -- 172.21.15.42:0/1421003639 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d4009550 con 0x7f62e0153660 2023-07-29T02:02:34.249 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.259+0000 7f62dffff700 1 --2- 172.21.15.42:0/1421003639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62e0153660 0x7f62e0154170 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f62cc00b4a0 tx=0x7f62cc00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:34.249 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.259+0000 7f62dd7fa700 1 -- 172.21.15.42:0/1421003639 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc011620 con 0x7f62e0153660 2023-07-29T02:02:34.249 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.259+0000 7f62dd7fa700 1 -- 172.21.15.42:0/1421003639 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62cc0117a0 con 0x7f62e0153660 2023-07-29T02:02:34.250 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.259+0000 7f62e6ae0700 1 -- 172.21.15.42:0/1421003639 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e01ef770 con 0x7f62e0153660 2023-07-29T02:02:34.250 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.259+0000 7f62dd7fa700 1 -- 172.21.15.42:0/1421003639 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc011b50 con 0x7f62e0153660 2023-07-29T02:02:34.250 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.259+0000 7f62e6ae0700 1 -- 172.21.15.42:0/1421003639 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e015c110 con 0x7f62e0153660 2023-07-29T02:02:34.250 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.260+0000 7f62e6ae0700 1 -- 172.21.15.42:0/1421003639 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e0153e90 con 0x7f62e0153660 2023-07-29T02:02:34.250 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.261+0000 7f62dd7fa700 1 -- 172.21.15.42:0/1421003639 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f62cc011d00 con 0x7f62e0153660 2023-07-29T02:02:34.250 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.261+0000 7f62dd7fa700 1 --2- 172.21.15.42:0/1421003639 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f62c406a690 0x7f62c406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:34.250 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.261+0000 7f62dd7fa700 1 -- 172.21.15.42:0/1421003639 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7022+0+0 (secure 0 0 0) 0x7f62cc088d40 con 0x7f62e0153660 2023-07-29T02:02:34.250 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.261+0000 7f62e487c700 1 --2- 172.21.15.42:0/1421003639 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f62c406a690 0x7f62c406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:34.251 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.262+0000 7f62e487c700 1 --2- 172.21.15.42:0/1421003639 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f62c406a690 0x7f62c406cb40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f62d4009130 tx=0x7f62d4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:34.251 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.266+0000 7f62dd7fa700 1 -- 172.21.15.42:0/1421003639 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f62e0153e90 con 0x7f62e0153660 2023-07-29T02:02:34.492 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.507+0000 7f62e6ae0700 1 -- 172.21.15.42:0/1421003639 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62e0153e90 con 0x7f62e0153660 2023-07-29T02:02:34.493 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.507+0000 7f62dd7fa700 1 -- 172.21.15.42:0/1421003639 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5412 (secure 0 0 0) 0x7f62e0153e90 con 0x7f62e0153660 2023-07-29T02:02:34.494 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:02:34.494 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:02:30.418288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5142":{"gid":5142,"name":"e","rank":0,"incarnation":16,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:02:34.495 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.509+0000 7f62e6ae0700 1 -- 172.21.15.42:0/1421003639 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f62c406a690 msgr2=0x7f62c406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.509+0000 7f62e6ae0700 1 --2- 172.21.15.42:0/1421003639 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f62c406a690 0x7f62c406cb40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f62d4009130 tx=0x7f62d4008030 comp rx=0 tx=0).stop 2023-07-29T02:02:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.509+0000 7f62e6ae0700 1 -- 172.21.15.42:0/1421003639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62e0153660 msgr2=0x7f62e0154170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.509+0000 7f62e6ae0700 1 --2- 172.21.15.42:0/1421003639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62e0153660 0x7f62e0154170 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f62cc00b4a0 tx=0x7f62cc00b7b0 comp rx=0 tx=0).stop 2023-07-29T02:02:34.496 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.510+0000 7f62e6ae0700 1 -- 172.21.15.42:0/1421003639 shutdown_connections 2023-07-29T02:02:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.510+0000 7f62e6ae0700 1 --2- 172.21.15.42:0/1421003639 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f62c406a690 0x7f62c406cb40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.510+0000 7f62e6ae0700 1 --2- 172.21.15.42:0/1421003639 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f62e015a780 0x7f62e01546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.510+0000 7f62e6ae0700 1 --2- 172.21.15.42:0/1421003639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62e006b860 0x7f62e00aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.510+0000 7f62e6ae0700 1 --2- 172.21.15.42:0/1421003639 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f62e0153660 0x7f62e0154170 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:34.497 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.510+0000 7f62e6ae0700 1 -- 172.21.15.42:0/1421003639 >> 172.21.15.42:0/1421003639 conn(0x7f62e0061190 msgr2=0x7f62e01522d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.510+0000 7f62e6ae0700 1 -- 172.21.15.42:0/1421003639 shutdown_connections 2023-07-29T02:02:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:34.510+0000 7f62e6ae0700 1 -- 172.21.15.42:0/1421003639 wait complete. 2023-07-29T02:02:34.498 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 17 2023-07-29T02:02:34.508 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2023-07-29T02:02:36.181 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:02:36.184 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:02:36.509 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:02:36.649 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.663+0000 7fef5a236700 1 Processor -- start 2023-07-29T02:02:36.649 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.664+0000 7fef5a236700 1 -- start start 2023-07-29T02:02:36.652 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.664+0000 7fef5a236700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef540cdc70 0x7fef5406d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:36.652 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.664+0000 7fef5a236700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fef5406e950 0x7fef5406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:36.652 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.664+0000 7fef5a236700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5415c770 con 0x7fef54153460 2023-07-29T02:02:36.652 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.664+0000 7fef5a236700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef5415c9c0 con 0x7fef5406e950 2023-07-29T02:02:36.653 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.664+0000 7fef5a236700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef5415cca0 con 0x7fef540cdc70 2023-07-29T02:02:36.653 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.665+0000 7fef52ffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef540cdc70 0x7fef5406d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:36.653 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.665+0000 7fef53fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fef5406e950 0x7fef5406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:36.653 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.665+0000 7fef52ffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef540cdc70 0x7fef5406d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:58248/0 (socket says 172.21.15.42:58248) 2023-07-29T02:02:36.654 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.665+0000 7fef53fff700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fef5406e950 0x7fef5406d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:41114/0 (socket says 172.21.15.42:41114) 2023-07-29T02:02:36.654 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.665+0000 7fef52ffd700 1 -- 172.21.15.42:0/3451568910 learned_addr learned my addr 172.21.15.42:0/3451568910 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:36.654 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.665+0000 7fef52ffd700 1 -- 172.21.15.42:0/3451568910 >> v2:172.21.15.144:3300/0 conn(0x7fef5406e950 msgr2=0x7fef5406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:36.654 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.665+0000 7fef52ffd700 1 --2- 172.21.15.42:0/3451568910 >> v2:172.21.15.144:3300/0 conn(0x7fef5406e950 0x7fef5406d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:36.655 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.665+0000 7fef52ffd700 1 -- 172.21.15.42:0/3451568910 >> v1:172.21.15.144:6789/0 conn(0x7fef54153460 legacy=0x7fef5406de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:36.655 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.665+0000 7fef52ffd700 1 -- 172.21.15.42:0/3451568910 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5415cf80 con 0x7fef540cdc70 2023-07-29T02:02:36.655 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.665+0000 7fef52ffd700 1 --2- 172.21.15.42:0/3451568910 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef540cdc70 0x7fef5406d090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fef480098f0 tx=0x7fef48009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31cd38e769719fcd server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:36.655 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.665+0000 7fef527fc700 1 -- 172.21.15.42:0/3451568910 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48011830 con 0x7fef540cdc70 2023-07-29T02:02:36.656 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.666+0000 7fef527fc700 1 -- 172.21.15.42:0/3451568910 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef48011990 con 0x7fef540cdc70 2023-07-29T02:02:36.656 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.666+0000 7fef527fc700 1 -- 172.21.15.42:0/3451568910 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48011d20 con 0x7fef540cdc70 2023-07-29T02:02:36.656 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.666+0000 7fef5a236700 1 -- 172.21.15.42:0/3451568910 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef540cdc70 msgr2=0x7fef5406d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:36.657 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.666+0000 7fef5a236700 1 --2- 172.21.15.42:0/3451568910 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef540cdc70 0x7fef5406d090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fef480098f0 tx=0x7fef48009c00 comp rx=0 tx=0).stop 2023-07-29T02:02:36.657 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.666+0000 7fef5a236700 1 -- 172.21.15.42:0/3451568910 shutdown_connections 2023-07-29T02:02:36.657 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.666+0000 7fef5a236700 1 --2- 172.21.15.42:0/3451568910 >> v2:172.21.15.144:3300/0 conn(0x7fef5406e950 0x7fef5406d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:36.657 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.666+0000 7fef5a236700 1 --2- 172.21.15.42:0/3451568910 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef540cdc70 0x7fef5406d090 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:36.657 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.666+0000 7fef5a236700 1 -- 172.21.15.42:0/3451568910 >> 172.21.15.42:0/3451568910 conn(0x7fef54061190 msgr2=0x7fef54061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:36.657 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.666+0000 7fef5a236700 1 -- 172.21.15.42:0/3451568910 shutdown_connections 2023-07-29T02:02:36.657 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.666+0000 7fef5a236700 1 -- 172.21.15.42:0/3451568910 wait complete. 2023-07-29T02:02:36.659 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.667+0000 7fef5a236700 1 Processor -- start 2023-07-29T02:02:36.660 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.668+0000 7fef5a236700 1 -- start start 2023-07-29T02:02:36.660 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.668+0000 7fef5a236700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef5406e950 0x7fef54158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:36.660 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.668+0000 7fef5a236700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef540cdc70 0x7fef541f1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:36.660 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.668+0000 7fef5a236700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef54153460 0x7fef541f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:36.660 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.668+0000 7fef5a236700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef54154c30 con 0x7fef540cdc70 2023-07-29T02:02:36.660 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.668+0000 7fef5a236700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef54155b40 con 0x7fef5406e950 2023-07-29T02:02:36.660 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.668+0000 7fef5a236700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef540b0800 con 0x7fef54153460 2023-07-29T02:02:36.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.668+0000 7fef52ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef540cdc70 0x7fef541f1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:36.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.668+0000 7fef52ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef540cdc70 0x7fef541f1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57740/0 (socket says 172.21.15.42:57740) 2023-07-29T02:02:36.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.668+0000 7fef52ffd700 1 -- 172.21.15.42:0/492255846 learned_addr learned my addr 172.21.15.42:0/492255846 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:36.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.668+0000 7fef53fff700 1 --2- 172.21.15.42:0/492255846 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef54153460 0x7fef541f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:36.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.668+0000 7fef537fe700 1 --2- 172.21.15.42:0/492255846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef5406e950 0x7fef54158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:36.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.669+0000 7fef52ffd700 1 -- 172.21.15.42:0/492255846 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef54153460 msgr2=0x7fef541f2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:36.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.669+0000 7fef52ffd700 1 --2- 172.21.15.42:0/492255846 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef54153460 0x7fef541f2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:36.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.669+0000 7fef52ffd700 1 -- 172.21.15.42:0/492255846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef5406e950 msgr2=0x7fef54158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:36.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.669+0000 7fef52ffd700 1 --2- 172.21.15.42:0/492255846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef5406e950 0x7fef54158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:36.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.669+0000 7fef52ffd700 1 -- 172.21.15.42:0/492255846 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef48009550 con 0x7fef540cdc70 2023-07-29T02:02:36.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.669+0000 7fef52ffd700 1 --2- 172.21.15.42:0/492255846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef540cdc70 0x7fef541f1fe0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fef48000c00 tx=0x7fef48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:36.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.669+0000 7fef3bfff700 1 -- 172.21.15.42:0/492255846 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef48004400 con 0x7fef540cdc70 2023-07-29T02:02:36.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.669+0000 7fef3bfff700 1 -- 172.21.15.42:0/492255846 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4801f070 con 0x7fef540cdc70 2023-07-29T02:02:36.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.669+0000 7fef5a236700 1 -- 172.21.15.42:0/492255846 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef54155720 con 0x7fef540cdc70 2023-07-29T02:02:36.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.669+0000 7fef3bfff700 1 -- 172.21.15.42:0/492255846 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef480038e0 con 0x7fef540cdc70 2023-07-29T02:02:36.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.669+0000 7fef5a236700 1 -- 172.21.15.42:0/492255846 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef54153ca0 con 0x7fef540cdc70 2023-07-29T02:02:36.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.670+0000 7fef5a236700 1 -- 172.21.15.42:0/492255846 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef5404ea50 con 0x7fef540cdc70 2023-07-29T02:02:36.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.671+0000 7fef3bfff700 1 -- 172.21.15.42:0/492255846 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fef48021030 con 0x7fef540cdc70 2023-07-29T02:02:36.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.671+0000 7fef3bfff700 1 --2- 172.21.15.42:0/492255846 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fef4006a660 0x7fef4006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:36.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.671+0000 7fef3bfff700 1 -- 172.21.15.42:0/492255846 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7022+0+0 (secure 0 0 0) 0x7fef4808a1d0 con 0x7fef540cdc70 2023-07-29T02:02:36.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.671+0000 7fef537fe700 1 --2- 172.21.15.42:0/492255846 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fef4006a660 0x7fef4006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:36.663 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.672+0000 7fef537fe700 1 --2- 172.21.15.42:0/492255846 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fef4006a660 0x7fef4006cb10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fef44007fd0 tx=0x7fef44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:36.664 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.675+0000 7fef3bfff700 1 -- 172.21.15.42:0/492255846 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fef48055350 con 0x7fef540cdc70 2023-07-29T02:02:36.908 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.923+0000 7fef5a236700 1 -- 172.21.15.42:0/492255846 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef5406e730 con 0x7fef540cdc70 2023-07-29T02:02:36.909 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.923+0000 7fef3bfff700 1 -- 172.21.15.42:0/492255846 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+5409 (secure 0 0 0) 0x7fef48058970 con 0x7fef540cdc70 2023-07-29T02:02:36.909 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:02:36.909 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:02:35.469056+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5142":{"gid":5142,"name":"e","rank":0,"incarnation":16,"state":"up:rejoin","state_seq":12,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:02:36.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.925+0000 7fef5a236700 1 -- 172.21.15.42:0/492255846 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fef4006a660 msgr2=0x7fef4006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:36.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.925+0000 7fef5a236700 1 --2- 172.21.15.42:0/492255846 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fef4006a660 0x7fef4006cb10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fef44007fd0 tx=0x7fef44009040 comp rx=0 tx=0).stop 2023-07-29T02:02:36.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.925+0000 7fef5a236700 1 -- 172.21.15.42:0/492255846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef540cdc70 msgr2=0x7fef541f1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:36.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.925+0000 7fef5a236700 1 --2- 172.21.15.42:0/492255846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef540cdc70 0x7fef541f1fe0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fef48000c00 tx=0x7fef48004750 comp rx=0 tx=0).stop 2023-07-29T02:02:36.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.925+0000 7fef5a236700 1 -- 172.21.15.42:0/492255846 shutdown_connections 2023-07-29T02:02:36.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.925+0000 7fef5a236700 1 --2- 172.21.15.42:0/492255846 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fef4006a660 0x7fef4006cb10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:36.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.925+0000 7fef5a236700 1 --2- 172.21.15.42:0/492255846 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fef54153460 0x7fef541f2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:36.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.925+0000 7fef5a236700 1 --2- 172.21.15.42:0/492255846 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fef5406e950 0x7fef54158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:36.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.925+0000 7fef5a236700 1 --2- 172.21.15.42:0/492255846 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fef540cdc70 0x7fef541f1fe0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:36.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.925+0000 7fef5a236700 1 -- 172.21.15.42:0/492255846 >> 172.21.15.42:0/492255846 conn(0x7fef54061190 msgr2=0x7fef54152320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:36.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.925+0000 7fef5a236700 1 -- 172.21.15.42:0/492255846 shutdown_connections 2023-07-29T02:02:36.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:36.925+0000 7fef5a236700 1 -- 172.21.15.42:0/492255846 wait complete. 2023-07-29T02:02:36.913 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 18 2023-07-29T02:02:36.923 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 18, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-07-29T01:59:57.946839+0000", "damaged": [], "data_pools": [ 4, 5 ], "enabled": true, "epoch": 18, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_5142": { "addr": "172.21.15.42:6837/2695599859", "addrs": { "addrvec": [ { "addr": "172.21.15.42:6836", "nonce": 2695599859, "type": "v2" }, { "addr": "172.21.15.42:6837", "nonce": 2695599859, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5142, "incarnation": 16, "join_fscid": -1, "name": "e", "rank": 0, "state": "up:rejoin", "state_seq": 12 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 3, "modified": "2023-07-29T02:02:35.469056+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5142 } } } ], "standbys": [ { "addr": "172.21.15.42:6833/3242692321", "addrs": { "addrvec": [ { "addr": "172.21.15.42:6832", "nonce": 3242692321, "type": "v2" }, { "addr": "172.21.15.42:6833", "nonce": 3242692321, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4263, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.42:6835/1860885615", "addrs": { "addrvec": [ { "addr": "172.21.15.42:6834", "nonce": 1860885615, "type": "v2" }, { "addr": "172.21.15.42:6835", "nonce": 1860885615, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4266, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.144:6835/400694688", "addrs": { "addrvec": [ { "addr": "172.21.15.144:6834", "nonce": 400694688, "type": "v2" }, { "addr": "172.21.15.144:6835", "nonce": 400694688, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4291, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.144:6838/2604441175", "addrs": { "addrvec": [ { "addr": "172.21.15.144:6836", "nonce": 2604441175, "type": "v2" }, { "addr": "172.21.15.144:6838", "nonce": 2604441175, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4294, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-07-29T02:02:38.925 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:02:39.064 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.078+0000 7f6d51081700 1 Processor -- start 2023-07-29T02:02:39.064 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.079+0000 7f6d51081700 1 -- start start 2023-07-29T02:02:39.067 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.079+0000 7f6d51081700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d4c159eb0 0x7f6d4c06cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:39.067 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.079+0000 7f6d51081700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4c159310 con 0x7f6d4c156740 2023-07-29T02:02:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.079+0000 7f6d51081700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4c06d960 con 0x7f6d4c072a90 2023-07-29T02:02:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.079+0000 7f6d51081700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c06a850 con 0x7f6d4c159eb0 2023-07-29T02:02:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d4ad9d700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f6d4c156740 0x7f6d4c1597a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51550/0 (socket says 172.21.15.42:51550) 2023-07-29T02:02:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d4ad9d700 1 -- 172.21.15.42:0/2653997303 learned_addr learned my addr 172.21.15.42:0/2653997303 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:02:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d4a59c700 1 --2- 172.21.15.42:0/2653997303 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d4c159eb0 0x7f6d4c06cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:39.068 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d49d9b700 1 -- 172.21.15.42:0/2653997303 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146727758 0 0) 0x7f6d4c159310 con 0x7f6d4c156740 2023-07-29T02:02:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d49d9b700 1 -- 172.21.15.42:0/2653997303 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d340035b0 con 0x7f6d4c156740 2023-07-29T02:02:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d49d9b700 1 -- 172.21.15.42:0/2653997303 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 100862195 0 0) 0x7f6d340035b0 con 0x7f6d4c156740 2023-07-29T02:02:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d49d9b700 1 -- 172.21.15.42:0/2653997303 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d4c159eb0 msgr2=0x7f6d4c06cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d49d9b700 1 --2- 172.21.15.42:0/2653997303 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d4c159eb0 0x7f6d4c06cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d49d9b700 1 -- 172.21.15.42:0/2653997303 >> v1:172.21.15.144:6789/0 conn(0x7f6d4c072a90 legacy=0x7f6d4c06d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:39.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d49d9b700 1 -- 172.21.15.42:0/2653997303 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c06bea0 con 0x7f6d4c156740 2023-07-29T02:02:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d49d9b700 1 -- 172.21.15.42:0/2653997303 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7f6d40001670 con 0x7f6d4c156740 2023-07-29T02:02:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d49d9b700 1 -- 172.21.15.42:0/2653997303 >> v1:172.21.15.42:6789/0 conn(0x7f6d4c156740 legacy=0x7f6d4c1597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d49d9b700 1 --2- 172.21.15.42:0/2653997303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d34003a30 0x7f6d34003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d49d9b700 1 --2- 172.21.15.42:0/2653997303 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d340043d0 0x7f6d34004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d49d9b700 1 --2- 172.21.15.42:0/2653997303 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d4c159eb0 0x7f6d34005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d49d9b700 1 -- 172.21.15.42:0/2653997303 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3400bac0 con 0x7f6d340043d0 2023-07-29T02:02:39.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d49d9b700 1 -- 172.21.15.42:0/2653997303 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3400bc00 con 0x7f6d34003a30 2023-07-29T02:02:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d49d9b700 1 -- 172.21.15.42:0/2653997303 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3400bd90 con 0x7f6d4c159eb0 2023-07-29T02:02:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d4a59c700 1 --2- 172.21.15.42:0/2653997303 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d340043d0 0x7f6d34004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d4ad9d700 1 --2- 172.21.15.42:0/2653997303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d34003a30 0x7f6d34003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.080+0000 7f6d4b59e700 1 --2- 172.21.15.42:0/2653997303 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d4c159eb0 0x7f6d34005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.081+0000 7f6d4a59c700 1 -- 172.21.15.42:0/2653997303 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d4c159eb0 msgr2=0x7f6d34005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.081+0000 7f6d4a59c700 1 --2- 172.21.15.42:0/2653997303 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d4c159eb0 0x7f6d34005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:39.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.081+0000 7f6d4a59c700 1 -- 172.21.15.42:0/2653997303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d34003a30 msgr2=0x7f6d34003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:39.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.081+0000 7f6d4a59c700 1 --2- 172.21.15.42:0/2653997303 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d34003a30 0x7f6d34003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:39.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.081+0000 7f6d4a59c700 1 -- 172.21.15.42:0/2653997303 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d340035b0 con 0x7f6d340043d0 2023-07-29T02:02:39.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.081+0000 7f6d4a59c700 1 --2- 172.21.15.42:0/2653997303 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d340043d0 0x7f6d34004890 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009b60 tx=0x7f6d34005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1470b10c132ca816 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:39.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.081+0000 7f6d49d9b700 1 -- 172.21.15.42:0/2653997303 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c00e6c0 con 0x7f6d340043d0 2023-07-29T02:02:39.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.081+0000 7f6d49d9b700 1 -- 172.21.15.42:0/2653997303 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c00e820 con 0x7f6d340043d0 2023-07-29T02:02:39.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.081+0000 7f6d49d9b700 1 -- 172.21.15.42:0/2653997303 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c00eb90 con 0x7f6d340043d0 2023-07-29T02:02:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.081+0000 7f6d51081700 1 -- 172.21.15.42:0/2653997303 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d340043d0 msgr2=0x7f6d34004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.081+0000 7f6d51081700 1 --2- 172.21.15.42:0/2653997303 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d340043d0 0x7f6d34004890 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009b60 tx=0x7f6d34005880 comp rx=0 tx=0).stop 2023-07-29T02:02:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.081+0000 7f6d4b59e700 1 -- 172.21.15.42:0/2653997303 reap_dead start 2023-07-29T02:02:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.081+0000 7f6d51081700 1 -- 172.21.15.42:0/2653997303 shutdown_connections 2023-07-29T02:02:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.081+0000 7f6d51081700 1 -- 172.21.15.42:0/2653997303 >> 172.21.15.42:0/2653997303 conn(0x7f6d4c0c8970 msgr2=0x7f6d4c0c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.082+0000 7f6d51081700 1 -- 172.21.15.42:0/2653997303 shutdown_connections 2023-07-29T02:02:39.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.082+0000 7f6d51081700 1 -- 172.21.15.42:0/2653997303 wait complete. 2023-07-29T02:02:39.076 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.083+0000 7f6d51081700 1 Processor -- start 2023-07-29T02:02:39.076 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.083+0000 7f6d51081700 1 -- start start 2023-07-29T02:02:39.076 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.084+0000 7f6d51081700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d340043d0 0x7f6d4c15b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:39.076 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.084+0000 7f6d51081700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d4c1eeeb0 0x7f6d4c1ef300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:39.076 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.084+0000 7f6d51081700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d4c1f1e90 0x7f6d4c1f2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:39.076 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.084+0000 7f6d51081700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c0ad860 con 0x7f6d4c1eeeb0 2023-07-29T02:02:39.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.084+0000 7f6d51081700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c1ef840 con 0x7f6d4c1f1e90 2023-07-29T02:02:39.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.084+0000 7f6d51081700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c15a370 con 0x7f6d340043d0 2023-07-29T02:02:39.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.084+0000 7f6d4a59c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d4c1eeeb0 0x7f6d4c1ef300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:39.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.084+0000 7f6d4a59c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d4c1eeeb0 0x7f6d4c1ef300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57760/0 (socket says 172.21.15.42:57760) 2023-07-29T02:02:39.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.084+0000 7f6d4a59c700 1 -- 172.21.15.42:0/318641636 learned_addr learned my addr 172.21.15.42:0/318641636 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:39.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.084+0000 7f6d4ad9d700 1 --2- 172.21.15.42:0/318641636 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d340043d0 0x7f6d4c15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:39.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.084+0000 7f6d4b59e700 1 --2- 172.21.15.42:0/318641636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d4c1f1e90 0x7f6d4c1f2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:39.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.084+0000 7f6d4a59c700 1 -- 172.21.15.42:0/318641636 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d340043d0 msgr2=0x7f6d4c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:39.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.084+0000 7f6d4a59c700 1 --2- 172.21.15.42:0/318641636 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d340043d0 0x7f6d4c15b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:39.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.084+0000 7f6d4a59c700 1 -- 172.21.15.42:0/318641636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d4c1f1e90 msgr2=0x7f6d4c1f2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:39.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.084+0000 7f6d4a59c700 1 --2- 172.21.15.42:0/318641636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d4c1f1e90 0x7f6d4c1f2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:39.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.084+0000 7f6d4a59c700 1 -- 172.21.15.42:0/318641636 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c15a650 con 0x7f6d4c1eeeb0 2023-07-29T02:02:39.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.085+0000 7f6d4a59c700 1 --2- 172.21.15.42:0/318641636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d4c1eeeb0 0x7f6d4c1ef300 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6d340057f0 tx=0x7f6d3c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:39.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.085+0000 7f6d337fe700 1 -- 172.21.15.42:0/318641636 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c021070 con 0x7f6d4c1eeeb0 2023-07-29T02:02:39.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.085+0000 7f6d337fe700 1 -- 172.21.15.42:0/318641636 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c004470 con 0x7f6d4c1eeeb0 2023-07-29T02:02:39.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.085+0000 7f6d337fe700 1 -- 172.21.15.42:0/318641636 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c00e6c0 con 0x7f6d4c1eeeb0 2023-07-29T02:02:39.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.085+0000 7f6d51081700 1 -- 172.21.15.42:0/318641636 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d4c15a930 con 0x7f6d4c1eeeb0 2023-07-29T02:02:39.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.085+0000 7f6d51081700 1 -- 172.21.15.42:0/318641636 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4c1ee920 con 0x7f6d4c1eeeb0 2023-07-29T02:02:39.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.086+0000 7f6d51081700 1 -- 172.21.15.42:0/318641636 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4c074740 con 0x7f6d4c1eeeb0 2023-07-29T02:02:39.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.086+0000 7f6d337fe700 1 -- 172.21.15.42:0/318641636 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f6d3c025070 con 0x7f6d4c1eeeb0 2023-07-29T02:02:39.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.087+0000 7f6d337fe700 1 --2- 172.21.15.42:0/318641636 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6d3806a690 0x7f6d3806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:39.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.087+0000 7f6d337fe700 1 -- 172.21.15.42:0/318641636 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7022+0+0 (secure 0 0 0) 0x7f6d3c089e50 con 0x7f6d4c1eeeb0 2023-07-29T02:02:39.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.087+0000 7f6d4ad9d700 1 --2- 172.21.15.42:0/318641636 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6d3806a690 0x7f6d3806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:39.080 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.088+0000 7f6d4ad9d700 1 --2- 172.21.15.42:0/318641636 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6d3806a690 0x7f6d3806cb40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6d40001eb0 tx=0x7f6d40001020 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:39.081 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.091+0000 7f6d337fe700 1 -- 172.21.15.42:0/318641636 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f6d3c054f20 con 0x7f6d4c1eeeb0 2023-07-29T02:02:39.321 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.335+0000 7f6d51081700 1 -- 172.21.15.42:0/318641636 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d4c0ad860 con 0x7f6d4c1eeeb0 2023-07-29T02:02:39.321 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.336+0000 7f6d337fe700 1 -- 172.21.15.42:0/318641636 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+5409 (secure 0 0 0) 0x7f6d3c058540 con 0x7f6d4c1eeeb0 2023-07-29T02:02:39.322 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:02:39.322 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:02:35.469056+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5142":{"gid":5142,"name":"e","rank":0,"incarnation":16,"state":"up:rejoin","state_seq":12,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:02:39.323 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.338+0000 7f6d51081700 1 -- 172.21.15.42:0/318641636 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6d3806a690 msgr2=0x7f6d3806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:39.323 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.338+0000 7f6d51081700 1 --2- 172.21.15.42:0/318641636 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6d3806a690 0x7f6d3806cb40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6d40001eb0 tx=0x7f6d40001020 comp rx=0 tx=0).stop 2023-07-29T02:02:39.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.338+0000 7f6d51081700 1 -- 172.21.15.42:0/318641636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d4c1eeeb0 msgr2=0x7f6d4c1ef300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:39.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.338+0000 7f6d51081700 1 --2- 172.21.15.42:0/318641636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d4c1eeeb0 0x7f6d4c1ef300 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6d340057f0 tx=0x7f6d3c0047c0 comp rx=0 tx=0).stop 2023-07-29T02:02:39.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.338+0000 7f6d51081700 1 -- 172.21.15.42:0/318641636 shutdown_connections 2023-07-29T02:02:39.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.338+0000 7f6d51081700 1 --2- 172.21.15.42:0/318641636 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6d3806a690 0x7f6d3806cb40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:39.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.338+0000 7f6d51081700 1 --2- 172.21.15.42:0/318641636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d4c1f1e90 0x7f6d4c1f2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.338+0000 7f6d51081700 1 --2- 172.21.15.42:0/318641636 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d340043d0 0x7f6d4c15b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.338+0000 7f6d51081700 1 --2- 172.21.15.42:0/318641636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d4c1eeeb0 0x7f6d4c1ef300 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.338+0000 7f6d51081700 1 -- 172.21.15.42:0/318641636 >> 172.21.15.42:0/318641636 conn(0x7f6d4c0c8970 msgr2=0x7f6d4c0c6770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.338+0000 7f6d51081700 1 -- 172.21.15.42:0/318641636 shutdown_connections 2023-07-29T02:02:39.325 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:39.338+0000 7f6d51081700 1 -- 172.21.15.42:0/318641636 wait complete. 2023-07-29T02:02:39.326 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 18 2023-07-29T02:02:39.335 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2023-07-29T02:02:41.336 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:02:41.475 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.489+0000 7f98bc66a700 1 Processor -- start 2023-07-29T02:02:41.476 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.489+0000 7f98bc66a700 1 -- start start 2023-07-29T02:02:41.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.490+0000 7f98bc66a700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f98b40c57b0 0x7f98b4156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:41.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.490+0000 7f98bc66a700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f98b4151410 0x7f98b40c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:41.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.490+0000 7f98bc66a700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98b40720b0 con 0x7f98b406e1e0 2023-07-29T02:02:41.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.490+0000 7f98bc66a700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b4071240 con 0x7f98b4151410 2023-07-29T02:02:41.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.490+0000 7f98bc66a700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b4072370 con 0x7f98b40c57b0 2023-07-29T02:02:41.477 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.490+0000 7f98b9c05700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f98b406e1e0 0x7f98b4150d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51572/0 (socket says 172.21.15.42:51572) 2023-07-29T02:02:41.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.490+0000 7f98b9c05700 1 -- 172.21.15.42:0/1622084372 learned_addr learned my addr 172.21.15.42:0/1622084372 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:02:41.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.490+0000 7f98bac07700 1 --2- 172.21.15.42:0/1622084372 >> v2:172.21.15.42:3300/0 conn(0x7f98b4151410 0x7f98b40c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:41.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.490+0000 7f98ba406700 1 --2- 172.21.15.42:0/1622084372 >> v2:172.21.15.144:3300/0 conn(0x7f98b40c57b0 0x7f98b4156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:41.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.491+0000 7f98bac07700 1 -- 172.21.15.42:0/1622084372 >> v2:172.21.15.144:3300/0 conn(0x7f98b40c57b0 msgr2=0x7f98b4156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:41.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.491+0000 7f98bac07700 1 --2- 172.21.15.42:0/1622084372 >> v2:172.21.15.144:3300/0 conn(0x7f98b40c57b0 0x7f98b4156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:41.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.491+0000 7f98bac07700 1 -- 172.21.15.42:0/1622084372 >> v1:172.21.15.42:6789/0 conn(0x7f98b406e1e0 legacy=0x7f98b4150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:41.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.491+0000 7f98bac07700 1 -- 172.21.15.42:0/1622084372 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b4072650 con 0x7f98b4151410 2023-07-29T02:02:41.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.491+0000 7f98bac07700 1 --2- 172.21.15.42:0/1622084372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98b4151410 0x7f98b40c6f70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f98b4070da0 tx=0x7f98ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ccd7d255a77156 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:41.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.491+0000 7f98b9404700 1 -- 172.21.15.42:0/1622084372 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac00e070 con 0x7f98b4151410 2023-07-29T02:02:41.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.491+0000 7f98b9404700 1 -- 172.21.15.42:0/1622084372 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac003a20 con 0x7f98b4151410 2023-07-29T02:02:41.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.491+0000 7f98b9404700 1 -- 172.21.15.42:0/1622084372 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac003dd0 con 0x7f98b4151410 2023-07-29T02:02:41.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.492+0000 7f98bc66a700 1 -- 172.21.15.42:0/1622084372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98b4151410 msgr2=0x7f98b40c6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:41.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.492+0000 7f98bc66a700 1 --2- 172.21.15.42:0/1622084372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98b4151410 0x7f98b40c6f70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f98b4070da0 tx=0x7f98ac00b330 comp rx=0 tx=0).stop 2023-07-29T02:02:41.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.492+0000 7f98bc66a700 1 -- 172.21.15.42:0/1622084372 shutdown_connections 2023-07-29T02:02:41.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.492+0000 7f98bc66a700 1 --2- 172.21.15.42:0/1622084372 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98b4151410 0x7f98b40c6f70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:41.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.492+0000 7f98bc66a700 1 --2- 172.21.15.42:0/1622084372 >> v2:172.21.15.144:3300/0 conn(0x7f98b40c57b0 0x7f98b4156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:41.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.492+0000 7f98bc66a700 1 -- 172.21.15.42:0/1622084372 >> 172.21.15.42:0/1622084372 conn(0x7f98b40c8970 msgr2=0x7f98b40c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:41.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.492+0000 7f98bc66a700 1 -- 172.21.15.42:0/1622084372 shutdown_connections 2023-07-29T02:02:41.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.492+0000 7f98bc66a700 1 -- 172.21.15.42:0/1622084372 wait complete. 2023-07-29T02:02:41.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.493+0000 7f98bc66a700 1 Processor -- start 2023-07-29T02:02:41.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.493+0000 7f98bc66a700 1 -- start start 2023-07-29T02:02:41.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.494+0000 7f98bc66a700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f98b406e1e0 0x7f98b41ed4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:41.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.494+0000 7f98bc66a700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98b40c57b0 0x7f98b4147450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:41.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.494+0000 7f98bc66a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98b4151410 0x7f98b414e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:41.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.494+0000 7f98bc66a700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b41564c0 con 0x7f98b4151410 2023-07-29T02:02:41.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.494+0000 7f98bc66a700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b414f2e0 con 0x7f98b40c57b0 2023-07-29T02:02:41.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.494+0000 7f98bc66a700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b41ed9f0 con 0x7f98b406e1e0 2023-07-29T02:02:41.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.494+0000 7f98bac07700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98b4151410 0x7f98b414e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:41.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.494+0000 7f98bac07700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98b4151410 0x7f98b414e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57776/0 (socket says 172.21.15.42:57776) 2023-07-29T02:02:41.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.494+0000 7f98bac07700 1 -- 172.21.15.42:0/3552708779 learned_addr learned my addr 172.21.15.42:0/3552708779 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:41.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.494+0000 7f98b9c05700 1 --2- 172.21.15.42:0/3552708779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98b40c57b0 0x7f98b4147450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:41.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.494+0000 7f98ba406700 1 --2- 172.21.15.42:0/3552708779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f98b406e1e0 0x7f98b41ed4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:41.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.494+0000 7f98bac07700 1 -- 172.21.15.42:0/3552708779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f98b406e1e0 msgr2=0x7f98b41ed4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:41.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.494+0000 7f98bac07700 1 --2- 172.21.15.42:0/3552708779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f98b406e1e0 0x7f98b41ed4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:41.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.494+0000 7f98bac07700 1 -- 172.21.15.42:0/3552708779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98b40c57b0 msgr2=0x7f98b4147450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:41.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.494+0000 7f98bac07700 1 --2- 172.21.15.42:0/3552708779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98b40c57b0 0x7f98b4147450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:41.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.494+0000 7f98bac07700 1 -- 172.21.15.42:0/3552708779 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac009a70 con 0x7f98b4151410 2023-07-29T02:02:41.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.495+0000 7f98bac07700 1 --2- 172.21.15.42:0/3552708779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98b4151410 0x7f98b414e390 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f98ac009d60 tx=0x7f98ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:41.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.495+0000 7f98aaffd700 1 -- 172.21.15.42:0/3552708779 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac004540 con 0x7f98b4151410 2023-07-29T02:02:41.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.495+0000 7f98aaffd700 1 -- 172.21.15.42:0/3552708779 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac0046c0 con 0x7f98b4151410 2023-07-29T02:02:41.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.495+0000 7f98aaffd700 1 -- 172.21.15.42:0/3552708779 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac012430 con 0x7f98b4151410 2023-07-29T02:02:41.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.495+0000 7f98bc66a700 1 -- 172.21.15.42:0/3552708779 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b4155650 con 0x7f98b4151410 2023-07-29T02:02:41.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.495+0000 7f98bc66a700 1 -- 172.21.15.42:0/3552708779 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b4156970 con 0x7f98b4151410 2023-07-29T02:02:41.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.496+0000 7f98bc66a700 1 -- 172.21.15.42:0/3552708779 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b4074740 con 0x7f98b4151410 2023-07-29T02:02:41.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.496+0000 7f98aaffd700 1 -- 172.21.15.42:0/3552708779 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f98ac012590 con 0x7f98b4151410 2023-07-29T02:02:41.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.497+0000 7f98aaffd700 1 --2- 172.21.15.42:0/3552708779 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f989806a660 0x7f989806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:41.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.497+0000 7f98aaffd700 1 -- 172.21.15.42:0/3552708779 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7022+0+0 (secure 0 0 0) 0x7f98ac08a1b0 con 0x7f98b4151410 2023-07-29T02:02:41.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.497+0000 7f98ba406700 1 --2- 172.21.15.42:0/3552708779 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f989806a660 0x7f989806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:41.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.497+0000 7f98ba406700 1 --2- 172.21.15.42:0/3552708779 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f989806a660 0x7f989806cb10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f98b0009be0 tx=0x7f98b0009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:41.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.501+0000 7f98aaffd700 1 -- 172.21.15.42:0/3552708779 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f98ac0551f0 con 0x7f98b4151410 2023-07-29T02:02:41.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.743+0000 7f98bc66a700 1 -- 172.21.15.42:0/3552708779 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98b40c6750 con 0x7f98b4151410 2023-07-29T02:02:41.730 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.744+0000 7f98aaffd700 1 -- 172.21.15.42:0/3552708779 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5409 (secure 0 0 0) 0x7f98b40c6750 con 0x7f98b4151410 2023-07-29T02:02:41.730 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:02:41.731 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:02:40.487146+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5142":{"gid":5142,"name":"e","rank":0,"incarnation":16,"state":"up:active","state_seq":14,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:02:41.732 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.746+0000 7f98bc66a700 1 -- 172.21.15.42:0/3552708779 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f989806a660 msgr2=0x7f989806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:41.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.746+0000 7f98bc66a700 1 --2- 172.21.15.42:0/3552708779 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f989806a660 0x7f989806cb10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f98b0009be0 tx=0x7f98b0009210 comp rx=0 tx=0).stop 2023-07-29T02:02:41.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.746+0000 7f98bc66a700 1 -- 172.21.15.42:0/3552708779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98b4151410 msgr2=0x7f98b414e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:41.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.746+0000 7f98bc66a700 1 --2- 172.21.15.42:0/3552708779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98b4151410 0x7f98b414e390 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f98ac009d60 tx=0x7f98ac004ad0 comp rx=0 tx=0).stop 2023-07-29T02:02:41.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.746+0000 7f98bc66a700 1 -- 172.21.15.42:0/3552708779 shutdown_connections 2023-07-29T02:02:41.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.746+0000 7f98bc66a700 1 --2- 172.21.15.42:0/3552708779 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f989806a660 0x7f989806cb10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.746+0000 7f98bc66a700 1 --2- 172.21.15.42:0/3552708779 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f98b4151410 0x7f98b414e390 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.746+0000 7f98bc66a700 1 --2- 172.21.15.42:0/3552708779 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f98b406e1e0 0x7f98b41ed4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.746+0000 7f98bc66a700 1 --2- 172.21.15.42:0/3552708779 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98b40c57b0 0x7f98b4147450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.746+0000 7f98bc66a700 1 -- 172.21.15.42:0/3552708779 >> 172.21.15.42:0/3552708779 conn(0x7f98b40c8970 msgr2=0x7f98b406f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.746+0000 7f98bc66a700 1 -- 172.21.15.42:0/3552708779 shutdown_connections 2023-07-29T02:02:41.734 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:41.746+0000 7f98bc66a700 1 -- 172.21.15.42:0/3552708779 wait complete. 2023-07-29T02:02:41.735 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 19 2023-07-29T02:02:41.744 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e has gained rank=0, replacing gid=4297 2023-07-29T02:02:41.745 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 8 secs before reviving mds.d 2023-07-29T02:02:45.495 INFO:tasks.workunit.client.0.smithi042.stderr:+ wget -q http://download.ceph.com/qa/linux-2.6.33.tar.bz2 2023-07-29T02:02:45.659 INFO:tasks.ceph.mds.e.smithi042.stderr:2023-07-29T02:02:45.672+0000 7f019329d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-29T02:02:49.745 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.d 2023-07-29T02:02:49.746 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-29T02:02:49.746 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-29T02:02:49.749 INFO:tasks.ceph.mds.d:Started 2023-07-29T02:02:49.749 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:02:49.837 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-07-29T02:02:49.880 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.895+0000 7f94e7ec5700 1 Processor -- start 2023-07-29T02:02:49.880 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.895+0000 7f94e7ec5700 1 -- start start 2023-07-29T02:02:49.882 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.896+0000 7f94e7ec5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94e0153410 0x7f94e00c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:49.882 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.896+0000 7f94e7ec5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f94e0061520 0x7f94e01639a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:49.882 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.896+0000 7f94e7ec5700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e01537e0 con 0x7f94e00c73b0 2023-07-29T02:02:49.882 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.896+0000 7f94e7ec5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e015d5d0 con 0x7f94e0061520 2023-07-29T02:02:49.882 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.896+0000 7f94e7ec5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e006b220 con 0x7f94e0153410 2023-07-29T02:02:49.883 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.896+0000 7f94e6462700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f94e0061520 0x7f94e01639a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:49.883 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.896+0000 7f94e5c61700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94e0153410 0x7f94e00c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:49.883 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.896+0000 7f94e6462700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f94e0061520 0x7f94e01639a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:41170/0 (socket says 172.21.15.42:41170) 2023-07-29T02:02:49.883 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.896+0000 7f94e6462700 1 -- 172.21.15.42:0/3259627333 learned_addr learned my addr 172.21.15.42:0/3259627333 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:49.883 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.896+0000 7f94e5c61700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94e0153410 0x7f94e00c5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:58302/0 (socket says 172.21.15.42:58302) 2023-07-29T02:02:49.883 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.896+0000 7f94e6462700 1 -- 172.21.15.42:0/3259627333 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94e0153410 msgr2=0x7f94e00c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:49.883 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.896+0000 7f94e6462700 1 --2- 172.21.15.42:0/3259627333 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94e0153410 0x7f94e00c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:49.883 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.896+0000 7f94e6462700 1 -- 172.21.15.42:0/3259627333 >> v1:172.21.15.144:6789/0 conn(0x7f94e00c73b0 legacy=0x7f94e015c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:49.884 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.896+0000 7f94e6462700 1 -- 172.21.15.42:0/3259627333 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e015d2f0 con 0x7f94e0061520 2023-07-29T02:02:49.884 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.896+0000 7f94e6462700 1 --2- 172.21.15.42:0/3259627333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94e0061520 0x7f94e01639a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009e50 tx=0x7f94d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=840c4cbcf6d538a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:49.884 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.896+0000 7f94e4c5f700 1 -- 172.21.15.42:0/3259627333 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d800e070 con 0x7f94e0061520 2023-07-29T02:02:49.884 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.897+0000 7f94e4c5f700 1 -- 172.21.15.42:0/3259627333 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d800b910 con 0x7f94e0061520 2023-07-29T02:02:49.884 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.897+0000 7f94e4c5f700 1 -- 172.21.15.42:0/3259627333 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d800bcc0 con 0x7f94e0061520 2023-07-29T02:02:49.886 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.897+0000 7f94e7ec5700 1 -- 172.21.15.42:0/3259627333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94e0061520 msgr2=0x7f94e01639a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:49.887 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.897+0000 7f94e7ec5700 1 --2- 172.21.15.42:0/3259627333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94e0061520 0x7f94e01639a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009e50 tx=0x7f94d800b330 comp rx=0 tx=0).stop 2023-07-29T02:02:49.887 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.897+0000 7f94e7ec5700 1 -- 172.21.15.42:0/3259627333 shutdown_connections 2023-07-29T02:02:49.887 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.897+0000 7f94e7ec5700 1 --2- 172.21.15.42:0/3259627333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94e0061520 0x7f94e01639a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:49.887 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.897+0000 7f94e7ec5700 1 --2- 172.21.15.42:0/3259627333 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94e0153410 0x7f94e00c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:49.887 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.897+0000 7f94e7ec5700 1 -- 172.21.15.42:0/3259627333 >> 172.21.15.42:0/3259627333 conn(0x7f94e00c80e0 msgr2=0x7f94e00c84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:49.887 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.897+0000 7f94e7ec5700 1 -- 172.21.15.42:0/3259627333 shutdown_connections 2023-07-29T02:02:49.887 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.897+0000 7f94e7ec5700 1 -- 172.21.15.42:0/3259627333 wait complete. 2023-07-29T02:02:49.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.898+0000 7f94e7ec5700 1 Processor -- start 2023-07-29T02:02:49.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.898+0000 7f94e7ec5700 1 -- start start 2023-07-29T02:02:49.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.899+0000 7f94e7ec5700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94e0061520 0x7f94e0148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:49.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.899+0000 7f94e7ec5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94e00c73b0 0x7f94e00bf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:49.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.899+0000 7f94e7ec5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94e0153410 0x7f94e01f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:49.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.899+0000 7f94e7ec5700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e01f2790 con 0x7f94e0061520 2023-07-29T02:02:49.888 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.899+0000 7f94e7ec5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e0148c50 con 0x7f94e0153410 2023-07-29T02:02:49.889 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.899+0000 7f94e7ec5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e0151130 con 0x7f94e00c73b0 2023-07-29T02:02:49.889 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.899+0000 7f94e5c61700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94e0061520 0x7f94e0148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:49.889 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.899+0000 7f94e5c61700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94e0061520 0x7f94e0148710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57794/0 (socket says 172.21.15.42:57794) 2023-07-29T02:02:49.889 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.899+0000 7f94e5c61700 1 -- 172.21.15.42:0/2426812228 learned_addr learned my addr 172.21.15.42:0/2426812228 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:49.889 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.899+0000 7f94e6462700 1 --2- 172.21.15.42:0/2426812228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94e0153410 0x7f94e01f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:49.889 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.899+0000 7f94e5460700 1 --2- 172.21.15.42:0/2426812228 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94e00c73b0 0x7f94e00bf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:49.889 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.900+0000 7f94e5c61700 1 -- 172.21.15.42:0/2426812228 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94e00c73b0 msgr2=0x7f94e00bf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:49.889 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.900+0000 7f94e5c61700 1 --2- 172.21.15.42:0/2426812228 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94e00c73b0 0x7f94e00bf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:49.890 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.900+0000 7f94e5c61700 1 -- 172.21.15.42:0/2426812228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94e0153410 msgr2=0x7f94e01f2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:49.890 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.900+0000 7f94e5c61700 1 --2- 172.21.15.42:0/2426812228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94e0153410 0x7f94e01f2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:49.890 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.900+0000 7f94e5c61700 1 -- 172.21.15.42:0/2426812228 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d8009b30 con 0x7f94e0061520 2023-07-29T02:02:49.890 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.900+0000 7f94e5c61700 1 --2- 172.21.15.42:0/2426812228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94e0061520 0x7f94e0148710 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00e9b0 tx=0x7f94dc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:49.890 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.900+0000 7f94d67fc700 1 -- 172.21.15.42:0/2426812228 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc009710 con 0x7f94e0061520 2023-07-29T02:02:49.890 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.900+0000 7f94d67fc700 1 -- 172.21.15.42:0/2426812228 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc00ee50 con 0x7f94e0061520 2023-07-29T02:02:49.890 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.900+0000 7f94e7ec5700 1 -- 172.21.15.42:0/2426812228 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e0151410 con 0x7f94e0061520 2023-07-29T02:02:49.890 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.900+0000 7f94d67fc700 1 -- 172.21.15.42:0/2426812228 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc00ca50 con 0x7f94e0061520 2023-07-29T02:02:49.891 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.900+0000 7f94e7ec5700 1 -- 172.21.15.42:0/2426812228 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e01f2420 con 0x7f94e0061520 2023-07-29T02:02:49.891 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.901+0000 7f94e7ec5700 1 -- 172.21.15.42:0/2426812228 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e00c5cb0 con 0x7f94e0061520 2023-07-29T02:02:49.891 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.901+0000 7f94d67fc700 1 -- 172.21.15.42:0/2426812228 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f94dc00cbb0 con 0x7f94e0061520 2023-07-29T02:02:49.892 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.902+0000 7f94d67fc700 1 --2- 172.21.15.42:0/2426812228 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f94c406a690 0x7f94c406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:49.892 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.902+0000 7f94d67fc700 1 -- 172.21.15.42:0/2426812228 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7022+0+0 (secure 0 0 0) 0x7f94dc088e50 con 0x7f94e0061520 2023-07-29T02:02:49.892 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.902+0000 7f94e5460700 1 --2- 172.21.15.42:0/2426812228 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f94c406a690 0x7f94c406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:49.892 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.903+0000 7f94e5460700 1 --2- 172.21.15.42:0/2426812228 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f94c406a690 0x7f94c406cb40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f94e00c0cd0 tx=0x7f94d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:49.892 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:49.906+0000 7f94d67fc700 1 -- 172.21.15.42:0/2426812228 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f94dc057890 con 0x7f94e0061520 2023-07-29T02:02:50.141 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:50.156+0000 7f94e7ec5700 1 -- 172.21.15.42:0/2426812228 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94e004ea50 con 0x7f94e0061520 2023-07-29T02:02:50.142 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:50.157+0000 7f94d67fc700 1 -- 172.21.15.42:0/2426812228 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5409 (secure 0 0 0) 0x7f94dc021090 con 0x7f94e0061520 2023-07-29T02:02:50.142 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:02:50.142 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:02:40.487146+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5142":{"gid":5142,"name":"e","rank":0,"incarnation":16,"state":"up:active","state_seq":14,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:02:50.144 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:50.159+0000 7f94e7ec5700 1 -- 172.21.15.42:0/2426812228 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f94c406a690 msgr2=0x7f94c406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:50.144 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:50.159+0000 7f94e7ec5700 1 --2- 172.21.15.42:0/2426812228 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f94c406a690 0x7f94c406cb40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f94e00c0cd0 tx=0x7f94d0009040 comp rx=0 tx=0).stop 2023-07-29T02:02:50.144 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:50.159+0000 7f94e7ec5700 1 -- 172.21.15.42:0/2426812228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94e0061520 msgr2=0x7f94e0148710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:50.144 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:50.159+0000 7f94e7ec5700 1 --2- 172.21.15.42:0/2426812228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94e0061520 0x7f94e0148710 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00e9b0 tx=0x7f94dc00ecc0 comp rx=0 tx=0).stop 2023-07-29T02:02:50.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:50.159+0000 7f94e7ec5700 1 -- 172.21.15.42:0/2426812228 shutdown_connections 2023-07-29T02:02:50.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:50.159+0000 7f94e7ec5700 1 --2- 172.21.15.42:0/2426812228 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f94c406a690 0x7f94c406cb40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:50.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:50.159+0000 7f94e7ec5700 1 --2- 172.21.15.42:0/2426812228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f94e0153410 0x7f94e01f2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:50.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:50.159+0000 7f94e7ec5700 1 --2- 172.21.15.42:0/2426812228 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f94e0061520 0x7f94e0148710 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:50.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:50.159+0000 7f94e7ec5700 1 --2- 172.21.15.42:0/2426812228 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f94e00c73b0 0x7f94e00bf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:50.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:50.159+0000 7f94e7ec5700 1 -- 172.21.15.42:0/2426812228 >> 172.21.15.42:0/2426812228 conn(0x7f94e00c80e0 msgr2=0x7f94e006a750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:50.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:50.159+0000 7f94e7ec5700 1 -- 172.21.15.42:0/2426812228 shutdown_connections 2023-07-29T02:02:50.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:50.159+0000 7f94e7ec5700 1 -- 172.21.15.42:0/2426812228 wait complete. 2023-07-29T02:02:50.146 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 19 2023-07-29T02:02:50.156 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2023-07-29T02:02:51.029 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir foo 2023-07-29T02:02:51.034 INFO:tasks.workunit.client.0.smithi042.stderr:+ cp linux-2.6.33.tar.bz2 foo 2023-07-29T02:02:51.076 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir foo/.snap/barsnap 2023-07-29T02:02:51.101 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm foo/linux-2.6.33.tar.bz2 2023-07-29T02:02:51.115 INFO:tasks.workunit.client.0.smithi042.stderr:+ diff -q foo/.snap/barsnap/linux-2.6.33.tar.bz2 linux-2.6.33.tar.bz2 2023-07-29T02:02:51.321 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'passed: files are identical' 2023-07-29T02:02:51.322 INFO:tasks.workunit.client.0.smithi042.stdout:passed: files are identical 2023-07-29T02:02:51.322 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir foo/.snap/barsnap 2023-07-29T02:02:51.330 INFO:tasks.workunit.client.0.smithi042.stdout:OK 2023-07-29T02:02:51.331 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo OK 2023-07-29T02:02:51.332 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-07-29T02:02:51.332 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-07-29T02:02:51.368 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-1.sh... 2023-07-29T02:02:51.368 DEBUG:teuthology.orchestra.run.smithi042:workunit test fs/snaps/snaptest-1.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0484097b0572e96f42cf6402cbe0ac8dcb046577 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-1.sh 2023-07-29T02:02:51.430 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 1 2023-07-29T02:02:51.431 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 2 2023-07-29T02:02:51.432 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 3 2023-07-29T02:02:51.432 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -e file4 ']' 2023-07-29T02:02:51.433 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir .snap/snap1 2023-07-29T02:02:51.458 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 4 2023-07-29T02:02:51.461 INFO:tasks.workunit.client.0.smithi042.stderr:++ ls 2023-07-29T02:02:51.469 INFO:tasks.workunit.client.0.smithi042.stderr:+ now='file1 2023-07-29T02:02:51.469 INFO:tasks.workunit.client.0.smithi042.stderr:file2 2023-07-29T02:02:51.469 INFO:tasks.workunit.client.0.smithi042.stderr:file3 2023-07-29T02:02:51.469 INFO:tasks.workunit.client.0.smithi042.stderr:file4' 2023-07-29T02:02:51.469 INFO:tasks.workunit.client.0.smithi042.stderr:++ ls .snap/snap1 2023-07-29T02:02:51.475 INFO:tasks.workunit.client.0.smithi042.stderr:+ then='file1 2023-07-29T02:02:51.475 INFO:tasks.workunit.client.0.smithi042.stderr:file2 2023-07-29T02:02:51.475 INFO:tasks.workunit.client.0.smithi042.stderr:file3' 2023-07-29T02:02:51.475 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir .snap/snap1 2023-07-29T02:02:51.479 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' 'file1 2023-07-29T02:02:51.479 INFO:tasks.workunit.client.0.smithi042.stderr:file2 2023-07-29T02:02:51.479 INFO:tasks.workunit.client.0.smithi042.stderr:file3 2023-07-29T02:02:51.480 INFO:tasks.workunit.client.0.smithi042.stderr:file4' = 'file1 2023-07-29T02:02:51.480 INFO:tasks.workunit.client.0.smithi042.stderr:file2 2023-07-29T02:02:51.480 INFO:tasks.workunit.client.0.smithi042.stderr:file3' ']' 2023-07-29T02:02:51.480 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 1 2023-07-29T02:02:51.487 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 2 2023-07-29T02:02:51.509 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 3 2023-07-29T02:02:51.516 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir .snap/snap1 2023-07-29T02:02:51.539 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 4 2023-07-29T02:02:51.554 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir .snap/snap1 2023-07-29T02:02:51.560 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm file1 file2 file3 file4 2023-07-29T02:02:51.568 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo OK 2023-07-29T02:02:51.569 INFO:tasks.workunit.client.0.smithi042.stdout:OK 2023-07-29T02:02:51.569 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-07-29T02:02:51.570 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-07-29T02:02:51.643 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-2.sh... 2023-07-29T02:02:51.643 DEBUG:teuthology.orchestra.run.smithi042:workunit test fs/snaps/snaptest-2.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0484097b0572e96f42cf6402cbe0ac8dcb046577 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-2.sh 2023-07-29T02:02:51.706 INFO:tasks.workunit.client.0.smithi042.stdout:Create dir 100 to 199 ... 2023-07-29T02:02:51.714 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 100 2023-07-29T02:02:51.723 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 101 2023-07-29T02:02:51.732 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 102 2023-07-29T02:02:51.740 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 103 2023-07-29T02:02:51.749 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 104 2023-07-29T02:02:51.758 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 105 2023-07-29T02:02:51.767 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 106 2023-07-29T02:02:51.776 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 107 2023-07-29T02:02:51.785 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 108 2023-07-29T02:02:51.793 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 109 2023-07-29T02:02:51.802 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 110 2023-07-29T02:02:51.811 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 111 2023-07-29T02:02:51.819 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 112 2023-07-29T02:02:51.828 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 113 2023-07-29T02:02:51.836 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 114 2023-07-29T02:02:51.844 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 115 2023-07-29T02:02:51.853 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 116 2023-07-29T02:02:51.862 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 117 2023-07-29T02:02:51.870 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 118 2023-07-29T02:02:51.879 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 119 2023-07-29T02:02:51.887 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 120 2023-07-29T02:02:51.896 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 121 2023-07-29T02:02:51.905 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 122 2023-07-29T02:02:51.913 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 123 2023-07-29T02:02:51.922 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 124 2023-07-29T02:02:51.930 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 125 2023-07-29T02:02:51.939 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 126 2023-07-29T02:02:51.948 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 127 2023-07-29T02:02:51.956 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 128 2023-07-29T02:02:51.965 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 129 2023-07-29T02:02:51.973 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 130 2023-07-29T02:02:51.982 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 131 2023-07-29T02:02:51.990 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 132 2023-07-29T02:02:51.998 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 133 2023-07-29T02:02:52.007 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 134 2023-07-29T02:02:52.015 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 135 2023-07-29T02:02:52.024 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 136 2023-07-29T02:02:52.032 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 137 2023-07-29T02:02:52.040 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 138 2023-07-29T02:02:52.049 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 139 2023-07-29T02:02:52.058 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 140 2023-07-29T02:02:52.066 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 141 2023-07-29T02:02:52.074 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 142 2023-07-29T02:02:52.082 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 143 2023-07-29T02:02:52.091 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 144 2023-07-29T02:02:52.099 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 145 2023-07-29T02:02:52.108 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 146 2023-07-29T02:02:52.116 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 147 2023-07-29T02:02:52.125 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 148 2023-07-29T02:02:52.133 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 149 2023-07-29T02:02:52.142 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 150 2023-07-29T02:02:52.150 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 151 2023-07-29T02:02:52.157 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:02:52.159 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 152 2023-07-29T02:02:52.168 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 153 2023-07-29T02:02:52.177 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 154 2023-07-29T02:02:52.186 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 155 2023-07-29T02:02:52.195 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 156 2023-07-29T02:02:52.203 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 157 2023-07-29T02:02:52.212 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 158 2023-07-29T02:02:52.220 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 159 2023-07-29T02:02:52.229 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 160 2023-07-29T02:02:52.238 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 161 2023-07-29T02:02:52.246 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 162 2023-07-29T02:02:52.255 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 163 2023-07-29T02:02:52.263 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 164 2023-07-29T02:02:52.272 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 165 2023-07-29T02:02:52.280 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 166 2023-07-29T02:02:52.287 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.301+0000 7f8c35b7d700 1 Processor -- start 2023-07-29T02:02:52.287 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.302+0000 7f8c35b7d700 1 -- start start 2023-07-29T02:02:52.288 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.302+0000 7f8c35b7d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8c30156740 0x7f8c301597a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:52.288 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.302+0000 7f8c35b7d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8c3006db60 0x7f8c30159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:52.288 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.302+0000 7f8c35b7d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c30159310 con 0x7f8c30072a90 2023-07-29T02:02:52.288 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.302+0000 7f8c35b7d700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3006a850 con 0x7f8c30156740 2023-07-29T02:02:52.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.302+0000 7f8c35b7d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c3006bea0 con 0x7f8c3006db60 2023-07-29T02:02:52.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.303+0000 7f8c2f7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8c30156740 0x7f8c301597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:52.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.303+0000 7f8c2f7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8c30156740 0x7f8c301597a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57818/0 (socket says 172.21.15.42:57818) 2023-07-29T02:02:52.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.303+0000 7f8c2f7fe700 1 -- 172.21.15.42:0/2416380424 learned_addr learned my addr 172.21.15.42:0/2416380424 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:52.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.303+0000 7f8c2ffff700 1 --2- 172.21.15.42:0/2416380424 >> v2:172.21.15.144:3300/0 conn(0x7f8c3006db60 0x7f8c30159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:52.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.303+0000 7f8c2f7fe700 1 -- 172.21.15.42:0/2416380424 >> v2:172.21.15.144:3300/0 conn(0x7f8c3006db60 msgr2=0x7f8c30159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:52.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.303+0000 7f8c2f7fe700 1 --2- 172.21.15.42:0/2416380424 >> v2:172.21.15.144:3300/0 conn(0x7f8c3006db60 0x7f8c30159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:52.290 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.303+0000 7f8c2f7fe700 1 -- 172.21.15.42:0/2416380424 >> v1:172.21.15.144:6789/0 conn(0x7f8c30072a90 legacy=0x7f8c3006cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:02:52.290 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.303+0000 7f8c2f7fe700 1 -- 172.21.15.42:0/2416380424 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3006b5d0 con 0x7f8c30156740 2023-07-29T02:02:52.290 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.303+0000 7f8c2f7fe700 1 --2- 172.21.15.42:0/2416380424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c30156740 0x7f8c301597a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8c3006e5b0 tx=0x7f8c20009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a646d046503e39 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:52.291 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.303+0000 7f8c2e7fc700 1 -- 172.21.15.42:0/2416380424 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20004230 con 0x7f8c30156740 2023-07-29T02:02:52.291 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.303+0000 7f8c2e7fc700 1 -- 172.21.15.42:0/2416380424 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c20004390 con 0x7f8c30156740 2023-07-29T02:02:52.291 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.303+0000 7f8c2e7fc700 1 -- 172.21.15.42:0/2416380424 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c200036a0 con 0x7f8c30156740 2023-07-29T02:02:52.291 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.304+0000 7f8c35b7d700 1 -- 172.21.15.42:0/2416380424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c30156740 msgr2=0x7f8c301597a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:52.291 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.304+0000 7f8c35b7d700 1 --2- 172.21.15.42:0/2416380424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c30156740 0x7f8c301597a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8c3006e5b0 tx=0x7f8c20009bd0 comp rx=0 tx=0).stop 2023-07-29T02:02:52.291 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.304+0000 7f8c35b7d700 1 -- 172.21.15.42:0/2416380424 shutdown_connections 2023-07-29T02:02:52.292 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.304+0000 7f8c35b7d700 1 --2- 172.21.15.42:0/2416380424 >> v2:172.21.15.144:3300/0 conn(0x7f8c3006db60 0x7f8c30159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:52.292 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.304+0000 7f8c35b7d700 1 --2- 172.21.15.42:0/2416380424 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c30156740 0x7f8c301597a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:52.292 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.304+0000 7f8c35b7d700 1 -- 172.21.15.42:0/2416380424 >> 172.21.15.42:0/2416380424 conn(0x7f8c300c8970 msgr2=0x7f8c300c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:52.292 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.304+0000 7f8c35b7d700 1 -- 172.21.15.42:0/2416380424 shutdown_connections 2023-07-29T02:02:52.292 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.304+0000 7f8c35b7d700 1 -- 172.21.15.42:0/2416380424 wait complete. 2023-07-29T02:02:52.292 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.305+0000 7f8c35b7d700 1 Processor -- start 2023-07-29T02:02:52.293 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 167 2023-07-29T02:02:52.294 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.305+0000 7f8c35b7d700 1 -- start start 2023-07-29T02:02:52.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.306+0000 7f8c35b7d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c3006db60 0x7f8c3015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:52.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.306+0000 7f8c35b7d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c30072a90 0x7f8c30152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:52.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.306+0000 7f8c35b7d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c30156740 0x7f8c30154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:52.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.306+0000 7f8c35b7d700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3015d4b0 con 0x7f8c30072a90 2023-07-29T02:02:52.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.306+0000 7f8c35b7d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c301eeb40 con 0x7f8c3006db60 2023-07-29T02:02:52.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.306+0000 7f8c35b7d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c301eee20 con 0x7f8c30156740 2023-07-29T02:02:52.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.306+0000 7f8c2effd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c30072a90 0x7f8c30152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:52.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.306+0000 7f8c2effd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c30072a90 0x7f8c30152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57826/0 (socket says 172.21.15.42:57826) 2023-07-29T02:02:52.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.306+0000 7f8c2effd700 1 -- 172.21.15.42:0/2815523636 learned_addr learned my addr 172.21.15.42:0/2815523636 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:02:52.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.306+0000 7f8c2f7fe700 1 --2- 172.21.15.42:0/2815523636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c3006db60 0x7f8c3015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:52.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.306+0000 7f8c2ffff700 1 --2- 172.21.15.42:0/2815523636 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c30156740 0x7f8c30154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:52.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.307+0000 7f8c2effd700 1 -- 172.21.15.42:0/2815523636 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c30156740 msgr2=0x7f8c30154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:52.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.307+0000 7f8c2effd700 1 --2- 172.21.15.42:0/2815523636 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c30156740 0x7f8c30154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:52.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.307+0000 7f8c2effd700 1 -- 172.21.15.42:0/2815523636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c3006db60 msgr2=0x7f8c3015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:52.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.307+0000 7f8c2effd700 1 --2- 172.21.15.42:0/2815523636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c3006db60 0x7f8c3015ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:52.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.307+0000 7f8c2effd700 1 -- 172.21.15.42:0/2815523636 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c20009550 con 0x7f8c30072a90 2023-07-29T02:02:52.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.307+0000 7f8c2effd700 1 --2- 172.21.15.42:0/2815523636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c30072a90 0x7f8c30152d20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400c4d0 tx=0x7f8c2400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:52.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.307+0000 7f8c17fff700 1 -- 172.21.15.42:0/2815523636 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c24011790 con 0x7f8c30072a90 2023-07-29T02:02:52.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.307+0000 7f8c35b7d700 1 -- 172.21.15.42:0/2815523636 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c301ef100 con 0x7f8c30072a90 2023-07-29T02:02:52.297 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.307+0000 7f8c17fff700 1 -- 172.21.15.42:0/2815523636 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c240118f0 con 0x7f8c30072a90 2023-07-29T02:02:52.298 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.307+0000 7f8c17fff700 1 -- 172.21.15.42:0/2815523636 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c24011ca0 con 0x7f8c30072a90 2023-07-29T02:02:52.298 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.307+0000 7f8c35b7d700 1 -- 172.21.15.42:0/2815523636 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c301ef6c0 con 0x7f8c30072a90 2023-07-29T02:02:52.298 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.308+0000 7f8c35b7d700 1 -- 172.21.15.42:0/2815523636 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c30074740 con 0x7f8c30072a90 2023-07-29T02:02:52.298 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.309+0000 7f8c17fff700 1 -- 172.21.15.42:0/2815523636 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f8c24026430 con 0x7f8c30072a90 2023-07-29T02:02:52.298 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.309+0000 7f8c17fff700 1 --2- 172.21.15.42:0/2815523636 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c1c06a660 0x7f8c1c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:02:52.298 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.310+0000 7f8c17fff700 1 -- 172.21.15.42:0/2815523636 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 7022+0+0 (secure 0 0 0) 0x7f8c240897c0 con 0x7f8c30072a90 2023-07-29T02:02:52.298 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.310+0000 7f8c2f7fe700 1 --2- 172.21.15.42:0/2815523636 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c1c06a660 0x7f8c1c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:02:52.299 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.310+0000 7f8c2f7fe700 1 --2- 172.21.15.42:0/2815523636 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c1c06a660 0x7f8c1c06cb10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009130 tx=0x7f8c20008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:02:52.299 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.314+0000 7f8c17fff700 1 -- 172.21.15.42:0/2815523636 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f8c240547a0 con 0x7f8c30072a90 2023-07-29T02:02:52.301 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 168 2023-07-29T02:02:52.312 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 169 2023-07-29T02:02:52.321 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 170 2023-07-29T02:02:52.330 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 171 2023-07-29T02:02:52.338 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 172 2023-07-29T02:02:52.346 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 173 2023-07-29T02:02:52.355 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 174 2023-07-29T02:02:52.363 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 175 2023-07-29T02:02:52.372 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 176 2023-07-29T02:02:52.380 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 177 2023-07-29T02:02:52.388 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 178 2023-07-29T02:02:52.397 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 179 2023-07-29T02:02:52.406 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 180 2023-07-29T02:02:52.414 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 181 2023-07-29T02:02:52.423 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 182 2023-07-29T02:02:52.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.562+0000 7f8c35b7d700 1 -- 172.21.15.42:0/2815523636 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c3004ea50 con 0x7f8c30072a90 2023-07-29T02:02:52.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.563+0000 7f8c17fff700 1 -- 172.21.15.42:0/2815523636 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6169 (secure 0 0 0) 0x7f8c24057dc0 con 0x7f8c30072a90 2023-07-29T02:02:52.548 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:02:52.549 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:02:40.487146+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5142":{"gid":5142,"name":"e","rank":0,"incarnation":16,"state":"up:active","state_seq":14,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:02:52.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.565+0000 7f8c35b7d700 1 -- 172.21.15.42:0/2815523636 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c1c06a660 msgr2=0x7f8c1c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:52.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.565+0000 7f8c35b7d700 1 --2- 172.21.15.42:0/2815523636 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c1c06a660 0x7f8c1c06cb10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8c20009130 tx=0x7f8c20008030 comp rx=0 tx=0).stop 2023-07-29T02:02:52.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.565+0000 7f8c35b7d700 1 -- 172.21.15.42:0/2815523636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c30072a90 msgr2=0x7f8c30152d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:02:52.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.565+0000 7f8c35b7d700 1 --2- 172.21.15.42:0/2815523636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c30072a90 0x7f8c30152d20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400c4d0 tx=0x7f8c2400c7e0 comp rx=0 tx=0).stop 2023-07-29T02:02:52.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.565+0000 7f8c35b7d700 1 -- 172.21.15.42:0/2815523636 shutdown_connections 2023-07-29T02:02:52.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.565+0000 7f8c35b7d700 1 --2- 172.21.15.42:0/2815523636 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c1c06a660 0x7f8c1c06cb10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:52.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.565+0000 7f8c35b7d700 1 --2- 172.21.15.42:0/2815523636 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c30156740 0x7f8c30154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:52.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.565+0000 7f8c35b7d700 1 --2- 172.21.15.42:0/2815523636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c3006db60 0x7f8c3015ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:52.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.565+0000 7f8c35b7d700 1 --2- 172.21.15.42:0/2815523636 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c30072a90 0x7f8c30152d20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:02:52.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.565+0000 7f8c35b7d700 1 -- 172.21.15.42:0/2815523636 >> 172.21.15.42:0/2815523636 conn(0x7f8c300c8970 msgr2=0x7f8c3006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:02:52.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.565+0000 7f8c35b7d700 1 -- 172.21.15.42:0/2815523636 shutdown_connections 2023-07-29T02:02:52.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:02:52.565+0000 7f8c35b7d700 1 -- 172.21.15.42:0/2815523636 wait complete. 2023-07-29T02:02:52.553 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 20 2023-07-29T02:02:52.565 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d reported in up:standby state 2023-07-29T02:02:52.565 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 71 secs before thrashing 2023-07-29T02:02:52.690 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 183 2023-07-29T02:02:52.699 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 184 2023-07-29T02:02:52.707 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 185 2023-07-29T02:02:52.716 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 186 2023-07-29T02:02:52.725 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 187 2023-07-29T02:02:52.734 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 188 2023-07-29T02:02:52.742 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 189 2023-07-29T02:02:52.751 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 190 2023-07-29T02:02:52.760 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 191 2023-07-29T02:02:52.768 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 192 2023-07-29T02:02:52.777 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 193 2023-07-29T02:02:52.786 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 194 2023-07-29T02:02:52.795 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 195 2023-07-29T02:02:52.804 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 196 2023-07-29T02:02:52.812 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 197 2023-07-29T02:02:52.823 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 198 2023-07-29T02:02:52.833 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 199 2023-07-29T02:02:52.842 INFO:tasks.workunit.client.0.smithi042.stdout:Take first snapshot .snap/test1 2023-07-29T02:02:52.934 INFO:tasks.workunit.client.0.smithi042.stdout:Create dir 200 to 299 ... 2023-07-29T02:02:52.936 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 200 2023-07-29T02:02:52.956 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 201 2023-07-29T02:02:52.965 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 202 2023-07-29T02:02:52.973 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 203 2023-07-29T02:02:52.981 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 204 2023-07-29T02:02:52.990 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 205 2023-07-29T02:02:52.998 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 206 2023-07-29T02:02:53.007 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 207 2023-07-29T02:02:53.015 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 208 2023-07-29T02:02:53.024 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 209 2023-07-29T02:02:53.032 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 210 2023-07-29T02:02:53.040 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 211 2023-07-29T02:02:53.049 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 212 2023-07-29T02:02:53.057 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 213 2023-07-29T02:02:53.065 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 214 2023-07-29T02:02:53.073 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 215 2023-07-29T02:02:53.084 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 216 2023-07-29T02:02:53.096 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 217 2023-07-29T02:02:53.108 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 218 2023-07-29T02:02:53.118 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 219 2023-07-29T02:02:53.126 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 220 2023-07-29T02:02:53.134 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 221 2023-07-29T02:02:53.142 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 222 2023-07-29T02:02:53.150 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 223 2023-07-29T02:02:53.158 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 224 2023-07-29T02:02:53.166 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 225 2023-07-29T02:02:53.174 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 226 2023-07-29T02:02:53.182 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 227 2023-07-29T02:02:53.190 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 228 2023-07-29T02:02:53.198 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 229 2023-07-29T02:02:53.206 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 230 2023-07-29T02:02:53.214 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 231 2023-07-29T02:02:53.222 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 232 2023-07-29T02:02:53.230 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 233 2023-07-29T02:02:53.238 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 234 2023-07-29T02:02:53.246 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 235 2023-07-29T02:02:53.254 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 236 2023-07-29T02:02:53.262 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 237 2023-07-29T02:02:53.270 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 238 2023-07-29T02:02:53.278 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 239 2023-07-29T02:02:53.286 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 240 2023-07-29T02:02:53.294 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 241 2023-07-29T02:02:53.302 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 242 2023-07-29T02:02:53.313 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 243 2023-07-29T02:02:53.322 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 244 2023-07-29T02:02:53.333 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 245 2023-07-29T02:02:53.343 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 246 2023-07-29T02:02:53.353 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 247 2023-07-29T02:02:53.365 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 248 2023-07-29T02:02:53.377 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 249 2023-07-29T02:02:53.389 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 250 2023-07-29T02:02:53.404 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 251 2023-07-29T02:02:53.555 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 252 2023-07-29T02:02:53.563 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 253 2023-07-29T02:02:53.571 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 254 2023-07-29T02:02:53.579 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 255 2023-07-29T02:02:53.587 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 256 2023-07-29T02:02:53.596 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 257 2023-07-29T02:02:53.604 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 258 2023-07-29T02:02:53.612 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 259 2023-07-29T02:02:53.620 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 260 2023-07-29T02:02:53.629 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 261 2023-07-29T02:02:53.640 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 262 2023-07-29T02:02:53.652 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 263 2023-07-29T02:02:53.664 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 264 2023-07-29T02:02:53.675 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 265 2023-07-29T02:02:53.685 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 266 2023-07-29T02:02:53.695 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 267 2023-07-29T02:02:53.704 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 268 2023-07-29T02:02:53.712 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 269 2023-07-29T02:02:53.720 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 270 2023-07-29T02:02:53.729 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 271 2023-07-29T02:02:53.737 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 272 2023-07-29T02:02:53.745 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 273 2023-07-29T02:02:53.753 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 274 2023-07-29T02:02:53.761 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 275 2023-07-29T02:02:53.769 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 276 2023-07-29T02:02:53.777 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 277 2023-07-29T02:02:53.784 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 278 2023-07-29T02:02:53.792 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 279 2023-07-29T02:02:53.800 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 280 2023-07-29T02:02:53.808 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 281 2023-07-29T02:02:53.816 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 282 2023-07-29T02:02:53.824 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 283 2023-07-29T02:02:53.832 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 284 2023-07-29T02:02:53.840 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 285 2023-07-29T02:02:53.849 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 286 2023-07-29T02:02:53.857 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 287 2023-07-29T02:02:53.865 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 288 2023-07-29T02:02:53.873 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 289 2023-07-29T02:02:53.881 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 290 2023-07-29T02:02:53.889 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 291 2023-07-29T02:02:53.897 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 292 2023-07-29T02:02:53.905 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 293 2023-07-29T02:02:53.913 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 294 2023-07-29T02:02:53.921 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 295 2023-07-29T02:02:53.930 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 296 2023-07-29T02:02:53.938 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 297 2023-07-29T02:02:53.946 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 298 2023-07-29T02:02:53.954 INFO:tasks.workunit.client.0.smithi042.stdout: create dir 299 2023-07-29T02:02:53.964 INFO:tasks.workunit.client.0.smithi042.stdout:Create a snapshot in every first level dir ... 2023-07-29T02:02:54.082 INFO:tasks.workunit.client.0.smithi042.stdout: create 100/.snap/snap-subdir-test 2023-07-29T02:02:54.119 INFO:tasks.workunit.client.0.smithi042.stdout: create 100/30 file after the snapshot 2023-07-29T02:02:54.121 INFO:tasks.workunit.client.0.smithi042.stdout: create 100/31 file after the snapshot 2023-07-29T02:02:54.123 INFO:tasks.workunit.client.0.smithi042.stdout: create 100/32 file after the snapshot 2023-07-29T02:02:54.124 INFO:tasks.workunit.client.0.smithi042.stdout: create 100/33 file after the snapshot 2023-07-29T02:02:54.126 INFO:tasks.workunit.client.0.smithi042.stdout: create 100/34 file after the snapshot 2023-07-29T02:02:54.127 INFO:tasks.workunit.client.0.smithi042.stdout: create 100/35 file after the snapshot 2023-07-29T02:02:54.129 INFO:tasks.workunit.client.0.smithi042.stdout: create 100/36 file after the snapshot 2023-07-29T02:02:54.130 INFO:tasks.workunit.client.0.smithi042.stdout: create 100/37 file after the snapshot 2023-07-29T02:02:54.131 INFO:tasks.workunit.client.0.smithi042.stdout: create 100/38 file after the snapshot 2023-07-29T02:02:54.131 INFO:tasks.workunit.client.0.smithi042.stdout: create 100/39 file after the snapshot 2023-07-29T02:02:54.132 INFO:tasks.workunit.client.0.smithi042.stdout: create 101/.snap/snap-subdir-test 2023-07-29T02:02:54.169 INFO:tasks.workunit.client.0.smithi042.stdout: create 101/30 file after the snapshot 2023-07-29T02:02:54.172 INFO:tasks.workunit.client.0.smithi042.stdout: create 101/31 file after the snapshot 2023-07-29T02:02:54.174 INFO:tasks.workunit.client.0.smithi042.stdout: create 101/32 file after the snapshot 2023-07-29T02:02:54.176 INFO:tasks.workunit.client.0.smithi042.stdout: create 101/33 file after the snapshot 2023-07-29T02:02:54.179 INFO:tasks.workunit.client.0.smithi042.stdout: create 101/34 file after the snapshot 2023-07-29T02:02:54.181 INFO:tasks.workunit.client.0.smithi042.stdout: create 101/35 file after the snapshot 2023-07-29T02:02:54.183 INFO:tasks.workunit.client.0.smithi042.stdout: create 101/36 file after the snapshot 2023-07-29T02:02:54.183 INFO:tasks.workunit.client.0.smithi042.stdout: create 101/37 file after the snapshot 2023-07-29T02:02:54.184 INFO:tasks.workunit.client.0.smithi042.stdout: create 101/38 file after the snapshot 2023-07-29T02:02:54.185 INFO:tasks.workunit.client.0.smithi042.stdout: create 101/39 file after the snapshot 2023-07-29T02:02:54.185 INFO:tasks.workunit.client.0.smithi042.stdout: create 102/.snap/snap-subdir-test 2023-07-29T02:02:54.223 INFO:tasks.workunit.client.0.smithi042.stdout: create 102/30 file after the snapshot 2023-07-29T02:02:54.226 INFO:tasks.workunit.client.0.smithi042.stdout: create 102/31 file after the snapshot 2023-07-29T02:02:54.227 INFO:tasks.workunit.client.0.smithi042.stdout: create 102/32 file after the snapshot 2023-07-29T02:02:54.229 INFO:tasks.workunit.client.0.smithi042.stdout: create 102/33 file after the snapshot 2023-07-29T02:02:54.231 INFO:tasks.workunit.client.0.smithi042.stdout: create 102/34 file after the snapshot 2023-07-29T02:02:54.233 INFO:tasks.workunit.client.0.smithi042.stdout: create 102/35 file after the snapshot 2023-07-29T02:02:54.236 INFO:tasks.workunit.client.0.smithi042.stdout: create 102/36 file after the snapshot 2023-07-29T02:02:54.237 INFO:tasks.workunit.client.0.smithi042.stdout: create 102/37 file after the snapshot 2023-07-29T02:02:54.238 INFO:tasks.workunit.client.0.smithi042.stdout: create 102/38 file after the snapshot 2023-07-29T02:02:54.238 INFO:tasks.workunit.client.0.smithi042.stdout: create 102/39 file after the snapshot 2023-07-29T02:02:54.239 INFO:tasks.workunit.client.0.smithi042.stdout: create 103/.snap/snap-subdir-test 2023-07-29T02:02:54.276 INFO:tasks.workunit.client.0.smithi042.stdout: create 103/30 file after the snapshot 2023-07-29T02:02:54.290 INFO:tasks.workunit.client.0.smithi042.stdout: create 103/31 file after the snapshot 2023-07-29T02:02:54.291 INFO:tasks.workunit.client.0.smithi042.stdout: create 103/32 file after the snapshot 2023-07-29T02:02:54.292 INFO:tasks.workunit.client.0.smithi042.stdout: create 103/33 file after the snapshot 2023-07-29T02:02:54.292 INFO:tasks.workunit.client.0.smithi042.stdout: create 103/34 file after the snapshot 2023-07-29T02:02:54.293 INFO:tasks.workunit.client.0.smithi042.stdout: create 103/35 file after the snapshot 2023-07-29T02:02:54.293 INFO:tasks.workunit.client.0.smithi042.stdout: create 103/36 file after the snapshot 2023-07-29T02:02:54.294 INFO:tasks.workunit.client.0.smithi042.stdout: create 103/37 file after the snapshot 2023-07-29T02:02:54.295 INFO:tasks.workunit.client.0.smithi042.stdout: create 103/38 file after the snapshot 2023-07-29T02:02:54.295 INFO:tasks.workunit.client.0.smithi042.stdout: create 103/39 file after the snapshot 2023-07-29T02:02:54.296 INFO:tasks.workunit.client.0.smithi042.stdout: create 104/.snap/snap-subdir-test 2023-07-29T02:02:54.333 INFO:tasks.workunit.client.0.smithi042.stdout: create 104/30 file after the snapshot 2023-07-29T02:02:54.335 INFO:tasks.workunit.client.0.smithi042.stdout: create 104/31 file after the snapshot 2023-07-29T02:02:54.337 INFO:tasks.workunit.client.0.smithi042.stdout: create 104/32 file after the snapshot 2023-07-29T02:02:54.339 INFO:tasks.workunit.client.0.smithi042.stdout: create 104/33 file after the snapshot 2023-07-29T02:02:54.340 INFO:tasks.workunit.client.0.smithi042.stdout: create 104/34 file after the snapshot 2023-07-29T02:02:54.342 INFO:tasks.workunit.client.0.smithi042.stdout: create 104/35 file after the snapshot 2023-07-29T02:02:54.343 INFO:tasks.workunit.client.0.smithi042.stdout: create 104/36 file after the snapshot 2023-07-29T02:02:54.345 INFO:tasks.workunit.client.0.smithi042.stdout: create 104/37 file after the snapshot 2023-07-29T02:02:54.347 INFO:tasks.workunit.client.0.smithi042.stdout: create 104/38 file after the snapshot 2023-07-29T02:02:54.348 INFO:tasks.workunit.client.0.smithi042.stdout: create 104/39 file after the snapshot 2023-07-29T02:02:54.348 INFO:tasks.workunit.client.0.smithi042.stdout: create 105/.snap/snap-subdir-test 2023-07-29T02:02:54.386 INFO:tasks.workunit.client.0.smithi042.stdout: create 105/30 file after the snapshot 2023-07-29T02:02:54.388 INFO:tasks.workunit.client.0.smithi042.stdout: create 105/31 file after the snapshot 2023-07-29T02:02:54.389 INFO:tasks.workunit.client.0.smithi042.stdout: create 105/32 file after the snapshot 2023-07-29T02:02:54.391 INFO:tasks.workunit.client.0.smithi042.stdout: create 105/33 file after the snapshot 2023-07-29T02:02:54.392 INFO:tasks.workunit.client.0.smithi042.stdout: create 105/34 file after the snapshot 2023-07-29T02:02:54.394 INFO:tasks.workunit.client.0.smithi042.stdout: create 105/35 file after the snapshot 2023-07-29T02:02:54.396 INFO:tasks.workunit.client.0.smithi042.stdout: create 105/36 file after the snapshot 2023-07-29T02:02:54.397 INFO:tasks.workunit.client.0.smithi042.stdout: create 105/37 file after the snapshot 2023-07-29T02:02:54.399 INFO:tasks.workunit.client.0.smithi042.stdout: create 105/38 file after the snapshot 2023-07-29T02:02:54.400 INFO:tasks.workunit.client.0.smithi042.stdout: create 105/39 file after the snapshot 2023-07-29T02:02:54.400 INFO:tasks.workunit.client.0.smithi042.stdout: create 106/.snap/snap-subdir-test 2023-07-29T02:02:54.431 INFO:tasks.workunit.client.0.smithi042.stdout: create 106/30 file after the snapshot 2023-07-29T02:02:54.433 INFO:tasks.workunit.client.0.smithi042.stdout: create 106/31 file after the snapshot 2023-07-29T02:02:54.435 INFO:tasks.workunit.client.0.smithi042.stdout: create 106/32 file after the snapshot 2023-07-29T02:02:54.436 INFO:tasks.workunit.client.0.smithi042.stdout: create 106/33 file after the snapshot 2023-07-29T02:02:54.438 INFO:tasks.workunit.client.0.smithi042.stdout: create 106/34 file after the snapshot 2023-07-29T02:02:54.439 INFO:tasks.workunit.client.0.smithi042.stdout: create 106/35 file after the snapshot 2023-07-29T02:02:54.441 INFO:tasks.workunit.client.0.smithi042.stdout: create 106/36 file after the snapshot 2023-07-29T02:02:54.442 INFO:tasks.workunit.client.0.smithi042.stdout: create 106/37 file after the snapshot 2023-07-29T02:02:54.444 INFO:tasks.workunit.client.0.smithi042.stdout: create 106/38 file after the snapshot 2023-07-29T02:02:54.445 INFO:tasks.workunit.client.0.smithi042.stdout: create 106/39 file after the snapshot 2023-07-29T02:02:54.446 INFO:tasks.workunit.client.0.smithi042.stdout: create 107/.snap/snap-subdir-test 2023-07-29T02:02:54.479 INFO:tasks.workunit.client.0.smithi042.stdout: create 107/30 file after the snapshot 2023-07-29T02:02:54.490 INFO:tasks.workunit.client.0.smithi042.stdout: create 107/31 file after the snapshot 2023-07-29T02:02:54.491 INFO:tasks.workunit.client.0.smithi042.stdout: create 107/32 file after the snapshot 2023-07-29T02:02:54.492 INFO:tasks.workunit.client.0.smithi042.stdout: create 107/33 file after the snapshot 2023-07-29T02:02:54.493 INFO:tasks.workunit.client.0.smithi042.stdout: create 107/34 file after the snapshot 2023-07-29T02:02:54.494 INFO:tasks.workunit.client.0.smithi042.stdout: create 107/35 file after the snapshot 2023-07-29T02:02:54.494 INFO:tasks.workunit.client.0.smithi042.stdout: create 107/36 file after the snapshot 2023-07-29T02:02:54.495 INFO:tasks.workunit.client.0.smithi042.stdout: create 107/37 file after the snapshot 2023-07-29T02:02:54.496 INFO:tasks.workunit.client.0.smithi042.stdout: create 107/38 file after the snapshot 2023-07-29T02:02:54.496 INFO:tasks.workunit.client.0.smithi042.stdout: create 107/39 file after the snapshot 2023-07-29T02:02:54.497 INFO:tasks.workunit.client.0.smithi042.stdout: create 108/.snap/snap-subdir-test 2023-07-29T02:02:54.531 INFO:tasks.workunit.client.0.smithi042.stdout: create 108/30 file after the snapshot 2023-07-29T02:02:54.542 INFO:tasks.workunit.client.0.smithi042.stdout: create 108/31 file after the snapshot 2023-07-29T02:02:54.542 INFO:tasks.workunit.client.0.smithi042.stdout: create 108/32 file after the snapshot 2023-07-29T02:02:54.543 INFO:tasks.workunit.client.0.smithi042.stdout: create 108/33 file after the snapshot 2023-07-29T02:02:54.544 INFO:tasks.workunit.client.0.smithi042.stdout: create 108/34 file after the snapshot 2023-07-29T02:02:54.544 INFO:tasks.workunit.client.0.smithi042.stdout: create 108/35 file after the snapshot 2023-07-29T02:02:54.545 INFO:tasks.workunit.client.0.smithi042.stdout: create 108/36 file after the snapshot 2023-07-29T02:02:54.546 INFO:tasks.workunit.client.0.smithi042.stdout: create 108/37 file after the snapshot 2023-07-29T02:02:54.546 INFO:tasks.workunit.client.0.smithi042.stdout: create 108/38 file after the snapshot 2023-07-29T02:02:54.547 INFO:tasks.workunit.client.0.smithi042.stdout: create 108/39 file after the snapshot 2023-07-29T02:02:54.547 INFO:tasks.workunit.client.0.smithi042.stdout: create 109/.snap/snap-subdir-test 2023-07-29T02:02:54.580 INFO:tasks.workunit.client.0.smithi042.stdout: create 109/30 file after the snapshot 2023-07-29T02:02:54.593 INFO:tasks.workunit.client.0.smithi042.stdout: create 109/31 file after the snapshot 2023-07-29T02:02:54.593 INFO:tasks.workunit.client.0.smithi042.stdout: create 109/32 file after the snapshot 2023-07-29T02:02:54.594 INFO:tasks.workunit.client.0.smithi042.stdout: create 109/33 file after the snapshot 2023-07-29T02:02:54.594 INFO:tasks.workunit.client.0.smithi042.stdout: create 109/34 file after the snapshot 2023-07-29T02:02:54.595 INFO:tasks.workunit.client.0.smithi042.stdout: create 109/35 file after the snapshot 2023-07-29T02:02:54.596 INFO:tasks.workunit.client.0.smithi042.stdout: create 109/36 file after the snapshot 2023-07-29T02:02:54.596 INFO:tasks.workunit.client.0.smithi042.stdout: create 109/37 file after the snapshot 2023-07-29T02:02:54.597 INFO:tasks.workunit.client.0.smithi042.stdout: create 109/38 file after the snapshot 2023-07-29T02:02:54.598 INFO:tasks.workunit.client.0.smithi042.stdout: create 109/39 file after the snapshot 2023-07-29T02:02:54.598 INFO:tasks.workunit.client.0.smithi042.stdout: create 110/.snap/snap-subdir-test 2023-07-29T02:02:54.629 INFO:tasks.workunit.client.0.smithi042.stdout: create 110/30 file after the snapshot 2023-07-29T02:02:54.643 INFO:tasks.workunit.client.0.smithi042.stdout: create 110/31 file after the snapshot 2023-07-29T02:02:54.644 INFO:tasks.workunit.client.0.smithi042.stdout: create 110/32 file after the snapshot 2023-07-29T02:02:54.644 INFO:tasks.workunit.client.0.smithi042.stdout: create 110/33 file after the snapshot 2023-07-29T02:02:54.645 INFO:tasks.workunit.client.0.smithi042.stdout: create 110/34 file after the snapshot 2023-07-29T02:02:54.646 INFO:tasks.workunit.client.0.smithi042.stdout: create 110/35 file after the snapshot 2023-07-29T02:02:54.646 INFO:tasks.workunit.client.0.smithi042.stdout: create 110/36 file after the snapshot 2023-07-29T02:02:54.647 INFO:tasks.workunit.client.0.smithi042.stdout: create 110/37 file after the snapshot 2023-07-29T02:02:54.648 INFO:tasks.workunit.client.0.smithi042.stdout: create 110/38 file after the snapshot 2023-07-29T02:02:54.648 INFO:tasks.workunit.client.0.smithi042.stdout: create 110/39 file after the snapshot 2023-07-29T02:02:54.649 INFO:tasks.workunit.client.0.smithi042.stdout: create 111/.snap/snap-subdir-test 2023-07-29T02:02:54.683 INFO:tasks.workunit.client.0.smithi042.stdout: create 111/30 file after the snapshot 2023-07-29T02:02:54.694 INFO:tasks.workunit.client.0.smithi042.stdout: create 111/31 file after the snapshot 2023-07-29T02:02:54.694 INFO:tasks.workunit.client.0.smithi042.stdout: create 111/32 file after the snapshot 2023-07-29T02:02:54.695 INFO:tasks.workunit.client.0.smithi042.stdout: create 111/33 file after the snapshot 2023-07-29T02:02:54.695 INFO:tasks.workunit.client.0.smithi042.stdout: create 111/34 file after the snapshot 2023-07-29T02:02:54.696 INFO:tasks.workunit.client.0.smithi042.stdout: create 111/35 file after the snapshot 2023-07-29T02:02:54.697 INFO:tasks.workunit.client.0.smithi042.stdout: create 111/36 file after the snapshot 2023-07-29T02:02:54.697 INFO:tasks.workunit.client.0.smithi042.stdout: create 111/37 file after the snapshot 2023-07-29T02:02:54.698 INFO:tasks.workunit.client.0.smithi042.stdout: create 111/38 file after the snapshot 2023-07-29T02:02:54.699 INFO:tasks.workunit.client.0.smithi042.stdout: create 111/39 file after the snapshot 2023-07-29T02:02:54.699 INFO:tasks.workunit.client.0.smithi042.stdout: create 112/.snap/snap-subdir-test 2023-07-29T02:02:54.733 INFO:tasks.workunit.client.0.smithi042.stdout: create 112/30 file after the snapshot 2023-07-29T02:02:54.744 INFO:tasks.workunit.client.0.smithi042.stdout: create 112/31 file after the snapshot 2023-07-29T02:02:54.745 INFO:tasks.workunit.client.0.smithi042.stdout: create 112/32 file after the snapshot 2023-07-29T02:02:54.745 INFO:tasks.workunit.client.0.smithi042.stdout: create 112/33 file after the snapshot 2023-07-29T02:02:54.746 INFO:tasks.workunit.client.0.smithi042.stdout: create 112/34 file after the snapshot 2023-07-29T02:02:54.747 INFO:tasks.workunit.client.0.smithi042.stdout: create 112/35 file after the snapshot 2023-07-29T02:02:54.747 INFO:tasks.workunit.client.0.smithi042.stdout: create 112/36 file after the snapshot 2023-07-29T02:02:54.748 INFO:tasks.workunit.client.0.smithi042.stdout: create 112/37 file after the snapshot 2023-07-29T02:02:54.748 INFO:tasks.workunit.client.0.smithi042.stdout: create 112/38 file after the snapshot 2023-07-29T02:02:54.749 INFO:tasks.workunit.client.0.smithi042.stdout: create 112/39 file after the snapshot 2023-07-29T02:02:54.750 INFO:tasks.workunit.client.0.smithi042.stdout: create 113/.snap/snap-subdir-test 2023-07-29T02:02:54.783 INFO:tasks.workunit.client.0.smithi042.stdout: create 113/30 file after the snapshot 2023-07-29T02:02:54.794 INFO:tasks.workunit.client.0.smithi042.stdout: create 113/31 file after the snapshot 2023-07-29T02:02:54.795 INFO:tasks.workunit.client.0.smithi042.stdout: create 113/32 file after the snapshot 2023-07-29T02:02:54.796 INFO:tasks.workunit.client.0.smithi042.stdout: create 113/33 file after the snapshot 2023-07-29T02:02:54.796 INFO:tasks.workunit.client.0.smithi042.stdout: create 113/34 file after the snapshot 2023-07-29T02:02:54.797 INFO:tasks.workunit.client.0.smithi042.stdout: create 113/35 file after the snapshot 2023-07-29T02:02:54.798 INFO:tasks.workunit.client.0.smithi042.stdout: create 113/36 file after the snapshot 2023-07-29T02:02:54.798 INFO:tasks.workunit.client.0.smithi042.stdout: create 113/37 file after the snapshot 2023-07-29T02:02:54.799 INFO:tasks.workunit.client.0.smithi042.stdout: create 113/38 file after the snapshot 2023-07-29T02:02:54.799 INFO:tasks.workunit.client.0.smithi042.stdout: create 113/39 file after the snapshot 2023-07-29T02:02:54.800 INFO:tasks.workunit.client.0.smithi042.stdout: create 114/.snap/snap-subdir-test 2023-07-29T02:02:54.834 INFO:tasks.workunit.client.0.smithi042.stdout: create 114/30 file after the snapshot 2023-07-29T02:02:54.837 INFO:tasks.workunit.client.0.smithi042.stdout: create 114/31 file after the snapshot 2023-07-29T02:02:54.840 INFO:tasks.workunit.client.0.smithi042.stdout: create 114/32 file after the snapshot 2023-07-29T02:02:54.843 INFO:tasks.workunit.client.0.smithi042.stdout: create 114/33 file after the snapshot 2023-07-29T02:02:54.845 INFO:tasks.workunit.client.0.smithi042.stdout: create 114/34 file after the snapshot 2023-07-29T02:02:54.845 INFO:tasks.workunit.client.0.smithi042.stdout: create 114/35 file after the snapshot 2023-07-29T02:02:54.846 INFO:tasks.workunit.client.0.smithi042.stdout: create 114/36 file after the snapshot 2023-07-29T02:02:54.847 INFO:tasks.workunit.client.0.smithi042.stdout: create 114/37 file after the snapshot 2023-07-29T02:02:54.847 INFO:tasks.workunit.client.0.smithi042.stdout: create 114/38 file after the snapshot 2023-07-29T02:02:54.848 INFO:tasks.workunit.client.0.smithi042.stdout: create 114/39 file after the snapshot 2023-07-29T02:02:54.849 INFO:tasks.workunit.client.0.smithi042.stdout: create 115/.snap/snap-subdir-test 2023-07-29T02:02:54.883 INFO:tasks.workunit.client.0.smithi042.stdout: create 115/30 file after the snapshot 2023-07-29T02:02:54.886 INFO:tasks.workunit.client.0.smithi042.stdout: create 115/31 file after the snapshot 2023-07-29T02:02:54.889 INFO:tasks.workunit.client.0.smithi042.stdout: create 115/32 file after the snapshot 2023-07-29T02:02:54.892 INFO:tasks.workunit.client.0.smithi042.stdout: create 115/33 file after the snapshot 2023-07-29T02:02:54.893 INFO:tasks.workunit.client.0.smithi042.stdout: create 115/34 file after the snapshot 2023-07-29T02:02:54.894 INFO:tasks.workunit.client.0.smithi042.stdout: create 115/35 file after the snapshot 2023-07-29T02:02:54.894 INFO:tasks.workunit.client.0.smithi042.stdout: create 115/36 file after the snapshot 2023-07-29T02:02:54.895 INFO:tasks.workunit.client.0.smithi042.stdout: create 115/37 file after the snapshot 2023-07-29T02:02:54.896 INFO:tasks.workunit.client.0.smithi042.stdout: create 115/38 file after the snapshot 2023-07-29T02:02:54.896 INFO:tasks.workunit.client.0.smithi042.stdout: create 115/39 file after the snapshot 2023-07-29T02:02:54.897 INFO:tasks.workunit.client.0.smithi042.stdout: create 116/.snap/snap-subdir-test 2023-07-29T02:02:54.929 INFO:tasks.workunit.client.0.smithi042.stdout: create 116/30 file after the snapshot 2023-07-29T02:02:54.932 INFO:tasks.workunit.client.0.smithi042.stdout: create 116/31 file after the snapshot 2023-07-29T02:02:54.933 INFO:tasks.workunit.client.0.smithi042.stdout: create 116/32 file after the snapshot 2023-07-29T02:02:54.935 INFO:tasks.workunit.client.0.smithi042.stdout: create 116/33 file after the snapshot 2023-07-29T02:02:54.937 INFO:tasks.workunit.client.0.smithi042.stdout: create 116/34 file after the snapshot 2023-07-29T02:02:54.938 INFO:tasks.workunit.client.0.smithi042.stdout: create 116/35 file after the snapshot 2023-07-29T02:02:54.940 INFO:tasks.workunit.client.0.smithi042.stdout: create 116/36 file after the snapshot 2023-07-29T02:02:54.941 INFO:tasks.workunit.client.0.smithi042.stdout: create 116/37 file after the snapshot 2023-07-29T02:02:54.942 INFO:tasks.workunit.client.0.smithi042.stdout: create 116/38 file after the snapshot 2023-07-29T02:02:54.942 INFO:tasks.workunit.client.0.smithi042.stdout: create 116/39 file after the snapshot 2023-07-29T02:02:54.943 INFO:tasks.workunit.client.0.smithi042.stdout: create 117/.snap/snap-subdir-test 2023-07-29T02:02:54.973 INFO:tasks.workunit.client.0.smithi042.stdout: create 117/30 file after the snapshot 2023-07-29T02:02:54.975 INFO:tasks.workunit.client.0.smithi042.stdout: create 117/31 file after the snapshot 2023-07-29T02:02:54.977 INFO:tasks.workunit.client.0.smithi042.stdout: create 117/32 file after the snapshot 2023-07-29T02:02:54.978 INFO:tasks.workunit.client.0.smithi042.stdout: create 117/33 file after the snapshot 2023-07-29T02:02:54.980 INFO:tasks.workunit.client.0.smithi042.stdout: create 117/34 file after the snapshot 2023-07-29T02:02:54.982 INFO:tasks.workunit.client.0.smithi042.stdout: create 117/35 file after the snapshot 2023-07-29T02:02:54.983 INFO:tasks.workunit.client.0.smithi042.stdout: create 117/36 file after the snapshot 2023-07-29T02:02:54.985 INFO:tasks.workunit.client.0.smithi042.stdout: create 117/37 file after the snapshot 2023-07-29T02:02:54.986 INFO:tasks.workunit.client.0.smithi042.stdout: create 117/38 file after the snapshot 2023-07-29T02:02:54.987 INFO:tasks.workunit.client.0.smithi042.stdout: create 117/39 file after the snapshot 2023-07-29T02:02:54.988 INFO:tasks.workunit.client.0.smithi042.stdout: create 118/.snap/snap-subdir-test 2023-07-29T02:02:55.018 INFO:tasks.workunit.client.0.smithi042.stdout: create 118/30 file after the snapshot 2023-07-29T02:02:55.020 INFO:tasks.workunit.client.0.smithi042.stdout: create 118/31 file after the snapshot 2023-07-29T02:02:55.022 INFO:tasks.workunit.client.0.smithi042.stdout: create 118/32 file after the snapshot 2023-07-29T02:02:55.023 INFO:tasks.workunit.client.0.smithi042.stdout: create 118/33 file after the snapshot 2023-07-29T02:02:55.025 INFO:tasks.workunit.client.0.smithi042.stdout: create 118/34 file after the snapshot 2023-07-29T02:02:55.027 INFO:tasks.workunit.client.0.smithi042.stdout: create 118/35 file after the snapshot 2023-07-29T02:02:55.028 INFO:tasks.workunit.client.0.smithi042.stdout: create 118/36 file after the snapshot 2023-07-29T02:02:55.030 INFO:tasks.workunit.client.0.smithi042.stdout: create 118/37 file after the snapshot 2023-07-29T02:02:55.031 INFO:tasks.workunit.client.0.smithi042.stdout: create 118/38 file after the snapshot 2023-07-29T02:02:55.032 INFO:tasks.workunit.client.0.smithi042.stdout: create 118/39 file after the snapshot 2023-07-29T02:02:55.032 INFO:tasks.workunit.client.0.smithi042.stdout: create 119/.snap/snap-subdir-test 2023-07-29T02:02:55.063 INFO:tasks.workunit.client.0.smithi042.stdout: create 119/30 file after the snapshot 2023-07-29T02:02:55.065 INFO:tasks.workunit.client.0.smithi042.stdout: create 119/31 file after the snapshot 2023-07-29T02:02:55.067 INFO:tasks.workunit.client.0.smithi042.stdout: create 119/32 file after the snapshot 2023-07-29T02:02:55.069 INFO:tasks.workunit.client.0.smithi042.stdout: create 119/33 file after the snapshot 2023-07-29T02:02:55.071 INFO:tasks.workunit.client.0.smithi042.stdout: create 119/34 file after the snapshot 2023-07-29T02:02:55.073 INFO:tasks.workunit.client.0.smithi042.stdout: create 119/35 file after the snapshot 2023-07-29T02:02:55.075 INFO:tasks.workunit.client.0.smithi042.stdout: create 119/36 file after the snapshot 2023-07-29T02:02:55.076 INFO:tasks.workunit.client.0.smithi042.stdout: create 119/37 file after the snapshot 2023-07-29T02:02:55.077 INFO:tasks.workunit.client.0.smithi042.stdout: create 119/38 file after the snapshot 2023-07-29T02:02:55.078 INFO:tasks.workunit.client.0.smithi042.stdout: create 119/39 file after the snapshot 2023-07-29T02:02:55.078 INFO:tasks.workunit.client.0.smithi042.stdout: create 120/.snap/snap-subdir-test 2023-07-29T02:02:55.112 INFO:tasks.workunit.client.0.smithi042.stdout: create 120/30 file after the snapshot 2023-07-29T02:02:55.123 INFO:tasks.workunit.client.0.smithi042.stdout: create 120/31 file after the snapshot 2023-07-29T02:02:55.123 INFO:tasks.workunit.client.0.smithi042.stdout: create 120/32 file after the snapshot 2023-07-29T02:02:55.124 INFO:tasks.workunit.client.0.smithi042.stdout: create 120/33 file after the snapshot 2023-07-29T02:02:55.124 INFO:tasks.workunit.client.0.smithi042.stdout: create 120/34 file after the snapshot 2023-07-29T02:02:55.125 INFO:tasks.workunit.client.0.smithi042.stdout: create 120/35 file after the snapshot 2023-07-29T02:02:55.126 INFO:tasks.workunit.client.0.smithi042.stdout: create 120/36 file after the snapshot 2023-07-29T02:02:55.126 INFO:tasks.workunit.client.0.smithi042.stdout: create 120/37 file after the snapshot 2023-07-29T02:02:55.127 INFO:tasks.workunit.client.0.smithi042.stdout: create 120/38 file after the snapshot 2023-07-29T02:02:55.128 INFO:tasks.workunit.client.0.smithi042.stdout: create 120/39 file after the snapshot 2023-07-29T02:02:55.128 INFO:tasks.workunit.client.0.smithi042.stdout: create 121/.snap/snap-subdir-test 2023-07-29T02:02:55.162 INFO:tasks.workunit.client.0.smithi042.stdout: create 121/30 file after the snapshot 2023-07-29T02:02:55.172 INFO:tasks.workunit.client.0.smithi042.stdout: create 121/31 file after the snapshot 2023-07-29T02:02:55.173 INFO:tasks.workunit.client.0.smithi042.stdout: create 121/32 file after the snapshot 2023-07-29T02:02:55.174 INFO:tasks.workunit.client.0.smithi042.stdout: create 121/33 file after the snapshot 2023-07-29T02:02:55.174 INFO:tasks.workunit.client.0.smithi042.stdout: create 121/34 file after the snapshot 2023-07-29T02:02:55.175 INFO:tasks.workunit.client.0.smithi042.stdout: create 121/35 file after the snapshot 2023-07-29T02:02:55.176 INFO:tasks.workunit.client.0.smithi042.stdout: create 121/36 file after the snapshot 2023-07-29T02:02:55.176 INFO:tasks.workunit.client.0.smithi042.stdout: create 121/37 file after the snapshot 2023-07-29T02:02:55.177 INFO:tasks.workunit.client.0.smithi042.stdout: create 121/38 file after the snapshot 2023-07-29T02:02:55.178 INFO:tasks.workunit.client.0.smithi042.stdout: create 121/39 file after the snapshot 2023-07-29T02:02:55.178 INFO:tasks.workunit.client.0.smithi042.stdout: create 122/.snap/snap-subdir-test 2023-07-29T02:02:55.211 INFO:tasks.workunit.client.0.smithi042.stdout: create 122/30 file after the snapshot 2023-07-29T02:02:55.222 INFO:tasks.workunit.client.0.smithi042.stdout: create 122/31 file after the snapshot 2023-07-29T02:02:55.223 INFO:tasks.workunit.client.0.smithi042.stdout: create 122/32 file after the snapshot 2023-07-29T02:02:55.223 INFO:tasks.workunit.client.0.smithi042.stdout: create 122/33 file after the snapshot 2023-07-29T02:02:55.224 INFO:tasks.workunit.client.0.smithi042.stdout: create 122/34 file after the snapshot 2023-07-29T02:02:55.225 INFO:tasks.workunit.client.0.smithi042.stdout: create 122/35 file after the snapshot 2023-07-29T02:02:55.225 INFO:tasks.workunit.client.0.smithi042.stdout: create 122/36 file after the snapshot 2023-07-29T02:02:55.226 INFO:tasks.workunit.client.0.smithi042.stdout: create 122/37 file after the snapshot 2023-07-29T02:02:55.227 INFO:tasks.workunit.client.0.smithi042.stdout: create 122/38 file after the snapshot 2023-07-29T02:02:55.227 INFO:tasks.workunit.client.0.smithi042.stdout: create 122/39 file after the snapshot 2023-07-29T02:02:55.228 INFO:tasks.workunit.client.0.smithi042.stdout: create 123/.snap/snap-subdir-test 2023-07-29T02:02:55.261 INFO:tasks.workunit.client.0.smithi042.stdout: create 123/30 file after the snapshot 2023-07-29T02:02:55.272 INFO:tasks.workunit.client.0.smithi042.stdout: create 123/31 file after the snapshot 2023-07-29T02:02:55.273 INFO:tasks.workunit.client.0.smithi042.stdout: create 123/32 file after the snapshot 2023-07-29T02:02:55.273 INFO:tasks.workunit.client.0.smithi042.stdout: create 123/33 file after the snapshot 2023-07-29T02:02:55.274 INFO:tasks.workunit.client.0.smithi042.stdout: create 123/34 file after the snapshot 2023-07-29T02:02:55.274 INFO:tasks.workunit.client.0.smithi042.stdout: create 123/35 file after the snapshot 2023-07-29T02:02:55.275 INFO:tasks.workunit.client.0.smithi042.stdout: create 123/36 file after the snapshot 2023-07-29T02:02:55.276 INFO:tasks.workunit.client.0.smithi042.stdout: create 123/37 file after the snapshot 2023-07-29T02:02:55.276 INFO:tasks.workunit.client.0.smithi042.stdout: create 123/38 file after the snapshot 2023-07-29T02:02:55.277 INFO:tasks.workunit.client.0.smithi042.stdout: create 123/39 file after the snapshot 2023-07-29T02:02:55.278 INFO:tasks.workunit.client.0.smithi042.stdout: create 124/.snap/snap-subdir-test 2023-07-29T02:02:55.308 INFO:tasks.workunit.client.0.smithi042.stdout: create 124/30 file after the snapshot 2023-07-29T02:02:55.312 INFO:tasks.workunit.client.0.smithi042.stdout: create 124/31 file after the snapshot 2023-07-29T02:02:55.313 INFO:tasks.workunit.client.0.smithi042.stdout: create 124/32 file after the snapshot 2023-07-29T02:02:55.313 INFO:tasks.workunit.client.0.smithi042.stdout: create 124/33 file after the snapshot 2023-07-29T02:02:55.315 INFO:tasks.workunit.client.0.smithi042.stdout: create 124/34 file after the snapshot 2023-07-29T02:02:55.316 INFO:tasks.workunit.client.0.smithi042.stdout: create 124/35 file after the snapshot 2023-07-29T02:02:55.318 INFO:tasks.workunit.client.0.smithi042.stdout: create 124/36 file after the snapshot 2023-07-29T02:02:55.319 INFO:tasks.workunit.client.0.smithi042.stdout: create 124/37 file after the snapshot 2023-07-29T02:02:55.321 INFO:tasks.workunit.client.0.smithi042.stdout: create 124/38 file after the snapshot 2023-07-29T02:02:55.322 INFO:tasks.workunit.client.0.smithi042.stdout: create 124/39 file after the snapshot 2023-07-29T02:02:55.322 INFO:tasks.workunit.client.0.smithi042.stdout: create 125/.snap/snap-subdir-test 2023-07-29T02:02:55.355 INFO:tasks.workunit.client.0.smithi042.stdout: create 125/30 file after the snapshot 2023-07-29T02:02:55.359 INFO:tasks.workunit.client.0.smithi042.stdout: create 125/31 file after the snapshot 2023-07-29T02:02:55.362 INFO:tasks.workunit.client.0.smithi042.stdout: create 125/32 file after the snapshot 2023-07-29T02:02:55.365 INFO:tasks.workunit.client.0.smithi042.stdout: create 125/33 file after the snapshot 2023-07-29T02:02:55.366 INFO:tasks.workunit.client.0.smithi042.stdout: create 125/34 file after the snapshot 2023-07-29T02:02:55.366 INFO:tasks.workunit.client.0.smithi042.stdout: create 125/35 file after the snapshot 2023-07-29T02:02:55.367 INFO:tasks.workunit.client.0.smithi042.stdout: create 125/36 file after the snapshot 2023-07-29T02:02:55.368 INFO:tasks.workunit.client.0.smithi042.stdout: create 125/37 file after the snapshot 2023-07-29T02:02:55.368 INFO:tasks.workunit.client.0.smithi042.stdout: create 125/38 file after the snapshot 2023-07-29T02:02:55.369 INFO:tasks.workunit.client.0.smithi042.stdout: create 125/39 file after the snapshot 2023-07-29T02:02:55.370 INFO:tasks.workunit.client.0.smithi042.stdout: create 126/.snap/snap-subdir-test 2023-07-29T02:02:55.403 INFO:tasks.workunit.client.0.smithi042.stdout: create 126/30 file after the snapshot 2023-07-29T02:02:55.407 INFO:tasks.workunit.client.0.smithi042.stdout: create 126/31 file after the snapshot 2023-07-29T02:02:55.410 INFO:tasks.workunit.client.0.smithi042.stdout: create 126/32 file after the snapshot 2023-07-29T02:02:55.413 INFO:tasks.workunit.client.0.smithi042.stdout: create 126/33 file after the snapshot 2023-07-29T02:02:55.414 INFO:tasks.workunit.client.0.smithi042.stdout: create 126/34 file after the snapshot 2023-07-29T02:02:55.415 INFO:tasks.workunit.client.0.smithi042.stdout: create 126/35 file after the snapshot 2023-07-29T02:02:55.415 INFO:tasks.workunit.client.0.smithi042.stdout: create 126/36 file after the snapshot 2023-07-29T02:02:55.416 INFO:tasks.workunit.client.0.smithi042.stdout: create 126/37 file after the snapshot 2023-07-29T02:02:55.417 INFO:tasks.workunit.client.0.smithi042.stdout: create 126/38 file after the snapshot 2023-07-29T02:02:55.417 INFO:tasks.workunit.client.0.smithi042.stdout: create 126/39 file after the snapshot 2023-07-29T02:02:55.418 INFO:tasks.workunit.client.0.smithi042.stdout: create 127/.snap/snap-subdir-test 2023-07-29T02:02:55.451 INFO:tasks.workunit.client.0.smithi042.stdout: create 127/30 file after the snapshot 2023-07-29T02:02:55.455 INFO:tasks.workunit.client.0.smithi042.stdout: create 127/31 file after the snapshot 2023-07-29T02:02:55.458 INFO:tasks.workunit.client.0.smithi042.stdout: create 127/32 file after the snapshot 2023-07-29T02:02:55.461 INFO:tasks.workunit.client.0.smithi042.stdout: create 127/33 file after the snapshot 2023-07-29T02:02:55.462 INFO:tasks.workunit.client.0.smithi042.stdout: create 127/34 file after the snapshot 2023-07-29T02:02:55.462 INFO:tasks.workunit.client.0.smithi042.stdout: create 127/35 file after the snapshot 2023-07-29T02:02:55.463 INFO:tasks.workunit.client.0.smithi042.stdout: create 127/36 file after the snapshot 2023-07-29T02:02:55.464 INFO:tasks.workunit.client.0.smithi042.stdout: create 127/37 file after the snapshot 2023-07-29T02:02:55.464 INFO:tasks.workunit.client.0.smithi042.stdout: create 127/38 file after the snapshot 2023-07-29T02:02:55.465 INFO:tasks.workunit.client.0.smithi042.stdout: create 127/39 file after the snapshot 2023-07-29T02:02:55.466 INFO:tasks.workunit.client.0.smithi042.stdout: create 128/.snap/snap-subdir-test 2023-07-29T02:02:55.497 INFO:tasks.workunit.client.0.smithi042.stdout: create 128/30 file after the snapshot 2023-07-29T02:02:55.499 INFO:tasks.workunit.client.0.smithi042.stdout: create 128/31 file after the snapshot 2023-07-29T02:02:55.500 INFO:tasks.workunit.client.0.smithi042.stdout: create 128/32 file after the snapshot 2023-07-29T02:02:55.502 INFO:tasks.workunit.client.0.smithi042.stdout: create 128/33 file after the snapshot 2023-07-29T02:02:55.504 INFO:tasks.workunit.client.0.smithi042.stdout: create 128/34 file after the snapshot 2023-07-29T02:02:55.505 INFO:tasks.workunit.client.0.smithi042.stdout: create 128/35 file after the snapshot 2023-07-29T02:02:55.507 INFO:tasks.workunit.client.0.smithi042.stdout: create 128/36 file after the snapshot 2023-07-29T02:02:55.509 INFO:tasks.workunit.client.0.smithi042.stdout: create 128/37 file after the snapshot 2023-07-29T02:02:55.510 INFO:tasks.workunit.client.0.smithi042.stdout: create 128/38 file after the snapshot 2023-07-29T02:02:55.511 INFO:tasks.workunit.client.0.smithi042.stdout: create 128/39 file after the snapshot 2023-07-29T02:02:55.512 INFO:tasks.workunit.client.0.smithi042.stdout: create 129/.snap/snap-subdir-test 2023-07-29T02:02:55.588 INFO:tasks.workunit.client.0.smithi042.stdout: create 129/30 file after the snapshot 2023-07-29T02:02:55.599 INFO:tasks.workunit.client.0.smithi042.stdout: create 129/31 file after the snapshot 2023-07-29T02:02:55.600 INFO:tasks.workunit.client.0.smithi042.stdout: create 129/32 file after the snapshot 2023-07-29T02:02:55.600 INFO:tasks.workunit.client.0.smithi042.stdout: create 129/33 file after the snapshot 2023-07-29T02:02:55.601 INFO:tasks.workunit.client.0.smithi042.stdout: create 129/34 file after the snapshot 2023-07-29T02:02:55.601 INFO:tasks.workunit.client.0.smithi042.stdout: create 129/35 file after the snapshot 2023-07-29T02:02:55.602 INFO:tasks.workunit.client.0.smithi042.stdout: create 129/36 file after the snapshot 2023-07-29T02:02:55.603 INFO:tasks.workunit.client.0.smithi042.stdout: create 129/37 file after the snapshot 2023-07-29T02:02:55.603 INFO:tasks.workunit.client.0.smithi042.stdout: create 129/38 file after the snapshot 2023-07-29T02:02:55.604 INFO:tasks.workunit.client.0.smithi042.stdout: create 129/39 file after the snapshot 2023-07-29T02:02:55.604 INFO:tasks.workunit.client.0.smithi042.stdout: create 130/.snap/snap-subdir-test 2023-07-29T02:02:55.636 INFO:tasks.workunit.client.0.smithi042.stdout: create 130/30 file after the snapshot 2023-07-29T02:02:55.648 INFO:tasks.workunit.client.0.smithi042.stdout: create 130/31 file after the snapshot 2023-07-29T02:02:55.649 INFO:tasks.workunit.client.0.smithi042.stdout: create 130/32 file after the snapshot 2023-07-29T02:02:55.650 INFO:tasks.workunit.client.0.smithi042.stdout: create 130/33 file after the snapshot 2023-07-29T02:02:55.650 INFO:tasks.workunit.client.0.smithi042.stdout: create 130/34 file after the snapshot 2023-07-29T02:02:55.651 INFO:tasks.workunit.client.0.smithi042.stdout: create 130/35 file after the snapshot 2023-07-29T02:02:55.652 INFO:tasks.workunit.client.0.smithi042.stdout: create 130/36 file after the snapshot 2023-07-29T02:02:55.652 INFO:tasks.workunit.client.0.smithi042.stdout: create 130/37 file after the snapshot 2023-07-29T02:02:55.653 INFO:tasks.workunit.client.0.smithi042.stdout: create 130/38 file after the snapshot 2023-07-29T02:02:55.654 INFO:tasks.workunit.client.0.smithi042.stdout: create 130/39 file after the snapshot 2023-07-29T02:02:55.654 INFO:tasks.workunit.client.0.smithi042.stdout: create 131/.snap/snap-subdir-test 2023-07-29T02:02:55.687 INFO:tasks.workunit.client.0.smithi042.stdout: create 131/30 file after the snapshot 2023-07-29T02:02:55.691 INFO:tasks.workunit.client.0.smithi042.stdout: create 131/31 file after the snapshot 2023-07-29T02:02:55.694 INFO:tasks.workunit.client.0.smithi042.stdout: create 131/32 file after the snapshot 2023-07-29T02:02:55.697 INFO:tasks.workunit.client.0.smithi042.stdout: create 131/33 file after the snapshot 2023-07-29T02:02:55.698 INFO:tasks.workunit.client.0.smithi042.stdout: create 131/34 file after the snapshot 2023-07-29T02:02:55.698 INFO:tasks.workunit.client.0.smithi042.stdout: create 131/35 file after the snapshot 2023-07-29T02:02:55.699 INFO:tasks.workunit.client.0.smithi042.stdout: create 131/36 file after the snapshot 2023-07-29T02:02:55.700 INFO:tasks.workunit.client.0.smithi042.stdout: create 131/37 file after the snapshot 2023-07-29T02:02:55.700 INFO:tasks.workunit.client.0.smithi042.stdout: create 131/38 file after the snapshot 2023-07-29T02:02:55.701 INFO:tasks.workunit.client.0.smithi042.stdout: create 131/39 file after the snapshot 2023-07-29T02:02:55.702 INFO:tasks.workunit.client.0.smithi042.stdout: create 132/.snap/snap-subdir-test 2023-07-29T02:02:55.734 INFO:tasks.workunit.client.0.smithi042.stdout: create 132/30 file after the snapshot 2023-07-29T02:02:55.746 INFO:tasks.workunit.client.0.smithi042.stdout: create 132/31 file after the snapshot 2023-07-29T02:02:55.746 INFO:tasks.workunit.client.0.smithi042.stdout: create 132/32 file after the snapshot 2023-07-29T02:02:55.747 INFO:tasks.workunit.client.0.smithi042.stdout: create 132/33 file after the snapshot 2023-07-29T02:02:55.747 INFO:tasks.workunit.client.0.smithi042.stdout: create 132/34 file after the snapshot 2023-07-29T02:02:55.748 INFO:tasks.workunit.client.0.smithi042.stdout: create 132/35 file after the snapshot 2023-07-29T02:02:55.749 INFO:tasks.workunit.client.0.smithi042.stdout: create 132/36 file after the snapshot 2023-07-29T02:02:55.749 INFO:tasks.workunit.client.0.smithi042.stdout: create 132/37 file after the snapshot 2023-07-29T02:02:55.750 INFO:tasks.workunit.client.0.smithi042.stdout: create 132/38 file after the snapshot 2023-07-29T02:02:55.751 INFO:tasks.workunit.client.0.smithi042.stdout: create 132/39 file after the snapshot 2023-07-29T02:02:55.751 INFO:tasks.workunit.client.0.smithi042.stdout: create 133/.snap/snap-subdir-test 2023-07-29T02:02:55.781 INFO:tasks.workunit.client.0.smithi042.stdout: create 133/30 file after the snapshot 2023-07-29T02:02:55.783 INFO:tasks.workunit.client.0.smithi042.stdout: create 133/31 file after the snapshot 2023-07-29T02:02:55.785 INFO:tasks.workunit.client.0.smithi042.stdout: create 133/32 file after the snapshot 2023-07-29T02:02:55.786 INFO:tasks.workunit.client.0.smithi042.stdout: create 133/33 file after the snapshot 2023-07-29T02:02:55.788 INFO:tasks.workunit.client.0.smithi042.stdout: create 133/34 file after the snapshot 2023-07-29T02:02:55.789 INFO:tasks.workunit.client.0.smithi042.stdout: create 133/35 file after the snapshot 2023-07-29T02:02:55.791 INFO:tasks.workunit.client.0.smithi042.stdout: create 133/36 file after the snapshot 2023-07-29T02:02:55.792 INFO:tasks.workunit.client.0.smithi042.stdout: create 133/37 file after the snapshot 2023-07-29T02:02:55.794 INFO:tasks.workunit.client.0.smithi042.stdout: create 133/38 file after the snapshot 2023-07-29T02:02:55.795 INFO:tasks.workunit.client.0.smithi042.stdout: create 133/39 file after the snapshot 2023-07-29T02:02:55.796 INFO:tasks.workunit.client.0.smithi042.stdout: create 134/.snap/snap-subdir-test 2023-07-29T02:02:55.828 INFO:tasks.workunit.client.0.smithi042.stdout: create 134/30 file after the snapshot 2023-07-29T02:02:55.832 INFO:tasks.workunit.client.0.smithi042.stdout: create 134/31 file after the snapshot 2023-07-29T02:02:55.835 INFO:tasks.workunit.client.0.smithi042.stdout: create 134/32 file after the snapshot 2023-07-29T02:02:55.838 INFO:tasks.workunit.client.0.smithi042.stdout: create 134/33 file after the snapshot 2023-07-29T02:02:55.839 INFO:tasks.workunit.client.0.smithi042.stdout: create 134/34 file after the snapshot 2023-07-29T02:02:55.840 INFO:tasks.workunit.client.0.smithi042.stdout: create 134/35 file after the snapshot 2023-07-29T02:02:55.840 INFO:tasks.workunit.client.0.smithi042.stdout: create 134/36 file after the snapshot 2023-07-29T02:02:55.841 INFO:tasks.workunit.client.0.smithi042.stdout: create 134/37 file after the snapshot 2023-07-29T02:02:55.842 INFO:tasks.workunit.client.0.smithi042.stdout: create 134/38 file after the snapshot 2023-07-29T02:02:55.842 INFO:tasks.workunit.client.0.smithi042.stdout: create 134/39 file after the snapshot 2023-07-29T02:02:55.843 INFO:tasks.workunit.client.0.smithi042.stdout: create 135/.snap/snap-subdir-test 2023-07-29T02:02:55.872 INFO:tasks.workunit.client.0.smithi042.stdout: create 135/30 file after the snapshot 2023-07-29T02:02:55.874 INFO:tasks.workunit.client.0.smithi042.stdout: create 135/31 file after the snapshot 2023-07-29T02:02:55.876 INFO:tasks.workunit.client.0.smithi042.stdout: create 135/32 file after the snapshot 2023-07-29T02:02:55.877 INFO:tasks.workunit.client.0.smithi042.stdout: create 135/33 file after the snapshot 2023-07-29T02:02:55.879 INFO:tasks.workunit.client.0.smithi042.stdout: create 135/34 file after the snapshot 2023-07-29T02:02:55.880 INFO:tasks.workunit.client.0.smithi042.stdout: create 135/35 file after the snapshot 2023-07-29T02:02:55.882 INFO:tasks.workunit.client.0.smithi042.stdout: create 135/36 file after the snapshot 2023-07-29T02:02:55.883 INFO:tasks.workunit.client.0.smithi042.stdout: create 135/37 file after the snapshot 2023-07-29T02:02:55.885 INFO:tasks.workunit.client.0.smithi042.stdout: create 135/38 file after the snapshot 2023-07-29T02:02:55.886 INFO:tasks.workunit.client.0.smithi042.stdout: create 135/39 file after the snapshot 2023-07-29T02:02:55.887 INFO:tasks.workunit.client.0.smithi042.stdout: create 136/.snap/snap-subdir-test 2023-07-29T02:02:55.919 INFO:tasks.workunit.client.0.smithi042.stdout: create 136/30 file after the snapshot 2023-07-29T02:02:55.930 INFO:tasks.workunit.client.0.smithi042.stdout: create 136/31 file after the snapshot 2023-07-29T02:02:55.931 INFO:tasks.workunit.client.0.smithi042.stdout: create 136/32 file after the snapshot 2023-07-29T02:02:55.931 INFO:tasks.workunit.client.0.smithi042.stdout: create 136/33 file after the snapshot 2023-07-29T02:02:55.932 INFO:tasks.workunit.client.0.smithi042.stdout: create 136/34 file after the snapshot 2023-07-29T02:02:55.933 INFO:tasks.workunit.client.0.smithi042.stdout: create 136/35 file after the snapshot 2023-07-29T02:02:55.933 INFO:tasks.workunit.client.0.smithi042.stdout: create 136/36 file after the snapshot 2023-07-29T02:02:55.934 INFO:tasks.workunit.client.0.smithi042.stdout: create 136/37 file after the snapshot 2023-07-29T02:02:55.935 INFO:tasks.workunit.client.0.smithi042.stdout: create 136/38 file after the snapshot 2023-07-29T02:02:55.935 INFO:tasks.workunit.client.0.smithi042.stdout: create 136/39 file after the snapshot 2023-07-29T02:02:55.936 INFO:tasks.workunit.client.0.smithi042.stdout: create 137/.snap/snap-subdir-test 2023-07-29T02:02:55.969 INFO:tasks.workunit.client.0.smithi042.stdout: create 137/30 file after the snapshot 2023-07-29T02:02:55.980 INFO:tasks.workunit.client.0.smithi042.stdout: create 137/31 file after the snapshot 2023-07-29T02:02:55.981 INFO:tasks.workunit.client.0.smithi042.stdout: create 137/32 file after the snapshot 2023-07-29T02:02:55.981 INFO:tasks.workunit.client.0.smithi042.stdout: create 137/33 file after the snapshot 2023-07-29T02:02:55.982 INFO:tasks.workunit.client.0.smithi042.stdout: create 137/34 file after the snapshot 2023-07-29T02:02:55.983 INFO:tasks.workunit.client.0.smithi042.stdout: create 137/35 file after the snapshot 2023-07-29T02:02:55.983 INFO:tasks.workunit.client.0.smithi042.stdout: create 137/36 file after the snapshot 2023-07-29T02:02:55.984 INFO:tasks.workunit.client.0.smithi042.stdout: create 137/37 file after the snapshot 2023-07-29T02:02:55.985 INFO:tasks.workunit.client.0.smithi042.stdout: create 137/38 file after the snapshot 2023-07-29T02:02:55.985 INFO:tasks.workunit.client.0.smithi042.stdout: create 137/39 file after the snapshot 2023-07-29T02:02:55.986 INFO:tasks.workunit.client.0.smithi042.stdout: create 138/.snap/snap-subdir-test 2023-07-29T02:02:56.019 INFO:tasks.workunit.client.0.smithi042.stdout: create 138/30 file after the snapshot 2023-07-29T02:02:56.023 INFO:tasks.workunit.client.0.smithi042.stdout: create 138/31 file after the snapshot 2023-07-29T02:02:56.026 INFO:tasks.workunit.client.0.smithi042.stdout: create 138/32 file after the snapshot 2023-07-29T02:02:56.028 INFO:tasks.workunit.client.0.smithi042.stdout: create 138/33 file after the snapshot 2023-07-29T02:02:56.030 INFO:tasks.workunit.client.0.smithi042.stdout: create 138/34 file after the snapshot 2023-07-29T02:02:56.030 INFO:tasks.workunit.client.0.smithi042.stdout: create 138/35 file after the snapshot 2023-07-29T02:02:56.031 INFO:tasks.workunit.client.0.smithi042.stdout: create 138/36 file after the snapshot 2023-07-29T02:02:56.031 INFO:tasks.workunit.client.0.smithi042.stdout: create 138/37 file after the snapshot 2023-07-29T02:02:56.032 INFO:tasks.workunit.client.0.smithi042.stdout: create 138/38 file after the snapshot 2023-07-29T02:02:56.033 INFO:tasks.workunit.client.0.smithi042.stdout: create 138/39 file after the snapshot 2023-07-29T02:02:56.033 INFO:tasks.workunit.client.0.smithi042.stdout: create 139/.snap/snap-subdir-test 2023-07-29T02:02:56.064 INFO:tasks.workunit.client.0.smithi042.stdout: create 139/30 file after the snapshot 2023-07-29T02:02:56.066 INFO:tasks.workunit.client.0.smithi042.stdout: create 139/31 file after the snapshot 2023-07-29T02:02:56.068 INFO:tasks.workunit.client.0.smithi042.stdout: create 139/32 file after the snapshot 2023-07-29T02:02:56.070 INFO:tasks.workunit.client.0.smithi042.stdout: create 139/33 file after the snapshot 2023-07-29T02:02:56.072 INFO:tasks.workunit.client.0.smithi042.stdout: create 139/34 file after the snapshot 2023-07-29T02:02:56.074 INFO:tasks.workunit.client.0.smithi042.stdout: create 139/35 file after the snapshot 2023-07-29T02:02:56.076 INFO:tasks.workunit.client.0.smithi042.stdout: create 139/36 file after the snapshot 2023-07-29T02:02:56.078 INFO:tasks.workunit.client.0.smithi042.stdout: create 139/37 file after the snapshot 2023-07-29T02:02:56.078 INFO:tasks.workunit.client.0.smithi042.stdout: create 139/38 file after the snapshot 2023-07-29T02:02:56.080 INFO:tasks.workunit.client.0.smithi042.stdout: create 139/39 file after the snapshot 2023-07-29T02:02:56.080 INFO:tasks.workunit.client.0.smithi042.stdout: create 140/.snap/snap-subdir-test 2023-07-29T02:02:56.122 INFO:tasks.workunit.client.0.smithi042.stdout: create 140/30 file after the snapshot 2023-07-29T02:02:56.124 INFO:tasks.workunit.client.0.smithi042.stdout: create 140/31 file after the snapshot 2023-07-29T02:02:56.126 INFO:tasks.workunit.client.0.smithi042.stdout: create 140/32 file after the snapshot 2023-07-29T02:02:56.128 INFO:tasks.workunit.client.0.smithi042.stdout: create 140/33 file after the snapshot 2023-07-29T02:02:56.129 INFO:tasks.workunit.client.0.smithi042.stdout: create 140/34 file after the snapshot 2023-07-29T02:02:56.131 INFO:tasks.workunit.client.0.smithi042.stdout: create 140/35 file after the snapshot 2023-07-29T02:02:56.133 INFO:tasks.workunit.client.0.smithi042.stdout: create 140/36 file after the snapshot 2023-07-29T02:02:56.135 INFO:tasks.workunit.client.0.smithi042.stdout: create 140/37 file after the snapshot 2023-07-29T02:02:56.136 INFO:tasks.workunit.client.0.smithi042.stdout: create 140/38 file after the snapshot 2023-07-29T02:02:56.136 INFO:tasks.workunit.client.0.smithi042.stdout: create 140/39 file after the snapshot 2023-07-29T02:02:56.137 INFO:tasks.workunit.client.0.smithi042.stdout: create 141/.snap/snap-subdir-test 2023-07-29T02:02:56.175 INFO:tasks.workunit.client.0.smithi042.stdout: create 141/30 file after the snapshot 2023-07-29T02:02:56.177 INFO:tasks.workunit.client.0.smithi042.stdout: create 141/31 file after the snapshot 2023-07-29T02:02:56.179 INFO:tasks.workunit.client.0.smithi042.stdout: create 141/32 file after the snapshot 2023-07-29T02:02:56.180 INFO:tasks.workunit.client.0.smithi042.stdout: create 141/33 file after the snapshot 2023-07-29T02:02:56.182 INFO:tasks.workunit.client.0.smithi042.stdout: create 141/34 file after the snapshot 2023-07-29T02:02:56.184 INFO:tasks.workunit.client.0.smithi042.stdout: create 141/35 file after the snapshot 2023-07-29T02:02:56.185 INFO:tasks.workunit.client.0.smithi042.stdout: create 141/36 file after the snapshot 2023-07-29T02:02:56.187 INFO:tasks.workunit.client.0.smithi042.stdout: create 141/37 file after the snapshot 2023-07-29T02:02:56.187 INFO:tasks.workunit.client.0.smithi042.stdout: create 141/38 file after the snapshot 2023-07-29T02:02:56.188 INFO:tasks.workunit.client.0.smithi042.stdout: create 141/39 file after the snapshot 2023-07-29T02:02:56.188 INFO:tasks.workunit.client.0.smithi042.stdout: create 142/.snap/snap-subdir-test 2023-07-29T02:02:56.230 INFO:tasks.workunit.client.0.smithi042.stdout: create 142/30 file after the snapshot 2023-07-29T02:02:56.232 INFO:tasks.workunit.client.0.smithi042.stdout: create 142/31 file after the snapshot 2023-07-29T02:02:56.234 INFO:tasks.workunit.client.0.smithi042.stdout: create 142/32 file after the snapshot 2023-07-29T02:02:56.235 INFO:tasks.workunit.client.0.smithi042.stdout: create 142/33 file after the snapshot 2023-07-29T02:02:56.237 INFO:tasks.workunit.client.0.smithi042.stdout: create 142/34 file after the snapshot 2023-07-29T02:02:56.239 INFO:tasks.workunit.client.0.smithi042.stdout: create 142/35 file after the snapshot 2023-07-29T02:02:56.240 INFO:tasks.workunit.client.0.smithi042.stdout: create 142/36 file after the snapshot 2023-07-29T02:02:56.242 INFO:tasks.workunit.client.0.smithi042.stdout: create 142/37 file after the snapshot 2023-07-29T02:02:56.243 INFO:tasks.workunit.client.0.smithi042.stdout: create 142/38 file after the snapshot 2023-07-29T02:02:56.244 INFO:tasks.workunit.client.0.smithi042.stdout: create 142/39 file after the snapshot 2023-07-29T02:02:56.245 INFO:tasks.workunit.client.0.smithi042.stdout: create 143/.snap/snap-subdir-test 2023-07-29T02:02:56.280 INFO:tasks.workunit.client.0.smithi042.stdout: create 143/30 file after the snapshot 2023-07-29T02:02:56.282 INFO:tasks.workunit.client.0.smithi042.stdout: create 143/31 file after the snapshot 2023-07-29T02:02:56.284 INFO:tasks.workunit.client.0.smithi042.stdout: create 143/32 file after the snapshot 2023-07-29T02:02:56.286 INFO:tasks.workunit.client.0.smithi042.stdout: create 143/33 file after the snapshot 2023-07-29T02:02:56.287 INFO:tasks.workunit.client.0.smithi042.stdout: create 143/34 file after the snapshot 2023-07-29T02:02:56.289 INFO:tasks.workunit.client.0.smithi042.stdout: create 143/35 file after the snapshot 2023-07-29T02:02:56.291 INFO:tasks.workunit.client.0.smithi042.stdout: create 143/36 file after the snapshot 2023-07-29T02:02:56.292 INFO:tasks.workunit.client.0.smithi042.stdout: create 143/37 file after the snapshot 2023-07-29T02:02:56.294 INFO:tasks.workunit.client.0.smithi042.stdout: create 143/38 file after the snapshot 2023-07-29T02:02:56.295 INFO:tasks.workunit.client.0.smithi042.stdout: create 143/39 file after the snapshot 2023-07-29T02:02:56.295 INFO:tasks.workunit.client.0.smithi042.stdout: create 144/.snap/snap-subdir-test 2023-07-29T02:02:56.332 INFO:tasks.workunit.client.0.smithi042.stdout: create 144/30 file after the snapshot 2023-07-29T02:02:56.334 INFO:tasks.workunit.client.0.smithi042.stdout: create 144/31 file after the snapshot 2023-07-29T02:02:56.335 INFO:tasks.workunit.client.0.smithi042.stdout: create 144/32 file after the snapshot 2023-07-29T02:02:56.337 INFO:tasks.workunit.client.0.smithi042.stdout: create 144/33 file after the snapshot 2023-07-29T02:02:56.339 INFO:tasks.workunit.client.0.smithi042.stdout: create 144/34 file after the snapshot 2023-07-29T02:02:56.340 INFO:tasks.workunit.client.0.smithi042.stdout: create 144/35 file after the snapshot 2023-07-29T02:02:56.342 INFO:tasks.workunit.client.0.smithi042.stdout: create 144/36 file after the snapshot 2023-07-29T02:02:56.344 INFO:tasks.workunit.client.0.smithi042.stdout: create 144/37 file after the snapshot 2023-07-29T02:02:56.345 INFO:tasks.workunit.client.0.smithi042.stdout: create 144/38 file after the snapshot 2023-07-29T02:02:56.346 INFO:tasks.workunit.client.0.smithi042.stdout: create 144/39 file after the snapshot 2023-07-29T02:02:56.347 INFO:tasks.workunit.client.0.smithi042.stdout: create 145/.snap/snap-subdir-test 2023-07-29T02:02:56.383 INFO:tasks.workunit.client.0.smithi042.stdout: create 145/30 file after the snapshot 2023-07-29T02:02:56.386 INFO:tasks.workunit.client.0.smithi042.stdout: create 145/31 file after the snapshot 2023-07-29T02:02:56.389 INFO:tasks.workunit.client.0.smithi042.stdout: create 145/32 file after the snapshot 2023-07-29T02:02:56.391 INFO:tasks.workunit.client.0.smithi042.stdout: create 145/33 file after the snapshot 2023-07-29T02:02:56.394 INFO:tasks.workunit.client.0.smithi042.stdout: create 145/34 file after the snapshot 2023-07-29T02:02:56.396 INFO:tasks.workunit.client.0.smithi042.stdout: create 145/35 file after the snapshot 2023-07-29T02:02:56.398 INFO:tasks.workunit.client.0.smithi042.stdout: create 145/36 file after the snapshot 2023-07-29T02:02:56.399 INFO:tasks.workunit.client.0.smithi042.stdout: create 145/37 file after the snapshot 2023-07-29T02:02:56.399 INFO:tasks.workunit.client.0.smithi042.stdout: create 145/38 file after the snapshot 2023-07-29T02:02:56.400 INFO:tasks.workunit.client.0.smithi042.stdout: create 145/39 file after the snapshot 2023-07-29T02:02:56.402 INFO:tasks.workunit.client.0.smithi042.stdout: create 146/.snap/snap-subdir-test 2023-07-29T02:02:56.438 INFO:tasks.workunit.client.0.smithi042.stdout: create 146/30 file after the snapshot 2023-07-29T02:02:56.441 INFO:tasks.workunit.client.0.smithi042.stdout: create 146/31 file after the snapshot 2023-07-29T02:02:56.444 INFO:tasks.workunit.client.0.smithi042.stdout: create 146/32 file after the snapshot 2023-07-29T02:02:56.446 INFO:tasks.workunit.client.0.smithi042.stdout: create 146/33 file after the snapshot 2023-07-29T02:02:56.449 INFO:tasks.workunit.client.0.smithi042.stdout: create 146/34 file after the snapshot 2023-07-29T02:02:56.451 INFO:tasks.workunit.client.0.smithi042.stdout: create 146/35 file after the snapshot 2023-07-29T02:02:56.452 INFO:tasks.workunit.client.0.smithi042.stdout: create 146/36 file after the snapshot 2023-07-29T02:02:56.453 INFO:tasks.workunit.client.0.smithi042.stdout: create 146/37 file after the snapshot 2023-07-29T02:02:56.454 INFO:tasks.workunit.client.0.smithi042.stdout: create 146/38 file after the snapshot 2023-07-29T02:02:56.455 INFO:tasks.workunit.client.0.smithi042.stdout: create 146/39 file after the snapshot 2023-07-29T02:02:56.456 INFO:tasks.workunit.client.0.smithi042.stdout: create 147/.snap/snap-subdir-test 2023-07-29T02:02:56.495 INFO:tasks.workunit.client.0.smithi042.stdout: create 147/30 file after the snapshot 2023-07-29T02:02:56.498 INFO:tasks.workunit.client.0.smithi042.stdout: create 147/31 file after the snapshot 2023-07-29T02:02:56.501 INFO:tasks.workunit.client.0.smithi042.stdout: create 147/32 file after the snapshot 2023-07-29T02:02:56.503 INFO:tasks.workunit.client.0.smithi042.stdout: create 147/33 file after the snapshot 2023-07-29T02:02:56.505 INFO:tasks.workunit.client.0.smithi042.stdout: create 147/34 file after the snapshot 2023-07-29T02:02:56.507 INFO:tasks.workunit.client.0.smithi042.stdout: create 147/35 file after the snapshot 2023-07-29T02:02:56.508 INFO:tasks.workunit.client.0.smithi042.stdout: create 147/36 file after the snapshot 2023-07-29T02:02:56.508 INFO:tasks.workunit.client.0.smithi042.stdout: create 147/37 file after the snapshot 2023-07-29T02:02:56.509 INFO:tasks.workunit.client.0.smithi042.stdout: create 147/38 file after the snapshot 2023-07-29T02:02:56.510 INFO:tasks.workunit.client.0.smithi042.stdout: create 147/39 file after the snapshot 2023-07-29T02:02:56.511 INFO:tasks.workunit.client.0.smithi042.stdout: create 148/.snap/snap-subdir-test 2023-07-29T02:02:56.548 INFO:tasks.workunit.client.0.smithi042.stdout: create 148/30 file after the snapshot 2023-07-29T02:02:56.551 INFO:tasks.workunit.client.0.smithi042.stdout: create 148/31 file after the snapshot 2023-07-29T02:02:56.554 INFO:tasks.workunit.client.0.smithi042.stdout: create 148/32 file after the snapshot 2023-07-29T02:02:56.556 INFO:tasks.workunit.client.0.smithi042.stdout: create 148/33 file after the snapshot 2023-07-29T02:02:56.559 INFO:tasks.workunit.client.0.smithi042.stdout: create 148/34 file after the snapshot 2023-07-29T02:02:56.562 INFO:tasks.workunit.client.0.smithi042.stdout: create 148/35 file after the snapshot 2023-07-29T02:02:56.562 INFO:tasks.workunit.client.0.smithi042.stdout: create 148/36 file after the snapshot 2023-07-29T02:02:56.563 INFO:tasks.workunit.client.0.smithi042.stdout: create 148/37 file after the snapshot 2023-07-29T02:02:56.565 INFO:tasks.workunit.client.0.smithi042.stdout: create 148/38 file after the snapshot 2023-07-29T02:02:56.565 INFO:tasks.workunit.client.0.smithi042.stdout: create 148/39 file after the snapshot 2023-07-29T02:02:56.566 INFO:tasks.workunit.client.0.smithi042.stdout: create 149/.snap/snap-subdir-test 2023-07-29T02:02:56.604 INFO:tasks.workunit.client.0.smithi042.stdout: create 149/30 file after the snapshot 2023-07-29T02:02:56.607 INFO:tasks.workunit.client.0.smithi042.stdout: create 149/31 file after the snapshot 2023-07-29T02:02:56.609 INFO:tasks.workunit.client.0.smithi042.stdout: create 149/32 file after the snapshot 2023-07-29T02:02:56.612 INFO:tasks.workunit.client.0.smithi042.stdout: create 149/33 file after the snapshot 2023-07-29T02:02:56.614 INFO:tasks.workunit.client.0.smithi042.stdout: create 149/34 file after the snapshot 2023-07-29T02:02:56.617 INFO:tasks.workunit.client.0.smithi042.stdout: create 149/35 file after the snapshot 2023-07-29T02:02:56.618 INFO:tasks.workunit.client.0.smithi042.stdout: create 149/36 file after the snapshot 2023-07-29T02:02:56.619 INFO:tasks.workunit.client.0.smithi042.stdout: create 149/37 file after the snapshot 2023-07-29T02:02:56.622 INFO:tasks.workunit.client.0.smithi042.stdout: create 149/38 file after the snapshot 2023-07-29T02:02:56.622 INFO:tasks.workunit.client.0.smithi042.stdout: create 149/39 file after the snapshot 2023-07-29T02:02:56.622 INFO:tasks.workunit.client.0.smithi042.stdout: create 150/.snap/snap-subdir-test 2023-07-29T02:02:56.653 INFO:tasks.workunit.client.0.smithi042.stdout: create 150/30 file after the snapshot 2023-07-29T02:02:56.656 INFO:tasks.workunit.client.0.smithi042.stdout: create 150/31 file after the snapshot 2023-07-29T02:02:56.657 INFO:tasks.workunit.client.0.smithi042.stdout: create 150/32 file after the snapshot 2023-07-29T02:02:56.659 INFO:tasks.workunit.client.0.smithi042.stdout: create 150/33 file after the snapshot 2023-07-29T02:02:56.661 INFO:tasks.workunit.client.0.smithi042.stdout: create 150/34 file after the snapshot 2023-07-29T02:02:56.663 INFO:tasks.workunit.client.0.smithi042.stdout: create 150/35 file after the snapshot 2023-07-29T02:02:56.665 INFO:tasks.workunit.client.0.smithi042.stdout: create 150/36 file after the snapshot 2023-07-29T02:02:56.667 INFO:tasks.workunit.client.0.smithi042.stdout: create 150/37 file after the snapshot 2023-07-29T02:02:56.667 INFO:tasks.workunit.client.0.smithi042.stdout: create 150/38 file after the snapshot 2023-07-29T02:02:56.668 INFO:tasks.workunit.client.0.smithi042.stdout: create 150/39 file after the snapshot 2023-07-29T02:02:56.669 INFO:tasks.workunit.client.0.smithi042.stdout: create 151/.snap/snap-subdir-test 2023-07-29T02:02:56.698 INFO:tasks.workunit.client.0.smithi042.stdout: create 151/30 file after the snapshot 2023-07-29T02:02:56.701 INFO:tasks.workunit.client.0.smithi042.stdout: create 151/31 file after the snapshot 2023-07-29T02:02:56.703 INFO:tasks.workunit.client.0.smithi042.stdout: create 151/32 file after the snapshot 2023-07-29T02:02:56.706 INFO:tasks.workunit.client.0.smithi042.stdout: create 151/33 file after the snapshot 2023-07-29T02:02:56.708 INFO:tasks.workunit.client.0.smithi042.stdout: create 151/34 file after the snapshot 2023-07-29T02:02:56.711 INFO:tasks.workunit.client.0.smithi042.stdout: create 151/35 file after the snapshot 2023-07-29T02:02:56.712 INFO:tasks.workunit.client.0.smithi042.stdout: create 151/36 file after the snapshot 2023-07-29T02:02:56.713 INFO:tasks.workunit.client.0.smithi042.stdout: create 151/37 file after the snapshot 2023-07-29T02:02:56.714 INFO:tasks.workunit.client.0.smithi042.stdout: create 151/38 file after the snapshot 2023-07-29T02:02:56.715 INFO:tasks.workunit.client.0.smithi042.stdout: create 151/39 file after the snapshot 2023-07-29T02:02:56.716 INFO:tasks.workunit.client.0.smithi042.stdout: create 152/.snap/snap-subdir-test 2023-07-29T02:02:56.748 INFO:tasks.workunit.client.0.smithi042.stdout: create 152/30 file after the snapshot 2023-07-29T02:02:56.752 INFO:tasks.workunit.client.0.smithi042.stdout: create 152/31 file after the snapshot 2023-07-29T02:02:56.754 INFO:tasks.workunit.client.0.smithi042.stdout: create 152/32 file after the snapshot 2023-07-29T02:02:56.757 INFO:tasks.workunit.client.0.smithi042.stdout: create 152/33 file after the snapshot 2023-07-29T02:02:56.759 INFO:tasks.workunit.client.0.smithi042.stdout: create 152/34 file after the snapshot 2023-07-29T02:02:56.760 INFO:tasks.workunit.client.0.smithi042.stdout: create 152/35 file after the snapshot 2023-07-29T02:02:56.761 INFO:tasks.workunit.client.0.smithi042.stdout: create 152/36 file after the snapshot 2023-07-29T02:02:56.762 INFO:tasks.workunit.client.0.smithi042.stdout: create 152/37 file after the snapshot 2023-07-29T02:02:56.763 INFO:tasks.workunit.client.0.smithi042.stdout: create 152/38 file after the snapshot 2023-07-29T02:02:56.764 INFO:tasks.workunit.client.0.smithi042.stdout: create 152/39 file after the snapshot 2023-07-29T02:02:56.765 INFO:tasks.workunit.client.0.smithi042.stdout: create 153/.snap/snap-subdir-test 2023-07-29T02:02:56.795 INFO:tasks.workunit.client.0.smithi042.stdout: create 153/30 file after the snapshot 2023-07-29T02:02:56.797 INFO:tasks.workunit.client.0.smithi042.stdout: create 153/31 file after the snapshot 2023-07-29T02:02:56.799 INFO:tasks.workunit.client.0.smithi042.stdout: create 153/32 file after the snapshot 2023-07-29T02:02:56.800 INFO:tasks.workunit.client.0.smithi042.stdout: create 153/33 file after the snapshot 2023-07-29T02:02:56.802 INFO:tasks.workunit.client.0.smithi042.stdout: create 153/34 file after the snapshot 2023-07-29T02:02:56.803 INFO:tasks.workunit.client.0.smithi042.stdout: create 153/35 file after the snapshot 2023-07-29T02:02:56.805 INFO:tasks.workunit.client.0.smithi042.stdout: create 153/36 file after the snapshot 2023-07-29T02:02:56.806 INFO:tasks.workunit.client.0.smithi042.stdout: create 153/37 file after the snapshot 2023-07-29T02:02:56.808 INFO:tasks.workunit.client.0.smithi042.stdout: create 153/38 file after the snapshot 2023-07-29T02:02:56.809 INFO:tasks.workunit.client.0.smithi042.stdout: create 153/39 file after the snapshot 2023-07-29T02:02:56.809 INFO:tasks.workunit.client.0.smithi042.stdout: create 154/.snap/snap-subdir-test 2023-07-29T02:02:56.839 INFO:tasks.workunit.client.0.smithi042.stdout: create 154/30 file after the snapshot 2023-07-29T02:02:56.843 INFO:tasks.workunit.client.0.smithi042.stdout: create 154/31 file after the snapshot 2023-07-29T02:02:56.845 INFO:tasks.workunit.client.0.smithi042.stdout: create 154/32 file after the snapshot 2023-07-29T02:02:56.848 INFO:tasks.workunit.client.0.smithi042.stdout: create 154/33 file after the snapshot 2023-07-29T02:02:56.850 INFO:tasks.workunit.client.0.smithi042.stdout: create 154/34 file after the snapshot 2023-07-29T02:02:56.852 INFO:tasks.workunit.client.0.smithi042.stdout: create 154/35 file after the snapshot 2023-07-29T02:02:56.854 INFO:tasks.workunit.client.0.smithi042.stdout: create 154/36 file after the snapshot 2023-07-29T02:02:56.855 INFO:tasks.workunit.client.0.smithi042.stdout: create 154/37 file after the snapshot 2023-07-29T02:02:56.856 INFO:tasks.workunit.client.0.smithi042.stdout: create 154/38 file after the snapshot 2023-07-29T02:02:56.857 INFO:tasks.workunit.client.0.smithi042.stdout: create 154/39 file after the snapshot 2023-07-29T02:02:56.857 INFO:tasks.workunit.client.0.smithi042.stdout: create 155/.snap/snap-subdir-test 2023-07-29T02:02:56.888 INFO:tasks.workunit.client.0.smithi042.stdout: create 155/30 file after the snapshot 2023-07-29T02:02:56.890 INFO:tasks.workunit.client.0.smithi042.stdout: create 155/31 file after the snapshot 2023-07-29T02:02:56.892 INFO:tasks.workunit.client.0.smithi042.stdout: create 155/32 file after the snapshot 2023-07-29T02:02:56.894 INFO:tasks.workunit.client.0.smithi042.stdout: create 155/33 file after the snapshot 2023-07-29T02:02:56.895 INFO:tasks.workunit.client.0.smithi042.stdout: create 155/34 file after the snapshot 2023-07-29T02:02:56.897 INFO:tasks.workunit.client.0.smithi042.stdout: create 155/35 file after the snapshot 2023-07-29T02:02:56.898 INFO:tasks.workunit.client.0.smithi042.stdout: create 155/36 file after the snapshot 2023-07-29T02:02:56.900 INFO:tasks.workunit.client.0.smithi042.stdout: create 155/37 file after the snapshot 2023-07-29T02:02:56.901 INFO:tasks.workunit.client.0.smithi042.stdout: create 155/38 file after the snapshot 2023-07-29T02:02:56.902 INFO:tasks.workunit.client.0.smithi042.stdout: create 155/39 file after the snapshot 2023-07-29T02:02:56.903 INFO:tasks.workunit.client.0.smithi042.stdout: create 156/.snap/snap-subdir-test 2023-07-29T02:02:56.931 INFO:tasks.workunit.client.0.smithi042.stdout: create 156/30 file after the snapshot 2023-07-29T02:02:56.933 INFO:tasks.workunit.client.0.smithi042.stdout: create 156/31 file after the snapshot 2023-07-29T02:02:56.935 INFO:tasks.workunit.client.0.smithi042.stdout: create 156/32 file after the snapshot 2023-07-29T02:02:56.937 INFO:tasks.workunit.client.0.smithi042.stdout: create 156/33 file after the snapshot 2023-07-29T02:02:56.938 INFO:tasks.workunit.client.0.smithi042.stdout: create 156/34 file after the snapshot 2023-07-29T02:02:56.940 INFO:tasks.workunit.client.0.smithi042.stdout: create 156/35 file after the snapshot 2023-07-29T02:02:56.942 INFO:tasks.workunit.client.0.smithi042.stdout: create 156/36 file after the snapshot 2023-07-29T02:02:56.943 INFO:tasks.workunit.client.0.smithi042.stdout: create 156/37 file after the snapshot 2023-07-29T02:02:56.945 INFO:tasks.workunit.client.0.smithi042.stdout: create 156/38 file after the snapshot 2023-07-29T02:02:56.946 INFO:tasks.workunit.client.0.smithi042.stdout: create 156/39 file after the snapshot 2023-07-29T02:02:56.946 INFO:tasks.workunit.client.0.smithi042.stdout: create 157/.snap/snap-subdir-test 2023-07-29T02:02:56.975 INFO:tasks.workunit.client.0.smithi042.stdout: create 157/30 file after the snapshot 2023-07-29T02:02:56.977 INFO:tasks.workunit.client.0.smithi042.stdout: create 157/31 file after the snapshot 2023-07-29T02:02:56.979 INFO:tasks.workunit.client.0.smithi042.stdout: create 157/32 file after the snapshot 2023-07-29T02:02:56.980 INFO:tasks.workunit.client.0.smithi042.stdout: create 157/33 file after the snapshot 2023-07-29T02:02:56.982 INFO:tasks.workunit.client.0.smithi042.stdout: create 157/34 file after the snapshot 2023-07-29T02:02:56.984 INFO:tasks.workunit.client.0.smithi042.stdout: create 157/35 file after the snapshot 2023-07-29T02:02:56.985 INFO:tasks.workunit.client.0.smithi042.stdout: create 157/36 file after the snapshot 2023-07-29T02:02:56.987 INFO:tasks.workunit.client.0.smithi042.stdout: create 157/37 file after the snapshot 2023-07-29T02:02:56.988 INFO:tasks.workunit.client.0.smithi042.stdout: create 157/38 file after the snapshot 2023-07-29T02:02:56.989 INFO:tasks.workunit.client.0.smithi042.stdout: create 157/39 file after the snapshot 2023-07-29T02:02:56.990 INFO:tasks.workunit.client.0.smithi042.stdout: create 158/.snap/snap-subdir-test 2023-07-29T02:02:57.018 INFO:tasks.workunit.client.0.smithi042.stdout: create 158/30 file after the snapshot 2023-07-29T02:02:57.021 INFO:tasks.workunit.client.0.smithi042.stdout: create 158/31 file after the snapshot 2023-07-29T02:02:57.022 INFO:tasks.workunit.client.0.smithi042.stdout: create 158/32 file after the snapshot 2023-07-29T02:02:57.024 INFO:tasks.workunit.client.0.smithi042.stdout: create 158/33 file after the snapshot 2023-07-29T02:02:57.026 INFO:tasks.workunit.client.0.smithi042.stdout: create 158/34 file after the snapshot 2023-07-29T02:02:57.028 INFO:tasks.workunit.client.0.smithi042.stdout: create 158/35 file after the snapshot 2023-07-29T02:02:57.030 INFO:tasks.workunit.client.0.smithi042.stdout: create 158/36 file after the snapshot 2023-07-29T02:02:57.032 INFO:tasks.workunit.client.0.smithi042.stdout: create 158/37 file after the snapshot 2023-07-29T02:02:57.032 INFO:tasks.workunit.client.0.smithi042.stdout: create 158/38 file after the snapshot 2023-07-29T02:02:57.033 INFO:tasks.workunit.client.0.smithi042.stdout: create 158/39 file after the snapshot 2023-07-29T02:02:57.034 INFO:tasks.workunit.client.0.smithi042.stdout: create 159/.snap/snap-subdir-test 2023-07-29T02:02:57.063 INFO:tasks.workunit.client.0.smithi042.stdout: create 159/30 file after the snapshot 2023-07-29T02:02:57.077 INFO:tasks.workunit.client.0.smithi042.stdout: create 159/31 file after the snapshot 2023-07-29T02:02:57.078 INFO:tasks.workunit.client.0.smithi042.stdout: create 159/32 file after the snapshot 2023-07-29T02:02:57.080 INFO:tasks.workunit.client.0.smithi042.stdout: create 159/33 file after the snapshot 2023-07-29T02:02:57.080 INFO:tasks.workunit.client.0.smithi042.stdout: create 159/34 file after the snapshot 2023-07-29T02:02:57.081 INFO:tasks.workunit.client.0.smithi042.stdout: create 159/35 file after the snapshot 2023-07-29T02:02:57.081 INFO:tasks.workunit.client.0.smithi042.stdout: create 159/36 file after the snapshot 2023-07-29T02:02:57.081 INFO:tasks.workunit.client.0.smithi042.stdout: create 159/37 file after the snapshot 2023-07-29T02:02:57.082 INFO:tasks.workunit.client.0.smithi042.stdout: create 159/38 file after the snapshot 2023-07-29T02:02:57.082 INFO:tasks.workunit.client.0.smithi042.stdout: create 159/39 file after the snapshot 2023-07-29T02:02:57.083 INFO:tasks.workunit.client.0.smithi042.stdout: create 160/.snap/snap-subdir-test 2023-07-29T02:02:57.112 INFO:tasks.workunit.client.0.smithi042.stdout: create 160/30 file after the snapshot 2023-07-29T02:02:57.126 INFO:tasks.workunit.client.0.smithi042.stdout: create 160/31 file after the snapshot 2023-07-29T02:02:57.126 INFO:tasks.workunit.client.0.smithi042.stdout: create 160/32 file after the snapshot 2023-07-29T02:02:57.127 INFO:tasks.workunit.client.0.smithi042.stdout: create 160/33 file after the snapshot 2023-07-29T02:02:57.128 INFO:tasks.workunit.client.0.smithi042.stdout: create 160/34 file after the snapshot 2023-07-29T02:02:57.128 INFO:tasks.workunit.client.0.smithi042.stdout: create 160/35 file after the snapshot 2023-07-29T02:02:57.129 INFO:tasks.workunit.client.0.smithi042.stdout: create 160/36 file after the snapshot 2023-07-29T02:02:57.129 INFO:tasks.workunit.client.0.smithi042.stdout: create 160/37 file after the snapshot 2023-07-29T02:02:57.130 INFO:tasks.workunit.client.0.smithi042.stdout: create 160/38 file after the snapshot 2023-07-29T02:02:57.131 INFO:tasks.workunit.client.0.smithi042.stdout: create 160/39 file after the snapshot 2023-07-29T02:02:57.131 INFO:tasks.workunit.client.0.smithi042.stdout: create 161/.snap/snap-subdir-test 2023-07-29T02:02:57.160 INFO:tasks.workunit.client.0.smithi042.stdout: create 161/30 file after the snapshot 2023-07-29T02:02:57.161 INFO:tasks.workunit.client.0.smithi042.stdout: create 161/31 file after the snapshot 2023-07-29T02:02:57.163 INFO:tasks.workunit.client.0.smithi042.stdout: create 161/32 file after the snapshot 2023-07-29T02:02:57.165 INFO:tasks.workunit.client.0.smithi042.stdout: create 161/33 file after the snapshot 2023-07-29T02:02:57.166 INFO:tasks.workunit.client.0.smithi042.stdout: create 161/34 file after the snapshot 2023-07-29T02:02:57.168 INFO:tasks.workunit.client.0.smithi042.stdout: create 161/35 file after the snapshot 2023-07-29T02:02:57.170 INFO:tasks.workunit.client.0.smithi042.stdout: create 161/36 file after the snapshot 2023-07-29T02:02:57.171 INFO:tasks.workunit.client.0.smithi042.stdout: create 161/37 file after the snapshot 2023-07-29T02:02:57.173 INFO:tasks.workunit.client.0.smithi042.stdout: create 161/38 file after the snapshot 2023-07-29T02:02:57.173 INFO:tasks.workunit.client.0.smithi042.stdout: create 161/39 file after the snapshot 2023-07-29T02:02:57.174 INFO:tasks.workunit.client.0.smithi042.stdout: create 162/.snap/snap-subdir-test 2023-07-29T02:02:57.204 INFO:tasks.workunit.client.0.smithi042.stdout: create 162/30 file after the snapshot 2023-07-29T02:02:57.216 INFO:tasks.workunit.client.0.smithi042.stdout: create 162/31 file after the snapshot 2023-07-29T02:02:57.216 INFO:tasks.workunit.client.0.smithi042.stdout: create 162/32 file after the snapshot 2023-07-29T02:02:57.217 INFO:tasks.workunit.client.0.smithi042.stdout: create 162/33 file after the snapshot 2023-07-29T02:02:57.218 INFO:tasks.workunit.client.0.smithi042.stdout: create 162/34 file after the snapshot 2023-07-29T02:02:57.218 INFO:tasks.workunit.client.0.smithi042.stdout: create 162/35 file after the snapshot 2023-07-29T02:02:57.219 INFO:tasks.workunit.client.0.smithi042.stdout: create 162/36 file after the snapshot 2023-07-29T02:02:57.220 INFO:tasks.workunit.client.0.smithi042.stdout: create 162/37 file after the snapshot 2023-07-29T02:02:57.220 INFO:tasks.workunit.client.0.smithi042.stdout: create 162/38 file after the snapshot 2023-07-29T02:02:57.221 INFO:tasks.workunit.client.0.smithi042.stdout: create 162/39 file after the snapshot 2023-07-29T02:02:57.222 INFO:tasks.workunit.client.0.smithi042.stdout: create 163/.snap/snap-subdir-test 2023-07-29T02:02:57.250 INFO:tasks.workunit.client.0.smithi042.stdout: create 163/30 file after the snapshot 2023-07-29T02:02:57.252 INFO:tasks.workunit.client.0.smithi042.stdout: create 163/31 file after the snapshot 2023-07-29T02:02:57.254 INFO:tasks.workunit.client.0.smithi042.stdout: create 163/32 file after the snapshot 2023-07-29T02:02:57.257 INFO:tasks.workunit.client.0.smithi042.stdout: create 163/33 file after the snapshot 2023-07-29T02:02:57.259 INFO:tasks.workunit.client.0.smithi042.stdout: create 163/34 file after the snapshot 2023-07-29T02:02:57.262 INFO:tasks.workunit.client.0.smithi042.stdout: create 163/35 file after the snapshot 2023-07-29T02:02:57.263 INFO:tasks.workunit.client.0.smithi042.stdout: create 163/36 file after the snapshot 2023-07-29T02:02:57.264 INFO:tasks.workunit.client.0.smithi042.stdout: create 163/37 file after the snapshot 2023-07-29T02:02:57.265 INFO:tasks.workunit.client.0.smithi042.stdout: create 163/38 file after the snapshot 2023-07-29T02:02:57.266 INFO:tasks.workunit.client.0.smithi042.stdout: create 163/39 file after the snapshot 2023-07-29T02:02:57.267 INFO:tasks.workunit.client.0.smithi042.stdout: create 164/.snap/snap-subdir-test 2023-07-29T02:02:57.306 INFO:tasks.workunit.client.0.smithi042.stdout: create 164/30 file after the snapshot 2023-07-29T02:02:57.309 INFO:tasks.workunit.client.0.smithi042.stdout: create 164/31 file after the snapshot 2023-07-29T02:02:57.311 INFO:tasks.workunit.client.0.smithi042.stdout: create 164/32 file after the snapshot 2023-07-29T02:02:57.314 INFO:tasks.workunit.client.0.smithi042.stdout: create 164/33 file after the snapshot 2023-07-29T02:02:57.316 INFO:tasks.workunit.client.0.smithi042.stdout: create 164/34 file after the snapshot 2023-07-29T02:02:57.318 INFO:tasks.workunit.client.0.smithi042.stdout: create 164/35 file after the snapshot 2023-07-29T02:02:57.319 INFO:tasks.workunit.client.0.smithi042.stdout: create 164/36 file after the snapshot 2023-07-29T02:02:57.320 INFO:tasks.workunit.client.0.smithi042.stdout: create 164/37 file after the snapshot 2023-07-29T02:02:57.321 INFO:tasks.workunit.client.0.smithi042.stdout: create 164/38 file after the snapshot 2023-07-29T02:02:57.322 INFO:tasks.workunit.client.0.smithi042.stdout: create 164/39 file after the snapshot 2023-07-29T02:02:57.323 INFO:tasks.workunit.client.0.smithi042.stdout: create 165/.snap/snap-subdir-test 2023-07-29T02:02:57.354 INFO:tasks.workunit.client.0.smithi042.stdout: create 165/30 file after the snapshot 2023-07-29T02:02:57.355 INFO:tasks.workunit.client.0.smithi042.stdout: create 165/31 file after the snapshot 2023-07-29T02:02:57.357 INFO:tasks.workunit.client.0.smithi042.stdout: create 165/32 file after the snapshot 2023-07-29T02:02:57.359 INFO:tasks.workunit.client.0.smithi042.stdout: create 165/33 file after the snapshot 2023-07-29T02:02:57.360 INFO:tasks.workunit.client.0.smithi042.stdout: create 165/34 file after the snapshot 2023-07-29T02:02:57.362 INFO:tasks.workunit.client.0.smithi042.stdout: create 165/35 file after the snapshot 2023-07-29T02:02:57.364 INFO:tasks.workunit.client.0.smithi042.stdout: create 165/36 file after the snapshot 2023-07-29T02:02:57.366 INFO:tasks.workunit.client.0.smithi042.stdout: create 165/37 file after the snapshot 2023-07-29T02:02:57.368 INFO:tasks.workunit.client.0.smithi042.stdout: create 165/38 file after the snapshot 2023-07-29T02:02:57.369 INFO:tasks.workunit.client.0.smithi042.stdout: create 165/39 file after the snapshot 2023-07-29T02:02:57.370 INFO:tasks.workunit.client.0.smithi042.stdout: create 166/.snap/snap-subdir-test 2023-07-29T02:02:57.410 INFO:tasks.workunit.client.0.smithi042.stdout: create 166/30 file after the snapshot 2023-07-29T02:02:57.412 INFO:tasks.workunit.client.0.smithi042.stdout: create 166/31 file after the snapshot 2023-07-29T02:02:57.413 INFO:tasks.workunit.client.0.smithi042.stdout: create 166/32 file after the snapshot 2023-07-29T02:02:57.415 INFO:tasks.workunit.client.0.smithi042.stdout: create 166/33 file after the snapshot 2023-07-29T02:02:57.416 INFO:tasks.workunit.client.0.smithi042.stdout: create 166/34 file after the snapshot 2023-07-29T02:02:57.418 INFO:tasks.workunit.client.0.smithi042.stdout: create 166/35 file after the snapshot 2023-07-29T02:02:57.420 INFO:tasks.workunit.client.0.smithi042.stdout: create 166/36 file after the snapshot 2023-07-29T02:02:57.421 INFO:tasks.workunit.client.0.smithi042.stdout: create 166/37 file after the snapshot 2023-07-29T02:02:57.421 INFO:tasks.workunit.client.0.smithi042.stdout: create 166/38 file after the snapshot 2023-07-29T02:02:57.422 INFO:tasks.workunit.client.0.smithi042.stdout: create 166/39 file after the snapshot 2023-07-29T02:02:57.423 INFO:tasks.workunit.client.0.smithi042.stdout: create 167/.snap/snap-subdir-test 2023-07-29T02:02:57.459 INFO:tasks.workunit.client.0.smithi042.stdout: create 167/30 file after the snapshot 2023-07-29T02:02:57.461 INFO:tasks.workunit.client.0.smithi042.stdout: create 167/31 file after the snapshot 2023-07-29T02:02:57.463 INFO:tasks.workunit.client.0.smithi042.stdout: create 167/32 file after the snapshot 2023-07-29T02:02:57.465 INFO:tasks.workunit.client.0.smithi042.stdout: create 167/33 file after the snapshot 2023-07-29T02:02:57.466 INFO:tasks.workunit.client.0.smithi042.stdout: create 167/34 file after the snapshot 2023-07-29T02:02:57.468 INFO:tasks.workunit.client.0.smithi042.stdout: create 167/35 file after the snapshot 2023-07-29T02:02:57.469 INFO:tasks.workunit.client.0.smithi042.stdout: create 167/36 file after the snapshot 2023-07-29T02:02:57.471 INFO:tasks.workunit.client.0.smithi042.stdout: create 167/37 file after the snapshot 2023-07-29T02:02:57.473 INFO:tasks.workunit.client.0.smithi042.stdout: create 167/38 file after the snapshot 2023-07-29T02:02:57.473 INFO:tasks.workunit.client.0.smithi042.stdout: create 167/39 file after the snapshot 2023-07-29T02:02:57.474 INFO:tasks.workunit.client.0.smithi042.stdout: create 168/.snap/snap-subdir-test 2023-07-29T02:02:57.506 INFO:tasks.workunit.client.0.smithi042.stdout: create 168/30 file after the snapshot 2023-07-29T02:02:57.508 INFO:tasks.workunit.client.0.smithi042.stdout: create 168/31 file after the snapshot 2023-07-29T02:02:57.509 INFO:tasks.workunit.client.0.smithi042.stdout: create 168/32 file after the snapshot 2023-07-29T02:02:57.511 INFO:tasks.workunit.client.0.smithi042.stdout: create 168/33 file after the snapshot 2023-07-29T02:02:57.513 INFO:tasks.workunit.client.0.smithi042.stdout: create 168/34 file after the snapshot 2023-07-29T02:02:57.514 INFO:tasks.workunit.client.0.smithi042.stdout: create 168/35 file after the snapshot 2023-07-29T02:02:57.516 INFO:tasks.workunit.client.0.smithi042.stdout: create 168/36 file after the snapshot 2023-07-29T02:02:57.517 INFO:tasks.workunit.client.0.smithi042.stdout: create 168/37 file after the snapshot 2023-07-29T02:02:57.518 INFO:tasks.workunit.client.0.smithi042.stdout: create 168/38 file after the snapshot 2023-07-29T02:02:57.519 INFO:tasks.workunit.client.0.smithi042.stdout: create 168/39 file after the snapshot 2023-07-29T02:02:57.519 INFO:tasks.workunit.client.0.smithi042.stdout: create 169/.snap/snap-subdir-test 2023-07-29T02:02:57.547 INFO:tasks.workunit.client.0.smithi042.stdout: create 169/30 file after the snapshot 2023-07-29T02:02:57.549 INFO:tasks.workunit.client.0.smithi042.stdout: create 169/31 file after the snapshot 2023-07-29T02:02:57.550 INFO:tasks.workunit.client.0.smithi042.stdout: create 169/32 file after the snapshot 2023-07-29T02:02:57.552 INFO:tasks.workunit.client.0.smithi042.stdout: create 169/33 file after the snapshot 2023-07-29T02:02:57.553 INFO:tasks.workunit.client.0.smithi042.stdout: create 169/34 file after the snapshot 2023-07-29T02:02:57.555 INFO:tasks.workunit.client.0.smithi042.stdout: create 169/35 file after the snapshot 2023-07-29T02:02:57.557 INFO:tasks.workunit.client.0.smithi042.stdout: create 169/36 file after the snapshot 2023-07-29T02:02:57.560 INFO:tasks.workunit.client.0.smithi042.stdout: create 169/37 file after the snapshot 2023-07-29T02:02:57.561 INFO:tasks.workunit.client.0.smithi042.stdout: create 169/38 file after the snapshot 2023-07-29T02:02:57.562 INFO:tasks.workunit.client.0.smithi042.stdout: create 169/39 file after the snapshot 2023-07-29T02:02:57.563 INFO:tasks.workunit.client.0.smithi042.stdout: create 170/.snap/snap-subdir-test 2023-07-29T02:02:57.600 INFO:tasks.workunit.client.0.smithi042.stdout: create 170/30 file after the snapshot 2023-07-29T02:02:57.602 INFO:tasks.workunit.client.0.smithi042.stdout: create 170/31 file after the snapshot 2023-07-29T02:02:57.604 INFO:tasks.workunit.client.0.smithi042.stdout: create 170/32 file after the snapshot 2023-07-29T02:02:57.605 INFO:tasks.workunit.client.0.smithi042.stdout: create 170/33 file after the snapshot 2023-07-29T02:02:57.607 INFO:tasks.workunit.client.0.smithi042.stdout: create 170/34 file after the snapshot 2023-07-29T02:02:57.609 INFO:tasks.workunit.client.0.smithi042.stdout: create 170/35 file after the snapshot 2023-07-29T02:02:57.610 INFO:tasks.workunit.client.0.smithi042.stdout: create 170/36 file after the snapshot 2023-07-29T02:02:57.612 INFO:tasks.workunit.client.0.smithi042.stdout: create 170/37 file after the snapshot 2023-07-29T02:02:57.613 INFO:tasks.workunit.client.0.smithi042.stdout: create 170/38 file after the snapshot 2023-07-29T02:02:57.614 INFO:tasks.workunit.client.0.smithi042.stdout: create 170/39 file after the snapshot 2023-07-29T02:02:57.615 INFO:tasks.workunit.client.0.smithi042.stdout: create 171/.snap/snap-subdir-test 2023-07-29T02:02:57.651 INFO:tasks.workunit.client.0.smithi042.stdout: create 171/30 file after the snapshot 2023-07-29T02:02:57.653 INFO:tasks.workunit.client.0.smithi042.stdout: create 171/31 file after the snapshot 2023-07-29T02:02:57.655 INFO:tasks.workunit.client.0.smithi042.stdout: create 171/32 file after the snapshot 2023-07-29T02:02:57.656 INFO:tasks.workunit.client.0.smithi042.stdout: create 171/33 file after the snapshot 2023-07-29T02:02:57.658 INFO:tasks.workunit.client.0.smithi042.stdout: create 171/34 file after the snapshot 2023-07-29T02:02:57.659 INFO:tasks.workunit.client.0.smithi042.stdout: create 171/35 file after the snapshot 2023-07-29T02:02:57.661 INFO:tasks.workunit.client.0.smithi042.stdout: create 171/36 file after the snapshot 2023-07-29T02:02:57.662 INFO:tasks.workunit.client.0.smithi042.stdout: create 171/37 file after the snapshot 2023-07-29T02:02:57.664 INFO:tasks.workunit.client.0.smithi042.stdout: create 171/38 file after the snapshot 2023-07-29T02:02:57.665 INFO:tasks.workunit.client.0.smithi042.stdout: create 171/39 file after the snapshot 2023-07-29T02:02:57.666 INFO:tasks.workunit.client.0.smithi042.stdout: create 172/.snap/snap-subdir-test 2023-07-29T02:02:57.702 INFO:tasks.workunit.client.0.smithi042.stdout: create 172/30 file after the snapshot 2023-07-29T02:02:57.704 INFO:tasks.workunit.client.0.smithi042.stdout: create 172/31 file after the snapshot 2023-07-29T02:02:57.706 INFO:tasks.workunit.client.0.smithi042.stdout: create 172/32 file after the snapshot 2023-07-29T02:02:57.708 INFO:tasks.workunit.client.0.smithi042.stdout: create 172/33 file after the snapshot 2023-07-29T02:02:57.709 INFO:tasks.workunit.client.0.smithi042.stdout: create 172/34 file after the snapshot 2023-07-29T02:02:57.711 INFO:tasks.workunit.client.0.smithi042.stdout: create 172/35 file after the snapshot 2023-07-29T02:02:57.712 INFO:tasks.workunit.client.0.smithi042.stdout: create 172/36 file after the snapshot 2023-07-29T02:02:57.714 INFO:tasks.workunit.client.0.smithi042.stdout: create 172/37 file after the snapshot 2023-07-29T02:02:57.716 INFO:tasks.workunit.client.0.smithi042.stdout: create 172/38 file after the snapshot 2023-07-29T02:02:57.716 INFO:tasks.workunit.client.0.smithi042.stdout: create 172/39 file after the snapshot 2023-07-29T02:02:57.717 INFO:tasks.workunit.client.0.smithi042.stdout: create 173/.snap/snap-subdir-test 2023-07-29T02:02:57.746 INFO:tasks.workunit.client.0.smithi042.stdout: create 173/30 file after the snapshot 2023-07-29T02:02:57.749 INFO:tasks.workunit.client.0.smithi042.stdout: create 173/31 file after the snapshot 2023-07-29T02:02:57.750 INFO:tasks.workunit.client.0.smithi042.stdout: create 173/32 file after the snapshot 2023-07-29T02:02:57.752 INFO:tasks.workunit.client.0.smithi042.stdout: create 173/33 file after the snapshot 2023-07-29T02:02:57.753 INFO:tasks.workunit.client.0.smithi042.stdout: create 173/34 file after the snapshot 2023-07-29T02:02:57.755 INFO:tasks.workunit.client.0.smithi042.stdout: create 173/35 file after the snapshot 2023-07-29T02:02:57.756 INFO:tasks.workunit.client.0.smithi042.stdout: create 173/36 file after the snapshot 2023-07-29T02:02:57.758 INFO:tasks.workunit.client.0.smithi042.stdout: create 173/37 file after the snapshot 2023-07-29T02:02:57.759 INFO:tasks.workunit.client.0.smithi042.stdout: create 173/38 file after the snapshot 2023-07-29T02:02:57.760 INFO:tasks.workunit.client.0.smithi042.stdout: create 173/39 file after the snapshot 2023-07-29T02:02:57.761 INFO:tasks.workunit.client.0.smithi042.stdout: create 174/.snap/snap-subdir-test 2023-07-29T02:02:57.797 INFO:tasks.workunit.client.0.smithi042.stdout: create 174/30 file after the snapshot 2023-07-29T02:02:57.799 INFO:tasks.workunit.client.0.smithi042.stdout: create 174/31 file after the snapshot 2023-07-29T02:02:57.801 INFO:tasks.workunit.client.0.smithi042.stdout: create 174/32 file after the snapshot 2023-07-29T02:02:57.802 INFO:tasks.workunit.client.0.smithi042.stdout: create 174/33 file after the snapshot 2023-07-29T02:02:57.804 INFO:tasks.workunit.client.0.smithi042.stdout: create 174/34 file after the snapshot 2023-07-29T02:02:57.805 INFO:tasks.workunit.client.0.smithi042.stdout: create 174/35 file after the snapshot 2023-07-29T02:02:57.807 INFO:tasks.workunit.client.0.smithi042.stdout: create 174/36 file after the snapshot 2023-07-29T02:02:57.809 INFO:tasks.workunit.client.0.smithi042.stdout: create 174/37 file after the snapshot 2023-07-29T02:02:57.810 INFO:tasks.workunit.client.0.smithi042.stdout: create 174/38 file after the snapshot 2023-07-29T02:02:57.811 INFO:tasks.workunit.client.0.smithi042.stdout: create 174/39 file after the snapshot 2023-07-29T02:02:57.811 INFO:tasks.workunit.client.0.smithi042.stdout: create 175/.snap/snap-subdir-test 2023-07-29T02:02:57.839 INFO:tasks.workunit.client.0.smithi042.stdout: create 175/30 file after the snapshot 2023-07-29T02:02:57.841 INFO:tasks.workunit.client.0.smithi042.stdout: create 175/31 file after the snapshot 2023-07-29T02:02:57.843 INFO:tasks.workunit.client.0.smithi042.stdout: create 175/32 file after the snapshot 2023-07-29T02:02:57.845 INFO:tasks.workunit.client.0.smithi042.stdout: create 175/33 file after the snapshot 2023-07-29T02:02:57.846 INFO:tasks.workunit.client.0.smithi042.stdout: create 175/34 file after the snapshot 2023-07-29T02:02:57.848 INFO:tasks.workunit.client.0.smithi042.stdout: create 175/35 file after the snapshot 2023-07-29T02:02:57.849 INFO:tasks.workunit.client.0.smithi042.stdout: create 175/36 file after the snapshot 2023-07-29T02:02:57.851 INFO:tasks.workunit.client.0.smithi042.stdout: create 175/37 file after the snapshot 2023-07-29T02:02:57.852 INFO:tasks.workunit.client.0.smithi042.stdout: create 175/38 file after the snapshot 2023-07-29T02:02:57.853 INFO:tasks.workunit.client.0.smithi042.stdout: create 175/39 file after the snapshot 2023-07-29T02:02:57.854 INFO:tasks.workunit.client.0.smithi042.stdout: create 176/.snap/snap-subdir-test 2023-07-29T02:02:57.883 INFO:tasks.workunit.client.0.smithi042.stdout: create 176/30 file after the snapshot 2023-07-29T02:02:57.885 INFO:tasks.workunit.client.0.smithi042.stdout: create 176/31 file after the snapshot 2023-07-29T02:02:57.887 INFO:tasks.workunit.client.0.smithi042.stdout: create 176/32 file after the snapshot 2023-07-29T02:02:57.888 INFO:tasks.workunit.client.0.smithi042.stdout: create 176/33 file after the snapshot 2023-07-29T02:02:57.890 INFO:tasks.workunit.client.0.smithi042.stdout: create 176/34 file after the snapshot 2023-07-29T02:02:57.892 INFO:tasks.workunit.client.0.smithi042.stdout: create 176/35 file after the snapshot 2023-07-29T02:02:57.893 INFO:tasks.workunit.client.0.smithi042.stdout: create 176/36 file after the snapshot 2023-07-29T02:02:57.895 INFO:tasks.workunit.client.0.smithi042.stdout: create 176/37 file after the snapshot 2023-07-29T02:02:57.895 INFO:tasks.workunit.client.0.smithi042.stdout: create 176/38 file after the snapshot 2023-07-29T02:02:57.896 INFO:tasks.workunit.client.0.smithi042.stdout: create 176/39 file after the snapshot 2023-07-29T02:02:57.897 INFO:tasks.workunit.client.0.smithi042.stdout: create 177/.snap/snap-subdir-test 2023-07-29T02:02:57.924 INFO:tasks.workunit.client.0.smithi042.stdout: create 177/30 file after the snapshot 2023-07-29T02:02:57.926 INFO:tasks.workunit.client.0.smithi042.stdout: create 177/31 file after the snapshot 2023-07-29T02:02:57.928 INFO:tasks.workunit.client.0.smithi042.stdout: create 177/32 file after the snapshot 2023-07-29T02:02:57.929 INFO:tasks.workunit.client.0.smithi042.stdout: create 177/33 file after the snapshot 2023-07-29T02:02:57.931 INFO:tasks.workunit.client.0.smithi042.stdout: create 177/34 file after the snapshot 2023-07-29T02:02:57.932 INFO:tasks.workunit.client.0.smithi042.stdout: create 177/35 file after the snapshot 2023-07-29T02:02:57.933 INFO:tasks.workunit.client.0.smithi042.stdout: create 177/36 file after the snapshot 2023-07-29T02:02:57.935 INFO:tasks.workunit.client.0.smithi042.stdout: create 177/37 file after the snapshot 2023-07-29T02:02:57.937 INFO:tasks.workunit.client.0.smithi042.stdout: create 177/38 file after the snapshot 2023-07-29T02:02:57.938 INFO:tasks.workunit.client.0.smithi042.stdout: create 177/39 file after the snapshot 2023-07-29T02:02:57.939 INFO:tasks.workunit.client.0.smithi042.stdout: create 178/.snap/snap-subdir-test 2023-07-29T02:02:57.967 INFO:tasks.workunit.client.0.smithi042.stdout: create 178/30 file after the snapshot 2023-07-29T02:02:57.969 INFO:tasks.workunit.client.0.smithi042.stdout: create 178/31 file after the snapshot 2023-07-29T02:02:57.970 INFO:tasks.workunit.client.0.smithi042.stdout: create 178/32 file after the snapshot 2023-07-29T02:02:57.972 INFO:tasks.workunit.client.0.smithi042.stdout: create 178/33 file after the snapshot 2023-07-29T02:02:57.975 INFO:tasks.workunit.client.0.smithi042.stdout: create 178/34 file after the snapshot 2023-07-29T02:02:57.978 INFO:tasks.workunit.client.0.smithi042.stdout: create 178/35 file after the snapshot 2023-07-29T02:02:57.980 INFO:tasks.workunit.client.0.smithi042.stdout: create 178/36 file after the snapshot 2023-07-29T02:02:57.981 INFO:tasks.workunit.client.0.smithi042.stdout: create 178/37 file after the snapshot 2023-07-29T02:02:57.982 INFO:tasks.workunit.client.0.smithi042.stdout: create 178/38 file after the snapshot 2023-07-29T02:02:57.983 INFO:tasks.workunit.client.0.smithi042.stdout: create 178/39 file after the snapshot 2023-07-29T02:02:57.983 INFO:tasks.workunit.client.0.smithi042.stdout: create 179/.snap/snap-subdir-test 2023-07-29T02:02:58.011 INFO:tasks.workunit.client.0.smithi042.stdout: create 179/30 file after the snapshot 2023-07-29T02:02:58.013 INFO:tasks.workunit.client.0.smithi042.stdout: create 179/31 file after the snapshot 2023-07-29T02:02:58.015 INFO:tasks.workunit.client.0.smithi042.stdout: create 179/32 file after the snapshot 2023-07-29T02:02:58.016 INFO:tasks.workunit.client.0.smithi042.stdout: create 179/33 file after the snapshot 2023-07-29T02:02:58.018 INFO:tasks.workunit.client.0.smithi042.stdout: create 179/34 file after the snapshot 2023-07-29T02:02:58.019 INFO:tasks.workunit.client.0.smithi042.stdout: create 179/35 file after the snapshot 2023-07-29T02:02:58.021 INFO:tasks.workunit.client.0.smithi042.stdout: create 179/36 file after the snapshot 2023-07-29T02:02:58.022 INFO:tasks.workunit.client.0.smithi042.stdout: create 179/37 file after the snapshot 2023-07-29T02:02:58.025 INFO:tasks.workunit.client.0.smithi042.stdout: create 179/38 file after the snapshot 2023-07-29T02:02:58.026 INFO:tasks.workunit.client.0.smithi042.stdout: create 179/39 file after the snapshot 2023-07-29T02:02:58.026 INFO:tasks.workunit.client.0.smithi042.stdout: create 180/.snap/snap-subdir-test 2023-07-29T02:02:58.053 INFO:tasks.workunit.client.0.smithi042.stdout: create 180/30 file after the snapshot 2023-07-29T02:02:58.055 INFO:tasks.workunit.client.0.smithi042.stdout: create 180/31 file after the snapshot 2023-07-29T02:02:58.056 INFO:tasks.workunit.client.0.smithi042.stdout: create 180/32 file after the snapshot 2023-07-29T02:02:58.058 INFO:tasks.workunit.client.0.smithi042.stdout: create 180/33 file after the snapshot 2023-07-29T02:02:58.059 INFO:tasks.workunit.client.0.smithi042.stdout: create 180/34 file after the snapshot 2023-07-29T02:02:58.061 INFO:tasks.workunit.client.0.smithi042.stdout: create 180/35 file after the snapshot 2023-07-29T02:02:58.062 INFO:tasks.workunit.client.0.smithi042.stdout: create 180/36 file after the snapshot 2023-07-29T02:02:58.064 INFO:tasks.workunit.client.0.smithi042.stdout: create 180/37 file after the snapshot 2023-07-29T02:02:58.066 INFO:tasks.workunit.client.0.smithi042.stdout: create 180/38 file after the snapshot 2023-07-29T02:02:58.067 INFO:tasks.workunit.client.0.smithi042.stdout: create 180/39 file after the snapshot 2023-07-29T02:02:58.067 INFO:tasks.workunit.client.0.smithi042.stdout: create 181/.snap/snap-subdir-test 2023-07-29T02:02:58.095 INFO:tasks.workunit.client.0.smithi042.stdout: create 181/30 file after the snapshot 2023-07-29T02:02:58.097 INFO:tasks.workunit.client.0.smithi042.stdout: create 181/31 file after the snapshot 2023-07-29T02:02:58.098 INFO:tasks.workunit.client.0.smithi042.stdout: create 181/32 file after the snapshot 2023-07-29T02:02:58.100 INFO:tasks.workunit.client.0.smithi042.stdout: create 181/33 file after the snapshot 2023-07-29T02:02:58.101 INFO:tasks.workunit.client.0.smithi042.stdout: create 181/34 file after the snapshot 2023-07-29T02:02:58.103 INFO:tasks.workunit.client.0.smithi042.stdout: create 181/35 file after the snapshot 2023-07-29T02:02:58.104 INFO:tasks.workunit.client.0.smithi042.stdout: create 181/36 file after the snapshot 2023-07-29T02:02:58.106 INFO:tasks.workunit.client.0.smithi042.stdout: create 181/37 file after the snapshot 2023-07-29T02:02:58.107 INFO:tasks.workunit.client.0.smithi042.stdout: create 181/38 file after the snapshot 2023-07-29T02:02:58.108 INFO:tasks.workunit.client.0.smithi042.stdout: create 181/39 file after the snapshot 2023-07-29T02:02:58.109 INFO:tasks.workunit.client.0.smithi042.stdout: create 182/.snap/snap-subdir-test 2023-07-29T02:02:58.136 INFO:tasks.workunit.client.0.smithi042.stdout: create 182/30 file after the snapshot 2023-07-29T02:02:58.138 INFO:tasks.workunit.client.0.smithi042.stdout: create 182/31 file after the snapshot 2023-07-29T02:02:58.140 INFO:tasks.workunit.client.0.smithi042.stdout: create 182/32 file after the snapshot 2023-07-29T02:02:58.141 INFO:tasks.workunit.client.0.smithi042.stdout: create 182/33 file after the snapshot 2023-07-29T02:02:58.143 INFO:tasks.workunit.client.0.smithi042.stdout: create 182/34 file after the snapshot 2023-07-29T02:02:58.144 INFO:tasks.workunit.client.0.smithi042.stdout: create 182/35 file after the snapshot 2023-07-29T02:02:58.146 INFO:tasks.workunit.client.0.smithi042.stdout: create 182/36 file after the snapshot 2023-07-29T02:02:58.148 INFO:tasks.workunit.client.0.smithi042.stdout: create 182/37 file after the snapshot 2023-07-29T02:02:58.149 INFO:tasks.workunit.client.0.smithi042.stdout: create 182/38 file after the snapshot 2023-07-29T02:02:58.150 INFO:tasks.workunit.client.0.smithi042.stdout: create 182/39 file after the snapshot 2023-07-29T02:02:58.151 INFO:tasks.workunit.client.0.smithi042.stdout: create 183/.snap/snap-subdir-test 2023-07-29T02:02:58.178 INFO:tasks.workunit.client.0.smithi042.stdout: create 183/30 file after the snapshot 2023-07-29T02:02:58.181 INFO:tasks.workunit.client.0.smithi042.stdout: create 183/31 file after the snapshot 2023-07-29T02:02:58.183 INFO:tasks.workunit.client.0.smithi042.stdout: create 183/32 file after the snapshot 2023-07-29T02:02:58.184 INFO:tasks.workunit.client.0.smithi042.stdout: create 183/33 file after the snapshot 2023-07-29T02:02:58.186 INFO:tasks.workunit.client.0.smithi042.stdout: create 183/34 file after the snapshot 2023-07-29T02:02:58.188 INFO:tasks.workunit.client.0.smithi042.stdout: create 183/35 file after the snapshot 2023-07-29T02:02:58.190 INFO:tasks.workunit.client.0.smithi042.stdout: create 183/36 file after the snapshot 2023-07-29T02:02:58.192 INFO:tasks.workunit.client.0.smithi042.stdout: create 183/37 file after the snapshot 2023-07-29T02:02:58.192 INFO:tasks.workunit.client.0.smithi042.stdout: create 183/38 file after the snapshot 2023-07-29T02:02:58.193 INFO:tasks.workunit.client.0.smithi042.stdout: create 183/39 file after the snapshot 2023-07-29T02:02:58.194 INFO:tasks.workunit.client.0.smithi042.stdout: create 184/.snap/snap-subdir-test 2023-07-29T02:02:58.221 INFO:tasks.workunit.client.0.smithi042.stdout: create 184/30 file after the snapshot 2023-07-29T02:02:58.223 INFO:tasks.workunit.client.0.smithi042.stdout: create 184/31 file after the snapshot 2023-07-29T02:02:58.225 INFO:tasks.workunit.client.0.smithi042.stdout: create 184/32 file after the snapshot 2023-07-29T02:02:58.227 INFO:tasks.workunit.client.0.smithi042.stdout: create 184/33 file after the snapshot 2023-07-29T02:02:58.228 INFO:tasks.workunit.client.0.smithi042.stdout: create 184/34 file after the snapshot 2023-07-29T02:02:58.230 INFO:tasks.workunit.client.0.smithi042.stdout: create 184/35 file after the snapshot 2023-07-29T02:02:58.231 INFO:tasks.workunit.client.0.smithi042.stdout: create 184/36 file after the snapshot 2023-07-29T02:02:58.233 INFO:tasks.workunit.client.0.smithi042.stdout: create 184/37 file after the snapshot 2023-07-29T02:02:58.234 INFO:tasks.workunit.client.0.smithi042.stdout: create 184/38 file after the snapshot 2023-07-29T02:02:58.235 INFO:tasks.workunit.client.0.smithi042.stdout: create 184/39 file after the snapshot 2023-07-29T02:02:58.236 INFO:tasks.workunit.client.0.smithi042.stdout: create 185/.snap/snap-subdir-test 2023-07-29T02:02:58.266 INFO:tasks.workunit.client.0.smithi042.stdout: create 185/30 file after the snapshot 2023-07-29T02:02:58.267 INFO:tasks.workunit.client.0.smithi042.stdout: create 185/31 file after the snapshot 2023-07-29T02:02:58.269 INFO:tasks.workunit.client.0.smithi042.stdout: create 185/32 file after the snapshot 2023-07-29T02:02:58.270 INFO:tasks.workunit.client.0.smithi042.stdout: create 185/33 file after the snapshot 2023-07-29T02:02:58.272 INFO:tasks.workunit.client.0.smithi042.stdout: create 185/34 file after the snapshot 2023-07-29T02:02:58.273 INFO:tasks.workunit.client.0.smithi042.stdout: create 185/35 file after the snapshot 2023-07-29T02:02:58.275 INFO:tasks.workunit.client.0.smithi042.stdout: create 185/36 file after the snapshot 2023-07-29T02:02:58.276 INFO:tasks.workunit.client.0.smithi042.stdout: create 185/37 file after the snapshot 2023-07-29T02:02:58.277 INFO:tasks.workunit.client.0.smithi042.stdout: create 185/38 file after the snapshot 2023-07-29T02:02:58.277 INFO:tasks.workunit.client.0.smithi042.stdout: create 185/39 file after the snapshot 2023-07-29T02:02:58.278 INFO:tasks.workunit.client.0.smithi042.stdout: create 186/.snap/snap-subdir-test 2023-07-29T02:02:58.306 INFO:tasks.workunit.client.0.smithi042.stdout: create 186/30 file after the snapshot 2023-07-29T02:02:58.308 INFO:tasks.workunit.client.0.smithi042.stdout: create 186/31 file after the snapshot 2023-07-29T02:02:58.309 INFO:tasks.workunit.client.0.smithi042.stdout: create 186/32 file after the snapshot 2023-07-29T02:02:58.310 INFO:tasks.workunit.client.0.smithi042.stdout: create 186/33 file after the snapshot 2023-07-29T02:02:58.312 INFO:tasks.workunit.client.0.smithi042.stdout: create 186/34 file after the snapshot 2023-07-29T02:02:58.314 INFO:tasks.workunit.client.0.smithi042.stdout: create 186/35 file after the snapshot 2023-07-29T02:02:58.315 INFO:tasks.workunit.client.0.smithi042.stdout: create 186/36 file after the snapshot 2023-07-29T02:02:58.316 INFO:tasks.workunit.client.0.smithi042.stdout: create 186/37 file after the snapshot 2023-07-29T02:02:58.318 INFO:tasks.workunit.client.0.smithi042.stdout: create 186/38 file after the snapshot 2023-07-29T02:02:58.319 INFO:tasks.workunit.client.0.smithi042.stdout: create 186/39 file after the snapshot 2023-07-29T02:02:58.320 INFO:tasks.workunit.client.0.smithi042.stdout: create 187/.snap/snap-subdir-test 2023-07-29T02:02:58.350 INFO:tasks.workunit.client.0.smithi042.stdout: create 187/30 file after the snapshot 2023-07-29T02:02:58.354 INFO:tasks.workunit.client.0.smithi042.stdout: create 187/31 file after the snapshot 2023-07-29T02:02:58.357 INFO:tasks.workunit.client.0.smithi042.stdout: create 187/32 file after the snapshot 2023-07-29T02:02:58.360 INFO:tasks.workunit.client.0.smithi042.stdout: create 187/33 file after the snapshot 2023-07-29T02:02:58.361 INFO:tasks.workunit.client.0.smithi042.stdout: create 187/34 file after the snapshot 2023-07-29T02:02:58.362 INFO:tasks.workunit.client.0.smithi042.stdout: create 187/35 file after the snapshot 2023-07-29T02:02:58.362 INFO:tasks.workunit.client.0.smithi042.stdout: create 187/36 file after the snapshot 2023-07-29T02:02:58.363 INFO:tasks.workunit.client.0.smithi042.stdout: create 187/37 file after the snapshot 2023-07-29T02:02:58.364 INFO:tasks.workunit.client.0.smithi042.stdout: create 187/38 file after the snapshot 2023-07-29T02:02:58.364 INFO:tasks.workunit.client.0.smithi042.stdout: create 187/39 file after the snapshot 2023-07-29T02:02:58.365 INFO:tasks.workunit.client.0.smithi042.stdout: create 188/.snap/snap-subdir-test 2023-07-29T02:02:58.391 INFO:tasks.workunit.client.0.smithi042.stdout: create 188/30 file after the snapshot 2023-07-29T02:02:58.393 INFO:tasks.workunit.client.0.smithi042.stdout: create 188/31 file after the snapshot 2023-07-29T02:02:58.395 INFO:tasks.workunit.client.0.smithi042.stdout: create 188/32 file after the snapshot 2023-07-29T02:02:58.396 INFO:tasks.workunit.client.0.smithi042.stdout: create 188/33 file after the snapshot 2023-07-29T02:02:58.398 INFO:tasks.workunit.client.0.smithi042.stdout: create 188/34 file after the snapshot 2023-07-29T02:02:58.400 INFO:tasks.workunit.client.0.smithi042.stdout: create 188/35 file after the snapshot 2023-07-29T02:02:58.401 INFO:tasks.workunit.client.0.smithi042.stdout: create 188/36 file after the snapshot 2023-07-29T02:02:58.403 INFO:tasks.workunit.client.0.smithi042.stdout: create 188/37 file after the snapshot 2023-07-29T02:02:58.405 INFO:tasks.workunit.client.0.smithi042.stdout: create 188/38 file after the snapshot 2023-07-29T02:02:58.406 INFO:tasks.workunit.client.0.smithi042.stdout: create 188/39 file after the snapshot 2023-07-29T02:02:58.406 INFO:tasks.workunit.client.0.smithi042.stdout: create 189/.snap/snap-subdir-test 2023-07-29T02:02:58.436 INFO:tasks.workunit.client.0.smithi042.stdout: create 189/30 file after the snapshot 2023-07-29T02:02:58.448 INFO:tasks.workunit.client.0.smithi042.stdout: create 189/31 file after the snapshot 2023-07-29T02:02:58.449 INFO:tasks.workunit.client.0.smithi042.stdout: create 189/32 file after the snapshot 2023-07-29T02:02:58.449 INFO:tasks.workunit.client.0.smithi042.stdout: create 189/33 file after the snapshot 2023-07-29T02:02:58.450 INFO:tasks.workunit.client.0.smithi042.stdout: create 189/34 file after the snapshot 2023-07-29T02:02:58.450 INFO:tasks.workunit.client.0.smithi042.stdout: create 189/35 file after the snapshot 2023-07-29T02:02:58.451 INFO:tasks.workunit.client.0.smithi042.stdout: create 189/36 file after the snapshot 2023-07-29T02:02:58.452 INFO:tasks.workunit.client.0.smithi042.stdout: create 189/37 file after the snapshot 2023-07-29T02:02:58.452 INFO:tasks.workunit.client.0.smithi042.stdout: create 189/38 file after the snapshot 2023-07-29T02:02:58.453 INFO:tasks.workunit.client.0.smithi042.stdout: create 189/39 file after the snapshot 2023-07-29T02:02:58.454 INFO:tasks.workunit.client.0.smithi042.stdout: create 190/.snap/snap-subdir-test 2023-07-29T02:02:58.480 INFO:tasks.workunit.client.0.smithi042.stdout: create 190/30 file after the snapshot 2023-07-29T02:02:58.482 INFO:tasks.workunit.client.0.smithi042.stdout: create 190/31 file after the snapshot 2023-07-29T02:02:58.484 INFO:tasks.workunit.client.0.smithi042.stdout: create 190/32 file after the snapshot 2023-07-29T02:02:58.486 INFO:tasks.workunit.client.0.smithi042.stdout: create 190/33 file after the snapshot 2023-07-29T02:02:58.487 INFO:tasks.workunit.client.0.smithi042.stdout: create 190/34 file after the snapshot 2023-07-29T02:02:58.489 INFO:tasks.workunit.client.0.smithi042.stdout: create 190/35 file after the snapshot 2023-07-29T02:02:58.490 INFO:tasks.workunit.client.0.smithi042.stdout: create 190/36 file after the snapshot 2023-07-29T02:02:58.492 INFO:tasks.workunit.client.0.smithi042.stdout: create 190/37 file after the snapshot 2023-07-29T02:02:58.493 INFO:tasks.workunit.client.0.smithi042.stdout: create 190/38 file after the snapshot 2023-07-29T02:02:58.495 INFO:tasks.workunit.client.0.smithi042.stdout: create 190/39 file after the snapshot 2023-07-29T02:02:58.495 INFO:tasks.workunit.client.0.smithi042.stdout: create 191/.snap/snap-subdir-test 2023-07-29T02:02:58.525 INFO:tasks.workunit.client.0.smithi042.stdout: create 191/30 file after the snapshot 2023-07-29T02:02:58.527 INFO:tasks.workunit.client.0.smithi042.stdout: create 191/31 file after the snapshot 2023-07-29T02:02:58.528 INFO:tasks.workunit.client.0.smithi042.stdout: create 191/32 file after the snapshot 2023-07-29T02:02:58.530 INFO:tasks.workunit.client.0.smithi042.stdout: create 191/33 file after the snapshot 2023-07-29T02:02:58.532 INFO:tasks.workunit.client.0.smithi042.stdout: create 191/34 file after the snapshot 2023-07-29T02:02:58.533 INFO:tasks.workunit.client.0.smithi042.stdout: create 191/35 file after the snapshot 2023-07-29T02:02:58.535 INFO:tasks.workunit.client.0.smithi042.stdout: create 191/36 file after the snapshot 2023-07-29T02:02:58.536 INFO:tasks.workunit.client.0.smithi042.stdout: create 191/37 file after the snapshot 2023-07-29T02:02:58.536 INFO:tasks.workunit.client.0.smithi042.stdout: create 191/38 file after the snapshot 2023-07-29T02:02:58.537 INFO:tasks.workunit.client.0.smithi042.stdout: create 191/39 file after the snapshot 2023-07-29T02:02:58.538 INFO:tasks.workunit.client.0.smithi042.stdout: create 192/.snap/snap-subdir-test 2023-07-29T02:02:58.565 INFO:tasks.workunit.client.0.smithi042.stdout: create 192/30 file after the snapshot 2023-07-29T02:02:58.567 INFO:tasks.workunit.client.0.smithi042.stdout: create 192/31 file after the snapshot 2023-07-29T02:02:58.568 INFO:tasks.workunit.client.0.smithi042.stdout: create 192/32 file after the snapshot 2023-07-29T02:02:58.570 INFO:tasks.workunit.client.0.smithi042.stdout: create 192/33 file after the snapshot 2023-07-29T02:02:58.571 INFO:tasks.workunit.client.0.smithi042.stdout: create 192/34 file after the snapshot 2023-07-29T02:02:58.573 INFO:tasks.workunit.client.0.smithi042.stdout: create 192/35 file after the snapshot 2023-07-29T02:02:58.574 INFO:tasks.workunit.client.0.smithi042.stdout: create 192/36 file after the snapshot 2023-07-29T02:02:58.576 INFO:tasks.workunit.client.0.smithi042.stdout: create 192/37 file after the snapshot 2023-07-29T02:02:58.577 INFO:tasks.workunit.client.0.smithi042.stdout: create 192/38 file after the snapshot 2023-07-29T02:02:58.578 INFO:tasks.workunit.client.0.smithi042.stdout: create 192/39 file after the snapshot 2023-07-29T02:02:58.579 INFO:tasks.workunit.client.0.smithi042.stdout: create 193/.snap/snap-subdir-test 2023-07-29T02:02:58.607 INFO:tasks.workunit.client.0.smithi042.stdout: create 193/30 file after the snapshot 2023-07-29T02:02:58.608 INFO:tasks.workunit.client.0.smithi042.stdout: create 193/31 file after the snapshot 2023-07-29T02:02:58.610 INFO:tasks.workunit.client.0.smithi042.stdout: create 193/32 file after the snapshot 2023-07-29T02:02:58.611 INFO:tasks.workunit.client.0.smithi042.stdout: create 193/33 file after the snapshot 2023-07-29T02:02:58.613 INFO:tasks.workunit.client.0.smithi042.stdout: create 193/34 file after the snapshot 2023-07-29T02:02:58.615 INFO:tasks.workunit.client.0.smithi042.stdout: create 193/35 file after the snapshot 2023-07-29T02:02:58.616 INFO:tasks.workunit.client.0.smithi042.stdout: create 193/36 file after the snapshot 2023-07-29T02:02:58.618 INFO:tasks.workunit.client.0.smithi042.stdout: create 193/37 file after the snapshot 2023-07-29T02:02:58.619 INFO:tasks.workunit.client.0.smithi042.stdout: create 193/38 file after the snapshot 2023-07-29T02:02:58.620 INFO:tasks.workunit.client.0.smithi042.stdout: create 193/39 file after the snapshot 2023-07-29T02:02:58.621 INFO:tasks.workunit.client.0.smithi042.stdout: create 194/.snap/snap-subdir-test 2023-07-29T02:02:58.649 INFO:tasks.workunit.client.0.smithi042.stdout: create 194/30 file after the snapshot 2023-07-29T02:02:58.650 INFO:tasks.workunit.client.0.smithi042.stdout: create 194/31 file after the snapshot 2023-07-29T02:02:58.652 INFO:tasks.workunit.client.0.smithi042.stdout: create 194/32 file after the snapshot 2023-07-29T02:02:58.653 INFO:tasks.workunit.client.0.smithi042.stdout: create 194/33 file after the snapshot 2023-07-29T02:02:58.655 INFO:tasks.workunit.client.0.smithi042.stdout: create 194/34 file after the snapshot 2023-07-29T02:02:58.656 INFO:tasks.workunit.client.0.smithi042.stdout: create 194/35 file after the snapshot 2023-07-29T02:02:58.657 INFO:tasks.workunit.client.0.smithi042.stdout: create 194/36 file after the snapshot 2023-07-29T02:02:58.659 INFO:tasks.workunit.client.0.smithi042.stdout: create 194/37 file after the snapshot 2023-07-29T02:02:58.661 INFO:tasks.workunit.client.0.smithi042.stdout: create 194/38 file after the snapshot 2023-07-29T02:02:58.661 INFO:tasks.workunit.client.0.smithi042.stdout: create 194/39 file after the snapshot 2023-07-29T02:02:58.662 INFO:tasks.workunit.client.0.smithi042.stdout: create 195/.snap/snap-subdir-test 2023-07-29T02:02:58.689 INFO:tasks.workunit.client.0.smithi042.stdout: create 195/30 file after the snapshot 2023-07-29T02:02:58.691 INFO:tasks.workunit.client.0.smithi042.stdout: create 195/31 file after the snapshot 2023-07-29T02:02:58.692 INFO:tasks.workunit.client.0.smithi042.stdout: create 195/32 file after the snapshot 2023-07-29T02:02:58.694 INFO:tasks.workunit.client.0.smithi042.stdout: create 195/33 file after the snapshot 2023-07-29T02:02:58.695 INFO:tasks.workunit.client.0.smithi042.stdout: create 195/34 file after the snapshot 2023-07-29T02:02:58.697 INFO:tasks.workunit.client.0.smithi042.stdout: create 195/35 file after the snapshot 2023-07-29T02:02:58.698 INFO:tasks.workunit.client.0.smithi042.stdout: create 195/36 file after the snapshot 2023-07-29T02:02:58.700 INFO:tasks.workunit.client.0.smithi042.stdout: create 195/37 file after the snapshot 2023-07-29T02:02:58.701 INFO:tasks.workunit.client.0.smithi042.stdout: create 195/38 file after the snapshot 2023-07-29T02:02:58.702 INFO:tasks.workunit.client.0.smithi042.stdout: create 195/39 file after the snapshot 2023-07-29T02:02:58.703 INFO:tasks.workunit.client.0.smithi042.stdout: create 196/.snap/snap-subdir-test 2023-07-29T02:02:58.732 INFO:tasks.workunit.client.0.smithi042.stdout: create 196/30 file after the snapshot 2023-07-29T02:02:58.734 INFO:tasks.workunit.client.0.smithi042.stdout: create 196/31 file after the snapshot 2023-07-29T02:02:58.735 INFO:tasks.workunit.client.0.smithi042.stdout: create 196/32 file after the snapshot 2023-07-29T02:02:58.737 INFO:tasks.workunit.client.0.smithi042.stdout: create 196/33 file after the snapshot 2023-07-29T02:02:58.738 INFO:tasks.workunit.client.0.smithi042.stdout: create 196/34 file after the snapshot 2023-07-29T02:02:58.740 INFO:tasks.workunit.client.0.smithi042.stdout: create 196/35 file after the snapshot 2023-07-29T02:02:58.742 INFO:tasks.workunit.client.0.smithi042.stdout: create 196/36 file after the snapshot 2023-07-29T02:02:58.743 INFO:tasks.workunit.client.0.smithi042.stdout: create 196/37 file after the snapshot 2023-07-29T02:02:58.744 INFO:tasks.workunit.client.0.smithi042.stdout: create 196/38 file after the snapshot 2023-07-29T02:02:58.744 INFO:tasks.workunit.client.0.smithi042.stdout: create 196/39 file after the snapshot 2023-07-29T02:02:58.745 INFO:tasks.workunit.client.0.smithi042.stdout: create 197/.snap/snap-subdir-test 2023-07-29T02:02:58.775 INFO:tasks.workunit.client.0.smithi042.stdout: create 197/30 file after the snapshot 2023-07-29T02:02:58.776 INFO:tasks.workunit.client.0.smithi042.stdout: create 197/31 file after the snapshot 2023-07-29T02:02:58.778 INFO:tasks.workunit.client.0.smithi042.stdout: create 197/32 file after the snapshot 2023-07-29T02:02:58.780 INFO:tasks.workunit.client.0.smithi042.stdout: create 197/33 file after the snapshot 2023-07-29T02:02:58.781 INFO:tasks.workunit.client.0.smithi042.stdout: create 197/34 file after the snapshot 2023-07-29T02:02:58.783 INFO:tasks.workunit.client.0.smithi042.stdout: create 197/35 file after the snapshot 2023-07-29T02:02:58.784 INFO:tasks.workunit.client.0.smithi042.stdout: create 197/36 file after the snapshot 2023-07-29T02:02:58.785 INFO:tasks.workunit.client.0.smithi042.stdout: create 197/37 file after the snapshot 2023-07-29T02:02:58.786 INFO:tasks.workunit.client.0.smithi042.stdout: create 197/38 file after the snapshot 2023-07-29T02:02:58.787 INFO:tasks.workunit.client.0.smithi042.stdout: create 197/39 file after the snapshot 2023-07-29T02:02:58.787 INFO:tasks.workunit.client.0.smithi042.stdout: create 198/.snap/snap-subdir-test 2023-07-29T02:02:58.814 INFO:tasks.workunit.client.0.smithi042.stdout: create 198/30 file after the snapshot 2023-07-29T02:02:58.816 INFO:tasks.workunit.client.0.smithi042.stdout: create 198/31 file after the snapshot 2023-07-29T02:02:58.817 INFO:tasks.workunit.client.0.smithi042.stdout: create 198/32 file after the snapshot 2023-07-29T02:02:58.819 INFO:tasks.workunit.client.0.smithi042.stdout: create 198/33 file after the snapshot 2023-07-29T02:02:58.820 INFO:tasks.workunit.client.0.smithi042.stdout: create 198/34 file after the snapshot 2023-07-29T02:02:58.822 INFO:tasks.workunit.client.0.smithi042.stdout: create 198/35 file after the snapshot 2023-07-29T02:02:58.823 INFO:tasks.workunit.client.0.smithi042.stdout: create 198/36 file after the snapshot 2023-07-29T02:02:58.825 INFO:tasks.workunit.client.0.smithi042.stdout: create 198/37 file after the snapshot 2023-07-29T02:02:58.827 INFO:tasks.workunit.client.0.smithi042.stdout: create 198/38 file after the snapshot 2023-07-29T02:02:58.828 INFO:tasks.workunit.client.0.smithi042.stdout: create 198/39 file after the snapshot 2023-07-29T02:02:58.828 INFO:tasks.workunit.client.0.smithi042.stdout: create 199/.snap/snap-subdir-test 2023-07-29T02:02:58.862 INFO:tasks.workunit.client.0.smithi042.stdout: create 199/30 file after the snapshot 2023-07-29T02:02:58.864 INFO:tasks.workunit.client.0.smithi042.stdout: create 199/31 file after the snapshot 2023-07-29T02:02:58.866 INFO:tasks.workunit.client.0.smithi042.stdout: create 199/32 file after the snapshot 2023-07-29T02:02:58.867 INFO:tasks.workunit.client.0.smithi042.stdout: create 199/33 file after the snapshot 2023-07-29T02:02:58.869 INFO:tasks.workunit.client.0.smithi042.stdout: create 199/34 file after the snapshot 2023-07-29T02:02:58.870 INFO:tasks.workunit.client.0.smithi042.stdout: create 199/35 file after the snapshot 2023-07-29T02:02:58.872 INFO:tasks.workunit.client.0.smithi042.stdout: create 199/36 file after the snapshot 2023-07-29T02:02:58.874 INFO:tasks.workunit.client.0.smithi042.stdout: create 199/37 file after the snapshot 2023-07-29T02:02:58.876 INFO:tasks.workunit.client.0.smithi042.stdout: create 199/38 file after the snapshot 2023-07-29T02:02:58.876 INFO:tasks.workunit.client.0.smithi042.stdout: create 199/39 file after the snapshot 2023-07-29T02:02:58.877 INFO:tasks.workunit.client.0.smithi042.stdout: create 200/.snap/snap-subdir-test 2023-07-29T02:02:58.905 INFO:tasks.workunit.client.0.smithi042.stdout: create 200/30 file after the snapshot 2023-07-29T02:02:58.907 INFO:tasks.workunit.client.0.smithi042.stdout: create 200/31 file after the snapshot 2023-07-29T02:02:58.908 INFO:tasks.workunit.client.0.smithi042.stdout: create 200/32 file after the snapshot 2023-07-29T02:02:58.910 INFO:tasks.workunit.client.0.smithi042.stdout: create 200/33 file after the snapshot 2023-07-29T02:02:58.912 INFO:tasks.workunit.client.0.smithi042.stdout: create 200/34 file after the snapshot 2023-07-29T02:02:58.915 INFO:tasks.workunit.client.0.smithi042.stdout: create 200/35 file after the snapshot 2023-07-29T02:02:58.916 INFO:tasks.workunit.client.0.smithi042.stdout: create 200/36 file after the snapshot 2023-07-29T02:02:58.918 INFO:tasks.workunit.client.0.smithi042.stdout: create 200/37 file after the snapshot 2023-07-29T02:02:58.919 INFO:tasks.workunit.client.0.smithi042.stdout: create 200/38 file after the snapshot 2023-07-29T02:02:58.919 INFO:tasks.workunit.client.0.smithi042.stdout: create 200/39 file after the snapshot 2023-07-29T02:02:58.920 INFO:tasks.workunit.client.0.smithi042.stdout: create 201/.snap/snap-subdir-test 2023-07-29T02:02:58.946 INFO:tasks.workunit.client.0.smithi042.stdout: create 201/30 file after the snapshot 2023-07-29T02:02:58.949 INFO:tasks.workunit.client.0.smithi042.stdout: create 201/31 file after the snapshot 2023-07-29T02:02:58.950 INFO:tasks.workunit.client.0.smithi042.stdout: create 201/32 file after the snapshot 2023-07-29T02:02:58.953 INFO:tasks.workunit.client.0.smithi042.stdout: create 201/33 file after the snapshot 2023-07-29T02:02:58.955 INFO:tasks.workunit.client.0.smithi042.stdout: create 201/34 file after the snapshot 2023-07-29T02:02:58.956 INFO:tasks.workunit.client.0.smithi042.stdout: create 201/35 file after the snapshot 2023-07-29T02:02:58.958 INFO:tasks.workunit.client.0.smithi042.stdout: create 201/36 file after the snapshot 2023-07-29T02:02:58.960 INFO:tasks.workunit.client.0.smithi042.stdout: create 201/37 file after the snapshot 2023-07-29T02:02:58.961 INFO:tasks.workunit.client.0.smithi042.stdout: create 201/38 file after the snapshot 2023-07-29T02:02:58.961 INFO:tasks.workunit.client.0.smithi042.stdout: create 201/39 file after the snapshot 2023-07-29T02:02:58.962 INFO:tasks.workunit.client.0.smithi042.stdout: create 202/.snap/snap-subdir-test 2023-07-29T02:02:58.988 INFO:tasks.workunit.client.0.smithi042.stdout: create 202/30 file after the snapshot 2023-07-29T02:02:58.991 INFO:tasks.workunit.client.0.smithi042.stdout: create 202/31 file after the snapshot 2023-07-29T02:02:58.992 INFO:tasks.workunit.client.0.smithi042.stdout: create 202/32 file after the snapshot 2023-07-29T02:02:58.994 INFO:tasks.workunit.client.0.smithi042.stdout: create 202/33 file after the snapshot 2023-07-29T02:02:58.996 INFO:tasks.workunit.client.0.smithi042.stdout: create 202/34 file after the snapshot 2023-07-29T02:02:58.998 INFO:tasks.workunit.client.0.smithi042.stdout: create 202/35 file after the snapshot 2023-07-29T02:02:59.000 INFO:tasks.workunit.client.0.smithi042.stdout: create 202/36 file after the snapshot 2023-07-29T02:02:59.002 INFO:tasks.workunit.client.0.smithi042.stdout: create 202/37 file after the snapshot 2023-07-29T02:02:59.003 INFO:tasks.workunit.client.0.smithi042.stdout: create 202/38 file after the snapshot 2023-07-29T02:02:59.003 INFO:tasks.workunit.client.0.smithi042.stdout: create 202/39 file after the snapshot 2023-07-29T02:02:59.004 INFO:tasks.workunit.client.0.smithi042.stdout: create 203/.snap/snap-subdir-test 2023-07-29T02:02:59.030 INFO:tasks.workunit.client.0.smithi042.stdout: create 203/30 file after the snapshot 2023-07-29T02:02:59.033 INFO:tasks.workunit.client.0.smithi042.stdout: create 203/31 file after the snapshot 2023-07-29T02:02:59.035 INFO:tasks.workunit.client.0.smithi042.stdout: create 203/32 file after the snapshot 2023-07-29T02:02:59.036 INFO:tasks.workunit.client.0.smithi042.stdout: create 203/33 file after the snapshot 2023-07-29T02:02:59.038 INFO:tasks.workunit.client.0.smithi042.stdout: create 203/34 file after the snapshot 2023-07-29T02:02:59.040 INFO:tasks.workunit.client.0.smithi042.stdout: create 203/35 file after the snapshot 2023-07-29T02:02:59.042 INFO:tasks.workunit.client.0.smithi042.stdout: create 203/36 file after the snapshot 2023-07-29T02:02:59.044 INFO:tasks.workunit.client.0.smithi042.stdout: create 203/37 file after the snapshot 2023-07-29T02:02:59.044 INFO:tasks.workunit.client.0.smithi042.stdout: create 203/38 file after the snapshot 2023-07-29T02:02:59.045 INFO:tasks.workunit.client.0.smithi042.stdout: create 203/39 file after the snapshot 2023-07-29T02:02:59.045 INFO:tasks.workunit.client.0.smithi042.stdout: create 204/.snap/snap-subdir-test 2023-07-29T02:02:59.073 INFO:tasks.workunit.client.0.smithi042.stdout: create 204/30 file after the snapshot 2023-07-29T02:02:59.074 INFO:tasks.workunit.client.0.smithi042.stdout: create 204/31 file after the snapshot 2023-07-29T02:02:59.076 INFO:tasks.workunit.client.0.smithi042.stdout: create 204/32 file after the snapshot 2023-07-29T02:02:59.077 INFO:tasks.workunit.client.0.smithi042.stdout: create 204/33 file after the snapshot 2023-07-29T02:02:59.079 INFO:tasks.workunit.client.0.smithi042.stdout: create 204/34 file after the snapshot 2023-07-29T02:02:59.080 INFO:tasks.workunit.client.0.smithi042.stdout: create 204/35 file after the snapshot 2023-07-29T02:02:59.082 INFO:tasks.workunit.client.0.smithi042.stdout: create 204/36 file after the snapshot 2023-07-29T02:02:59.083 INFO:tasks.workunit.client.0.smithi042.stdout: create 204/37 file after the snapshot 2023-07-29T02:02:59.084 INFO:tasks.workunit.client.0.smithi042.stdout: create 204/38 file after the snapshot 2023-07-29T02:02:59.085 INFO:tasks.workunit.client.0.smithi042.stdout: create 204/39 file after the snapshot 2023-07-29T02:02:59.086 INFO:tasks.workunit.client.0.smithi042.stdout: create 205/.snap/snap-subdir-test 2023-07-29T02:02:59.116 INFO:tasks.workunit.client.0.smithi042.stdout: create 205/30 file after the snapshot 2023-07-29T02:02:59.118 INFO:tasks.workunit.client.0.smithi042.stdout: create 205/31 file after the snapshot 2023-07-29T02:02:59.119 INFO:tasks.workunit.client.0.smithi042.stdout: create 205/32 file after the snapshot 2023-07-29T02:02:59.121 INFO:tasks.workunit.client.0.smithi042.stdout: create 205/33 file after the snapshot 2023-07-29T02:02:59.122 INFO:tasks.workunit.client.0.smithi042.stdout: create 205/34 file after the snapshot 2023-07-29T02:02:59.123 INFO:tasks.workunit.client.0.smithi042.stdout: create 205/35 file after the snapshot 2023-07-29T02:02:59.125 INFO:tasks.workunit.client.0.smithi042.stdout: create 205/36 file after the snapshot 2023-07-29T02:02:59.126 INFO:tasks.workunit.client.0.smithi042.stdout: create 205/37 file after the snapshot 2023-07-29T02:02:59.127 INFO:tasks.workunit.client.0.smithi042.stdout: create 205/38 file after the snapshot 2023-07-29T02:02:59.128 INFO:tasks.workunit.client.0.smithi042.stdout: create 205/39 file after the snapshot 2023-07-29T02:02:59.128 INFO:tasks.workunit.client.0.smithi042.stdout: create 206/.snap/snap-subdir-test 2023-07-29T02:02:59.156 INFO:tasks.workunit.client.0.smithi042.stdout: create 206/30 file after the snapshot 2023-07-29T02:02:59.157 INFO:tasks.workunit.client.0.smithi042.stdout: create 206/31 file after the snapshot 2023-07-29T02:02:59.159 INFO:tasks.workunit.client.0.smithi042.stdout: create 206/32 file after the snapshot 2023-07-29T02:02:59.160 INFO:tasks.workunit.client.0.smithi042.stdout: create 206/33 file after the snapshot 2023-07-29T02:02:59.162 INFO:tasks.workunit.client.0.smithi042.stdout: create 206/34 file after the snapshot 2023-07-29T02:02:59.163 INFO:tasks.workunit.client.0.smithi042.stdout: create 206/35 file after the snapshot 2023-07-29T02:02:59.165 INFO:tasks.workunit.client.0.smithi042.stdout: create 206/36 file after the snapshot 2023-07-29T02:02:59.166 INFO:tasks.workunit.client.0.smithi042.stdout: create 206/37 file after the snapshot 2023-07-29T02:02:59.168 INFO:tasks.workunit.client.0.smithi042.stdout: create 206/38 file after the snapshot 2023-07-29T02:02:59.169 INFO:tasks.workunit.client.0.smithi042.stdout: create 206/39 file after the snapshot 2023-07-29T02:02:59.169 INFO:tasks.workunit.client.0.smithi042.stdout: create 207/.snap/snap-subdir-test 2023-07-29T02:02:59.197 INFO:tasks.workunit.client.0.smithi042.stdout: create 207/30 file after the snapshot 2023-07-29T02:02:59.201 INFO:tasks.workunit.client.0.smithi042.stdout: create 207/31 file after the snapshot 2023-07-29T02:02:59.204 INFO:tasks.workunit.client.0.smithi042.stdout: create 207/32 file after the snapshot 2023-07-29T02:02:59.205 INFO:tasks.workunit.client.0.smithi042.stdout: create 207/33 file after the snapshot 2023-07-29T02:02:59.207 INFO:tasks.workunit.client.0.smithi042.stdout: create 207/34 file after the snapshot 2023-07-29T02:02:59.208 INFO:tasks.workunit.client.0.smithi042.stdout: create 207/35 file after the snapshot 2023-07-29T02:02:59.209 INFO:tasks.workunit.client.0.smithi042.stdout: create 207/36 file after the snapshot 2023-07-29T02:02:59.210 INFO:tasks.workunit.client.0.smithi042.stdout: create 207/37 file after the snapshot 2023-07-29T02:02:59.211 INFO:tasks.workunit.client.0.smithi042.stdout: create 207/38 file after the snapshot 2023-07-29T02:02:59.211 INFO:tasks.workunit.client.0.smithi042.stdout: create 207/39 file after the snapshot 2023-07-29T02:02:59.212 INFO:tasks.workunit.client.0.smithi042.stdout: create 208/.snap/snap-subdir-test 2023-07-29T02:02:59.238 INFO:tasks.workunit.client.0.smithi042.stdout: create 208/30 file after the snapshot 2023-07-29T02:02:59.240 INFO:tasks.workunit.client.0.smithi042.stdout: create 208/31 file after the snapshot 2023-07-29T02:02:59.242 INFO:tasks.workunit.client.0.smithi042.stdout: create 208/32 file after the snapshot 2023-07-29T02:02:59.243 INFO:tasks.workunit.client.0.smithi042.stdout: create 208/33 file after the snapshot 2023-07-29T02:02:59.244 INFO:tasks.workunit.client.0.smithi042.stdout: create 208/34 file after the snapshot 2023-07-29T02:02:59.246 INFO:tasks.workunit.client.0.smithi042.stdout: create 208/35 file after the snapshot 2023-07-29T02:02:59.248 INFO:tasks.workunit.client.0.smithi042.stdout: create 208/36 file after the snapshot 2023-07-29T02:02:59.249 INFO:tasks.workunit.client.0.smithi042.stdout: create 208/37 file after the snapshot 2023-07-29T02:02:59.251 INFO:tasks.workunit.client.0.smithi042.stdout: create 208/38 file after the snapshot 2023-07-29T02:02:59.252 INFO:tasks.workunit.client.0.smithi042.stdout: create 208/39 file after the snapshot 2023-07-29T02:02:59.253 INFO:tasks.workunit.client.0.smithi042.stdout: create 209/.snap/snap-subdir-test 2023-07-29T02:02:59.279 INFO:tasks.workunit.client.0.smithi042.stdout: create 209/30 file after the snapshot 2023-07-29T02:02:59.281 INFO:tasks.workunit.client.0.smithi042.stdout: create 209/31 file after the snapshot 2023-07-29T02:02:59.283 INFO:tasks.workunit.client.0.smithi042.stdout: create 209/32 file after the snapshot 2023-07-29T02:02:59.284 INFO:tasks.workunit.client.0.smithi042.stdout: create 209/33 file after the snapshot 2023-07-29T02:02:59.286 INFO:tasks.workunit.client.0.smithi042.stdout: create 209/34 file after the snapshot 2023-07-29T02:02:59.287 INFO:tasks.workunit.client.0.smithi042.stdout: create 209/35 file after the snapshot 2023-07-29T02:02:59.289 INFO:tasks.workunit.client.0.smithi042.stdout: create 209/36 file after the snapshot 2023-07-29T02:02:59.291 INFO:tasks.workunit.client.0.smithi042.stdout: create 209/37 file after the snapshot 2023-07-29T02:02:59.292 INFO:tasks.workunit.client.0.smithi042.stdout: create 209/38 file after the snapshot 2023-07-29T02:02:59.293 INFO:tasks.workunit.client.0.smithi042.stdout: create 209/39 file after the snapshot 2023-07-29T02:02:59.294 INFO:tasks.workunit.client.0.smithi042.stdout: create 210/.snap/snap-subdir-test 2023-07-29T02:02:59.321 INFO:tasks.workunit.client.0.smithi042.stdout: create 210/30 file after the snapshot 2023-07-29T02:02:59.322 INFO:tasks.workunit.client.0.smithi042.stdout: create 210/31 file after the snapshot 2023-07-29T02:02:59.324 INFO:tasks.workunit.client.0.smithi042.stdout: create 210/32 file after the snapshot 2023-07-29T02:02:59.326 INFO:tasks.workunit.client.0.smithi042.stdout: create 210/33 file after the snapshot 2023-07-29T02:02:59.327 INFO:tasks.workunit.client.0.smithi042.stdout: create 210/34 file after the snapshot 2023-07-29T02:02:59.329 INFO:tasks.workunit.client.0.smithi042.stdout: create 210/35 file after the snapshot 2023-07-29T02:02:59.330 INFO:tasks.workunit.client.0.smithi042.stdout: create 210/36 file after the snapshot 2023-07-29T02:02:59.332 INFO:tasks.workunit.client.0.smithi042.stdout: create 210/37 file after the snapshot 2023-07-29T02:02:59.333 INFO:tasks.workunit.client.0.smithi042.stdout: create 210/38 file after the snapshot 2023-07-29T02:02:59.334 INFO:tasks.workunit.client.0.smithi042.stdout: create 210/39 file after the snapshot 2023-07-29T02:02:59.335 INFO:tasks.workunit.client.0.smithi042.stdout: create 211/.snap/snap-subdir-test 2023-07-29T02:02:59.361 INFO:tasks.workunit.client.0.smithi042.stdout: create 211/30 file after the snapshot 2023-07-29T02:02:59.363 INFO:tasks.workunit.client.0.smithi042.stdout: create 211/31 file after the snapshot 2023-07-29T02:02:59.365 INFO:tasks.workunit.client.0.smithi042.stdout: create 211/32 file after the snapshot 2023-07-29T02:02:59.366 INFO:tasks.workunit.client.0.smithi042.stdout: create 211/33 file after the snapshot 2023-07-29T02:02:59.368 INFO:tasks.workunit.client.0.smithi042.stdout: create 211/34 file after the snapshot 2023-07-29T02:02:59.369 INFO:tasks.workunit.client.0.smithi042.stdout: create 211/35 file after the snapshot 2023-07-29T02:02:59.371 INFO:tasks.workunit.client.0.smithi042.stdout: create 211/36 file after the snapshot 2023-07-29T02:02:59.372 INFO:tasks.workunit.client.0.smithi042.stdout: create 211/37 file after the snapshot 2023-07-29T02:02:59.374 INFO:tasks.workunit.client.0.smithi042.stdout: create 211/38 file after the snapshot 2023-07-29T02:02:59.375 INFO:tasks.workunit.client.0.smithi042.stdout: create 211/39 file after the snapshot 2023-07-29T02:02:59.376 INFO:tasks.workunit.client.0.smithi042.stdout: create 212/.snap/snap-subdir-test 2023-07-29T02:02:59.409 INFO:tasks.workunit.client.0.smithi042.stdout: create 212/30 file after the snapshot 2023-07-29T02:02:59.412 INFO:tasks.workunit.client.0.smithi042.stdout: create 212/31 file after the snapshot 2023-07-29T02:02:59.414 INFO:tasks.workunit.client.0.smithi042.stdout: create 212/32 file after the snapshot 2023-07-29T02:02:59.417 INFO:tasks.workunit.client.0.smithi042.stdout: create 212/33 file after the snapshot 2023-07-29T02:02:59.419 INFO:tasks.workunit.client.0.smithi042.stdout: create 212/34 file after the snapshot 2023-07-29T02:02:59.422 INFO:tasks.workunit.client.0.smithi042.stdout: create 212/35 file after the snapshot 2023-07-29T02:02:59.423 INFO:tasks.workunit.client.0.smithi042.stdout: create 212/36 file after the snapshot 2023-07-29T02:02:59.424 INFO:tasks.workunit.client.0.smithi042.stdout: create 212/37 file after the snapshot 2023-07-29T02:02:59.425 INFO:tasks.workunit.client.0.smithi042.stdout: create 212/38 file after the snapshot 2023-07-29T02:02:59.426 INFO:tasks.workunit.client.0.smithi042.stdout: create 212/39 file after the snapshot 2023-07-29T02:02:59.427 INFO:tasks.workunit.client.0.smithi042.stdout: create 213/.snap/snap-subdir-test 2023-07-29T02:02:59.455 INFO:tasks.workunit.client.0.smithi042.stdout: create 213/30 file after the snapshot 2023-07-29T02:02:59.459 INFO:tasks.workunit.client.0.smithi042.stdout: create 213/31 file after the snapshot 2023-07-29T02:02:59.461 INFO:tasks.workunit.client.0.smithi042.stdout: create 213/32 file after the snapshot 2023-07-29T02:02:59.463 INFO:tasks.workunit.client.0.smithi042.stdout: create 213/33 file after the snapshot 2023-07-29T02:02:59.466 INFO:tasks.workunit.client.0.smithi042.stdout: create 213/34 file after the snapshot 2023-07-29T02:02:59.468 INFO:tasks.workunit.client.0.smithi042.stdout: create 213/35 file after the snapshot 2023-07-29T02:02:59.469 INFO:tasks.workunit.client.0.smithi042.stdout: create 213/36 file after the snapshot 2023-07-29T02:02:59.470 INFO:tasks.workunit.client.0.smithi042.stdout: create 213/37 file after the snapshot 2023-07-29T02:02:59.470 INFO:tasks.workunit.client.0.smithi042.stdout: create 213/38 file after the snapshot 2023-07-29T02:02:59.471 INFO:tasks.workunit.client.0.smithi042.stdout: create 213/39 file after the snapshot 2023-07-29T02:02:59.472 INFO:tasks.workunit.client.0.smithi042.stdout: create 214/.snap/snap-subdir-test 2023-07-29T02:02:59.499 INFO:tasks.workunit.client.0.smithi042.stdout: create 214/30 file after the snapshot 2023-07-29T02:02:59.503 INFO:tasks.workunit.client.0.smithi042.stdout: create 214/31 file after the snapshot 2023-07-29T02:02:59.505 INFO:tasks.workunit.client.0.smithi042.stdout: create 214/32 file after the snapshot 2023-07-29T02:02:59.507 INFO:tasks.workunit.client.0.smithi042.stdout: create 214/33 file after the snapshot 2023-07-29T02:02:59.510 INFO:tasks.workunit.client.0.smithi042.stdout: create 214/34 file after the snapshot 2023-07-29T02:02:59.512 INFO:tasks.workunit.client.0.smithi042.stdout: create 214/35 file after the snapshot 2023-07-29T02:02:59.513 INFO:tasks.workunit.client.0.smithi042.stdout: create 214/36 file after the snapshot 2023-07-29T02:02:59.514 INFO:tasks.workunit.client.0.smithi042.stdout: create 214/37 file after the snapshot 2023-07-29T02:02:59.514 INFO:tasks.workunit.client.0.smithi042.stdout: create 214/38 file after the snapshot 2023-07-29T02:02:59.515 INFO:tasks.workunit.client.0.smithi042.stdout: create 214/39 file after the snapshot 2023-07-29T02:02:59.516 INFO:tasks.workunit.client.0.smithi042.stdout: create 215/.snap/snap-subdir-test 2023-07-29T02:02:59.542 INFO:tasks.workunit.client.0.smithi042.stdout: create 215/30 file after the snapshot 2023-07-29T02:02:59.544 INFO:tasks.workunit.client.0.smithi042.stdout: create 215/31 file after the snapshot 2023-07-29T02:02:59.546 INFO:tasks.workunit.client.0.smithi042.stdout: create 215/32 file after the snapshot 2023-07-29T02:02:59.548 INFO:tasks.workunit.client.0.smithi042.stdout: create 215/33 file after the snapshot 2023-07-29T02:02:59.549 INFO:tasks.workunit.client.0.smithi042.stdout: create 215/34 file after the snapshot 2023-07-29T02:02:59.551 INFO:tasks.workunit.client.0.smithi042.stdout: create 215/35 file after the snapshot 2023-07-29T02:02:59.553 INFO:tasks.workunit.client.0.smithi042.stdout: create 215/36 file after the snapshot 2023-07-29T02:02:59.555 INFO:tasks.workunit.client.0.smithi042.stdout: create 215/37 file after the snapshot 2023-07-29T02:02:59.556 INFO:tasks.workunit.client.0.smithi042.stdout: create 215/38 file after the snapshot 2023-07-29T02:02:59.557 INFO:tasks.workunit.client.0.smithi042.stdout: create 215/39 file after the snapshot 2023-07-29T02:02:59.557 INFO:tasks.workunit.client.0.smithi042.stdout: create 216/.snap/snap-subdir-test 2023-07-29T02:02:59.584 INFO:tasks.workunit.client.0.smithi042.stdout: create 216/30 file after the snapshot 2023-07-29T02:02:59.586 INFO:tasks.workunit.client.0.smithi042.stdout: create 216/31 file after the snapshot 2023-07-29T02:02:59.587 INFO:tasks.workunit.client.0.smithi042.stdout: create 216/32 file after the snapshot 2023-07-29T02:02:59.589 INFO:tasks.workunit.client.0.smithi042.stdout: create 216/33 file after the snapshot 2023-07-29T02:02:59.591 INFO:tasks.workunit.client.0.smithi042.stdout: create 216/34 file after the snapshot 2023-07-29T02:02:59.593 INFO:tasks.workunit.client.0.smithi042.stdout: create 216/35 file after the snapshot 2023-07-29T02:02:59.595 INFO:tasks.workunit.client.0.smithi042.stdout: create 216/36 file after the snapshot 2023-07-29T02:02:59.596 INFO:tasks.workunit.client.0.smithi042.stdout: create 216/37 file after the snapshot 2023-07-29T02:02:59.598 INFO:tasks.workunit.client.0.smithi042.stdout: create 216/38 file after the snapshot 2023-07-29T02:02:59.598 INFO:tasks.workunit.client.0.smithi042.stdout: create 216/39 file after the snapshot 2023-07-29T02:02:59.599 INFO:tasks.workunit.client.0.smithi042.stdout: create 217/.snap/snap-subdir-test 2023-07-29T02:02:59.625 INFO:tasks.workunit.client.0.smithi042.stdout: create 217/30 file after the snapshot 2023-07-29T02:02:59.627 INFO:tasks.workunit.client.0.smithi042.stdout: create 217/31 file after the snapshot 2023-07-29T02:02:59.629 INFO:tasks.workunit.client.0.smithi042.stdout: create 217/32 file after the snapshot 2023-07-29T02:02:59.630 INFO:tasks.workunit.client.0.smithi042.stdout: create 217/33 file after the snapshot 2023-07-29T02:02:59.632 INFO:tasks.workunit.client.0.smithi042.stdout: create 217/34 file after the snapshot 2023-07-29T02:02:59.634 INFO:tasks.workunit.client.0.smithi042.stdout: create 217/35 file after the snapshot 2023-07-29T02:02:59.635 INFO:tasks.workunit.client.0.smithi042.stdout: create 217/36 file after the snapshot 2023-07-29T02:02:59.637 INFO:tasks.workunit.client.0.smithi042.stdout: create 217/37 file after the snapshot 2023-07-29T02:02:59.638 INFO:tasks.workunit.client.0.smithi042.stdout: create 217/38 file after the snapshot 2023-07-29T02:02:59.639 INFO:tasks.workunit.client.0.smithi042.stdout: create 217/39 file after the snapshot 2023-07-29T02:02:59.640 INFO:tasks.workunit.client.0.smithi042.stdout: create 218/.snap/snap-subdir-test 2023-07-29T02:02:59.666 INFO:tasks.workunit.client.0.smithi042.stdout: create 218/30 file after the snapshot 2023-07-29T02:02:59.668 INFO:tasks.workunit.client.0.smithi042.stdout: create 218/31 file after the snapshot 2023-07-29T02:02:59.670 INFO:tasks.workunit.client.0.smithi042.stdout: create 218/32 file after the snapshot 2023-07-29T02:02:59.671 INFO:tasks.workunit.client.0.smithi042.stdout: create 218/33 file after the snapshot 2023-07-29T02:02:59.673 INFO:tasks.workunit.client.0.smithi042.stdout: create 218/34 file after the snapshot 2023-07-29T02:02:59.674 INFO:tasks.workunit.client.0.smithi042.stdout: create 218/35 file after the snapshot 2023-07-29T02:02:59.676 INFO:tasks.workunit.client.0.smithi042.stdout: create 218/36 file after the snapshot 2023-07-29T02:02:59.678 INFO:tasks.workunit.client.0.smithi042.stdout: create 218/37 file after the snapshot 2023-07-29T02:02:59.680 INFO:tasks.workunit.client.0.smithi042.stdout: create 218/38 file after the snapshot 2023-07-29T02:02:59.680 INFO:tasks.workunit.client.0.smithi042.stdout: create 218/39 file after the snapshot 2023-07-29T02:02:59.681 INFO:tasks.workunit.client.0.smithi042.stdout: create 219/.snap/snap-subdir-test 2023-07-29T02:02:59.711 INFO:tasks.workunit.client.0.smithi042.stdout: create 219/30 file after the snapshot 2023-07-29T02:02:59.712 INFO:tasks.workunit.client.0.smithi042.stdout: create 219/31 file after the snapshot 2023-07-29T02:02:59.714 INFO:tasks.workunit.client.0.smithi042.stdout: create 219/32 file after the snapshot 2023-07-29T02:02:59.715 INFO:tasks.workunit.client.0.smithi042.stdout: create 219/33 file after the snapshot 2023-07-29T02:02:59.716 INFO:tasks.workunit.client.0.smithi042.stdout: create 219/34 file after the snapshot 2023-07-29T02:02:59.718 INFO:tasks.workunit.client.0.smithi042.stdout: create 219/35 file after the snapshot 2023-07-29T02:02:59.719 INFO:tasks.workunit.client.0.smithi042.stdout: create 219/36 file after the snapshot 2023-07-29T02:02:59.721 INFO:tasks.workunit.client.0.smithi042.stdout: create 219/37 file after the snapshot 2023-07-29T02:02:59.722 INFO:tasks.workunit.client.0.smithi042.stdout: create 219/38 file after the snapshot 2023-07-29T02:02:59.722 INFO:tasks.workunit.client.0.smithi042.stdout: create 219/39 file after the snapshot 2023-07-29T02:02:59.723 INFO:tasks.workunit.client.0.smithi042.stdout: create 220/.snap/snap-subdir-test 2023-07-29T02:02:59.752 INFO:tasks.workunit.client.0.smithi042.stdout: create 220/30 file after the snapshot 2023-07-29T02:02:59.754 INFO:tasks.workunit.client.0.smithi042.stdout: create 220/31 file after the snapshot 2023-07-29T02:02:59.755 INFO:tasks.workunit.client.0.smithi042.stdout: create 220/32 file after the snapshot 2023-07-29T02:02:59.757 INFO:tasks.workunit.client.0.smithi042.stdout: create 220/33 file after the snapshot 2023-07-29T02:02:59.758 INFO:tasks.workunit.client.0.smithi042.stdout: create 220/34 file after the snapshot 2023-07-29T02:02:59.760 INFO:tasks.workunit.client.0.smithi042.stdout: create 220/35 file after the snapshot 2023-07-29T02:02:59.762 INFO:tasks.workunit.client.0.smithi042.stdout: create 220/36 file after the snapshot 2023-07-29T02:02:59.763 INFO:tasks.workunit.client.0.smithi042.stdout: create 220/37 file after the snapshot 2023-07-29T02:02:59.764 INFO:tasks.workunit.client.0.smithi042.stdout: create 220/38 file after the snapshot 2023-07-29T02:02:59.765 INFO:tasks.workunit.client.0.smithi042.stdout: create 220/39 file after the snapshot 2023-07-29T02:02:59.765 INFO:tasks.workunit.client.0.smithi042.stdout: create 221/.snap/snap-subdir-test 2023-07-29T02:02:59.792 INFO:tasks.workunit.client.0.smithi042.stdout: create 221/30 file after the snapshot 2023-07-29T02:02:59.794 INFO:tasks.workunit.client.0.smithi042.stdout: create 221/31 file after the snapshot 2023-07-29T02:02:59.796 INFO:tasks.workunit.client.0.smithi042.stdout: create 221/32 file after the snapshot 2023-07-29T02:02:59.798 INFO:tasks.workunit.client.0.smithi042.stdout: create 221/33 file after the snapshot 2023-07-29T02:02:59.800 INFO:tasks.workunit.client.0.smithi042.stdout: create 221/34 file after the snapshot 2023-07-29T02:02:59.802 INFO:tasks.workunit.client.0.smithi042.stdout: create 221/35 file after the snapshot 2023-07-29T02:02:59.803 INFO:tasks.workunit.client.0.smithi042.stdout: create 221/36 file after the snapshot 2023-07-29T02:02:59.805 INFO:tasks.workunit.client.0.smithi042.stdout: create 221/37 file after the snapshot 2023-07-29T02:02:59.806 INFO:tasks.workunit.client.0.smithi042.stdout: create 221/38 file after the snapshot 2023-07-29T02:02:59.807 INFO:tasks.workunit.client.0.smithi042.stdout: create 221/39 file after the snapshot 2023-07-29T02:02:59.808 INFO:tasks.workunit.client.0.smithi042.stdout: create 222/.snap/snap-subdir-test 2023-07-29T02:02:59.834 INFO:tasks.workunit.client.0.smithi042.stdout: create 222/30 file after the snapshot 2023-07-29T02:02:59.837 INFO:tasks.workunit.client.0.smithi042.stdout: create 222/31 file after the snapshot 2023-07-29T02:02:59.838 INFO:tasks.workunit.client.0.smithi042.stdout: create 222/32 file after the snapshot 2023-07-29T02:02:59.840 INFO:tasks.workunit.client.0.smithi042.stdout: create 222/33 file after the snapshot 2023-07-29T02:02:59.842 INFO:tasks.workunit.client.0.smithi042.stdout: create 222/34 file after the snapshot 2023-07-29T02:02:59.845 INFO:tasks.workunit.client.0.smithi042.stdout: create 222/35 file after the snapshot 2023-07-29T02:02:59.846 INFO:tasks.workunit.client.0.smithi042.stdout: create 222/36 file after the snapshot 2023-07-29T02:02:59.848 INFO:tasks.workunit.client.0.smithi042.stdout: create 222/37 file after the snapshot 2023-07-29T02:02:59.849 INFO:tasks.workunit.client.0.smithi042.stdout: create 222/38 file after the snapshot 2023-07-29T02:02:59.849 INFO:tasks.workunit.client.0.smithi042.stdout: create 222/39 file after the snapshot 2023-07-29T02:02:59.850 INFO:tasks.workunit.client.0.smithi042.stdout: create 223/.snap/snap-subdir-test 2023-07-29T02:02:59.877 INFO:tasks.workunit.client.0.smithi042.stdout: create 223/30 file after the snapshot 2023-07-29T02:02:59.879 INFO:tasks.workunit.client.0.smithi042.stdout: create 223/31 file after the snapshot 2023-07-29T02:02:59.880 INFO:tasks.workunit.client.0.smithi042.stdout: create 223/32 file after the snapshot 2023-07-29T02:02:59.882 INFO:tasks.workunit.client.0.smithi042.stdout: create 223/33 file after the snapshot 2023-07-29T02:02:59.883 INFO:tasks.workunit.client.0.smithi042.stdout: create 223/34 file after the snapshot 2023-07-29T02:02:59.885 INFO:tasks.workunit.client.0.smithi042.stdout: create 223/35 file after the snapshot 2023-07-29T02:02:59.887 INFO:tasks.workunit.client.0.smithi042.stdout: create 223/36 file after the snapshot 2023-07-29T02:02:59.888 INFO:tasks.workunit.client.0.smithi042.stdout: create 223/37 file after the snapshot 2023-07-29T02:02:59.890 INFO:tasks.workunit.client.0.smithi042.stdout: create 223/38 file after the snapshot 2023-07-29T02:02:59.891 INFO:tasks.workunit.client.0.smithi042.stdout: create 223/39 file after the snapshot 2023-07-29T02:02:59.891 INFO:tasks.workunit.client.0.smithi042.stdout: create 224/.snap/snap-subdir-test 2023-07-29T02:02:59.918 INFO:tasks.workunit.client.0.smithi042.stdout: create 224/30 file after the snapshot 2023-07-29T02:02:59.920 INFO:tasks.workunit.client.0.smithi042.stdout: create 224/31 file after the snapshot 2023-07-29T02:02:59.921 INFO:tasks.workunit.client.0.smithi042.stdout: create 224/32 file after the snapshot 2023-07-29T02:02:59.923 INFO:tasks.workunit.client.0.smithi042.stdout: create 224/33 file after the snapshot 2023-07-29T02:02:59.925 INFO:tasks.workunit.client.0.smithi042.stdout: create 224/34 file after the snapshot 2023-07-29T02:02:59.926 INFO:tasks.workunit.client.0.smithi042.stdout: create 224/35 file after the snapshot 2023-07-29T02:02:59.928 INFO:tasks.workunit.client.0.smithi042.stdout: create 224/36 file after the snapshot 2023-07-29T02:02:59.929 INFO:tasks.workunit.client.0.smithi042.stdout: create 224/37 file after the snapshot 2023-07-29T02:02:59.931 INFO:tasks.workunit.client.0.smithi042.stdout: create 224/38 file after the snapshot 2023-07-29T02:02:59.932 INFO:tasks.workunit.client.0.smithi042.stdout: create 224/39 file after the snapshot 2023-07-29T02:02:59.932 INFO:tasks.workunit.client.0.smithi042.stdout: create 225/.snap/snap-subdir-test 2023-07-29T02:02:59.959 INFO:tasks.workunit.client.0.smithi042.stdout: create 225/30 file after the snapshot 2023-07-29T02:02:59.961 INFO:tasks.workunit.client.0.smithi042.stdout: create 225/31 file after the snapshot 2023-07-29T02:02:59.963 INFO:tasks.workunit.client.0.smithi042.stdout: create 225/32 file after the snapshot 2023-07-29T02:02:59.964 INFO:tasks.workunit.client.0.smithi042.stdout: create 225/33 file after the snapshot 2023-07-29T02:02:59.965 INFO:tasks.workunit.client.0.smithi042.stdout: create 225/34 file after the snapshot 2023-07-29T02:02:59.967 INFO:tasks.workunit.client.0.smithi042.stdout: create 225/35 file after the snapshot 2023-07-29T02:02:59.968 INFO:tasks.workunit.client.0.smithi042.stdout: create 225/36 file after the snapshot 2023-07-29T02:02:59.970 INFO:tasks.workunit.client.0.smithi042.stdout: create 225/37 file after the snapshot 2023-07-29T02:02:59.972 INFO:tasks.workunit.client.0.smithi042.stdout: create 225/38 file after the snapshot 2023-07-29T02:02:59.973 INFO:tasks.workunit.client.0.smithi042.stdout: create 225/39 file after the snapshot 2023-07-29T02:02:59.974 INFO:tasks.workunit.client.0.smithi042.stdout: create 226/.snap/snap-subdir-test 2023-07-29T02:03:00.002 INFO:tasks.workunit.client.0.smithi042.stdout: create 226/30 file after the snapshot 2023-07-29T02:03:00.004 INFO:tasks.workunit.client.0.smithi042.stdout: create 226/31 file after the snapshot 2023-07-29T02:03:00.006 INFO:tasks.workunit.client.0.smithi042.stdout: create 226/32 file after the snapshot 2023-07-29T02:03:00.007 INFO:tasks.workunit.client.0.smithi042.stdout: create 226/33 file after the snapshot 2023-07-29T02:03:00.009 INFO:tasks.workunit.client.0.smithi042.stdout: create 226/34 file after the snapshot 2023-07-29T02:03:00.010 INFO:tasks.workunit.client.0.smithi042.stdout: create 226/35 file after the snapshot 2023-07-29T02:03:00.012 INFO:tasks.workunit.client.0.smithi042.stdout: create 226/36 file after the snapshot 2023-07-29T02:03:00.013 INFO:tasks.workunit.client.0.smithi042.stdout: create 226/37 file after the snapshot 2023-07-29T02:03:00.015 INFO:tasks.workunit.client.0.smithi042.stdout: create 226/38 file after the snapshot 2023-07-29T02:03:00.016 INFO:tasks.workunit.client.0.smithi042.stdout: create 226/39 file after the snapshot 2023-07-29T02:03:00.017 INFO:tasks.workunit.client.0.smithi042.stdout: create 227/.snap/snap-subdir-test 2023-07-29T02:03:00.046 INFO:tasks.workunit.client.0.smithi042.stdout: create 227/30 file after the snapshot 2023-07-29T02:03:00.048 INFO:tasks.workunit.client.0.smithi042.stdout: create 227/31 file after the snapshot 2023-07-29T02:03:00.050 INFO:tasks.workunit.client.0.smithi042.stdout: create 227/32 file after the snapshot 2023-07-29T02:03:00.053 INFO:tasks.workunit.client.0.smithi042.stdout: create 227/33 file after the snapshot 2023-07-29T02:03:00.055 INFO:tasks.workunit.client.0.smithi042.stdout: create 227/34 file after the snapshot 2023-07-29T02:03:00.057 INFO:tasks.workunit.client.0.smithi042.stdout: create 227/35 file after the snapshot 2023-07-29T02:03:00.059 INFO:tasks.workunit.client.0.smithi042.stdout: create 227/36 file after the snapshot 2023-07-29T02:03:00.060 INFO:tasks.workunit.client.0.smithi042.stdout: create 227/37 file after the snapshot 2023-07-29T02:03:00.061 INFO:tasks.workunit.client.0.smithi042.stdout: create 227/38 file after the snapshot 2023-07-29T02:03:00.062 INFO:tasks.workunit.client.0.smithi042.stdout: create 227/39 file after the snapshot 2023-07-29T02:03:00.063 INFO:tasks.workunit.client.0.smithi042.stdout: create 228/.snap/snap-subdir-test 2023-07-29T02:03:00.094 INFO:tasks.workunit.client.0.smithi042.stdout: create 228/30 file after the snapshot 2023-07-29T02:03:00.099 INFO:tasks.workunit.client.0.smithi042.stdout: create 228/31 file after the snapshot 2023-07-29T02:03:00.168 INFO:tasks.workunit.client.0.smithi042.stdout: create 228/32 file after the snapshot 2023-07-29T02:03:00.168 INFO:tasks.workunit.client.0.smithi042.stdout: create 228/33 file after the snapshot 2023-07-29T02:03:00.169 INFO:tasks.workunit.client.0.smithi042.stdout: create 228/34 file after the snapshot 2023-07-29T02:03:00.169 INFO:tasks.workunit.client.0.smithi042.stdout: create 228/35 file after the snapshot 2023-07-29T02:03:00.169 INFO:tasks.workunit.client.0.smithi042.stdout: create 228/36 file after the snapshot 2023-07-29T02:03:00.169 INFO:tasks.workunit.client.0.smithi042.stdout: create 228/37 file after the snapshot 2023-07-29T02:03:00.169 INFO:tasks.workunit.client.0.smithi042.stdout: create 228/38 file after the snapshot 2023-07-29T02:03:00.169 INFO:tasks.workunit.client.0.smithi042.stdout: create 228/39 file after the snapshot 2023-07-29T02:03:00.169 INFO:tasks.workunit.client.0.smithi042.stdout: create 229/.snap/snap-subdir-test 2023-07-29T02:03:00.170 INFO:tasks.workunit.client.0.smithi042.stdout: create 229/30 file after the snapshot 2023-07-29T02:03:00.170 INFO:tasks.workunit.client.0.smithi042.stdout: create 229/31 file after the snapshot 2023-07-29T02:03:00.170 INFO:tasks.workunit.client.0.smithi042.stdout: create 229/32 file after the snapshot 2023-07-29T02:03:00.170 INFO:tasks.workunit.client.0.smithi042.stdout: create 229/33 file after the snapshot 2023-07-29T02:03:00.171 INFO:tasks.workunit.client.0.smithi042.stdout: create 229/34 file after the snapshot 2023-07-29T02:03:00.171 INFO:tasks.workunit.client.0.smithi042.stdout: create 229/35 file after the snapshot 2023-07-29T02:03:00.171 INFO:tasks.workunit.client.0.smithi042.stdout: create 229/36 file after the snapshot 2023-07-29T02:03:00.171 INFO:tasks.workunit.client.0.smithi042.stdout: create 229/37 file after the snapshot 2023-07-29T02:03:00.171 INFO:tasks.workunit.client.0.smithi042.stdout: create 229/38 file after the snapshot 2023-07-29T02:03:00.171 INFO:tasks.workunit.client.0.smithi042.stdout: create 229/39 file after the snapshot 2023-07-29T02:03:00.172 INFO:tasks.workunit.client.0.smithi042.stdout: create 230/.snap/snap-subdir-test 2023-07-29T02:03:00.191 INFO:tasks.workunit.client.0.smithi042.stdout: create 230/30 file after the snapshot 2023-07-29T02:03:00.193 INFO:tasks.workunit.client.0.smithi042.stdout: create 230/31 file after the snapshot 2023-07-29T02:03:00.194 INFO:tasks.workunit.client.0.smithi042.stdout: create 230/32 file after the snapshot 2023-07-29T02:03:00.196 INFO:tasks.workunit.client.0.smithi042.stdout: create 230/33 file after the snapshot 2023-07-29T02:03:00.198 INFO:tasks.workunit.client.0.smithi042.stdout: create 230/34 file after the snapshot 2023-07-29T02:03:00.199 INFO:tasks.workunit.client.0.smithi042.stdout: create 230/35 file after the snapshot 2023-07-29T02:03:00.201 INFO:tasks.workunit.client.0.smithi042.stdout: create 230/36 file after the snapshot 2023-07-29T02:03:00.202 INFO:tasks.workunit.client.0.smithi042.stdout: create 230/37 file after the snapshot 2023-07-29T02:03:00.204 INFO:tasks.workunit.client.0.smithi042.stdout: create 230/38 file after the snapshot 2023-07-29T02:03:00.205 INFO:tasks.workunit.client.0.smithi042.stdout: create 230/39 file after the snapshot 2023-07-29T02:03:00.206 INFO:tasks.workunit.client.0.smithi042.stdout: create 231/.snap/snap-subdir-test 2023-07-29T02:03:00.233 INFO:tasks.workunit.client.0.smithi042.stdout: create 231/30 file after the snapshot 2023-07-29T02:03:00.247 INFO:tasks.workunit.client.0.smithi042.stdout: create 231/31 file after the snapshot 2023-07-29T02:03:00.247 INFO:tasks.workunit.client.0.smithi042.stdout: create 231/32 file after the snapshot 2023-07-29T02:03:00.248 INFO:tasks.workunit.client.0.smithi042.stdout: create 231/33 file after the snapshot 2023-07-29T02:03:00.249 INFO:tasks.workunit.client.0.smithi042.stdout: create 231/34 file after the snapshot 2023-07-29T02:03:00.249 INFO:tasks.workunit.client.0.smithi042.stdout: create 231/35 file after the snapshot 2023-07-29T02:03:00.250 INFO:tasks.workunit.client.0.smithi042.stdout: create 231/36 file after the snapshot 2023-07-29T02:03:00.250 INFO:tasks.workunit.client.0.smithi042.stdout: create 231/37 file after the snapshot 2023-07-29T02:03:00.251 INFO:tasks.workunit.client.0.smithi042.stdout: create 231/38 file after the snapshot 2023-07-29T02:03:00.252 INFO:tasks.workunit.client.0.smithi042.stdout: create 231/39 file after the snapshot 2023-07-29T02:03:00.252 INFO:tasks.workunit.client.0.smithi042.stdout: create 232/.snap/snap-subdir-test 2023-07-29T02:03:00.278 INFO:tasks.workunit.client.0.smithi042.stdout: create 232/30 file after the snapshot 2023-07-29T02:03:00.280 INFO:tasks.workunit.client.0.smithi042.stdout: create 232/31 file after the snapshot 2023-07-29T02:03:00.282 INFO:tasks.workunit.client.0.smithi042.stdout: create 232/32 file after the snapshot 2023-07-29T02:03:00.284 INFO:tasks.workunit.client.0.smithi042.stdout: create 232/33 file after the snapshot 2023-07-29T02:03:00.285 INFO:tasks.workunit.client.0.smithi042.stdout: create 232/34 file after the snapshot 2023-07-29T02:03:00.287 INFO:tasks.workunit.client.0.smithi042.stdout: create 232/35 file after the snapshot 2023-07-29T02:03:00.289 INFO:tasks.workunit.client.0.smithi042.stdout: create 232/36 file after the snapshot 2023-07-29T02:03:00.290 INFO:tasks.workunit.client.0.smithi042.stdout: create 232/37 file after the snapshot 2023-07-29T02:03:00.292 INFO:tasks.workunit.client.0.smithi042.stdout: create 232/38 file after the snapshot 2023-07-29T02:03:00.293 INFO:tasks.workunit.client.0.smithi042.stdout: create 232/39 file after the snapshot 2023-07-29T02:03:00.293 INFO:tasks.workunit.client.0.smithi042.stdout: create 233/.snap/snap-subdir-test 2023-07-29T02:03:00.322 INFO:tasks.workunit.client.0.smithi042.stdout: create 233/30 file after the snapshot 2023-07-29T02:03:00.324 INFO:tasks.workunit.client.0.smithi042.stdout: create 233/31 file after the snapshot 2023-07-29T02:03:00.325 INFO:tasks.workunit.client.0.smithi042.stdout: create 233/32 file after the snapshot 2023-07-29T02:03:00.327 INFO:tasks.workunit.client.0.smithi042.stdout: create 233/33 file after the snapshot 2023-07-29T02:03:00.329 INFO:tasks.workunit.client.0.smithi042.stdout: create 233/34 file after the snapshot 2023-07-29T02:03:00.330 INFO:tasks.workunit.client.0.smithi042.stdout: create 233/35 file after the snapshot 2023-07-29T02:03:00.332 INFO:tasks.workunit.client.0.smithi042.stdout: create 233/36 file after the snapshot 2023-07-29T02:03:00.333 INFO:tasks.workunit.client.0.smithi042.stdout: create 233/37 file after the snapshot 2023-07-29T02:03:00.334 INFO:tasks.workunit.client.0.smithi042.stdout: create 233/38 file after the snapshot 2023-07-29T02:03:00.335 INFO:tasks.workunit.client.0.smithi042.stdout: create 233/39 file after the snapshot 2023-07-29T02:03:00.335 INFO:tasks.workunit.client.0.smithi042.stdout: create 234/.snap/snap-subdir-test 2023-07-29T02:03:00.362 INFO:tasks.workunit.client.0.smithi042.stdout: create 234/30 file after the snapshot 2023-07-29T02:03:00.364 INFO:tasks.workunit.client.0.smithi042.stdout: create 234/31 file after the snapshot 2023-07-29T02:03:00.366 INFO:tasks.workunit.client.0.smithi042.stdout: create 234/32 file after the snapshot 2023-07-29T02:03:00.367 INFO:tasks.workunit.client.0.smithi042.stdout: create 234/33 file after the snapshot 2023-07-29T02:03:00.369 INFO:tasks.workunit.client.0.smithi042.stdout: create 234/34 file after the snapshot 2023-07-29T02:03:00.370 INFO:tasks.workunit.client.0.smithi042.stdout: create 234/35 file after the snapshot 2023-07-29T02:03:00.372 INFO:tasks.workunit.client.0.smithi042.stdout: create 234/36 file after the snapshot 2023-07-29T02:03:00.373 INFO:tasks.workunit.client.0.smithi042.stdout: create 234/37 file after the snapshot 2023-07-29T02:03:00.375 INFO:tasks.workunit.client.0.smithi042.stdout: create 234/38 file after the snapshot 2023-07-29T02:03:00.376 INFO:tasks.workunit.client.0.smithi042.stdout: create 234/39 file after the snapshot 2023-07-29T02:03:00.377 INFO:tasks.workunit.client.0.smithi042.stdout: create 235/.snap/snap-subdir-test 2023-07-29T02:03:00.403 INFO:tasks.workunit.client.0.smithi042.stdout: create 235/30 file after the snapshot 2023-07-29T02:03:00.405 INFO:tasks.workunit.client.0.smithi042.stdout: create 235/31 file after the snapshot 2023-07-29T02:03:00.407 INFO:tasks.workunit.client.0.smithi042.stdout: create 235/32 file after the snapshot 2023-07-29T02:03:00.408 INFO:tasks.workunit.client.0.smithi042.stdout: create 235/33 file after the snapshot 2023-07-29T02:03:00.410 INFO:tasks.workunit.client.0.smithi042.stdout: create 235/34 file after the snapshot 2023-07-29T02:03:00.411 INFO:tasks.workunit.client.0.smithi042.stdout: create 235/35 file after the snapshot 2023-07-29T02:03:00.413 INFO:tasks.workunit.client.0.smithi042.stdout: create 235/36 file after the snapshot 2023-07-29T02:03:00.414 INFO:tasks.workunit.client.0.smithi042.stdout: create 235/37 file after the snapshot 2023-07-29T02:03:00.416 INFO:tasks.workunit.client.0.smithi042.stdout: create 235/38 file after the snapshot 2023-07-29T02:03:00.417 INFO:tasks.workunit.client.0.smithi042.stdout: create 235/39 file after the snapshot 2023-07-29T02:03:00.418 INFO:tasks.workunit.client.0.smithi042.stdout: create 236/.snap/snap-subdir-test 2023-07-29T02:03:00.444 INFO:tasks.workunit.client.0.smithi042.stdout: create 236/30 file after the snapshot 2023-07-29T02:03:00.446 INFO:tasks.workunit.client.0.smithi042.stdout: create 236/31 file after the snapshot 2023-07-29T02:03:00.448 INFO:tasks.workunit.client.0.smithi042.stdout: create 236/32 file after the snapshot 2023-07-29T02:03:00.449 INFO:tasks.workunit.client.0.smithi042.stdout: create 236/33 file after the snapshot 2023-07-29T02:03:00.451 INFO:tasks.workunit.client.0.smithi042.stdout: create 236/34 file after the snapshot 2023-07-29T02:03:00.452 INFO:tasks.workunit.client.0.smithi042.stdout: create 236/35 file after the snapshot 2023-07-29T02:03:00.454 INFO:tasks.workunit.client.0.smithi042.stdout: create 236/36 file after the snapshot 2023-07-29T02:03:00.456 INFO:tasks.workunit.client.0.smithi042.stdout: create 236/37 file after the snapshot 2023-07-29T02:03:00.457 INFO:tasks.workunit.client.0.smithi042.stdout: create 236/38 file after the snapshot 2023-07-29T02:03:00.458 INFO:tasks.workunit.client.0.smithi042.stdout: create 236/39 file after the snapshot 2023-07-29T02:03:00.459 INFO:tasks.workunit.client.0.smithi042.stdout: create 237/.snap/snap-subdir-test 2023-07-29T02:03:00.486 INFO:tasks.workunit.client.0.smithi042.stdout: create 237/30 file after the snapshot 2023-07-29T02:03:00.507 INFO:tasks.workunit.client.0.smithi042.stdout: create 237/31 file after the snapshot 2023-07-29T02:03:00.508 INFO:tasks.workunit.client.0.smithi042.stdout: create 237/32 file after the snapshot 2023-07-29T02:03:00.508 INFO:tasks.workunit.client.0.smithi042.stdout: create 237/33 file after the snapshot 2023-07-29T02:03:00.515 INFO:tasks.workunit.client.0.smithi042.stdout: create 237/34 file after the snapshot 2023-07-29T02:03:00.515 INFO:tasks.workunit.client.0.smithi042.stdout: create 237/35 file after the snapshot 2023-07-29T02:03:00.516 INFO:tasks.workunit.client.0.smithi042.stdout: create 237/36 file after the snapshot 2023-07-29T02:03:00.517 INFO:tasks.workunit.client.0.smithi042.stdout: create 237/37 file after the snapshot 2023-07-29T02:03:00.518 INFO:tasks.workunit.client.0.smithi042.stdout: create 237/38 file after the snapshot 2023-07-29T02:03:00.519 INFO:tasks.workunit.client.0.smithi042.stdout: create 237/39 file after the snapshot 2023-07-29T02:03:00.519 INFO:tasks.workunit.client.0.smithi042.stdout: create 238/.snap/snap-subdir-test 2023-07-29T02:03:00.544 INFO:tasks.workunit.client.0.smithi042.stdout: create 238/30 file after the snapshot 2023-07-29T02:03:00.546 INFO:tasks.workunit.client.0.smithi042.stdout: create 238/31 file after the snapshot 2023-07-29T02:03:00.548 INFO:tasks.workunit.client.0.smithi042.stdout: create 238/32 file after the snapshot 2023-07-29T02:03:00.550 INFO:tasks.workunit.client.0.smithi042.stdout: create 238/33 file after the snapshot 2023-07-29T02:03:00.551 INFO:tasks.workunit.client.0.smithi042.stdout: create 238/34 file after the snapshot 2023-07-29T02:03:00.554 INFO:tasks.workunit.client.0.smithi042.stdout: create 238/35 file after the snapshot 2023-07-29T02:03:00.556 INFO:tasks.workunit.client.0.smithi042.stdout: create 238/36 file after the snapshot 2023-07-29T02:03:00.557 INFO:tasks.workunit.client.0.smithi042.stdout: create 238/37 file after the snapshot 2023-07-29T02:03:00.558 INFO:tasks.workunit.client.0.smithi042.stdout: create 238/38 file after the snapshot 2023-07-29T02:03:00.558 INFO:tasks.workunit.client.0.smithi042.stdout: create 238/39 file after the snapshot 2023-07-29T02:03:00.559 INFO:tasks.workunit.client.0.smithi042.stdout: create 239/.snap/snap-subdir-test 2023-07-29T02:03:00.585 INFO:tasks.workunit.client.0.smithi042.stdout: create 239/30 file after the snapshot 2023-07-29T02:03:00.587 INFO:tasks.workunit.client.0.smithi042.stdout: create 239/31 file after the snapshot 2023-07-29T02:03:00.590 INFO:tasks.workunit.client.0.smithi042.stdout: create 239/32 file after the snapshot 2023-07-29T02:03:00.592 INFO:tasks.workunit.client.0.smithi042.stdout: create 239/33 file after the snapshot 2023-07-29T02:03:00.594 INFO:tasks.workunit.client.0.smithi042.stdout: create 239/34 file after the snapshot 2023-07-29T02:03:00.596 INFO:tasks.workunit.client.0.smithi042.stdout: create 239/35 file after the snapshot 2023-07-29T02:03:00.598 INFO:tasks.workunit.client.0.smithi042.stdout: create 239/36 file after the snapshot 2023-07-29T02:03:00.599 INFO:tasks.workunit.client.0.smithi042.stdout: create 239/37 file after the snapshot 2023-07-29T02:03:00.600 INFO:tasks.workunit.client.0.smithi042.stdout: create 239/38 file after the snapshot 2023-07-29T02:03:00.600 INFO:tasks.workunit.client.0.smithi042.stdout: create 239/39 file after the snapshot 2023-07-29T02:03:00.601 INFO:tasks.workunit.client.0.smithi042.stdout: create 240/.snap/snap-subdir-test 2023-07-29T02:03:00.627 INFO:tasks.workunit.client.0.smithi042.stdout: create 240/30 file after the snapshot 2023-07-29T02:03:00.629 INFO:tasks.workunit.client.0.smithi042.stdout: create 240/31 file after the snapshot 2023-07-29T02:03:00.631 INFO:tasks.workunit.client.0.smithi042.stdout: create 240/32 file after the snapshot 2023-07-29T02:03:00.633 INFO:tasks.workunit.client.0.smithi042.stdout: create 240/33 file after the snapshot 2023-07-29T02:03:00.635 INFO:tasks.workunit.client.0.smithi042.stdout: create 240/34 file after the snapshot 2023-07-29T02:03:00.637 INFO:tasks.workunit.client.0.smithi042.stdout: create 240/35 file after the snapshot 2023-07-29T02:03:00.639 INFO:tasks.workunit.client.0.smithi042.stdout: create 240/36 file after the snapshot 2023-07-29T02:03:00.641 INFO:tasks.workunit.client.0.smithi042.stdout: create 240/37 file after the snapshot 2023-07-29T02:03:00.642 INFO:tasks.workunit.client.0.smithi042.stdout: create 240/38 file after the snapshot 2023-07-29T02:03:00.642 INFO:tasks.workunit.client.0.smithi042.stdout: create 240/39 file after the snapshot 2023-07-29T02:03:00.642 INFO:tasks.workunit.client.0.smithi042.stdout: create 241/.snap/snap-subdir-test 2023-07-29T02:03:00.669 INFO:tasks.workunit.client.0.smithi042.stdout: create 241/30 file after the snapshot 2023-07-29T02:03:00.671 INFO:tasks.workunit.client.0.smithi042.stdout: create 241/31 file after the snapshot 2023-07-29T02:03:00.673 INFO:tasks.workunit.client.0.smithi042.stdout: create 241/32 file after the snapshot 2023-07-29T02:03:00.675 INFO:tasks.workunit.client.0.smithi042.stdout: create 241/33 file after the snapshot 2023-07-29T02:03:00.677 INFO:tasks.workunit.client.0.smithi042.stdout: create 241/34 file after the snapshot 2023-07-29T02:03:00.679 INFO:tasks.workunit.client.0.smithi042.stdout: create 241/35 file after the snapshot 2023-07-29T02:03:00.681 INFO:tasks.workunit.client.0.smithi042.stdout: create 241/36 file after the snapshot 2023-07-29T02:03:00.682 INFO:tasks.workunit.client.0.smithi042.stdout: create 241/37 file after the snapshot 2023-07-29T02:03:00.683 INFO:tasks.workunit.client.0.smithi042.stdout: create 241/38 file after the snapshot 2023-07-29T02:03:00.684 INFO:tasks.workunit.client.0.smithi042.stdout: create 241/39 file after the snapshot 2023-07-29T02:03:00.684 INFO:tasks.workunit.client.0.smithi042.stdout: create 242/.snap/snap-subdir-test 2023-07-29T02:03:00.710 INFO:tasks.workunit.client.0.smithi042.stdout: create 242/30 file after the snapshot 2023-07-29T02:03:00.712 INFO:tasks.workunit.client.0.smithi042.stdout: create 242/31 file after the snapshot 2023-07-29T02:03:00.714 INFO:tasks.workunit.client.0.smithi042.stdout: create 242/32 file after the snapshot 2023-07-29T02:03:00.716 INFO:tasks.workunit.client.0.smithi042.stdout: create 242/33 file after the snapshot 2023-07-29T02:03:00.717 INFO:tasks.workunit.client.0.smithi042.stdout: create 242/34 file after the snapshot 2023-07-29T02:03:00.719 INFO:tasks.workunit.client.0.smithi042.stdout: create 242/35 file after the snapshot 2023-07-29T02:03:00.720 INFO:tasks.workunit.client.0.smithi042.stdout: create 242/36 file after the snapshot 2023-07-29T02:03:00.722 INFO:tasks.workunit.client.0.smithi042.stdout: create 242/37 file after the snapshot 2023-07-29T02:03:00.723 INFO:tasks.workunit.client.0.smithi042.stdout: create 242/38 file after the snapshot 2023-07-29T02:03:00.724 INFO:tasks.workunit.client.0.smithi042.stdout: create 242/39 file after the snapshot 2023-07-29T02:03:00.725 INFO:tasks.workunit.client.0.smithi042.stdout: create 243/.snap/snap-subdir-test 2023-07-29T02:03:00.754 INFO:tasks.workunit.client.0.smithi042.stdout: create 243/30 file after the snapshot 2023-07-29T02:03:00.756 INFO:tasks.workunit.client.0.smithi042.stdout: create 243/31 file after the snapshot 2023-07-29T02:03:00.757 INFO:tasks.workunit.client.0.smithi042.stdout: create 243/32 file after the snapshot 2023-07-29T02:03:00.759 INFO:tasks.workunit.client.0.smithi042.stdout: create 243/33 file after the snapshot 2023-07-29T02:03:00.760 INFO:tasks.workunit.client.0.smithi042.stdout: create 243/34 file after the snapshot 2023-07-29T02:03:00.762 INFO:tasks.workunit.client.0.smithi042.stdout: create 243/35 file after the snapshot 2023-07-29T02:03:00.763 INFO:tasks.workunit.client.0.smithi042.stdout: create 243/36 file after the snapshot 2023-07-29T02:03:00.765 INFO:tasks.workunit.client.0.smithi042.stdout: create 243/37 file after the snapshot 2023-07-29T02:03:00.765 INFO:tasks.workunit.client.0.smithi042.stdout: create 243/38 file after the snapshot 2023-07-29T02:03:00.766 INFO:tasks.workunit.client.0.smithi042.stdout: create 243/39 file after the snapshot 2023-07-29T02:03:00.767 INFO:tasks.workunit.client.0.smithi042.stdout: create 244/.snap/snap-subdir-test 2023-07-29T02:03:00.795 INFO:tasks.workunit.client.0.smithi042.stdout: create 244/30 file after the snapshot 2023-07-29T02:03:00.797 INFO:tasks.workunit.client.0.smithi042.stdout: create 244/31 file after the snapshot 2023-07-29T02:03:00.799 INFO:tasks.workunit.client.0.smithi042.stdout: create 244/32 file after the snapshot 2023-07-29T02:03:00.800 INFO:tasks.workunit.client.0.smithi042.stdout: create 244/33 file after the snapshot 2023-07-29T02:03:00.802 INFO:tasks.workunit.client.0.smithi042.stdout: create 244/34 file after the snapshot 2023-07-29T02:03:00.803 INFO:tasks.workunit.client.0.smithi042.stdout: create 244/35 file after the snapshot 2023-07-29T02:03:00.805 INFO:tasks.workunit.client.0.smithi042.stdout: create 244/36 file after the snapshot 2023-07-29T02:03:00.806 INFO:tasks.workunit.client.0.smithi042.stdout: create 244/37 file after the snapshot 2023-07-29T02:03:00.807 INFO:tasks.workunit.client.0.smithi042.stdout: create 244/38 file after the snapshot 2023-07-29T02:03:00.808 INFO:tasks.workunit.client.0.smithi042.stdout: create 244/39 file after the snapshot 2023-07-29T02:03:00.809 INFO:tasks.workunit.client.0.smithi042.stdout: create 245/.snap/snap-subdir-test 2023-07-29T02:03:00.834 INFO:tasks.workunit.client.0.smithi042.stdout: create 245/30 file after the snapshot 2023-07-29T02:03:00.836 INFO:tasks.workunit.client.0.smithi042.stdout: create 245/31 file after the snapshot 2023-07-29T02:03:00.838 INFO:tasks.workunit.client.0.smithi042.stdout: create 245/32 file after the snapshot 2023-07-29T02:03:00.839 INFO:tasks.workunit.client.0.smithi042.stdout: create 245/33 file after the snapshot 2023-07-29T02:03:00.841 INFO:tasks.workunit.client.0.smithi042.stdout: create 245/34 file after the snapshot 2023-07-29T02:03:00.843 INFO:tasks.workunit.client.0.smithi042.stdout: create 245/35 file after the snapshot 2023-07-29T02:03:00.844 INFO:tasks.workunit.client.0.smithi042.stdout: create 245/36 file after the snapshot 2023-07-29T02:03:00.846 INFO:tasks.workunit.client.0.smithi042.stdout: create 245/37 file after the snapshot 2023-07-29T02:03:00.848 INFO:tasks.workunit.client.0.smithi042.stdout: create 245/38 file after the snapshot 2023-07-29T02:03:00.849 INFO:tasks.workunit.client.0.smithi042.stdout: create 245/39 file after the snapshot 2023-07-29T02:03:00.849 INFO:tasks.workunit.client.0.smithi042.stdout: create 246/.snap/snap-subdir-test 2023-07-29T02:03:00.878 INFO:tasks.workunit.client.0.smithi042.stdout: create 246/30 file after the snapshot 2023-07-29T02:03:00.880 INFO:tasks.workunit.client.0.smithi042.stdout: create 246/31 file after the snapshot 2023-07-29T02:03:00.882 INFO:tasks.workunit.client.0.smithi042.stdout: create 246/32 file after the snapshot 2023-07-29T02:03:00.883 INFO:tasks.workunit.client.0.smithi042.stdout: create 246/33 file after the snapshot 2023-07-29T02:03:00.885 INFO:tasks.workunit.client.0.smithi042.stdout: create 246/34 file after the snapshot 2023-07-29T02:03:00.887 INFO:tasks.workunit.client.0.smithi042.stdout: create 246/35 file after the snapshot 2023-07-29T02:03:00.888 INFO:tasks.workunit.client.0.smithi042.stdout: create 246/36 file after the snapshot 2023-07-29T02:03:00.890 INFO:tasks.workunit.client.0.smithi042.stdout: create 246/37 file after the snapshot 2023-07-29T02:03:00.890 INFO:tasks.workunit.client.0.smithi042.stdout: create 246/38 file after the snapshot 2023-07-29T02:03:00.891 INFO:tasks.workunit.client.0.smithi042.stdout: create 246/39 file after the snapshot 2023-07-29T02:03:00.892 INFO:tasks.workunit.client.0.smithi042.stdout: create 247/.snap/snap-subdir-test 2023-07-29T02:03:00.918 INFO:tasks.workunit.client.0.smithi042.stdout: create 247/30 file after the snapshot 2023-07-29T02:03:00.919 INFO:tasks.workunit.client.0.smithi042.stdout: create 247/31 file after the snapshot 2023-07-29T02:03:00.921 INFO:tasks.workunit.client.0.smithi042.stdout: create 247/32 file after the snapshot 2023-07-29T02:03:00.923 INFO:tasks.workunit.client.0.smithi042.stdout: create 247/33 file after the snapshot 2023-07-29T02:03:00.924 INFO:tasks.workunit.client.0.smithi042.stdout: create 247/34 file after the snapshot 2023-07-29T02:03:00.926 INFO:tasks.workunit.client.0.smithi042.stdout: create 247/35 file after the snapshot 2023-07-29T02:03:00.927 INFO:tasks.workunit.client.0.smithi042.stdout: create 247/36 file after the snapshot 2023-07-29T02:03:00.929 INFO:tasks.workunit.client.0.smithi042.stdout: create 247/37 file after the snapshot 2023-07-29T02:03:00.931 INFO:tasks.workunit.client.0.smithi042.stdout: create 247/38 file after the snapshot 2023-07-29T02:03:00.932 INFO:tasks.workunit.client.0.smithi042.stdout: create 247/39 file after the snapshot 2023-07-29T02:03:00.932 INFO:tasks.workunit.client.0.smithi042.stdout: create 248/.snap/snap-subdir-test 2023-07-29T02:03:00.959 INFO:tasks.workunit.client.0.smithi042.stdout: create 248/30 file after the snapshot 2023-07-29T02:03:00.960 INFO:tasks.workunit.client.0.smithi042.stdout: create 248/31 file after the snapshot 2023-07-29T02:03:00.962 INFO:tasks.workunit.client.0.smithi042.stdout: create 248/32 file after the snapshot 2023-07-29T02:03:00.963 INFO:tasks.workunit.client.0.smithi042.stdout: create 248/33 file after the snapshot 2023-07-29T02:03:00.965 INFO:tasks.workunit.client.0.smithi042.stdout: create 248/34 file after the snapshot 2023-07-29T02:03:00.966 INFO:tasks.workunit.client.0.smithi042.stdout: create 248/35 file after the snapshot 2023-07-29T02:03:00.968 INFO:tasks.workunit.client.0.smithi042.stdout: create 248/36 file after the snapshot 2023-07-29T02:03:00.969 INFO:tasks.workunit.client.0.smithi042.stdout: create 248/37 file after the snapshot 2023-07-29T02:03:00.971 INFO:tasks.workunit.client.0.smithi042.stdout: create 248/38 file after the snapshot 2023-07-29T02:03:00.972 INFO:tasks.workunit.client.0.smithi042.stdout: create 248/39 file after the snapshot 2023-07-29T02:03:00.972 INFO:tasks.workunit.client.0.smithi042.stdout: create 249/.snap/snap-subdir-test 2023-07-29T02:03:01.000 INFO:tasks.workunit.client.0.smithi042.stdout: create 249/30 file after the snapshot 2023-07-29T02:03:01.001 INFO:tasks.workunit.client.0.smithi042.stdout: create 249/31 file after the snapshot 2023-07-29T02:03:01.003 INFO:tasks.workunit.client.0.smithi042.stdout: create 249/32 file after the snapshot 2023-07-29T02:03:01.004 INFO:tasks.workunit.client.0.smithi042.stdout: create 249/33 file after the snapshot 2023-07-29T02:03:01.006 INFO:tasks.workunit.client.0.smithi042.stdout: create 249/34 file after the snapshot 2023-07-29T02:03:01.007 INFO:tasks.workunit.client.0.smithi042.stdout: create 249/35 file after the snapshot 2023-07-29T02:03:01.009 INFO:tasks.workunit.client.0.smithi042.stdout: create 249/36 file after the snapshot 2023-07-29T02:03:01.010 INFO:tasks.workunit.client.0.smithi042.stdout: create 249/37 file after the snapshot 2023-07-29T02:03:01.012 INFO:tasks.workunit.client.0.smithi042.stdout: create 249/38 file after the snapshot 2023-07-29T02:03:01.012 INFO:tasks.workunit.client.0.smithi042.stdout: create 249/39 file after the snapshot 2023-07-29T02:03:01.014 INFO:tasks.workunit.client.0.smithi042.stdout: create 250/.snap/snap-subdir-test 2023-07-29T02:03:01.039 INFO:tasks.workunit.client.0.smithi042.stdout: create 250/30 file after the snapshot 2023-07-29T02:03:01.041 INFO:tasks.workunit.client.0.smithi042.stdout: create 250/31 file after the snapshot 2023-07-29T02:03:01.043 INFO:tasks.workunit.client.0.smithi042.stdout: create 250/32 file after the snapshot 2023-07-29T02:03:01.044 INFO:tasks.workunit.client.0.smithi042.stdout: create 250/33 file after the snapshot 2023-07-29T02:03:01.046 INFO:tasks.workunit.client.0.smithi042.stdout: create 250/34 file after the snapshot 2023-07-29T02:03:01.047 INFO:tasks.workunit.client.0.smithi042.stdout: create 250/35 file after the snapshot 2023-07-29T02:03:01.049 INFO:tasks.workunit.client.0.smithi042.stdout: create 250/36 file after the snapshot 2023-07-29T02:03:01.050 INFO:tasks.workunit.client.0.smithi042.stdout: create 250/37 file after the snapshot 2023-07-29T02:03:01.052 INFO:tasks.workunit.client.0.smithi042.stdout: create 250/38 file after the snapshot 2023-07-29T02:03:01.053 INFO:tasks.workunit.client.0.smithi042.stdout: create 250/39 file after the snapshot 2023-07-29T02:03:01.053 INFO:tasks.workunit.client.0.smithi042.stdout: create 251/.snap/snap-subdir-test 2023-07-29T02:03:01.084 INFO:tasks.workunit.client.0.smithi042.stdout: create 251/30 file after the snapshot 2023-07-29T02:03:01.086 INFO:tasks.workunit.client.0.smithi042.stdout: create 251/31 file after the snapshot 2023-07-29T02:03:01.088 INFO:tasks.workunit.client.0.smithi042.stdout: create 251/32 file after the snapshot 2023-07-29T02:03:01.089 INFO:tasks.workunit.client.0.smithi042.stdout: create 251/33 file after the snapshot 2023-07-29T02:03:01.091 INFO:tasks.workunit.client.0.smithi042.stdout: create 251/34 file after the snapshot 2023-07-29T02:03:01.093 INFO:tasks.workunit.client.0.smithi042.stdout: create 251/35 file after the snapshot 2023-07-29T02:03:01.094 INFO:tasks.workunit.client.0.smithi042.stdout: create 251/36 file after the snapshot 2023-07-29T02:03:01.096 INFO:tasks.workunit.client.0.smithi042.stdout: create 251/37 file after the snapshot 2023-07-29T02:03:01.096 INFO:tasks.workunit.client.0.smithi042.stdout: create 251/38 file after the snapshot 2023-07-29T02:03:01.097 INFO:tasks.workunit.client.0.smithi042.stdout: create 251/39 file after the snapshot 2023-07-29T02:03:01.098 INFO:tasks.workunit.client.0.smithi042.stdout: create 252/.snap/snap-subdir-test 2023-07-29T02:03:01.136 INFO:tasks.workunit.client.0.smithi042.stdout: create 252/30 file after the snapshot 2023-07-29T02:03:01.138 INFO:tasks.workunit.client.0.smithi042.stdout: create 252/31 file after the snapshot 2023-07-29T02:03:01.140 INFO:tasks.workunit.client.0.smithi042.stdout: create 252/32 file after the snapshot 2023-07-29T02:03:01.141 INFO:tasks.workunit.client.0.smithi042.stdout: create 252/33 file after the snapshot 2023-07-29T02:03:01.143 INFO:tasks.workunit.client.0.smithi042.stdout: create 252/34 file after the snapshot 2023-07-29T02:03:01.144 INFO:tasks.workunit.client.0.smithi042.stdout: create 252/35 file after the snapshot 2023-07-29T02:03:01.146 INFO:tasks.workunit.client.0.smithi042.stdout: create 252/36 file after the snapshot 2023-07-29T02:03:01.148 INFO:tasks.workunit.client.0.smithi042.stdout: create 252/37 file after the snapshot 2023-07-29T02:03:01.149 INFO:tasks.workunit.client.0.smithi042.stdout: create 252/38 file after the snapshot 2023-07-29T02:03:01.150 INFO:tasks.workunit.client.0.smithi042.stdout: create 252/39 file after the snapshot 2023-07-29T02:03:01.151 INFO:tasks.workunit.client.0.smithi042.stdout: create 253/.snap/snap-subdir-test 2023-07-29T02:03:01.183 INFO:tasks.workunit.client.0.smithi042.stdout: create 253/30 file after the snapshot 2023-07-29T02:03:01.185 INFO:tasks.workunit.client.0.smithi042.stdout: create 253/31 file after the snapshot 2023-07-29T02:03:01.187 INFO:tasks.workunit.client.0.smithi042.stdout: create 253/32 file after the snapshot 2023-07-29T02:03:01.188 INFO:tasks.workunit.client.0.smithi042.stdout: create 253/33 file after the snapshot 2023-07-29T02:03:01.190 INFO:tasks.workunit.client.0.smithi042.stdout: create 253/34 file after the snapshot 2023-07-29T02:03:01.191 INFO:tasks.workunit.client.0.smithi042.stdout: create 253/35 file after the snapshot 2023-07-29T02:03:01.193 INFO:tasks.workunit.client.0.smithi042.stdout: create 253/36 file after the snapshot 2023-07-29T02:03:01.194 INFO:tasks.workunit.client.0.smithi042.stdout: create 253/37 file after the snapshot 2023-07-29T02:03:01.196 INFO:tasks.workunit.client.0.smithi042.stdout: create 253/38 file after the snapshot 2023-07-29T02:03:01.197 INFO:tasks.workunit.client.0.smithi042.stdout: create 253/39 file after the snapshot 2023-07-29T02:03:01.198 INFO:tasks.workunit.client.0.smithi042.stdout: create 254/.snap/snap-subdir-test 2023-07-29T02:03:01.231 INFO:tasks.workunit.client.0.smithi042.stdout: create 254/30 file after the snapshot 2023-07-29T02:03:01.233 INFO:tasks.workunit.client.0.smithi042.stdout: create 254/31 file after the snapshot 2023-07-29T02:03:01.234 INFO:tasks.workunit.client.0.smithi042.stdout: create 254/32 file after the snapshot 2023-07-29T02:03:01.236 INFO:tasks.workunit.client.0.smithi042.stdout: create 254/33 file after the snapshot 2023-07-29T02:03:01.237 INFO:tasks.workunit.client.0.smithi042.stdout: create 254/34 file after the snapshot 2023-07-29T02:03:01.239 INFO:tasks.workunit.client.0.smithi042.stdout: create 254/35 file after the snapshot 2023-07-29T02:03:01.241 INFO:tasks.workunit.client.0.smithi042.stdout: create 254/36 file after the snapshot 2023-07-29T02:03:01.242 INFO:tasks.workunit.client.0.smithi042.stdout: create 254/37 file after the snapshot 2023-07-29T02:03:01.244 INFO:tasks.workunit.client.0.smithi042.stdout: create 254/38 file after the snapshot 2023-07-29T02:03:01.245 INFO:tasks.workunit.client.0.smithi042.stdout: create 254/39 file after the snapshot 2023-07-29T02:03:01.246 INFO:tasks.workunit.client.0.smithi042.stdout: create 255/.snap/snap-subdir-test 2023-07-29T02:03:01.278 INFO:tasks.workunit.client.0.smithi042.stdout: create 255/30 file after the snapshot 2023-07-29T02:03:01.281 INFO:tasks.workunit.client.0.smithi042.stdout: create 255/31 file after the snapshot 2023-07-29T02:03:01.282 INFO:tasks.workunit.client.0.smithi042.stdout: create 255/32 file after the snapshot 2023-07-29T02:03:01.284 INFO:tasks.workunit.client.0.smithi042.stdout: create 255/33 file after the snapshot 2023-07-29T02:03:01.285 INFO:tasks.workunit.client.0.smithi042.stdout: create 255/34 file after the snapshot 2023-07-29T02:03:01.286 INFO:tasks.workunit.client.0.smithi042.stdout: create 255/35 file after the snapshot 2023-07-29T02:03:01.289 INFO:tasks.workunit.client.0.smithi042.stdout: create 255/36 file after the snapshot 2023-07-29T02:03:01.290 INFO:tasks.workunit.client.0.smithi042.stdout: create 255/37 file after the snapshot 2023-07-29T02:03:01.291 INFO:tasks.workunit.client.0.smithi042.stdout: create 255/38 file after the snapshot 2023-07-29T02:03:01.292 INFO:tasks.workunit.client.0.smithi042.stdout: create 255/39 file after the snapshot 2023-07-29T02:03:01.293 INFO:tasks.workunit.client.0.smithi042.stdout: create 256/.snap/snap-subdir-test 2023-07-29T02:03:01.326 INFO:tasks.workunit.client.0.smithi042.stdout: create 256/30 file after the snapshot 2023-07-29T02:03:01.328 INFO:tasks.workunit.client.0.smithi042.stdout: create 256/31 file after the snapshot 2023-07-29T02:03:01.329 INFO:tasks.workunit.client.0.smithi042.stdout: create 256/32 file after the snapshot 2023-07-29T02:03:01.331 INFO:tasks.workunit.client.0.smithi042.stdout: create 256/33 file after the snapshot 2023-07-29T02:03:01.332 INFO:tasks.workunit.client.0.smithi042.stdout: create 256/34 file after the snapshot 2023-07-29T02:03:01.334 INFO:tasks.workunit.client.0.smithi042.stdout: create 256/35 file after the snapshot 2023-07-29T02:03:01.335 INFO:tasks.workunit.client.0.smithi042.stdout: create 256/36 file after the snapshot 2023-07-29T02:03:01.337 INFO:tasks.workunit.client.0.smithi042.stdout: create 256/37 file after the snapshot 2023-07-29T02:03:01.338 INFO:tasks.workunit.client.0.smithi042.stdout: create 256/38 file after the snapshot 2023-07-29T02:03:01.340 INFO:tasks.workunit.client.0.smithi042.stdout: create 256/39 file after the snapshot 2023-07-29T02:03:01.340 INFO:tasks.workunit.client.0.smithi042.stdout: create 257/.snap/snap-subdir-test 2023-07-29T02:03:01.373 INFO:tasks.workunit.client.0.smithi042.stdout: create 257/30 file after the snapshot 2023-07-29T02:03:01.375 INFO:tasks.workunit.client.0.smithi042.stdout: create 257/31 file after the snapshot 2023-07-29T02:03:01.376 INFO:tasks.workunit.client.0.smithi042.stdout: create 257/32 file after the snapshot 2023-07-29T02:03:01.378 INFO:tasks.workunit.client.0.smithi042.stdout: create 257/33 file after the snapshot 2023-07-29T02:03:01.379 INFO:tasks.workunit.client.0.smithi042.stdout: create 257/34 file after the snapshot 2023-07-29T02:03:01.381 INFO:tasks.workunit.client.0.smithi042.stdout: create 257/35 file after the snapshot 2023-07-29T02:03:01.383 INFO:tasks.workunit.client.0.smithi042.stdout: create 257/36 file after the snapshot 2023-07-29T02:03:01.384 INFO:tasks.workunit.client.0.smithi042.stdout: create 257/37 file after the snapshot 2023-07-29T02:03:01.386 INFO:tasks.workunit.client.0.smithi042.stdout: create 257/38 file after the snapshot 2023-07-29T02:03:01.387 INFO:tasks.workunit.client.0.smithi042.stdout: create 257/39 file after the snapshot 2023-07-29T02:03:01.387 INFO:tasks.workunit.client.0.smithi042.stdout: create 258/.snap/snap-subdir-test 2023-07-29T02:03:01.426 INFO:tasks.workunit.client.0.smithi042.stdout: create 258/30 file after the snapshot 2023-07-29T02:03:01.430 INFO:tasks.workunit.client.0.smithi042.stdout: create 258/31 file after the snapshot 2023-07-29T02:03:01.432 INFO:tasks.workunit.client.0.smithi042.stdout: create 258/32 file after the snapshot 2023-07-29T02:03:01.435 INFO:tasks.workunit.client.0.smithi042.stdout: create 258/33 file after the snapshot 2023-07-29T02:03:01.436 INFO:tasks.workunit.client.0.smithi042.stdout: create 258/34 file after the snapshot 2023-07-29T02:03:01.437 INFO:tasks.workunit.client.0.smithi042.stdout: create 258/35 file after the snapshot 2023-07-29T02:03:01.438 INFO:tasks.workunit.client.0.smithi042.stdout: create 258/36 file after the snapshot 2023-07-29T02:03:01.438 INFO:tasks.workunit.client.0.smithi042.stdout: create 258/37 file after the snapshot 2023-07-29T02:03:01.439 INFO:tasks.workunit.client.0.smithi042.stdout: create 258/38 file after the snapshot 2023-07-29T02:03:01.440 INFO:tasks.workunit.client.0.smithi042.stdout: create 258/39 file after the snapshot 2023-07-29T02:03:01.440 INFO:tasks.workunit.client.0.smithi042.stdout: create 259/.snap/snap-subdir-test 2023-07-29T02:03:01.477 INFO:tasks.workunit.client.0.smithi042.stdout: create 259/30 file after the snapshot 2023-07-29T02:03:01.480 INFO:tasks.workunit.client.0.smithi042.stdout: create 259/31 file after the snapshot 2023-07-29T02:03:01.483 INFO:tasks.workunit.client.0.smithi042.stdout: create 259/32 file after the snapshot 2023-07-29T02:03:01.486 INFO:tasks.workunit.client.0.smithi042.stdout: create 259/33 file after the snapshot 2023-07-29T02:03:01.487 INFO:tasks.workunit.client.0.smithi042.stdout: create 259/34 file after the snapshot 2023-07-29T02:03:01.488 INFO:tasks.workunit.client.0.smithi042.stdout: create 259/35 file after the snapshot 2023-07-29T02:03:01.489 INFO:tasks.workunit.client.0.smithi042.stdout: create 259/36 file after the snapshot 2023-07-29T02:03:01.489 INFO:tasks.workunit.client.0.smithi042.stdout: create 259/37 file after the snapshot 2023-07-29T02:03:01.490 INFO:tasks.workunit.client.0.smithi042.stdout: create 259/38 file after the snapshot 2023-07-29T02:03:01.490 INFO:tasks.workunit.client.0.smithi042.stdout: create 259/39 file after the snapshot 2023-07-29T02:03:01.491 INFO:tasks.workunit.client.0.smithi042.stdout: create 260/.snap/snap-subdir-test 2023-07-29T02:03:01.530 INFO:tasks.workunit.client.0.smithi042.stdout: create 260/30 file after the snapshot 2023-07-29T02:03:01.532 INFO:tasks.workunit.client.0.smithi042.stdout: create 260/31 file after the snapshot 2023-07-29T02:03:01.534 INFO:tasks.workunit.client.0.smithi042.stdout: create 260/32 file after the snapshot 2023-07-29T02:03:01.536 INFO:tasks.workunit.client.0.smithi042.stdout: create 260/33 file after the snapshot 2023-07-29T02:03:01.538 INFO:tasks.workunit.client.0.smithi042.stdout: create 260/34 file after the snapshot 2023-07-29T02:03:01.538 INFO:tasks.workunit.client.0.smithi042.stdout: create 260/35 file after the snapshot 2023-07-29T02:03:01.539 INFO:tasks.workunit.client.0.smithi042.stdout: create 260/36 file after the snapshot 2023-07-29T02:03:01.539 INFO:tasks.workunit.client.0.smithi042.stdout: create 260/37 file after the snapshot 2023-07-29T02:03:01.540 INFO:tasks.workunit.client.0.smithi042.stdout: create 260/38 file after the snapshot 2023-07-29T02:03:01.541 INFO:tasks.workunit.client.0.smithi042.stdout: create 260/39 file after the snapshot 2023-07-29T02:03:01.541 INFO:tasks.workunit.client.0.smithi042.stdout: create 261/.snap/snap-subdir-test 2023-07-29T02:03:01.575 INFO:tasks.workunit.client.0.smithi042.stdout: create 261/30 file after the snapshot 2023-07-29T02:03:01.576 INFO:tasks.workunit.client.0.smithi042.stdout: create 261/31 file after the snapshot 2023-07-29T02:03:01.578 INFO:tasks.workunit.client.0.smithi042.stdout: create 261/32 file after the snapshot 2023-07-29T02:03:01.579 INFO:tasks.workunit.client.0.smithi042.stdout: create 261/33 file after the snapshot 2023-07-29T02:03:01.581 INFO:tasks.workunit.client.0.smithi042.stdout: create 261/34 file after the snapshot 2023-07-29T02:03:01.582 INFO:tasks.workunit.client.0.smithi042.stdout: create 261/35 file after the snapshot 2023-07-29T02:03:01.589 INFO:tasks.workunit.client.0.smithi042.stdout: create 261/36 file after the snapshot 2023-07-29T02:03:01.589 INFO:tasks.workunit.client.0.smithi042.stdout: create 261/37 file after the snapshot 2023-07-29T02:03:01.590 INFO:tasks.workunit.client.0.smithi042.stdout: create 261/38 file after the snapshot 2023-07-29T02:03:01.590 INFO:tasks.workunit.client.0.smithi042.stdout: create 261/39 file after the snapshot 2023-07-29T02:03:01.591 INFO:tasks.workunit.client.0.smithi042.stdout: create 262/.snap/snap-subdir-test 2023-07-29T02:03:01.620 INFO:tasks.workunit.client.0.smithi042.stdout: create 262/30 file after the snapshot 2023-07-29T02:03:01.623 INFO:tasks.workunit.client.0.smithi042.stdout: create 262/31 file after the snapshot 2023-07-29T02:03:01.625 INFO:tasks.workunit.client.0.smithi042.stdout: create 262/32 file after the snapshot 2023-07-29T02:03:01.627 INFO:tasks.workunit.client.0.smithi042.stdout: create 262/33 file after the snapshot 2023-07-29T02:03:01.629 INFO:tasks.workunit.client.0.smithi042.stdout: create 262/34 file after the snapshot 2023-07-29T02:03:01.630 INFO:tasks.workunit.client.0.smithi042.stdout: create 262/35 file after the snapshot 2023-07-29T02:03:01.631 INFO:tasks.workunit.client.0.smithi042.stdout: create 262/36 file after the snapshot 2023-07-29T02:03:01.632 INFO:tasks.workunit.client.0.smithi042.stdout: create 262/37 file after the snapshot 2023-07-29T02:03:01.632 INFO:tasks.workunit.client.0.smithi042.stdout: create 262/38 file after the snapshot 2023-07-29T02:03:01.633 INFO:tasks.workunit.client.0.smithi042.stdout: create 262/39 file after the snapshot 2023-07-29T02:03:01.633 INFO:tasks.workunit.client.0.smithi042.stdout: create 263/.snap/snap-subdir-test 2023-07-29T02:03:01.659 INFO:tasks.workunit.client.0.smithi042.stdout: create 263/30 file after the snapshot 2023-07-29T02:03:01.662 INFO:tasks.workunit.client.0.smithi042.stdout: create 263/31 file after the snapshot 2023-07-29T02:03:01.663 INFO:tasks.workunit.client.0.smithi042.stdout: create 263/32 file after the snapshot 2023-07-29T02:03:01.665 INFO:tasks.workunit.client.0.smithi042.stdout: create 263/33 file after the snapshot 2023-07-29T02:03:01.667 INFO:tasks.workunit.client.0.smithi042.stdout: create 263/34 file after the snapshot 2023-07-29T02:03:01.669 INFO:tasks.workunit.client.0.smithi042.stdout: create 263/35 file after the snapshot 2023-07-29T02:03:01.671 INFO:tasks.workunit.client.0.smithi042.stdout: create 263/36 file after the snapshot 2023-07-29T02:03:01.673 INFO:tasks.workunit.client.0.smithi042.stdout: create 263/37 file after the snapshot 2023-07-29T02:03:01.674 INFO:tasks.workunit.client.0.smithi042.stdout: create 263/38 file after the snapshot 2023-07-29T02:03:01.674 INFO:tasks.workunit.client.0.smithi042.stdout: create 263/39 file after the snapshot 2023-07-29T02:03:01.675 INFO:tasks.workunit.client.0.smithi042.stdout: create 264/.snap/snap-subdir-test 2023-07-29T02:03:01.701 INFO:tasks.workunit.client.0.smithi042.stdout: create 264/30 file after the snapshot 2023-07-29T02:03:01.703 INFO:tasks.workunit.client.0.smithi042.stdout: create 264/31 file after the snapshot 2023-07-29T02:03:01.704 INFO:tasks.workunit.client.0.smithi042.stdout: create 264/32 file after the snapshot 2023-07-29T02:03:01.706 INFO:tasks.workunit.client.0.smithi042.stdout: create 264/33 file after the snapshot 2023-07-29T02:03:01.708 INFO:tasks.workunit.client.0.smithi042.stdout: create 264/34 file after the snapshot 2023-07-29T02:03:01.709 INFO:tasks.workunit.client.0.smithi042.stdout: create 264/35 file after the snapshot 2023-07-29T02:03:01.711 INFO:tasks.workunit.client.0.smithi042.stdout: create 264/36 file after the snapshot 2023-07-29T02:03:01.713 INFO:tasks.workunit.client.0.smithi042.stdout: create 264/37 file after the snapshot 2023-07-29T02:03:01.714 INFO:tasks.workunit.client.0.smithi042.stdout: create 264/38 file after the snapshot 2023-07-29T02:03:01.715 INFO:tasks.workunit.client.0.smithi042.stdout: create 264/39 file after the snapshot 2023-07-29T02:03:01.716 INFO:tasks.workunit.client.0.smithi042.stdout: create 265/.snap/snap-subdir-test 2023-07-29T02:03:01.742 INFO:tasks.workunit.client.0.smithi042.stdout: create 265/30 file after the snapshot 2023-07-29T02:03:01.744 INFO:tasks.workunit.client.0.smithi042.stdout: create 265/31 file after the snapshot 2023-07-29T02:03:01.746 INFO:tasks.workunit.client.0.smithi042.stdout: create 265/32 file after the snapshot 2023-07-29T02:03:01.748 INFO:tasks.workunit.client.0.smithi042.stdout: create 265/33 file after the snapshot 2023-07-29T02:03:01.750 INFO:tasks.workunit.client.0.smithi042.stdout: create 265/34 file after the snapshot 2023-07-29T02:03:01.752 INFO:tasks.workunit.client.0.smithi042.stdout: create 265/35 file after the snapshot 2023-07-29T02:03:01.753 INFO:tasks.workunit.client.0.smithi042.stdout: create 265/36 file after the snapshot 2023-07-29T02:03:01.755 INFO:tasks.workunit.client.0.smithi042.stdout: create 265/37 file after the snapshot 2023-07-29T02:03:01.756 INFO:tasks.workunit.client.0.smithi042.stdout: create 265/38 file after the snapshot 2023-07-29T02:03:01.757 INFO:tasks.workunit.client.0.smithi042.stdout: create 265/39 file after the snapshot 2023-07-29T02:03:01.757 INFO:tasks.workunit.client.0.smithi042.stdout: create 266/.snap/snap-subdir-test 2023-07-29T02:03:01.784 INFO:tasks.workunit.client.0.smithi042.stdout: create 266/30 file after the snapshot 2023-07-29T02:03:01.786 INFO:tasks.workunit.client.0.smithi042.stdout: create 266/31 file after the snapshot 2023-07-29T02:03:01.787 INFO:tasks.workunit.client.0.smithi042.stdout: create 266/32 file after the snapshot 2023-07-29T02:03:01.789 INFO:tasks.workunit.client.0.smithi042.stdout: create 266/33 file after the snapshot 2023-07-29T02:03:01.791 INFO:tasks.workunit.client.0.smithi042.stdout: create 266/34 file after the snapshot 2023-07-29T02:03:01.793 INFO:tasks.workunit.client.0.smithi042.stdout: create 266/35 file after the snapshot 2023-07-29T02:03:01.795 INFO:tasks.workunit.client.0.smithi042.stdout: create 266/36 file after the snapshot 2023-07-29T02:03:01.797 INFO:tasks.workunit.client.0.smithi042.stdout: create 266/37 file after the snapshot 2023-07-29T02:03:01.799 INFO:tasks.workunit.client.0.smithi042.stdout: create 266/38 file after the snapshot 2023-07-29T02:03:01.799 INFO:tasks.workunit.client.0.smithi042.stdout: create 266/39 file after the snapshot 2023-07-29T02:03:01.799 INFO:tasks.workunit.client.0.smithi042.stdout: create 267/.snap/snap-subdir-test 2023-07-29T02:03:01.825 INFO:tasks.workunit.client.0.smithi042.stdout: create 267/30 file after the snapshot 2023-07-29T02:03:01.827 INFO:tasks.workunit.client.0.smithi042.stdout: create 267/31 file after the snapshot 2023-07-29T02:03:01.828 INFO:tasks.workunit.client.0.smithi042.stdout: create 267/32 file after the snapshot 2023-07-29T02:03:01.829 INFO:tasks.workunit.client.0.smithi042.stdout: create 267/33 file after the snapshot 2023-07-29T02:03:01.831 INFO:tasks.workunit.client.0.smithi042.stdout: create 267/34 file after the snapshot 2023-07-29T02:03:01.832 INFO:tasks.workunit.client.0.smithi042.stdout: create 267/35 file after the snapshot 2023-07-29T02:03:01.834 INFO:tasks.workunit.client.0.smithi042.stdout: create 267/36 file after the snapshot 2023-07-29T02:03:01.836 INFO:tasks.workunit.client.0.smithi042.stdout: create 267/37 file after the snapshot 2023-07-29T02:03:01.837 INFO:tasks.workunit.client.0.smithi042.stdout: create 267/38 file after the snapshot 2023-07-29T02:03:01.838 INFO:tasks.workunit.client.0.smithi042.stdout: create 267/39 file after the snapshot 2023-07-29T02:03:01.839 INFO:tasks.workunit.client.0.smithi042.stdout: create 268/.snap/snap-subdir-test 2023-07-29T02:03:01.864 INFO:tasks.workunit.client.0.smithi042.stdout: create 268/30 file after the snapshot 2023-07-29T02:03:01.867 INFO:tasks.workunit.client.0.smithi042.stdout: create 268/31 file after the snapshot 2023-07-29T02:03:01.868 INFO:tasks.workunit.client.0.smithi042.stdout: create 268/32 file after the snapshot 2023-07-29T02:03:01.869 INFO:tasks.workunit.client.0.smithi042.stdout: create 268/33 file after the snapshot 2023-07-29T02:03:01.871 INFO:tasks.workunit.client.0.smithi042.stdout: create 268/34 file after the snapshot 2023-07-29T02:03:01.873 INFO:tasks.workunit.client.0.smithi042.stdout: create 268/35 file after the snapshot 2023-07-29T02:03:01.874 INFO:tasks.workunit.client.0.smithi042.stdout: create 268/36 file after the snapshot 2023-07-29T02:03:01.876 INFO:tasks.workunit.client.0.smithi042.stdout: create 268/37 file after the snapshot 2023-07-29T02:03:01.877 INFO:tasks.workunit.client.0.smithi042.stdout: create 268/38 file after the snapshot 2023-07-29T02:03:01.878 INFO:tasks.workunit.client.0.smithi042.stdout: create 268/39 file after the snapshot 2023-07-29T02:03:01.879 INFO:tasks.workunit.client.0.smithi042.stdout: create 269/.snap/snap-subdir-test 2023-07-29T02:03:01.908 INFO:tasks.workunit.client.0.smithi042.stdout: create 269/30 file after the snapshot 2023-07-29T02:03:01.909 INFO:tasks.workunit.client.0.smithi042.stdout: create 269/31 file after the snapshot 2023-07-29T02:03:01.911 INFO:tasks.workunit.client.0.smithi042.stdout: create 269/32 file after the snapshot 2023-07-29T02:03:01.912 INFO:tasks.workunit.client.0.smithi042.stdout: create 269/33 file after the snapshot 2023-07-29T02:03:01.914 INFO:tasks.workunit.client.0.smithi042.stdout: create 269/34 file after the snapshot 2023-07-29T02:03:01.915 INFO:tasks.workunit.client.0.smithi042.stdout: create 269/35 file after the snapshot 2023-07-29T02:03:01.917 INFO:tasks.workunit.client.0.smithi042.stdout: create 269/36 file after the snapshot 2023-07-29T02:03:01.918 INFO:tasks.workunit.client.0.smithi042.stdout: create 269/37 file after the snapshot 2023-07-29T02:03:01.921 INFO:tasks.workunit.client.0.smithi042.stdout: create 269/38 file after the snapshot 2023-07-29T02:03:01.922 INFO:tasks.workunit.client.0.smithi042.stdout: create 269/39 file after the snapshot 2023-07-29T02:03:01.922 INFO:tasks.workunit.client.0.smithi042.stdout: create 270/.snap/snap-subdir-test 2023-07-29T02:03:01.947 INFO:tasks.workunit.client.0.smithi042.stdout: create 270/30 file after the snapshot 2023-07-29T02:03:01.952 INFO:tasks.workunit.client.0.smithi042.stdout: create 270/31 file after the snapshot 2023-07-29T02:03:01.953 INFO:tasks.workunit.client.0.smithi042.stdout: create 270/32 file after the snapshot 2023-07-29T02:03:01.956 INFO:tasks.workunit.client.0.smithi042.stdout: create 270/33 file after the snapshot 2023-07-29T02:03:01.957 INFO:tasks.workunit.client.0.smithi042.stdout: create 270/34 file after the snapshot 2023-07-29T02:03:01.960 INFO:tasks.workunit.client.0.smithi042.stdout: create 270/35 file after the snapshot 2023-07-29T02:03:01.961 INFO:tasks.workunit.client.0.smithi042.stdout: create 270/36 file after the snapshot 2023-07-29T02:03:01.962 INFO:tasks.workunit.client.0.smithi042.stdout: create 270/37 file after the snapshot 2023-07-29T02:03:01.963 INFO:tasks.workunit.client.0.smithi042.stdout: create 270/38 file after the snapshot 2023-07-29T02:03:01.963 INFO:tasks.workunit.client.0.smithi042.stdout: create 270/39 file after the snapshot 2023-07-29T02:03:01.964 INFO:tasks.workunit.client.0.smithi042.stdout: create 271/.snap/snap-subdir-test 2023-07-29T02:03:01.993 INFO:tasks.workunit.client.0.smithi042.stdout: create 271/30 file after the snapshot 2023-07-29T02:03:01.994 INFO:tasks.workunit.client.0.smithi042.stdout: create 271/31 file after the snapshot 2023-07-29T02:03:01.996 INFO:tasks.workunit.client.0.smithi042.stdout: create 271/32 file after the snapshot 2023-07-29T02:03:01.998 INFO:tasks.workunit.client.0.smithi042.stdout: create 271/33 file after the snapshot 2023-07-29T02:03:01.999 INFO:tasks.workunit.client.0.smithi042.stdout: create 271/34 file after the snapshot 2023-07-29T02:03:02.001 INFO:tasks.workunit.client.0.smithi042.stdout: create 271/35 file after the snapshot 2023-07-29T02:03:02.002 INFO:tasks.workunit.client.0.smithi042.stdout: create 271/36 file after the snapshot 2023-07-29T02:03:02.004 INFO:tasks.workunit.client.0.smithi042.stdout: create 271/37 file after the snapshot 2023-07-29T02:03:02.005 INFO:tasks.workunit.client.0.smithi042.stdout: create 271/38 file after the snapshot 2023-07-29T02:03:02.007 INFO:tasks.workunit.client.0.smithi042.stdout: create 271/39 file after the snapshot 2023-07-29T02:03:02.007 INFO:tasks.workunit.client.0.smithi042.stdout: create 272/.snap/snap-subdir-test 2023-07-29T02:03:02.036 INFO:tasks.workunit.client.0.smithi042.stdout: create 272/30 file after the snapshot 2023-07-29T02:03:02.039 INFO:tasks.workunit.client.0.smithi042.stdout: create 272/31 file after the snapshot 2023-07-29T02:03:02.042 INFO:tasks.workunit.client.0.smithi042.stdout: create 272/32 file after the snapshot 2023-07-29T02:03:02.046 INFO:tasks.workunit.client.0.smithi042.stdout: create 272/33 file after the snapshot 2023-07-29T02:03:02.047 INFO:tasks.workunit.client.0.smithi042.stdout: create 272/34 file after the snapshot 2023-07-29T02:03:02.047 INFO:tasks.workunit.client.0.smithi042.stdout: create 272/35 file after the snapshot 2023-07-29T02:03:02.048 INFO:tasks.workunit.client.0.smithi042.stdout: create 272/36 file after the snapshot 2023-07-29T02:03:02.049 INFO:tasks.workunit.client.0.smithi042.stdout: create 272/37 file after the snapshot 2023-07-29T02:03:02.050 INFO:tasks.workunit.client.0.smithi042.stdout: create 272/38 file after the snapshot 2023-07-29T02:03:02.051 INFO:tasks.workunit.client.0.smithi042.stdout: create 272/39 file after the snapshot 2023-07-29T02:03:02.051 INFO:tasks.workunit.client.0.smithi042.stdout: create 273/.snap/snap-subdir-test 2023-07-29T02:03:02.078 INFO:tasks.workunit.client.0.smithi042.stdout: create 273/30 file after the snapshot 2023-07-29T02:03:02.081 INFO:tasks.workunit.client.0.smithi042.stdout: create 273/31 file after the snapshot 2023-07-29T02:03:02.083 INFO:tasks.workunit.client.0.smithi042.stdout: create 273/32 file after the snapshot 2023-07-29T02:03:02.086 INFO:tasks.workunit.client.0.smithi042.stdout: create 273/33 file after the snapshot 2023-07-29T02:03:02.088 INFO:tasks.workunit.client.0.smithi042.stdout: create 273/34 file after the snapshot 2023-07-29T02:03:02.090 INFO:tasks.workunit.client.0.smithi042.stdout: create 273/35 file after the snapshot 2023-07-29T02:03:02.092 INFO:tasks.workunit.client.0.smithi042.stdout: create 273/36 file after the snapshot 2023-07-29T02:03:02.093 INFO:tasks.workunit.client.0.smithi042.stdout: create 273/37 file after the snapshot 2023-07-29T02:03:02.094 INFO:tasks.workunit.client.0.smithi042.stdout: create 273/38 file after the snapshot 2023-07-29T02:03:02.095 INFO:tasks.workunit.client.0.smithi042.stdout: create 273/39 file after the snapshot 2023-07-29T02:03:02.096 INFO:tasks.workunit.client.0.smithi042.stdout: create 274/.snap/snap-subdir-test 2023-07-29T02:03:02.122 INFO:tasks.workunit.client.0.smithi042.stdout: create 274/30 file after the snapshot 2023-07-29T02:03:02.126 INFO:tasks.workunit.client.0.smithi042.stdout: create 274/31 file after the snapshot 2023-07-29T02:03:02.128 INFO:tasks.workunit.client.0.smithi042.stdout: create 274/32 file after the snapshot 2023-07-29T02:03:02.131 INFO:tasks.workunit.client.0.smithi042.stdout: create 274/33 file after the snapshot 2023-07-29T02:03:02.133 INFO:tasks.workunit.client.0.smithi042.stdout: create 274/34 file after the snapshot 2023-07-29T02:03:02.135 INFO:tasks.workunit.client.0.smithi042.stdout: create 274/35 file after the snapshot 2023-07-29T02:03:02.137 INFO:tasks.workunit.client.0.smithi042.stdout: create 274/36 file after the snapshot 2023-07-29T02:03:02.138 INFO:tasks.workunit.client.0.smithi042.stdout: create 274/37 file after the snapshot 2023-07-29T02:03:02.139 INFO:tasks.workunit.client.0.smithi042.stdout: create 274/38 file after the snapshot 2023-07-29T02:03:02.140 INFO:tasks.workunit.client.0.smithi042.stdout: create 274/39 file after the snapshot 2023-07-29T02:03:02.141 INFO:tasks.workunit.client.0.smithi042.stdout: create 275/.snap/snap-subdir-test 2023-07-29T02:03:02.170 INFO:tasks.workunit.client.0.smithi042.stdout: create 275/30 file after the snapshot 2023-07-29T02:03:02.173 INFO:tasks.workunit.client.0.smithi042.stdout: create 275/31 file after the snapshot 2023-07-29T02:03:02.174 INFO:tasks.workunit.client.0.smithi042.stdout: create 275/32 file after the snapshot 2023-07-29T02:03:02.176 INFO:tasks.workunit.client.0.smithi042.stdout: create 275/33 file after the snapshot 2023-07-29T02:03:02.178 INFO:tasks.workunit.client.0.smithi042.stdout: create 275/34 file after the snapshot 2023-07-29T02:03:02.179 INFO:tasks.workunit.client.0.smithi042.stdout: create 275/35 file after the snapshot 2023-07-29T02:03:02.181 INFO:tasks.workunit.client.0.smithi042.stdout: create 275/36 file after the snapshot 2023-07-29T02:03:02.182 INFO:tasks.workunit.client.0.smithi042.stdout: create 275/37 file after the snapshot 2023-07-29T02:03:02.184 INFO:tasks.workunit.client.0.smithi042.stdout: create 275/38 file after the snapshot 2023-07-29T02:03:02.185 INFO:tasks.workunit.client.0.smithi042.stdout: create 275/39 file after the snapshot 2023-07-29T02:03:02.186 INFO:tasks.workunit.client.0.smithi042.stdout: create 276/.snap/snap-subdir-test 2023-07-29T02:03:02.212 INFO:tasks.workunit.client.0.smithi042.stdout: create 276/30 file after the snapshot 2023-07-29T02:03:02.214 INFO:tasks.workunit.client.0.smithi042.stdout: create 276/31 file after the snapshot 2023-07-29T02:03:02.216 INFO:tasks.workunit.client.0.smithi042.stdout: create 276/32 file after the snapshot 2023-07-29T02:03:02.217 INFO:tasks.workunit.client.0.smithi042.stdout: create 276/33 file after the snapshot 2023-07-29T02:03:02.219 INFO:tasks.workunit.client.0.smithi042.stdout: create 276/34 file after the snapshot 2023-07-29T02:03:02.221 INFO:tasks.workunit.client.0.smithi042.stdout: create 276/35 file after the snapshot 2023-07-29T02:03:02.222 INFO:tasks.workunit.client.0.smithi042.stdout: create 276/36 file after the snapshot 2023-07-29T02:03:02.224 INFO:tasks.workunit.client.0.smithi042.stdout: create 276/37 file after the snapshot 2023-07-29T02:03:02.225 INFO:tasks.workunit.client.0.smithi042.stdout: create 276/38 file after the snapshot 2023-07-29T02:03:02.226 INFO:tasks.workunit.client.0.smithi042.stdout: create 276/39 file after the snapshot 2023-07-29T02:03:02.227 INFO:tasks.workunit.client.0.smithi042.stdout: create 277/.snap/snap-subdir-test 2023-07-29T02:03:02.252 INFO:tasks.workunit.client.0.smithi042.stdout: create 277/30 file after the snapshot 2023-07-29T02:03:02.254 INFO:tasks.workunit.client.0.smithi042.stdout: create 277/31 file after the snapshot 2023-07-29T02:03:02.256 INFO:tasks.workunit.client.0.smithi042.stdout: create 277/32 file after the snapshot 2023-07-29T02:03:02.258 INFO:tasks.workunit.client.0.smithi042.stdout: create 277/33 file after the snapshot 2023-07-29T02:03:02.260 INFO:tasks.workunit.client.0.smithi042.stdout: create 277/34 file after the snapshot 2023-07-29T02:03:02.263 INFO:tasks.workunit.client.0.smithi042.stdout: create 277/35 file after the snapshot 2023-07-29T02:03:02.265 INFO:tasks.workunit.client.0.smithi042.stdout: create 277/36 file after the snapshot 2023-07-29T02:03:02.266 INFO:tasks.workunit.client.0.smithi042.stdout: create 277/37 file after the snapshot 2023-07-29T02:03:02.267 INFO:tasks.workunit.client.0.smithi042.stdout: create 277/38 file after the snapshot 2023-07-29T02:03:02.269 INFO:tasks.workunit.client.0.smithi042.stdout: create 277/39 file after the snapshot 2023-07-29T02:03:02.270 INFO:tasks.workunit.client.0.smithi042.stdout: create 278/.snap/snap-subdir-test 2023-07-29T02:03:02.297 INFO:tasks.workunit.client.0.smithi042.stdout: create 278/30 file after the snapshot 2023-07-29T02:03:02.299 INFO:tasks.workunit.client.0.smithi042.stdout: create 278/31 file after the snapshot 2023-07-29T02:03:02.300 INFO:tasks.workunit.client.0.smithi042.stdout: create 278/32 file after the snapshot 2023-07-29T02:03:02.301 INFO:tasks.workunit.client.0.smithi042.stdout: create 278/33 file after the snapshot 2023-07-29T02:03:02.303 INFO:tasks.workunit.client.0.smithi042.stdout: create 278/34 file after the snapshot 2023-07-29T02:03:02.304 INFO:tasks.workunit.client.0.smithi042.stdout: create 278/35 file after the snapshot 2023-07-29T02:03:02.306 INFO:tasks.workunit.client.0.smithi042.stdout: create 278/36 file after the snapshot 2023-07-29T02:03:02.308 INFO:tasks.workunit.client.0.smithi042.stdout: create 278/37 file after the snapshot 2023-07-29T02:03:02.310 INFO:tasks.workunit.client.0.smithi042.stdout: create 278/38 file after the snapshot 2023-07-29T02:03:02.310 INFO:tasks.workunit.client.0.smithi042.stdout: create 278/39 file after the snapshot 2023-07-29T02:03:02.311 INFO:tasks.workunit.client.0.smithi042.stdout: create 279/.snap/snap-subdir-test 2023-07-29T02:03:02.341 INFO:tasks.workunit.client.0.smithi042.stdout: create 279/30 file after the snapshot 2023-07-29T02:03:02.342 INFO:tasks.workunit.client.0.smithi042.stdout: create 279/31 file after the snapshot 2023-07-29T02:03:02.344 INFO:tasks.workunit.client.0.smithi042.stdout: create 279/32 file after the snapshot 2023-07-29T02:03:02.345 INFO:tasks.workunit.client.0.smithi042.stdout: create 279/33 file after the snapshot 2023-07-29T02:03:02.347 INFO:tasks.workunit.client.0.smithi042.stdout: create 279/34 file after the snapshot 2023-07-29T02:03:02.348 INFO:tasks.workunit.client.0.smithi042.stdout: create 279/35 file after the snapshot 2023-07-29T02:03:02.350 INFO:tasks.workunit.client.0.smithi042.stdout: create 279/36 file after the snapshot 2023-07-29T02:03:02.351 INFO:tasks.workunit.client.0.smithi042.stdout: create 279/37 file after the snapshot 2023-07-29T02:03:02.353 INFO:tasks.workunit.client.0.smithi042.stdout: create 279/38 file after the snapshot 2023-07-29T02:03:02.354 INFO:tasks.workunit.client.0.smithi042.stdout: create 279/39 file after the snapshot 2023-07-29T02:03:02.354 INFO:tasks.workunit.client.0.smithi042.stdout: create 280/.snap/snap-subdir-test 2023-07-29T02:03:02.382 INFO:tasks.workunit.client.0.smithi042.stdout: create 280/30 file after the snapshot 2023-07-29T02:03:02.384 INFO:tasks.workunit.client.0.smithi042.stdout: create 280/31 file after the snapshot 2023-07-29T02:03:02.385 INFO:tasks.workunit.client.0.smithi042.stdout: create 280/32 file after the snapshot 2023-07-29T02:03:02.387 INFO:tasks.workunit.client.0.smithi042.stdout: create 280/33 file after the snapshot 2023-07-29T02:03:02.388 INFO:tasks.workunit.client.0.smithi042.stdout: create 280/34 file after the snapshot 2023-07-29T02:03:02.390 INFO:tasks.workunit.client.0.smithi042.stdout: create 280/35 file after the snapshot 2023-07-29T02:03:02.391 INFO:tasks.workunit.client.0.smithi042.stdout: create 280/36 file after the snapshot 2023-07-29T02:03:02.393 INFO:tasks.workunit.client.0.smithi042.stdout: create 280/37 file after the snapshot 2023-07-29T02:03:02.393 INFO:tasks.workunit.client.0.smithi042.stdout: create 280/38 file after the snapshot 2023-07-29T02:03:02.394 INFO:tasks.workunit.client.0.smithi042.stdout: create 280/39 file after the snapshot 2023-07-29T02:03:02.394 INFO:tasks.workunit.client.0.smithi042.stdout: create 281/.snap/snap-subdir-test 2023-07-29T02:03:02.423 INFO:tasks.workunit.client.0.smithi042.stdout: create 281/30 file after the snapshot 2023-07-29T02:03:02.425 INFO:tasks.workunit.client.0.smithi042.stdout: create 281/31 file after the snapshot 2023-07-29T02:03:02.426 INFO:tasks.workunit.client.0.smithi042.stdout: create 281/32 file after the snapshot 2023-07-29T02:03:02.428 INFO:tasks.workunit.client.0.smithi042.stdout: create 281/33 file after the snapshot 2023-07-29T02:03:02.429 INFO:tasks.workunit.client.0.smithi042.stdout: create 281/34 file after the snapshot 2023-07-29T02:03:02.431 INFO:tasks.workunit.client.0.smithi042.stdout: create 281/35 file after the snapshot 2023-07-29T02:03:02.433 INFO:tasks.workunit.client.0.smithi042.stdout: create 281/36 file after the snapshot 2023-07-29T02:03:02.434 INFO:tasks.workunit.client.0.smithi042.stdout: create 281/37 file after the snapshot 2023-07-29T02:03:02.436 INFO:tasks.workunit.client.0.smithi042.stdout: create 281/38 file after the snapshot 2023-07-29T02:03:02.437 INFO:tasks.workunit.client.0.smithi042.stdout: create 281/39 file after the snapshot 2023-07-29T02:03:02.437 INFO:tasks.workunit.client.0.smithi042.stdout: create 282/.snap/snap-subdir-test 2023-07-29T02:03:02.465 INFO:tasks.workunit.client.0.smithi042.stdout: create 282/30 file after the snapshot 2023-07-29T02:03:02.469 INFO:tasks.workunit.client.0.smithi042.stdout: create 282/31 file after the snapshot 2023-07-29T02:03:02.471 INFO:tasks.workunit.client.0.smithi042.stdout: create 282/32 file after the snapshot 2023-07-29T02:03:02.474 INFO:tasks.workunit.client.0.smithi042.stdout: create 282/33 file after the snapshot 2023-07-29T02:03:02.476 INFO:tasks.workunit.client.0.smithi042.stdout: create 282/34 file after the snapshot 2023-07-29T02:03:02.478 INFO:tasks.workunit.client.0.smithi042.stdout: create 282/35 file after the snapshot 2023-07-29T02:03:02.479 INFO:tasks.workunit.client.0.smithi042.stdout: create 282/36 file after the snapshot 2023-07-29T02:03:02.480 INFO:tasks.workunit.client.0.smithi042.stdout: create 282/37 file after the snapshot 2023-07-29T02:03:02.480 INFO:tasks.workunit.client.0.smithi042.stdout: create 282/38 file after the snapshot 2023-07-29T02:03:02.481 INFO:tasks.workunit.client.0.smithi042.stdout: create 282/39 file after the snapshot 2023-07-29T02:03:02.482 INFO:tasks.workunit.client.0.smithi042.stdout: create 283/.snap/snap-subdir-test 2023-07-29T02:03:02.510 INFO:tasks.workunit.client.0.smithi042.stdout: create 283/30 file after the snapshot 2023-07-29T02:03:02.511 INFO:tasks.workunit.client.0.smithi042.stdout: create 283/31 file after the snapshot 2023-07-29T02:03:02.513 INFO:tasks.workunit.client.0.smithi042.stdout: create 283/32 file after the snapshot 2023-07-29T02:03:02.515 INFO:tasks.workunit.client.0.smithi042.stdout: create 283/33 file after the snapshot 2023-07-29T02:03:02.522 INFO:tasks.workunit.client.0.smithi042.stdout: create 283/34 file after the snapshot 2023-07-29T02:03:02.523 INFO:tasks.workunit.client.0.smithi042.stdout: create 283/35 file after the snapshot 2023-07-29T02:03:02.524 INFO:tasks.workunit.client.0.smithi042.stdout: create 283/36 file after the snapshot 2023-07-29T02:03:02.525 INFO:tasks.workunit.client.0.smithi042.stdout: create 283/37 file after the snapshot 2023-07-29T02:03:02.526 INFO:tasks.workunit.client.0.smithi042.stdout: create 283/38 file after the snapshot 2023-07-29T02:03:02.527 INFO:tasks.workunit.client.0.smithi042.stdout: create 283/39 file after the snapshot 2023-07-29T02:03:02.528 INFO:tasks.workunit.client.0.smithi042.stdout: create 284/.snap/snap-subdir-test 2023-07-29T02:03:02.561 INFO:tasks.workunit.client.0.smithi042.stdout: create 284/30 file after the snapshot 2023-07-29T02:03:02.564 INFO:tasks.workunit.client.0.smithi042.stdout: create 284/31 file after the snapshot 2023-07-29T02:03:02.566 INFO:tasks.workunit.client.0.smithi042.stdout: create 284/32 file after the snapshot 2023-07-29T02:03:02.568 INFO:tasks.workunit.client.0.smithi042.stdout: create 284/33 file after the snapshot 2023-07-29T02:03:02.570 INFO:tasks.workunit.client.0.smithi042.stdout: create 284/34 file after the snapshot 2023-07-29T02:03:02.572 INFO:tasks.workunit.client.0.smithi042.stdout: create 284/35 file after the snapshot 2023-07-29T02:03:02.573 INFO:tasks.workunit.client.0.smithi042.stdout: create 284/36 file after the snapshot 2023-07-29T02:03:02.574 INFO:tasks.workunit.client.0.smithi042.stdout: create 284/37 file after the snapshot 2023-07-29T02:03:02.575 INFO:tasks.workunit.client.0.smithi042.stdout: create 284/38 file after the snapshot 2023-07-29T02:03:02.576 INFO:tasks.workunit.client.0.smithi042.stdout: create 284/39 file after the snapshot 2023-07-29T02:03:02.577 INFO:tasks.workunit.client.0.smithi042.stdout: create 285/.snap/snap-subdir-test 2023-07-29T02:03:02.604 INFO:tasks.workunit.client.0.smithi042.stdout: create 285/30 file after the snapshot 2023-07-29T02:03:02.607 INFO:tasks.workunit.client.0.smithi042.stdout: create 285/31 file after the snapshot 2023-07-29T02:03:02.609 INFO:tasks.workunit.client.0.smithi042.stdout: create 285/32 file after the snapshot 2023-07-29T02:03:02.612 INFO:tasks.workunit.client.0.smithi042.stdout: create 285/33 file after the snapshot 2023-07-29T02:03:02.614 INFO:tasks.workunit.client.0.smithi042.stdout: create 285/34 file after the snapshot 2023-07-29T02:03:02.617 INFO:tasks.workunit.client.0.smithi042.stdout: create 285/35 file after the snapshot 2023-07-29T02:03:02.617 INFO:tasks.workunit.client.0.smithi042.stdout: create 285/36 file after the snapshot 2023-07-29T02:03:02.618 INFO:tasks.workunit.client.0.smithi042.stdout: create 285/37 file after the snapshot 2023-07-29T02:03:02.619 INFO:tasks.workunit.client.0.smithi042.stdout: create 285/38 file after the snapshot 2023-07-29T02:03:02.620 INFO:tasks.workunit.client.0.smithi042.stdout: create 285/39 file after the snapshot 2023-07-29T02:03:02.621 INFO:tasks.workunit.client.0.smithi042.stdout: create 286/.snap/snap-subdir-test 2023-07-29T02:03:02.652 INFO:tasks.workunit.client.0.smithi042.stdout: create 286/30 file after the snapshot 2023-07-29T02:03:02.653 INFO:tasks.workunit.client.0.smithi042.stdout: create 286/31 file after the snapshot 2023-07-29T02:03:02.655 INFO:tasks.workunit.client.0.smithi042.stdout: create 286/32 file after the snapshot 2023-07-29T02:03:02.656 INFO:tasks.workunit.client.0.smithi042.stdout: create 286/33 file after the snapshot 2023-07-29T02:03:02.658 INFO:tasks.workunit.client.0.smithi042.stdout: create 286/34 file after the snapshot 2023-07-29T02:03:02.659 INFO:tasks.workunit.client.0.smithi042.stdout: create 286/35 file after the snapshot 2023-07-29T02:03:02.661 INFO:tasks.workunit.client.0.smithi042.stdout: create 286/36 file after the snapshot 2023-07-29T02:03:02.662 INFO:tasks.workunit.client.0.smithi042.stdout: create 286/37 file after the snapshot 2023-07-29T02:03:02.663 INFO:tasks.workunit.client.0.smithi042.stdout: create 286/38 file after the snapshot 2023-07-29T02:03:02.664 INFO:tasks.workunit.client.0.smithi042.stdout: create 286/39 file after the snapshot 2023-07-29T02:03:02.664 INFO:tasks.workunit.client.0.smithi042.stdout: create 287/.snap/snap-subdir-test 2023-07-29T02:03:02.691 INFO:tasks.workunit.client.0.smithi042.stdout: create 287/30 file after the snapshot 2023-07-29T02:03:02.693 INFO:tasks.workunit.client.0.smithi042.stdout: create 287/31 file after the snapshot 2023-07-29T02:03:02.695 INFO:tasks.workunit.client.0.smithi042.stdout: create 287/32 file after the snapshot 2023-07-29T02:03:02.696 INFO:tasks.workunit.client.0.smithi042.stdout: create 287/33 file after the snapshot 2023-07-29T02:03:02.698 INFO:tasks.workunit.client.0.smithi042.stdout: create 287/34 file after the snapshot 2023-07-29T02:03:02.699 INFO:tasks.workunit.client.0.smithi042.stdout: create 287/35 file after the snapshot 2023-07-29T02:03:02.701 INFO:tasks.workunit.client.0.smithi042.stdout: create 287/36 file after the snapshot 2023-07-29T02:03:02.703 INFO:tasks.workunit.client.0.smithi042.stdout: create 287/37 file after the snapshot 2023-07-29T02:03:02.704 INFO:tasks.workunit.client.0.smithi042.stdout: create 287/38 file after the snapshot 2023-07-29T02:03:02.705 INFO:tasks.workunit.client.0.smithi042.stdout: create 287/39 file after the snapshot 2023-07-29T02:03:02.705 INFO:tasks.workunit.client.0.smithi042.stdout: create 288/.snap/snap-subdir-test 2023-07-29T02:03:02.735 INFO:tasks.workunit.client.0.smithi042.stdout: create 288/30 file after the snapshot 2023-07-29T02:03:02.735 INFO:tasks.workunit.client.0.smithi042.stdout: create 288/31 file after the snapshot 2023-07-29T02:03:02.737 INFO:tasks.workunit.client.0.smithi042.stdout: create 288/32 file after the snapshot 2023-07-29T02:03:02.738 INFO:tasks.workunit.client.0.smithi042.stdout: create 288/33 file after the snapshot 2023-07-29T02:03:02.740 INFO:tasks.workunit.client.0.smithi042.stdout: create 288/34 file after the snapshot 2023-07-29T02:03:02.742 INFO:tasks.workunit.client.0.smithi042.stdout: create 288/35 file after the snapshot 2023-07-29T02:03:02.743 INFO:tasks.workunit.client.0.smithi042.stdout: create 288/36 file after the snapshot 2023-07-29T02:03:02.744 INFO:tasks.workunit.client.0.smithi042.stdout: create 288/37 file after the snapshot 2023-07-29T02:03:02.745 INFO:tasks.workunit.client.0.smithi042.stdout: create 288/38 file after the snapshot 2023-07-29T02:03:02.746 INFO:tasks.workunit.client.0.smithi042.stdout: create 288/39 file after the snapshot 2023-07-29T02:03:02.746 INFO:tasks.workunit.client.0.smithi042.stdout: create 289/.snap/snap-subdir-test 2023-07-29T02:03:02.773 INFO:tasks.workunit.client.0.smithi042.stdout: create 289/30 file after the snapshot 2023-07-29T02:03:02.775 INFO:tasks.workunit.client.0.smithi042.stdout: create 289/31 file after the snapshot 2023-07-29T02:03:02.777 INFO:tasks.workunit.client.0.smithi042.stdout: create 289/32 file after the snapshot 2023-07-29T02:03:02.778 INFO:tasks.workunit.client.0.smithi042.stdout: create 289/33 file after the snapshot 2023-07-29T02:03:02.780 INFO:tasks.workunit.client.0.smithi042.stdout: create 289/34 file after the snapshot 2023-07-29T02:03:02.783 INFO:tasks.workunit.client.0.smithi042.stdout: create 289/35 file after the snapshot 2023-07-29T02:03:02.785 INFO:tasks.workunit.client.0.smithi042.stdout: create 289/36 file after the snapshot 2023-07-29T02:03:02.786 INFO:tasks.workunit.client.0.smithi042.stdout: create 289/37 file after the snapshot 2023-07-29T02:03:02.787 INFO:tasks.workunit.client.0.smithi042.stdout: create 289/38 file after the snapshot 2023-07-29T02:03:02.788 INFO:tasks.workunit.client.0.smithi042.stdout: create 289/39 file after the snapshot 2023-07-29T02:03:02.789 INFO:tasks.workunit.client.0.smithi042.stdout: create 290/.snap/snap-subdir-test 2023-07-29T02:03:02.818 INFO:tasks.workunit.client.0.smithi042.stdout: create 290/30 file after the snapshot 2023-07-29T02:03:02.822 INFO:tasks.workunit.client.0.smithi042.stdout: create 290/31 file after the snapshot 2023-07-29T02:03:02.824 INFO:tasks.workunit.client.0.smithi042.stdout: create 290/32 file after the snapshot 2023-07-29T02:03:02.826 INFO:tasks.workunit.client.0.smithi042.stdout: create 290/33 file after the snapshot 2023-07-29T02:03:02.829 INFO:tasks.workunit.client.0.smithi042.stdout: create 290/34 file after the snapshot 2023-07-29T02:03:02.831 INFO:tasks.workunit.client.0.smithi042.stdout: create 290/35 file after the snapshot 2023-07-29T02:03:02.833 INFO:tasks.workunit.client.0.smithi042.stdout: create 290/36 file after the snapshot 2023-07-29T02:03:02.834 INFO:tasks.workunit.client.0.smithi042.stdout: create 290/37 file after the snapshot 2023-07-29T02:03:02.835 INFO:tasks.workunit.client.0.smithi042.stdout: create 290/38 file after the snapshot 2023-07-29T02:03:02.836 INFO:tasks.workunit.client.0.smithi042.stdout: create 290/39 file after the snapshot 2023-07-29T02:03:02.837 INFO:tasks.workunit.client.0.smithi042.stdout: create 291/.snap/snap-subdir-test 2023-07-29T02:03:02.862 INFO:tasks.workunit.client.0.smithi042.stdout: create 291/30 file after the snapshot 2023-07-29T02:03:02.876 INFO:tasks.workunit.client.0.smithi042.stdout: create 291/31 file after the snapshot 2023-07-29T02:03:02.877 INFO:tasks.workunit.client.0.smithi042.stdout: create 291/32 file after the snapshot 2023-07-29T02:03:02.878 INFO:tasks.workunit.client.0.smithi042.stdout: create 291/33 file after the snapshot 2023-07-29T02:03:02.878 INFO:tasks.workunit.client.0.smithi042.stdout: create 291/34 file after the snapshot 2023-07-29T02:03:02.879 INFO:tasks.workunit.client.0.smithi042.stdout: create 291/35 file after the snapshot 2023-07-29T02:03:02.880 INFO:tasks.workunit.client.0.smithi042.stdout: create 291/36 file after the snapshot 2023-07-29T02:03:02.880 INFO:tasks.workunit.client.0.smithi042.stdout: create 291/37 file after the snapshot 2023-07-29T02:03:02.881 INFO:tasks.workunit.client.0.smithi042.stdout: create 291/38 file after the snapshot 2023-07-29T02:03:02.882 INFO:tasks.workunit.client.0.smithi042.stdout: create 291/39 file after the snapshot 2023-07-29T02:03:02.882 INFO:tasks.workunit.client.0.smithi042.stdout: create 292/.snap/snap-subdir-test 2023-07-29T02:03:02.913 INFO:tasks.workunit.client.0.smithi042.stdout: create 292/30 file after the snapshot 2023-07-29T02:03:02.915 INFO:tasks.workunit.client.0.smithi042.stdout: create 292/31 file after the snapshot 2023-07-29T02:03:02.916 INFO:tasks.workunit.client.0.smithi042.stdout: create 292/32 file after the snapshot 2023-07-29T02:03:02.918 INFO:tasks.workunit.client.0.smithi042.stdout: create 292/33 file after the snapshot 2023-07-29T02:03:02.920 INFO:tasks.workunit.client.0.smithi042.stdout: create 292/34 file after the snapshot 2023-07-29T02:03:02.921 INFO:tasks.workunit.client.0.smithi042.stdout: create 292/35 file after the snapshot 2023-07-29T02:03:02.923 INFO:tasks.workunit.client.0.smithi042.stdout: create 292/36 file after the snapshot 2023-07-29T02:03:02.924 INFO:tasks.workunit.client.0.smithi042.stdout: create 292/37 file after the snapshot 2023-07-29T02:03:02.926 INFO:tasks.workunit.client.0.smithi042.stdout: create 292/38 file after the snapshot 2023-07-29T02:03:02.927 INFO:tasks.workunit.client.0.smithi042.stdout: create 292/39 file after the snapshot 2023-07-29T02:03:02.928 INFO:tasks.workunit.client.0.smithi042.stdout: create 293/.snap/snap-subdir-test 2023-07-29T02:03:02.957 INFO:tasks.workunit.client.0.smithi042.stdout: create 293/30 file after the snapshot 2023-07-29T02:03:02.959 INFO:tasks.workunit.client.0.smithi042.stdout: create 293/31 file after the snapshot 2023-07-29T02:03:02.961 INFO:tasks.workunit.client.0.smithi042.stdout: create 293/32 file after the snapshot 2023-07-29T02:03:02.963 INFO:tasks.workunit.client.0.smithi042.stdout: create 293/33 file after the snapshot 2023-07-29T02:03:02.964 INFO:tasks.workunit.client.0.smithi042.stdout: create 293/34 file after the snapshot 2023-07-29T02:03:02.966 INFO:tasks.workunit.client.0.smithi042.stdout: create 293/35 file after the snapshot 2023-07-29T02:03:02.967 INFO:tasks.workunit.client.0.smithi042.stdout: create 293/36 file after the snapshot 2023-07-29T02:03:02.969 INFO:tasks.workunit.client.0.smithi042.stdout: create 293/37 file after the snapshot 2023-07-29T02:03:02.970 INFO:tasks.workunit.client.0.smithi042.stdout: create 293/38 file after the snapshot 2023-07-29T02:03:02.970 INFO:tasks.workunit.client.0.smithi042.stdout: create 293/39 file after the snapshot 2023-07-29T02:03:02.971 INFO:tasks.workunit.client.0.smithi042.stdout: create 294/.snap/snap-subdir-test 2023-07-29T02:03:03.001 INFO:tasks.workunit.client.0.smithi042.stdout: create 294/30 file after the snapshot 2023-07-29T02:03:03.003 INFO:tasks.workunit.client.0.smithi042.stdout: create 294/31 file after the snapshot 2023-07-29T02:03:03.005 INFO:tasks.workunit.client.0.smithi042.stdout: create 294/32 file after the snapshot 2023-07-29T02:03:03.006 INFO:tasks.workunit.client.0.smithi042.stdout: create 294/33 file after the snapshot 2023-07-29T02:03:03.008 INFO:tasks.workunit.client.0.smithi042.stdout: create 294/34 file after the snapshot 2023-07-29T02:03:03.009 INFO:tasks.workunit.client.0.smithi042.stdout: create 294/35 file after the snapshot 2023-07-29T02:03:03.011 INFO:tasks.workunit.client.0.smithi042.stdout: create 294/36 file after the snapshot 2023-07-29T02:03:03.012 INFO:tasks.workunit.client.0.smithi042.stdout: create 294/37 file after the snapshot 2023-07-29T02:03:03.014 INFO:tasks.workunit.client.0.smithi042.stdout: create 294/38 file after the snapshot 2023-07-29T02:03:03.015 INFO:tasks.workunit.client.0.smithi042.stdout: create 294/39 file after the snapshot 2023-07-29T02:03:03.016 INFO:tasks.workunit.client.0.smithi042.stdout: create 295/.snap/snap-subdir-test 2023-07-29T02:03:03.044 INFO:tasks.workunit.client.0.smithi042.stdout: create 295/30 file after the snapshot 2023-07-29T02:03:03.046 INFO:tasks.workunit.client.0.smithi042.stdout: create 295/31 file after the snapshot 2023-07-29T02:03:03.048 INFO:tasks.workunit.client.0.smithi042.stdout: create 295/32 file after the snapshot 2023-07-29T02:03:03.049 INFO:tasks.workunit.client.0.smithi042.stdout: create 295/33 file after the snapshot 2023-07-29T02:03:03.051 INFO:tasks.workunit.client.0.smithi042.stdout: create 295/34 file after the snapshot 2023-07-29T02:03:03.053 INFO:tasks.workunit.client.0.smithi042.stdout: create 295/35 file after the snapshot 2023-07-29T02:03:03.054 INFO:tasks.workunit.client.0.smithi042.stdout: create 295/36 file after the snapshot 2023-07-29T02:03:03.056 INFO:tasks.workunit.client.0.smithi042.stdout: create 295/37 file after the snapshot 2023-07-29T02:03:03.057 INFO:tasks.workunit.client.0.smithi042.stdout: create 295/38 file after the snapshot 2023-07-29T02:03:03.058 INFO:tasks.workunit.client.0.smithi042.stdout: create 295/39 file after the snapshot 2023-07-29T02:03:03.059 INFO:tasks.workunit.client.0.smithi042.stdout: create 296/.snap/snap-subdir-test 2023-07-29T02:03:03.087 INFO:tasks.workunit.client.0.smithi042.stdout: create 296/30 file after the snapshot 2023-07-29T02:03:03.089 INFO:tasks.workunit.client.0.smithi042.stdout: create 296/31 file after the snapshot 2023-07-29T02:03:03.090 INFO:tasks.workunit.client.0.smithi042.stdout: create 296/32 file after the snapshot 2023-07-29T02:03:03.092 INFO:tasks.workunit.client.0.smithi042.stdout: create 296/33 file after the snapshot 2023-07-29T02:03:03.093 INFO:tasks.workunit.client.0.smithi042.stdout: create 296/34 file after the snapshot 2023-07-29T02:03:03.095 INFO:tasks.workunit.client.0.smithi042.stdout: create 296/35 file after the snapshot 2023-07-29T02:03:03.097 INFO:tasks.workunit.client.0.smithi042.stdout: create 296/36 file after the snapshot 2023-07-29T02:03:03.099 INFO:tasks.workunit.client.0.smithi042.stdout: create 296/37 file after the snapshot 2023-07-29T02:03:03.100 INFO:tasks.workunit.client.0.smithi042.stdout: create 296/38 file after the snapshot 2023-07-29T02:03:03.101 INFO:tasks.workunit.client.0.smithi042.stdout: create 296/39 file after the snapshot 2023-07-29T02:03:03.101 INFO:tasks.workunit.client.0.smithi042.stdout: create 297/.snap/snap-subdir-test 2023-07-29T02:03:03.129 INFO:tasks.workunit.client.0.smithi042.stdout: create 297/30 file after the snapshot 2023-07-29T02:03:03.143 INFO:tasks.workunit.client.0.smithi042.stdout: create 297/31 file after the snapshot 2023-07-29T02:03:03.143 INFO:tasks.workunit.client.0.smithi042.stdout: create 297/32 file after the snapshot 2023-07-29T02:03:03.144 INFO:tasks.workunit.client.0.smithi042.stdout: create 297/33 file after the snapshot 2023-07-29T02:03:03.144 INFO:tasks.workunit.client.0.smithi042.stdout: create 297/34 file after the snapshot 2023-07-29T02:03:03.145 INFO:tasks.workunit.client.0.smithi042.stdout: create 297/35 file after the snapshot 2023-07-29T02:03:03.146 INFO:tasks.workunit.client.0.smithi042.stdout: create 297/36 file after the snapshot 2023-07-29T02:03:03.146 INFO:tasks.workunit.client.0.smithi042.stdout: create 297/37 file after the snapshot 2023-07-29T02:03:03.147 INFO:tasks.workunit.client.0.smithi042.stdout: create 297/38 file after the snapshot 2023-07-29T02:03:03.148 INFO:tasks.workunit.client.0.smithi042.stdout: create 297/39 file after the snapshot 2023-07-29T02:03:03.148 INFO:tasks.workunit.client.0.smithi042.stdout: create 298/.snap/snap-subdir-test 2023-07-29T02:03:03.173 INFO:tasks.workunit.client.0.smithi042.stdout: create 298/30 file after the snapshot 2023-07-29T02:03:03.187 INFO:tasks.workunit.client.0.smithi042.stdout: create 298/31 file after the snapshot 2023-07-29T02:03:03.188 INFO:tasks.workunit.client.0.smithi042.stdout: create 298/32 file after the snapshot 2023-07-29T02:03:03.188 INFO:tasks.workunit.client.0.smithi042.stdout: create 298/33 file after the snapshot 2023-07-29T02:03:03.189 INFO:tasks.workunit.client.0.smithi042.stdout: create 298/34 file after the snapshot 2023-07-29T02:03:03.190 INFO:tasks.workunit.client.0.smithi042.stdout: create 298/35 file after the snapshot 2023-07-29T02:03:03.190 INFO:tasks.workunit.client.0.smithi042.stdout: create 298/36 file after the snapshot 2023-07-29T02:03:03.191 INFO:tasks.workunit.client.0.smithi042.stdout: create 298/37 file after the snapshot 2023-07-29T02:03:03.191 INFO:tasks.workunit.client.0.smithi042.stdout: create 298/38 file after the snapshot 2023-07-29T02:03:03.192 INFO:tasks.workunit.client.0.smithi042.stdout: create 298/39 file after the snapshot 2023-07-29T02:03:03.193 INFO:tasks.workunit.client.0.smithi042.stdout: create 299/.snap/snap-subdir-test 2023-07-29T02:03:03.218 INFO:tasks.workunit.client.0.smithi042.stdout: create 299/30 file after the snapshot 2023-07-29T02:03:03.220 INFO:tasks.workunit.client.0.smithi042.stdout: create 299/31 file after the snapshot 2023-07-29T02:03:03.222 INFO:tasks.workunit.client.0.smithi042.stdout: create 299/32 file after the snapshot 2023-07-29T02:03:03.223 INFO:tasks.workunit.client.0.smithi042.stdout: create 299/33 file after the snapshot 2023-07-29T02:03:03.225 INFO:tasks.workunit.client.0.smithi042.stdout: create 299/34 file after the snapshot 2023-07-29T02:03:03.226 INFO:tasks.workunit.client.0.smithi042.stdout: create 299/35 file after the snapshot 2023-07-29T02:03:03.228 INFO:tasks.workunit.client.0.smithi042.stdout: create 299/36 file after the snapshot 2023-07-29T02:03:03.229 INFO:tasks.workunit.client.0.smithi042.stdout: create 299/37 file after the snapshot 2023-07-29T02:03:03.231 INFO:tasks.workunit.client.0.smithi042.stdout: create 299/38 file after the snapshot 2023-07-29T02:03:03.232 INFO:tasks.workunit.client.0.smithi042.stdout: create 299/39 file after the snapshot 2023-07-29T02:03:03.232 INFO:tasks.workunit.client.0.smithi042.stdout:Take second snapshot .snap/test2 2023-07-29T02:03:03.282 INFO:tasks.workunit.client.0.smithi042.stdout:Copy content of .snap/test1 to copyofsnap1 ... 2023-07-29T02:03:06.253 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:03:06.255 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:03:14.688 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1' -> 'copyofsnap1/test1' 2023-07-29T02:03:14.688 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/100' -> 'copyofsnap1/test1/100' 2023-07-29T02:03:14.689 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/100/10' -> 'copyofsnap1/test1/100/10' 2023-07-29T02:03:14.689 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/100/11' -> 'copyofsnap1/test1/100/11' 2023-07-29T02:03:14.689 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/100/12' -> 'copyofsnap1/test1/100/12' 2023-07-29T02:03:14.689 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/100/13' -> 'copyofsnap1/test1/100/13' 2023-07-29T02:03:14.689 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/100/14' -> 'copyofsnap1/test1/100/14' 2023-07-29T02:03:14.689 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/100/15' -> 'copyofsnap1/test1/100/15' 2023-07-29T02:03:14.689 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/100/16' -> 'copyofsnap1/test1/100/16' 2023-07-29T02:03:14.690 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/100/17' -> 'copyofsnap1/test1/100/17' 2023-07-29T02:03:14.690 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/100/18' -> 'copyofsnap1/test1/100/18' 2023-07-29T02:03:14.690 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/100/19' -> 'copyofsnap1/test1/100/19' 2023-07-29T02:03:14.690 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/100/20' -> 'copyofsnap1/test1/100/20' 2023-07-29T02:03:14.690 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/101' -> 'copyofsnap1/test1/101' 2023-07-29T02:03:14.690 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/101/10' -> 'copyofsnap1/test1/101/10' 2023-07-29T02:03:14.690 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/101/11' -> 'copyofsnap1/test1/101/11' 2023-07-29T02:03:14.690 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/101/12' -> 'copyofsnap1/test1/101/12' 2023-07-29T02:03:14.691 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/101/13' -> 'copyofsnap1/test1/101/13' 2023-07-29T02:03:14.691 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/101/14' -> 'copyofsnap1/test1/101/14' 2023-07-29T02:03:14.691 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/101/15' -> 'copyofsnap1/test1/101/15' 2023-07-29T02:03:14.691 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/101/16' -> 'copyofsnap1/test1/101/16' 2023-07-29T02:03:14.691 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/101/17' -> 'copyofsnap1/test1/101/17' 2023-07-29T02:03:14.691 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/101/18' -> 'copyofsnap1/test1/101/18' 2023-07-29T02:03:14.691 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/101/19' -> 'copyofsnap1/test1/101/19' 2023-07-29T02:03:14.691 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/101/20' -> 'copyofsnap1/test1/101/20' 2023-07-29T02:03:14.692 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/102' -> 'copyofsnap1/test1/102' 2023-07-29T02:03:14.692 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/102/10' -> 'copyofsnap1/test1/102/10' 2023-07-29T02:03:14.692 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/102/11' -> 'copyofsnap1/test1/102/11' 2023-07-29T02:03:14.692 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/102/12' -> 'copyofsnap1/test1/102/12' 2023-07-29T02:03:14.692 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/102/13' -> 'copyofsnap1/test1/102/13' 2023-07-29T02:03:14.692 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/102/14' -> 'copyofsnap1/test1/102/14' 2023-07-29T02:03:14.692 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/102/15' -> 'copyofsnap1/test1/102/15' 2023-07-29T02:03:14.692 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/102/16' -> 'copyofsnap1/test1/102/16' 2023-07-29T02:03:14.693 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/102/17' -> 'copyofsnap1/test1/102/17' 2023-07-29T02:03:14.693 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/102/18' -> 'copyofsnap1/test1/102/18' 2023-07-29T02:03:14.693 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/102/19' -> 'copyofsnap1/test1/102/19' 2023-07-29T02:03:14.693 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/102/20' -> 'copyofsnap1/test1/102/20' 2023-07-29T02:03:14.693 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/103' -> 'copyofsnap1/test1/103' 2023-07-29T02:03:14.693 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/103/10' -> 'copyofsnap1/test1/103/10' 2023-07-29T02:03:14.693 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/103/11' -> 'copyofsnap1/test1/103/11' 2023-07-29T02:03:14.694 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/103/12' -> 'copyofsnap1/test1/103/12' 2023-07-29T02:03:14.694 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/103/13' -> 'copyofsnap1/test1/103/13' 2023-07-29T02:03:14.694 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/103/14' -> 'copyofsnap1/test1/103/14' 2023-07-29T02:03:14.694 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/103/15' -> 'copyofsnap1/test1/103/15' 2023-07-29T02:03:14.694 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/103/16' -> 'copyofsnap1/test1/103/16' 2023-07-29T02:03:14.694 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/103/17' -> 'copyofsnap1/test1/103/17' 2023-07-29T02:03:14.694 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/103/18' -> 'copyofsnap1/test1/103/18' 2023-07-29T02:03:14.694 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/103/19' -> 'copyofsnap1/test1/103/19' 2023-07-29T02:03:14.695 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/103/20' -> 'copyofsnap1/test1/103/20' 2023-07-29T02:03:14.695 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/104' -> 'copyofsnap1/test1/104' 2023-07-29T02:03:14.695 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/104/10' -> 'copyofsnap1/test1/104/10' 2023-07-29T02:03:14.695 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/104/11' -> 'copyofsnap1/test1/104/11' 2023-07-29T02:03:14.695 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/104/12' -> 'copyofsnap1/test1/104/12' 2023-07-29T02:03:14.695 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/104/13' -> 'copyofsnap1/test1/104/13' 2023-07-29T02:03:14.695 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/104/14' -> 'copyofsnap1/test1/104/14' 2023-07-29T02:03:14.695 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/104/15' -> 'copyofsnap1/test1/104/15' 2023-07-29T02:03:14.696 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/104/16' -> 'copyofsnap1/test1/104/16' 2023-07-29T02:03:14.696 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/104/17' -> 'copyofsnap1/test1/104/17' 2023-07-29T02:03:14.696 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/104/18' -> 'copyofsnap1/test1/104/18' 2023-07-29T02:03:14.696 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/104/19' -> 'copyofsnap1/test1/104/19' 2023-07-29T02:03:14.696 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/104/20' -> 'copyofsnap1/test1/104/20' 2023-07-29T02:03:14.696 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/105' -> 'copyofsnap1/test1/105' 2023-07-29T02:03:14.696 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/105/10' -> 'copyofsnap1/test1/105/10' 2023-07-29T02:03:14.696 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/105/11' -> 'copyofsnap1/test1/105/11' 2023-07-29T02:03:14.697 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/105/12' -> 'copyofsnap1/test1/105/12' 2023-07-29T02:03:14.697 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/105/13' -> 'copyofsnap1/test1/105/13' 2023-07-29T02:03:14.697 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/105/14' -> 'copyofsnap1/test1/105/14' 2023-07-29T02:03:14.697 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/105/15' -> 'copyofsnap1/test1/105/15' 2023-07-29T02:03:14.697 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/105/16' -> 'copyofsnap1/test1/105/16' 2023-07-29T02:03:14.697 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/105/17' -> 'copyofsnap1/test1/105/17' 2023-07-29T02:03:14.697 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/105/18' -> 'copyofsnap1/test1/105/18' 2023-07-29T02:03:14.697 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/105/19' -> 'copyofsnap1/test1/105/19' 2023-07-29T02:03:14.698 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/105/20' -> 'copyofsnap1/test1/105/20' 2023-07-29T02:03:14.698 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/106' -> 'copyofsnap1/test1/106' 2023-07-29T02:03:14.698 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/106/10' -> 'copyofsnap1/test1/106/10' 2023-07-29T02:03:14.698 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/106/11' -> 'copyofsnap1/test1/106/11' 2023-07-29T02:03:14.698 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/106/12' -> 'copyofsnap1/test1/106/12' 2023-07-29T02:03:14.698 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/106/13' -> 'copyofsnap1/test1/106/13' 2023-07-29T02:03:14.698 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/106/14' -> 'copyofsnap1/test1/106/14' 2023-07-29T02:03:14.699 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/106/15' -> 'copyofsnap1/test1/106/15' 2023-07-29T02:03:14.699 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/106/16' -> 'copyofsnap1/test1/106/16' 2023-07-29T02:03:14.853 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/106/17' -> 'copyofsnap1/test1/106/17' 2023-07-29T02:03:14.853 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/106/18' -> 'copyofsnap1/test1/106/18' 2023-07-29T02:03:14.853 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/106/19' -> 'copyofsnap1/test1/106/19' 2023-07-29T02:03:14.853 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/106/20' -> 'copyofsnap1/test1/106/20' 2023-07-29T02:03:14.853 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/107' -> 'copyofsnap1/test1/107' 2023-07-29T02:03:14.854 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/107/10' -> 'copyofsnap1/test1/107/10' 2023-07-29T02:03:14.854 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/107/11' -> 'copyofsnap1/test1/107/11' 2023-07-29T02:03:14.854 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/107/12' -> 'copyofsnap1/test1/107/12' 2023-07-29T02:03:14.854 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/107/13' -> 'copyofsnap1/test1/107/13' 2023-07-29T02:03:14.854 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/107/14' -> 'copyofsnap1/test1/107/14' 2023-07-29T02:03:14.854 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/107/15' -> 'copyofsnap1/test1/107/15' 2023-07-29T02:03:14.854 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/107/16' -> 'copyofsnap1/test1/107/16' 2023-07-29T02:03:14.854 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/107/17' -> 'copyofsnap1/test1/107/17' 2023-07-29T02:03:14.855 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/107/18' -> 'copyofsnap1/test1/107/18' 2023-07-29T02:03:14.855 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/107/19' -> 'copyofsnap1/test1/107/19' 2023-07-29T02:03:14.855 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/107/20' -> 'copyofsnap1/test1/107/20' 2023-07-29T02:03:14.855 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/108' -> 'copyofsnap1/test1/108' 2023-07-29T02:03:14.855 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/108/10' -> 'copyofsnap1/test1/108/10' 2023-07-29T02:03:14.855 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/108/11' -> 'copyofsnap1/test1/108/11' 2023-07-29T02:03:14.855 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/108/12' -> 'copyofsnap1/test1/108/12' 2023-07-29T02:03:14.855 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/108/13' -> 'copyofsnap1/test1/108/13' 2023-07-29T02:03:14.856 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/108/14' -> 'copyofsnap1/test1/108/14' 2023-07-29T02:03:14.856 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/108/15' -> 'copyofsnap1/test1/108/15' 2023-07-29T02:03:14.856 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/108/16' -> 'copyofsnap1/test1/108/16' 2023-07-29T02:03:14.856 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/108/17' -> 'copyofsnap1/test1/108/17' 2023-07-29T02:03:14.856 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/108/18' -> 'copyofsnap1/test1/108/18' 2023-07-29T02:03:14.856 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/108/19' -> 'copyofsnap1/test1/108/19' 2023-07-29T02:03:14.856 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/108/20' -> 'copyofsnap1/test1/108/20' 2023-07-29T02:03:14.857 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/109' -> 'copyofsnap1/test1/109' 2023-07-29T02:03:14.857 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/109/10' -> 'copyofsnap1/test1/109/10' 2023-07-29T02:03:14.857 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/109/11' -> 'copyofsnap1/test1/109/11' 2023-07-29T02:03:14.857 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/109/12' -> 'copyofsnap1/test1/109/12' 2023-07-29T02:03:14.857 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/109/13' -> 'copyofsnap1/test1/109/13' 2023-07-29T02:03:14.857 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/109/14' -> 'copyofsnap1/test1/109/14' 2023-07-29T02:03:14.857 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/109/15' -> 'copyofsnap1/test1/109/15' 2023-07-29T02:03:14.857 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/109/16' -> 'copyofsnap1/test1/109/16' 2023-07-29T02:03:14.858 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/109/17' -> 'copyofsnap1/test1/109/17' 2023-07-29T02:03:14.858 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/109/18' -> 'copyofsnap1/test1/109/18' 2023-07-29T02:03:14.858 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/109/19' -> 'copyofsnap1/test1/109/19' 2023-07-29T02:03:14.858 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/109/20' -> 'copyofsnap1/test1/109/20' 2023-07-29T02:03:14.858 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/110' -> 'copyofsnap1/test1/110' 2023-07-29T02:03:14.858 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/110/10' -> 'copyofsnap1/test1/110/10' 2023-07-29T02:03:14.858 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/110/11' -> 'copyofsnap1/test1/110/11' 2023-07-29T02:03:14.858 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/110/12' -> 'copyofsnap1/test1/110/12' 2023-07-29T02:03:14.859 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/110/13' -> 'copyofsnap1/test1/110/13' 2023-07-29T02:03:14.859 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/110/14' -> 'copyofsnap1/test1/110/14' 2023-07-29T02:03:14.859 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/110/15' -> 'copyofsnap1/test1/110/15' 2023-07-29T02:03:14.859 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/110/16' -> 'copyofsnap1/test1/110/16' 2023-07-29T02:03:14.859 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/110/17' -> 'copyofsnap1/test1/110/17' 2023-07-29T02:03:14.859 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/110/18' -> 'copyofsnap1/test1/110/18' 2023-07-29T02:03:14.859 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/110/19' -> 'copyofsnap1/test1/110/19' 2023-07-29T02:03:14.859 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/110/20' -> 'copyofsnap1/test1/110/20' 2023-07-29T02:03:14.860 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/111' -> 'copyofsnap1/test1/111' 2023-07-29T02:03:14.860 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/111/10' -> 'copyofsnap1/test1/111/10' 2023-07-29T02:03:14.860 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/111/11' -> 'copyofsnap1/test1/111/11' 2023-07-29T02:03:14.860 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/111/12' -> 'copyofsnap1/test1/111/12' 2023-07-29T02:03:14.860 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/111/13' -> 'copyofsnap1/test1/111/13' 2023-07-29T02:03:14.860 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/111/14' -> 'copyofsnap1/test1/111/14' 2023-07-29T02:03:14.860 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/111/15' -> 'copyofsnap1/test1/111/15' 2023-07-29T02:03:14.860 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/111/16' -> 'copyofsnap1/test1/111/16' 2023-07-29T02:03:14.861 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/111/17' -> 'copyofsnap1/test1/111/17' 2023-07-29T02:03:14.861 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/111/18' -> 'copyofsnap1/test1/111/18' 2023-07-29T02:03:14.861 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/111/19' -> 'copyofsnap1/test1/111/19' 2023-07-29T02:03:14.861 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/111/20' -> 'copyofsnap1/test1/111/20' 2023-07-29T02:03:14.861 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/112' -> 'copyofsnap1/test1/112' 2023-07-29T02:03:14.861 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/112/10' -> 'copyofsnap1/test1/112/10' 2023-07-29T02:03:14.861 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/112/11' -> 'copyofsnap1/test1/112/11' 2023-07-29T02:03:14.861 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/112/12' -> 'copyofsnap1/test1/112/12' 2023-07-29T02:03:14.862 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/112/13' -> 'copyofsnap1/test1/112/13' 2023-07-29T02:03:14.862 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/112/14' -> 'copyofsnap1/test1/112/14' 2023-07-29T02:03:14.862 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/112/15' -> 'copyofsnap1/test1/112/15' 2023-07-29T02:03:14.862 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/112/16' -> 'copyofsnap1/test1/112/16' 2023-07-29T02:03:14.862 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/112/17' -> 'copyofsnap1/test1/112/17' 2023-07-29T02:03:14.863 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/112/18' -> 'copyofsnap1/test1/112/18' 2023-07-29T02:03:14.863 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/112/19' -> 'copyofsnap1/test1/112/19' 2023-07-29T02:03:14.863 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/112/20' -> 'copyofsnap1/test1/112/20' 2023-07-29T02:03:14.863 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/113' -> 'copyofsnap1/test1/113' 2023-07-29T02:03:14.863 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/113/10' -> 'copyofsnap1/test1/113/10' 2023-07-29T02:03:14.863 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/113/11' -> 'copyofsnap1/test1/113/11' 2023-07-29T02:03:14.864 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/113/12' -> 'copyofsnap1/test1/113/12' 2023-07-29T02:03:14.864 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/113/13' -> 'copyofsnap1/test1/113/13' 2023-07-29T02:03:15.014 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/113/14' -> 'copyofsnap1/test1/113/14' 2023-07-29T02:03:15.014 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/113/15' -> 'copyofsnap1/test1/113/15' 2023-07-29T02:03:15.015 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/113/16' -> 'copyofsnap1/test1/113/16' 2023-07-29T02:03:15.015 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/113/17' -> 'copyofsnap1/test1/113/17' 2023-07-29T02:03:15.015 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/113/18' -> 'copyofsnap1/test1/113/18' 2023-07-29T02:03:15.015 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/113/19' -> 'copyofsnap1/test1/113/19' 2023-07-29T02:03:15.016 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/113/20' -> 'copyofsnap1/test1/113/20' 2023-07-29T02:03:15.016 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/114' -> 'copyofsnap1/test1/114' 2023-07-29T02:03:15.016 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/114/10' -> 'copyofsnap1/test1/114/10' 2023-07-29T02:03:15.016 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/114/11' -> 'copyofsnap1/test1/114/11' 2023-07-29T02:03:15.016 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/114/12' -> 'copyofsnap1/test1/114/12' 2023-07-29T02:03:15.016 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/114/13' -> 'copyofsnap1/test1/114/13' 2023-07-29T02:03:15.016 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/114/14' -> 'copyofsnap1/test1/114/14' 2023-07-29T02:03:15.017 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/114/15' -> 'copyofsnap1/test1/114/15' 2023-07-29T02:03:15.017 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/114/16' -> 'copyofsnap1/test1/114/16' 2023-07-29T02:03:15.017 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/114/17' -> 'copyofsnap1/test1/114/17' 2023-07-29T02:03:15.017 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/114/18' -> 'copyofsnap1/test1/114/18' 2023-07-29T02:03:15.017 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/114/19' -> 'copyofsnap1/test1/114/19' 2023-07-29T02:03:15.017 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/114/20' -> 'copyofsnap1/test1/114/20' 2023-07-29T02:03:15.017 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/115' -> 'copyofsnap1/test1/115' 2023-07-29T02:03:15.017 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/115/10' -> 'copyofsnap1/test1/115/10' 2023-07-29T02:03:15.018 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/115/11' -> 'copyofsnap1/test1/115/11' 2023-07-29T02:03:15.018 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/115/12' -> 'copyofsnap1/test1/115/12' 2023-07-29T02:03:15.018 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/115/13' -> 'copyofsnap1/test1/115/13' 2023-07-29T02:03:15.018 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/115/14' -> 'copyofsnap1/test1/115/14' 2023-07-29T02:03:15.018 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/115/15' -> 'copyofsnap1/test1/115/15' 2023-07-29T02:03:15.018 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/115/16' -> 'copyofsnap1/test1/115/16' 2023-07-29T02:03:15.018 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/115/17' -> 'copyofsnap1/test1/115/17' 2023-07-29T02:03:15.018 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/115/18' -> 'copyofsnap1/test1/115/18' 2023-07-29T02:03:15.019 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/115/19' -> 'copyofsnap1/test1/115/19' 2023-07-29T02:03:15.019 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/115/20' -> 'copyofsnap1/test1/115/20' 2023-07-29T02:03:15.019 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/116' -> 'copyofsnap1/test1/116' 2023-07-29T02:03:15.019 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/116/10' -> 'copyofsnap1/test1/116/10' 2023-07-29T02:03:15.019 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/116/11' -> 'copyofsnap1/test1/116/11' 2023-07-29T02:03:15.019 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/116/12' -> 'copyofsnap1/test1/116/12' 2023-07-29T02:03:15.019 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/116/13' -> 'copyofsnap1/test1/116/13' 2023-07-29T02:03:15.020 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/116/14' -> 'copyofsnap1/test1/116/14' 2023-07-29T02:03:15.020 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/116/15' -> 'copyofsnap1/test1/116/15' 2023-07-29T02:03:15.020 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/116/16' -> 'copyofsnap1/test1/116/16' 2023-07-29T02:03:15.020 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/116/17' -> 'copyofsnap1/test1/116/17' 2023-07-29T02:03:15.020 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/116/18' -> 'copyofsnap1/test1/116/18' 2023-07-29T02:03:15.020 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/116/19' -> 'copyofsnap1/test1/116/19' 2023-07-29T02:03:15.020 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/116/20' -> 'copyofsnap1/test1/116/20' 2023-07-29T02:03:15.020 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/117' -> 'copyofsnap1/test1/117' 2023-07-29T02:03:15.021 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/117/10' -> 'copyofsnap1/test1/117/10' 2023-07-29T02:03:15.021 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/117/11' -> 'copyofsnap1/test1/117/11' 2023-07-29T02:03:15.021 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/117/12' -> 'copyofsnap1/test1/117/12' 2023-07-29T02:03:15.021 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/117/13' -> 'copyofsnap1/test1/117/13' 2023-07-29T02:03:15.021 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/117/14' -> 'copyofsnap1/test1/117/14' 2023-07-29T02:03:15.021 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/117/15' -> 'copyofsnap1/test1/117/15' 2023-07-29T02:03:15.021 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/117/16' -> 'copyofsnap1/test1/117/16' 2023-07-29T02:03:15.021 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/117/17' -> 'copyofsnap1/test1/117/17' 2023-07-29T02:03:15.022 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/117/18' -> 'copyofsnap1/test1/117/18' 2023-07-29T02:03:15.022 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/117/19' -> 'copyofsnap1/test1/117/19' 2023-07-29T02:03:15.022 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/117/20' -> 'copyofsnap1/test1/117/20' 2023-07-29T02:03:15.022 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/118' -> 'copyofsnap1/test1/118' 2023-07-29T02:03:15.022 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/118/10' -> 'copyofsnap1/test1/118/10' 2023-07-29T02:03:15.023 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/118/11' -> 'copyofsnap1/test1/118/11' 2023-07-29T02:03:15.023 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/118/12' -> 'copyofsnap1/test1/118/12' 2023-07-29T02:03:15.023 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/118/13' -> 'copyofsnap1/test1/118/13' 2023-07-29T02:03:15.023 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/118/14' -> 'copyofsnap1/test1/118/14' 2023-07-29T02:03:15.023 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/118/15' -> 'copyofsnap1/test1/118/15' 2023-07-29T02:03:15.023 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/118/16' -> 'copyofsnap1/test1/118/16' 2023-07-29T02:03:15.023 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/118/17' -> 'copyofsnap1/test1/118/17' 2023-07-29T02:03:15.023 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/118/18' -> 'copyofsnap1/test1/118/18' 2023-07-29T02:03:15.024 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/118/19' -> 'copyofsnap1/test1/118/19' 2023-07-29T02:03:15.024 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/118/20' -> 'copyofsnap1/test1/118/20' 2023-07-29T02:03:15.024 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/119' -> 'copyofsnap1/test1/119' 2023-07-29T02:03:15.024 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/119/10' -> 'copyofsnap1/test1/119/10' 2023-07-29T02:03:15.024 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/119/11' -> 'copyofsnap1/test1/119/11' 2023-07-29T02:03:15.024 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/119/12' -> 'copyofsnap1/test1/119/12' 2023-07-29T02:03:15.025 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/119/13' -> 'copyofsnap1/test1/119/13' 2023-07-29T02:03:15.025 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/119/14' -> 'copyofsnap1/test1/119/14' 2023-07-29T02:03:15.025 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/119/15' -> 'copyofsnap1/test1/119/15' 2023-07-29T02:03:15.025 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/119/16' -> 'copyofsnap1/test1/119/16' 2023-07-29T02:03:15.025 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/119/17' -> 'copyofsnap1/test1/119/17' 2023-07-29T02:03:15.025 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/119/18' -> 'copyofsnap1/test1/119/18' 2023-07-29T02:03:15.025 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/119/19' -> 'copyofsnap1/test1/119/19' 2023-07-29T02:03:15.026 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/119/20' -> 'copyofsnap1/test1/119/20' 2023-07-29T02:03:15.026 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/120' -> 'copyofsnap1/test1/120' 2023-07-29T02:03:15.026 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/120/10' -> 'copyofsnap1/test1/120/10' 2023-07-29T02:03:15.177 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/120/11' -> 'copyofsnap1/test1/120/11' 2023-07-29T02:03:15.178 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/120/12' -> 'copyofsnap1/test1/120/12' 2023-07-29T02:03:15.178 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/120/13' -> 'copyofsnap1/test1/120/13' 2023-07-29T02:03:15.178 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/120/14' -> 'copyofsnap1/test1/120/14' 2023-07-29T02:03:15.178 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/120/15' -> 'copyofsnap1/test1/120/15' 2023-07-29T02:03:15.179 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/120/16' -> 'copyofsnap1/test1/120/16' 2023-07-29T02:03:15.179 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/120/17' -> 'copyofsnap1/test1/120/17' 2023-07-29T02:03:15.179 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/120/18' -> 'copyofsnap1/test1/120/18' 2023-07-29T02:03:15.179 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/120/19' -> 'copyofsnap1/test1/120/19' 2023-07-29T02:03:15.179 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/120/20' -> 'copyofsnap1/test1/120/20' 2023-07-29T02:03:15.179 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/121' -> 'copyofsnap1/test1/121' 2023-07-29T02:03:15.179 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/121/10' -> 'copyofsnap1/test1/121/10' 2023-07-29T02:03:15.180 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/121/11' -> 'copyofsnap1/test1/121/11' 2023-07-29T02:03:15.180 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/121/12' -> 'copyofsnap1/test1/121/12' 2023-07-29T02:03:15.180 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/121/13' -> 'copyofsnap1/test1/121/13' 2023-07-29T02:03:15.180 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/121/14' -> 'copyofsnap1/test1/121/14' 2023-07-29T02:03:15.180 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/121/15' -> 'copyofsnap1/test1/121/15' 2023-07-29T02:03:15.180 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/121/16' -> 'copyofsnap1/test1/121/16' 2023-07-29T02:03:15.180 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/121/17' -> 'copyofsnap1/test1/121/17' 2023-07-29T02:03:15.181 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/121/18' -> 'copyofsnap1/test1/121/18' 2023-07-29T02:03:15.181 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/121/19' -> 'copyofsnap1/test1/121/19' 2023-07-29T02:03:15.181 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/121/20' -> 'copyofsnap1/test1/121/20' 2023-07-29T02:03:15.181 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/122' -> 'copyofsnap1/test1/122' 2023-07-29T02:03:15.181 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/122/10' -> 'copyofsnap1/test1/122/10' 2023-07-29T02:03:15.181 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/122/11' -> 'copyofsnap1/test1/122/11' 2023-07-29T02:03:15.181 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/122/12' -> 'copyofsnap1/test1/122/12' 2023-07-29T02:03:15.182 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/122/13' -> 'copyofsnap1/test1/122/13' 2023-07-29T02:03:15.182 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/122/14' -> 'copyofsnap1/test1/122/14' 2023-07-29T02:03:15.182 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/122/15' -> 'copyofsnap1/test1/122/15' 2023-07-29T02:03:15.182 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/122/16' -> 'copyofsnap1/test1/122/16' 2023-07-29T02:03:15.182 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/122/17' -> 'copyofsnap1/test1/122/17' 2023-07-29T02:03:15.182 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/122/18' -> 'copyofsnap1/test1/122/18' 2023-07-29T02:03:15.182 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/122/19' -> 'copyofsnap1/test1/122/19' 2023-07-29T02:03:15.183 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/122/20' -> 'copyofsnap1/test1/122/20' 2023-07-29T02:03:15.183 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/123' -> 'copyofsnap1/test1/123' 2023-07-29T02:03:15.183 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/123/10' -> 'copyofsnap1/test1/123/10' 2023-07-29T02:03:15.183 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/123/11' -> 'copyofsnap1/test1/123/11' 2023-07-29T02:03:15.183 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/123/12' -> 'copyofsnap1/test1/123/12' 2023-07-29T02:03:15.183 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/123/13' -> 'copyofsnap1/test1/123/13' 2023-07-29T02:03:15.183 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/123/14' -> 'copyofsnap1/test1/123/14' 2023-07-29T02:03:15.184 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/123/15' -> 'copyofsnap1/test1/123/15' 2023-07-29T02:03:15.184 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/123/16' -> 'copyofsnap1/test1/123/16' 2023-07-29T02:03:15.184 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/123/17' -> 'copyofsnap1/test1/123/17' 2023-07-29T02:03:15.184 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/123/18' -> 'copyofsnap1/test1/123/18' 2023-07-29T02:03:15.184 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/123/19' -> 'copyofsnap1/test1/123/19' 2023-07-29T02:03:15.184 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/123/20' -> 'copyofsnap1/test1/123/20' 2023-07-29T02:03:15.184 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/124' -> 'copyofsnap1/test1/124' 2023-07-29T02:03:15.185 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/124/10' -> 'copyofsnap1/test1/124/10' 2023-07-29T02:03:15.185 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/124/11' -> 'copyofsnap1/test1/124/11' 2023-07-29T02:03:15.185 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/124/12' -> 'copyofsnap1/test1/124/12' 2023-07-29T02:03:15.185 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/124/13' -> 'copyofsnap1/test1/124/13' 2023-07-29T02:03:15.185 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/124/14' -> 'copyofsnap1/test1/124/14' 2023-07-29T02:03:15.185 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/124/15' -> 'copyofsnap1/test1/124/15' 2023-07-29T02:03:15.185 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/124/16' -> 'copyofsnap1/test1/124/16' 2023-07-29T02:03:15.186 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/124/17' -> 'copyofsnap1/test1/124/17' 2023-07-29T02:03:15.186 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/124/18' -> 'copyofsnap1/test1/124/18' 2023-07-29T02:03:15.186 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/124/19' -> 'copyofsnap1/test1/124/19' 2023-07-29T02:03:15.186 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/124/20' -> 'copyofsnap1/test1/124/20' 2023-07-29T02:03:15.186 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/125' -> 'copyofsnap1/test1/125' 2023-07-29T02:03:15.186 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/125/10' -> 'copyofsnap1/test1/125/10' 2023-07-29T02:03:15.186 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/125/11' -> 'copyofsnap1/test1/125/11' 2023-07-29T02:03:15.187 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/125/12' -> 'copyofsnap1/test1/125/12' 2023-07-29T02:03:15.187 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/125/13' -> 'copyofsnap1/test1/125/13' 2023-07-29T02:03:15.187 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/125/14' -> 'copyofsnap1/test1/125/14' 2023-07-29T02:03:15.187 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/125/15' -> 'copyofsnap1/test1/125/15' 2023-07-29T02:03:15.187 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/125/16' -> 'copyofsnap1/test1/125/16' 2023-07-29T02:03:15.187 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/125/17' -> 'copyofsnap1/test1/125/17' 2023-07-29T02:03:15.187 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/125/18' -> 'copyofsnap1/test1/125/18' 2023-07-29T02:03:15.188 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/125/19' -> 'copyofsnap1/test1/125/19' 2023-07-29T02:03:15.188 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/125/20' -> 'copyofsnap1/test1/125/20' 2023-07-29T02:03:15.188 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/126' -> 'copyofsnap1/test1/126' 2023-07-29T02:03:15.188 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/126/10' -> 'copyofsnap1/test1/126/10' 2023-07-29T02:03:15.188 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/126/11' -> 'copyofsnap1/test1/126/11' 2023-07-29T02:03:15.188 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/126/12' -> 'copyofsnap1/test1/126/12' 2023-07-29T02:03:15.188 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/126/13' -> 'copyofsnap1/test1/126/13' 2023-07-29T02:03:15.189 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/126/14' -> 'copyofsnap1/test1/126/14' 2023-07-29T02:03:15.189 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/126/15' -> 'copyofsnap1/test1/126/15' 2023-07-29T02:03:15.189 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/126/16' -> 'copyofsnap1/test1/126/16' 2023-07-29T02:03:15.189 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/126/17' -> 'copyofsnap1/test1/126/17' 2023-07-29T02:03:15.189 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/126/18' -> 'copyofsnap1/test1/126/18' 2023-07-29T02:03:15.189 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/126/19' -> 'copyofsnap1/test1/126/19' 2023-07-29T02:03:15.347 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/126/20' -> 'copyofsnap1/test1/126/20' 2023-07-29T02:03:15.347 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/127' -> 'copyofsnap1/test1/127' 2023-07-29T02:03:15.348 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/127/10' -> 'copyofsnap1/test1/127/10' 2023-07-29T02:03:15.348 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/127/11' -> 'copyofsnap1/test1/127/11' 2023-07-29T02:03:15.348 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/127/12' -> 'copyofsnap1/test1/127/12' 2023-07-29T02:03:15.348 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/127/13' -> 'copyofsnap1/test1/127/13' 2023-07-29T02:03:15.348 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/127/14' -> 'copyofsnap1/test1/127/14' 2023-07-29T02:03:15.348 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/127/15' -> 'copyofsnap1/test1/127/15' 2023-07-29T02:03:15.348 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/127/16' -> 'copyofsnap1/test1/127/16' 2023-07-29T02:03:15.349 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/127/17' -> 'copyofsnap1/test1/127/17' 2023-07-29T02:03:15.349 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/127/18' -> 'copyofsnap1/test1/127/18' 2023-07-29T02:03:15.349 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/127/19' -> 'copyofsnap1/test1/127/19' 2023-07-29T02:03:15.349 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/127/20' -> 'copyofsnap1/test1/127/20' 2023-07-29T02:03:15.349 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/128' -> 'copyofsnap1/test1/128' 2023-07-29T02:03:15.349 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/128/10' -> 'copyofsnap1/test1/128/10' 2023-07-29T02:03:15.349 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/128/11' -> 'copyofsnap1/test1/128/11' 2023-07-29T02:03:15.350 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/128/12' -> 'copyofsnap1/test1/128/12' 2023-07-29T02:03:15.350 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/128/13' -> 'copyofsnap1/test1/128/13' 2023-07-29T02:03:15.350 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/128/14' -> 'copyofsnap1/test1/128/14' 2023-07-29T02:03:15.350 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/128/15' -> 'copyofsnap1/test1/128/15' 2023-07-29T02:03:15.350 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/128/16' -> 'copyofsnap1/test1/128/16' 2023-07-29T02:03:15.350 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/128/17' -> 'copyofsnap1/test1/128/17' 2023-07-29T02:03:15.350 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/128/18' -> 'copyofsnap1/test1/128/18' 2023-07-29T02:03:15.351 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/128/19' -> 'copyofsnap1/test1/128/19' 2023-07-29T02:03:15.351 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/128/20' -> 'copyofsnap1/test1/128/20' 2023-07-29T02:03:15.351 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/129' -> 'copyofsnap1/test1/129' 2023-07-29T02:03:15.351 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/129/10' -> 'copyofsnap1/test1/129/10' 2023-07-29T02:03:15.351 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/129/11' -> 'copyofsnap1/test1/129/11' 2023-07-29T02:03:15.351 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/129/12' -> 'copyofsnap1/test1/129/12' 2023-07-29T02:03:15.351 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/129/13' -> 'copyofsnap1/test1/129/13' 2023-07-29T02:03:15.352 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/129/14' -> 'copyofsnap1/test1/129/14' 2023-07-29T02:03:15.352 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/129/15' -> 'copyofsnap1/test1/129/15' 2023-07-29T02:03:15.352 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/129/16' -> 'copyofsnap1/test1/129/16' 2023-07-29T02:03:15.352 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/129/17' -> 'copyofsnap1/test1/129/17' 2023-07-29T02:03:15.352 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/129/18' -> 'copyofsnap1/test1/129/18' 2023-07-29T02:03:15.352 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/129/19' -> 'copyofsnap1/test1/129/19' 2023-07-29T02:03:15.352 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/129/20' -> 'copyofsnap1/test1/129/20' 2023-07-29T02:03:15.353 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/130' -> 'copyofsnap1/test1/130' 2023-07-29T02:03:15.353 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/130/10' -> 'copyofsnap1/test1/130/10' 2023-07-29T02:03:15.353 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/130/11' -> 'copyofsnap1/test1/130/11' 2023-07-29T02:03:15.353 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/130/12' -> 'copyofsnap1/test1/130/12' 2023-07-29T02:03:15.353 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/130/13' -> 'copyofsnap1/test1/130/13' 2023-07-29T02:03:15.353 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/130/14' -> 'copyofsnap1/test1/130/14' 2023-07-29T02:03:15.353 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/130/15' -> 'copyofsnap1/test1/130/15' 2023-07-29T02:03:15.354 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/130/16' -> 'copyofsnap1/test1/130/16' 2023-07-29T02:03:15.354 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/130/17' -> 'copyofsnap1/test1/130/17' 2023-07-29T02:03:15.354 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/130/18' -> 'copyofsnap1/test1/130/18' 2023-07-29T02:03:15.354 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/130/19' -> 'copyofsnap1/test1/130/19' 2023-07-29T02:03:15.354 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/130/20' -> 'copyofsnap1/test1/130/20' 2023-07-29T02:03:15.354 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/131' -> 'copyofsnap1/test1/131' 2023-07-29T02:03:15.354 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/131/10' -> 'copyofsnap1/test1/131/10' 2023-07-29T02:03:15.355 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/131/11' -> 'copyofsnap1/test1/131/11' 2023-07-29T02:03:15.355 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/131/12' -> 'copyofsnap1/test1/131/12' 2023-07-29T02:03:15.355 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/131/13' -> 'copyofsnap1/test1/131/13' 2023-07-29T02:03:15.355 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/131/14' -> 'copyofsnap1/test1/131/14' 2023-07-29T02:03:15.355 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/131/15' -> 'copyofsnap1/test1/131/15' 2023-07-29T02:03:15.355 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/131/16' -> 'copyofsnap1/test1/131/16' 2023-07-29T02:03:15.355 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/131/17' -> 'copyofsnap1/test1/131/17' 2023-07-29T02:03:15.356 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/131/18' -> 'copyofsnap1/test1/131/18' 2023-07-29T02:03:15.356 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/131/19' -> 'copyofsnap1/test1/131/19' 2023-07-29T02:03:15.356 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/131/20' -> 'copyofsnap1/test1/131/20' 2023-07-29T02:03:15.356 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/132' -> 'copyofsnap1/test1/132' 2023-07-29T02:03:15.357 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/132/10' -> 'copyofsnap1/test1/132/10' 2023-07-29T02:03:15.357 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/132/11' -> 'copyofsnap1/test1/132/11' 2023-07-29T02:03:15.357 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/132/12' -> 'copyofsnap1/test1/132/12' 2023-07-29T02:03:15.357 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/132/13' -> 'copyofsnap1/test1/132/13' 2023-07-29T02:03:15.358 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/132/14' -> 'copyofsnap1/test1/132/14' 2023-07-29T02:03:15.358 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/132/15' -> 'copyofsnap1/test1/132/15' 2023-07-29T02:03:15.358 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/132/16' -> 'copyofsnap1/test1/132/16' 2023-07-29T02:03:15.359 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/132/17' -> 'copyofsnap1/test1/132/17' 2023-07-29T02:03:15.359 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/132/18' -> 'copyofsnap1/test1/132/18' 2023-07-29T02:03:15.359 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/132/19' -> 'copyofsnap1/test1/132/19' 2023-07-29T02:03:15.359 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/132/20' -> 'copyofsnap1/test1/132/20' 2023-07-29T02:03:15.360 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/133' -> 'copyofsnap1/test1/133' 2023-07-29T02:03:15.360 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/133/10' -> 'copyofsnap1/test1/133/10' 2023-07-29T02:03:15.360 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/133/11' -> 'copyofsnap1/test1/133/11' 2023-07-29T02:03:15.361 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/133/12' -> 'copyofsnap1/test1/133/12' 2023-07-29T02:03:15.361 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/133/13' -> 'copyofsnap1/test1/133/13' 2023-07-29T02:03:15.361 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/133/14' -> 'copyofsnap1/test1/133/14' 2023-07-29T02:03:15.361 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/133/15' -> 'copyofsnap1/test1/133/15' 2023-07-29T02:03:15.361 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/133/16' -> 'copyofsnap1/test1/133/16' 2023-07-29T02:03:15.511 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/133/17' -> 'copyofsnap1/test1/133/17' 2023-07-29T02:03:15.512 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/133/18' -> 'copyofsnap1/test1/133/18' 2023-07-29T02:03:15.512 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/133/19' -> 'copyofsnap1/test1/133/19' 2023-07-29T02:03:15.512 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/133/20' -> 'copyofsnap1/test1/133/20' 2023-07-29T02:03:15.513 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/134' -> 'copyofsnap1/test1/134' 2023-07-29T02:03:15.513 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/134/10' -> 'copyofsnap1/test1/134/10' 2023-07-29T02:03:15.513 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/134/11' -> 'copyofsnap1/test1/134/11' 2023-07-29T02:03:15.513 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/134/12' -> 'copyofsnap1/test1/134/12' 2023-07-29T02:03:15.513 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/134/13' -> 'copyofsnap1/test1/134/13' 2023-07-29T02:03:15.514 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/134/14' -> 'copyofsnap1/test1/134/14' 2023-07-29T02:03:15.514 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/134/15' -> 'copyofsnap1/test1/134/15' 2023-07-29T02:03:15.514 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/134/16' -> 'copyofsnap1/test1/134/16' 2023-07-29T02:03:15.514 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/134/17' -> 'copyofsnap1/test1/134/17' 2023-07-29T02:03:15.514 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/134/18' -> 'copyofsnap1/test1/134/18' 2023-07-29T02:03:15.514 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/134/19' -> 'copyofsnap1/test1/134/19' 2023-07-29T02:03:15.514 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/134/20' -> 'copyofsnap1/test1/134/20' 2023-07-29T02:03:15.514 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/135' -> 'copyofsnap1/test1/135' 2023-07-29T02:03:15.515 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/135/10' -> 'copyofsnap1/test1/135/10' 2023-07-29T02:03:15.515 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/135/11' -> 'copyofsnap1/test1/135/11' 2023-07-29T02:03:15.515 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/135/12' -> 'copyofsnap1/test1/135/12' 2023-07-29T02:03:15.515 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/135/13' -> 'copyofsnap1/test1/135/13' 2023-07-29T02:03:15.515 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/135/14' -> 'copyofsnap1/test1/135/14' 2023-07-29T02:03:15.515 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/135/15' -> 'copyofsnap1/test1/135/15' 2023-07-29T02:03:15.515 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/135/16' -> 'copyofsnap1/test1/135/16' 2023-07-29T02:03:15.515 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/135/17' -> 'copyofsnap1/test1/135/17' 2023-07-29T02:03:15.516 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/135/18' -> 'copyofsnap1/test1/135/18' 2023-07-29T02:03:15.516 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/135/19' -> 'copyofsnap1/test1/135/19' 2023-07-29T02:03:15.516 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/135/20' -> 'copyofsnap1/test1/135/20' 2023-07-29T02:03:15.516 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/136' -> 'copyofsnap1/test1/136' 2023-07-29T02:03:15.516 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/136/10' -> 'copyofsnap1/test1/136/10' 2023-07-29T02:03:15.516 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/136/11' -> 'copyofsnap1/test1/136/11' 2023-07-29T02:03:15.516 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/136/12' -> 'copyofsnap1/test1/136/12' 2023-07-29T02:03:15.517 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/136/13' -> 'copyofsnap1/test1/136/13' 2023-07-29T02:03:15.517 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/136/14' -> 'copyofsnap1/test1/136/14' 2023-07-29T02:03:15.517 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/136/15' -> 'copyofsnap1/test1/136/15' 2023-07-29T02:03:15.517 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/136/16' -> 'copyofsnap1/test1/136/16' 2023-07-29T02:03:15.517 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/136/17' -> 'copyofsnap1/test1/136/17' 2023-07-29T02:03:15.517 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/136/18' -> 'copyofsnap1/test1/136/18' 2023-07-29T02:03:15.517 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/136/19' -> 'copyofsnap1/test1/136/19' 2023-07-29T02:03:15.517 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/136/20' -> 'copyofsnap1/test1/136/20' 2023-07-29T02:03:15.518 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/137' -> 'copyofsnap1/test1/137' 2023-07-29T02:03:15.518 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/137/10' -> 'copyofsnap1/test1/137/10' 2023-07-29T02:03:15.518 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/137/11' -> 'copyofsnap1/test1/137/11' 2023-07-29T02:03:15.518 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/137/12' -> 'copyofsnap1/test1/137/12' 2023-07-29T02:03:15.518 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/137/13' -> 'copyofsnap1/test1/137/13' 2023-07-29T02:03:15.518 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/137/14' -> 'copyofsnap1/test1/137/14' 2023-07-29T02:03:15.518 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/137/15' -> 'copyofsnap1/test1/137/15' 2023-07-29T02:03:15.518 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/137/16' -> 'copyofsnap1/test1/137/16' 2023-07-29T02:03:15.519 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/137/17' -> 'copyofsnap1/test1/137/17' 2023-07-29T02:03:15.519 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/137/18' -> 'copyofsnap1/test1/137/18' 2023-07-29T02:03:15.519 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/137/19' -> 'copyofsnap1/test1/137/19' 2023-07-29T02:03:15.519 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/137/20' -> 'copyofsnap1/test1/137/20' 2023-07-29T02:03:15.519 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/138' -> 'copyofsnap1/test1/138' 2023-07-29T02:03:15.519 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/138/10' -> 'copyofsnap1/test1/138/10' 2023-07-29T02:03:15.519 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/138/11' -> 'copyofsnap1/test1/138/11' 2023-07-29T02:03:15.519 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/138/12' -> 'copyofsnap1/test1/138/12' 2023-07-29T02:03:15.520 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/138/13' -> 'copyofsnap1/test1/138/13' 2023-07-29T02:03:15.520 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/138/14' -> 'copyofsnap1/test1/138/14' 2023-07-29T02:03:15.520 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/138/15' -> 'copyofsnap1/test1/138/15' 2023-07-29T02:03:15.520 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/138/16' -> 'copyofsnap1/test1/138/16' 2023-07-29T02:03:15.520 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/138/17' -> 'copyofsnap1/test1/138/17' 2023-07-29T02:03:15.520 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/138/18' -> 'copyofsnap1/test1/138/18' 2023-07-29T02:03:15.520 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/138/19' -> 'copyofsnap1/test1/138/19' 2023-07-29T02:03:15.521 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/138/20' -> 'copyofsnap1/test1/138/20' 2023-07-29T02:03:15.521 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/139' -> 'copyofsnap1/test1/139' 2023-07-29T02:03:15.521 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/139/10' -> 'copyofsnap1/test1/139/10' 2023-07-29T02:03:15.521 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/139/11' -> 'copyofsnap1/test1/139/11' 2023-07-29T02:03:15.521 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/139/12' -> 'copyofsnap1/test1/139/12' 2023-07-29T02:03:15.521 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/139/13' -> 'copyofsnap1/test1/139/13' 2023-07-29T02:03:15.521 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/139/14' -> 'copyofsnap1/test1/139/14' 2023-07-29T02:03:15.521 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/139/15' -> 'copyofsnap1/test1/139/15' 2023-07-29T02:03:15.522 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/139/16' -> 'copyofsnap1/test1/139/16' 2023-07-29T02:03:15.522 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/139/17' -> 'copyofsnap1/test1/139/17' 2023-07-29T02:03:15.522 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/139/18' -> 'copyofsnap1/test1/139/18' 2023-07-29T02:03:15.522 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/139/19' -> 'copyofsnap1/test1/139/19' 2023-07-29T02:03:15.522 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/139/20' -> 'copyofsnap1/test1/139/20' 2023-07-29T02:03:15.522 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/140' -> 'copyofsnap1/test1/140' 2023-07-29T02:03:15.522 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/140/10' -> 'copyofsnap1/test1/140/10' 2023-07-29T02:03:15.522 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/140/11' -> 'copyofsnap1/test1/140/11' 2023-07-29T02:03:15.523 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/140/12' -> 'copyofsnap1/test1/140/12' 2023-07-29T02:03:15.523 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/140/13' -> 'copyofsnap1/test1/140/13' 2023-07-29T02:03:15.691 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/140/14' -> 'copyofsnap1/test1/140/14' 2023-07-29T02:03:15.691 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/140/15' -> 'copyofsnap1/test1/140/15' 2023-07-29T02:03:15.691 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/140/16' -> 'copyofsnap1/test1/140/16' 2023-07-29T02:03:15.692 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/140/17' -> 'copyofsnap1/test1/140/17' 2023-07-29T02:03:15.692 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/140/18' -> 'copyofsnap1/test1/140/18' 2023-07-29T02:03:15.692 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/140/19' -> 'copyofsnap1/test1/140/19' 2023-07-29T02:03:15.692 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/140/20' -> 'copyofsnap1/test1/140/20' 2023-07-29T02:03:15.692 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/141' -> 'copyofsnap1/test1/141' 2023-07-29T02:03:15.692 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/141/10' -> 'copyofsnap1/test1/141/10' 2023-07-29T02:03:15.692 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/141/11' -> 'copyofsnap1/test1/141/11' 2023-07-29T02:03:15.693 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/141/12' -> 'copyofsnap1/test1/141/12' 2023-07-29T02:03:15.693 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/141/13' -> 'copyofsnap1/test1/141/13' 2023-07-29T02:03:15.693 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/141/14' -> 'copyofsnap1/test1/141/14' 2023-07-29T02:03:15.693 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/141/15' -> 'copyofsnap1/test1/141/15' 2023-07-29T02:03:15.693 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/141/16' -> 'copyofsnap1/test1/141/16' 2023-07-29T02:03:15.693 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/141/17' -> 'copyofsnap1/test1/141/17' 2023-07-29T02:03:15.694 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/141/18' -> 'copyofsnap1/test1/141/18' 2023-07-29T02:03:15.694 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/141/19' -> 'copyofsnap1/test1/141/19' 2023-07-29T02:03:15.694 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/141/20' -> 'copyofsnap1/test1/141/20' 2023-07-29T02:03:15.694 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/142' -> 'copyofsnap1/test1/142' 2023-07-29T02:03:15.694 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/142/10' -> 'copyofsnap1/test1/142/10' 2023-07-29T02:03:15.694 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/142/11' -> 'copyofsnap1/test1/142/11' 2023-07-29T02:03:15.694 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/142/12' -> 'copyofsnap1/test1/142/12' 2023-07-29T02:03:15.695 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/142/13' -> 'copyofsnap1/test1/142/13' 2023-07-29T02:03:15.695 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/142/14' -> 'copyofsnap1/test1/142/14' 2023-07-29T02:03:15.695 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/142/15' -> 'copyofsnap1/test1/142/15' 2023-07-29T02:03:15.695 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/142/16' -> 'copyofsnap1/test1/142/16' 2023-07-29T02:03:15.695 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/142/17' -> 'copyofsnap1/test1/142/17' 2023-07-29T02:03:15.695 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/142/18' -> 'copyofsnap1/test1/142/18' 2023-07-29T02:03:15.695 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/142/19' -> 'copyofsnap1/test1/142/19' 2023-07-29T02:03:15.696 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/142/20' -> 'copyofsnap1/test1/142/20' 2023-07-29T02:03:15.696 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/143' -> 'copyofsnap1/test1/143' 2023-07-29T02:03:15.696 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/143/10' -> 'copyofsnap1/test1/143/10' 2023-07-29T02:03:15.696 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/143/11' -> 'copyofsnap1/test1/143/11' 2023-07-29T02:03:15.696 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/143/12' -> 'copyofsnap1/test1/143/12' 2023-07-29T02:03:15.696 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/143/13' -> 'copyofsnap1/test1/143/13' 2023-07-29T02:03:15.696 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/143/14' -> 'copyofsnap1/test1/143/14' 2023-07-29T02:03:15.697 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/143/15' -> 'copyofsnap1/test1/143/15' 2023-07-29T02:03:15.697 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/143/16' -> 'copyofsnap1/test1/143/16' 2023-07-29T02:03:15.697 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/143/17' -> 'copyofsnap1/test1/143/17' 2023-07-29T02:03:15.697 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/143/18' -> 'copyofsnap1/test1/143/18' 2023-07-29T02:03:15.697 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/143/19' -> 'copyofsnap1/test1/143/19' 2023-07-29T02:03:15.697 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/143/20' -> 'copyofsnap1/test1/143/20' 2023-07-29T02:03:15.698 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/144' -> 'copyofsnap1/test1/144' 2023-07-29T02:03:15.698 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/144/10' -> 'copyofsnap1/test1/144/10' 2023-07-29T02:03:15.698 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/144/11' -> 'copyofsnap1/test1/144/11' 2023-07-29T02:03:15.698 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/144/12' -> 'copyofsnap1/test1/144/12' 2023-07-29T02:03:15.698 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/144/13' -> 'copyofsnap1/test1/144/13' 2023-07-29T02:03:15.698 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/144/14' -> 'copyofsnap1/test1/144/14' 2023-07-29T02:03:15.698 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/144/15' -> 'copyofsnap1/test1/144/15' 2023-07-29T02:03:15.698 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/144/16' -> 'copyofsnap1/test1/144/16' 2023-07-29T02:03:15.699 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/144/17' -> 'copyofsnap1/test1/144/17' 2023-07-29T02:03:15.699 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/144/18' -> 'copyofsnap1/test1/144/18' 2023-07-29T02:03:15.699 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/144/19' -> 'copyofsnap1/test1/144/19' 2023-07-29T02:03:15.699 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/144/20' -> 'copyofsnap1/test1/144/20' 2023-07-29T02:03:15.699 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/145' -> 'copyofsnap1/test1/145' 2023-07-29T02:03:15.699 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/145/10' -> 'copyofsnap1/test1/145/10' 2023-07-29T02:03:15.699 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/145/11' -> 'copyofsnap1/test1/145/11' 2023-07-29T02:03:15.700 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/145/12' -> 'copyofsnap1/test1/145/12' 2023-07-29T02:03:15.700 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/145/13' -> 'copyofsnap1/test1/145/13' 2023-07-29T02:03:15.700 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/145/14' -> 'copyofsnap1/test1/145/14' 2023-07-29T02:03:15.700 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/145/15' -> 'copyofsnap1/test1/145/15' 2023-07-29T02:03:15.700 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/145/16' -> 'copyofsnap1/test1/145/16' 2023-07-29T02:03:15.700 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/145/17' -> 'copyofsnap1/test1/145/17' 2023-07-29T02:03:15.700 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/145/18' -> 'copyofsnap1/test1/145/18' 2023-07-29T02:03:15.701 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/145/19' -> 'copyofsnap1/test1/145/19' 2023-07-29T02:03:15.701 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/145/20' -> 'copyofsnap1/test1/145/20' 2023-07-29T02:03:15.701 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/146' -> 'copyofsnap1/test1/146' 2023-07-29T02:03:15.701 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/146/10' -> 'copyofsnap1/test1/146/10' 2023-07-29T02:03:15.701 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/146/11' -> 'copyofsnap1/test1/146/11' 2023-07-29T02:03:15.701 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/146/12' -> 'copyofsnap1/test1/146/12' 2023-07-29T02:03:15.701 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/146/13' -> 'copyofsnap1/test1/146/13' 2023-07-29T02:03:15.702 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/146/14' -> 'copyofsnap1/test1/146/14' 2023-07-29T02:03:15.702 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/146/15' -> 'copyofsnap1/test1/146/15' 2023-07-29T02:03:15.702 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/146/16' -> 'copyofsnap1/test1/146/16' 2023-07-29T02:03:15.702 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/146/17' -> 'copyofsnap1/test1/146/17' 2023-07-29T02:03:15.702 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/146/18' -> 'copyofsnap1/test1/146/18' 2023-07-29T02:03:15.703 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/146/19' -> 'copyofsnap1/test1/146/19' 2023-07-29T02:03:15.703 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/146/20' -> 'copyofsnap1/test1/146/20' 2023-07-29T02:03:15.703 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/147' -> 'copyofsnap1/test1/147' 2023-07-29T02:03:15.703 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/147/10' -> 'copyofsnap1/test1/147/10' 2023-07-29T02:03:15.704 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/147/11' -> 'copyofsnap1/test1/147/11' 2023-07-29T02:03:15.859 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/147/12' -> 'copyofsnap1/test1/147/12' 2023-07-29T02:03:15.859 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/147/13' -> 'copyofsnap1/test1/147/13' 2023-07-29T02:03:15.859 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/147/14' -> 'copyofsnap1/test1/147/14' 2023-07-29T02:03:15.860 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/147/15' -> 'copyofsnap1/test1/147/15' 2023-07-29T02:03:15.860 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/147/16' -> 'copyofsnap1/test1/147/16' 2023-07-29T02:03:15.860 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/147/17' -> 'copyofsnap1/test1/147/17' 2023-07-29T02:03:15.860 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/147/18' -> 'copyofsnap1/test1/147/18' 2023-07-29T02:03:15.861 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/147/19' -> 'copyofsnap1/test1/147/19' 2023-07-29T02:03:15.861 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/147/20' -> 'copyofsnap1/test1/147/20' 2023-07-29T02:03:15.861 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/148' -> 'copyofsnap1/test1/148' 2023-07-29T02:03:15.862 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/148/10' -> 'copyofsnap1/test1/148/10' 2023-07-29T02:03:15.862 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/148/11' -> 'copyofsnap1/test1/148/11' 2023-07-29T02:03:15.862 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/148/12' -> 'copyofsnap1/test1/148/12' 2023-07-29T02:03:15.862 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/148/13' -> 'copyofsnap1/test1/148/13' 2023-07-29T02:03:15.863 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/148/14' -> 'copyofsnap1/test1/148/14' 2023-07-29T02:03:15.863 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/148/15' -> 'copyofsnap1/test1/148/15' 2023-07-29T02:03:15.863 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/148/16' -> 'copyofsnap1/test1/148/16' 2023-07-29T02:03:15.863 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/148/17' -> 'copyofsnap1/test1/148/17' 2023-07-29T02:03:15.864 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/148/18' -> 'copyofsnap1/test1/148/18' 2023-07-29T02:03:15.864 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/148/19' -> 'copyofsnap1/test1/148/19' 2023-07-29T02:03:15.864 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/148/20' -> 'copyofsnap1/test1/148/20' 2023-07-29T02:03:15.865 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/149' -> 'copyofsnap1/test1/149' 2023-07-29T02:03:15.865 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/149/10' -> 'copyofsnap1/test1/149/10' 2023-07-29T02:03:15.865 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/149/11' -> 'copyofsnap1/test1/149/11' 2023-07-29T02:03:15.865 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/149/12' -> 'copyofsnap1/test1/149/12' 2023-07-29T02:03:15.866 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/149/13' -> 'copyofsnap1/test1/149/13' 2023-07-29T02:03:15.866 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/149/14' -> 'copyofsnap1/test1/149/14' 2023-07-29T02:03:15.866 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/149/15' -> 'copyofsnap1/test1/149/15' 2023-07-29T02:03:15.866 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/149/16' -> 'copyofsnap1/test1/149/16' 2023-07-29T02:03:15.867 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/149/17' -> 'copyofsnap1/test1/149/17' 2023-07-29T02:03:15.867 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/149/18' -> 'copyofsnap1/test1/149/18' 2023-07-29T02:03:15.868 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/149/19' -> 'copyofsnap1/test1/149/19' 2023-07-29T02:03:15.868 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/149/20' -> 'copyofsnap1/test1/149/20' 2023-07-29T02:03:15.868 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/150' -> 'copyofsnap1/test1/150' 2023-07-29T02:03:15.869 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/150/10' -> 'copyofsnap1/test1/150/10' 2023-07-29T02:03:15.869 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/150/11' -> 'copyofsnap1/test1/150/11' 2023-07-29T02:03:15.869 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/150/12' -> 'copyofsnap1/test1/150/12' 2023-07-29T02:03:15.869 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/150/13' -> 'copyofsnap1/test1/150/13' 2023-07-29T02:03:15.870 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/150/14' -> 'copyofsnap1/test1/150/14' 2023-07-29T02:03:15.870 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/150/15' -> 'copyofsnap1/test1/150/15' 2023-07-29T02:03:15.870 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/150/16' -> 'copyofsnap1/test1/150/16' 2023-07-29T02:03:15.870 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/150/17' -> 'copyofsnap1/test1/150/17' 2023-07-29T02:03:15.871 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/150/18' -> 'copyofsnap1/test1/150/18' 2023-07-29T02:03:15.871 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/150/19' -> 'copyofsnap1/test1/150/19' 2023-07-29T02:03:15.871 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/150/20' -> 'copyofsnap1/test1/150/20' 2023-07-29T02:03:15.871 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/151' -> 'copyofsnap1/test1/151' 2023-07-29T02:03:15.872 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/151/10' -> 'copyofsnap1/test1/151/10' 2023-07-29T02:03:15.872 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/151/11' -> 'copyofsnap1/test1/151/11' 2023-07-29T02:03:15.872 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/151/12' -> 'copyofsnap1/test1/151/12' 2023-07-29T02:03:15.872 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/151/13' -> 'copyofsnap1/test1/151/13' 2023-07-29T02:03:15.872 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/151/14' -> 'copyofsnap1/test1/151/14' 2023-07-29T02:03:15.873 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/151/15' -> 'copyofsnap1/test1/151/15' 2023-07-29T02:03:15.873 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/151/16' -> 'copyofsnap1/test1/151/16' 2023-07-29T02:03:15.873 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/151/17' -> 'copyofsnap1/test1/151/17' 2023-07-29T02:03:15.873 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/151/18' -> 'copyofsnap1/test1/151/18' 2023-07-29T02:03:15.873 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/151/19' -> 'copyofsnap1/test1/151/19' 2023-07-29T02:03:15.873 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/151/20' -> 'copyofsnap1/test1/151/20' 2023-07-29T02:03:15.873 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/152' -> 'copyofsnap1/test1/152' 2023-07-29T02:03:15.874 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/152/10' -> 'copyofsnap1/test1/152/10' 2023-07-29T02:03:15.874 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/152/11' -> 'copyofsnap1/test1/152/11' 2023-07-29T02:03:15.874 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/152/12' -> 'copyofsnap1/test1/152/12' 2023-07-29T02:03:15.874 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/152/13' -> 'copyofsnap1/test1/152/13' 2023-07-29T02:03:15.874 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/152/14' -> 'copyofsnap1/test1/152/14' 2023-07-29T02:03:15.875 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/152/15' -> 'copyofsnap1/test1/152/15' 2023-07-29T02:03:15.875 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/152/16' -> 'copyofsnap1/test1/152/16' 2023-07-29T02:03:15.875 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/152/17' -> 'copyofsnap1/test1/152/17' 2023-07-29T02:03:15.875 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/152/18' -> 'copyofsnap1/test1/152/18' 2023-07-29T02:03:15.875 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/152/19' -> 'copyofsnap1/test1/152/19' 2023-07-29T02:03:15.875 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/152/20' -> 'copyofsnap1/test1/152/20' 2023-07-29T02:03:15.875 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/153' -> 'copyofsnap1/test1/153' 2023-07-29T02:03:15.875 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/153/10' -> 'copyofsnap1/test1/153/10' 2023-07-29T02:03:15.876 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/153/11' -> 'copyofsnap1/test1/153/11' 2023-07-29T02:03:15.876 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/153/12' -> 'copyofsnap1/test1/153/12' 2023-07-29T02:03:15.876 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/153/13' -> 'copyofsnap1/test1/153/13' 2023-07-29T02:03:15.876 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/153/14' -> 'copyofsnap1/test1/153/14' 2023-07-29T02:03:15.876 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/153/15' -> 'copyofsnap1/test1/153/15' 2023-07-29T02:03:15.876 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/153/16' -> 'copyofsnap1/test1/153/16' 2023-07-29T02:03:15.876 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/153/17' -> 'copyofsnap1/test1/153/17' 2023-07-29T02:03:15.877 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/153/18' -> 'copyofsnap1/test1/153/18' 2023-07-29T02:03:15.877 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/153/19' -> 'copyofsnap1/test1/153/19' 2023-07-29T02:03:15.877 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/153/20' -> 'copyofsnap1/test1/153/20' 2023-07-29T02:03:16.014 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/154' -> 'copyofsnap1/test1/154' 2023-07-29T02:03:16.015 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/154/10' -> 'copyofsnap1/test1/154/10' 2023-07-29T02:03:16.015 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/154/11' -> 'copyofsnap1/test1/154/11' 2023-07-29T02:03:16.015 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/154/12' -> 'copyofsnap1/test1/154/12' 2023-07-29T02:03:16.015 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/154/13' -> 'copyofsnap1/test1/154/13' 2023-07-29T02:03:16.015 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/154/14' -> 'copyofsnap1/test1/154/14' 2023-07-29T02:03:16.016 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/154/15' -> 'copyofsnap1/test1/154/15' 2023-07-29T02:03:16.016 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/154/16' -> 'copyofsnap1/test1/154/16' 2023-07-29T02:03:16.016 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/154/17' -> 'copyofsnap1/test1/154/17' 2023-07-29T02:03:16.016 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/154/18' -> 'copyofsnap1/test1/154/18' 2023-07-29T02:03:16.016 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/154/19' -> 'copyofsnap1/test1/154/19' 2023-07-29T02:03:16.016 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/154/20' -> 'copyofsnap1/test1/154/20' 2023-07-29T02:03:16.017 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/155' -> 'copyofsnap1/test1/155' 2023-07-29T02:03:16.017 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/155/10' -> 'copyofsnap1/test1/155/10' 2023-07-29T02:03:16.017 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/155/11' -> 'copyofsnap1/test1/155/11' 2023-07-29T02:03:16.017 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/155/12' -> 'copyofsnap1/test1/155/12' 2023-07-29T02:03:16.018 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/155/13' -> 'copyofsnap1/test1/155/13' 2023-07-29T02:03:16.018 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/155/14' -> 'copyofsnap1/test1/155/14' 2023-07-29T02:03:16.018 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/155/15' -> 'copyofsnap1/test1/155/15' 2023-07-29T02:03:16.018 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/155/16' -> 'copyofsnap1/test1/155/16' 2023-07-29T02:03:16.018 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/155/17' -> 'copyofsnap1/test1/155/17' 2023-07-29T02:03:16.018 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/155/18' -> 'copyofsnap1/test1/155/18' 2023-07-29T02:03:16.019 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/155/19' -> 'copyofsnap1/test1/155/19' 2023-07-29T02:03:16.019 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/155/20' -> 'copyofsnap1/test1/155/20' 2023-07-29T02:03:16.019 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/156' -> 'copyofsnap1/test1/156' 2023-07-29T02:03:16.019 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/156/10' -> 'copyofsnap1/test1/156/10' 2023-07-29T02:03:16.019 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/156/11' -> 'copyofsnap1/test1/156/11' 2023-07-29T02:03:16.019 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/156/12' -> 'copyofsnap1/test1/156/12' 2023-07-29T02:03:16.019 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/156/13' -> 'copyofsnap1/test1/156/13' 2023-07-29T02:03:16.020 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/156/14' -> 'copyofsnap1/test1/156/14' 2023-07-29T02:03:16.020 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/156/15' -> 'copyofsnap1/test1/156/15' 2023-07-29T02:03:16.020 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/156/16' -> 'copyofsnap1/test1/156/16' 2023-07-29T02:03:16.020 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/156/17' -> 'copyofsnap1/test1/156/17' 2023-07-29T02:03:16.020 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/156/18' -> 'copyofsnap1/test1/156/18' 2023-07-29T02:03:16.020 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/156/19' -> 'copyofsnap1/test1/156/19' 2023-07-29T02:03:16.020 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/156/20' -> 'copyofsnap1/test1/156/20' 2023-07-29T02:03:16.021 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/157' -> 'copyofsnap1/test1/157' 2023-07-29T02:03:16.021 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/157/10' -> 'copyofsnap1/test1/157/10' 2023-07-29T02:03:16.021 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/157/11' -> 'copyofsnap1/test1/157/11' 2023-07-29T02:03:16.021 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/157/12' -> 'copyofsnap1/test1/157/12' 2023-07-29T02:03:16.021 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/157/13' -> 'copyofsnap1/test1/157/13' 2023-07-29T02:03:16.021 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/157/14' -> 'copyofsnap1/test1/157/14' 2023-07-29T02:03:16.021 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/157/15' -> 'copyofsnap1/test1/157/15' 2023-07-29T02:03:16.021 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/157/16' -> 'copyofsnap1/test1/157/16' 2023-07-29T02:03:16.022 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/157/17' -> 'copyofsnap1/test1/157/17' 2023-07-29T02:03:16.022 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/157/18' -> 'copyofsnap1/test1/157/18' 2023-07-29T02:03:16.022 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/157/19' -> 'copyofsnap1/test1/157/19' 2023-07-29T02:03:16.022 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/157/20' -> 'copyofsnap1/test1/157/20' 2023-07-29T02:03:16.022 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/158' -> 'copyofsnap1/test1/158' 2023-07-29T02:03:16.022 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/158/10' -> 'copyofsnap1/test1/158/10' 2023-07-29T02:03:16.022 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/158/11' -> 'copyofsnap1/test1/158/11' 2023-07-29T02:03:16.022 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/158/12' -> 'copyofsnap1/test1/158/12' 2023-07-29T02:03:16.023 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/158/13' -> 'copyofsnap1/test1/158/13' 2023-07-29T02:03:16.023 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/158/14' -> 'copyofsnap1/test1/158/14' 2023-07-29T02:03:16.023 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/158/15' -> 'copyofsnap1/test1/158/15' 2023-07-29T02:03:16.023 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/158/16' -> 'copyofsnap1/test1/158/16' 2023-07-29T02:03:16.023 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/158/17' -> 'copyofsnap1/test1/158/17' 2023-07-29T02:03:16.023 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/158/18' -> 'copyofsnap1/test1/158/18' 2023-07-29T02:03:16.023 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/158/19' -> 'copyofsnap1/test1/158/19' 2023-07-29T02:03:16.024 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/158/20' -> 'copyofsnap1/test1/158/20' 2023-07-29T02:03:16.024 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/159' -> 'copyofsnap1/test1/159' 2023-07-29T02:03:16.024 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/159/10' -> 'copyofsnap1/test1/159/10' 2023-07-29T02:03:16.024 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/159/11' -> 'copyofsnap1/test1/159/11' 2023-07-29T02:03:16.024 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/159/12' -> 'copyofsnap1/test1/159/12' 2023-07-29T02:03:16.024 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/159/13' -> 'copyofsnap1/test1/159/13' 2023-07-29T02:03:16.024 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/159/14' -> 'copyofsnap1/test1/159/14' 2023-07-29T02:03:16.025 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/159/15' -> 'copyofsnap1/test1/159/15' 2023-07-29T02:03:16.025 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/159/16' -> 'copyofsnap1/test1/159/16' 2023-07-29T02:03:16.025 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/159/17' -> 'copyofsnap1/test1/159/17' 2023-07-29T02:03:16.025 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/159/18' -> 'copyofsnap1/test1/159/18' 2023-07-29T02:03:16.026 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/159/19' -> 'copyofsnap1/test1/159/19' 2023-07-29T02:03:16.026 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/159/20' -> 'copyofsnap1/test1/159/20' 2023-07-29T02:03:16.026 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/160' -> 'copyofsnap1/test1/160' 2023-07-29T02:03:16.026 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/160/10' -> 'copyofsnap1/test1/160/10' 2023-07-29T02:03:16.026 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/160/11' -> 'copyofsnap1/test1/160/11' 2023-07-29T02:03:16.026 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/160/12' -> 'copyofsnap1/test1/160/12' 2023-07-29T02:03:16.026 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/160/13' -> 'copyofsnap1/test1/160/13' 2023-07-29T02:03:16.026 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/160/14' -> 'copyofsnap1/test1/160/14' 2023-07-29T02:03:16.027 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/160/15' -> 'copyofsnap1/test1/160/15' 2023-07-29T02:03:16.027 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/160/16' -> 'copyofsnap1/test1/160/16' 2023-07-29T02:03:16.027 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/160/17' -> 'copyofsnap1/test1/160/17' 2023-07-29T02:03:16.182 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/160/18' -> 'copyofsnap1/test1/160/18' 2023-07-29T02:03:16.182 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/160/19' -> 'copyofsnap1/test1/160/19' 2023-07-29T02:03:16.182 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/160/20' -> 'copyofsnap1/test1/160/20' 2023-07-29T02:03:16.182 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/161' -> 'copyofsnap1/test1/161' 2023-07-29T02:03:16.182 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/161/10' -> 'copyofsnap1/test1/161/10' 2023-07-29T02:03:16.183 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/161/11' -> 'copyofsnap1/test1/161/11' 2023-07-29T02:03:16.183 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/161/12' -> 'copyofsnap1/test1/161/12' 2023-07-29T02:03:16.183 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/161/13' -> 'copyofsnap1/test1/161/13' 2023-07-29T02:03:16.183 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/161/14' -> 'copyofsnap1/test1/161/14' 2023-07-29T02:03:16.183 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/161/15' -> 'copyofsnap1/test1/161/15' 2023-07-29T02:03:16.184 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/161/16' -> 'copyofsnap1/test1/161/16' 2023-07-29T02:03:16.184 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/161/17' -> 'copyofsnap1/test1/161/17' 2023-07-29T02:03:16.184 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/161/18' -> 'copyofsnap1/test1/161/18' 2023-07-29T02:03:16.184 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/161/19' -> 'copyofsnap1/test1/161/19' 2023-07-29T02:03:16.184 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/161/20' -> 'copyofsnap1/test1/161/20' 2023-07-29T02:03:16.185 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/162' -> 'copyofsnap1/test1/162' 2023-07-29T02:03:16.185 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/162/10' -> 'copyofsnap1/test1/162/10' 2023-07-29T02:03:16.185 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/162/11' -> 'copyofsnap1/test1/162/11' 2023-07-29T02:03:16.185 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/162/12' -> 'copyofsnap1/test1/162/12' 2023-07-29T02:03:16.185 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/162/13' -> 'copyofsnap1/test1/162/13' 2023-07-29T02:03:16.185 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/162/14' -> 'copyofsnap1/test1/162/14' 2023-07-29T02:03:16.186 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/162/15' -> 'copyofsnap1/test1/162/15' 2023-07-29T02:03:16.186 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/162/16' -> 'copyofsnap1/test1/162/16' 2023-07-29T02:03:16.186 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/162/17' -> 'copyofsnap1/test1/162/17' 2023-07-29T02:03:16.186 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/162/18' -> 'copyofsnap1/test1/162/18' 2023-07-29T02:03:16.186 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/162/19' -> 'copyofsnap1/test1/162/19' 2023-07-29T02:03:16.186 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/162/20' -> 'copyofsnap1/test1/162/20' 2023-07-29T02:03:16.186 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/163' -> 'copyofsnap1/test1/163' 2023-07-29T02:03:16.187 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/163/10' -> 'copyofsnap1/test1/163/10' 2023-07-29T02:03:16.187 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/163/11' -> 'copyofsnap1/test1/163/11' 2023-07-29T02:03:16.187 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/163/12' -> 'copyofsnap1/test1/163/12' 2023-07-29T02:03:16.187 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/163/13' -> 'copyofsnap1/test1/163/13' 2023-07-29T02:03:16.187 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/163/14' -> 'copyofsnap1/test1/163/14' 2023-07-29T02:03:16.187 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/163/15' -> 'copyofsnap1/test1/163/15' 2023-07-29T02:03:16.187 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/163/16' -> 'copyofsnap1/test1/163/16' 2023-07-29T02:03:16.187 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/163/17' -> 'copyofsnap1/test1/163/17' 2023-07-29T02:03:16.188 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/163/18' -> 'copyofsnap1/test1/163/18' 2023-07-29T02:03:16.188 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/163/19' -> 'copyofsnap1/test1/163/19' 2023-07-29T02:03:16.188 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/163/20' -> 'copyofsnap1/test1/163/20' 2023-07-29T02:03:16.188 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/164' -> 'copyofsnap1/test1/164' 2023-07-29T02:03:16.188 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/164/10' -> 'copyofsnap1/test1/164/10' 2023-07-29T02:03:16.188 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/164/11' -> 'copyofsnap1/test1/164/11' 2023-07-29T02:03:16.188 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/164/12' -> 'copyofsnap1/test1/164/12' 2023-07-29T02:03:16.189 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/164/13' -> 'copyofsnap1/test1/164/13' 2023-07-29T02:03:16.189 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/164/14' -> 'copyofsnap1/test1/164/14' 2023-07-29T02:03:16.189 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/164/15' -> 'copyofsnap1/test1/164/15' 2023-07-29T02:03:16.189 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/164/16' -> 'copyofsnap1/test1/164/16' 2023-07-29T02:03:16.189 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/164/17' -> 'copyofsnap1/test1/164/17' 2023-07-29T02:03:16.189 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/164/18' -> 'copyofsnap1/test1/164/18' 2023-07-29T02:03:16.189 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/164/19' -> 'copyofsnap1/test1/164/19' 2023-07-29T02:03:16.189 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/164/20' -> 'copyofsnap1/test1/164/20' 2023-07-29T02:03:16.190 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/165' -> 'copyofsnap1/test1/165' 2023-07-29T02:03:16.190 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/165/10' -> 'copyofsnap1/test1/165/10' 2023-07-29T02:03:16.190 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/165/11' -> 'copyofsnap1/test1/165/11' 2023-07-29T02:03:16.190 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/165/12' -> 'copyofsnap1/test1/165/12' 2023-07-29T02:03:16.190 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/165/13' -> 'copyofsnap1/test1/165/13' 2023-07-29T02:03:16.190 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/165/14' -> 'copyofsnap1/test1/165/14' 2023-07-29T02:03:16.190 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/165/15' -> 'copyofsnap1/test1/165/15' 2023-07-29T02:03:16.191 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/165/16' -> 'copyofsnap1/test1/165/16' 2023-07-29T02:03:16.191 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/165/17' -> 'copyofsnap1/test1/165/17' 2023-07-29T02:03:16.191 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/165/18' -> 'copyofsnap1/test1/165/18' 2023-07-29T02:03:16.191 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/165/19' -> 'copyofsnap1/test1/165/19' 2023-07-29T02:03:16.191 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/165/20' -> 'copyofsnap1/test1/165/20' 2023-07-29T02:03:16.191 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/166' -> 'copyofsnap1/test1/166' 2023-07-29T02:03:16.191 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/166/10' -> 'copyofsnap1/test1/166/10' 2023-07-29T02:03:16.191 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/166/11' -> 'copyofsnap1/test1/166/11' 2023-07-29T02:03:16.192 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/166/12' -> 'copyofsnap1/test1/166/12' 2023-07-29T02:03:16.192 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/166/13' -> 'copyofsnap1/test1/166/13' 2023-07-29T02:03:16.192 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/166/14' -> 'copyofsnap1/test1/166/14' 2023-07-29T02:03:16.192 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/166/15' -> 'copyofsnap1/test1/166/15' 2023-07-29T02:03:16.192 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/166/16' -> 'copyofsnap1/test1/166/16' 2023-07-29T02:03:16.192 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/166/17' -> 'copyofsnap1/test1/166/17' 2023-07-29T02:03:16.193 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/166/18' -> 'copyofsnap1/test1/166/18' 2023-07-29T02:03:16.193 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/166/19' -> 'copyofsnap1/test1/166/19' 2023-07-29T02:03:16.193 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/166/20' -> 'copyofsnap1/test1/166/20' 2023-07-29T02:03:16.193 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/167' -> 'copyofsnap1/test1/167' 2023-07-29T02:03:16.194 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/167/10' -> 'copyofsnap1/test1/167/10' 2023-07-29T02:03:16.194 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/167/11' -> 'copyofsnap1/test1/167/11' 2023-07-29T02:03:16.194 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/167/12' -> 'copyofsnap1/test1/167/12' 2023-07-29T02:03:16.194 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/167/13' -> 'copyofsnap1/test1/167/13' 2023-07-29T02:03:16.194 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/167/14' -> 'copyofsnap1/test1/167/14' 2023-07-29T02:03:16.345 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/167/15' -> 'copyofsnap1/test1/167/15' 2023-07-29T02:03:16.345 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/167/16' -> 'copyofsnap1/test1/167/16' 2023-07-29T02:03:16.345 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/167/17' -> 'copyofsnap1/test1/167/17' 2023-07-29T02:03:16.346 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/167/18' -> 'copyofsnap1/test1/167/18' 2023-07-29T02:03:16.346 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/167/19' -> 'copyofsnap1/test1/167/19' 2023-07-29T02:03:16.346 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/167/20' -> 'copyofsnap1/test1/167/20' 2023-07-29T02:03:16.346 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/168' -> 'copyofsnap1/test1/168' 2023-07-29T02:03:16.346 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/168/10' -> 'copyofsnap1/test1/168/10' 2023-07-29T02:03:16.346 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/168/11' -> 'copyofsnap1/test1/168/11' 2023-07-29T02:03:16.346 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/168/12' -> 'copyofsnap1/test1/168/12' 2023-07-29T02:03:16.347 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/168/13' -> 'copyofsnap1/test1/168/13' 2023-07-29T02:03:16.347 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/168/14' -> 'copyofsnap1/test1/168/14' 2023-07-29T02:03:16.347 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/168/15' -> 'copyofsnap1/test1/168/15' 2023-07-29T02:03:16.347 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/168/16' -> 'copyofsnap1/test1/168/16' 2023-07-29T02:03:16.347 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/168/17' -> 'copyofsnap1/test1/168/17' 2023-07-29T02:03:16.347 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/168/18' -> 'copyofsnap1/test1/168/18' 2023-07-29T02:03:16.347 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/168/19' -> 'copyofsnap1/test1/168/19' 2023-07-29T02:03:16.347 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/168/20' -> 'copyofsnap1/test1/168/20' 2023-07-29T02:03:16.348 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/169' -> 'copyofsnap1/test1/169' 2023-07-29T02:03:16.348 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/169/10' -> 'copyofsnap1/test1/169/10' 2023-07-29T02:03:16.348 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/169/11' -> 'copyofsnap1/test1/169/11' 2023-07-29T02:03:16.348 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/169/12' -> 'copyofsnap1/test1/169/12' 2023-07-29T02:03:16.348 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/169/13' -> 'copyofsnap1/test1/169/13' 2023-07-29T02:03:16.348 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/169/14' -> 'copyofsnap1/test1/169/14' 2023-07-29T02:03:16.348 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/169/15' -> 'copyofsnap1/test1/169/15' 2023-07-29T02:03:16.349 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/169/16' -> 'copyofsnap1/test1/169/16' 2023-07-29T02:03:16.349 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/169/17' -> 'copyofsnap1/test1/169/17' 2023-07-29T02:03:16.349 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/169/18' -> 'copyofsnap1/test1/169/18' 2023-07-29T02:03:16.349 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/169/19' -> 'copyofsnap1/test1/169/19' 2023-07-29T02:03:16.349 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/169/20' -> 'copyofsnap1/test1/169/20' 2023-07-29T02:03:16.349 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/170' -> 'copyofsnap1/test1/170' 2023-07-29T02:03:16.349 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/170/10' -> 'copyofsnap1/test1/170/10' 2023-07-29T02:03:16.349 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/170/11' -> 'copyofsnap1/test1/170/11' 2023-07-29T02:03:16.350 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/170/12' -> 'copyofsnap1/test1/170/12' 2023-07-29T02:03:16.350 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/170/13' -> 'copyofsnap1/test1/170/13' 2023-07-29T02:03:16.350 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/170/14' -> 'copyofsnap1/test1/170/14' 2023-07-29T02:03:16.350 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/170/15' -> 'copyofsnap1/test1/170/15' 2023-07-29T02:03:16.350 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/170/16' -> 'copyofsnap1/test1/170/16' 2023-07-29T02:03:16.350 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/170/17' -> 'copyofsnap1/test1/170/17' 2023-07-29T02:03:16.350 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/170/18' -> 'copyofsnap1/test1/170/18' 2023-07-29T02:03:16.351 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/170/19' -> 'copyofsnap1/test1/170/19' 2023-07-29T02:03:16.351 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/170/20' -> 'copyofsnap1/test1/170/20' 2023-07-29T02:03:16.351 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/171' -> 'copyofsnap1/test1/171' 2023-07-29T02:03:16.351 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/171/10' -> 'copyofsnap1/test1/171/10' 2023-07-29T02:03:16.351 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/171/11' -> 'copyofsnap1/test1/171/11' 2023-07-29T02:03:16.351 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/171/12' -> 'copyofsnap1/test1/171/12' 2023-07-29T02:03:16.351 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/171/13' -> 'copyofsnap1/test1/171/13' 2023-07-29T02:03:16.351 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/171/14' -> 'copyofsnap1/test1/171/14' 2023-07-29T02:03:16.352 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/171/15' -> 'copyofsnap1/test1/171/15' 2023-07-29T02:03:16.352 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/171/16' -> 'copyofsnap1/test1/171/16' 2023-07-29T02:03:16.352 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/171/17' -> 'copyofsnap1/test1/171/17' 2023-07-29T02:03:16.352 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/171/18' -> 'copyofsnap1/test1/171/18' 2023-07-29T02:03:16.352 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/171/19' -> 'copyofsnap1/test1/171/19' 2023-07-29T02:03:16.352 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/171/20' -> 'copyofsnap1/test1/171/20' 2023-07-29T02:03:16.352 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/172' -> 'copyofsnap1/test1/172' 2023-07-29T02:03:16.352 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/172/10' -> 'copyofsnap1/test1/172/10' 2023-07-29T02:03:16.353 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/172/11' -> 'copyofsnap1/test1/172/11' 2023-07-29T02:03:16.353 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/172/12' -> 'copyofsnap1/test1/172/12' 2023-07-29T02:03:16.353 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/172/13' -> 'copyofsnap1/test1/172/13' 2023-07-29T02:03:16.353 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/172/14' -> 'copyofsnap1/test1/172/14' 2023-07-29T02:03:16.353 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/172/15' -> 'copyofsnap1/test1/172/15' 2023-07-29T02:03:16.353 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/172/16' -> 'copyofsnap1/test1/172/16' 2023-07-29T02:03:16.353 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/172/17' -> 'copyofsnap1/test1/172/17' 2023-07-29T02:03:16.353 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/172/18' -> 'copyofsnap1/test1/172/18' 2023-07-29T02:03:16.354 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/172/19' -> 'copyofsnap1/test1/172/19' 2023-07-29T02:03:16.354 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/172/20' -> 'copyofsnap1/test1/172/20' 2023-07-29T02:03:16.354 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/173' -> 'copyofsnap1/test1/173' 2023-07-29T02:03:16.354 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/173/10' -> 'copyofsnap1/test1/173/10' 2023-07-29T02:03:16.354 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/173/11' -> 'copyofsnap1/test1/173/11' 2023-07-29T02:03:16.354 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/173/12' -> 'copyofsnap1/test1/173/12' 2023-07-29T02:03:16.354 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/173/13' -> 'copyofsnap1/test1/173/13' 2023-07-29T02:03:16.355 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/173/14' -> 'copyofsnap1/test1/173/14' 2023-07-29T02:03:16.355 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/173/15' -> 'copyofsnap1/test1/173/15' 2023-07-29T02:03:16.355 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/173/16' -> 'copyofsnap1/test1/173/16' 2023-07-29T02:03:16.355 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/173/17' -> 'copyofsnap1/test1/173/17' 2023-07-29T02:03:16.355 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/173/18' -> 'copyofsnap1/test1/173/18' 2023-07-29T02:03:16.355 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/173/19' -> 'copyofsnap1/test1/173/19' 2023-07-29T02:03:16.355 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/173/20' -> 'copyofsnap1/test1/173/20' 2023-07-29T02:03:16.355 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/174' -> 'copyofsnap1/test1/174' 2023-07-29T02:03:16.356 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/174/10' -> 'copyofsnap1/test1/174/10' 2023-07-29T02:03:16.356 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/174/11' -> 'copyofsnap1/test1/174/11' 2023-07-29T02:03:16.510 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/174/12' -> 'copyofsnap1/test1/174/12' 2023-07-29T02:03:16.510 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/174/13' -> 'copyofsnap1/test1/174/13' 2023-07-29T02:03:16.510 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/174/14' -> 'copyofsnap1/test1/174/14' 2023-07-29T02:03:16.511 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/174/15' -> 'copyofsnap1/test1/174/15' 2023-07-29T02:03:16.511 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/174/16' -> 'copyofsnap1/test1/174/16' 2023-07-29T02:03:16.511 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/174/17' -> 'copyofsnap1/test1/174/17' 2023-07-29T02:03:16.511 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/174/18' -> 'copyofsnap1/test1/174/18' 2023-07-29T02:03:16.511 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/174/19' -> 'copyofsnap1/test1/174/19' 2023-07-29T02:03:16.511 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/174/20' -> 'copyofsnap1/test1/174/20' 2023-07-29T02:03:16.511 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/175' -> 'copyofsnap1/test1/175' 2023-07-29T02:03:16.512 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/175/10' -> 'copyofsnap1/test1/175/10' 2023-07-29T02:03:16.512 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/175/11' -> 'copyofsnap1/test1/175/11' 2023-07-29T02:03:16.512 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/175/12' -> 'copyofsnap1/test1/175/12' 2023-07-29T02:03:16.512 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/175/13' -> 'copyofsnap1/test1/175/13' 2023-07-29T02:03:16.512 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/175/14' -> 'copyofsnap1/test1/175/14' 2023-07-29T02:03:16.512 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/175/15' -> 'copyofsnap1/test1/175/15' 2023-07-29T02:03:16.513 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/175/16' -> 'copyofsnap1/test1/175/16' 2023-07-29T02:03:16.513 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/175/17' -> 'copyofsnap1/test1/175/17' 2023-07-29T02:03:16.513 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/175/18' -> 'copyofsnap1/test1/175/18' 2023-07-29T02:03:16.513 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/175/19' -> 'copyofsnap1/test1/175/19' 2023-07-29T02:03:16.513 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/175/20' -> 'copyofsnap1/test1/175/20' 2023-07-29T02:03:16.513 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/176' -> 'copyofsnap1/test1/176' 2023-07-29T02:03:16.513 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/176/10' -> 'copyofsnap1/test1/176/10' 2023-07-29T02:03:16.513 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/176/11' -> 'copyofsnap1/test1/176/11' 2023-07-29T02:03:16.514 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/176/12' -> 'copyofsnap1/test1/176/12' 2023-07-29T02:03:16.514 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/176/13' -> 'copyofsnap1/test1/176/13' 2023-07-29T02:03:16.514 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/176/14' -> 'copyofsnap1/test1/176/14' 2023-07-29T02:03:16.514 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/176/15' -> 'copyofsnap1/test1/176/15' 2023-07-29T02:03:16.514 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/176/16' -> 'copyofsnap1/test1/176/16' 2023-07-29T02:03:16.514 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/176/17' -> 'copyofsnap1/test1/176/17' 2023-07-29T02:03:16.514 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/176/18' -> 'copyofsnap1/test1/176/18' 2023-07-29T02:03:16.515 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/176/19' -> 'copyofsnap1/test1/176/19' 2023-07-29T02:03:16.515 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/176/20' -> 'copyofsnap1/test1/176/20' 2023-07-29T02:03:16.515 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/177' -> 'copyofsnap1/test1/177' 2023-07-29T02:03:16.516 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/177/10' -> 'copyofsnap1/test1/177/10' 2023-07-29T02:03:16.516 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/177/11' -> 'copyofsnap1/test1/177/11' 2023-07-29T02:03:16.516 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/177/12' -> 'copyofsnap1/test1/177/12' 2023-07-29T02:03:16.516 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/177/13' -> 'copyofsnap1/test1/177/13' 2023-07-29T02:03:16.516 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/177/14' -> 'copyofsnap1/test1/177/14' 2023-07-29T02:03:16.517 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/177/15' -> 'copyofsnap1/test1/177/15' 2023-07-29T02:03:16.517 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/177/16' -> 'copyofsnap1/test1/177/16' 2023-07-29T02:03:16.517 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/177/17' -> 'copyofsnap1/test1/177/17' 2023-07-29T02:03:16.517 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/177/18' -> 'copyofsnap1/test1/177/18' 2023-07-29T02:03:16.517 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/177/19' -> 'copyofsnap1/test1/177/19' 2023-07-29T02:03:16.517 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/177/20' -> 'copyofsnap1/test1/177/20' 2023-07-29T02:03:16.517 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/178' -> 'copyofsnap1/test1/178' 2023-07-29T02:03:16.518 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/178/10' -> 'copyofsnap1/test1/178/10' 2023-07-29T02:03:16.518 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/178/11' -> 'copyofsnap1/test1/178/11' 2023-07-29T02:03:16.518 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/178/12' -> 'copyofsnap1/test1/178/12' 2023-07-29T02:03:16.518 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/178/13' -> 'copyofsnap1/test1/178/13' 2023-07-29T02:03:16.518 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/178/14' -> 'copyofsnap1/test1/178/14' 2023-07-29T02:03:16.518 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/178/15' -> 'copyofsnap1/test1/178/15' 2023-07-29T02:03:16.518 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/178/16' -> 'copyofsnap1/test1/178/16' 2023-07-29T02:03:16.518 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/178/17' -> 'copyofsnap1/test1/178/17' 2023-07-29T02:03:16.519 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/178/18' -> 'copyofsnap1/test1/178/18' 2023-07-29T02:03:16.519 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/178/19' -> 'copyofsnap1/test1/178/19' 2023-07-29T02:03:16.519 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/178/20' -> 'copyofsnap1/test1/178/20' 2023-07-29T02:03:16.519 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/179' -> 'copyofsnap1/test1/179' 2023-07-29T02:03:16.519 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/179/10' -> 'copyofsnap1/test1/179/10' 2023-07-29T02:03:16.519 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/179/11' -> 'copyofsnap1/test1/179/11' 2023-07-29T02:03:16.519 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/179/12' -> 'copyofsnap1/test1/179/12' 2023-07-29T02:03:16.519 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/179/13' -> 'copyofsnap1/test1/179/13' 2023-07-29T02:03:16.520 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/179/14' -> 'copyofsnap1/test1/179/14' 2023-07-29T02:03:16.520 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/179/15' -> 'copyofsnap1/test1/179/15' 2023-07-29T02:03:16.520 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/179/16' -> 'copyofsnap1/test1/179/16' 2023-07-29T02:03:16.520 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/179/17' -> 'copyofsnap1/test1/179/17' 2023-07-29T02:03:16.520 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/179/18' -> 'copyofsnap1/test1/179/18' 2023-07-29T02:03:16.520 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/179/19' -> 'copyofsnap1/test1/179/19' 2023-07-29T02:03:16.520 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/179/20' -> 'copyofsnap1/test1/179/20' 2023-07-29T02:03:16.520 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/180' -> 'copyofsnap1/test1/180' 2023-07-29T02:03:16.521 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/180/10' -> 'copyofsnap1/test1/180/10' 2023-07-29T02:03:16.521 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/180/11' -> 'copyofsnap1/test1/180/11' 2023-07-29T02:03:16.521 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/180/12' -> 'copyofsnap1/test1/180/12' 2023-07-29T02:03:16.521 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/180/13' -> 'copyofsnap1/test1/180/13' 2023-07-29T02:03:16.521 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/180/14' -> 'copyofsnap1/test1/180/14' 2023-07-29T02:03:16.521 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/180/15' -> 'copyofsnap1/test1/180/15' 2023-07-29T02:03:16.521 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/180/16' -> 'copyofsnap1/test1/180/16' 2023-07-29T02:03:16.521 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/180/17' -> 'copyofsnap1/test1/180/17' 2023-07-29T02:03:16.522 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/180/18' -> 'copyofsnap1/test1/180/18' 2023-07-29T02:03:16.522 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/180/19' -> 'copyofsnap1/test1/180/19' 2023-07-29T02:03:16.522 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/180/20' -> 'copyofsnap1/test1/180/20' 2023-07-29T02:03:16.670 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/181' -> 'copyofsnap1/test1/181' 2023-07-29T02:03:16.671 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/181/10' -> 'copyofsnap1/test1/181/10' 2023-07-29T02:03:16.671 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/181/11' -> 'copyofsnap1/test1/181/11' 2023-07-29T02:03:16.671 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/181/12' -> 'copyofsnap1/test1/181/12' 2023-07-29T02:03:16.671 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/181/13' -> 'copyofsnap1/test1/181/13' 2023-07-29T02:03:16.671 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/181/14' -> 'copyofsnap1/test1/181/14' 2023-07-29T02:03:16.671 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/181/15' -> 'copyofsnap1/test1/181/15' 2023-07-29T02:03:16.671 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/181/16' -> 'copyofsnap1/test1/181/16' 2023-07-29T02:03:16.672 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/181/17' -> 'copyofsnap1/test1/181/17' 2023-07-29T02:03:16.672 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/181/18' -> 'copyofsnap1/test1/181/18' 2023-07-29T02:03:16.672 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/181/19' -> 'copyofsnap1/test1/181/19' 2023-07-29T02:03:16.672 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/181/20' -> 'copyofsnap1/test1/181/20' 2023-07-29T02:03:16.672 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/182' -> 'copyofsnap1/test1/182' 2023-07-29T02:03:16.672 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/182/10' -> 'copyofsnap1/test1/182/10' 2023-07-29T02:03:16.672 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/182/11' -> 'copyofsnap1/test1/182/11' 2023-07-29T02:03:16.673 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/182/12' -> 'copyofsnap1/test1/182/12' 2023-07-29T02:03:16.673 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/182/13' -> 'copyofsnap1/test1/182/13' 2023-07-29T02:03:16.673 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/182/14' -> 'copyofsnap1/test1/182/14' 2023-07-29T02:03:16.673 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/182/15' -> 'copyofsnap1/test1/182/15' 2023-07-29T02:03:16.673 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/182/16' -> 'copyofsnap1/test1/182/16' 2023-07-29T02:03:16.673 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/182/17' -> 'copyofsnap1/test1/182/17' 2023-07-29T02:03:16.673 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/182/19' -> 'copyofsnap1/test1/182/19' 2023-07-29T02:03:16.673 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/182/20' -> 'copyofsnap1/test1/182/20' 2023-07-29T02:03:16.674 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/182/18' -> 'copyofsnap1/test1/182/18' 2023-07-29T02:03:16.674 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/183' -> 'copyofsnap1/test1/183' 2023-07-29T02:03:16.674 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/183/10' -> 'copyofsnap1/test1/183/10' 2023-07-29T02:03:16.674 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/183/11' -> 'copyofsnap1/test1/183/11' 2023-07-29T02:03:16.674 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/183/12' -> 'copyofsnap1/test1/183/12' 2023-07-29T02:03:16.674 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/183/13' -> 'copyofsnap1/test1/183/13' 2023-07-29T02:03:16.674 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/183/14' -> 'copyofsnap1/test1/183/14' 2023-07-29T02:03:16.674 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/183/15' -> 'copyofsnap1/test1/183/15' 2023-07-29T02:03:16.675 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/183/16' -> 'copyofsnap1/test1/183/16' 2023-07-29T02:03:16.675 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/183/17' -> 'copyofsnap1/test1/183/17' 2023-07-29T02:03:16.675 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/183/18' -> 'copyofsnap1/test1/183/18' 2023-07-29T02:03:16.675 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/183/19' -> 'copyofsnap1/test1/183/19' 2023-07-29T02:03:16.675 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/183/20' -> 'copyofsnap1/test1/183/20' 2023-07-29T02:03:16.675 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/184' -> 'copyofsnap1/test1/184' 2023-07-29T02:03:16.676 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/184/10' -> 'copyofsnap1/test1/184/10' 2023-07-29T02:03:16.676 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/184/11' -> 'copyofsnap1/test1/184/11' 2023-07-29T02:03:16.676 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/184/12' -> 'copyofsnap1/test1/184/12' 2023-07-29T02:03:16.676 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/184/13' -> 'copyofsnap1/test1/184/13' 2023-07-29T02:03:16.677 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/184/14' -> 'copyofsnap1/test1/184/14' 2023-07-29T02:03:16.677 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/184/15' -> 'copyofsnap1/test1/184/15' 2023-07-29T02:03:16.677 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/184/16' -> 'copyofsnap1/test1/184/16' 2023-07-29T02:03:16.677 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/184/17' -> 'copyofsnap1/test1/184/17' 2023-07-29T02:03:16.677 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/184/18' -> 'copyofsnap1/test1/184/18' 2023-07-29T02:03:16.677 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/184/19' -> 'copyofsnap1/test1/184/19' 2023-07-29T02:03:16.677 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/184/20' -> 'copyofsnap1/test1/184/20' 2023-07-29T02:03:16.677 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/185' -> 'copyofsnap1/test1/185' 2023-07-29T02:03:16.678 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/185/10' -> 'copyofsnap1/test1/185/10' 2023-07-29T02:03:16.678 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/185/11' -> 'copyofsnap1/test1/185/11' 2023-07-29T02:03:16.678 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/185/12' -> 'copyofsnap1/test1/185/12' 2023-07-29T02:03:16.678 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/185/13' -> 'copyofsnap1/test1/185/13' 2023-07-29T02:03:16.678 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/185/14' -> 'copyofsnap1/test1/185/14' 2023-07-29T02:03:16.678 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/185/15' -> 'copyofsnap1/test1/185/15' 2023-07-29T02:03:16.678 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/185/16' -> 'copyofsnap1/test1/185/16' 2023-07-29T02:03:16.678 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/185/17' -> 'copyofsnap1/test1/185/17' 2023-07-29T02:03:16.679 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/185/18' -> 'copyofsnap1/test1/185/18' 2023-07-29T02:03:16.679 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/185/19' -> 'copyofsnap1/test1/185/19' 2023-07-29T02:03:16.679 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/185/20' -> 'copyofsnap1/test1/185/20' 2023-07-29T02:03:16.679 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/186' -> 'copyofsnap1/test1/186' 2023-07-29T02:03:16.679 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/186/10' -> 'copyofsnap1/test1/186/10' 2023-07-29T02:03:16.679 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/186/11' -> 'copyofsnap1/test1/186/11' 2023-07-29T02:03:16.679 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/186/12' -> 'copyofsnap1/test1/186/12' 2023-07-29T02:03:16.679 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/186/13' -> 'copyofsnap1/test1/186/13' 2023-07-29T02:03:16.680 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/186/14' -> 'copyofsnap1/test1/186/14' 2023-07-29T02:03:16.680 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/186/15' -> 'copyofsnap1/test1/186/15' 2023-07-29T02:03:16.680 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/186/16' -> 'copyofsnap1/test1/186/16' 2023-07-29T02:03:16.680 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/186/17' -> 'copyofsnap1/test1/186/17' 2023-07-29T02:03:16.680 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/186/18' -> 'copyofsnap1/test1/186/18' 2023-07-29T02:03:16.680 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/186/19' -> 'copyofsnap1/test1/186/19' 2023-07-29T02:03:16.680 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/186/20' -> 'copyofsnap1/test1/186/20' 2023-07-29T02:03:16.681 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/187' -> 'copyofsnap1/test1/187' 2023-07-29T02:03:16.681 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/187/10' -> 'copyofsnap1/test1/187/10' 2023-07-29T02:03:16.681 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/187/11' -> 'copyofsnap1/test1/187/11' 2023-07-29T02:03:16.681 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/187/12' -> 'copyofsnap1/test1/187/12' 2023-07-29T02:03:16.681 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/187/13' -> 'copyofsnap1/test1/187/13' 2023-07-29T02:03:16.681 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/187/14' -> 'copyofsnap1/test1/187/14' 2023-07-29T02:03:16.681 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/187/15' -> 'copyofsnap1/test1/187/15' 2023-07-29T02:03:16.681 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/187/16' -> 'copyofsnap1/test1/187/16' 2023-07-29T02:03:16.682 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/187/17' -> 'copyofsnap1/test1/187/17' 2023-07-29T02:03:16.836 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/187/18' -> 'copyofsnap1/test1/187/18' 2023-07-29T02:03:16.836 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/187/19' -> 'copyofsnap1/test1/187/19' 2023-07-29T02:03:16.837 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/187/20' -> 'copyofsnap1/test1/187/20' 2023-07-29T02:03:16.837 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/188' -> 'copyofsnap1/test1/188' 2023-07-29T02:03:16.837 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/188/10' -> 'copyofsnap1/test1/188/10' 2023-07-29T02:03:16.837 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/188/11' -> 'copyofsnap1/test1/188/11' 2023-07-29T02:03:16.837 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/188/12' -> 'copyofsnap1/test1/188/12' 2023-07-29T02:03:16.837 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/188/13' -> 'copyofsnap1/test1/188/13' 2023-07-29T02:03:16.837 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/188/14' -> 'copyofsnap1/test1/188/14' 2023-07-29T02:03:16.838 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/188/15' -> 'copyofsnap1/test1/188/15' 2023-07-29T02:03:16.838 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/188/16' -> 'copyofsnap1/test1/188/16' 2023-07-29T02:03:16.838 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/188/17' -> 'copyofsnap1/test1/188/17' 2023-07-29T02:03:16.838 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/188/18' -> 'copyofsnap1/test1/188/18' 2023-07-29T02:03:16.838 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/188/19' -> 'copyofsnap1/test1/188/19' 2023-07-29T02:03:16.838 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/188/20' -> 'copyofsnap1/test1/188/20' 2023-07-29T02:03:16.838 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/189' -> 'copyofsnap1/test1/189' 2023-07-29T02:03:16.838 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/189/10' -> 'copyofsnap1/test1/189/10' 2023-07-29T02:03:16.839 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/189/11' -> 'copyofsnap1/test1/189/11' 2023-07-29T02:03:16.839 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/189/12' -> 'copyofsnap1/test1/189/12' 2023-07-29T02:03:16.839 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/189/13' -> 'copyofsnap1/test1/189/13' 2023-07-29T02:03:16.839 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/189/14' -> 'copyofsnap1/test1/189/14' 2023-07-29T02:03:16.839 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/189/15' -> 'copyofsnap1/test1/189/15' 2023-07-29T02:03:16.839 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/189/16' -> 'copyofsnap1/test1/189/16' 2023-07-29T02:03:16.839 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/189/17' -> 'copyofsnap1/test1/189/17' 2023-07-29T02:03:16.839 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/189/18' -> 'copyofsnap1/test1/189/18' 2023-07-29T02:03:16.840 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/189/19' -> 'copyofsnap1/test1/189/19' 2023-07-29T02:03:16.840 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/189/20' -> 'copyofsnap1/test1/189/20' 2023-07-29T02:03:16.840 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/190' -> 'copyofsnap1/test1/190' 2023-07-29T02:03:16.840 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/190/10' -> 'copyofsnap1/test1/190/10' 2023-07-29T02:03:16.840 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/190/11' -> 'copyofsnap1/test1/190/11' 2023-07-29T02:03:16.840 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/190/12' -> 'copyofsnap1/test1/190/12' 2023-07-29T02:03:16.840 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/190/13' -> 'copyofsnap1/test1/190/13' 2023-07-29T02:03:16.841 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/190/14' -> 'copyofsnap1/test1/190/14' 2023-07-29T02:03:16.841 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/190/15' -> 'copyofsnap1/test1/190/15' 2023-07-29T02:03:16.841 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/190/16' -> 'copyofsnap1/test1/190/16' 2023-07-29T02:03:16.841 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/190/17' -> 'copyofsnap1/test1/190/17' 2023-07-29T02:03:16.841 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/190/18' -> 'copyofsnap1/test1/190/18' 2023-07-29T02:03:16.841 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/190/19' -> 'copyofsnap1/test1/190/19' 2023-07-29T02:03:16.841 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/190/20' -> 'copyofsnap1/test1/190/20' 2023-07-29T02:03:16.841 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/191' -> 'copyofsnap1/test1/191' 2023-07-29T02:03:16.842 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/191/10' -> 'copyofsnap1/test1/191/10' 2023-07-29T02:03:16.842 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/191/11' -> 'copyofsnap1/test1/191/11' 2023-07-29T02:03:16.842 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/191/12' -> 'copyofsnap1/test1/191/12' 2023-07-29T02:03:16.842 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/191/13' -> 'copyofsnap1/test1/191/13' 2023-07-29T02:03:16.842 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/191/14' -> 'copyofsnap1/test1/191/14' 2023-07-29T02:03:16.842 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/191/15' -> 'copyofsnap1/test1/191/15' 2023-07-29T02:03:16.842 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/191/16' -> 'copyofsnap1/test1/191/16' 2023-07-29T02:03:16.842 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/191/17' -> 'copyofsnap1/test1/191/17' 2023-07-29T02:03:16.843 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/191/18' -> 'copyofsnap1/test1/191/18' 2023-07-29T02:03:16.843 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/191/19' -> 'copyofsnap1/test1/191/19' 2023-07-29T02:03:16.843 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/191/20' -> 'copyofsnap1/test1/191/20' 2023-07-29T02:03:16.843 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/192' -> 'copyofsnap1/test1/192' 2023-07-29T02:03:16.843 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/192/10' -> 'copyofsnap1/test1/192/10' 2023-07-29T02:03:16.843 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/192/11' -> 'copyofsnap1/test1/192/11' 2023-07-29T02:03:16.843 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/192/12' -> 'copyofsnap1/test1/192/12' 2023-07-29T02:03:16.844 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/192/13' -> 'copyofsnap1/test1/192/13' 2023-07-29T02:03:16.844 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/192/14' -> 'copyofsnap1/test1/192/14' 2023-07-29T02:03:16.844 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/192/15' -> 'copyofsnap1/test1/192/15' 2023-07-29T02:03:16.844 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/192/16' -> 'copyofsnap1/test1/192/16' 2023-07-29T02:03:16.844 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/192/17' -> 'copyofsnap1/test1/192/17' 2023-07-29T02:03:16.844 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/192/18' -> 'copyofsnap1/test1/192/18' 2023-07-29T02:03:16.844 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/192/19' -> 'copyofsnap1/test1/192/19' 2023-07-29T02:03:16.844 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/192/20' -> 'copyofsnap1/test1/192/20' 2023-07-29T02:03:16.845 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/193' -> 'copyofsnap1/test1/193' 2023-07-29T02:03:16.845 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/193/10' -> 'copyofsnap1/test1/193/10' 2023-07-29T02:03:16.845 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/193/11' -> 'copyofsnap1/test1/193/11' 2023-07-29T02:03:16.845 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/193/12' -> 'copyofsnap1/test1/193/12' 2023-07-29T02:03:16.845 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/193/13' -> 'copyofsnap1/test1/193/13' 2023-07-29T02:03:16.845 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/193/14' -> 'copyofsnap1/test1/193/14' 2023-07-29T02:03:16.845 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/193/15' -> 'copyofsnap1/test1/193/15' 2023-07-29T02:03:16.845 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/193/16' -> 'copyofsnap1/test1/193/16' 2023-07-29T02:03:16.846 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/193/17' -> 'copyofsnap1/test1/193/17' 2023-07-29T02:03:16.846 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/193/18' -> 'copyofsnap1/test1/193/18' 2023-07-29T02:03:16.846 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/193/19' -> 'copyofsnap1/test1/193/19' 2023-07-29T02:03:16.846 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/193/20' -> 'copyofsnap1/test1/193/20' 2023-07-29T02:03:16.846 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/194' -> 'copyofsnap1/test1/194' 2023-07-29T02:03:16.846 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/194/10' -> 'copyofsnap1/test1/194/10' 2023-07-29T02:03:16.846 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/194/11' -> 'copyofsnap1/test1/194/11' 2023-07-29T02:03:16.846 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/194/12' -> 'copyofsnap1/test1/194/12' 2023-07-29T02:03:16.847 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/194/13' -> 'copyofsnap1/test1/194/13' 2023-07-29T02:03:16.847 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/194/14' -> 'copyofsnap1/test1/194/14' 2023-07-29T02:03:16.969 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/194/15' -> 'copyofsnap1/test1/194/15' 2023-07-29T02:03:16.969 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/194/16' -> 'copyofsnap1/test1/194/16' 2023-07-29T02:03:16.969 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/194/17' -> 'copyofsnap1/test1/194/17' 2023-07-29T02:03:16.970 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/194/18' -> 'copyofsnap1/test1/194/18' 2023-07-29T02:03:16.970 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/194/19' -> 'copyofsnap1/test1/194/19' 2023-07-29T02:03:16.970 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/194/20' -> 'copyofsnap1/test1/194/20' 2023-07-29T02:03:16.970 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/195' -> 'copyofsnap1/test1/195' 2023-07-29T02:03:16.970 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/195/10' -> 'copyofsnap1/test1/195/10' 2023-07-29T02:03:16.970 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/195/11' -> 'copyofsnap1/test1/195/11' 2023-07-29T02:03:16.970 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/195/12' -> 'copyofsnap1/test1/195/12' 2023-07-29T02:03:16.971 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/195/13' -> 'copyofsnap1/test1/195/13' 2023-07-29T02:03:16.971 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/195/14' -> 'copyofsnap1/test1/195/14' 2023-07-29T02:03:16.971 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/195/15' -> 'copyofsnap1/test1/195/15' 2023-07-29T02:03:16.971 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/195/16' -> 'copyofsnap1/test1/195/16' 2023-07-29T02:03:16.971 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/195/17' -> 'copyofsnap1/test1/195/17' 2023-07-29T02:03:16.971 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/195/18' -> 'copyofsnap1/test1/195/18' 2023-07-29T02:03:16.971 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/195/19' -> 'copyofsnap1/test1/195/19' 2023-07-29T02:03:16.971 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/195/20' -> 'copyofsnap1/test1/195/20' 2023-07-29T02:03:16.972 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/196' -> 'copyofsnap1/test1/196' 2023-07-29T02:03:16.972 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/196/10' -> 'copyofsnap1/test1/196/10' 2023-07-29T02:03:16.972 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/196/11' -> 'copyofsnap1/test1/196/11' 2023-07-29T02:03:16.972 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/196/12' -> 'copyofsnap1/test1/196/12' 2023-07-29T02:03:16.972 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/196/13' -> 'copyofsnap1/test1/196/13' 2023-07-29T02:03:16.972 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/196/14' -> 'copyofsnap1/test1/196/14' 2023-07-29T02:03:16.972 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/196/15' -> 'copyofsnap1/test1/196/15' 2023-07-29T02:03:16.973 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/196/16' -> 'copyofsnap1/test1/196/16' 2023-07-29T02:03:16.973 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/196/17' -> 'copyofsnap1/test1/196/17' 2023-07-29T02:03:16.973 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/196/18' -> 'copyofsnap1/test1/196/18' 2023-07-29T02:03:16.973 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/196/19' -> 'copyofsnap1/test1/196/19' 2023-07-29T02:03:16.973 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/196/20' -> 'copyofsnap1/test1/196/20' 2023-07-29T02:03:16.973 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/197' -> 'copyofsnap1/test1/197' 2023-07-29T02:03:16.973 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/197/10' -> 'copyofsnap1/test1/197/10' 2023-07-29T02:03:16.973 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/197/11' -> 'copyofsnap1/test1/197/11' 2023-07-29T02:03:16.974 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/197/12' -> 'copyofsnap1/test1/197/12' 2023-07-29T02:03:16.974 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/197/13' -> 'copyofsnap1/test1/197/13' 2023-07-29T02:03:16.974 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/197/14' -> 'copyofsnap1/test1/197/14' 2023-07-29T02:03:16.974 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/197/15' -> 'copyofsnap1/test1/197/15' 2023-07-29T02:03:16.974 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/197/16' -> 'copyofsnap1/test1/197/16' 2023-07-29T02:03:16.974 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/197/17' -> 'copyofsnap1/test1/197/17' 2023-07-29T02:03:16.974 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/197/18' -> 'copyofsnap1/test1/197/18' 2023-07-29T02:03:16.974 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/197/19' -> 'copyofsnap1/test1/197/19' 2023-07-29T02:03:16.975 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/197/20' -> 'copyofsnap1/test1/197/20' 2023-07-29T02:03:16.975 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/198' -> 'copyofsnap1/test1/198' 2023-07-29T02:03:16.975 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/198/10' -> 'copyofsnap1/test1/198/10' 2023-07-29T02:03:16.975 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/198/11' -> 'copyofsnap1/test1/198/11' 2023-07-29T02:03:16.975 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/198/12' -> 'copyofsnap1/test1/198/12' 2023-07-29T02:03:16.975 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/198/13' -> 'copyofsnap1/test1/198/13' 2023-07-29T02:03:16.975 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/198/14' -> 'copyofsnap1/test1/198/14' 2023-07-29T02:03:16.975 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/198/15' -> 'copyofsnap1/test1/198/15' 2023-07-29T02:03:16.976 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/198/16' -> 'copyofsnap1/test1/198/16' 2023-07-29T02:03:16.976 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/198/17' -> 'copyofsnap1/test1/198/17' 2023-07-29T02:03:16.976 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/198/18' -> 'copyofsnap1/test1/198/18' 2023-07-29T02:03:16.976 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/198/19' -> 'copyofsnap1/test1/198/19' 2023-07-29T02:03:16.976 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/198/20' -> 'copyofsnap1/test1/198/20' 2023-07-29T02:03:16.976 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/199' -> 'copyofsnap1/test1/199' 2023-07-29T02:03:16.976 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/199/10' -> 'copyofsnap1/test1/199/10' 2023-07-29T02:03:16.977 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/199/11' -> 'copyofsnap1/test1/199/11' 2023-07-29T02:03:16.977 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/199/12' -> 'copyofsnap1/test1/199/12' 2023-07-29T02:03:16.977 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/199/13' -> 'copyofsnap1/test1/199/13' 2023-07-29T02:03:16.977 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/199/14' -> 'copyofsnap1/test1/199/14' 2023-07-29T02:03:16.977 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/199/15' -> 'copyofsnap1/test1/199/15' 2023-07-29T02:03:16.977 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/199/16' -> 'copyofsnap1/test1/199/16' 2023-07-29T02:03:16.978 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/199/17' -> 'copyofsnap1/test1/199/17' 2023-07-29T02:03:16.978 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/199/18' -> 'copyofsnap1/test1/199/18' 2023-07-29T02:03:16.978 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/199/19' -> 'copyofsnap1/test1/199/19' 2023-07-29T02:03:16.978 INFO:tasks.workunit.client.0.smithi042.stdout:'.snap/test1/199/20' -> 'copyofsnap1/test1/199/20' 2023-07-29T02:03:16.978 INFO:tasks.workunit.client.0.smithi042.stdout:Take third snapshot .snap/test3 2023-07-29T02:03:17.002 INFO:tasks.workunit.client.0.smithi042.stdout:Delete the snapshots... 2023-07-29T02:03:17.247 INFO:tasks.workunit.client.0.smithi042.stdout:.//.snap/test1 2023-07-29T02:03:17.247 INFO:tasks.workunit.client.0.smithi042.stdout:.//.snap/test2 2023-07-29T02:03:17.247 INFO:tasks.workunit.client.0.smithi042.stdout:.//.snap/test3 2023-07-29T02:03:17.250 INFO:tasks.workunit.client.0.smithi042.stdout:./274/.snap/snap-subdir-test 2023-07-29T02:03:17.255 INFO:tasks.workunit.client.0.smithi042.stdout:./166/.snap/snap-subdir-test 2023-07-29T02:03:17.258 INFO:tasks.workunit.client.0.smithi042.stdout:./256/.snap/snap-subdir-test 2023-07-29T02:03:17.262 INFO:tasks.workunit.client.0.smithi042.stdout:./247/.snap/snap-subdir-test 2023-07-29T02:03:17.266 INFO:tasks.workunit.client.0.smithi042.stdout:./248/.snap/snap-subdir-test 2023-07-29T02:03:17.270 INFO:tasks.workunit.client.0.smithi042.stdout:./147/.snap/snap-subdir-test 2023-07-29T02:03:17.273 INFO:tasks.workunit.client.0.smithi042.stdout:./151/.snap/snap-subdir-test 2023-07-29T02:03:17.278 INFO:tasks.workunit.client.0.smithi042.stdout:./170/.snap/snap-subdir-test 2023-07-29T02:03:17.281 INFO:tasks.workunit.client.0.smithi042.stdout:./167/.snap/snap-subdir-test 2023-07-29T02:03:17.285 INFO:tasks.workunit.client.0.smithi042.stdout:./140/.snap/snap-subdir-test 2023-07-29T02:03:17.289 INFO:tasks.workunit.client.0.smithi042.stdout:./142/.snap/snap-subdir-test 2023-07-29T02:03:17.292 INFO:tasks.workunit.client.0.smithi042.stdout:./150/.snap/snap-subdir-test 2023-07-29T02:03:17.296 INFO:tasks.workunit.client.0.smithi042.stdout:./273/.snap/snap-subdir-test 2023-07-29T02:03:17.300 INFO:tasks.workunit.client.0.smithi042.stdout:./269/.snap/snap-subdir-test 2023-07-29T02:03:17.303 INFO:tasks.workunit.client.0.smithi042.stdout:./105/.snap/snap-subdir-test 2023-07-29T02:03:17.307 INFO:tasks.workunit.client.0.smithi042.stdout:./210/.snap/snap-subdir-test 2023-07-29T02:03:17.311 INFO:tasks.workunit.client.0.smithi042.stdout:./265/.snap/snap-subdir-test 2023-07-29T02:03:17.315 INFO:tasks.workunit.client.0.smithi042.stdout:./218/.snap/snap-subdir-test 2023-07-29T02:03:17.319 INFO:tasks.workunit.client.0.smithi042.stdout:./290/.snap/snap-subdir-test 2023-07-29T02:03:17.323 INFO:tasks.workunit.client.0.smithi042.stdout:./149/.snap/snap-subdir-test 2023-07-29T02:03:17.326 INFO:tasks.workunit.client.0.smithi042.stdout:./109/.snap/snap-subdir-test 2023-07-29T02:03:17.330 INFO:tasks.workunit.client.0.smithi042.stdout:./292/.snap/snap-subdir-test 2023-07-29T02:03:17.334 INFO:tasks.workunit.client.0.smithi042.stdout:./242/.snap/snap-subdir-test 2023-07-29T02:03:17.338 INFO:tasks.workunit.client.0.smithi042.stdout:./158/.snap/snap-subdir-test 2023-07-29T02:03:17.342 INFO:tasks.workunit.client.0.smithi042.stdout:./243/.snap/snap-subdir-test 2023-07-29T02:03:17.346 INFO:tasks.workunit.client.0.smithi042.stdout:./106/.snap/snap-subdir-test 2023-07-29T02:03:17.349 INFO:tasks.workunit.client.0.smithi042.stdout:./250/.snap/snap-subdir-test 2023-07-29T02:03:17.353 INFO:tasks.workunit.client.0.smithi042.stdout:./221/.snap/snap-subdir-test 2023-07-29T02:03:17.357 INFO:tasks.workunit.client.0.smithi042.stdout:./244/.snap/snap-subdir-test 2023-07-29T02:03:17.361 INFO:tasks.workunit.client.0.smithi042.stdout:./258/.snap/snap-subdir-test 2023-07-29T02:03:17.365 INFO:tasks.workunit.client.0.smithi042.stdout:./268/.snap/snap-subdir-test 2023-07-29T02:03:17.368 INFO:tasks.workunit.client.0.smithi042.stdout:./189/.snap/snap-subdir-test 2023-07-29T02:03:17.372 INFO:tasks.workunit.client.0.smithi042.stdout:./285/.snap/snap-subdir-test 2023-07-29T02:03:17.376 INFO:tasks.workunit.client.0.smithi042.stdout:./208/.snap/snap-subdir-test 2023-07-29T02:03:17.380 INFO:tasks.workunit.client.0.smithi042.stdout:./288/.snap/snap-subdir-test 2023-07-29T02:03:17.384 INFO:tasks.workunit.client.0.smithi042.stdout:./209/.snap/snap-subdir-test 2023-07-29T02:03:17.388 INFO:tasks.workunit.client.0.smithi042.stdout:./253/.snap/snap-subdir-test 2023-07-29T02:03:17.392 INFO:tasks.workunit.client.0.smithi042.stdout:./249/.snap/snap-subdir-test 2023-07-29T02:03:17.395 INFO:tasks.workunit.client.0.smithi042.stdout:./133/.snap/snap-subdir-test 2023-07-29T02:03:17.399 INFO:tasks.workunit.client.0.smithi042.stdout:./291/.snap/snap-subdir-test 2023-07-29T02:03:17.403 INFO:tasks.workunit.client.0.smithi042.stdout:./226/.snap/snap-subdir-test 2023-07-29T02:03:17.407 INFO:tasks.workunit.client.0.smithi042.stdout:./173/.snap/snap-subdir-test 2023-07-29T02:03:17.410 INFO:tasks.workunit.client.0.smithi042.stdout:./174/.snap/snap-subdir-test 2023-07-29T02:03:17.414 INFO:tasks.workunit.client.0.smithi042.stdout:./299/.snap/snap-subdir-test 2023-07-29T02:03:17.418 INFO:tasks.workunit.client.0.smithi042.stdout:./262/.snap/snap-subdir-test 2023-07-29T02:03:17.422 INFO:tasks.workunit.client.0.smithi042.stdout:./231/.snap/snap-subdir-test 2023-07-29T02:03:17.426 INFO:tasks.workunit.client.0.smithi042.stdout:./214/.snap/snap-subdir-test 2023-07-29T02:03:17.429 INFO:tasks.workunit.client.0.smithi042.stdout:./281/.snap/snap-subdir-test 2023-07-29T02:03:17.433 INFO:tasks.workunit.client.0.smithi042.stdout:./289/.snap/snap-subdir-test 2023-07-29T02:03:17.437 INFO:tasks.workunit.client.0.smithi042.stdout:./283/.snap/snap-subdir-test 2023-07-29T02:03:17.441 INFO:tasks.workunit.client.0.smithi042.stdout:./232/.snap/snap-subdir-test 2023-07-29T02:03:17.445 INFO:tasks.workunit.client.0.smithi042.stdout:./298/.snap/snap-subdir-test 2023-07-29T02:03:17.448 INFO:tasks.workunit.client.0.smithi042.stdout:./233/.snap/snap-subdir-test 2023-07-29T02:03:17.452 INFO:tasks.workunit.client.0.smithi042.stdout:./155/.snap/snap-subdir-test 2023-07-29T02:03:17.456 INFO:tasks.workunit.client.0.smithi042.stdout:./114/.snap/snap-subdir-test 2023-07-29T02:03:17.459 INFO:tasks.workunit.client.0.smithi042.stdout:./159/.snap/snap-subdir-test 2023-07-29T02:03:17.463 INFO:tasks.workunit.client.0.smithi042.stdout:./187/.snap/snap-subdir-test 2023-07-29T02:03:17.467 INFO:tasks.workunit.client.0.smithi042.stdout:./185/.snap/snap-subdir-test 2023-07-29T02:03:17.471 INFO:tasks.workunit.client.0.smithi042.stdout:./293/.snap/snap-subdir-test 2023-07-29T02:03:17.475 INFO:tasks.workunit.client.0.smithi042.stdout:./228/.snap/snap-subdir-test 2023-07-29T02:03:17.478 INFO:tasks.workunit.client.0.smithi042.stdout:./120/.snap/snap-subdir-test 2023-07-29T02:03:17.482 INFO:tasks.workunit.client.0.smithi042.stdout:./110/.snap/snap-subdir-test 2023-07-29T02:03:17.486 INFO:tasks.workunit.client.0.smithi042.stdout:./267/.snap/snap-subdir-test 2023-07-29T02:03:17.490 INFO:tasks.workunit.client.0.smithi042.stdout:./202/.snap/snap-subdir-test 2023-07-29T02:03:17.493 INFO:tasks.workunit.client.0.smithi042.stdout:./137/.snap/snap-subdir-test 2023-07-29T02:03:17.497 INFO:tasks.workunit.client.0.smithi042.stdout:./246/.snap/snap-subdir-test 2023-07-29T02:03:17.501 INFO:tasks.workunit.client.0.smithi042.stdout:./219/.snap/snap-subdir-test 2023-07-29T02:03:17.505 INFO:tasks.workunit.client.0.smithi042.stdout:./198/.snap/snap-subdir-test 2023-07-29T02:03:17.509 INFO:tasks.workunit.client.0.smithi042.stdout:./136/.snap/snap-subdir-test 2023-07-29T02:03:17.512 INFO:tasks.workunit.client.0.smithi042.stdout:./270/.snap/snap-subdir-test 2023-07-29T02:03:17.516 INFO:tasks.workunit.client.0.smithi042.stdout:./125/.snap/snap-subdir-test 2023-07-29T02:03:17.521 INFO:tasks.workunit.client.0.smithi042.stdout:./194/.snap/snap-subdir-test 2023-07-29T02:03:17.525 INFO:tasks.workunit.client.0.smithi042.stdout:./119/.snap/snap-subdir-test 2023-07-29T02:03:17.529 INFO:tasks.workunit.client.0.smithi042.stdout:./297/.snap/snap-subdir-test 2023-07-29T02:03:17.533 INFO:tasks.workunit.client.0.smithi042.stdout:./230/.snap/snap-subdir-test 2023-07-29T02:03:17.537 INFO:tasks.workunit.client.0.smithi042.stdout:./260/.snap/snap-subdir-test 2023-07-29T02:03:17.541 INFO:tasks.workunit.client.0.smithi042.stdout:./157/.snap/snap-subdir-test 2023-07-29T02:03:17.549 INFO:tasks.workunit.client.0.smithi042.stdout:./172/.snap/snap-subdir-test 2023-07-29T02:03:17.549 INFO:tasks.workunit.client.0.smithi042.stdout:./277/.snap/snap-subdir-test 2023-07-29T02:03:17.553 INFO:tasks.workunit.client.0.smithi042.stdout:./186/.snap/snap-subdir-test 2023-07-29T02:03:17.558 INFO:tasks.workunit.client.0.smithi042.stdout:./237/.snap/snap-subdir-test 2023-07-29T02:03:17.562 INFO:tasks.workunit.client.0.smithi042.stdout:./190/.snap/snap-subdir-test 2023-07-29T02:03:17.566 INFO:tasks.workunit.client.0.smithi042.stdout:./213/.snap/snap-subdir-test 2023-07-29T02:03:17.570 INFO:tasks.workunit.client.0.smithi042.stdout:./104/.snap/snap-subdir-test 2023-07-29T02:03:17.575 INFO:tasks.workunit.client.0.smithi042.stdout:./164/.snap/snap-subdir-test 2023-07-29T02:03:17.579 INFO:tasks.workunit.client.0.smithi042.stdout:./112/.snap/snap-subdir-test 2023-07-29T02:03:17.583 INFO:tasks.workunit.client.0.smithi042.stdout:./295/.snap/snap-subdir-test 2023-07-29T02:03:17.587 INFO:tasks.workunit.client.0.smithi042.stdout:./272/.snap/snap-subdir-test 2023-07-29T02:03:17.591 INFO:tasks.workunit.client.0.smithi042.stdout:./100/.snap/snap-subdir-test 2023-07-29T02:03:17.596 INFO:tasks.workunit.client.0.smithi042.stdout:./134/.snap/snap-subdir-test 2023-07-29T02:03:17.601 INFO:tasks.workunit.client.0.smithi042.stdout:./200/.snap/snap-subdir-test 2023-07-29T02:03:17.607 INFO:tasks.workunit.client.0.smithi042.stdout:./115/.snap/snap-subdir-test 2023-07-29T02:03:17.612 INFO:tasks.workunit.client.0.smithi042.stdout:./284/.snap/snap-subdir-test 2023-07-29T02:03:17.618 INFO:tasks.workunit.client.0.smithi042.stdout:./280/.snap/snap-subdir-test 2023-07-29T02:03:17.623 INFO:tasks.workunit.client.0.smithi042.stdout:./116/.snap/snap-subdir-test 2023-07-29T02:03:17.628 INFO:tasks.workunit.client.0.smithi042.stdout:./245/.snap/snap-subdir-test 2023-07-29T02:03:17.634 INFO:tasks.workunit.client.0.smithi042.stdout:./195/.snap/snap-subdir-test 2023-07-29T02:03:17.640 INFO:tasks.workunit.client.0.smithi042.stdout:./138/.snap/snap-subdir-test 2023-07-29T02:03:17.645 INFO:tasks.workunit.client.0.smithi042.stdout:./135/.snap/snap-subdir-test 2023-07-29T02:03:17.650 INFO:tasks.workunit.client.0.smithi042.stdout:./117/.snap/snap-subdir-test 2023-07-29T02:03:17.656 INFO:tasks.workunit.client.0.smithi042.stdout:./241/.snap/snap-subdir-test 2023-07-29T02:03:17.662 INFO:tasks.workunit.client.0.smithi042.stdout:./143/.snap/snap-subdir-test 2023-07-29T02:03:17.667 INFO:tasks.workunit.client.0.smithi042.stdout:./180/.snap/snap-subdir-test 2023-07-29T02:03:17.673 INFO:tasks.workunit.client.0.smithi042.stdout:./126/.snap/snap-subdir-test 2023-07-29T02:03:17.677 INFO:tasks.workunit.client.0.smithi042.stdout:./161/.snap/snap-subdir-test 2023-07-29T02:03:17.681 INFO:tasks.workunit.client.0.smithi042.stdout:./204/.snap/snap-subdir-test 2023-07-29T02:03:17.685 INFO:tasks.workunit.client.0.smithi042.stdout:./176/.snap/snap-subdir-test 2023-07-29T02:03:17.689 INFO:tasks.workunit.client.0.smithi042.stdout:./255/.snap/snap-subdir-test 2023-07-29T02:03:17.693 INFO:tasks.workunit.client.0.smithi042.stdout:./215/.snap/snap-subdir-test 2023-07-29T02:03:17.697 INFO:tasks.workunit.client.0.smithi042.stdout:./111/.snap/snap-subdir-test 2023-07-29T02:03:17.701 INFO:tasks.workunit.client.0.smithi042.stdout:./238/.snap/snap-subdir-test 2023-07-29T02:03:17.704 INFO:tasks.workunit.client.0.smithi042.stdout:./191/.snap/snap-subdir-test 2023-07-29T02:03:17.708 INFO:tasks.workunit.client.0.smithi042.stdout:./184/.snap/snap-subdir-test 2023-07-29T02:03:17.712 INFO:tasks.workunit.client.0.smithi042.stdout:./192/.snap/snap-subdir-test 2023-07-29T02:03:17.716 INFO:tasks.workunit.client.0.smithi042.stdout:./103/.snap/snap-subdir-test 2023-07-29T02:03:17.720 INFO:tasks.workunit.client.0.smithi042.stdout:./128/.snap/snap-subdir-test 2023-07-29T02:03:17.724 INFO:tasks.workunit.client.0.smithi042.stdout:./229/.snap/snap-subdir-test 2023-07-29T02:03:17.728 INFO:tasks.workunit.client.0.smithi042.stdout:./144/.snap/snap-subdir-test 2023-07-29T02:03:17.732 INFO:tasks.workunit.client.0.smithi042.stdout:./146/.snap/snap-subdir-test 2023-07-29T02:03:17.735 INFO:tasks.workunit.client.0.smithi042.stdout:./227/.snap/snap-subdir-test 2023-07-29T02:03:17.739 INFO:tasks.workunit.client.0.smithi042.stdout:./278/.snap/snap-subdir-test 2023-07-29T02:03:17.743 INFO:tasks.workunit.client.0.smithi042.stdout:./141/.snap/snap-subdir-test 2023-07-29T02:03:17.747 INFO:tasks.workunit.client.0.smithi042.stdout:./234/.snap/snap-subdir-test 2023-07-29T02:03:17.751 INFO:tasks.workunit.client.0.smithi042.stdout:./225/.snap/snap-subdir-test 2023-07-29T02:03:17.755 INFO:tasks.workunit.client.0.smithi042.stdout:./182/.snap/snap-subdir-test 2023-07-29T02:03:17.760 INFO:tasks.workunit.client.0.smithi042.stdout:./107/.snap/snap-subdir-test 2023-07-29T02:03:17.766 INFO:tasks.workunit.client.0.smithi042.stdout:./178/.snap/snap-subdir-test 2023-07-29T02:03:17.771 INFO:tasks.workunit.client.0.smithi042.stdout:./266/.snap/snap-subdir-test 2023-07-29T02:03:17.777 INFO:tasks.workunit.client.0.smithi042.stdout:./240/.snap/snap-subdir-test 2023-07-29T02:03:17.782 INFO:tasks.workunit.client.0.smithi042.stdout:./156/.snap/snap-subdir-test 2023-07-29T02:03:17.787 INFO:tasks.workunit.client.0.smithi042.stdout:./131/.snap/snap-subdir-test 2023-07-29T02:03:17.793 INFO:tasks.workunit.client.0.smithi042.stdout:./123/.snap/snap-subdir-test 2023-07-29T02:03:17.798 INFO:tasks.workunit.client.0.smithi042.stdout:./160/.snap/snap-subdir-test 2023-07-29T02:03:17.804 INFO:tasks.workunit.client.0.smithi042.stdout:./165/.snap/snap-subdir-test 2023-07-29T02:03:17.809 INFO:tasks.workunit.client.0.smithi042.stdout:./101/.snap/snap-subdir-test 2023-07-29T02:03:17.814 INFO:tasks.workunit.client.0.smithi042.stdout:./148/.snap/snap-subdir-test 2023-07-29T02:03:17.820 INFO:tasks.workunit.client.0.smithi042.stdout:./168/.snap/snap-subdir-test 2023-07-29T02:03:17.825 INFO:tasks.workunit.client.0.smithi042.stdout:./179/.snap/snap-subdir-test 2023-07-29T02:03:17.831 INFO:tasks.workunit.client.0.smithi042.stdout:./257/.snap/snap-subdir-test 2023-07-29T02:03:17.837 INFO:tasks.workunit.client.0.smithi042.stdout:./252/.snap/snap-subdir-test 2023-07-29T02:03:17.842 INFO:tasks.workunit.client.0.smithi042.stdout:./132/.snap/snap-subdir-test 2023-07-29T02:03:17.848 INFO:tasks.workunit.client.0.smithi042.stdout:./236/.snap/snap-subdir-test 2023-07-29T02:03:17.853 INFO:tasks.workunit.client.0.smithi042.stdout:./211/.snap/snap-subdir-test 2023-07-29T02:03:17.859 INFO:tasks.workunit.client.0.smithi042.stdout:./199/.snap/snap-subdir-test 2023-07-29T02:03:17.864 INFO:tasks.workunit.client.0.smithi042.stdout:./205/.snap/snap-subdir-test 2023-07-29T02:03:17.870 INFO:tasks.workunit.client.0.smithi042.stdout:./163/.snap/snap-subdir-test 2023-07-29T02:03:17.875 INFO:tasks.workunit.client.0.smithi042.stdout:./261/.snap/snap-subdir-test 2023-07-29T02:03:17.881 INFO:tasks.workunit.client.0.smithi042.stdout:./201/.snap/snap-subdir-test 2023-07-29T02:03:17.886 INFO:tasks.workunit.client.0.smithi042.stdout:./282/.snap/snap-subdir-test 2023-07-29T02:03:17.892 INFO:tasks.workunit.client.0.smithi042.stdout:./296/.snap/snap-subdir-test 2023-07-29T02:03:17.896 INFO:tasks.workunit.client.0.smithi042.stdout:./217/.snap/snap-subdir-test 2023-07-29T02:03:17.900 INFO:tasks.workunit.client.0.smithi042.stdout:./153/.snap/snap-subdir-test 2023-07-29T02:03:17.904 INFO:tasks.workunit.client.0.smithi042.stdout:./206/.snap/snap-subdir-test 2023-07-29T02:03:17.907 INFO:tasks.workunit.client.0.smithi042.stdout:./122/.snap/snap-subdir-test 2023-07-29T02:03:17.911 INFO:tasks.workunit.client.0.smithi042.stdout:./162/.snap/snap-subdir-test 2023-07-29T02:03:17.915 INFO:tasks.workunit.client.0.smithi042.stdout:./197/.snap/snap-subdir-test 2023-07-29T02:03:17.919 INFO:tasks.workunit.client.0.smithi042.stdout:./216/.snap/snap-subdir-test 2023-07-29T02:03:18.185 INFO:tasks.workunit.client.0.smithi042.stdout:./254/.snap/snap-subdir-test 2023-07-29T02:03:18.189 INFO:tasks.workunit.client.0.smithi042.stdout:./113/.snap/snap-subdir-test 2023-07-29T02:03:18.193 INFO:tasks.workunit.client.0.smithi042.stdout:./152/.snap/snap-subdir-test 2023-07-29T02:03:18.197 INFO:tasks.workunit.client.0.smithi042.stdout:./121/.snap/snap-subdir-test 2023-07-29T02:03:18.200 INFO:tasks.workunit.client.0.smithi042.stdout:./118/.snap/snap-subdir-test 2023-07-29T02:03:18.204 INFO:tasks.workunit.client.0.smithi042.stdout:./196/.snap/snap-subdir-test 2023-07-29T02:03:18.208 INFO:tasks.workunit.client.0.smithi042.stdout:./124/.snap/snap-subdir-test 2023-07-29T02:03:18.212 INFO:tasks.workunit.client.0.smithi042.stdout:./239/.snap/snap-subdir-test 2023-07-29T02:03:18.216 INFO:tasks.workunit.client.0.smithi042.stdout:./188/.snap/snap-subdir-test 2023-07-29T02:03:18.220 INFO:tasks.workunit.client.0.smithi042.stdout:./287/.snap/snap-subdir-test 2023-07-29T02:03:18.224 INFO:tasks.workunit.client.0.smithi042.stdout:./275/.snap/snap-subdir-test 2023-07-29T02:03:18.228 INFO:tasks.workunit.client.0.smithi042.stdout:./259/.snap/snap-subdir-test 2023-07-29T02:03:18.231 INFO:tasks.workunit.client.0.smithi042.stdout:./224/.snap/snap-subdir-test 2023-07-29T02:03:18.235 INFO:tasks.workunit.client.0.smithi042.stdout:./264/.snap/snap-subdir-test 2023-07-29T02:03:18.239 INFO:tasks.workunit.client.0.smithi042.stdout:./145/.snap/snap-subdir-test 2023-07-29T02:03:18.243 INFO:tasks.workunit.client.0.smithi042.stdout:./279/.snap/snap-subdir-test 2023-07-29T02:03:18.247 INFO:tasks.workunit.client.0.smithi042.stdout:./263/.snap/snap-subdir-test 2023-07-29T02:03:18.251 INFO:tasks.workunit.client.0.smithi042.stdout:./130/.snap/snap-subdir-test 2023-07-29T02:03:18.255 INFO:tasks.workunit.client.0.smithi042.stdout:./193/.snap/snap-subdir-test 2023-07-29T02:03:18.259 INFO:tasks.workunit.client.0.smithi042.stdout:./223/.snap/snap-subdir-test 2023-07-29T02:03:18.263 INFO:tasks.workunit.client.0.smithi042.stdout:./207/.snap/snap-subdir-test 2023-07-29T02:03:18.267 INFO:tasks.workunit.client.0.smithi042.stdout:./276/.snap/snap-subdir-test 2023-07-29T02:03:18.271 INFO:tasks.workunit.client.0.smithi042.stdout:./271/.snap/snap-subdir-test 2023-07-29T02:03:18.274 INFO:tasks.workunit.client.0.smithi042.stdout:./251/.snap/snap-subdir-test 2023-07-29T02:03:18.278 INFO:tasks.workunit.client.0.smithi042.stdout:./175/.snap/snap-subdir-test 2023-07-29T02:03:18.282 INFO:tasks.workunit.client.0.smithi042.stdout:./222/.snap/snap-subdir-test 2023-07-29T02:03:18.286 INFO:tasks.workunit.client.0.smithi042.stdout:./220/.snap/snap-subdir-test 2023-07-29T02:03:18.290 INFO:tasks.workunit.client.0.smithi042.stdout:./203/.snap/snap-subdir-test 2023-07-29T02:03:18.294 INFO:tasks.workunit.client.0.smithi042.stdout:./181/.snap/snap-subdir-test 2023-07-29T02:03:18.297 INFO:tasks.workunit.client.0.smithi042.stdout:./286/.snap/snap-subdir-test 2023-07-29T02:03:18.301 INFO:tasks.workunit.client.0.smithi042.stdout:./127/.snap/snap-subdir-test 2023-07-29T02:03:18.305 INFO:tasks.workunit.client.0.smithi042.stdout:./108/.snap/snap-subdir-test 2023-07-29T02:03:18.309 INFO:tasks.workunit.client.0.smithi042.stdout:./183/.snap/snap-subdir-test 2023-07-29T02:03:18.313 INFO:tasks.workunit.client.0.smithi042.stdout:./294/.snap/snap-subdir-test 2023-07-29T02:03:18.317 INFO:tasks.workunit.client.0.smithi042.stdout:./235/.snap/snap-subdir-test 2023-07-29T02:03:18.321 INFO:tasks.workunit.client.0.smithi042.stdout:./177/.snap/snap-subdir-test 2023-07-29T02:03:18.325 INFO:tasks.workunit.client.0.smithi042.stdout:./169/.snap/snap-subdir-test 2023-07-29T02:03:18.329 INFO:tasks.workunit.client.0.smithi042.stdout:./212/.snap/snap-subdir-test 2023-07-29T02:03:18.333 INFO:tasks.workunit.client.0.smithi042.stdout:./154/.snap/snap-subdir-test 2023-07-29T02:03:18.337 INFO:tasks.workunit.client.0.smithi042.stdout:./171/.snap/snap-subdir-test 2023-07-29T02:03:18.342 INFO:tasks.workunit.client.0.smithi042.stdout:./139/.snap/snap-subdir-test 2023-07-29T02:03:18.344 INFO:tasks.workunit.client.0.smithi042.stdout:./102/.snap/snap-subdir-test 2023-07-29T02:03:18.348 INFO:tasks.workunit.client.0.smithi042.stdout:./129/.snap/snap-subdir-test 2023-07-29T02:03:19.561 INFO:tasks.workunit.client.0.smithi042.stdout:Delete all the files and directories ... 2023-07-29T02:03:19.963 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/19' 2023-07-29T02:03:19.963 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/15' 2023-07-29T02:03:19.963 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/31' 2023-07-29T02:03:19.963 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/36' 2023-07-29T02:03:19.963 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/20' 2023-07-29T02:03:19.964 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/12' 2023-07-29T02:03:19.964 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/39' 2023-07-29T02:03:19.964 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/10' 2023-07-29T02:03:19.964 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/34' 2023-07-29T02:03:19.964 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/38' 2023-07-29T02:03:19.964 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/11' 2023-07-29T02:03:19.964 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/16' 2023-07-29T02:03:19.965 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/32' 2023-07-29T02:03:19.965 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/30' 2023-07-29T02:03:19.965 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/14' 2023-07-29T02:03:19.965 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/18' 2023-07-29T02:03:19.965 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/13' 2023-07-29T02:03:19.965 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/33' 2023-07-29T02:03:19.965 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/17' 2023-07-29T02:03:19.965 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/35' 2023-07-29T02:03:19.966 INFO:tasks.workunit.client.0.smithi042.stdout:removed './100/37' 2023-07-29T02:03:19.966 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './100' 2023-07-29T02:03:19.966 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/19' 2023-07-29T02:03:19.966 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/15' 2023-07-29T02:03:19.966 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/31' 2023-07-29T02:03:19.966 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/36' 2023-07-29T02:03:19.966 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/20' 2023-07-29T02:03:19.966 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/12' 2023-07-29T02:03:19.967 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/39' 2023-07-29T02:03:19.967 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/10' 2023-07-29T02:03:19.967 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/34' 2023-07-29T02:03:19.967 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/38' 2023-07-29T02:03:19.967 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/11' 2023-07-29T02:03:19.967 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/16' 2023-07-29T02:03:19.967 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/32' 2023-07-29T02:03:19.967 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/30' 2023-07-29T02:03:19.968 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/14' 2023-07-29T02:03:19.968 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/18' 2023-07-29T02:03:19.968 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/13' 2023-07-29T02:03:19.968 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/33' 2023-07-29T02:03:19.968 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/17' 2023-07-29T02:03:19.968 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/35' 2023-07-29T02:03:19.968 INFO:tasks.workunit.client.0.smithi042.stdout:removed './101/37' 2023-07-29T02:03:19.969 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './101' 2023-07-29T02:03:19.969 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/19' 2023-07-29T02:03:19.969 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/15' 2023-07-29T02:03:19.969 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/31' 2023-07-29T02:03:19.969 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/36' 2023-07-29T02:03:19.969 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/20' 2023-07-29T02:03:19.969 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/12' 2023-07-29T02:03:19.969 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/39' 2023-07-29T02:03:19.970 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/10' 2023-07-29T02:03:19.970 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/34' 2023-07-29T02:03:19.970 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/38' 2023-07-29T02:03:19.970 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/11' 2023-07-29T02:03:19.970 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/16' 2023-07-29T02:03:19.970 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/32' 2023-07-29T02:03:19.970 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/30' 2023-07-29T02:03:19.970 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/14' 2023-07-29T02:03:19.971 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/18' 2023-07-29T02:03:19.971 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/13' 2023-07-29T02:03:19.971 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/33' 2023-07-29T02:03:19.971 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/17' 2023-07-29T02:03:19.971 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/35' 2023-07-29T02:03:19.971 INFO:tasks.workunit.client.0.smithi042.stdout:removed './102/37' 2023-07-29T02:03:19.971 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './102' 2023-07-29T02:03:19.971 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/19' 2023-07-29T02:03:19.972 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/15' 2023-07-29T02:03:19.972 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/31' 2023-07-29T02:03:19.972 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/36' 2023-07-29T02:03:19.972 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/20' 2023-07-29T02:03:19.972 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/12' 2023-07-29T02:03:19.972 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/39' 2023-07-29T02:03:19.972 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/10' 2023-07-29T02:03:19.973 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/34' 2023-07-29T02:03:19.973 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/38' 2023-07-29T02:03:19.973 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/11' 2023-07-29T02:03:19.973 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/16' 2023-07-29T02:03:19.973 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/32' 2023-07-29T02:03:19.973 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/30' 2023-07-29T02:03:19.973 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/14' 2023-07-29T02:03:19.973 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/18' 2023-07-29T02:03:19.974 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/13' 2023-07-29T02:03:19.974 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/33' 2023-07-29T02:03:19.974 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/17' 2023-07-29T02:03:19.974 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/35' 2023-07-29T02:03:19.974 INFO:tasks.workunit.client.0.smithi042.stdout:removed './103/37' 2023-07-29T02:03:19.974 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './103' 2023-07-29T02:03:19.974 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/19' 2023-07-29T02:03:19.974 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/15' 2023-07-29T02:03:19.975 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/31' 2023-07-29T02:03:19.975 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/36' 2023-07-29T02:03:19.975 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/20' 2023-07-29T02:03:19.975 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/12' 2023-07-29T02:03:19.975 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/39' 2023-07-29T02:03:19.975 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/10' 2023-07-29T02:03:19.975 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/34' 2023-07-29T02:03:19.975 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/38' 2023-07-29T02:03:19.976 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/11' 2023-07-29T02:03:19.976 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/16' 2023-07-29T02:03:19.976 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/32' 2023-07-29T02:03:19.976 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/30' 2023-07-29T02:03:19.976 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/14' 2023-07-29T02:03:19.977 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/18' 2023-07-29T02:03:19.977 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/13' 2023-07-29T02:03:19.977 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/33' 2023-07-29T02:03:19.977 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/17' 2023-07-29T02:03:19.977 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/35' 2023-07-29T02:03:19.977 INFO:tasks.workunit.client.0.smithi042.stdout:removed './104/37' 2023-07-29T02:03:19.978 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './104' 2023-07-29T02:03:19.978 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/19' 2023-07-29T02:03:19.978 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/15' 2023-07-29T02:03:19.978 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/31' 2023-07-29T02:03:19.979 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/36' 2023-07-29T02:03:19.979 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/20' 2023-07-29T02:03:19.979 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/12' 2023-07-29T02:03:19.979 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/39' 2023-07-29T02:03:19.980 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/10' 2023-07-29T02:03:19.980 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/34' 2023-07-29T02:03:19.980 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/38' 2023-07-29T02:03:19.980 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/11' 2023-07-29T02:03:19.981 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/16' 2023-07-29T02:03:19.981 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/32' 2023-07-29T02:03:19.981 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/30' 2023-07-29T02:03:19.981 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/14' 2023-07-29T02:03:19.981 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/18' 2023-07-29T02:03:19.981 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/13' 2023-07-29T02:03:19.982 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/33' 2023-07-29T02:03:19.982 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/17' 2023-07-29T02:03:19.982 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/35' 2023-07-29T02:03:19.982 INFO:tasks.workunit.client.0.smithi042.stdout:removed './105/37' 2023-07-29T02:03:19.982 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './105' 2023-07-29T02:03:19.982 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/19' 2023-07-29T02:03:19.982 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/15' 2023-07-29T02:03:19.982 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/31' 2023-07-29T02:03:19.983 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/36' 2023-07-29T02:03:19.983 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/20' 2023-07-29T02:03:19.983 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/12' 2023-07-29T02:03:19.983 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/39' 2023-07-29T02:03:19.983 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/10' 2023-07-29T02:03:19.983 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/34' 2023-07-29T02:03:19.984 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/38' 2023-07-29T02:03:19.984 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/11' 2023-07-29T02:03:19.984 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/16' 2023-07-29T02:03:19.984 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/32' 2023-07-29T02:03:19.984 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/30' 2023-07-29T02:03:19.984 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/14' 2023-07-29T02:03:19.984 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/18' 2023-07-29T02:03:19.984 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/13' 2023-07-29T02:03:19.985 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/33' 2023-07-29T02:03:19.985 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/17' 2023-07-29T02:03:19.985 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/35' 2023-07-29T02:03:19.985 INFO:tasks.workunit.client.0.smithi042.stdout:removed './106/37' 2023-07-29T02:03:19.985 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './106' 2023-07-29T02:03:19.985 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/19' 2023-07-29T02:03:19.985 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/15' 2023-07-29T02:03:19.986 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/31' 2023-07-29T02:03:19.986 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/36' 2023-07-29T02:03:19.986 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/20' 2023-07-29T02:03:19.986 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/12' 2023-07-29T02:03:19.986 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/39' 2023-07-29T02:03:19.986 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/10' 2023-07-29T02:03:19.986 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/34' 2023-07-29T02:03:19.986 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/38' 2023-07-29T02:03:19.987 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/11' 2023-07-29T02:03:19.987 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/16' 2023-07-29T02:03:19.987 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/32' 2023-07-29T02:03:19.987 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/30' 2023-07-29T02:03:19.987 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/14' 2023-07-29T02:03:19.987 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/18' 2023-07-29T02:03:19.987 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/13' 2023-07-29T02:03:19.987 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/33' 2023-07-29T02:03:19.988 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/17' 2023-07-29T02:03:19.988 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/35' 2023-07-29T02:03:19.988 INFO:tasks.workunit.client.0.smithi042.stdout:removed './107/37' 2023-07-29T02:03:19.988 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './107' 2023-07-29T02:03:19.988 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/19' 2023-07-29T02:03:19.988 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/15' 2023-07-29T02:03:19.988 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/31' 2023-07-29T02:03:19.988 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/36' 2023-07-29T02:03:19.989 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/20' 2023-07-29T02:03:19.989 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/12' 2023-07-29T02:03:19.989 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/39' 2023-07-29T02:03:19.989 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/10' 2023-07-29T02:03:19.989 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/34' 2023-07-29T02:03:19.989 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/38' 2023-07-29T02:03:19.989 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/11' 2023-07-29T02:03:19.989 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/16' 2023-07-29T02:03:19.990 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/32' 2023-07-29T02:03:19.990 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/30' 2023-07-29T02:03:19.990 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/14' 2023-07-29T02:03:19.990 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/18' 2023-07-29T02:03:19.990 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/13' 2023-07-29T02:03:19.990 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/33' 2023-07-29T02:03:19.990 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/17' 2023-07-29T02:03:19.990 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/35' 2023-07-29T02:03:19.991 INFO:tasks.workunit.client.0.smithi042.stdout:removed './108/37' 2023-07-29T02:03:19.991 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './108' 2023-07-29T02:03:19.991 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/19' 2023-07-29T02:03:19.991 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/15' 2023-07-29T02:03:19.991 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/31' 2023-07-29T02:03:19.991 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/36' 2023-07-29T02:03:19.991 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/20' 2023-07-29T02:03:19.992 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/12' 2023-07-29T02:03:19.992 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/39' 2023-07-29T02:03:19.992 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/10' 2023-07-29T02:03:19.992 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/34' 2023-07-29T02:03:19.992 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/38' 2023-07-29T02:03:19.992 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/11' 2023-07-29T02:03:19.992 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/16' 2023-07-29T02:03:19.992 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/32' 2023-07-29T02:03:19.993 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/30' 2023-07-29T02:03:20.362 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/14' 2023-07-29T02:03:20.362 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/18' 2023-07-29T02:03:20.362 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/13' 2023-07-29T02:03:20.363 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/33' 2023-07-29T02:03:20.363 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/17' 2023-07-29T02:03:20.363 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/35' 2023-07-29T02:03:20.363 INFO:tasks.workunit.client.0.smithi042.stdout:removed './109/37' 2023-07-29T02:03:20.364 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './109' 2023-07-29T02:03:20.364 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/19' 2023-07-29T02:03:20.364 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/15' 2023-07-29T02:03:20.364 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/31' 2023-07-29T02:03:20.364 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/36' 2023-07-29T02:03:20.364 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/20' 2023-07-29T02:03:20.365 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/12' 2023-07-29T02:03:20.365 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/39' 2023-07-29T02:03:20.365 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/10' 2023-07-29T02:03:20.365 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/34' 2023-07-29T02:03:20.365 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/38' 2023-07-29T02:03:20.365 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/11' 2023-07-29T02:03:20.365 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/16' 2023-07-29T02:03:20.365 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/32' 2023-07-29T02:03:20.366 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/30' 2023-07-29T02:03:20.366 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/14' 2023-07-29T02:03:20.366 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/18' 2023-07-29T02:03:20.366 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/13' 2023-07-29T02:03:20.367 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/33' 2023-07-29T02:03:20.367 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/17' 2023-07-29T02:03:20.367 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/35' 2023-07-29T02:03:20.367 INFO:tasks.workunit.client.0.smithi042.stdout:removed './110/37' 2023-07-29T02:03:20.368 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './110' 2023-07-29T02:03:20.368 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/19' 2023-07-29T02:03:20.368 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/15' 2023-07-29T02:03:20.368 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/31' 2023-07-29T02:03:20.368 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/36' 2023-07-29T02:03:20.368 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/20' 2023-07-29T02:03:20.368 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/12' 2023-07-29T02:03:20.369 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/39' 2023-07-29T02:03:20.369 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/10' 2023-07-29T02:03:20.369 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/34' 2023-07-29T02:03:20.369 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/38' 2023-07-29T02:03:20.369 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/11' 2023-07-29T02:03:20.369 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/16' 2023-07-29T02:03:20.369 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/32' 2023-07-29T02:03:20.370 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/30' 2023-07-29T02:03:20.370 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/14' 2023-07-29T02:03:20.370 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/18' 2023-07-29T02:03:20.370 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/13' 2023-07-29T02:03:20.370 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/33' 2023-07-29T02:03:20.370 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/17' 2023-07-29T02:03:20.370 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/35' 2023-07-29T02:03:20.370 INFO:tasks.workunit.client.0.smithi042.stdout:removed './111/37' 2023-07-29T02:03:20.371 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './111' 2023-07-29T02:03:20.371 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/19' 2023-07-29T02:03:20.371 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/15' 2023-07-29T02:03:20.371 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/31' 2023-07-29T02:03:20.371 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/36' 2023-07-29T02:03:20.371 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/20' 2023-07-29T02:03:20.371 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/12' 2023-07-29T02:03:20.372 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/39' 2023-07-29T02:03:20.372 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/10' 2023-07-29T02:03:20.372 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/34' 2023-07-29T02:03:20.372 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/38' 2023-07-29T02:03:20.373 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/11' 2023-07-29T02:03:20.373 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/16' 2023-07-29T02:03:20.373 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/32' 2023-07-29T02:03:20.373 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/30' 2023-07-29T02:03:20.374 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/14' 2023-07-29T02:03:20.374 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/18' 2023-07-29T02:03:20.374 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/13' 2023-07-29T02:03:20.374 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/33' 2023-07-29T02:03:20.374 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/17' 2023-07-29T02:03:20.375 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/35' 2023-07-29T02:03:20.375 INFO:tasks.workunit.client.0.smithi042.stdout:removed './112/37' 2023-07-29T02:03:20.375 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './112' 2023-07-29T02:03:20.375 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/19' 2023-07-29T02:03:20.376 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/15' 2023-07-29T02:03:20.376 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/31' 2023-07-29T02:03:20.376 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/36' 2023-07-29T02:03:20.376 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/20' 2023-07-29T02:03:20.377 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/12' 2023-07-29T02:03:20.377 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/39' 2023-07-29T02:03:20.377 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/10' 2023-07-29T02:03:20.377 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/34' 2023-07-29T02:03:20.378 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/38' 2023-07-29T02:03:20.378 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/11' 2023-07-29T02:03:20.378 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/16' 2023-07-29T02:03:20.378 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/32' 2023-07-29T02:03:20.378 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/30' 2023-07-29T02:03:20.379 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/14' 2023-07-29T02:03:20.379 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/18' 2023-07-29T02:03:20.379 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/13' 2023-07-29T02:03:20.379 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/33' 2023-07-29T02:03:20.380 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/17' 2023-07-29T02:03:20.380 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/35' 2023-07-29T02:03:20.380 INFO:tasks.workunit.client.0.smithi042.stdout:removed './113/37' 2023-07-29T02:03:20.381 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './113' 2023-07-29T02:03:20.381 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/19' 2023-07-29T02:03:20.381 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/15' 2023-07-29T02:03:20.381 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/31' 2023-07-29T02:03:20.381 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/36' 2023-07-29T02:03:20.382 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/20' 2023-07-29T02:03:20.382 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/12' 2023-07-29T02:03:20.382 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/39' 2023-07-29T02:03:20.382 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/10' 2023-07-29T02:03:20.382 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/34' 2023-07-29T02:03:20.382 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/38' 2023-07-29T02:03:20.382 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/11' 2023-07-29T02:03:20.382 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/16' 2023-07-29T02:03:20.383 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/32' 2023-07-29T02:03:20.383 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/30' 2023-07-29T02:03:20.383 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/14' 2023-07-29T02:03:20.383 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/18' 2023-07-29T02:03:20.383 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/13' 2023-07-29T02:03:20.383 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/33' 2023-07-29T02:03:20.383 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/17' 2023-07-29T02:03:20.384 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/35' 2023-07-29T02:03:20.384 INFO:tasks.workunit.client.0.smithi042.stdout:removed './114/37' 2023-07-29T02:03:20.384 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './114' 2023-07-29T02:03:20.384 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/19' 2023-07-29T02:03:20.384 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/15' 2023-07-29T02:03:20.384 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/31' 2023-07-29T02:03:20.384 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/36' 2023-07-29T02:03:20.384 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/20' 2023-07-29T02:03:20.385 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/12' 2023-07-29T02:03:20.385 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/39' 2023-07-29T02:03:20.385 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/10' 2023-07-29T02:03:20.385 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/34' 2023-07-29T02:03:20.385 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/38' 2023-07-29T02:03:20.385 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/11' 2023-07-29T02:03:20.385 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/16' 2023-07-29T02:03:20.385 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/32' 2023-07-29T02:03:20.386 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/30' 2023-07-29T02:03:20.386 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/14' 2023-07-29T02:03:20.386 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/18' 2023-07-29T02:03:20.386 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/13' 2023-07-29T02:03:20.386 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/33' 2023-07-29T02:03:20.386 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/17' 2023-07-29T02:03:20.387 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/35' 2023-07-29T02:03:20.387 INFO:tasks.workunit.client.0.smithi042.stdout:removed './115/37' 2023-07-29T02:03:20.387 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './115' 2023-07-29T02:03:20.387 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/19' 2023-07-29T02:03:20.388 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/15' 2023-07-29T02:03:20.388 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/31' 2023-07-29T02:03:20.388 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/36' 2023-07-29T02:03:20.388 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/20' 2023-07-29T02:03:20.389 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/12' 2023-07-29T02:03:20.389 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/39' 2023-07-29T02:03:20.389 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/10' 2023-07-29T02:03:20.389 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/34' 2023-07-29T02:03:20.389 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/38' 2023-07-29T02:03:20.390 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/11' 2023-07-29T02:03:20.390 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/16' 2023-07-29T02:03:20.390 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/32' 2023-07-29T02:03:20.390 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/30' 2023-07-29T02:03:20.391 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/14' 2023-07-29T02:03:20.391 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/18' 2023-07-29T02:03:20.391 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/13' 2023-07-29T02:03:20.391 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/33' 2023-07-29T02:03:20.391 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/17' 2023-07-29T02:03:20.392 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/35' 2023-07-29T02:03:20.392 INFO:tasks.workunit.client.0.smithi042.stdout:removed './116/37' 2023-07-29T02:03:20.392 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './116' 2023-07-29T02:03:20.392 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/19' 2023-07-29T02:03:20.393 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/15' 2023-07-29T02:03:20.393 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/31' 2023-07-29T02:03:20.393 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/36' 2023-07-29T02:03:20.393 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/20' 2023-07-29T02:03:20.394 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/12' 2023-07-29T02:03:20.394 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/39' 2023-07-29T02:03:20.394 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/10' 2023-07-29T02:03:20.394 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/34' 2023-07-29T02:03:20.395 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/38' 2023-07-29T02:03:20.395 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/11' 2023-07-29T02:03:20.395 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/16' 2023-07-29T02:03:20.395 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/32' 2023-07-29T02:03:20.396 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/30' 2023-07-29T02:03:20.396 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/14' 2023-07-29T02:03:20.396 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/18' 2023-07-29T02:03:20.396 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/13' 2023-07-29T02:03:20.397 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/33' 2023-07-29T02:03:20.397 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/17' 2023-07-29T02:03:20.397 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/35' 2023-07-29T02:03:20.397 INFO:tasks.workunit.client.0.smithi042.stdout:removed './117/37' 2023-07-29T02:03:20.398 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './117' 2023-07-29T02:03:20.398 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/19' 2023-07-29T02:03:20.398 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/15' 2023-07-29T02:03:20.398 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/31' 2023-07-29T02:03:20.399 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/36' 2023-07-29T02:03:20.399 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/20' 2023-07-29T02:03:20.399 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/12' 2023-07-29T02:03:20.399 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/39' 2023-07-29T02:03:20.400 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/10' 2023-07-29T02:03:20.400 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/34' 2023-07-29T02:03:20.400 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/38' 2023-07-29T02:03:20.400 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/11' 2023-07-29T02:03:20.401 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/16' 2023-07-29T02:03:20.401 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/32' 2023-07-29T02:03:20.401 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/30' 2023-07-29T02:03:20.401 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/14' 2023-07-29T02:03:20.402 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/18' 2023-07-29T02:03:20.402 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/13' 2023-07-29T02:03:20.402 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/33' 2023-07-29T02:03:20.402 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/17' 2023-07-29T02:03:20.403 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/35' 2023-07-29T02:03:20.403 INFO:tasks.workunit.client.0.smithi042.stdout:removed './118/37' 2023-07-29T02:03:20.403 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './118' 2023-07-29T02:03:20.403 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/19' 2023-07-29T02:03:20.404 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/15' 2023-07-29T02:03:20.404 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/31' 2023-07-29T02:03:20.404 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/36' 2023-07-29T02:03:20.404 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/20' 2023-07-29T02:03:20.405 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/12' 2023-07-29T02:03:21.490 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/39' 2023-07-29T02:03:21.490 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/10' 2023-07-29T02:03:21.490 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/34' 2023-07-29T02:03:21.490 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/38' 2023-07-29T02:03:21.490 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/11' 2023-07-29T02:03:21.491 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/16' 2023-07-29T02:03:21.491 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/32' 2023-07-29T02:03:21.491 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/30' 2023-07-29T02:03:21.491 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/14' 2023-07-29T02:03:21.491 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/18' 2023-07-29T02:03:21.491 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/13' 2023-07-29T02:03:21.491 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/33' 2023-07-29T02:03:21.492 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/17' 2023-07-29T02:03:21.492 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/35' 2023-07-29T02:03:21.492 INFO:tasks.workunit.client.0.smithi042.stdout:removed './119/37' 2023-07-29T02:03:21.492 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './119' 2023-07-29T02:03:21.492 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/19' 2023-07-29T02:03:21.492 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/15' 2023-07-29T02:03:21.492 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/31' 2023-07-29T02:03:21.492 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/36' 2023-07-29T02:03:21.493 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/20' 2023-07-29T02:03:21.493 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/12' 2023-07-29T02:03:21.493 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/39' 2023-07-29T02:03:21.493 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/10' 2023-07-29T02:03:21.493 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/34' 2023-07-29T02:03:21.493 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/38' 2023-07-29T02:03:21.493 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/11' 2023-07-29T02:03:21.493 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/16' 2023-07-29T02:03:21.494 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/32' 2023-07-29T02:03:21.494 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/30' 2023-07-29T02:03:21.494 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/14' 2023-07-29T02:03:21.494 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/18' 2023-07-29T02:03:21.494 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/13' 2023-07-29T02:03:21.494 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/33' 2023-07-29T02:03:21.494 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/17' 2023-07-29T02:03:21.495 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/35' 2023-07-29T02:03:21.495 INFO:tasks.workunit.client.0.smithi042.stdout:removed './120/37' 2023-07-29T02:03:21.495 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './120' 2023-07-29T02:03:21.495 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/19' 2023-07-29T02:03:21.495 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/15' 2023-07-29T02:03:21.495 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/31' 2023-07-29T02:03:21.495 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/36' 2023-07-29T02:03:21.495 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/20' 2023-07-29T02:03:21.496 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/12' 2023-07-29T02:03:21.496 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/39' 2023-07-29T02:03:21.496 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/10' 2023-07-29T02:03:21.496 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/34' 2023-07-29T02:03:21.496 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/38' 2023-07-29T02:03:21.496 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/11' 2023-07-29T02:03:21.496 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/16' 2023-07-29T02:03:21.496 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/32' 2023-07-29T02:03:21.497 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/30' 2023-07-29T02:03:21.497 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/14' 2023-07-29T02:03:21.497 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/18' 2023-07-29T02:03:21.497 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/13' 2023-07-29T02:03:21.497 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/33' 2023-07-29T02:03:21.497 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/17' 2023-07-29T02:03:21.497 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/35' 2023-07-29T02:03:21.497 INFO:tasks.workunit.client.0.smithi042.stdout:removed './121/37' 2023-07-29T02:03:21.498 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './121' 2023-07-29T02:03:21.498 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/19' 2023-07-29T02:03:21.498 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/15' 2023-07-29T02:03:21.498 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/31' 2023-07-29T02:03:21.498 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/36' 2023-07-29T02:03:21.498 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/20' 2023-07-29T02:03:21.498 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/12' 2023-07-29T02:03:21.499 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/39' 2023-07-29T02:03:21.499 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/10' 2023-07-29T02:03:21.499 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/34' 2023-07-29T02:03:21.499 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/38' 2023-07-29T02:03:21.499 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/11' 2023-07-29T02:03:21.499 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/16' 2023-07-29T02:03:21.499 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/32' 2023-07-29T02:03:21.499 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/30' 2023-07-29T02:03:21.500 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/14' 2023-07-29T02:03:21.500 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/18' 2023-07-29T02:03:21.500 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/13' 2023-07-29T02:03:21.500 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/33' 2023-07-29T02:03:21.500 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/17' 2023-07-29T02:03:21.501 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/35' 2023-07-29T02:03:21.501 INFO:tasks.workunit.client.0.smithi042.stdout:removed './122/37' 2023-07-29T02:03:21.501 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './122' 2023-07-29T02:03:21.501 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/19' 2023-07-29T02:03:21.501 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/15' 2023-07-29T02:03:21.501 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/31' 2023-07-29T02:03:21.501 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/36' 2023-07-29T02:03:21.501 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/20' 2023-07-29T02:03:21.502 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/12' 2023-07-29T02:03:21.502 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/39' 2023-07-29T02:03:21.502 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/10' 2023-07-29T02:03:21.502 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/34' 2023-07-29T02:03:21.502 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/38' 2023-07-29T02:03:21.502 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/11' 2023-07-29T02:03:21.502 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/16' 2023-07-29T02:03:21.502 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/32' 2023-07-29T02:03:21.503 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/30' 2023-07-29T02:03:21.503 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/14' 2023-07-29T02:03:21.503 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/18' 2023-07-29T02:03:21.503 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/13' 2023-07-29T02:03:21.503 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/33' 2023-07-29T02:03:21.503 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/17' 2023-07-29T02:03:21.503 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/35' 2023-07-29T02:03:21.503 INFO:tasks.workunit.client.0.smithi042.stdout:removed './123/37' 2023-07-29T02:03:21.505 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './123' 2023-07-29T02:03:21.505 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/19' 2023-07-29T02:03:21.505 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/15' 2023-07-29T02:03:21.505 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/31' 2023-07-29T02:03:21.505 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/36' 2023-07-29T02:03:21.505 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/20' 2023-07-29T02:03:21.505 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/12' 2023-07-29T02:03:21.506 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/39' 2023-07-29T02:03:21.506 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/10' 2023-07-29T02:03:21.506 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/34' 2023-07-29T02:03:21.506 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/38' 2023-07-29T02:03:21.506 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/11' 2023-07-29T02:03:21.506 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/16' 2023-07-29T02:03:21.506 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/32' 2023-07-29T02:03:21.507 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/30' 2023-07-29T02:03:21.507 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/14' 2023-07-29T02:03:21.507 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/18' 2023-07-29T02:03:21.507 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/13' 2023-07-29T02:03:21.507 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/33' 2023-07-29T02:03:21.507 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/17' 2023-07-29T02:03:21.507 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/35' 2023-07-29T02:03:21.507 INFO:tasks.workunit.client.0.smithi042.stdout:removed './124/37' 2023-07-29T02:03:21.508 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './124' 2023-07-29T02:03:21.508 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/19' 2023-07-29T02:03:21.508 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/15' 2023-07-29T02:03:21.508 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/31' 2023-07-29T02:03:21.508 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/36' 2023-07-29T02:03:21.508 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/20' 2023-07-29T02:03:21.508 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/12' 2023-07-29T02:03:21.509 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/39' 2023-07-29T02:03:21.509 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/10' 2023-07-29T02:03:21.509 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/34' 2023-07-29T02:03:21.509 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/38' 2023-07-29T02:03:21.509 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/11' 2023-07-29T02:03:21.509 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/16' 2023-07-29T02:03:21.509 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/32' 2023-07-29T02:03:21.509 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/30' 2023-07-29T02:03:21.510 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/14' 2023-07-29T02:03:21.510 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/18' 2023-07-29T02:03:21.510 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/13' 2023-07-29T02:03:21.510 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/33' 2023-07-29T02:03:21.510 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/17' 2023-07-29T02:03:21.510 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/35' 2023-07-29T02:03:21.510 INFO:tasks.workunit.client.0.smithi042.stdout:removed './125/37' 2023-07-29T02:03:21.510 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './125' 2023-07-29T02:03:21.511 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/19' 2023-07-29T02:03:21.511 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/15' 2023-07-29T02:03:21.511 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/31' 2023-07-29T02:03:21.511 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/36' 2023-07-29T02:03:21.511 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/20' 2023-07-29T02:03:21.511 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/12' 2023-07-29T02:03:21.511 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/39' 2023-07-29T02:03:21.513 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/10' 2023-07-29T02:03:21.513 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/34' 2023-07-29T02:03:21.513 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/38' 2023-07-29T02:03:21.513 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/11' 2023-07-29T02:03:21.513 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/16' 2023-07-29T02:03:21.513 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/32' 2023-07-29T02:03:21.514 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/30' 2023-07-29T02:03:21.514 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/14' 2023-07-29T02:03:21.514 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/18' 2023-07-29T02:03:21.514 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/13' 2023-07-29T02:03:21.514 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/33' 2023-07-29T02:03:21.514 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/17' 2023-07-29T02:03:21.514 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/35' 2023-07-29T02:03:21.515 INFO:tasks.workunit.client.0.smithi042.stdout:removed './126/37' 2023-07-29T02:03:21.515 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './126' 2023-07-29T02:03:21.515 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/19' 2023-07-29T02:03:21.515 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/15' 2023-07-29T02:03:21.515 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/31' 2023-07-29T02:03:21.515 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/36' 2023-07-29T02:03:21.515 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/20' 2023-07-29T02:03:21.515 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/12' 2023-07-29T02:03:21.516 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/39' 2023-07-29T02:03:21.516 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/10' 2023-07-29T02:03:21.516 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/34' 2023-07-29T02:03:21.516 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/38' 2023-07-29T02:03:21.516 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/11' 2023-07-29T02:03:21.516 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/16' 2023-07-29T02:03:21.516 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/32' 2023-07-29T02:03:21.517 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/30' 2023-07-29T02:03:21.517 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/14' 2023-07-29T02:03:21.517 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/18' 2023-07-29T02:03:21.517 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/13' 2023-07-29T02:03:21.517 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/33' 2023-07-29T02:03:21.517 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/17' 2023-07-29T02:03:21.517 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/35' 2023-07-29T02:03:21.517 INFO:tasks.workunit.client.0.smithi042.stdout:removed './127/37' 2023-07-29T02:03:21.518 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './127' 2023-07-29T02:03:21.518 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/19' 2023-07-29T02:03:21.518 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/15' 2023-07-29T02:03:21.518 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/31' 2023-07-29T02:03:21.518 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/36' 2023-07-29T02:03:21.518 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/20' 2023-07-29T02:03:21.518 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/12' 2023-07-29T02:03:21.518 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/39' 2023-07-29T02:03:21.519 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/10' 2023-07-29T02:03:21.519 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/34' 2023-07-29T02:03:21.519 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/38' 2023-07-29T02:03:21.519 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/11' 2023-07-29T02:03:21.519 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/16' 2023-07-29T02:03:21.519 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/32' 2023-07-29T02:03:21.519 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/30' 2023-07-29T02:03:21.519 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/14' 2023-07-29T02:03:21.520 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/18' 2023-07-29T02:03:21.520 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/13' 2023-07-29T02:03:21.520 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/33' 2023-07-29T02:03:21.520 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/17' 2023-07-29T02:03:21.520 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/35' 2023-07-29T02:03:22.939 INFO:tasks.workunit.client.0.smithi042.stdout:removed './128/37' 2023-07-29T02:03:22.939 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './128' 2023-07-29T02:03:22.939 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/19' 2023-07-29T02:03:22.940 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/15' 2023-07-29T02:03:22.940 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/31' 2023-07-29T02:03:22.940 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/36' 2023-07-29T02:03:22.940 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/20' 2023-07-29T02:03:22.941 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/12' 2023-07-29T02:03:22.941 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/39' 2023-07-29T02:03:22.941 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/10' 2023-07-29T02:03:22.941 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/34' 2023-07-29T02:03:22.942 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/38' 2023-07-29T02:03:22.942 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/11' 2023-07-29T02:03:22.942 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/16' 2023-07-29T02:03:22.943 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/32' 2023-07-29T02:03:22.943 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/30' 2023-07-29T02:03:22.943 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/14' 2023-07-29T02:03:22.943 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/18' 2023-07-29T02:03:22.944 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/13' 2023-07-29T02:03:22.944 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/33' 2023-07-29T02:03:22.944 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/17' 2023-07-29T02:03:22.944 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/35' 2023-07-29T02:03:22.944 INFO:tasks.workunit.client.0.smithi042.stdout:removed './129/37' 2023-07-29T02:03:22.945 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './129' 2023-07-29T02:03:22.945 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/19' 2023-07-29T02:03:22.945 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/15' 2023-07-29T02:03:22.945 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/31' 2023-07-29T02:03:22.945 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/36' 2023-07-29T02:03:22.945 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/20' 2023-07-29T02:03:22.945 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/12' 2023-07-29T02:03:22.946 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/39' 2023-07-29T02:03:22.946 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/10' 2023-07-29T02:03:22.946 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/34' 2023-07-29T02:03:22.946 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/38' 2023-07-29T02:03:22.946 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/11' 2023-07-29T02:03:22.946 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/16' 2023-07-29T02:03:22.946 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/32' 2023-07-29T02:03:22.947 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/30' 2023-07-29T02:03:22.947 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/14' 2023-07-29T02:03:22.947 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/18' 2023-07-29T02:03:22.947 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/13' 2023-07-29T02:03:22.947 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/33' 2023-07-29T02:03:22.947 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/17' 2023-07-29T02:03:22.947 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/35' 2023-07-29T02:03:22.948 INFO:tasks.workunit.client.0.smithi042.stdout:removed './130/37' 2023-07-29T02:03:22.948 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './130' 2023-07-29T02:03:22.948 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/19' 2023-07-29T02:03:22.948 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/15' 2023-07-29T02:03:22.948 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/31' 2023-07-29T02:03:22.949 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/36' 2023-07-29T02:03:22.949 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/20' 2023-07-29T02:03:22.949 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/12' 2023-07-29T02:03:22.950 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/39' 2023-07-29T02:03:22.950 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/10' 2023-07-29T02:03:22.950 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/34' 2023-07-29T02:03:22.950 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/38' 2023-07-29T02:03:22.951 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/11' 2023-07-29T02:03:22.951 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/16' 2023-07-29T02:03:22.951 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/32' 2023-07-29T02:03:22.952 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/30' 2023-07-29T02:03:22.952 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/14' 2023-07-29T02:03:22.952 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/18' 2023-07-29T02:03:22.952 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/13' 2023-07-29T02:03:22.953 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/33' 2023-07-29T02:03:22.953 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/17' 2023-07-29T02:03:22.953 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/35' 2023-07-29T02:03:22.954 INFO:tasks.workunit.client.0.smithi042.stdout:removed './131/37' 2023-07-29T02:03:22.954 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './131' 2023-07-29T02:03:22.954 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/19' 2023-07-29T02:03:22.954 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/15' 2023-07-29T02:03:22.955 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/31' 2023-07-29T02:03:22.955 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/36' 2023-07-29T02:03:22.955 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/20' 2023-07-29T02:03:22.955 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/12' 2023-07-29T02:03:22.956 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/39' 2023-07-29T02:03:22.956 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/10' 2023-07-29T02:03:22.956 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/34' 2023-07-29T02:03:22.957 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/38' 2023-07-29T02:03:22.957 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/11' 2023-07-29T02:03:22.957 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/16' 2023-07-29T02:03:22.957 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/32' 2023-07-29T02:03:22.958 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/30' 2023-07-29T02:03:22.958 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/14' 2023-07-29T02:03:22.958 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/18' 2023-07-29T02:03:22.959 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/13' 2023-07-29T02:03:22.959 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/33' 2023-07-29T02:03:22.959 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/17' 2023-07-29T02:03:22.959 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/35' 2023-07-29T02:03:22.960 INFO:tasks.workunit.client.0.smithi042.stdout:removed './132/37' 2023-07-29T02:03:22.960 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './132' 2023-07-29T02:03:22.960 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/19' 2023-07-29T02:03:22.961 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/15' 2023-07-29T02:03:22.961 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/31' 2023-07-29T02:03:22.961 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/36' 2023-07-29T02:03:22.961 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/20' 2023-07-29T02:03:22.962 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/12' 2023-07-29T02:03:22.962 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/39' 2023-07-29T02:03:22.962 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/10' 2023-07-29T02:03:22.962 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/34' 2023-07-29T02:03:22.963 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/38' 2023-07-29T02:03:22.963 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/11' 2023-07-29T02:03:22.963 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/16' 2023-07-29T02:03:22.964 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/32' 2023-07-29T02:03:22.964 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/30' 2023-07-29T02:03:22.964 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/14' 2023-07-29T02:03:22.964 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/18' 2023-07-29T02:03:22.965 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/13' 2023-07-29T02:03:22.965 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/33' 2023-07-29T02:03:22.965 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/17' 2023-07-29T02:03:22.965 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/35' 2023-07-29T02:03:22.966 INFO:tasks.workunit.client.0.smithi042.stdout:removed './133/37' 2023-07-29T02:03:22.966 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './133' 2023-07-29T02:03:22.966 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/19' 2023-07-29T02:03:22.966 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/15' 2023-07-29T02:03:22.966 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/31' 2023-07-29T02:03:22.967 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/36' 2023-07-29T02:03:22.967 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/20' 2023-07-29T02:03:22.967 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/12' 2023-07-29T02:03:22.967 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/39' 2023-07-29T02:03:22.967 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/10' 2023-07-29T02:03:22.967 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/34' 2023-07-29T02:03:22.967 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/38' 2023-07-29T02:03:22.967 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/11' 2023-07-29T02:03:22.968 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/16' 2023-07-29T02:03:22.968 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/32' 2023-07-29T02:03:22.968 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/30' 2023-07-29T02:03:22.968 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/14' 2023-07-29T02:03:22.968 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/18' 2023-07-29T02:03:22.968 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/13' 2023-07-29T02:03:22.968 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/33' 2023-07-29T02:03:22.969 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/17' 2023-07-29T02:03:22.969 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/35' 2023-07-29T02:03:22.969 INFO:tasks.workunit.client.0.smithi042.stdout:removed './134/37' 2023-07-29T02:03:22.969 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './134' 2023-07-29T02:03:22.969 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/19' 2023-07-29T02:03:22.969 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/15' 2023-07-29T02:03:22.969 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/31' 2023-07-29T02:03:22.969 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/36' 2023-07-29T02:03:22.970 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/20' 2023-07-29T02:03:22.970 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/12' 2023-07-29T02:03:22.970 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/39' 2023-07-29T02:03:22.970 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/10' 2023-07-29T02:03:22.970 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/34' 2023-07-29T02:03:22.970 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/38' 2023-07-29T02:03:22.970 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/11' 2023-07-29T02:03:22.970 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/16' 2023-07-29T02:03:22.971 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/32' 2023-07-29T02:03:22.971 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/30' 2023-07-29T02:03:22.971 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/14' 2023-07-29T02:03:22.971 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/18' 2023-07-29T02:03:22.971 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/13' 2023-07-29T02:03:22.971 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/33' 2023-07-29T02:03:22.971 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/17' 2023-07-29T02:03:22.971 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/35' 2023-07-29T02:03:22.972 INFO:tasks.workunit.client.0.smithi042.stdout:removed './135/37' 2023-07-29T02:03:22.972 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './135' 2023-07-29T02:03:22.972 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/19' 2023-07-29T02:03:22.972 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/15' 2023-07-29T02:03:22.972 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/31' 2023-07-29T02:03:22.972 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/36' 2023-07-29T02:03:22.972 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/20' 2023-07-29T02:03:22.973 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/12' 2023-07-29T02:03:22.973 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/39' 2023-07-29T02:03:22.973 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/10' 2023-07-29T02:03:22.973 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/34' 2023-07-29T02:03:22.973 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/38' 2023-07-29T02:03:22.973 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/11' 2023-07-29T02:03:22.973 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/16' 2023-07-29T02:03:22.973 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/32' 2023-07-29T02:03:22.974 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/30' 2023-07-29T02:03:22.974 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/14' 2023-07-29T02:03:22.974 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/18' 2023-07-29T02:03:22.974 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/13' 2023-07-29T02:03:22.974 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/33' 2023-07-29T02:03:22.974 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/17' 2023-07-29T02:03:22.974 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/35' 2023-07-29T02:03:22.974 INFO:tasks.workunit.client.0.smithi042.stdout:removed './136/37' 2023-07-29T02:03:22.975 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './136' 2023-07-29T02:03:22.975 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/19' 2023-07-29T02:03:22.975 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/15' 2023-07-29T02:03:22.975 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/31' 2023-07-29T02:03:22.975 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/36' 2023-07-29T02:03:22.975 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/20' 2023-07-29T02:03:22.975 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/12' 2023-07-29T02:03:22.975 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/39' 2023-07-29T02:03:22.976 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/10' 2023-07-29T02:03:22.976 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/34' 2023-07-29T02:03:22.976 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/38' 2023-07-29T02:03:22.976 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/11' 2023-07-29T02:03:22.976 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/16' 2023-07-29T02:03:22.976 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/32' 2023-07-29T02:03:22.976 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/30' 2023-07-29T02:03:22.976 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/14' 2023-07-29T02:03:22.977 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/18' 2023-07-29T02:03:22.977 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/13' 2023-07-29T02:03:22.977 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/33' 2023-07-29T02:03:22.977 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/17' 2023-07-29T02:03:22.977 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/35' 2023-07-29T02:03:22.977 INFO:tasks.workunit.client.0.smithi042.stdout:removed './137/37' 2023-07-29T02:03:22.977 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './137' 2023-07-29T02:03:22.978 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/19' 2023-07-29T02:03:22.978 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/15' 2023-07-29T02:03:22.978 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/31' 2023-07-29T02:03:22.978 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/36' 2023-07-29T02:03:22.978 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/20' 2023-07-29T02:03:22.978 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/12' 2023-07-29T02:03:22.978 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/39' 2023-07-29T02:03:22.978 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/10' 2023-07-29T02:03:22.979 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/34' 2023-07-29T02:03:22.979 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/38' 2023-07-29T02:03:22.979 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/11' 2023-07-29T02:03:22.979 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/16' 2023-07-29T02:03:24.079 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/32' 2023-07-29T02:03:24.079 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/30' 2023-07-29T02:03:24.079 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/14' 2023-07-29T02:03:24.079 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/18' 2023-07-29T02:03:24.080 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/13' 2023-07-29T02:03:24.080 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/33' 2023-07-29T02:03:24.080 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/17' 2023-07-29T02:03:24.080 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/35' 2023-07-29T02:03:24.080 INFO:tasks.workunit.client.0.smithi042.stdout:removed './138/37' 2023-07-29T02:03:24.080 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './138' 2023-07-29T02:03:24.080 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/19' 2023-07-29T02:03:24.081 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/15' 2023-07-29T02:03:24.081 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/31' 2023-07-29T02:03:24.081 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/36' 2023-07-29T02:03:24.081 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/20' 2023-07-29T02:03:24.081 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/12' 2023-07-29T02:03:24.081 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/39' 2023-07-29T02:03:24.081 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/10' 2023-07-29T02:03:24.082 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/34' 2023-07-29T02:03:24.082 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/38' 2023-07-29T02:03:24.082 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/11' 2023-07-29T02:03:24.082 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/16' 2023-07-29T02:03:24.082 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/32' 2023-07-29T02:03:24.082 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/30' 2023-07-29T02:03:24.082 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/14' 2023-07-29T02:03:24.082 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/18' 2023-07-29T02:03:24.083 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/13' 2023-07-29T02:03:24.083 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/33' 2023-07-29T02:03:24.083 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/17' 2023-07-29T02:03:24.083 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/35' 2023-07-29T02:03:24.083 INFO:tasks.workunit.client.0.smithi042.stdout:removed './139/37' 2023-07-29T02:03:24.083 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './139' 2023-07-29T02:03:24.083 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/19' 2023-07-29T02:03:24.083 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/15' 2023-07-29T02:03:24.084 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/31' 2023-07-29T02:03:24.084 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/36' 2023-07-29T02:03:24.084 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/20' 2023-07-29T02:03:24.084 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/12' 2023-07-29T02:03:24.084 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/39' 2023-07-29T02:03:24.084 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/10' 2023-07-29T02:03:24.084 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/34' 2023-07-29T02:03:24.085 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/38' 2023-07-29T02:03:24.085 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/11' 2023-07-29T02:03:24.085 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/16' 2023-07-29T02:03:24.085 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/32' 2023-07-29T02:03:24.085 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/30' 2023-07-29T02:03:24.085 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/14' 2023-07-29T02:03:24.085 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/18' 2023-07-29T02:03:24.085 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/13' 2023-07-29T02:03:24.086 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/33' 2023-07-29T02:03:24.086 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/17' 2023-07-29T02:03:24.086 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/35' 2023-07-29T02:03:24.086 INFO:tasks.workunit.client.0.smithi042.stdout:removed './140/37' 2023-07-29T02:03:24.086 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './140' 2023-07-29T02:03:24.086 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/19' 2023-07-29T02:03:24.086 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/15' 2023-07-29T02:03:24.086 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/31' 2023-07-29T02:03:24.087 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/36' 2023-07-29T02:03:24.087 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/20' 2023-07-29T02:03:24.087 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/12' 2023-07-29T02:03:24.087 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/39' 2023-07-29T02:03:24.087 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/10' 2023-07-29T02:03:24.087 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/34' 2023-07-29T02:03:24.087 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/38' 2023-07-29T02:03:24.088 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/11' 2023-07-29T02:03:24.088 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/16' 2023-07-29T02:03:24.088 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/32' 2023-07-29T02:03:24.088 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/30' 2023-07-29T02:03:24.088 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/14' 2023-07-29T02:03:24.088 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/18' 2023-07-29T02:03:24.088 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/13' 2023-07-29T02:03:24.089 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/33' 2023-07-29T02:03:24.089 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/17' 2023-07-29T02:03:24.089 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/35' 2023-07-29T02:03:24.089 INFO:tasks.workunit.client.0.smithi042.stdout:removed './141/37' 2023-07-29T02:03:24.089 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './141' 2023-07-29T02:03:24.089 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/19' 2023-07-29T02:03:24.089 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/15' 2023-07-29T02:03:24.090 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/31' 2023-07-29T02:03:24.090 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/36' 2023-07-29T02:03:24.090 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/20' 2023-07-29T02:03:24.090 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/12' 2023-07-29T02:03:24.090 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/39' 2023-07-29T02:03:24.090 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/10' 2023-07-29T02:03:24.090 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/34' 2023-07-29T02:03:24.090 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/38' 2023-07-29T02:03:24.091 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/11' 2023-07-29T02:03:24.091 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/16' 2023-07-29T02:03:24.091 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/32' 2023-07-29T02:03:24.091 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/30' 2023-07-29T02:03:24.091 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/14' 2023-07-29T02:03:24.091 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/18' 2023-07-29T02:03:24.091 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/13' 2023-07-29T02:03:24.091 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/33' 2023-07-29T02:03:24.092 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/17' 2023-07-29T02:03:24.092 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/35' 2023-07-29T02:03:24.092 INFO:tasks.workunit.client.0.smithi042.stdout:removed './142/37' 2023-07-29T02:03:24.092 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './142' 2023-07-29T02:03:24.092 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/19' 2023-07-29T02:03:24.092 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/15' 2023-07-29T02:03:24.092 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/31' 2023-07-29T02:03:24.093 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/36' 2023-07-29T02:03:24.093 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/20' 2023-07-29T02:03:24.093 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/12' 2023-07-29T02:03:24.093 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/39' 2023-07-29T02:03:24.093 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/10' 2023-07-29T02:03:24.093 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/34' 2023-07-29T02:03:24.093 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/38' 2023-07-29T02:03:24.093 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/11' 2023-07-29T02:03:24.094 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/16' 2023-07-29T02:03:24.094 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/32' 2023-07-29T02:03:24.094 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/30' 2023-07-29T02:03:24.094 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/14' 2023-07-29T02:03:24.094 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/18' 2023-07-29T02:03:24.094 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/13' 2023-07-29T02:03:24.094 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/33' 2023-07-29T02:03:24.094 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/17' 2023-07-29T02:03:24.095 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/35' 2023-07-29T02:03:24.095 INFO:tasks.workunit.client.0.smithi042.stdout:removed './143/37' 2023-07-29T02:03:24.095 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './143' 2023-07-29T02:03:24.095 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/19' 2023-07-29T02:03:24.095 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/15' 2023-07-29T02:03:24.095 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/31' 2023-07-29T02:03:24.095 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/36' 2023-07-29T02:03:24.095 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/20' 2023-07-29T02:03:24.096 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/12' 2023-07-29T02:03:24.096 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/39' 2023-07-29T02:03:24.096 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/10' 2023-07-29T02:03:24.096 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/34' 2023-07-29T02:03:24.096 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/38' 2023-07-29T02:03:24.096 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/11' 2023-07-29T02:03:24.097 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/16' 2023-07-29T02:03:24.097 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/32' 2023-07-29T02:03:24.097 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/30' 2023-07-29T02:03:24.097 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/14' 2023-07-29T02:03:24.098 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/18' 2023-07-29T02:03:24.098 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/13' 2023-07-29T02:03:24.098 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/33' 2023-07-29T02:03:24.098 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/17' 2023-07-29T02:03:24.099 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/35' 2023-07-29T02:03:24.099 INFO:tasks.workunit.client.0.smithi042.stdout:removed './144/37' 2023-07-29T02:03:24.099 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './144' 2023-07-29T02:03:24.099 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/19' 2023-07-29T02:03:24.100 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/15' 2023-07-29T02:03:24.100 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/31' 2023-07-29T02:03:24.100 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/36' 2023-07-29T02:03:24.101 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/20' 2023-07-29T02:03:24.101 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/12' 2023-07-29T02:03:24.101 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/39' 2023-07-29T02:03:24.101 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/10' 2023-07-29T02:03:24.102 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/34' 2023-07-29T02:03:24.102 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/38' 2023-07-29T02:03:24.102 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/11' 2023-07-29T02:03:24.103 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/16' 2023-07-29T02:03:24.103 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/32' 2023-07-29T02:03:24.103 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/30' 2023-07-29T02:03:24.103 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/14' 2023-07-29T02:03:24.104 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/18' 2023-07-29T02:03:24.104 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/13' 2023-07-29T02:03:24.104 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/33' 2023-07-29T02:03:24.104 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/17' 2023-07-29T02:03:24.105 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/35' 2023-07-29T02:03:24.105 INFO:tasks.workunit.client.0.smithi042.stdout:removed './145/37' 2023-07-29T02:03:24.105 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './145' 2023-07-29T02:03:24.105 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/19' 2023-07-29T02:03:24.106 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/15' 2023-07-29T02:03:24.106 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/31' 2023-07-29T02:03:24.106 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/36' 2023-07-29T02:03:24.106 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/20' 2023-07-29T02:03:24.106 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/12' 2023-07-29T02:03:24.106 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/39' 2023-07-29T02:03:24.106 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/10' 2023-07-29T02:03:24.107 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/34' 2023-07-29T02:03:24.107 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/38' 2023-07-29T02:03:24.107 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/11' 2023-07-29T02:03:24.107 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/16' 2023-07-29T02:03:24.107 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/32' 2023-07-29T02:03:24.107 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/30' 2023-07-29T02:03:24.107 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/14' 2023-07-29T02:03:24.107 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/18' 2023-07-29T02:03:24.108 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/13' 2023-07-29T02:03:24.108 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/33' 2023-07-29T02:03:24.108 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/17' 2023-07-29T02:03:24.108 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/35' 2023-07-29T02:03:24.108 INFO:tasks.workunit.client.0.smithi042.stdout:removed './146/37' 2023-07-29T02:03:24.108 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './146' 2023-07-29T02:03:24.108 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/19' 2023-07-29T02:03:24.109 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/15' 2023-07-29T02:03:24.109 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/31' 2023-07-29T02:03:24.109 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/36' 2023-07-29T02:03:24.109 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/20' 2023-07-29T02:03:24.109 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/12' 2023-07-29T02:03:24.109 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/39' 2023-07-29T02:03:24.109 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/10' 2023-07-29T02:03:24.109 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/34' 2023-07-29T02:03:24.110 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/38' 2023-07-29T02:03:24.110 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/11' 2023-07-29T02:03:24.110 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/16' 2023-07-29T02:03:24.110 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/32' 2023-07-29T02:03:24.110 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/30' 2023-07-29T02:03:24.110 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/14' 2023-07-29T02:03:24.110 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/18' 2023-07-29T02:03:24.110 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/13' 2023-07-29T02:03:24.111 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/33' 2023-07-29T02:03:24.111 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/17' 2023-07-29T02:03:24.111 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/35' 2023-07-29T02:03:24.111 INFO:tasks.workunit.client.0.smithi042.stdout:removed './147/37' 2023-07-29T02:03:24.111 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './147' 2023-07-29T02:03:24.111 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/19' 2023-07-29T02:03:24.112 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/15' 2023-07-29T02:03:24.112 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/31' 2023-07-29T02:03:24.112 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/36' 2023-07-29T02:03:24.466 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/20' 2023-07-29T02:03:24.467 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/12' 2023-07-29T02:03:24.467 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/39' 2023-07-29T02:03:24.467 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/10' 2023-07-29T02:03:24.468 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/34' 2023-07-29T02:03:24.468 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/38' 2023-07-29T02:03:24.468 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/11' 2023-07-29T02:03:24.469 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/16' 2023-07-29T02:03:24.469 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/32' 2023-07-29T02:03:24.469 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/30' 2023-07-29T02:03:24.469 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/14' 2023-07-29T02:03:24.470 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/18' 2023-07-29T02:03:24.470 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/13' 2023-07-29T02:03:24.470 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/33' 2023-07-29T02:03:24.470 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/17' 2023-07-29T02:03:24.471 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/35' 2023-07-29T02:03:24.471 INFO:tasks.workunit.client.0.smithi042.stdout:removed './148/37' 2023-07-29T02:03:24.471 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './148' 2023-07-29T02:03:24.471 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/19' 2023-07-29T02:03:24.472 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/15' 2023-07-29T02:03:24.472 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/31' 2023-07-29T02:03:24.472 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/36' 2023-07-29T02:03:24.473 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/20' 2023-07-29T02:03:24.473 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/12' 2023-07-29T02:03:24.473 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/39' 2023-07-29T02:03:24.473 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/10' 2023-07-29T02:03:24.473 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/34' 2023-07-29T02:03:24.473 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/38' 2023-07-29T02:03:24.474 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/11' 2023-07-29T02:03:24.474 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/16' 2023-07-29T02:03:24.474 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/32' 2023-07-29T02:03:24.474 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/30' 2023-07-29T02:03:24.474 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/14' 2023-07-29T02:03:24.474 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/18' 2023-07-29T02:03:24.474 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/13' 2023-07-29T02:03:24.474 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/33' 2023-07-29T02:03:24.475 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/17' 2023-07-29T02:03:24.475 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/35' 2023-07-29T02:03:24.475 INFO:tasks.workunit.client.0.smithi042.stdout:removed './149/37' 2023-07-29T02:03:24.475 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './149' 2023-07-29T02:03:24.475 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/19' 2023-07-29T02:03:24.475 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/15' 2023-07-29T02:03:24.475 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/31' 2023-07-29T02:03:24.475 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/36' 2023-07-29T02:03:24.476 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/20' 2023-07-29T02:03:24.476 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/12' 2023-07-29T02:03:24.476 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/39' 2023-07-29T02:03:24.476 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/10' 2023-07-29T02:03:24.476 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/34' 2023-07-29T02:03:24.476 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/38' 2023-07-29T02:03:24.476 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/11' 2023-07-29T02:03:24.477 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/16' 2023-07-29T02:03:24.477 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/32' 2023-07-29T02:03:24.477 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/30' 2023-07-29T02:03:24.477 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/14' 2023-07-29T02:03:24.477 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/18' 2023-07-29T02:03:24.477 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/13' 2023-07-29T02:03:24.477 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/33' 2023-07-29T02:03:24.477 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/17' 2023-07-29T02:03:24.478 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/35' 2023-07-29T02:03:24.478 INFO:tasks.workunit.client.0.smithi042.stdout:removed './150/37' 2023-07-29T02:03:24.478 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './150' 2023-07-29T02:03:24.478 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/19' 2023-07-29T02:03:24.478 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/15' 2023-07-29T02:03:24.478 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/31' 2023-07-29T02:03:24.478 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/36' 2023-07-29T02:03:24.479 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/20' 2023-07-29T02:03:24.479 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/12' 2023-07-29T02:03:24.479 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/39' 2023-07-29T02:03:24.479 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/10' 2023-07-29T02:03:24.479 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/34' 2023-07-29T02:03:24.479 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/38' 2023-07-29T02:03:24.479 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/11' 2023-07-29T02:03:24.480 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/16' 2023-07-29T02:03:24.480 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/32' 2023-07-29T02:03:24.480 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/30' 2023-07-29T02:03:24.480 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/14' 2023-07-29T02:03:24.480 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/18' 2023-07-29T02:03:24.480 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/13' 2023-07-29T02:03:24.480 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/33' 2023-07-29T02:03:24.480 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/17' 2023-07-29T02:03:24.481 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/35' 2023-07-29T02:03:24.481 INFO:tasks.workunit.client.0.smithi042.stdout:removed './151/37' 2023-07-29T02:03:24.481 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './151' 2023-07-29T02:03:24.481 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/19' 2023-07-29T02:03:24.481 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/15' 2023-07-29T02:03:24.481 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/31' 2023-07-29T02:03:24.482 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/36' 2023-07-29T02:03:24.482 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/20' 2023-07-29T02:03:24.482 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/12' 2023-07-29T02:03:24.482 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/39' 2023-07-29T02:03:24.482 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/10' 2023-07-29T02:03:24.482 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/34' 2023-07-29T02:03:24.482 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/38' 2023-07-29T02:03:24.482 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/11' 2023-07-29T02:03:24.483 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/16' 2023-07-29T02:03:24.483 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/32' 2023-07-29T02:03:24.483 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/30' 2023-07-29T02:03:24.483 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/14' 2023-07-29T02:03:24.483 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/18' 2023-07-29T02:03:24.483 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/13' 2023-07-29T02:03:24.483 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/33' 2023-07-29T02:03:24.484 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/17' 2023-07-29T02:03:24.484 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/35' 2023-07-29T02:03:24.484 INFO:tasks.workunit.client.0.smithi042.stdout:removed './152/37' 2023-07-29T02:03:24.484 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './152' 2023-07-29T02:03:24.484 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/19' 2023-07-29T02:03:24.484 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/15' 2023-07-29T02:03:24.485 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/31' 2023-07-29T02:03:24.485 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/36' 2023-07-29T02:03:24.485 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/20' 2023-07-29T02:03:24.485 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/12' 2023-07-29T02:03:24.485 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/39' 2023-07-29T02:03:24.485 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/10' 2023-07-29T02:03:24.485 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/34' 2023-07-29T02:03:24.486 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/38' 2023-07-29T02:03:24.486 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/11' 2023-07-29T02:03:24.486 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/16' 2023-07-29T02:03:24.486 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/32' 2023-07-29T02:03:24.486 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/30' 2023-07-29T02:03:24.486 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/14' 2023-07-29T02:03:24.486 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/18' 2023-07-29T02:03:24.486 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/13' 2023-07-29T02:03:24.487 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/33' 2023-07-29T02:03:24.487 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/17' 2023-07-29T02:03:24.487 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/35' 2023-07-29T02:03:24.487 INFO:tasks.workunit.client.0.smithi042.stdout:removed './153/37' 2023-07-29T02:03:24.487 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './153' 2023-07-29T02:03:24.487 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/19' 2023-07-29T02:03:24.487 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/15' 2023-07-29T02:03:24.487 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/31' 2023-07-29T02:03:24.488 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/36' 2023-07-29T02:03:24.488 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/20' 2023-07-29T02:03:24.488 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/12' 2023-07-29T02:03:24.488 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/39' 2023-07-29T02:03:24.488 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/10' 2023-07-29T02:03:24.488 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/34' 2023-07-29T02:03:24.489 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/38' 2023-07-29T02:03:24.489 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/11' 2023-07-29T02:03:24.489 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/16' 2023-07-29T02:03:24.489 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/32' 2023-07-29T02:03:24.489 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/30' 2023-07-29T02:03:24.489 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/14' 2023-07-29T02:03:24.489 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/18' 2023-07-29T02:03:24.489 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/13' 2023-07-29T02:03:24.490 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/33' 2023-07-29T02:03:24.490 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/17' 2023-07-29T02:03:24.490 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/35' 2023-07-29T02:03:24.490 INFO:tasks.workunit.client.0.smithi042.stdout:removed './154/37' 2023-07-29T02:03:24.490 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './154' 2023-07-29T02:03:24.490 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/19' 2023-07-29T02:03:24.491 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/15' 2023-07-29T02:03:24.491 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/31' 2023-07-29T02:03:24.491 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/36' 2023-07-29T02:03:24.491 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/20' 2023-07-29T02:03:24.491 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/12' 2023-07-29T02:03:24.492 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/39' 2023-07-29T02:03:24.492 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/10' 2023-07-29T02:03:24.492 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/34' 2023-07-29T02:03:24.492 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/38' 2023-07-29T02:03:24.492 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/11' 2023-07-29T02:03:24.492 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/16' 2023-07-29T02:03:24.492 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/32' 2023-07-29T02:03:24.493 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/30' 2023-07-29T02:03:24.493 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/14' 2023-07-29T02:03:24.493 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/18' 2023-07-29T02:03:24.493 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/13' 2023-07-29T02:03:24.493 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/33' 2023-07-29T02:03:24.493 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/17' 2023-07-29T02:03:24.493 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/35' 2023-07-29T02:03:24.493 INFO:tasks.workunit.client.0.smithi042.stdout:removed './155/37' 2023-07-29T02:03:24.494 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './155' 2023-07-29T02:03:24.494 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/19' 2023-07-29T02:03:24.494 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/15' 2023-07-29T02:03:24.494 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/31' 2023-07-29T02:03:24.494 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/36' 2023-07-29T02:03:24.495 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/20' 2023-07-29T02:03:24.495 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/12' 2023-07-29T02:03:24.495 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/39' 2023-07-29T02:03:24.495 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/10' 2023-07-29T02:03:24.495 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/34' 2023-07-29T02:03:24.495 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/38' 2023-07-29T02:03:24.495 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/11' 2023-07-29T02:03:24.496 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/16' 2023-07-29T02:03:24.496 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/32' 2023-07-29T02:03:24.496 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/30' 2023-07-29T02:03:24.496 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/14' 2023-07-29T02:03:24.496 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/18' 2023-07-29T02:03:24.496 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/13' 2023-07-29T02:03:24.497 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/33' 2023-07-29T02:03:24.497 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/17' 2023-07-29T02:03:24.497 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/35' 2023-07-29T02:03:24.497 INFO:tasks.workunit.client.0.smithi042.stdout:removed './156/37' 2023-07-29T02:03:24.497 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './156' 2023-07-29T02:03:24.497 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/19' 2023-07-29T02:03:24.497 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/15' 2023-07-29T02:03:24.497 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/31' 2023-07-29T02:03:24.498 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/36' 2023-07-29T02:03:24.498 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/20' 2023-07-29T02:03:24.498 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/12' 2023-07-29T02:03:24.498 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/39' 2023-07-29T02:03:24.498 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/10' 2023-07-29T02:03:24.498 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/34' 2023-07-29T02:03:24.498 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/38' 2023-07-29T02:03:24.498 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/11' 2023-07-29T02:03:24.499 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/16' 2023-07-29T02:03:24.499 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/32' 2023-07-29T02:03:24.499 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/30' 2023-07-29T02:03:24.499 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/14' 2023-07-29T02:03:24.499 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/18' 2023-07-29T02:03:24.499 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/13' 2023-07-29T02:03:24.499 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/33' 2023-07-29T02:03:25.138 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/17' 2023-07-29T02:03:25.138 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/35' 2023-07-29T02:03:25.138 INFO:tasks.workunit.client.0.smithi042.stdout:removed './157/37' 2023-07-29T02:03:25.138 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './157' 2023-07-29T02:03:25.138 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/19' 2023-07-29T02:03:25.138 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/15' 2023-07-29T02:03:25.139 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/31' 2023-07-29T02:03:25.139 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/36' 2023-07-29T02:03:25.139 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/20' 2023-07-29T02:03:25.139 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/12' 2023-07-29T02:03:25.139 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/39' 2023-07-29T02:03:25.139 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/10' 2023-07-29T02:03:25.139 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/34' 2023-07-29T02:03:25.139 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/38' 2023-07-29T02:03:25.140 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/11' 2023-07-29T02:03:25.140 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/16' 2023-07-29T02:03:25.140 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/32' 2023-07-29T02:03:25.140 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/30' 2023-07-29T02:03:25.140 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/14' 2023-07-29T02:03:25.140 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/18' 2023-07-29T02:03:25.140 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/13' 2023-07-29T02:03:25.141 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/33' 2023-07-29T02:03:25.141 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/17' 2023-07-29T02:03:25.141 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/35' 2023-07-29T02:03:25.141 INFO:tasks.workunit.client.0.smithi042.stdout:removed './158/37' 2023-07-29T02:03:25.141 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './158' 2023-07-29T02:03:25.141 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/19' 2023-07-29T02:03:25.141 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/15' 2023-07-29T02:03:25.141 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/31' 2023-07-29T02:03:25.142 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/36' 2023-07-29T02:03:25.142 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/20' 2023-07-29T02:03:25.142 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/12' 2023-07-29T02:03:25.142 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/39' 2023-07-29T02:03:25.142 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/10' 2023-07-29T02:03:25.142 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/34' 2023-07-29T02:03:25.142 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/38' 2023-07-29T02:03:25.142 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/11' 2023-07-29T02:03:25.143 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/16' 2023-07-29T02:03:25.143 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/32' 2023-07-29T02:03:25.143 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/30' 2023-07-29T02:03:25.143 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/14' 2023-07-29T02:03:25.143 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/18' 2023-07-29T02:03:25.143 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/13' 2023-07-29T02:03:25.143 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/33' 2023-07-29T02:03:25.143 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/17' 2023-07-29T02:03:25.144 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/35' 2023-07-29T02:03:25.144 INFO:tasks.workunit.client.0.smithi042.stdout:removed './159/37' 2023-07-29T02:03:25.144 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './159' 2023-07-29T02:03:25.144 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/19' 2023-07-29T02:03:25.144 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/15' 2023-07-29T02:03:25.144 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/31' 2023-07-29T02:03:25.144 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/36' 2023-07-29T02:03:25.145 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/20' 2023-07-29T02:03:25.145 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/12' 2023-07-29T02:03:25.145 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/39' 2023-07-29T02:03:25.145 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/10' 2023-07-29T02:03:25.145 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/34' 2023-07-29T02:03:25.145 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/38' 2023-07-29T02:03:25.145 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/11' 2023-07-29T02:03:25.145 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/16' 2023-07-29T02:03:25.146 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/32' 2023-07-29T02:03:25.146 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/30' 2023-07-29T02:03:25.146 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/14' 2023-07-29T02:03:25.146 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/18' 2023-07-29T02:03:25.146 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/13' 2023-07-29T02:03:25.146 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/33' 2023-07-29T02:03:25.146 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/17' 2023-07-29T02:03:25.146 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/35' 2023-07-29T02:03:25.147 INFO:tasks.workunit.client.0.smithi042.stdout:removed './160/37' 2023-07-29T02:03:25.147 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './160' 2023-07-29T02:03:25.147 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/19' 2023-07-29T02:03:25.147 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/15' 2023-07-29T02:03:25.147 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/31' 2023-07-29T02:03:25.147 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/36' 2023-07-29T02:03:25.147 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/20' 2023-07-29T02:03:25.147 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/12' 2023-07-29T02:03:25.148 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/39' 2023-07-29T02:03:25.148 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/10' 2023-07-29T02:03:25.148 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/34' 2023-07-29T02:03:25.148 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/38' 2023-07-29T02:03:25.148 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/11' 2023-07-29T02:03:25.148 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/16' 2023-07-29T02:03:25.148 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/32' 2023-07-29T02:03:25.149 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/30' 2023-07-29T02:03:25.149 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/14' 2023-07-29T02:03:25.149 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/18' 2023-07-29T02:03:25.149 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/13' 2023-07-29T02:03:25.149 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/33' 2023-07-29T02:03:25.149 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/17' 2023-07-29T02:03:25.149 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/35' 2023-07-29T02:03:25.149 INFO:tasks.workunit.client.0.smithi042.stdout:removed './161/37' 2023-07-29T02:03:25.150 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './161' 2023-07-29T02:03:25.150 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/19' 2023-07-29T02:03:25.150 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/15' 2023-07-29T02:03:25.150 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/31' 2023-07-29T02:03:25.150 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/36' 2023-07-29T02:03:25.150 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/20' 2023-07-29T02:03:25.150 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/12' 2023-07-29T02:03:25.150 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/39' 2023-07-29T02:03:25.151 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/10' 2023-07-29T02:03:25.151 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/34' 2023-07-29T02:03:25.151 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/38' 2023-07-29T02:03:25.151 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/11' 2023-07-29T02:03:25.151 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/16' 2023-07-29T02:03:25.151 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/32' 2023-07-29T02:03:25.151 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/30' 2023-07-29T02:03:25.151 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/14' 2023-07-29T02:03:25.152 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/18' 2023-07-29T02:03:25.152 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/13' 2023-07-29T02:03:25.152 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/33' 2023-07-29T02:03:25.152 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/17' 2023-07-29T02:03:25.152 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/35' 2023-07-29T02:03:25.152 INFO:tasks.workunit.client.0.smithi042.stdout:removed './162/37' 2023-07-29T02:03:25.153 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './162' 2023-07-29T02:03:25.153 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/19' 2023-07-29T02:03:25.153 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/15' 2023-07-29T02:03:25.153 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/31' 2023-07-29T02:03:25.153 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/36' 2023-07-29T02:03:25.154 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/20' 2023-07-29T02:03:25.154 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/12' 2023-07-29T02:03:25.154 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/39' 2023-07-29T02:03:25.154 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/10' 2023-07-29T02:03:25.154 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/34' 2023-07-29T02:03:25.154 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/38' 2023-07-29T02:03:25.154 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/11' 2023-07-29T02:03:25.154 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/16' 2023-07-29T02:03:25.155 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/32' 2023-07-29T02:03:25.155 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/30' 2023-07-29T02:03:25.155 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/14' 2023-07-29T02:03:25.155 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/18' 2023-07-29T02:03:25.155 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/13' 2023-07-29T02:03:25.155 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/33' 2023-07-29T02:03:25.155 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/17' 2023-07-29T02:03:25.156 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/35' 2023-07-29T02:03:25.156 INFO:tasks.workunit.client.0.smithi042.stdout:removed './163/37' 2023-07-29T02:03:25.156 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './163' 2023-07-29T02:03:25.156 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/19' 2023-07-29T02:03:25.156 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/15' 2023-07-29T02:03:25.156 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/31' 2023-07-29T02:03:25.156 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/36' 2023-07-29T02:03:25.156 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/20' 2023-07-29T02:03:25.157 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/12' 2023-07-29T02:03:25.157 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/39' 2023-07-29T02:03:25.157 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/10' 2023-07-29T02:03:25.157 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/34' 2023-07-29T02:03:25.157 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/38' 2023-07-29T02:03:25.157 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/11' 2023-07-29T02:03:25.157 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/16' 2023-07-29T02:03:25.157 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/32' 2023-07-29T02:03:25.158 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/30' 2023-07-29T02:03:25.158 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/14' 2023-07-29T02:03:25.158 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/18' 2023-07-29T02:03:25.158 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/13' 2023-07-29T02:03:25.158 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/33' 2023-07-29T02:03:25.158 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/17' 2023-07-29T02:03:25.158 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/35' 2023-07-29T02:03:25.158 INFO:tasks.workunit.client.0.smithi042.stdout:removed './164/37' 2023-07-29T02:03:25.159 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './164' 2023-07-29T02:03:25.159 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/19' 2023-07-29T02:03:25.159 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/15' 2023-07-29T02:03:25.159 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/31' 2023-07-29T02:03:25.159 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/36' 2023-07-29T02:03:25.159 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/20' 2023-07-29T02:03:25.159 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/12' 2023-07-29T02:03:25.160 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/39' 2023-07-29T02:03:25.160 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/10' 2023-07-29T02:03:25.160 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/34' 2023-07-29T02:03:25.160 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/38' 2023-07-29T02:03:25.160 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/11' 2023-07-29T02:03:25.160 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/16' 2023-07-29T02:03:25.161 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/32' 2023-07-29T02:03:25.161 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/30' 2023-07-29T02:03:25.161 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/14' 2023-07-29T02:03:25.161 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/18' 2023-07-29T02:03:25.161 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/13' 2023-07-29T02:03:25.161 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/33' 2023-07-29T02:03:25.161 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/17' 2023-07-29T02:03:25.161 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/35' 2023-07-29T02:03:25.162 INFO:tasks.workunit.client.0.smithi042.stdout:removed './165/37' 2023-07-29T02:03:25.162 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './165' 2023-07-29T02:03:25.162 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/19' 2023-07-29T02:03:25.162 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/15' 2023-07-29T02:03:25.162 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/31' 2023-07-29T02:03:25.162 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/36' 2023-07-29T02:03:25.162 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/20' 2023-07-29T02:03:25.163 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/12' 2023-07-29T02:03:25.163 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/39' 2023-07-29T02:03:25.163 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/10' 2023-07-29T02:03:25.163 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/34' 2023-07-29T02:03:25.163 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/38' 2023-07-29T02:03:25.163 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/11' 2023-07-29T02:03:25.163 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/16' 2023-07-29T02:03:25.163 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/32' 2023-07-29T02:03:25.164 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/30' 2023-07-29T02:03:25.164 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/14' 2023-07-29T02:03:25.164 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/18' 2023-07-29T02:03:25.164 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/13' 2023-07-29T02:03:25.164 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/33' 2023-07-29T02:03:25.165 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/17' 2023-07-29T02:03:25.165 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/35' 2023-07-29T02:03:25.165 INFO:tasks.workunit.client.0.smithi042.stdout:removed './166/37' 2023-07-29T02:03:25.165 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './166' 2023-07-29T02:03:25.165 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/19' 2023-07-29T02:03:25.165 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/15' 2023-07-29T02:03:25.165 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/31' 2023-07-29T02:03:25.166 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/36' 2023-07-29T02:03:25.166 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/20' 2023-07-29T02:03:25.166 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/12' 2023-07-29T02:03:25.166 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/39' 2023-07-29T02:03:25.166 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/10' 2023-07-29T02:03:25.166 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/34' 2023-07-29T02:03:25.166 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/38' 2023-07-29T02:03:25.535 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/11' 2023-07-29T02:03:25.536 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/16' 2023-07-29T02:03:25.536 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/32' 2023-07-29T02:03:25.537 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/30' 2023-07-29T02:03:25.537 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/14' 2023-07-29T02:03:25.537 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/18' 2023-07-29T02:03:25.537 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/13' 2023-07-29T02:03:25.538 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/33' 2023-07-29T02:03:25.538 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/17' 2023-07-29T02:03:25.538 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/35' 2023-07-29T02:03:25.539 INFO:tasks.workunit.client.0.smithi042.stdout:removed './167/37' 2023-07-29T02:03:25.539 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './167' 2023-07-29T02:03:25.539 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/19' 2023-07-29T02:03:25.539 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/15' 2023-07-29T02:03:25.539 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/31' 2023-07-29T02:03:25.539 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/36' 2023-07-29T02:03:25.539 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/20' 2023-07-29T02:03:25.540 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/12' 2023-07-29T02:03:25.540 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/39' 2023-07-29T02:03:25.540 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/10' 2023-07-29T02:03:25.540 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/34' 2023-07-29T02:03:25.540 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/38' 2023-07-29T02:03:25.540 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/11' 2023-07-29T02:03:25.540 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/16' 2023-07-29T02:03:25.541 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/32' 2023-07-29T02:03:25.541 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/30' 2023-07-29T02:03:25.541 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/14' 2023-07-29T02:03:25.541 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/18' 2023-07-29T02:03:25.541 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/13' 2023-07-29T02:03:25.541 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/33' 2023-07-29T02:03:25.541 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/17' 2023-07-29T02:03:25.541 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/35' 2023-07-29T02:03:25.542 INFO:tasks.workunit.client.0.smithi042.stdout:removed './168/37' 2023-07-29T02:03:25.542 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './168' 2023-07-29T02:03:25.542 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/19' 2023-07-29T02:03:25.542 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/15' 2023-07-29T02:03:25.542 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/31' 2023-07-29T02:03:25.542 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/36' 2023-07-29T02:03:25.542 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/20' 2023-07-29T02:03:25.542 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/12' 2023-07-29T02:03:25.543 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/39' 2023-07-29T02:03:25.543 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/10' 2023-07-29T02:03:25.543 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/34' 2023-07-29T02:03:25.543 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/38' 2023-07-29T02:03:25.543 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/11' 2023-07-29T02:03:25.543 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/16' 2023-07-29T02:03:25.543 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/32' 2023-07-29T02:03:25.543 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/30' 2023-07-29T02:03:25.544 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/14' 2023-07-29T02:03:25.544 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/18' 2023-07-29T02:03:25.544 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/13' 2023-07-29T02:03:25.544 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/33' 2023-07-29T02:03:25.544 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/17' 2023-07-29T02:03:25.544 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/35' 2023-07-29T02:03:25.544 INFO:tasks.workunit.client.0.smithi042.stdout:removed './169/37' 2023-07-29T02:03:25.545 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './169' 2023-07-29T02:03:25.545 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/19' 2023-07-29T02:03:25.545 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/15' 2023-07-29T02:03:25.545 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/31' 2023-07-29T02:03:25.545 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/36' 2023-07-29T02:03:25.545 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/20' 2023-07-29T02:03:25.545 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/12' 2023-07-29T02:03:25.545 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/39' 2023-07-29T02:03:25.546 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/10' 2023-07-29T02:03:25.546 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/34' 2023-07-29T02:03:25.546 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/38' 2023-07-29T02:03:25.546 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/11' 2023-07-29T02:03:25.546 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/16' 2023-07-29T02:03:25.546 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/32' 2023-07-29T02:03:25.546 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/30' 2023-07-29T02:03:25.547 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/14' 2023-07-29T02:03:25.547 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/18' 2023-07-29T02:03:25.547 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/13' 2023-07-29T02:03:25.547 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/33' 2023-07-29T02:03:25.547 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/17' 2023-07-29T02:03:25.547 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/35' 2023-07-29T02:03:25.547 INFO:tasks.workunit.client.0.smithi042.stdout:removed './170/37' 2023-07-29T02:03:25.547 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './170' 2023-07-29T02:03:25.548 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/19' 2023-07-29T02:03:25.548 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/15' 2023-07-29T02:03:25.548 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/31' 2023-07-29T02:03:25.548 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/36' 2023-07-29T02:03:25.548 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/20' 2023-07-29T02:03:25.548 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/12' 2023-07-29T02:03:25.549 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/39' 2023-07-29T02:03:25.549 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/10' 2023-07-29T02:03:25.549 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/34' 2023-07-29T02:03:25.549 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/38' 2023-07-29T02:03:25.549 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/11' 2023-07-29T02:03:25.549 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/16' 2023-07-29T02:03:25.549 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/32' 2023-07-29T02:03:25.550 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/30' 2023-07-29T02:03:25.550 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/14' 2023-07-29T02:03:25.550 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/18' 2023-07-29T02:03:25.550 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/13' 2023-07-29T02:03:25.550 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/33' 2023-07-29T02:03:25.550 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/17' 2023-07-29T02:03:25.550 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/35' 2023-07-29T02:03:25.550 INFO:tasks.workunit.client.0.smithi042.stdout:removed './171/37' 2023-07-29T02:03:25.551 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './171' 2023-07-29T02:03:25.551 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/19' 2023-07-29T02:03:25.551 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/15' 2023-07-29T02:03:25.551 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/31' 2023-07-29T02:03:25.551 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/36' 2023-07-29T02:03:25.551 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/20' 2023-07-29T02:03:25.551 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/12' 2023-07-29T02:03:25.552 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/39' 2023-07-29T02:03:25.552 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/10' 2023-07-29T02:03:25.552 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/34' 2023-07-29T02:03:25.552 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/38' 2023-07-29T02:03:25.552 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/11' 2023-07-29T02:03:25.552 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/16' 2023-07-29T02:03:25.552 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/32' 2023-07-29T02:03:25.553 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/30' 2023-07-29T02:03:25.553 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/14' 2023-07-29T02:03:25.553 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/18' 2023-07-29T02:03:25.553 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/13' 2023-07-29T02:03:25.553 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/33' 2023-07-29T02:03:25.553 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/17' 2023-07-29T02:03:25.553 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/35' 2023-07-29T02:03:25.553 INFO:tasks.workunit.client.0.smithi042.stdout:removed './172/37' 2023-07-29T02:03:25.554 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './172' 2023-07-29T02:03:25.554 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/19' 2023-07-29T02:03:25.554 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/15' 2023-07-29T02:03:25.554 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/31' 2023-07-29T02:03:25.554 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/36' 2023-07-29T02:03:25.554 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/20' 2023-07-29T02:03:25.554 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/12' 2023-07-29T02:03:25.554 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/39' 2023-07-29T02:03:25.555 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/10' 2023-07-29T02:03:25.555 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/34' 2023-07-29T02:03:25.555 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/38' 2023-07-29T02:03:25.555 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/11' 2023-07-29T02:03:25.555 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/16' 2023-07-29T02:03:25.555 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/32' 2023-07-29T02:03:25.555 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/30' 2023-07-29T02:03:25.555 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/14' 2023-07-29T02:03:25.556 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/18' 2023-07-29T02:03:25.556 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/13' 2023-07-29T02:03:25.556 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/33' 2023-07-29T02:03:25.556 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/17' 2023-07-29T02:03:25.556 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/35' 2023-07-29T02:03:25.556 INFO:tasks.workunit.client.0.smithi042.stdout:removed './173/37' 2023-07-29T02:03:25.556 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './173' 2023-07-29T02:03:25.557 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/19' 2023-07-29T02:03:25.557 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/15' 2023-07-29T02:03:25.557 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/31' 2023-07-29T02:03:25.557 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/36' 2023-07-29T02:03:25.557 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/20' 2023-07-29T02:03:25.557 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/12' 2023-07-29T02:03:25.557 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/39' 2023-07-29T02:03:25.557 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/10' 2023-07-29T02:03:25.558 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/34' 2023-07-29T02:03:25.558 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/38' 2023-07-29T02:03:25.558 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/11' 2023-07-29T02:03:25.558 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/16' 2023-07-29T02:03:25.558 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/32' 2023-07-29T02:03:25.558 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/30' 2023-07-29T02:03:25.559 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/14' 2023-07-29T02:03:25.559 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/18' 2023-07-29T02:03:25.559 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/13' 2023-07-29T02:03:25.559 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/33' 2023-07-29T02:03:25.559 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/17' 2023-07-29T02:03:25.559 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/35' 2023-07-29T02:03:25.559 INFO:tasks.workunit.client.0.smithi042.stdout:removed './174/37' 2023-07-29T02:03:25.559 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './174' 2023-07-29T02:03:25.560 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/19' 2023-07-29T02:03:25.560 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/15' 2023-07-29T02:03:25.560 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/31' 2023-07-29T02:03:25.560 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/36' 2023-07-29T02:03:25.560 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/20' 2023-07-29T02:03:25.560 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/12' 2023-07-29T02:03:25.560 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/39' 2023-07-29T02:03:25.561 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/10' 2023-07-29T02:03:25.561 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/34' 2023-07-29T02:03:25.561 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/38' 2023-07-29T02:03:25.561 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/11' 2023-07-29T02:03:25.561 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/16' 2023-07-29T02:03:25.561 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/32' 2023-07-29T02:03:25.561 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/30' 2023-07-29T02:03:25.561 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/14' 2023-07-29T02:03:25.562 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/18' 2023-07-29T02:03:25.562 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/13' 2023-07-29T02:03:25.562 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/33' 2023-07-29T02:03:25.562 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/17' 2023-07-29T02:03:25.562 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/35' 2023-07-29T02:03:25.562 INFO:tasks.workunit.client.0.smithi042.stdout:removed './175/37' 2023-07-29T02:03:25.562 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './175' 2023-07-29T02:03:25.562 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/19' 2023-07-29T02:03:25.563 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/15' 2023-07-29T02:03:25.563 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/31' 2023-07-29T02:03:25.563 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/36' 2023-07-29T02:03:25.563 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/20' 2023-07-29T02:03:25.563 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/12' 2023-07-29T02:03:25.563 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/39' 2023-07-29T02:03:25.564 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/10' 2023-07-29T02:03:25.564 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/34' 2023-07-29T02:03:25.564 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/38' 2023-07-29T02:03:25.564 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/11' 2023-07-29T02:03:25.564 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/16' 2023-07-29T02:03:25.564 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/32' 2023-07-29T02:03:25.564 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/30' 2023-07-29T02:03:25.564 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/14' 2023-07-29T02:03:25.565 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/18' 2023-07-29T02:03:25.565 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/13' 2023-07-29T02:03:25.565 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/33' 2023-07-29T02:03:25.565 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/17' 2023-07-29T02:03:25.565 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/35' 2023-07-29T02:03:25.565 INFO:tasks.workunit.client.0.smithi042.stdout:removed './176/37' 2023-07-29T02:03:25.565 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './176' 2023-07-29T02:03:25.565 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/19' 2023-07-29T02:03:25.566 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/15' 2023-07-29T02:03:26.171 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/31' 2023-07-29T02:03:26.171 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/36' 2023-07-29T02:03:26.172 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/20' 2023-07-29T02:03:26.172 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/12' 2023-07-29T02:03:26.172 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/39' 2023-07-29T02:03:26.172 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/10' 2023-07-29T02:03:26.172 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/34' 2023-07-29T02:03:26.172 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/38' 2023-07-29T02:03:26.173 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/11' 2023-07-29T02:03:26.173 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/16' 2023-07-29T02:03:26.173 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/32' 2023-07-29T02:03:26.173 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/30' 2023-07-29T02:03:26.173 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/14' 2023-07-29T02:03:26.173 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/18' 2023-07-29T02:03:26.173 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/13' 2023-07-29T02:03:26.174 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/33' 2023-07-29T02:03:26.174 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/17' 2023-07-29T02:03:26.174 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/35' 2023-07-29T02:03:26.174 INFO:tasks.workunit.client.0.smithi042.stdout:removed './177/37' 2023-07-29T02:03:26.174 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './177' 2023-07-29T02:03:26.174 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/19' 2023-07-29T02:03:26.174 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/15' 2023-07-29T02:03:26.174 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/31' 2023-07-29T02:03:26.175 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/36' 2023-07-29T02:03:26.175 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/20' 2023-07-29T02:03:26.175 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/12' 2023-07-29T02:03:26.175 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/39' 2023-07-29T02:03:26.175 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/10' 2023-07-29T02:03:26.175 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/34' 2023-07-29T02:03:26.175 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/38' 2023-07-29T02:03:26.175 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/11' 2023-07-29T02:03:26.176 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/16' 2023-07-29T02:03:26.176 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/32' 2023-07-29T02:03:26.176 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/30' 2023-07-29T02:03:26.176 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/14' 2023-07-29T02:03:26.176 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/18' 2023-07-29T02:03:26.176 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/13' 2023-07-29T02:03:26.176 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/33' 2023-07-29T02:03:26.177 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/17' 2023-07-29T02:03:26.177 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/35' 2023-07-29T02:03:26.177 INFO:tasks.workunit.client.0.smithi042.stdout:removed './178/37' 2023-07-29T02:03:26.177 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './178' 2023-07-29T02:03:26.177 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/19' 2023-07-29T02:03:26.177 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/15' 2023-07-29T02:03:26.177 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/31' 2023-07-29T02:03:26.178 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/36' 2023-07-29T02:03:26.178 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/20' 2023-07-29T02:03:26.178 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/12' 2023-07-29T02:03:26.178 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/39' 2023-07-29T02:03:26.178 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/10' 2023-07-29T02:03:26.179 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/34' 2023-07-29T02:03:26.179 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/38' 2023-07-29T02:03:26.179 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/11' 2023-07-29T02:03:26.179 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/16' 2023-07-29T02:03:26.179 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/32' 2023-07-29T02:03:26.179 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/30' 2023-07-29T02:03:26.179 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/14' 2023-07-29T02:03:26.180 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/18' 2023-07-29T02:03:26.180 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/13' 2023-07-29T02:03:26.180 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/33' 2023-07-29T02:03:26.180 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/17' 2023-07-29T02:03:26.181 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/35' 2023-07-29T02:03:26.181 INFO:tasks.workunit.client.0.smithi042.stdout:removed './179/37' 2023-07-29T02:03:26.181 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './179' 2023-07-29T02:03:26.181 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/19' 2023-07-29T02:03:26.182 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/15' 2023-07-29T02:03:26.182 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/31' 2023-07-29T02:03:26.182 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/36' 2023-07-29T02:03:26.182 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/20' 2023-07-29T02:03:26.183 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/12' 2023-07-29T02:03:26.183 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/39' 2023-07-29T02:03:26.183 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/10' 2023-07-29T02:03:26.184 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/34' 2023-07-29T02:03:26.184 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/38' 2023-07-29T02:03:26.184 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/11' 2023-07-29T02:03:26.184 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/16' 2023-07-29T02:03:26.185 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/32' 2023-07-29T02:03:26.185 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/30' 2023-07-29T02:03:26.185 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/14' 2023-07-29T02:03:26.185 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/18' 2023-07-29T02:03:26.186 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/13' 2023-07-29T02:03:26.186 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/33' 2023-07-29T02:03:26.186 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/17' 2023-07-29T02:03:26.186 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/35' 2023-07-29T02:03:26.186 INFO:tasks.workunit.client.0.smithi042.stdout:removed './180/37' 2023-07-29T02:03:26.186 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './180' 2023-07-29T02:03:26.186 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/19' 2023-07-29T02:03:26.187 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/15' 2023-07-29T02:03:26.187 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/31' 2023-07-29T02:03:26.187 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/36' 2023-07-29T02:03:26.187 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/20' 2023-07-29T02:03:26.187 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/12' 2023-07-29T02:03:26.187 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/39' 2023-07-29T02:03:26.187 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/10' 2023-07-29T02:03:26.188 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/34' 2023-07-29T02:03:26.188 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/38' 2023-07-29T02:03:26.188 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/11' 2023-07-29T02:03:26.188 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/16' 2023-07-29T02:03:26.188 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/32' 2023-07-29T02:03:26.188 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/30' 2023-07-29T02:03:26.188 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/14' 2023-07-29T02:03:26.189 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/18' 2023-07-29T02:03:26.189 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/13' 2023-07-29T02:03:26.189 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/33' 2023-07-29T02:03:26.189 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/17' 2023-07-29T02:03:26.189 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/35' 2023-07-29T02:03:26.189 INFO:tasks.workunit.client.0.smithi042.stdout:removed './181/37' 2023-07-29T02:03:26.189 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './181' 2023-07-29T02:03:26.190 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/19' 2023-07-29T02:03:26.190 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/15' 2023-07-29T02:03:26.190 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/31' 2023-07-29T02:03:26.190 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/36' 2023-07-29T02:03:26.190 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/20' 2023-07-29T02:03:26.190 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/12' 2023-07-29T02:03:26.190 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/39' 2023-07-29T02:03:26.191 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/10' 2023-07-29T02:03:26.191 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/34' 2023-07-29T02:03:26.191 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/38' 2023-07-29T02:03:26.191 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/11' 2023-07-29T02:03:26.191 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/16' 2023-07-29T02:03:26.191 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/32' 2023-07-29T02:03:26.191 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/30' 2023-07-29T02:03:26.191 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/14' 2023-07-29T02:03:26.192 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/18' 2023-07-29T02:03:26.192 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/13' 2023-07-29T02:03:26.192 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/33' 2023-07-29T02:03:26.192 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/17' 2023-07-29T02:03:26.192 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/35' 2023-07-29T02:03:26.192 INFO:tasks.workunit.client.0.smithi042.stdout:removed './182/37' 2023-07-29T02:03:26.193 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './182' 2023-07-29T02:03:26.193 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/19' 2023-07-29T02:03:26.193 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/15' 2023-07-29T02:03:26.193 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/31' 2023-07-29T02:03:26.193 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/36' 2023-07-29T02:03:26.194 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/20' 2023-07-29T02:03:26.194 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/12' 2023-07-29T02:03:26.194 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/39' 2023-07-29T02:03:26.194 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/10' 2023-07-29T02:03:26.195 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/34' 2023-07-29T02:03:26.195 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/38' 2023-07-29T02:03:26.195 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/11' 2023-07-29T02:03:26.195 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/16' 2023-07-29T02:03:26.196 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/32' 2023-07-29T02:03:26.196 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/30' 2023-07-29T02:03:26.196 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/14' 2023-07-29T02:03:26.197 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/18' 2023-07-29T02:03:26.197 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/13' 2023-07-29T02:03:26.197 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/33' 2023-07-29T02:03:26.197 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/17' 2023-07-29T02:03:26.198 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/35' 2023-07-29T02:03:26.198 INFO:tasks.workunit.client.0.smithi042.stdout:removed './183/37' 2023-07-29T02:03:26.198 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './183' 2023-07-29T02:03:26.198 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/19' 2023-07-29T02:03:26.199 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/15' 2023-07-29T02:03:26.199 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/31' 2023-07-29T02:03:26.199 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/36' 2023-07-29T02:03:26.200 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/20' 2023-07-29T02:03:26.200 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/12' 2023-07-29T02:03:26.200 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/39' 2023-07-29T02:03:26.200 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/10' 2023-07-29T02:03:26.201 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/34' 2023-07-29T02:03:26.201 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/38' 2023-07-29T02:03:26.201 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/11' 2023-07-29T02:03:26.202 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/16' 2023-07-29T02:03:26.202 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/32' 2023-07-29T02:03:26.202 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/30' 2023-07-29T02:03:26.202 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/14' 2023-07-29T02:03:26.202 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/18' 2023-07-29T02:03:26.202 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/13' 2023-07-29T02:03:26.203 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/33' 2023-07-29T02:03:26.203 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/17' 2023-07-29T02:03:26.203 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/35' 2023-07-29T02:03:26.203 INFO:tasks.workunit.client.0.smithi042.stdout:removed './184/37' 2023-07-29T02:03:26.203 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './184' 2023-07-29T02:03:26.203 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/19' 2023-07-29T02:03:26.203 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/15' 2023-07-29T02:03:26.204 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/31' 2023-07-29T02:03:26.204 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/36' 2023-07-29T02:03:26.204 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/20' 2023-07-29T02:03:26.204 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/12' 2023-07-29T02:03:26.204 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/39' 2023-07-29T02:03:26.205 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/10' 2023-07-29T02:03:26.205 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/34' 2023-07-29T02:03:26.205 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/38' 2023-07-29T02:03:26.205 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/11' 2023-07-29T02:03:26.205 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/16' 2023-07-29T02:03:26.205 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/32' 2023-07-29T02:03:26.205 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/30' 2023-07-29T02:03:26.206 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/14' 2023-07-29T02:03:26.206 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/18' 2023-07-29T02:03:26.206 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/13' 2023-07-29T02:03:26.206 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/33' 2023-07-29T02:03:26.206 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/17' 2023-07-29T02:03:26.207 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/35' 2023-07-29T02:03:26.207 INFO:tasks.workunit.client.0.smithi042.stdout:removed './185/37' 2023-07-29T02:03:26.207 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './185' 2023-07-29T02:03:26.207 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/19' 2023-07-29T02:03:26.207 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/15' 2023-07-29T02:03:26.207 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/31' 2023-07-29T02:03:26.207 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/36' 2023-07-29T02:03:26.208 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/20' 2023-07-29T02:03:26.208 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/12' 2023-07-29T02:03:26.208 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/39' 2023-07-29T02:03:26.208 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/10' 2023-07-29T02:03:26.209 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/34' 2023-07-29T02:03:26.209 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/38' 2023-07-29T02:03:26.209 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/11' 2023-07-29T02:03:26.209 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/16' 2023-07-29T02:03:26.209 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/32' 2023-07-29T02:03:26.210 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/30' 2023-07-29T02:03:26.210 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/14' 2023-07-29T02:03:26.210 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/18' 2023-07-29T02:03:26.585 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/13' 2023-07-29T02:03:26.585 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/33' 2023-07-29T02:03:26.586 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/17' 2023-07-29T02:03:26.586 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/35' 2023-07-29T02:03:26.586 INFO:tasks.workunit.client.0.smithi042.stdout:removed './186/37' 2023-07-29T02:03:26.586 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './186' 2023-07-29T02:03:26.587 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/19' 2023-07-29T02:03:26.587 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/15' 2023-07-29T02:03:26.588 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/31' 2023-07-29T02:03:26.588 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/36' 2023-07-29T02:03:26.588 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/20' 2023-07-29T02:03:26.588 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/12' 2023-07-29T02:03:26.589 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/39' 2023-07-29T02:03:26.589 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/10' 2023-07-29T02:03:26.589 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/34' 2023-07-29T02:03:26.590 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/38' 2023-07-29T02:03:26.590 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/11' 2023-07-29T02:03:26.590 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/16' 2023-07-29T02:03:26.590 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/32' 2023-07-29T02:03:26.591 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/30' 2023-07-29T02:03:26.591 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/14' 2023-07-29T02:03:26.591 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/18' 2023-07-29T02:03:26.591 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/13' 2023-07-29T02:03:26.592 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/33' 2023-07-29T02:03:26.592 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/17' 2023-07-29T02:03:26.592 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/35' 2023-07-29T02:03:26.592 INFO:tasks.workunit.client.0.smithi042.stdout:removed './187/37' 2023-07-29T02:03:26.593 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './187' 2023-07-29T02:03:26.593 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/19' 2023-07-29T02:03:26.593 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/15' 2023-07-29T02:03:26.594 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/31' 2023-07-29T02:03:26.594 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/36' 2023-07-29T02:03:26.594 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/20' 2023-07-29T02:03:26.595 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/12' 2023-07-29T02:03:26.595 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/39' 2023-07-29T02:03:26.595 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/10' 2023-07-29T02:03:26.595 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/34' 2023-07-29T02:03:26.595 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/38' 2023-07-29T02:03:26.595 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/11' 2023-07-29T02:03:26.596 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/16' 2023-07-29T02:03:26.596 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/32' 2023-07-29T02:03:26.596 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/30' 2023-07-29T02:03:26.596 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/14' 2023-07-29T02:03:26.596 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/18' 2023-07-29T02:03:26.596 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/13' 2023-07-29T02:03:26.596 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/33' 2023-07-29T02:03:26.596 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/17' 2023-07-29T02:03:26.597 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/35' 2023-07-29T02:03:26.597 INFO:tasks.workunit.client.0.smithi042.stdout:removed './188/37' 2023-07-29T02:03:26.597 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './188' 2023-07-29T02:03:26.597 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/19' 2023-07-29T02:03:26.597 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/15' 2023-07-29T02:03:26.597 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/31' 2023-07-29T02:03:26.597 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/36' 2023-07-29T02:03:26.598 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/20' 2023-07-29T02:03:26.598 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/12' 2023-07-29T02:03:26.598 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/39' 2023-07-29T02:03:26.598 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/10' 2023-07-29T02:03:26.598 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/34' 2023-07-29T02:03:26.598 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/38' 2023-07-29T02:03:26.598 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/11' 2023-07-29T02:03:26.598 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/16' 2023-07-29T02:03:26.599 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/32' 2023-07-29T02:03:26.599 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/30' 2023-07-29T02:03:26.599 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/14' 2023-07-29T02:03:26.599 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/18' 2023-07-29T02:03:26.599 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/13' 2023-07-29T02:03:26.599 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/33' 2023-07-29T02:03:26.599 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/17' 2023-07-29T02:03:26.599 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/35' 2023-07-29T02:03:26.600 INFO:tasks.workunit.client.0.smithi042.stdout:removed './189/37' 2023-07-29T02:03:26.600 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './189' 2023-07-29T02:03:26.600 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/19' 2023-07-29T02:03:26.600 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/15' 2023-07-29T02:03:26.600 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/31' 2023-07-29T02:03:26.600 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/36' 2023-07-29T02:03:26.600 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/20' 2023-07-29T02:03:26.600 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/12' 2023-07-29T02:03:26.601 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/39' 2023-07-29T02:03:26.601 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/10' 2023-07-29T02:03:26.601 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/34' 2023-07-29T02:03:26.601 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/38' 2023-07-29T02:03:26.601 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/11' 2023-07-29T02:03:26.601 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/16' 2023-07-29T02:03:26.601 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/32' 2023-07-29T02:03:26.601 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/30' 2023-07-29T02:03:26.602 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/14' 2023-07-29T02:03:26.602 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/18' 2023-07-29T02:03:26.602 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/13' 2023-07-29T02:03:26.602 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/33' 2023-07-29T02:03:26.602 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/17' 2023-07-29T02:03:26.602 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/35' 2023-07-29T02:03:26.602 INFO:tasks.workunit.client.0.smithi042.stdout:removed './190/37' 2023-07-29T02:03:26.603 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './190' 2023-07-29T02:03:26.603 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/19' 2023-07-29T02:03:26.603 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/15' 2023-07-29T02:03:26.603 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/31' 2023-07-29T02:03:26.603 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/36' 2023-07-29T02:03:26.603 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/20' 2023-07-29T02:03:26.603 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/12' 2023-07-29T02:03:26.603 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/39' 2023-07-29T02:03:26.604 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/10' 2023-07-29T02:03:26.604 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/34' 2023-07-29T02:03:26.604 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/38' 2023-07-29T02:03:26.604 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/11' 2023-07-29T02:03:26.604 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/16' 2023-07-29T02:03:26.604 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/32' 2023-07-29T02:03:26.604 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/30' 2023-07-29T02:03:26.605 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/14' 2023-07-29T02:03:26.605 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/18' 2023-07-29T02:03:26.605 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/13' 2023-07-29T02:03:26.605 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/33' 2023-07-29T02:03:26.605 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/17' 2023-07-29T02:03:26.605 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/35' 2023-07-29T02:03:26.606 INFO:tasks.workunit.client.0.smithi042.stdout:removed './191/37' 2023-07-29T02:03:26.606 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './191' 2023-07-29T02:03:26.606 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/19' 2023-07-29T02:03:26.606 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/15' 2023-07-29T02:03:26.606 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/31' 2023-07-29T02:03:26.606 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/36' 2023-07-29T02:03:26.606 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/20' 2023-07-29T02:03:26.606 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/12' 2023-07-29T02:03:26.607 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/39' 2023-07-29T02:03:26.607 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/10' 2023-07-29T02:03:26.607 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/34' 2023-07-29T02:03:26.607 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/38' 2023-07-29T02:03:26.607 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/11' 2023-07-29T02:03:26.607 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/16' 2023-07-29T02:03:26.607 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/32' 2023-07-29T02:03:26.607 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/30' 2023-07-29T02:03:26.608 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/14' 2023-07-29T02:03:26.608 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/18' 2023-07-29T02:03:26.608 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/13' 2023-07-29T02:03:26.608 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/33' 2023-07-29T02:03:26.608 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/17' 2023-07-29T02:03:26.608 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/35' 2023-07-29T02:03:26.608 INFO:tasks.workunit.client.0.smithi042.stdout:removed './192/37' 2023-07-29T02:03:26.609 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './192' 2023-07-29T02:03:26.609 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/19' 2023-07-29T02:03:26.609 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/15' 2023-07-29T02:03:26.609 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/31' 2023-07-29T02:03:26.609 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/36' 2023-07-29T02:03:26.609 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/20' 2023-07-29T02:03:26.609 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/12' 2023-07-29T02:03:26.609 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/39' 2023-07-29T02:03:26.610 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/10' 2023-07-29T02:03:26.610 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/34' 2023-07-29T02:03:26.610 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/38' 2023-07-29T02:03:26.610 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/11' 2023-07-29T02:03:26.610 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/16' 2023-07-29T02:03:26.610 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/32' 2023-07-29T02:03:26.610 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/30' 2023-07-29T02:03:26.611 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/14' 2023-07-29T02:03:26.611 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/18' 2023-07-29T02:03:26.611 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/13' 2023-07-29T02:03:26.611 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/33' 2023-07-29T02:03:26.611 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/17' 2023-07-29T02:03:26.611 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/35' 2023-07-29T02:03:26.611 INFO:tasks.workunit.client.0.smithi042.stdout:removed './193/37' 2023-07-29T02:03:26.612 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './193' 2023-07-29T02:03:26.612 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/19' 2023-07-29T02:03:26.612 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/15' 2023-07-29T02:03:26.612 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/31' 2023-07-29T02:03:26.612 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/36' 2023-07-29T02:03:26.613 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/20' 2023-07-29T02:03:26.613 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/12' 2023-07-29T02:03:26.613 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/39' 2023-07-29T02:03:26.613 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/10' 2023-07-29T02:03:26.613 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/34' 2023-07-29T02:03:26.613 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/38' 2023-07-29T02:03:26.613 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/11' 2023-07-29T02:03:26.614 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/16' 2023-07-29T02:03:26.614 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/32' 2023-07-29T02:03:26.614 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/30' 2023-07-29T02:03:26.614 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/14' 2023-07-29T02:03:26.614 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/18' 2023-07-29T02:03:26.614 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/13' 2023-07-29T02:03:26.615 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/33' 2023-07-29T02:03:26.615 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/17' 2023-07-29T02:03:26.615 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/35' 2023-07-29T02:03:26.615 INFO:tasks.workunit.client.0.smithi042.stdout:removed './194/37' 2023-07-29T02:03:26.615 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './194' 2023-07-29T02:03:26.616 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/19' 2023-07-29T02:03:26.616 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/15' 2023-07-29T02:03:26.616 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/31' 2023-07-29T02:03:26.616 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/36' 2023-07-29T02:03:26.616 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/20' 2023-07-29T02:03:26.616 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/12' 2023-07-29T02:03:26.616 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/39' 2023-07-29T02:03:26.617 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/10' 2023-07-29T02:03:26.617 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/34' 2023-07-29T02:03:26.617 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/38' 2023-07-29T02:03:26.617 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/11' 2023-07-29T02:03:26.617 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/16' 2023-07-29T02:03:26.617 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/32' 2023-07-29T02:03:26.617 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/30' 2023-07-29T02:03:26.617 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/14' 2023-07-29T02:03:26.618 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/18' 2023-07-29T02:03:26.618 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/13' 2023-07-29T02:03:26.618 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/33' 2023-07-29T02:03:26.618 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/17' 2023-07-29T02:03:26.618 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/35' 2023-07-29T02:03:26.618 INFO:tasks.workunit.client.0.smithi042.stdout:removed './195/37' 2023-07-29T02:03:26.618 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './195' 2023-07-29T02:03:26.618 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/19' 2023-07-29T02:03:26.619 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/15' 2023-07-29T02:03:26.619 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/31' 2023-07-29T02:03:26.619 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/36' 2023-07-29T02:03:26.619 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/20' 2023-07-29T02:03:26.619 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/12' 2023-07-29T02:03:26.619 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/39' 2023-07-29T02:03:26.619 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/10' 2023-07-29T02:03:27.155 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/34' 2023-07-29T02:03:27.156 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/38' 2023-07-29T02:03:27.156 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/11' 2023-07-29T02:03:27.156 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/16' 2023-07-29T02:03:27.156 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/32' 2023-07-29T02:03:27.156 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/30' 2023-07-29T02:03:27.157 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/14' 2023-07-29T02:03:27.157 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/18' 2023-07-29T02:03:27.157 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/13' 2023-07-29T02:03:27.157 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/33' 2023-07-29T02:03:27.157 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/17' 2023-07-29T02:03:27.157 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/35' 2023-07-29T02:03:27.157 INFO:tasks.workunit.client.0.smithi042.stdout:removed './196/37' 2023-07-29T02:03:27.157 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './196' 2023-07-29T02:03:27.158 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/19' 2023-07-29T02:03:27.158 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/15' 2023-07-29T02:03:27.158 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/31' 2023-07-29T02:03:27.158 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/36' 2023-07-29T02:03:27.158 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/20' 2023-07-29T02:03:27.158 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/12' 2023-07-29T02:03:27.158 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/39' 2023-07-29T02:03:27.158 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/10' 2023-07-29T02:03:27.159 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/34' 2023-07-29T02:03:27.159 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/38' 2023-07-29T02:03:27.159 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/11' 2023-07-29T02:03:27.159 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/16' 2023-07-29T02:03:27.159 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/32' 2023-07-29T02:03:27.159 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/30' 2023-07-29T02:03:27.159 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/14' 2023-07-29T02:03:27.159 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/18' 2023-07-29T02:03:27.160 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/13' 2023-07-29T02:03:27.160 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/33' 2023-07-29T02:03:27.160 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/17' 2023-07-29T02:03:27.160 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/35' 2023-07-29T02:03:27.160 INFO:tasks.workunit.client.0.smithi042.stdout:removed './197/37' 2023-07-29T02:03:27.160 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './197' 2023-07-29T02:03:27.160 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/19' 2023-07-29T02:03:27.161 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/15' 2023-07-29T02:03:27.161 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/31' 2023-07-29T02:03:27.161 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/36' 2023-07-29T02:03:27.161 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/20' 2023-07-29T02:03:27.161 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/12' 2023-07-29T02:03:27.161 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/39' 2023-07-29T02:03:27.161 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/10' 2023-07-29T02:03:27.161 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/34' 2023-07-29T02:03:27.162 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/38' 2023-07-29T02:03:27.162 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/11' 2023-07-29T02:03:27.162 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/16' 2023-07-29T02:03:27.162 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/32' 2023-07-29T02:03:27.162 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/30' 2023-07-29T02:03:27.162 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/14' 2023-07-29T02:03:27.162 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/18' 2023-07-29T02:03:27.162 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/13' 2023-07-29T02:03:27.163 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/33' 2023-07-29T02:03:27.163 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/17' 2023-07-29T02:03:27.163 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/35' 2023-07-29T02:03:27.163 INFO:tasks.workunit.client.0.smithi042.stdout:removed './198/37' 2023-07-29T02:03:27.163 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './198' 2023-07-29T02:03:27.163 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/19' 2023-07-29T02:03:27.163 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/15' 2023-07-29T02:03:27.163 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/31' 2023-07-29T02:03:27.164 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/36' 2023-07-29T02:03:27.164 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/20' 2023-07-29T02:03:27.164 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/12' 2023-07-29T02:03:27.164 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/39' 2023-07-29T02:03:27.164 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/10' 2023-07-29T02:03:27.164 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/34' 2023-07-29T02:03:27.164 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/38' 2023-07-29T02:03:27.164 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/11' 2023-07-29T02:03:27.165 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/16' 2023-07-29T02:03:27.165 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/32' 2023-07-29T02:03:27.165 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/30' 2023-07-29T02:03:27.165 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/14' 2023-07-29T02:03:27.165 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/18' 2023-07-29T02:03:27.165 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/13' 2023-07-29T02:03:27.165 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/33' 2023-07-29T02:03:27.165 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/17' 2023-07-29T02:03:27.166 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/35' 2023-07-29T02:03:27.166 INFO:tasks.workunit.client.0.smithi042.stdout:removed './199/37' 2023-07-29T02:03:27.166 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './199' 2023-07-29T02:03:27.166 INFO:tasks.workunit.client.0.smithi042.stdout:removed './200/21' 2023-07-29T02:03:27.166 INFO:tasks.workunit.client.0.smithi042.stdout:removed './200/27' 2023-07-29T02:03:27.166 INFO:tasks.workunit.client.0.smithi042.stdout:removed './200/31' 2023-07-29T02:03:27.166 INFO:tasks.workunit.client.0.smithi042.stdout:removed './200/36' 2023-07-29T02:03:27.166 INFO:tasks.workunit.client.0.smithi042.stdout:removed './200/20' 2023-07-29T02:03:27.167 INFO:tasks.workunit.client.0.smithi042.stdout:removed './200/39' 2023-07-29T02:03:27.167 INFO:tasks.workunit.client.0.smithi042.stdout:removed './200/34' 2023-07-29T02:03:27.167 INFO:tasks.workunit.client.0.smithi042.stdout:removed './200/38' 2023-07-29T02:03:27.167 INFO:tasks.workunit.client.0.smithi042.stdout:removed './200/28' 2023-07-29T02:03:27.167 INFO:tasks.workunit.client.0.smithi042.stdout:removed './200/24' 2023-07-29T02:03:27.167 INFO:tasks.workunit.client.0.smithi042.stdout:removed './200/29' 2023-07-29T02:03:27.167 INFO:tasks.workunit.client.0.smithi042.stdout:removed './200/32' 2023-07-29T02:03:27.167 INFO:tasks.workunit.client.0.smithi042.stdout:removed './200/22' 2023-07-29T02:03:27.168 INFO:tasks.workunit.client.0.smithi042.stdout:removed './200/25' 2023-07-29T02:03:27.168 INFO:tasks.workunit.client.0.smithi042.stdout:removed './200/30' 2023-07-29T02:03:27.168 INFO:tasks.workunit.client.0.smithi042.stdout:removed './200/33' 2023-07-29T02:03:27.168 INFO:tasks.workunit.client.0.smithi042.stdout:removed './200/23' 2023-07-29T02:03:27.168 INFO:tasks.workunit.client.0.smithi042.stdout:removed './200/35' 2023-07-29T02:03:27.168 INFO:tasks.workunit.client.0.smithi042.stdout:removed './200/26' 2023-07-29T02:03:27.168 INFO:tasks.workunit.client.0.smithi042.stdout:removed './200/37' 2023-07-29T02:03:27.168 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './200' 2023-07-29T02:03:27.169 INFO:tasks.workunit.client.0.smithi042.stdout:removed './201/21' 2023-07-29T02:03:27.169 INFO:tasks.workunit.client.0.smithi042.stdout:removed './201/27' 2023-07-29T02:03:27.169 INFO:tasks.workunit.client.0.smithi042.stdout:removed './201/31' 2023-07-29T02:03:27.169 INFO:tasks.workunit.client.0.smithi042.stdout:removed './201/36' 2023-07-29T02:03:27.169 INFO:tasks.workunit.client.0.smithi042.stdout:removed './201/20' 2023-07-29T02:03:27.169 INFO:tasks.workunit.client.0.smithi042.stdout:removed './201/39' 2023-07-29T02:03:27.169 INFO:tasks.workunit.client.0.smithi042.stdout:removed './201/34' 2023-07-29T02:03:27.169 INFO:tasks.workunit.client.0.smithi042.stdout:removed './201/38' 2023-07-29T02:03:27.170 INFO:tasks.workunit.client.0.smithi042.stdout:removed './201/28' 2023-07-29T02:03:27.170 INFO:tasks.workunit.client.0.smithi042.stdout:removed './201/24' 2023-07-29T02:03:27.170 INFO:tasks.workunit.client.0.smithi042.stdout:removed './201/29' 2023-07-29T02:03:27.170 INFO:tasks.workunit.client.0.smithi042.stdout:removed './201/32' 2023-07-29T02:03:27.170 INFO:tasks.workunit.client.0.smithi042.stdout:removed './201/22' 2023-07-29T02:03:27.170 INFO:tasks.workunit.client.0.smithi042.stdout:removed './201/25' 2023-07-29T02:03:27.170 INFO:tasks.workunit.client.0.smithi042.stdout:removed './201/30' 2023-07-29T02:03:27.170 INFO:tasks.workunit.client.0.smithi042.stdout:removed './201/33' 2023-07-29T02:03:27.171 INFO:tasks.workunit.client.0.smithi042.stdout:removed './201/23' 2023-07-29T02:03:27.171 INFO:tasks.workunit.client.0.smithi042.stdout:removed './201/35' 2023-07-29T02:03:27.171 INFO:tasks.workunit.client.0.smithi042.stdout:removed './201/26' 2023-07-29T02:03:27.171 INFO:tasks.workunit.client.0.smithi042.stdout:removed './201/37' 2023-07-29T02:03:27.171 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './201' 2023-07-29T02:03:27.171 INFO:tasks.workunit.client.0.smithi042.stdout:removed './202/21' 2023-07-29T02:03:27.171 INFO:tasks.workunit.client.0.smithi042.stdout:removed './202/27' 2023-07-29T02:03:27.171 INFO:tasks.workunit.client.0.smithi042.stdout:removed './202/31' 2023-07-29T02:03:27.172 INFO:tasks.workunit.client.0.smithi042.stdout:removed './202/36' 2023-07-29T02:03:27.172 INFO:tasks.workunit.client.0.smithi042.stdout:removed './202/20' 2023-07-29T02:03:27.172 INFO:tasks.workunit.client.0.smithi042.stdout:removed './202/39' 2023-07-29T02:03:27.172 INFO:tasks.workunit.client.0.smithi042.stdout:removed './202/34' 2023-07-29T02:03:27.172 INFO:tasks.workunit.client.0.smithi042.stdout:removed './202/38' 2023-07-29T02:03:27.172 INFO:tasks.workunit.client.0.smithi042.stdout:removed './202/28' 2023-07-29T02:03:27.172 INFO:tasks.workunit.client.0.smithi042.stdout:removed './202/24' 2023-07-29T02:03:27.172 INFO:tasks.workunit.client.0.smithi042.stdout:removed './202/29' 2023-07-29T02:03:27.173 INFO:tasks.workunit.client.0.smithi042.stdout:removed './202/32' 2023-07-29T02:03:27.173 INFO:tasks.workunit.client.0.smithi042.stdout:removed './202/22' 2023-07-29T02:03:27.173 INFO:tasks.workunit.client.0.smithi042.stdout:removed './202/25' 2023-07-29T02:03:27.173 INFO:tasks.workunit.client.0.smithi042.stdout:removed './202/30' 2023-07-29T02:03:27.173 INFO:tasks.workunit.client.0.smithi042.stdout:removed './202/33' 2023-07-29T02:03:27.173 INFO:tasks.workunit.client.0.smithi042.stdout:removed './202/23' 2023-07-29T02:03:27.173 INFO:tasks.workunit.client.0.smithi042.stdout:removed './202/35' 2023-07-29T02:03:27.173 INFO:tasks.workunit.client.0.smithi042.stdout:removed './202/26' 2023-07-29T02:03:27.174 INFO:tasks.workunit.client.0.smithi042.stdout:removed './202/37' 2023-07-29T02:03:27.174 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './202' 2023-07-29T02:03:27.174 INFO:tasks.workunit.client.0.smithi042.stdout:removed './203/21' 2023-07-29T02:03:27.174 INFO:tasks.workunit.client.0.smithi042.stdout:removed './203/27' 2023-07-29T02:03:27.174 INFO:tasks.workunit.client.0.smithi042.stdout:removed './203/31' 2023-07-29T02:03:27.174 INFO:tasks.workunit.client.0.smithi042.stdout:removed './203/36' 2023-07-29T02:03:27.174 INFO:tasks.workunit.client.0.smithi042.stdout:removed './203/20' 2023-07-29T02:03:27.174 INFO:tasks.workunit.client.0.smithi042.stdout:removed './203/39' 2023-07-29T02:03:27.175 INFO:tasks.workunit.client.0.smithi042.stdout:removed './203/34' 2023-07-29T02:03:27.175 INFO:tasks.workunit.client.0.smithi042.stdout:removed './203/38' 2023-07-29T02:03:27.175 INFO:tasks.workunit.client.0.smithi042.stdout:removed './203/28' 2023-07-29T02:03:27.175 INFO:tasks.workunit.client.0.smithi042.stdout:removed './203/24' 2023-07-29T02:03:27.175 INFO:tasks.workunit.client.0.smithi042.stdout:removed './203/29' 2023-07-29T02:03:27.175 INFO:tasks.workunit.client.0.smithi042.stdout:removed './203/32' 2023-07-29T02:03:27.175 INFO:tasks.workunit.client.0.smithi042.stdout:removed './203/22' 2023-07-29T02:03:27.176 INFO:tasks.workunit.client.0.smithi042.stdout:removed './203/25' 2023-07-29T02:03:27.176 INFO:tasks.workunit.client.0.smithi042.stdout:removed './203/30' 2023-07-29T02:03:27.176 INFO:tasks.workunit.client.0.smithi042.stdout:removed './203/33' 2023-07-29T02:03:27.176 INFO:tasks.workunit.client.0.smithi042.stdout:removed './203/23' 2023-07-29T02:03:27.176 INFO:tasks.workunit.client.0.smithi042.stdout:removed './203/35' 2023-07-29T02:03:27.176 INFO:tasks.workunit.client.0.smithi042.stdout:removed './203/26' 2023-07-29T02:03:27.176 INFO:tasks.workunit.client.0.smithi042.stdout:removed './203/37' 2023-07-29T02:03:27.176 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './203' 2023-07-29T02:03:27.177 INFO:tasks.workunit.client.0.smithi042.stdout:removed './204/21' 2023-07-29T02:03:27.177 INFO:tasks.workunit.client.0.smithi042.stdout:removed './204/27' 2023-07-29T02:03:27.177 INFO:tasks.workunit.client.0.smithi042.stdout:removed './204/31' 2023-07-29T02:03:27.177 INFO:tasks.workunit.client.0.smithi042.stdout:removed './204/36' 2023-07-29T02:03:27.177 INFO:tasks.workunit.client.0.smithi042.stdout:removed './204/20' 2023-07-29T02:03:27.177 INFO:tasks.workunit.client.0.smithi042.stdout:removed './204/39' 2023-07-29T02:03:27.177 INFO:tasks.workunit.client.0.smithi042.stdout:removed './204/34' 2023-07-29T02:03:27.177 INFO:tasks.workunit.client.0.smithi042.stdout:removed './204/38' 2023-07-29T02:03:27.178 INFO:tasks.workunit.client.0.smithi042.stdout:removed './204/28' 2023-07-29T02:03:27.178 INFO:tasks.workunit.client.0.smithi042.stdout:removed './204/24' 2023-07-29T02:03:27.178 INFO:tasks.workunit.client.0.smithi042.stdout:removed './204/29' 2023-07-29T02:03:27.178 INFO:tasks.workunit.client.0.smithi042.stdout:removed './204/32' 2023-07-29T02:03:27.178 INFO:tasks.workunit.client.0.smithi042.stdout:removed './204/22' 2023-07-29T02:03:27.178 INFO:tasks.workunit.client.0.smithi042.stdout:removed './204/25' 2023-07-29T02:03:27.178 INFO:tasks.workunit.client.0.smithi042.stdout:removed './204/30' 2023-07-29T02:03:27.178 INFO:tasks.workunit.client.0.smithi042.stdout:removed './204/33' 2023-07-29T02:03:27.179 INFO:tasks.workunit.client.0.smithi042.stdout:removed './204/23' 2023-07-29T02:03:27.179 INFO:tasks.workunit.client.0.smithi042.stdout:removed './204/35' 2023-07-29T02:03:27.179 INFO:tasks.workunit.client.0.smithi042.stdout:removed './204/26' 2023-07-29T02:03:27.179 INFO:tasks.workunit.client.0.smithi042.stdout:removed './204/37' 2023-07-29T02:03:27.179 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './204' 2023-07-29T02:03:27.179 INFO:tasks.workunit.client.0.smithi042.stdout:removed './205/21' 2023-07-29T02:03:27.179 INFO:tasks.workunit.client.0.smithi042.stdout:removed './205/27' 2023-07-29T02:03:27.179 INFO:tasks.workunit.client.0.smithi042.stdout:removed './205/31' 2023-07-29T02:03:27.180 INFO:tasks.workunit.client.0.smithi042.stdout:removed './205/36' 2023-07-29T02:03:27.180 INFO:tasks.workunit.client.0.smithi042.stdout:removed './205/20' 2023-07-29T02:03:27.180 INFO:tasks.workunit.client.0.smithi042.stdout:removed './205/39' 2023-07-29T02:03:27.180 INFO:tasks.workunit.client.0.smithi042.stdout:removed './205/34' 2023-07-29T02:03:27.180 INFO:tasks.workunit.client.0.smithi042.stdout:removed './205/38' 2023-07-29T02:03:27.180 INFO:tasks.workunit.client.0.smithi042.stdout:removed './205/28' 2023-07-29T02:03:27.180 INFO:tasks.workunit.client.0.smithi042.stdout:removed './205/24' 2023-07-29T02:03:27.180 INFO:tasks.workunit.client.0.smithi042.stdout:removed './205/29' 2023-07-29T02:03:27.181 INFO:tasks.workunit.client.0.smithi042.stdout:removed './205/32' 2023-07-29T02:03:27.181 INFO:tasks.workunit.client.0.smithi042.stdout:removed './205/22' 2023-07-29T02:03:27.181 INFO:tasks.workunit.client.0.smithi042.stdout:removed './205/25' 2023-07-29T02:03:27.181 INFO:tasks.workunit.client.0.smithi042.stdout:removed './205/30' 2023-07-29T02:03:27.181 INFO:tasks.workunit.client.0.smithi042.stdout:removed './205/33' 2023-07-29T02:03:27.181 INFO:tasks.workunit.client.0.smithi042.stdout:removed './205/23' 2023-07-29T02:03:27.181 INFO:tasks.workunit.client.0.smithi042.stdout:removed './205/35' 2023-07-29T02:03:27.181 INFO:tasks.workunit.client.0.smithi042.stdout:removed './205/26' 2023-07-29T02:03:27.182 INFO:tasks.workunit.client.0.smithi042.stdout:removed './205/37' 2023-07-29T02:03:27.182 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './205' 2023-07-29T02:03:27.182 INFO:tasks.workunit.client.0.smithi042.stdout:removed './206/21' 2023-07-29T02:03:27.182 INFO:tasks.workunit.client.0.smithi042.stdout:removed './206/27' 2023-07-29T02:03:27.182 INFO:tasks.workunit.client.0.smithi042.stdout:removed './206/31' 2023-07-29T02:03:27.182 INFO:tasks.workunit.client.0.smithi042.stdout:removed './206/36' 2023-07-29T02:03:27.182 INFO:tasks.workunit.client.0.smithi042.stdout:removed './206/20' 2023-07-29T02:03:27.182 INFO:tasks.workunit.client.0.smithi042.stdout:removed './206/39' 2023-07-29T02:03:27.553 INFO:tasks.workunit.client.0.smithi042.stdout:removed './206/34' 2023-07-29T02:03:27.553 INFO:tasks.workunit.client.0.smithi042.stdout:removed './206/38' 2023-07-29T02:03:27.553 INFO:tasks.workunit.client.0.smithi042.stdout:removed './206/28' 2023-07-29T02:03:27.553 INFO:tasks.workunit.client.0.smithi042.stdout:removed './206/24' 2023-07-29T02:03:27.553 INFO:tasks.workunit.client.0.smithi042.stdout:removed './206/29' 2023-07-29T02:03:27.554 INFO:tasks.workunit.client.0.smithi042.stdout:removed './206/32' 2023-07-29T02:03:27.554 INFO:tasks.workunit.client.0.smithi042.stdout:removed './206/22' 2023-07-29T02:03:27.554 INFO:tasks.workunit.client.0.smithi042.stdout:removed './206/25' 2023-07-29T02:03:27.554 INFO:tasks.workunit.client.0.smithi042.stdout:removed './206/30' 2023-07-29T02:03:27.554 INFO:tasks.workunit.client.0.smithi042.stdout:removed './206/33' 2023-07-29T02:03:27.554 INFO:tasks.workunit.client.0.smithi042.stdout:removed './206/23' 2023-07-29T02:03:27.555 INFO:tasks.workunit.client.0.smithi042.stdout:removed './206/35' 2023-07-29T02:03:27.555 INFO:tasks.workunit.client.0.smithi042.stdout:removed './206/26' 2023-07-29T02:03:27.555 INFO:tasks.workunit.client.0.smithi042.stdout:removed './206/37' 2023-07-29T02:03:27.555 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './206' 2023-07-29T02:03:27.555 INFO:tasks.workunit.client.0.smithi042.stdout:removed './207/21' 2023-07-29T02:03:27.555 INFO:tasks.workunit.client.0.smithi042.stdout:removed './207/27' 2023-07-29T02:03:27.555 INFO:tasks.workunit.client.0.smithi042.stdout:removed './207/31' 2023-07-29T02:03:27.556 INFO:tasks.workunit.client.0.smithi042.stdout:removed './207/36' 2023-07-29T02:03:27.556 INFO:tasks.workunit.client.0.smithi042.stdout:removed './207/20' 2023-07-29T02:03:27.556 INFO:tasks.workunit.client.0.smithi042.stdout:removed './207/39' 2023-07-29T02:03:27.556 INFO:tasks.workunit.client.0.smithi042.stdout:removed './207/34' 2023-07-29T02:03:27.556 INFO:tasks.workunit.client.0.smithi042.stdout:removed './207/38' 2023-07-29T02:03:27.556 INFO:tasks.workunit.client.0.smithi042.stdout:removed './207/28' 2023-07-29T02:03:27.556 INFO:tasks.workunit.client.0.smithi042.stdout:removed './207/24' 2023-07-29T02:03:27.556 INFO:tasks.workunit.client.0.smithi042.stdout:removed './207/29' 2023-07-29T02:03:27.557 INFO:tasks.workunit.client.0.smithi042.stdout:removed './207/32' 2023-07-29T02:03:27.557 INFO:tasks.workunit.client.0.smithi042.stdout:removed './207/22' 2023-07-29T02:03:27.557 INFO:tasks.workunit.client.0.smithi042.stdout:removed './207/25' 2023-07-29T02:03:27.557 INFO:tasks.workunit.client.0.smithi042.stdout:removed './207/30' 2023-07-29T02:03:27.557 INFO:tasks.workunit.client.0.smithi042.stdout:removed './207/33' 2023-07-29T02:03:27.557 INFO:tasks.workunit.client.0.smithi042.stdout:removed './207/23' 2023-07-29T02:03:27.557 INFO:tasks.workunit.client.0.smithi042.stdout:removed './207/35' 2023-07-29T02:03:27.558 INFO:tasks.workunit.client.0.smithi042.stdout:removed './207/26' 2023-07-29T02:03:27.558 INFO:tasks.workunit.client.0.smithi042.stdout:removed './207/37' 2023-07-29T02:03:27.558 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './207' 2023-07-29T02:03:27.558 INFO:tasks.workunit.client.0.smithi042.stdout:removed './208/21' 2023-07-29T02:03:27.558 INFO:tasks.workunit.client.0.smithi042.stdout:removed './208/27' 2023-07-29T02:03:27.558 INFO:tasks.workunit.client.0.smithi042.stdout:removed './208/31' 2023-07-29T02:03:27.558 INFO:tasks.workunit.client.0.smithi042.stdout:removed './208/36' 2023-07-29T02:03:27.559 INFO:tasks.workunit.client.0.smithi042.stdout:removed './208/20' 2023-07-29T02:03:27.559 INFO:tasks.workunit.client.0.smithi042.stdout:removed './208/39' 2023-07-29T02:03:27.559 INFO:tasks.workunit.client.0.smithi042.stdout:removed './208/34' 2023-07-29T02:03:27.559 INFO:tasks.workunit.client.0.smithi042.stdout:removed './208/38' 2023-07-29T02:03:27.559 INFO:tasks.workunit.client.0.smithi042.stdout:removed './208/28' 2023-07-29T02:03:27.559 INFO:tasks.workunit.client.0.smithi042.stdout:removed './208/24' 2023-07-29T02:03:27.559 INFO:tasks.workunit.client.0.smithi042.stdout:removed './208/29' 2023-07-29T02:03:27.559 INFO:tasks.workunit.client.0.smithi042.stdout:removed './208/32' 2023-07-29T02:03:27.560 INFO:tasks.workunit.client.0.smithi042.stdout:removed './208/22' 2023-07-29T02:03:27.560 INFO:tasks.workunit.client.0.smithi042.stdout:removed './208/25' 2023-07-29T02:03:27.560 INFO:tasks.workunit.client.0.smithi042.stdout:removed './208/30' 2023-07-29T02:03:27.560 INFO:tasks.workunit.client.0.smithi042.stdout:removed './208/33' 2023-07-29T02:03:27.560 INFO:tasks.workunit.client.0.smithi042.stdout:removed './208/23' 2023-07-29T02:03:27.560 INFO:tasks.workunit.client.0.smithi042.stdout:removed './208/35' 2023-07-29T02:03:27.561 INFO:tasks.workunit.client.0.smithi042.stdout:removed './208/26' 2023-07-29T02:03:27.561 INFO:tasks.workunit.client.0.smithi042.stdout:removed './208/37' 2023-07-29T02:03:27.561 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './208' 2023-07-29T02:03:27.561 INFO:tasks.workunit.client.0.smithi042.stdout:removed './209/21' 2023-07-29T02:03:27.561 INFO:tasks.workunit.client.0.smithi042.stdout:removed './209/27' 2023-07-29T02:03:27.562 INFO:tasks.workunit.client.0.smithi042.stdout:removed './209/31' 2023-07-29T02:03:27.562 INFO:tasks.workunit.client.0.smithi042.stdout:removed './209/36' 2023-07-29T02:03:27.563 INFO:tasks.workunit.client.0.smithi042.stdout:removed './209/20' 2023-07-29T02:03:27.563 INFO:tasks.workunit.client.0.smithi042.stdout:removed './209/39' 2023-07-29T02:03:27.563 INFO:tasks.workunit.client.0.smithi042.stdout:removed './209/34' 2023-07-29T02:03:27.563 INFO:tasks.workunit.client.0.smithi042.stdout:removed './209/38' 2023-07-29T02:03:27.563 INFO:tasks.workunit.client.0.smithi042.stdout:removed './209/28' 2023-07-29T02:03:27.563 INFO:tasks.workunit.client.0.smithi042.stdout:removed './209/24' 2023-07-29T02:03:27.563 INFO:tasks.workunit.client.0.smithi042.stdout:removed './209/29' 2023-07-29T02:03:27.564 INFO:tasks.workunit.client.0.smithi042.stdout:removed './209/32' 2023-07-29T02:03:27.564 INFO:tasks.workunit.client.0.smithi042.stdout:removed './209/22' 2023-07-29T02:03:27.564 INFO:tasks.workunit.client.0.smithi042.stdout:removed './209/25' 2023-07-29T02:03:27.564 INFO:tasks.workunit.client.0.smithi042.stdout:removed './209/30' 2023-07-29T02:03:27.564 INFO:tasks.workunit.client.0.smithi042.stdout:removed './209/33' 2023-07-29T02:03:27.564 INFO:tasks.workunit.client.0.smithi042.stdout:removed './209/23' 2023-07-29T02:03:27.564 INFO:tasks.workunit.client.0.smithi042.stdout:removed './209/35' 2023-07-29T02:03:27.564 INFO:tasks.workunit.client.0.smithi042.stdout:removed './209/26' 2023-07-29T02:03:27.565 INFO:tasks.workunit.client.0.smithi042.stdout:removed './209/37' 2023-07-29T02:03:27.565 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './209' 2023-07-29T02:03:27.565 INFO:tasks.workunit.client.0.smithi042.stdout:removed './210/21' 2023-07-29T02:03:27.565 INFO:tasks.workunit.client.0.smithi042.stdout:removed './210/27' 2023-07-29T02:03:27.565 INFO:tasks.workunit.client.0.smithi042.stdout:removed './210/31' 2023-07-29T02:03:27.565 INFO:tasks.workunit.client.0.smithi042.stdout:removed './210/36' 2023-07-29T02:03:27.565 INFO:tasks.workunit.client.0.smithi042.stdout:removed './210/20' 2023-07-29T02:03:27.565 INFO:tasks.workunit.client.0.smithi042.stdout:removed './210/39' 2023-07-29T02:03:27.566 INFO:tasks.workunit.client.0.smithi042.stdout:removed './210/34' 2023-07-29T02:03:27.566 INFO:tasks.workunit.client.0.smithi042.stdout:removed './210/38' 2023-07-29T02:03:27.566 INFO:tasks.workunit.client.0.smithi042.stdout:removed './210/28' 2023-07-29T02:03:27.566 INFO:tasks.workunit.client.0.smithi042.stdout:removed './210/24' 2023-07-29T02:03:27.566 INFO:tasks.workunit.client.0.smithi042.stdout:removed './210/29' 2023-07-29T02:03:27.566 INFO:tasks.workunit.client.0.smithi042.stdout:removed './210/32' 2023-07-29T02:03:27.566 INFO:tasks.workunit.client.0.smithi042.stdout:removed './210/22' 2023-07-29T02:03:27.567 INFO:tasks.workunit.client.0.smithi042.stdout:removed './210/25' 2023-07-29T02:03:27.567 INFO:tasks.workunit.client.0.smithi042.stdout:removed './210/30' 2023-07-29T02:03:27.567 INFO:tasks.workunit.client.0.smithi042.stdout:removed './210/33' 2023-07-29T02:03:27.567 INFO:tasks.workunit.client.0.smithi042.stdout:removed './210/23' 2023-07-29T02:03:27.567 INFO:tasks.workunit.client.0.smithi042.stdout:removed './210/35' 2023-07-29T02:03:27.567 INFO:tasks.workunit.client.0.smithi042.stdout:removed './210/26' 2023-07-29T02:03:27.567 INFO:tasks.workunit.client.0.smithi042.stdout:removed './210/37' 2023-07-29T02:03:27.567 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './210' 2023-07-29T02:03:27.568 INFO:tasks.workunit.client.0.smithi042.stdout:removed './211/21' 2023-07-29T02:03:27.568 INFO:tasks.workunit.client.0.smithi042.stdout:removed './211/27' 2023-07-29T02:03:27.568 INFO:tasks.workunit.client.0.smithi042.stdout:removed './211/31' 2023-07-29T02:03:27.568 INFO:tasks.workunit.client.0.smithi042.stdout:removed './211/36' 2023-07-29T02:03:27.568 INFO:tasks.workunit.client.0.smithi042.stdout:removed './211/20' 2023-07-29T02:03:27.568 INFO:tasks.workunit.client.0.smithi042.stdout:removed './211/39' 2023-07-29T02:03:27.568 INFO:tasks.workunit.client.0.smithi042.stdout:removed './211/34' 2023-07-29T02:03:27.568 INFO:tasks.workunit.client.0.smithi042.stdout:removed './211/38' 2023-07-29T02:03:27.569 INFO:tasks.workunit.client.0.smithi042.stdout:removed './211/28' 2023-07-29T02:03:27.569 INFO:tasks.workunit.client.0.smithi042.stdout:removed './211/24' 2023-07-29T02:03:27.569 INFO:tasks.workunit.client.0.smithi042.stdout:removed './211/29' 2023-07-29T02:03:27.569 INFO:tasks.workunit.client.0.smithi042.stdout:removed './211/32' 2023-07-29T02:03:27.569 INFO:tasks.workunit.client.0.smithi042.stdout:removed './211/22' 2023-07-29T02:03:27.569 INFO:tasks.workunit.client.0.smithi042.stdout:removed './211/25' 2023-07-29T02:03:27.570 INFO:tasks.workunit.client.0.smithi042.stdout:removed './211/30' 2023-07-29T02:03:27.570 INFO:tasks.workunit.client.0.smithi042.stdout:removed './211/33' 2023-07-29T02:03:27.570 INFO:tasks.workunit.client.0.smithi042.stdout:removed './211/23' 2023-07-29T02:03:27.570 INFO:tasks.workunit.client.0.smithi042.stdout:removed './211/35' 2023-07-29T02:03:27.570 INFO:tasks.workunit.client.0.smithi042.stdout:removed './211/26' 2023-07-29T02:03:27.570 INFO:tasks.workunit.client.0.smithi042.stdout:removed './211/37' 2023-07-29T02:03:27.570 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './211' 2023-07-29T02:03:27.570 INFO:tasks.workunit.client.0.smithi042.stdout:removed './212/21' 2023-07-29T02:03:27.571 INFO:tasks.workunit.client.0.smithi042.stdout:removed './212/27' 2023-07-29T02:03:27.571 INFO:tasks.workunit.client.0.smithi042.stdout:removed './212/31' 2023-07-29T02:03:27.571 INFO:tasks.workunit.client.0.smithi042.stdout:removed './212/36' 2023-07-29T02:03:27.571 INFO:tasks.workunit.client.0.smithi042.stdout:removed './212/20' 2023-07-29T02:03:27.571 INFO:tasks.workunit.client.0.smithi042.stdout:removed './212/39' 2023-07-29T02:03:27.571 INFO:tasks.workunit.client.0.smithi042.stdout:removed './212/34' 2023-07-29T02:03:27.571 INFO:tasks.workunit.client.0.smithi042.stdout:removed './212/38' 2023-07-29T02:03:27.571 INFO:tasks.workunit.client.0.smithi042.stdout:removed './212/28' 2023-07-29T02:03:27.572 INFO:tasks.workunit.client.0.smithi042.stdout:removed './212/24' 2023-07-29T02:03:27.572 INFO:tasks.workunit.client.0.smithi042.stdout:removed './212/29' 2023-07-29T02:03:27.572 INFO:tasks.workunit.client.0.smithi042.stdout:removed './212/32' 2023-07-29T02:03:27.572 INFO:tasks.workunit.client.0.smithi042.stdout:removed './212/22' 2023-07-29T02:03:27.572 INFO:tasks.workunit.client.0.smithi042.stdout:removed './212/25' 2023-07-29T02:03:27.572 INFO:tasks.workunit.client.0.smithi042.stdout:removed './212/30' 2023-07-29T02:03:27.572 INFO:tasks.workunit.client.0.smithi042.stdout:removed './212/33' 2023-07-29T02:03:27.572 INFO:tasks.workunit.client.0.smithi042.stdout:removed './212/23' 2023-07-29T02:03:27.573 INFO:tasks.workunit.client.0.smithi042.stdout:removed './212/35' 2023-07-29T02:03:27.573 INFO:tasks.workunit.client.0.smithi042.stdout:removed './212/26' 2023-07-29T02:03:27.573 INFO:tasks.workunit.client.0.smithi042.stdout:removed './212/37' 2023-07-29T02:03:27.573 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './212' 2023-07-29T02:03:27.573 INFO:tasks.workunit.client.0.smithi042.stdout:removed './213/21' 2023-07-29T02:03:27.573 INFO:tasks.workunit.client.0.smithi042.stdout:removed './213/27' 2023-07-29T02:03:27.573 INFO:tasks.workunit.client.0.smithi042.stdout:removed './213/31' 2023-07-29T02:03:27.573 INFO:tasks.workunit.client.0.smithi042.stdout:removed './213/36' 2023-07-29T02:03:27.574 INFO:tasks.workunit.client.0.smithi042.stdout:removed './213/20' 2023-07-29T02:03:27.574 INFO:tasks.workunit.client.0.smithi042.stdout:removed './213/39' 2023-07-29T02:03:27.574 INFO:tasks.workunit.client.0.smithi042.stdout:removed './213/34' 2023-07-29T02:03:27.574 INFO:tasks.workunit.client.0.smithi042.stdout:removed './213/38' 2023-07-29T02:03:27.574 INFO:tasks.workunit.client.0.smithi042.stdout:removed './213/28' 2023-07-29T02:03:27.574 INFO:tasks.workunit.client.0.smithi042.stdout:removed './213/24' 2023-07-29T02:03:27.574 INFO:tasks.workunit.client.0.smithi042.stdout:removed './213/29' 2023-07-29T02:03:27.574 INFO:tasks.workunit.client.0.smithi042.stdout:removed './213/32' 2023-07-29T02:03:27.575 INFO:tasks.workunit.client.0.smithi042.stdout:removed './213/22' 2023-07-29T02:03:27.575 INFO:tasks.workunit.client.0.smithi042.stdout:removed './213/25' 2023-07-29T02:03:27.575 INFO:tasks.workunit.client.0.smithi042.stdout:removed './213/30' 2023-07-29T02:03:27.575 INFO:tasks.workunit.client.0.smithi042.stdout:removed './213/33' 2023-07-29T02:03:27.575 INFO:tasks.workunit.client.0.smithi042.stdout:removed './213/23' 2023-07-29T02:03:27.575 INFO:tasks.workunit.client.0.smithi042.stdout:removed './213/35' 2023-07-29T02:03:27.575 INFO:tasks.workunit.client.0.smithi042.stdout:removed './213/26' 2023-07-29T02:03:27.575 INFO:tasks.workunit.client.0.smithi042.stdout:removed './213/37' 2023-07-29T02:03:27.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './213' 2023-07-29T02:03:27.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed './214/21' 2023-07-29T02:03:27.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed './214/27' 2023-07-29T02:03:27.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed './214/31' 2023-07-29T02:03:27.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed './214/36' 2023-07-29T02:03:27.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed './214/20' 2023-07-29T02:03:27.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed './214/39' 2023-07-29T02:03:27.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './214/34' 2023-07-29T02:03:27.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './214/38' 2023-07-29T02:03:27.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './214/28' 2023-07-29T02:03:27.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './214/24' 2023-07-29T02:03:27.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './214/29' 2023-07-29T02:03:27.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './214/32' 2023-07-29T02:03:27.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './214/22' 2023-07-29T02:03:27.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './214/25' 2023-07-29T02:03:27.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './214/30' 2023-07-29T02:03:27.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './214/33' 2023-07-29T02:03:27.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './214/23' 2023-07-29T02:03:27.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './214/35' 2023-07-29T02:03:27.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './214/26' 2023-07-29T02:03:27.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './214/37' 2023-07-29T02:03:27.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './214' 2023-07-29T02:03:27.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './215/21' 2023-07-29T02:03:27.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './215/27' 2023-07-29T02:03:27.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './215/31' 2023-07-29T02:03:27.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './215/36' 2023-07-29T02:03:27.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './215/20' 2023-07-29T02:03:27.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './215/39' 2023-07-29T02:03:27.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './215/34' 2023-07-29T02:03:27.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './215/38' 2023-07-29T02:03:27.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './215/28' 2023-07-29T02:03:27.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './215/24' 2023-07-29T02:03:27.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './215/29' 2023-07-29T02:03:27.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './215/32' 2023-07-29T02:03:27.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './215/22' 2023-07-29T02:03:27.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './215/25' 2023-07-29T02:03:27.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './215/30' 2023-07-29T02:03:27.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './215/33' 2023-07-29T02:03:27.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './215/23' 2023-07-29T02:03:27.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './215/35' 2023-07-29T02:03:27.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './215/26' 2023-07-29T02:03:27.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './215/37' 2023-07-29T02:03:27.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './215' 2023-07-29T02:03:27.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './216/21' 2023-07-29T02:03:27.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './216/27' 2023-07-29T02:03:27.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './216/31' 2023-07-29T02:03:27.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './216/36' 2023-07-29T02:03:27.582 INFO:tasks.workunit.client.0.smithi042.stdout:removed './216/20' 2023-07-29T02:03:27.582 INFO:tasks.workunit.client.0.smithi042.stdout:removed './216/39' 2023-07-29T02:03:27.582 INFO:tasks.workunit.client.0.smithi042.stdout:removed './216/34' 2023-07-29T02:03:27.582 INFO:tasks.workunit.client.0.smithi042.stdout:removed './216/38' 2023-07-29T02:03:28.261 INFO:tasks.workunit.client.0.smithi042.stdout:removed './216/28' 2023-07-29T02:03:28.261 INFO:tasks.workunit.client.0.smithi042.stdout:removed './216/24' 2023-07-29T02:03:28.261 INFO:tasks.workunit.client.0.smithi042.stdout:removed './216/29' 2023-07-29T02:03:28.261 INFO:tasks.workunit.client.0.smithi042.stdout:removed './216/32' 2023-07-29T02:03:28.262 INFO:tasks.workunit.client.0.smithi042.stdout:removed './216/22' 2023-07-29T02:03:28.262 INFO:tasks.workunit.client.0.smithi042.stdout:removed './216/25' 2023-07-29T02:03:28.262 INFO:tasks.workunit.client.0.smithi042.stdout:removed './216/30' 2023-07-29T02:03:28.262 INFO:tasks.workunit.client.0.smithi042.stdout:removed './216/33' 2023-07-29T02:03:28.262 INFO:tasks.workunit.client.0.smithi042.stdout:removed './216/23' 2023-07-29T02:03:28.262 INFO:tasks.workunit.client.0.smithi042.stdout:removed './216/35' 2023-07-29T02:03:28.262 INFO:tasks.workunit.client.0.smithi042.stdout:removed './216/26' 2023-07-29T02:03:28.263 INFO:tasks.workunit.client.0.smithi042.stdout:removed './216/37' 2023-07-29T02:03:28.263 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './216' 2023-07-29T02:03:28.263 INFO:tasks.workunit.client.0.smithi042.stdout:removed './217/21' 2023-07-29T02:03:28.263 INFO:tasks.workunit.client.0.smithi042.stdout:removed './217/27' 2023-07-29T02:03:28.263 INFO:tasks.workunit.client.0.smithi042.stdout:removed './217/31' 2023-07-29T02:03:28.263 INFO:tasks.workunit.client.0.smithi042.stdout:removed './217/36' 2023-07-29T02:03:28.263 INFO:tasks.workunit.client.0.smithi042.stdout:removed './217/20' 2023-07-29T02:03:28.263 INFO:tasks.workunit.client.0.smithi042.stdout:removed './217/39' 2023-07-29T02:03:28.264 INFO:tasks.workunit.client.0.smithi042.stdout:removed './217/34' 2023-07-29T02:03:28.264 INFO:tasks.workunit.client.0.smithi042.stdout:removed './217/38' 2023-07-29T02:03:28.264 INFO:tasks.workunit.client.0.smithi042.stdout:removed './217/28' 2023-07-29T02:03:28.264 INFO:tasks.workunit.client.0.smithi042.stdout:removed './217/24' 2023-07-29T02:03:28.264 INFO:tasks.workunit.client.0.smithi042.stdout:removed './217/29' 2023-07-29T02:03:28.264 INFO:tasks.workunit.client.0.smithi042.stdout:removed './217/32' 2023-07-29T02:03:28.264 INFO:tasks.workunit.client.0.smithi042.stdout:removed './217/22' 2023-07-29T02:03:28.265 INFO:tasks.workunit.client.0.smithi042.stdout:removed './217/25' 2023-07-29T02:03:28.265 INFO:tasks.workunit.client.0.smithi042.stdout:removed './217/30' 2023-07-29T02:03:28.265 INFO:tasks.workunit.client.0.smithi042.stdout:removed './217/33' 2023-07-29T02:03:28.265 INFO:tasks.workunit.client.0.smithi042.stdout:removed './217/23' 2023-07-29T02:03:28.265 INFO:tasks.workunit.client.0.smithi042.stdout:removed './217/35' 2023-07-29T02:03:28.265 INFO:tasks.workunit.client.0.smithi042.stdout:removed './217/26' 2023-07-29T02:03:28.265 INFO:tasks.workunit.client.0.smithi042.stdout:removed './217/37' 2023-07-29T02:03:28.265 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './217' 2023-07-29T02:03:28.266 INFO:tasks.workunit.client.0.smithi042.stdout:removed './218/21' 2023-07-29T02:03:28.266 INFO:tasks.workunit.client.0.smithi042.stdout:removed './218/27' 2023-07-29T02:03:28.266 INFO:tasks.workunit.client.0.smithi042.stdout:removed './218/31' 2023-07-29T02:03:28.266 INFO:tasks.workunit.client.0.smithi042.stdout:removed './218/36' 2023-07-29T02:03:28.266 INFO:tasks.workunit.client.0.smithi042.stdout:removed './218/20' 2023-07-29T02:03:28.267 INFO:tasks.workunit.client.0.smithi042.stdout:removed './218/39' 2023-07-29T02:03:28.267 INFO:tasks.workunit.client.0.smithi042.stdout:removed './218/34' 2023-07-29T02:03:28.267 INFO:tasks.workunit.client.0.smithi042.stdout:removed './218/38' 2023-07-29T02:03:28.267 INFO:tasks.workunit.client.0.smithi042.stdout:removed './218/28' 2023-07-29T02:03:28.267 INFO:tasks.workunit.client.0.smithi042.stdout:removed './218/24' 2023-07-29T02:03:28.267 INFO:tasks.workunit.client.0.smithi042.stdout:removed './218/29' 2023-07-29T02:03:28.267 INFO:tasks.workunit.client.0.smithi042.stdout:removed './218/32' 2023-07-29T02:03:28.267 INFO:tasks.workunit.client.0.smithi042.stdout:removed './218/22' 2023-07-29T02:03:28.268 INFO:tasks.workunit.client.0.smithi042.stdout:removed './218/25' 2023-07-29T02:03:28.268 INFO:tasks.workunit.client.0.smithi042.stdout:removed './218/30' 2023-07-29T02:03:28.268 INFO:tasks.workunit.client.0.smithi042.stdout:removed './218/33' 2023-07-29T02:03:28.268 INFO:tasks.workunit.client.0.smithi042.stdout:removed './218/23' 2023-07-29T02:03:28.268 INFO:tasks.workunit.client.0.smithi042.stdout:removed './218/35' 2023-07-29T02:03:28.268 INFO:tasks.workunit.client.0.smithi042.stdout:removed './218/26' 2023-07-29T02:03:28.268 INFO:tasks.workunit.client.0.smithi042.stdout:removed './218/37' 2023-07-29T02:03:28.268 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './218' 2023-07-29T02:03:28.269 INFO:tasks.workunit.client.0.smithi042.stdout:removed './219/21' 2023-07-29T02:03:28.269 INFO:tasks.workunit.client.0.smithi042.stdout:removed './219/27' 2023-07-29T02:03:28.269 INFO:tasks.workunit.client.0.smithi042.stdout:removed './219/31' 2023-07-29T02:03:28.269 INFO:tasks.workunit.client.0.smithi042.stdout:removed './219/36' 2023-07-29T02:03:28.269 INFO:tasks.workunit.client.0.smithi042.stdout:removed './219/20' 2023-07-29T02:03:28.269 INFO:tasks.workunit.client.0.smithi042.stdout:removed './219/39' 2023-07-29T02:03:28.269 INFO:tasks.workunit.client.0.smithi042.stdout:removed './219/34' 2023-07-29T02:03:28.269 INFO:tasks.workunit.client.0.smithi042.stdout:removed './219/38' 2023-07-29T02:03:28.270 INFO:tasks.workunit.client.0.smithi042.stdout:removed './219/28' 2023-07-29T02:03:28.270 INFO:tasks.workunit.client.0.smithi042.stdout:removed './219/24' 2023-07-29T02:03:28.270 INFO:tasks.workunit.client.0.smithi042.stdout:removed './219/29' 2023-07-29T02:03:28.270 INFO:tasks.workunit.client.0.smithi042.stdout:removed './219/32' 2023-07-29T02:03:28.270 INFO:tasks.workunit.client.0.smithi042.stdout:removed './219/22' 2023-07-29T02:03:28.270 INFO:tasks.workunit.client.0.smithi042.stdout:removed './219/25' 2023-07-29T02:03:28.270 INFO:tasks.workunit.client.0.smithi042.stdout:removed './219/30' 2023-07-29T02:03:28.271 INFO:tasks.workunit.client.0.smithi042.stdout:removed './219/33' 2023-07-29T02:03:28.271 INFO:tasks.workunit.client.0.smithi042.stdout:removed './219/23' 2023-07-29T02:03:28.271 INFO:tasks.workunit.client.0.smithi042.stdout:removed './219/35' 2023-07-29T02:03:28.271 INFO:tasks.workunit.client.0.smithi042.stdout:removed './219/26' 2023-07-29T02:03:28.271 INFO:tasks.workunit.client.0.smithi042.stdout:removed './219/37' 2023-07-29T02:03:28.271 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './219' 2023-07-29T02:03:28.271 INFO:tasks.workunit.client.0.smithi042.stdout:removed './220/21' 2023-07-29T02:03:28.271 INFO:tasks.workunit.client.0.smithi042.stdout:removed './220/27' 2023-07-29T02:03:28.272 INFO:tasks.workunit.client.0.smithi042.stdout:removed './220/31' 2023-07-29T02:03:28.272 INFO:tasks.workunit.client.0.smithi042.stdout:removed './220/36' 2023-07-29T02:03:28.272 INFO:tasks.workunit.client.0.smithi042.stdout:removed './220/20' 2023-07-29T02:03:28.272 INFO:tasks.workunit.client.0.smithi042.stdout:removed './220/39' 2023-07-29T02:03:28.272 INFO:tasks.workunit.client.0.smithi042.stdout:removed './220/34' 2023-07-29T02:03:28.272 INFO:tasks.workunit.client.0.smithi042.stdout:removed './220/38' 2023-07-29T02:03:28.272 INFO:tasks.workunit.client.0.smithi042.stdout:removed './220/28' 2023-07-29T02:03:28.272 INFO:tasks.workunit.client.0.smithi042.stdout:removed './220/24' 2023-07-29T02:03:28.273 INFO:tasks.workunit.client.0.smithi042.stdout:removed './220/29' 2023-07-29T02:03:28.273 INFO:tasks.workunit.client.0.smithi042.stdout:removed './220/32' 2023-07-29T02:03:28.273 INFO:tasks.workunit.client.0.smithi042.stdout:removed './220/22' 2023-07-29T02:03:28.273 INFO:tasks.workunit.client.0.smithi042.stdout:removed './220/25' 2023-07-29T02:03:28.273 INFO:tasks.workunit.client.0.smithi042.stdout:removed './220/30' 2023-07-29T02:03:28.273 INFO:tasks.workunit.client.0.smithi042.stdout:removed './220/33' 2023-07-29T02:03:28.273 INFO:tasks.workunit.client.0.smithi042.stdout:removed './220/23' 2023-07-29T02:03:28.273 INFO:tasks.workunit.client.0.smithi042.stdout:removed './220/35' 2023-07-29T02:03:28.274 INFO:tasks.workunit.client.0.smithi042.stdout:removed './220/26' 2023-07-29T02:03:28.274 INFO:tasks.workunit.client.0.smithi042.stdout:removed './220/37' 2023-07-29T02:03:28.274 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './220' 2023-07-29T02:03:28.274 INFO:tasks.workunit.client.0.smithi042.stdout:removed './221/21' 2023-07-29T02:03:28.274 INFO:tasks.workunit.client.0.smithi042.stdout:removed './221/27' 2023-07-29T02:03:28.274 INFO:tasks.workunit.client.0.smithi042.stdout:removed './221/31' 2023-07-29T02:03:28.274 INFO:tasks.workunit.client.0.smithi042.stdout:removed './221/36' 2023-07-29T02:03:28.274 INFO:tasks.workunit.client.0.smithi042.stdout:removed './221/20' 2023-07-29T02:03:28.275 INFO:tasks.workunit.client.0.smithi042.stdout:removed './221/39' 2023-07-29T02:03:28.275 INFO:tasks.workunit.client.0.smithi042.stdout:removed './221/34' 2023-07-29T02:03:28.275 INFO:tasks.workunit.client.0.smithi042.stdout:removed './221/38' 2023-07-29T02:03:28.275 INFO:tasks.workunit.client.0.smithi042.stdout:removed './221/28' 2023-07-29T02:03:28.275 INFO:tasks.workunit.client.0.smithi042.stdout:removed './221/24' 2023-07-29T02:03:28.275 INFO:tasks.workunit.client.0.smithi042.stdout:removed './221/29' 2023-07-29T02:03:28.275 INFO:tasks.workunit.client.0.smithi042.stdout:removed './221/32' 2023-07-29T02:03:28.275 INFO:tasks.workunit.client.0.smithi042.stdout:removed './221/22' 2023-07-29T02:03:28.276 INFO:tasks.workunit.client.0.smithi042.stdout:removed './221/25' 2023-07-29T02:03:28.276 INFO:tasks.workunit.client.0.smithi042.stdout:removed './221/30' 2023-07-29T02:03:28.276 INFO:tasks.workunit.client.0.smithi042.stdout:removed './221/33' 2023-07-29T02:03:28.276 INFO:tasks.workunit.client.0.smithi042.stdout:removed './221/23' 2023-07-29T02:03:28.276 INFO:tasks.workunit.client.0.smithi042.stdout:removed './221/35' 2023-07-29T02:03:28.276 INFO:tasks.workunit.client.0.smithi042.stdout:removed './221/26' 2023-07-29T02:03:28.276 INFO:tasks.workunit.client.0.smithi042.stdout:removed './221/37' 2023-07-29T02:03:28.276 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './221' 2023-07-29T02:03:28.277 INFO:tasks.workunit.client.0.smithi042.stdout:removed './222/21' 2023-07-29T02:03:28.277 INFO:tasks.workunit.client.0.smithi042.stdout:removed './222/27' 2023-07-29T02:03:28.277 INFO:tasks.workunit.client.0.smithi042.stdout:removed './222/31' 2023-07-29T02:03:28.277 INFO:tasks.workunit.client.0.smithi042.stdout:removed './222/36' 2023-07-29T02:03:28.277 INFO:tasks.workunit.client.0.smithi042.stdout:removed './222/20' 2023-07-29T02:03:28.277 INFO:tasks.workunit.client.0.smithi042.stdout:removed './222/39' 2023-07-29T02:03:28.278 INFO:tasks.workunit.client.0.smithi042.stdout:removed './222/34' 2023-07-29T02:03:28.278 INFO:tasks.workunit.client.0.smithi042.stdout:removed './222/38' 2023-07-29T02:03:28.278 INFO:tasks.workunit.client.0.smithi042.stdout:removed './222/28' 2023-07-29T02:03:28.278 INFO:tasks.workunit.client.0.smithi042.stdout:removed './222/24' 2023-07-29T02:03:28.278 INFO:tasks.workunit.client.0.smithi042.stdout:removed './222/29' 2023-07-29T02:03:28.279 INFO:tasks.workunit.client.0.smithi042.stdout:removed './222/32' 2023-07-29T02:03:28.279 INFO:tasks.workunit.client.0.smithi042.stdout:removed './222/22' 2023-07-29T02:03:28.280 INFO:tasks.workunit.client.0.smithi042.stdout:removed './222/25' 2023-07-29T02:03:28.280 INFO:tasks.workunit.client.0.smithi042.stdout:removed './222/30' 2023-07-29T02:03:28.280 INFO:tasks.workunit.client.0.smithi042.stdout:removed './222/33' 2023-07-29T02:03:28.280 INFO:tasks.workunit.client.0.smithi042.stdout:removed './222/23' 2023-07-29T02:03:28.280 INFO:tasks.workunit.client.0.smithi042.stdout:removed './222/35' 2023-07-29T02:03:28.280 INFO:tasks.workunit.client.0.smithi042.stdout:removed './222/26' 2023-07-29T02:03:28.281 INFO:tasks.workunit.client.0.smithi042.stdout:removed './222/37' 2023-07-29T02:03:28.281 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './222' 2023-07-29T02:03:28.281 INFO:tasks.workunit.client.0.smithi042.stdout:removed './223/21' 2023-07-29T02:03:28.281 INFO:tasks.workunit.client.0.smithi042.stdout:removed './223/27' 2023-07-29T02:03:28.281 INFO:tasks.workunit.client.0.smithi042.stdout:removed './223/31' 2023-07-29T02:03:28.281 INFO:tasks.workunit.client.0.smithi042.stdout:removed './223/36' 2023-07-29T02:03:28.281 INFO:tasks.workunit.client.0.smithi042.stdout:removed './223/20' 2023-07-29T02:03:28.281 INFO:tasks.workunit.client.0.smithi042.stdout:removed './223/39' 2023-07-29T02:03:28.282 INFO:tasks.workunit.client.0.smithi042.stdout:removed './223/34' 2023-07-29T02:03:28.282 INFO:tasks.workunit.client.0.smithi042.stdout:removed './223/38' 2023-07-29T02:03:28.282 INFO:tasks.workunit.client.0.smithi042.stdout:removed './223/28' 2023-07-29T02:03:28.282 INFO:tasks.workunit.client.0.smithi042.stdout:removed './223/24' 2023-07-29T02:03:28.282 INFO:tasks.workunit.client.0.smithi042.stdout:removed './223/29' 2023-07-29T02:03:28.282 INFO:tasks.workunit.client.0.smithi042.stdout:removed './223/32' 2023-07-29T02:03:28.282 INFO:tasks.workunit.client.0.smithi042.stdout:removed './223/22' 2023-07-29T02:03:28.282 INFO:tasks.workunit.client.0.smithi042.stdout:removed './223/25' 2023-07-29T02:03:28.283 INFO:tasks.workunit.client.0.smithi042.stdout:removed './223/30' 2023-07-29T02:03:28.283 INFO:tasks.workunit.client.0.smithi042.stdout:removed './223/33' 2023-07-29T02:03:28.283 INFO:tasks.workunit.client.0.smithi042.stdout:removed './223/23' 2023-07-29T02:03:28.283 INFO:tasks.workunit.client.0.smithi042.stdout:removed './223/35' 2023-07-29T02:03:28.284 INFO:tasks.workunit.client.0.smithi042.stdout:removed './223/26' 2023-07-29T02:03:28.284 INFO:tasks.workunit.client.0.smithi042.stdout:removed './223/37' 2023-07-29T02:03:28.284 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './223' 2023-07-29T02:03:28.284 INFO:tasks.workunit.client.0.smithi042.stdout:removed './224/21' 2023-07-29T02:03:28.284 INFO:tasks.workunit.client.0.smithi042.stdout:removed './224/27' 2023-07-29T02:03:28.284 INFO:tasks.workunit.client.0.smithi042.stdout:removed './224/31' 2023-07-29T02:03:28.284 INFO:tasks.workunit.client.0.smithi042.stdout:removed './224/36' 2023-07-29T02:03:28.285 INFO:tasks.workunit.client.0.smithi042.stdout:removed './224/20' 2023-07-29T02:03:28.285 INFO:tasks.workunit.client.0.smithi042.stdout:removed './224/39' 2023-07-29T02:03:28.285 INFO:tasks.workunit.client.0.smithi042.stdout:removed './224/34' 2023-07-29T02:03:28.285 INFO:tasks.workunit.client.0.smithi042.stdout:removed './224/38' 2023-07-29T02:03:28.285 INFO:tasks.workunit.client.0.smithi042.stdout:removed './224/28' 2023-07-29T02:03:28.285 INFO:tasks.workunit.client.0.smithi042.stdout:removed './224/24' 2023-07-29T02:03:28.285 INFO:tasks.workunit.client.0.smithi042.stdout:removed './224/29' 2023-07-29T02:03:28.286 INFO:tasks.workunit.client.0.smithi042.stdout:removed './224/32' 2023-07-29T02:03:28.286 INFO:tasks.workunit.client.0.smithi042.stdout:removed './224/22' 2023-07-29T02:03:28.286 INFO:tasks.workunit.client.0.smithi042.stdout:removed './224/25' 2023-07-29T02:03:28.286 INFO:tasks.workunit.client.0.smithi042.stdout:removed './224/30' 2023-07-29T02:03:28.286 INFO:tasks.workunit.client.0.smithi042.stdout:removed './224/33' 2023-07-29T02:03:28.286 INFO:tasks.workunit.client.0.smithi042.stdout:removed './224/23' 2023-07-29T02:03:28.286 INFO:tasks.workunit.client.0.smithi042.stdout:removed './224/35' 2023-07-29T02:03:28.286 INFO:tasks.workunit.client.0.smithi042.stdout:removed './224/26' 2023-07-29T02:03:28.287 INFO:tasks.workunit.client.0.smithi042.stdout:removed './224/37' 2023-07-29T02:03:28.287 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './224' 2023-07-29T02:03:28.287 INFO:tasks.workunit.client.0.smithi042.stdout:removed './225/21' 2023-07-29T02:03:28.287 INFO:tasks.workunit.client.0.smithi042.stdout:removed './225/27' 2023-07-29T02:03:28.287 INFO:tasks.workunit.client.0.smithi042.stdout:removed './225/31' 2023-07-29T02:03:28.287 INFO:tasks.workunit.client.0.smithi042.stdout:removed './225/36' 2023-07-29T02:03:28.287 INFO:tasks.workunit.client.0.smithi042.stdout:removed './225/20' 2023-07-29T02:03:28.287 INFO:tasks.workunit.client.0.smithi042.stdout:removed './225/39' 2023-07-29T02:03:28.288 INFO:tasks.workunit.client.0.smithi042.stdout:removed './225/34' 2023-07-29T02:03:28.288 INFO:tasks.workunit.client.0.smithi042.stdout:removed './225/38' 2023-07-29T02:03:28.288 INFO:tasks.workunit.client.0.smithi042.stdout:removed './225/28' 2023-07-29T02:03:28.288 INFO:tasks.workunit.client.0.smithi042.stdout:removed './225/24' 2023-07-29T02:03:28.288 INFO:tasks.workunit.client.0.smithi042.stdout:removed './225/29' 2023-07-29T02:03:28.288 INFO:tasks.workunit.client.0.smithi042.stdout:removed './225/32' 2023-07-29T02:03:28.288 INFO:tasks.workunit.client.0.smithi042.stdout:removed './225/22' 2023-07-29T02:03:28.289 INFO:tasks.workunit.client.0.smithi042.stdout:removed './225/25' 2023-07-29T02:03:28.289 INFO:tasks.workunit.client.0.smithi042.stdout:removed './225/30' 2023-07-29T02:03:28.289 INFO:tasks.workunit.client.0.smithi042.stdout:removed './225/33' 2023-07-29T02:03:28.289 INFO:tasks.workunit.client.0.smithi042.stdout:removed './225/23' 2023-07-29T02:03:28.289 INFO:tasks.workunit.client.0.smithi042.stdout:removed './225/35' 2023-07-29T02:03:28.289 INFO:tasks.workunit.client.0.smithi042.stdout:removed './225/26' 2023-07-29T02:03:28.289 INFO:tasks.workunit.client.0.smithi042.stdout:removed './225/37' 2023-07-29T02:03:28.289 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './225' 2023-07-29T02:03:28.290 INFO:tasks.workunit.client.0.smithi042.stdout:removed './226/21' 2023-07-29T02:03:28.290 INFO:tasks.workunit.client.0.smithi042.stdout:removed './226/27' 2023-07-29T02:03:28.290 INFO:tasks.workunit.client.0.smithi042.stdout:removed './226/31' 2023-07-29T02:03:28.290 INFO:tasks.workunit.client.0.smithi042.stdout:removed './226/36' 2023-07-29T02:03:28.290 INFO:tasks.workunit.client.0.smithi042.stdout:removed './226/20' 2023-07-29T02:03:28.290 INFO:tasks.workunit.client.0.smithi042.stdout:removed './226/39' 2023-07-29T02:03:28.290 INFO:tasks.workunit.client.0.smithi042.stdout:removed './226/34' 2023-07-29T02:03:28.290 INFO:tasks.workunit.client.0.smithi042.stdout:removed './226/38' 2023-07-29T02:03:28.291 INFO:tasks.workunit.client.0.smithi042.stdout:removed './226/28' 2023-07-29T02:03:28.291 INFO:tasks.workunit.client.0.smithi042.stdout:removed './226/24' 2023-07-29T02:03:28.696 INFO:tasks.workunit.client.0.smithi042.stdout:removed './226/29' 2023-07-29T02:03:28.696 INFO:tasks.workunit.client.0.smithi042.stdout:removed './226/32' 2023-07-29T02:03:28.696 INFO:tasks.workunit.client.0.smithi042.stdout:removed './226/22' 2023-07-29T02:03:28.696 INFO:tasks.workunit.client.0.smithi042.stdout:removed './226/25' 2023-07-29T02:03:28.696 INFO:tasks.workunit.client.0.smithi042.stdout:removed './226/30' 2023-07-29T02:03:28.697 INFO:tasks.workunit.client.0.smithi042.stdout:removed './226/33' 2023-07-29T02:03:28.697 INFO:tasks.workunit.client.0.smithi042.stdout:removed './226/23' 2023-07-29T02:03:28.697 INFO:tasks.workunit.client.0.smithi042.stdout:removed './226/35' 2023-07-29T02:03:28.697 INFO:tasks.workunit.client.0.smithi042.stdout:removed './226/26' 2023-07-29T02:03:28.697 INFO:tasks.workunit.client.0.smithi042.stdout:removed './226/37' 2023-07-29T02:03:28.697 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './226' 2023-07-29T02:03:28.697 INFO:tasks.workunit.client.0.smithi042.stdout:removed './227/21' 2023-07-29T02:03:28.698 INFO:tasks.workunit.client.0.smithi042.stdout:removed './227/27' 2023-07-29T02:03:28.698 INFO:tasks.workunit.client.0.smithi042.stdout:removed './227/31' 2023-07-29T02:03:28.698 INFO:tasks.workunit.client.0.smithi042.stdout:removed './227/36' 2023-07-29T02:03:28.698 INFO:tasks.workunit.client.0.smithi042.stdout:removed './227/20' 2023-07-29T02:03:28.698 INFO:tasks.workunit.client.0.smithi042.stdout:removed './227/39' 2023-07-29T02:03:28.698 INFO:tasks.workunit.client.0.smithi042.stdout:removed './227/34' 2023-07-29T02:03:28.698 INFO:tasks.workunit.client.0.smithi042.stdout:removed './227/38' 2023-07-29T02:03:28.699 INFO:tasks.workunit.client.0.smithi042.stdout:removed './227/28' 2023-07-29T02:03:28.699 INFO:tasks.workunit.client.0.smithi042.stdout:removed './227/24' 2023-07-29T02:03:28.699 INFO:tasks.workunit.client.0.smithi042.stdout:removed './227/29' 2023-07-29T02:03:28.699 INFO:tasks.workunit.client.0.smithi042.stdout:removed './227/32' 2023-07-29T02:03:28.699 INFO:tasks.workunit.client.0.smithi042.stdout:removed './227/22' 2023-07-29T02:03:28.699 INFO:tasks.workunit.client.0.smithi042.stdout:removed './227/25' 2023-07-29T02:03:28.699 INFO:tasks.workunit.client.0.smithi042.stdout:removed './227/30' 2023-07-29T02:03:28.700 INFO:tasks.workunit.client.0.smithi042.stdout:removed './227/33' 2023-07-29T02:03:28.700 INFO:tasks.workunit.client.0.smithi042.stdout:removed './227/23' 2023-07-29T02:03:28.700 INFO:tasks.workunit.client.0.smithi042.stdout:removed './227/35' 2023-07-29T02:03:28.700 INFO:tasks.workunit.client.0.smithi042.stdout:removed './227/26' 2023-07-29T02:03:28.700 INFO:tasks.workunit.client.0.smithi042.stdout:removed './227/37' 2023-07-29T02:03:28.700 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './227' 2023-07-29T02:03:28.700 INFO:tasks.workunit.client.0.smithi042.stdout:removed './228/21' 2023-07-29T02:03:28.701 INFO:tasks.workunit.client.0.smithi042.stdout:removed './228/27' 2023-07-29T02:03:28.701 INFO:tasks.workunit.client.0.smithi042.stdout:removed './228/31' 2023-07-29T02:03:28.701 INFO:tasks.workunit.client.0.smithi042.stdout:removed './228/36' 2023-07-29T02:03:28.701 INFO:tasks.workunit.client.0.smithi042.stdout:removed './228/20' 2023-07-29T02:03:28.701 INFO:tasks.workunit.client.0.smithi042.stdout:removed './228/39' 2023-07-29T02:03:28.701 INFO:tasks.workunit.client.0.smithi042.stdout:removed './228/34' 2023-07-29T02:03:28.701 INFO:tasks.workunit.client.0.smithi042.stdout:removed './228/38' 2023-07-29T02:03:28.701 INFO:tasks.workunit.client.0.smithi042.stdout:removed './228/28' 2023-07-29T02:03:28.702 INFO:tasks.workunit.client.0.smithi042.stdout:removed './228/24' 2023-07-29T02:03:28.702 INFO:tasks.workunit.client.0.smithi042.stdout:removed './228/29' 2023-07-29T02:03:28.702 INFO:tasks.workunit.client.0.smithi042.stdout:removed './228/32' 2023-07-29T02:03:28.702 INFO:tasks.workunit.client.0.smithi042.stdout:removed './228/22' 2023-07-29T02:03:28.702 INFO:tasks.workunit.client.0.smithi042.stdout:removed './228/25' 2023-07-29T02:03:28.702 INFO:tasks.workunit.client.0.smithi042.stdout:removed './228/30' 2023-07-29T02:03:28.702 INFO:tasks.workunit.client.0.smithi042.stdout:removed './228/33' 2023-07-29T02:03:28.703 INFO:tasks.workunit.client.0.smithi042.stdout:removed './228/23' 2023-07-29T02:03:28.703 INFO:tasks.workunit.client.0.smithi042.stdout:removed './228/35' 2023-07-29T02:03:28.703 INFO:tasks.workunit.client.0.smithi042.stdout:removed './228/26' 2023-07-29T02:03:28.703 INFO:tasks.workunit.client.0.smithi042.stdout:removed './228/37' 2023-07-29T02:03:28.703 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './228' 2023-07-29T02:03:28.703 INFO:tasks.workunit.client.0.smithi042.stdout:removed './229/21' 2023-07-29T02:03:28.703 INFO:tasks.workunit.client.0.smithi042.stdout:removed './229/27' 2023-07-29T02:03:28.704 INFO:tasks.workunit.client.0.smithi042.stdout:removed './229/31' 2023-07-29T02:03:28.704 INFO:tasks.workunit.client.0.smithi042.stdout:removed './229/36' 2023-07-29T02:03:28.704 INFO:tasks.workunit.client.0.smithi042.stdout:removed './229/20' 2023-07-29T02:03:28.704 INFO:tasks.workunit.client.0.smithi042.stdout:removed './229/39' 2023-07-29T02:03:28.704 INFO:tasks.workunit.client.0.smithi042.stdout:removed './229/34' 2023-07-29T02:03:28.704 INFO:tasks.workunit.client.0.smithi042.stdout:removed './229/38' 2023-07-29T02:03:28.704 INFO:tasks.workunit.client.0.smithi042.stdout:removed './229/28' 2023-07-29T02:03:28.705 INFO:tasks.workunit.client.0.smithi042.stdout:removed './229/24' 2023-07-29T02:03:28.705 INFO:tasks.workunit.client.0.smithi042.stdout:removed './229/29' 2023-07-29T02:03:28.705 INFO:tasks.workunit.client.0.smithi042.stdout:removed './229/32' 2023-07-29T02:03:28.705 INFO:tasks.workunit.client.0.smithi042.stdout:removed './229/22' 2023-07-29T02:03:28.705 INFO:tasks.workunit.client.0.smithi042.stdout:removed './229/25' 2023-07-29T02:03:28.705 INFO:tasks.workunit.client.0.smithi042.stdout:removed './229/30' 2023-07-29T02:03:28.705 INFO:tasks.workunit.client.0.smithi042.stdout:removed './229/33' 2023-07-29T02:03:28.705 INFO:tasks.workunit.client.0.smithi042.stdout:removed './229/23' 2023-07-29T02:03:28.706 INFO:tasks.workunit.client.0.smithi042.stdout:removed './229/35' 2023-07-29T02:03:28.706 INFO:tasks.workunit.client.0.smithi042.stdout:removed './229/26' 2023-07-29T02:03:28.706 INFO:tasks.workunit.client.0.smithi042.stdout:removed './229/37' 2023-07-29T02:03:28.706 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './229' 2023-07-29T02:03:28.706 INFO:tasks.workunit.client.0.smithi042.stdout:removed './230/21' 2023-07-29T02:03:28.706 INFO:tasks.workunit.client.0.smithi042.stdout:removed './230/27' 2023-07-29T02:03:28.706 INFO:tasks.workunit.client.0.smithi042.stdout:removed './230/31' 2023-07-29T02:03:28.707 INFO:tasks.workunit.client.0.smithi042.stdout:removed './230/36' 2023-07-29T02:03:28.707 INFO:tasks.workunit.client.0.smithi042.stdout:removed './230/20' 2023-07-29T02:03:28.707 INFO:tasks.workunit.client.0.smithi042.stdout:removed './230/39' 2023-07-29T02:03:28.707 INFO:tasks.workunit.client.0.smithi042.stdout:removed './230/34' 2023-07-29T02:03:28.707 INFO:tasks.workunit.client.0.smithi042.stdout:removed './230/38' 2023-07-29T02:03:28.707 INFO:tasks.workunit.client.0.smithi042.stdout:removed './230/28' 2023-07-29T02:03:28.707 INFO:tasks.workunit.client.0.smithi042.stdout:removed './230/24' 2023-07-29T02:03:28.708 INFO:tasks.workunit.client.0.smithi042.stdout:removed './230/29' 2023-07-29T02:03:28.708 INFO:tasks.workunit.client.0.smithi042.stdout:removed './230/32' 2023-07-29T02:03:28.708 INFO:tasks.workunit.client.0.smithi042.stdout:removed './230/22' 2023-07-29T02:03:28.708 INFO:tasks.workunit.client.0.smithi042.stdout:removed './230/25' 2023-07-29T02:03:28.708 INFO:tasks.workunit.client.0.smithi042.stdout:removed './230/30' 2023-07-29T02:03:28.708 INFO:tasks.workunit.client.0.smithi042.stdout:removed './230/33' 2023-07-29T02:03:28.708 INFO:tasks.workunit.client.0.smithi042.stdout:removed './230/23' 2023-07-29T02:03:28.709 INFO:tasks.workunit.client.0.smithi042.stdout:removed './230/35' 2023-07-29T02:03:28.709 INFO:tasks.workunit.client.0.smithi042.stdout:removed './230/26' 2023-07-29T02:03:28.709 INFO:tasks.workunit.client.0.smithi042.stdout:removed './230/37' 2023-07-29T02:03:28.709 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './230' 2023-07-29T02:03:28.709 INFO:tasks.workunit.client.0.smithi042.stdout:removed './231/21' 2023-07-29T02:03:28.709 INFO:tasks.workunit.client.0.smithi042.stdout:removed './231/27' 2023-07-29T02:03:28.710 INFO:tasks.workunit.client.0.smithi042.stdout:removed './231/31' 2023-07-29T02:03:28.710 INFO:tasks.workunit.client.0.smithi042.stdout:removed './231/36' 2023-07-29T02:03:28.710 INFO:tasks.workunit.client.0.smithi042.stdout:removed './231/20' 2023-07-29T02:03:28.710 INFO:tasks.workunit.client.0.smithi042.stdout:removed './231/39' 2023-07-29T02:03:28.710 INFO:tasks.workunit.client.0.smithi042.stdout:removed './231/34' 2023-07-29T02:03:28.710 INFO:tasks.workunit.client.0.smithi042.stdout:removed './231/38' 2023-07-29T02:03:28.710 INFO:tasks.workunit.client.0.smithi042.stdout:removed './231/28' 2023-07-29T02:03:28.711 INFO:tasks.workunit.client.0.smithi042.stdout:removed './231/24' 2023-07-29T02:03:28.711 INFO:tasks.workunit.client.0.smithi042.stdout:removed './231/29' 2023-07-29T02:03:28.711 INFO:tasks.workunit.client.0.smithi042.stdout:removed './231/32' 2023-07-29T02:03:28.711 INFO:tasks.workunit.client.0.smithi042.stdout:removed './231/22' 2023-07-29T02:03:28.711 INFO:tasks.workunit.client.0.smithi042.stdout:removed './231/25' 2023-07-29T02:03:28.711 INFO:tasks.workunit.client.0.smithi042.stdout:removed './231/30' 2023-07-29T02:03:28.711 INFO:tasks.workunit.client.0.smithi042.stdout:removed './231/33' 2023-07-29T02:03:28.712 INFO:tasks.workunit.client.0.smithi042.stdout:removed './231/23' 2023-07-29T02:03:28.712 INFO:tasks.workunit.client.0.smithi042.stdout:removed './231/35' 2023-07-29T02:03:28.712 INFO:tasks.workunit.client.0.smithi042.stdout:removed './231/26' 2023-07-29T02:03:28.712 INFO:tasks.workunit.client.0.smithi042.stdout:removed './231/37' 2023-07-29T02:03:28.712 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './231' 2023-07-29T02:03:28.712 INFO:tasks.workunit.client.0.smithi042.stdout:removed './232/21' 2023-07-29T02:03:28.712 INFO:tasks.workunit.client.0.smithi042.stdout:removed './232/27' 2023-07-29T02:03:28.713 INFO:tasks.workunit.client.0.smithi042.stdout:removed './232/31' 2023-07-29T02:03:28.713 INFO:tasks.workunit.client.0.smithi042.stdout:removed './232/36' 2023-07-29T02:03:28.713 INFO:tasks.workunit.client.0.smithi042.stdout:removed './232/20' 2023-07-29T02:03:28.713 INFO:tasks.workunit.client.0.smithi042.stdout:removed './232/39' 2023-07-29T02:03:28.713 INFO:tasks.workunit.client.0.smithi042.stdout:removed './232/34' 2023-07-29T02:03:28.713 INFO:tasks.workunit.client.0.smithi042.stdout:removed './232/38' 2023-07-29T02:03:28.713 INFO:tasks.workunit.client.0.smithi042.stdout:removed './232/28' 2023-07-29T02:03:28.714 INFO:tasks.workunit.client.0.smithi042.stdout:removed './232/24' 2023-07-29T02:03:28.714 INFO:tasks.workunit.client.0.smithi042.stdout:removed './232/29' 2023-07-29T02:03:28.714 INFO:tasks.workunit.client.0.smithi042.stdout:removed './232/32' 2023-07-29T02:03:28.714 INFO:tasks.workunit.client.0.smithi042.stdout:removed './232/22' 2023-07-29T02:03:28.714 INFO:tasks.workunit.client.0.smithi042.stdout:removed './232/25' 2023-07-29T02:03:28.714 INFO:tasks.workunit.client.0.smithi042.stdout:removed './232/30' 2023-07-29T02:03:28.714 INFO:tasks.workunit.client.0.smithi042.stdout:removed './232/33' 2023-07-29T02:03:28.714 INFO:tasks.workunit.client.0.smithi042.stdout:removed './232/23' 2023-07-29T02:03:28.715 INFO:tasks.workunit.client.0.smithi042.stdout:removed './232/35' 2023-07-29T02:03:28.715 INFO:tasks.workunit.client.0.smithi042.stdout:removed './232/26' 2023-07-29T02:03:28.715 INFO:tasks.workunit.client.0.smithi042.stdout:removed './232/37' 2023-07-29T02:03:28.715 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './232' 2023-07-29T02:03:28.715 INFO:tasks.workunit.client.0.smithi042.stdout:removed './233/21' 2023-07-29T02:03:28.715 INFO:tasks.workunit.client.0.smithi042.stdout:removed './233/27' 2023-07-29T02:03:28.715 INFO:tasks.workunit.client.0.smithi042.stdout:removed './233/31' 2023-07-29T02:03:28.716 INFO:tasks.workunit.client.0.smithi042.stdout:removed './233/36' 2023-07-29T02:03:28.716 INFO:tasks.workunit.client.0.smithi042.stdout:removed './233/20' 2023-07-29T02:03:28.716 INFO:tasks.workunit.client.0.smithi042.stdout:removed './233/39' 2023-07-29T02:03:28.716 INFO:tasks.workunit.client.0.smithi042.stdout:removed './233/34' 2023-07-29T02:03:28.716 INFO:tasks.workunit.client.0.smithi042.stdout:removed './233/38' 2023-07-29T02:03:28.716 INFO:tasks.workunit.client.0.smithi042.stdout:removed './233/28' 2023-07-29T02:03:28.716 INFO:tasks.workunit.client.0.smithi042.stdout:removed './233/24' 2023-07-29T02:03:28.717 INFO:tasks.workunit.client.0.smithi042.stdout:removed './233/29' 2023-07-29T02:03:28.717 INFO:tasks.workunit.client.0.smithi042.stdout:removed './233/32' 2023-07-29T02:03:28.717 INFO:tasks.workunit.client.0.smithi042.stdout:removed './233/22' 2023-07-29T02:03:28.717 INFO:tasks.workunit.client.0.smithi042.stdout:removed './233/25' 2023-07-29T02:03:28.717 INFO:tasks.workunit.client.0.smithi042.stdout:removed './233/30' 2023-07-29T02:03:28.717 INFO:tasks.workunit.client.0.smithi042.stdout:removed './233/33' 2023-07-29T02:03:28.717 INFO:tasks.workunit.client.0.smithi042.stdout:removed './233/23' 2023-07-29T02:03:28.718 INFO:tasks.workunit.client.0.smithi042.stdout:removed './233/35' 2023-07-29T02:03:28.718 INFO:tasks.workunit.client.0.smithi042.stdout:removed './233/26' 2023-07-29T02:03:28.718 INFO:tasks.workunit.client.0.smithi042.stdout:removed './233/37' 2023-07-29T02:03:28.718 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './233' 2023-07-29T02:03:28.718 INFO:tasks.workunit.client.0.smithi042.stdout:removed './234/21' 2023-07-29T02:03:28.718 INFO:tasks.workunit.client.0.smithi042.stdout:removed './234/27' 2023-07-29T02:03:28.718 INFO:tasks.workunit.client.0.smithi042.stdout:removed './234/31' 2023-07-29T02:03:28.718 INFO:tasks.workunit.client.0.smithi042.stdout:removed './234/36' 2023-07-29T02:03:28.719 INFO:tasks.workunit.client.0.smithi042.stdout:removed './234/20' 2023-07-29T02:03:28.719 INFO:tasks.workunit.client.0.smithi042.stdout:removed './234/39' 2023-07-29T02:03:28.719 INFO:tasks.workunit.client.0.smithi042.stdout:removed './234/34' 2023-07-29T02:03:28.719 INFO:tasks.workunit.client.0.smithi042.stdout:removed './234/38' 2023-07-29T02:03:28.719 INFO:tasks.workunit.client.0.smithi042.stdout:removed './234/28' 2023-07-29T02:03:28.719 INFO:tasks.workunit.client.0.smithi042.stdout:removed './234/24' 2023-07-29T02:03:28.719 INFO:tasks.workunit.client.0.smithi042.stdout:removed './234/29' 2023-07-29T02:03:28.720 INFO:tasks.workunit.client.0.smithi042.stdout:removed './234/32' 2023-07-29T02:03:28.720 INFO:tasks.workunit.client.0.smithi042.stdout:removed './234/22' 2023-07-29T02:03:28.720 INFO:tasks.workunit.client.0.smithi042.stdout:removed './234/25' 2023-07-29T02:03:28.720 INFO:tasks.workunit.client.0.smithi042.stdout:removed './234/30' 2023-07-29T02:03:28.720 INFO:tasks.workunit.client.0.smithi042.stdout:removed './234/33' 2023-07-29T02:03:28.720 INFO:tasks.workunit.client.0.smithi042.stdout:removed './234/23' 2023-07-29T02:03:28.720 INFO:tasks.workunit.client.0.smithi042.stdout:removed './234/35' 2023-07-29T02:03:28.721 INFO:tasks.workunit.client.0.smithi042.stdout:removed './234/26' 2023-07-29T02:03:28.721 INFO:tasks.workunit.client.0.smithi042.stdout:removed './234/37' 2023-07-29T02:03:28.721 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './234' 2023-07-29T02:03:28.721 INFO:tasks.workunit.client.0.smithi042.stdout:removed './235/21' 2023-07-29T02:03:28.721 INFO:tasks.workunit.client.0.smithi042.stdout:removed './235/27' 2023-07-29T02:03:28.721 INFO:tasks.workunit.client.0.smithi042.stdout:removed './235/31' 2023-07-29T02:03:28.721 INFO:tasks.workunit.client.0.smithi042.stdout:removed './235/36' 2023-07-29T02:03:28.722 INFO:tasks.workunit.client.0.smithi042.stdout:removed './235/20' 2023-07-29T02:03:28.722 INFO:tasks.workunit.client.0.smithi042.stdout:removed './235/39' 2023-07-29T02:03:28.722 INFO:tasks.workunit.client.0.smithi042.stdout:removed './235/34' 2023-07-29T02:03:28.722 INFO:tasks.workunit.client.0.smithi042.stdout:removed './235/38' 2023-07-29T02:03:28.722 INFO:tasks.workunit.client.0.smithi042.stdout:removed './235/28' 2023-07-29T02:03:28.722 INFO:tasks.workunit.client.0.smithi042.stdout:removed './235/24' 2023-07-29T02:03:28.722 INFO:tasks.workunit.client.0.smithi042.stdout:removed './235/29' 2023-07-29T02:03:28.722 INFO:tasks.workunit.client.0.smithi042.stdout:removed './235/32' 2023-07-29T02:03:28.723 INFO:tasks.workunit.client.0.smithi042.stdout:removed './235/22' 2023-07-29T02:03:28.723 INFO:tasks.workunit.client.0.smithi042.stdout:removed './235/25' 2023-07-29T02:03:28.723 INFO:tasks.workunit.client.0.smithi042.stdout:removed './235/30' 2023-07-29T02:03:28.723 INFO:tasks.workunit.client.0.smithi042.stdout:removed './235/33' 2023-07-29T02:03:28.723 INFO:tasks.workunit.client.0.smithi042.stdout:removed './235/23' 2023-07-29T02:03:28.723 INFO:tasks.workunit.client.0.smithi042.stdout:removed './235/35' 2023-07-29T02:03:28.723 INFO:tasks.workunit.client.0.smithi042.stdout:removed './235/26' 2023-07-29T02:03:28.724 INFO:tasks.workunit.client.0.smithi042.stdout:removed './235/37' 2023-07-29T02:03:28.724 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './235' 2023-07-29T02:03:28.724 INFO:tasks.workunit.client.0.smithi042.stdout:removed './236/21' 2023-07-29T02:03:28.724 INFO:tasks.workunit.client.0.smithi042.stdout:removed './236/27' 2023-07-29T02:03:28.724 INFO:tasks.workunit.client.0.smithi042.stdout:removed './236/31' 2023-07-29T02:03:28.724 INFO:tasks.workunit.client.0.smithi042.stdout:removed './236/36' 2023-07-29T02:03:28.724 INFO:tasks.workunit.client.0.smithi042.stdout:removed './236/20' 2023-07-29T02:03:28.725 INFO:tasks.workunit.client.0.smithi042.stdout:removed './236/39' 2023-07-29T02:03:28.725 INFO:tasks.workunit.client.0.smithi042.stdout:removed './236/34' 2023-07-29T02:03:28.725 INFO:tasks.workunit.client.0.smithi042.stdout:removed './236/38' 2023-07-29T02:03:28.725 INFO:tasks.workunit.client.0.smithi042.stdout:removed './236/28' 2023-07-29T02:03:28.725 INFO:tasks.workunit.client.0.smithi042.stdout:removed './236/24' 2023-07-29T02:03:28.725 INFO:tasks.workunit.client.0.smithi042.stdout:removed './236/29' 2023-07-29T02:03:28.725 INFO:tasks.workunit.client.0.smithi042.stdout:removed './236/32' 2023-07-29T02:03:29.250 INFO:tasks.workunit.client.0.smithi042.stdout:removed './236/22' 2023-07-29T02:03:29.250 INFO:tasks.workunit.client.0.smithi042.stdout:removed './236/25' 2023-07-29T02:03:29.250 INFO:tasks.workunit.client.0.smithi042.stdout:removed './236/30' 2023-07-29T02:03:29.250 INFO:tasks.workunit.client.0.smithi042.stdout:removed './236/33' 2023-07-29T02:03:29.250 INFO:tasks.workunit.client.0.smithi042.stdout:removed './236/23' 2023-07-29T02:03:29.251 INFO:tasks.workunit.client.0.smithi042.stdout:removed './236/35' 2023-07-29T02:03:29.251 INFO:tasks.workunit.client.0.smithi042.stdout:removed './236/26' 2023-07-29T02:03:29.251 INFO:tasks.workunit.client.0.smithi042.stdout:removed './236/37' 2023-07-29T02:03:29.251 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './236' 2023-07-29T02:03:29.251 INFO:tasks.workunit.client.0.smithi042.stdout:removed './237/21' 2023-07-29T02:03:29.251 INFO:tasks.workunit.client.0.smithi042.stdout:removed './237/27' 2023-07-29T02:03:29.251 INFO:tasks.workunit.client.0.smithi042.stdout:removed './237/31' 2023-07-29T02:03:29.252 INFO:tasks.workunit.client.0.smithi042.stdout:removed './237/36' 2023-07-29T02:03:29.252 INFO:tasks.workunit.client.0.smithi042.stdout:removed './237/20' 2023-07-29T02:03:29.252 INFO:tasks.workunit.client.0.smithi042.stdout:removed './237/39' 2023-07-29T02:03:29.252 INFO:tasks.workunit.client.0.smithi042.stdout:removed './237/34' 2023-07-29T02:03:29.252 INFO:tasks.workunit.client.0.smithi042.stdout:removed './237/38' 2023-07-29T02:03:29.252 INFO:tasks.workunit.client.0.smithi042.stdout:removed './237/28' 2023-07-29T02:03:29.253 INFO:tasks.workunit.client.0.smithi042.stdout:removed './237/24' 2023-07-29T02:03:29.253 INFO:tasks.workunit.client.0.smithi042.stdout:removed './237/29' 2023-07-29T02:03:29.253 INFO:tasks.workunit.client.0.smithi042.stdout:removed './237/32' 2023-07-29T02:03:29.253 INFO:tasks.workunit.client.0.smithi042.stdout:removed './237/22' 2023-07-29T02:03:29.253 INFO:tasks.workunit.client.0.smithi042.stdout:removed './237/25' 2023-07-29T02:03:29.253 INFO:tasks.workunit.client.0.smithi042.stdout:removed './237/30' 2023-07-29T02:03:29.253 INFO:tasks.workunit.client.0.smithi042.stdout:removed './237/33' 2023-07-29T02:03:29.254 INFO:tasks.workunit.client.0.smithi042.stdout:removed './237/23' 2023-07-29T02:03:29.254 INFO:tasks.workunit.client.0.smithi042.stdout:removed './237/35' 2023-07-29T02:03:29.254 INFO:tasks.workunit.client.0.smithi042.stdout:removed './237/26' 2023-07-29T02:03:29.254 INFO:tasks.workunit.client.0.smithi042.stdout:removed './237/37' 2023-07-29T02:03:29.254 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './237' 2023-07-29T02:03:29.254 INFO:tasks.workunit.client.0.smithi042.stdout:removed './238/21' 2023-07-29T02:03:29.254 INFO:tasks.workunit.client.0.smithi042.stdout:removed './238/27' 2023-07-29T02:03:29.254 INFO:tasks.workunit.client.0.smithi042.stdout:removed './238/31' 2023-07-29T02:03:29.255 INFO:tasks.workunit.client.0.smithi042.stdout:removed './238/36' 2023-07-29T02:03:29.255 INFO:tasks.workunit.client.0.smithi042.stdout:removed './238/20' 2023-07-29T02:03:29.255 INFO:tasks.workunit.client.0.smithi042.stdout:removed './238/39' 2023-07-29T02:03:29.255 INFO:tasks.workunit.client.0.smithi042.stdout:removed './238/34' 2023-07-29T02:03:29.255 INFO:tasks.workunit.client.0.smithi042.stdout:removed './238/38' 2023-07-29T02:03:29.255 INFO:tasks.workunit.client.0.smithi042.stdout:removed './238/28' 2023-07-29T02:03:29.255 INFO:tasks.workunit.client.0.smithi042.stdout:removed './238/24' 2023-07-29T02:03:29.256 INFO:tasks.workunit.client.0.smithi042.stdout:removed './238/29' 2023-07-29T02:03:29.256 INFO:tasks.workunit.client.0.smithi042.stdout:removed './238/32' 2023-07-29T02:03:29.256 INFO:tasks.workunit.client.0.smithi042.stdout:removed './238/22' 2023-07-29T02:03:29.256 INFO:tasks.workunit.client.0.smithi042.stdout:removed './238/25' 2023-07-29T02:03:29.256 INFO:tasks.workunit.client.0.smithi042.stdout:removed './238/30' 2023-07-29T02:03:29.256 INFO:tasks.workunit.client.0.smithi042.stdout:removed './238/33' 2023-07-29T02:03:29.256 INFO:tasks.workunit.client.0.smithi042.stdout:removed './238/23' 2023-07-29T02:03:29.257 INFO:tasks.workunit.client.0.smithi042.stdout:removed './238/35' 2023-07-29T02:03:29.257 INFO:tasks.workunit.client.0.smithi042.stdout:removed './238/26' 2023-07-29T02:03:29.257 INFO:tasks.workunit.client.0.smithi042.stdout:removed './238/37' 2023-07-29T02:03:29.257 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './238' 2023-07-29T02:03:29.258 INFO:tasks.workunit.client.0.smithi042.stdout:removed './239/21' 2023-07-29T02:03:29.258 INFO:tasks.workunit.client.0.smithi042.stdout:removed './239/27' 2023-07-29T02:03:29.258 INFO:tasks.workunit.client.0.smithi042.stdout:removed './239/31' 2023-07-29T02:03:29.258 INFO:tasks.workunit.client.0.smithi042.stdout:removed './239/36' 2023-07-29T02:03:29.258 INFO:tasks.workunit.client.0.smithi042.stdout:removed './239/20' 2023-07-29T02:03:29.258 INFO:tasks.workunit.client.0.smithi042.stdout:removed './239/39' 2023-07-29T02:03:29.258 INFO:tasks.workunit.client.0.smithi042.stdout:removed './239/34' 2023-07-29T02:03:29.259 INFO:tasks.workunit.client.0.smithi042.stdout:removed './239/38' 2023-07-29T02:03:29.259 INFO:tasks.workunit.client.0.smithi042.stdout:removed './239/28' 2023-07-29T02:03:29.259 INFO:tasks.workunit.client.0.smithi042.stdout:removed './239/24' 2023-07-29T02:03:29.259 INFO:tasks.workunit.client.0.smithi042.stdout:removed './239/29' 2023-07-29T02:03:29.259 INFO:tasks.workunit.client.0.smithi042.stdout:removed './239/32' 2023-07-29T02:03:29.260 INFO:tasks.workunit.client.0.smithi042.stdout:removed './239/22' 2023-07-29T02:03:29.260 INFO:tasks.workunit.client.0.smithi042.stdout:removed './239/25' 2023-07-29T02:03:29.260 INFO:tasks.workunit.client.0.smithi042.stdout:removed './239/30' 2023-07-29T02:03:29.260 INFO:tasks.workunit.client.0.smithi042.stdout:removed './239/33' 2023-07-29T02:03:29.260 INFO:tasks.workunit.client.0.smithi042.stdout:removed './239/23' 2023-07-29T02:03:29.260 INFO:tasks.workunit.client.0.smithi042.stdout:removed './239/35' 2023-07-29T02:03:29.260 INFO:tasks.workunit.client.0.smithi042.stdout:removed './239/26' 2023-07-29T02:03:29.261 INFO:tasks.workunit.client.0.smithi042.stdout:removed './239/37' 2023-07-29T02:03:29.261 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './239' 2023-07-29T02:03:29.261 INFO:tasks.workunit.client.0.smithi042.stdout:removed './240/21' 2023-07-29T02:03:29.261 INFO:tasks.workunit.client.0.smithi042.stdout:removed './240/27' 2023-07-29T02:03:29.261 INFO:tasks.workunit.client.0.smithi042.stdout:removed './240/31' 2023-07-29T02:03:29.261 INFO:tasks.workunit.client.0.smithi042.stdout:removed './240/36' 2023-07-29T02:03:29.261 INFO:tasks.workunit.client.0.smithi042.stdout:removed './240/20' 2023-07-29T02:03:29.262 INFO:tasks.workunit.client.0.smithi042.stdout:removed './240/39' 2023-07-29T02:03:29.262 INFO:tasks.workunit.client.0.smithi042.stdout:removed './240/34' 2023-07-29T02:03:29.262 INFO:tasks.workunit.client.0.smithi042.stdout:removed './240/38' 2023-07-29T02:03:29.262 INFO:tasks.workunit.client.0.smithi042.stdout:removed './240/28' 2023-07-29T02:03:29.262 INFO:tasks.workunit.client.0.smithi042.stdout:removed './240/24' 2023-07-29T02:03:29.262 INFO:tasks.workunit.client.0.smithi042.stdout:removed './240/29' 2023-07-29T02:03:29.262 INFO:tasks.workunit.client.0.smithi042.stdout:removed './240/32' 2023-07-29T02:03:29.262 INFO:tasks.workunit.client.0.smithi042.stdout:removed './240/22' 2023-07-29T02:03:29.263 INFO:tasks.workunit.client.0.smithi042.stdout:removed './240/25' 2023-07-29T02:03:29.263 INFO:tasks.workunit.client.0.smithi042.stdout:removed './240/30' 2023-07-29T02:03:29.263 INFO:tasks.workunit.client.0.smithi042.stdout:removed './240/33' 2023-07-29T02:03:29.263 INFO:tasks.workunit.client.0.smithi042.stdout:removed './240/23' 2023-07-29T02:03:29.263 INFO:tasks.workunit.client.0.smithi042.stdout:removed './240/35' 2023-07-29T02:03:29.263 INFO:tasks.workunit.client.0.smithi042.stdout:removed './240/26' 2023-07-29T02:03:29.264 INFO:tasks.workunit.client.0.smithi042.stdout:removed './240/37' 2023-07-29T02:03:29.264 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './240' 2023-07-29T02:03:29.264 INFO:tasks.workunit.client.0.smithi042.stdout:removed './241/21' 2023-07-29T02:03:29.264 INFO:tasks.workunit.client.0.smithi042.stdout:removed './241/27' 2023-07-29T02:03:29.264 INFO:tasks.workunit.client.0.smithi042.stdout:removed './241/31' 2023-07-29T02:03:29.265 INFO:tasks.workunit.client.0.smithi042.stdout:removed './241/36' 2023-07-29T02:03:29.265 INFO:tasks.workunit.client.0.smithi042.stdout:removed './241/20' 2023-07-29T02:03:29.265 INFO:tasks.workunit.client.0.smithi042.stdout:removed './241/39' 2023-07-29T02:03:29.265 INFO:tasks.workunit.client.0.smithi042.stdout:removed './241/34' 2023-07-29T02:03:29.265 INFO:tasks.workunit.client.0.smithi042.stdout:removed './241/38' 2023-07-29T02:03:29.265 INFO:tasks.workunit.client.0.smithi042.stdout:removed './241/28' 2023-07-29T02:03:29.265 INFO:tasks.workunit.client.0.smithi042.stdout:removed './241/24' 2023-07-29T02:03:29.266 INFO:tasks.workunit.client.0.smithi042.stdout:removed './241/29' 2023-07-29T02:03:29.266 INFO:tasks.workunit.client.0.smithi042.stdout:removed './241/32' 2023-07-29T02:03:29.266 INFO:tasks.workunit.client.0.smithi042.stdout:removed './241/22' 2023-07-29T02:03:29.266 INFO:tasks.workunit.client.0.smithi042.stdout:removed './241/25' 2023-07-29T02:03:29.266 INFO:tasks.workunit.client.0.smithi042.stdout:removed './241/30' 2023-07-29T02:03:29.266 INFO:tasks.workunit.client.0.smithi042.stdout:removed './241/33' 2023-07-29T02:03:29.266 INFO:tasks.workunit.client.0.smithi042.stdout:removed './241/23' 2023-07-29T02:03:29.267 INFO:tasks.workunit.client.0.smithi042.stdout:removed './241/35' 2023-07-29T02:03:29.267 INFO:tasks.workunit.client.0.smithi042.stdout:removed './241/26' 2023-07-29T02:03:29.267 INFO:tasks.workunit.client.0.smithi042.stdout:removed './241/37' 2023-07-29T02:03:29.267 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './241' 2023-07-29T02:03:29.267 INFO:tasks.workunit.client.0.smithi042.stdout:removed './242/21' 2023-07-29T02:03:29.267 INFO:tasks.workunit.client.0.smithi042.stdout:removed './242/27' 2023-07-29T02:03:29.268 INFO:tasks.workunit.client.0.smithi042.stdout:removed './242/31' 2023-07-29T02:03:29.268 INFO:tasks.workunit.client.0.smithi042.stdout:removed './242/36' 2023-07-29T02:03:29.268 INFO:tasks.workunit.client.0.smithi042.stdout:removed './242/20' 2023-07-29T02:03:29.268 INFO:tasks.workunit.client.0.smithi042.stdout:removed './242/39' 2023-07-29T02:03:29.268 INFO:tasks.workunit.client.0.smithi042.stdout:removed './242/34' 2023-07-29T02:03:29.269 INFO:tasks.workunit.client.0.smithi042.stdout:removed './242/38' 2023-07-29T02:03:29.269 INFO:tasks.workunit.client.0.smithi042.stdout:removed './242/28' 2023-07-29T02:03:29.269 INFO:tasks.workunit.client.0.smithi042.stdout:removed './242/24' 2023-07-29T02:03:29.269 INFO:tasks.workunit.client.0.smithi042.stdout:removed './242/29' 2023-07-29T02:03:29.269 INFO:tasks.workunit.client.0.smithi042.stdout:removed './242/32' 2023-07-29T02:03:29.269 INFO:tasks.workunit.client.0.smithi042.stdout:removed './242/22' 2023-07-29T02:03:29.269 INFO:tasks.workunit.client.0.smithi042.stdout:removed './242/25' 2023-07-29T02:03:29.270 INFO:tasks.workunit.client.0.smithi042.stdout:removed './242/30' 2023-07-29T02:03:29.270 INFO:tasks.workunit.client.0.smithi042.stdout:removed './242/33' 2023-07-29T02:03:29.270 INFO:tasks.workunit.client.0.smithi042.stdout:removed './242/23' 2023-07-29T02:03:29.270 INFO:tasks.workunit.client.0.smithi042.stdout:removed './242/35' 2023-07-29T02:03:29.270 INFO:tasks.workunit.client.0.smithi042.stdout:removed './242/26' 2023-07-29T02:03:29.270 INFO:tasks.workunit.client.0.smithi042.stdout:removed './242/37' 2023-07-29T02:03:29.270 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './242' 2023-07-29T02:03:29.270 INFO:tasks.workunit.client.0.smithi042.stdout:removed './243/21' 2023-07-29T02:03:29.271 INFO:tasks.workunit.client.0.smithi042.stdout:removed './243/27' 2023-07-29T02:03:29.271 INFO:tasks.workunit.client.0.smithi042.stdout:removed './243/31' 2023-07-29T02:03:29.271 INFO:tasks.workunit.client.0.smithi042.stdout:removed './243/36' 2023-07-29T02:03:29.271 INFO:tasks.workunit.client.0.smithi042.stdout:removed './243/20' 2023-07-29T02:03:29.271 INFO:tasks.workunit.client.0.smithi042.stdout:removed './243/39' 2023-07-29T02:03:29.271 INFO:tasks.workunit.client.0.smithi042.stdout:removed './243/34' 2023-07-29T02:03:29.271 INFO:tasks.workunit.client.0.smithi042.stdout:removed './243/38' 2023-07-29T02:03:29.272 INFO:tasks.workunit.client.0.smithi042.stdout:removed './243/28' 2023-07-29T02:03:29.272 INFO:tasks.workunit.client.0.smithi042.stdout:removed './243/24' 2023-07-29T02:03:29.272 INFO:tasks.workunit.client.0.smithi042.stdout:removed './243/29' 2023-07-29T02:03:29.272 INFO:tasks.workunit.client.0.smithi042.stdout:removed './243/32' 2023-07-29T02:03:29.272 INFO:tasks.workunit.client.0.smithi042.stdout:removed './243/22' 2023-07-29T02:03:29.272 INFO:tasks.workunit.client.0.smithi042.stdout:removed './243/25' 2023-07-29T02:03:29.272 INFO:tasks.workunit.client.0.smithi042.stdout:removed './243/30' 2023-07-29T02:03:29.273 INFO:tasks.workunit.client.0.smithi042.stdout:removed './243/33' 2023-07-29T02:03:29.273 INFO:tasks.workunit.client.0.smithi042.stdout:removed './243/23' 2023-07-29T02:03:29.273 INFO:tasks.workunit.client.0.smithi042.stdout:removed './243/35' 2023-07-29T02:03:29.273 INFO:tasks.workunit.client.0.smithi042.stdout:removed './243/26' 2023-07-29T02:03:29.273 INFO:tasks.workunit.client.0.smithi042.stdout:removed './243/37' 2023-07-29T02:03:29.273 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './243' 2023-07-29T02:03:29.273 INFO:tasks.workunit.client.0.smithi042.stdout:removed './244/21' 2023-07-29T02:03:29.274 INFO:tasks.workunit.client.0.smithi042.stdout:removed './244/27' 2023-07-29T02:03:29.274 INFO:tasks.workunit.client.0.smithi042.stdout:removed './244/31' 2023-07-29T02:03:29.274 INFO:tasks.workunit.client.0.smithi042.stdout:removed './244/36' 2023-07-29T02:03:29.274 INFO:tasks.workunit.client.0.smithi042.stdout:removed './244/20' 2023-07-29T02:03:29.274 INFO:tasks.workunit.client.0.smithi042.stdout:removed './244/39' 2023-07-29T02:03:29.274 INFO:tasks.workunit.client.0.smithi042.stdout:removed './244/34' 2023-07-29T02:03:29.275 INFO:tasks.workunit.client.0.smithi042.stdout:removed './244/38' 2023-07-29T02:03:29.275 INFO:tasks.workunit.client.0.smithi042.stdout:removed './244/28' 2023-07-29T02:03:29.275 INFO:tasks.workunit.client.0.smithi042.stdout:removed './244/24' 2023-07-29T02:03:29.275 INFO:tasks.workunit.client.0.smithi042.stdout:removed './244/29' 2023-07-29T02:03:29.275 INFO:tasks.workunit.client.0.smithi042.stdout:removed './244/32' 2023-07-29T02:03:29.275 INFO:tasks.workunit.client.0.smithi042.stdout:removed './244/22' 2023-07-29T02:03:29.276 INFO:tasks.workunit.client.0.smithi042.stdout:removed './244/25' 2023-07-29T02:03:29.276 INFO:tasks.workunit.client.0.smithi042.stdout:removed './244/30' 2023-07-29T02:03:29.276 INFO:tasks.workunit.client.0.smithi042.stdout:removed './244/33' 2023-07-29T02:03:29.276 INFO:tasks.workunit.client.0.smithi042.stdout:removed './244/23' 2023-07-29T02:03:29.276 INFO:tasks.workunit.client.0.smithi042.stdout:removed './244/35' 2023-07-29T02:03:29.276 INFO:tasks.workunit.client.0.smithi042.stdout:removed './244/26' 2023-07-29T02:03:29.276 INFO:tasks.workunit.client.0.smithi042.stdout:removed './244/37' 2023-07-29T02:03:29.276 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './244' 2023-07-29T02:03:29.277 INFO:tasks.workunit.client.0.smithi042.stdout:removed './245/21' 2023-07-29T02:03:29.277 INFO:tasks.workunit.client.0.smithi042.stdout:removed './245/27' 2023-07-29T02:03:29.277 INFO:tasks.workunit.client.0.smithi042.stdout:removed './245/31' 2023-07-29T02:03:29.277 INFO:tasks.workunit.client.0.smithi042.stdout:removed './245/36' 2023-07-29T02:03:29.277 INFO:tasks.workunit.client.0.smithi042.stdout:removed './245/20' 2023-07-29T02:03:29.277 INFO:tasks.workunit.client.0.smithi042.stdout:removed './245/39' 2023-07-29T02:03:29.277 INFO:tasks.workunit.client.0.smithi042.stdout:removed './245/34' 2023-07-29T02:03:29.278 INFO:tasks.workunit.client.0.smithi042.stdout:removed './245/38' 2023-07-29T02:03:29.278 INFO:tasks.workunit.client.0.smithi042.stdout:removed './245/28' 2023-07-29T02:03:29.278 INFO:tasks.workunit.client.0.smithi042.stdout:removed './245/24' 2023-07-29T02:03:29.278 INFO:tasks.workunit.client.0.smithi042.stdout:removed './245/29' 2023-07-29T02:03:29.279 INFO:tasks.workunit.client.0.smithi042.stdout:removed './245/32' 2023-07-29T02:03:29.279 INFO:tasks.workunit.client.0.smithi042.stdout:removed './245/22' 2023-07-29T02:03:29.279 INFO:tasks.workunit.client.0.smithi042.stdout:removed './245/25' 2023-07-29T02:03:29.279 INFO:tasks.workunit.client.0.smithi042.stdout:removed './245/30' 2023-07-29T02:03:29.279 INFO:tasks.workunit.client.0.smithi042.stdout:removed './245/33' 2023-07-29T02:03:29.279 INFO:tasks.workunit.client.0.smithi042.stdout:removed './245/23' 2023-07-29T02:03:29.279 INFO:tasks.workunit.client.0.smithi042.stdout:removed './245/35' 2023-07-29T02:03:29.280 INFO:tasks.workunit.client.0.smithi042.stdout:removed './245/26' 2023-07-29T02:03:29.280 INFO:tasks.workunit.client.0.smithi042.stdout:removed './245/37' 2023-07-29T02:03:29.280 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './245' 2023-07-29T02:03:29.280 INFO:tasks.workunit.client.0.smithi042.stdout:removed './246/21' 2023-07-29T02:03:29.280 INFO:tasks.workunit.client.0.smithi042.stdout:removed './246/27' 2023-07-29T02:03:29.280 INFO:tasks.workunit.client.0.smithi042.stdout:removed './246/31' 2023-07-29T02:03:29.280 INFO:tasks.workunit.client.0.smithi042.stdout:removed './246/36' 2023-07-29T02:03:29.281 INFO:tasks.workunit.client.0.smithi042.stdout:removed './246/20' 2023-07-29T02:03:29.281 INFO:tasks.workunit.client.0.smithi042.stdout:removed './246/39' 2023-07-29T02:03:29.281 INFO:tasks.workunit.client.0.smithi042.stdout:removed './246/34' 2023-07-29T02:03:29.281 INFO:tasks.workunit.client.0.smithi042.stdout:removed './246/38' 2023-07-29T02:03:29.281 INFO:tasks.workunit.client.0.smithi042.stdout:removed './246/28' 2023-07-29T02:03:29.281 INFO:tasks.workunit.client.0.smithi042.stdout:removed './246/24' 2023-07-29T02:03:29.281 INFO:tasks.workunit.client.0.smithi042.stdout:removed './246/29' 2023-07-29T02:03:29.281 INFO:tasks.workunit.client.0.smithi042.stdout:removed './246/32' 2023-07-29T02:03:29.282 INFO:tasks.workunit.client.0.smithi042.stdout:removed './246/22' 2023-07-29T02:03:29.732 INFO:tasks.workunit.client.0.smithi042.stdout:removed './246/25' 2023-07-29T02:03:29.732 INFO:tasks.workunit.client.0.smithi042.stdout:removed './246/30' 2023-07-29T02:03:29.732 INFO:tasks.workunit.client.0.smithi042.stdout:removed './246/33' 2023-07-29T02:03:29.735 INFO:tasks.workunit.client.0.smithi042.stdout:removed './246/23' 2023-07-29T02:03:29.736 INFO:tasks.workunit.client.0.smithi042.stdout:removed './246/35' 2023-07-29T02:03:29.736 INFO:tasks.workunit.client.0.smithi042.stdout:removed './246/26' 2023-07-29T02:03:29.736 INFO:tasks.workunit.client.0.smithi042.stdout:removed './246/37' 2023-07-29T02:03:29.736 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './246' 2023-07-29T02:03:29.736 INFO:tasks.workunit.client.0.smithi042.stdout:removed './247/21' 2023-07-29T02:03:29.736 INFO:tasks.workunit.client.0.smithi042.stdout:removed './247/27' 2023-07-29T02:03:29.736 INFO:tasks.workunit.client.0.smithi042.stdout:removed './247/31' 2023-07-29T02:03:29.737 INFO:tasks.workunit.client.0.smithi042.stdout:removed './247/36' 2023-07-29T02:03:29.737 INFO:tasks.workunit.client.0.smithi042.stdout:removed './247/20' 2023-07-29T02:03:29.737 INFO:tasks.workunit.client.0.smithi042.stdout:removed './247/39' 2023-07-29T02:03:29.737 INFO:tasks.workunit.client.0.smithi042.stdout:removed './247/34' 2023-07-29T02:03:29.737 INFO:tasks.workunit.client.0.smithi042.stdout:removed './247/38' 2023-07-29T02:03:29.737 INFO:tasks.workunit.client.0.smithi042.stdout:removed './247/28' 2023-07-29T02:03:29.737 INFO:tasks.workunit.client.0.smithi042.stdout:removed './247/24' 2023-07-29T02:03:29.738 INFO:tasks.workunit.client.0.smithi042.stdout:removed './247/29' 2023-07-29T02:03:29.738 INFO:tasks.workunit.client.0.smithi042.stdout:removed './247/32' 2023-07-29T02:03:29.738 INFO:tasks.workunit.client.0.smithi042.stdout:removed './247/22' 2023-07-29T02:03:29.738 INFO:tasks.workunit.client.0.smithi042.stdout:removed './247/25' 2023-07-29T02:03:29.738 INFO:tasks.workunit.client.0.smithi042.stdout:removed './247/30' 2023-07-29T02:03:29.738 INFO:tasks.workunit.client.0.smithi042.stdout:removed './247/33' 2023-07-29T02:03:29.738 INFO:tasks.workunit.client.0.smithi042.stdout:removed './247/23' 2023-07-29T02:03:29.738 INFO:tasks.workunit.client.0.smithi042.stdout:removed './247/35' 2023-07-29T02:03:29.739 INFO:tasks.workunit.client.0.smithi042.stdout:removed './247/26' 2023-07-29T02:03:29.739 INFO:tasks.workunit.client.0.smithi042.stdout:removed './247/37' 2023-07-29T02:03:29.739 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './247' 2023-07-29T02:03:29.739 INFO:tasks.workunit.client.0.smithi042.stdout:removed './248/21' 2023-07-29T02:03:29.739 INFO:tasks.workunit.client.0.smithi042.stdout:removed './248/27' 2023-07-29T02:03:29.739 INFO:tasks.workunit.client.0.smithi042.stdout:removed './248/31' 2023-07-29T02:03:29.739 INFO:tasks.workunit.client.0.smithi042.stdout:removed './248/36' 2023-07-29T02:03:29.739 INFO:tasks.workunit.client.0.smithi042.stdout:removed './248/20' 2023-07-29T02:03:29.740 INFO:tasks.workunit.client.0.smithi042.stdout:removed './248/39' 2023-07-29T02:03:29.740 INFO:tasks.workunit.client.0.smithi042.stdout:removed './248/34' 2023-07-29T02:03:29.740 INFO:tasks.workunit.client.0.smithi042.stdout:removed './248/38' 2023-07-29T02:03:29.740 INFO:tasks.workunit.client.0.smithi042.stdout:removed './248/28' 2023-07-29T02:03:29.740 INFO:tasks.workunit.client.0.smithi042.stdout:removed './248/24' 2023-07-29T02:03:29.740 INFO:tasks.workunit.client.0.smithi042.stdout:removed './248/29' 2023-07-29T02:03:29.740 INFO:tasks.workunit.client.0.smithi042.stdout:removed './248/32' 2023-07-29T02:03:29.741 INFO:tasks.workunit.client.0.smithi042.stdout:removed './248/22' 2023-07-29T02:03:29.741 INFO:tasks.workunit.client.0.smithi042.stdout:removed './248/25' 2023-07-29T02:03:29.741 INFO:tasks.workunit.client.0.smithi042.stdout:removed './248/30' 2023-07-29T02:03:29.741 INFO:tasks.workunit.client.0.smithi042.stdout:removed './248/33' 2023-07-29T02:03:29.741 INFO:tasks.workunit.client.0.smithi042.stdout:removed './248/23' 2023-07-29T02:03:29.741 INFO:tasks.workunit.client.0.smithi042.stdout:removed './248/35' 2023-07-29T02:03:29.741 INFO:tasks.workunit.client.0.smithi042.stdout:removed './248/26' 2023-07-29T02:03:29.741 INFO:tasks.workunit.client.0.smithi042.stdout:removed './248/37' 2023-07-29T02:03:29.742 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './248' 2023-07-29T02:03:29.742 INFO:tasks.workunit.client.0.smithi042.stdout:removed './249/21' 2023-07-29T02:03:29.742 INFO:tasks.workunit.client.0.smithi042.stdout:removed './249/27' 2023-07-29T02:03:29.742 INFO:tasks.workunit.client.0.smithi042.stdout:removed './249/31' 2023-07-29T02:03:29.742 INFO:tasks.workunit.client.0.smithi042.stdout:removed './249/36' 2023-07-29T02:03:29.742 INFO:tasks.workunit.client.0.smithi042.stdout:removed './249/20' 2023-07-29T02:03:29.742 INFO:tasks.workunit.client.0.smithi042.stdout:removed './249/39' 2023-07-29T02:03:29.742 INFO:tasks.workunit.client.0.smithi042.stdout:removed './249/34' 2023-07-29T02:03:29.743 INFO:tasks.workunit.client.0.smithi042.stdout:removed './249/38' 2023-07-29T02:03:29.743 INFO:tasks.workunit.client.0.smithi042.stdout:removed './249/28' 2023-07-29T02:03:29.743 INFO:tasks.workunit.client.0.smithi042.stdout:removed './249/24' 2023-07-29T02:03:29.743 INFO:tasks.workunit.client.0.smithi042.stdout:removed './249/29' 2023-07-29T02:03:29.743 INFO:tasks.workunit.client.0.smithi042.stdout:removed './249/32' 2023-07-29T02:03:29.743 INFO:tasks.workunit.client.0.smithi042.stdout:removed './249/22' 2023-07-29T02:03:29.743 INFO:tasks.workunit.client.0.smithi042.stdout:removed './249/25' 2023-07-29T02:03:29.743 INFO:tasks.workunit.client.0.smithi042.stdout:removed './249/30' 2023-07-29T02:03:29.744 INFO:tasks.workunit.client.0.smithi042.stdout:removed './249/33' 2023-07-29T02:03:29.744 INFO:tasks.workunit.client.0.smithi042.stdout:removed './249/23' 2023-07-29T02:03:29.744 INFO:tasks.workunit.client.0.smithi042.stdout:removed './249/35' 2023-07-29T02:03:29.744 INFO:tasks.workunit.client.0.smithi042.stdout:removed './249/26' 2023-07-29T02:03:29.744 INFO:tasks.workunit.client.0.smithi042.stdout:removed './249/37' 2023-07-29T02:03:29.744 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './249' 2023-07-29T02:03:29.744 INFO:tasks.workunit.client.0.smithi042.stdout:removed './250/21' 2023-07-29T02:03:29.744 INFO:tasks.workunit.client.0.smithi042.stdout:removed './250/27' 2023-07-29T02:03:29.745 INFO:tasks.workunit.client.0.smithi042.stdout:removed './250/31' 2023-07-29T02:03:29.745 INFO:tasks.workunit.client.0.smithi042.stdout:removed './250/36' 2023-07-29T02:03:29.745 INFO:tasks.workunit.client.0.smithi042.stdout:removed './250/20' 2023-07-29T02:03:29.745 INFO:tasks.workunit.client.0.smithi042.stdout:removed './250/39' 2023-07-29T02:03:29.745 INFO:tasks.workunit.client.0.smithi042.stdout:removed './250/34' 2023-07-29T02:03:29.745 INFO:tasks.workunit.client.0.smithi042.stdout:removed './250/38' 2023-07-29T02:03:29.746 INFO:tasks.workunit.client.0.smithi042.stdout:removed './250/28' 2023-07-29T02:03:29.746 INFO:tasks.workunit.client.0.smithi042.stdout:removed './250/24' 2023-07-29T02:03:29.746 INFO:tasks.workunit.client.0.smithi042.stdout:removed './250/29' 2023-07-29T02:03:29.746 INFO:tasks.workunit.client.0.smithi042.stdout:removed './250/32' 2023-07-29T02:03:29.746 INFO:tasks.workunit.client.0.smithi042.stdout:removed './250/22' 2023-07-29T02:03:29.746 INFO:tasks.workunit.client.0.smithi042.stdout:removed './250/25' 2023-07-29T02:03:29.746 INFO:tasks.workunit.client.0.smithi042.stdout:removed './250/30' 2023-07-29T02:03:29.746 INFO:tasks.workunit.client.0.smithi042.stdout:removed './250/33' 2023-07-29T02:03:29.747 INFO:tasks.workunit.client.0.smithi042.stdout:removed './250/23' 2023-07-29T02:03:29.747 INFO:tasks.workunit.client.0.smithi042.stdout:removed './250/35' 2023-07-29T02:03:29.747 INFO:tasks.workunit.client.0.smithi042.stdout:removed './250/26' 2023-07-29T02:03:29.747 INFO:tasks.workunit.client.0.smithi042.stdout:removed './250/37' 2023-07-29T02:03:29.747 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './250' 2023-07-29T02:03:29.747 INFO:tasks.workunit.client.0.smithi042.stdout:removed './251/21' 2023-07-29T02:03:29.747 INFO:tasks.workunit.client.0.smithi042.stdout:removed './251/27' 2023-07-29T02:03:29.747 INFO:tasks.workunit.client.0.smithi042.stdout:removed './251/31' 2023-07-29T02:03:29.748 INFO:tasks.workunit.client.0.smithi042.stdout:removed './251/36' 2023-07-29T02:03:29.748 INFO:tasks.workunit.client.0.smithi042.stdout:removed './251/20' 2023-07-29T02:03:29.748 INFO:tasks.workunit.client.0.smithi042.stdout:removed './251/39' 2023-07-29T02:03:29.748 INFO:tasks.workunit.client.0.smithi042.stdout:removed './251/34' 2023-07-29T02:03:29.748 INFO:tasks.workunit.client.0.smithi042.stdout:removed './251/38' 2023-07-29T02:03:29.748 INFO:tasks.workunit.client.0.smithi042.stdout:removed './251/28' 2023-07-29T02:03:29.748 INFO:tasks.workunit.client.0.smithi042.stdout:removed './251/24' 2023-07-29T02:03:29.749 INFO:tasks.workunit.client.0.smithi042.stdout:removed './251/29' 2023-07-29T02:03:29.749 INFO:tasks.workunit.client.0.smithi042.stdout:removed './251/32' 2023-07-29T02:03:29.749 INFO:tasks.workunit.client.0.smithi042.stdout:removed './251/22' 2023-07-29T02:03:29.749 INFO:tasks.workunit.client.0.smithi042.stdout:removed './251/25' 2023-07-29T02:03:29.749 INFO:tasks.workunit.client.0.smithi042.stdout:removed './251/30' 2023-07-29T02:03:29.749 INFO:tasks.workunit.client.0.smithi042.stdout:removed './251/33' 2023-07-29T02:03:29.749 INFO:tasks.workunit.client.0.smithi042.stdout:removed './251/23' 2023-07-29T02:03:29.749 INFO:tasks.workunit.client.0.smithi042.stdout:removed './251/35' 2023-07-29T02:03:29.750 INFO:tasks.workunit.client.0.smithi042.stdout:removed './251/26' 2023-07-29T02:03:29.750 INFO:tasks.workunit.client.0.smithi042.stdout:removed './251/37' 2023-07-29T02:03:29.750 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './251' 2023-07-29T02:03:29.750 INFO:tasks.workunit.client.0.smithi042.stdout:removed './252/21' 2023-07-29T02:03:29.750 INFO:tasks.workunit.client.0.smithi042.stdout:removed './252/27' 2023-07-29T02:03:29.750 INFO:tasks.workunit.client.0.smithi042.stdout:removed './252/31' 2023-07-29T02:03:29.750 INFO:tasks.workunit.client.0.smithi042.stdout:removed './252/36' 2023-07-29T02:03:29.750 INFO:tasks.workunit.client.0.smithi042.stdout:removed './252/20' 2023-07-29T02:03:29.751 INFO:tasks.workunit.client.0.smithi042.stdout:removed './252/39' 2023-07-29T02:03:29.751 INFO:tasks.workunit.client.0.smithi042.stdout:removed './252/34' 2023-07-29T02:03:29.751 INFO:tasks.workunit.client.0.smithi042.stdout:removed './252/38' 2023-07-29T02:03:29.751 INFO:tasks.workunit.client.0.smithi042.stdout:removed './252/28' 2023-07-29T02:03:29.751 INFO:tasks.workunit.client.0.smithi042.stdout:removed './252/24' 2023-07-29T02:03:29.751 INFO:tasks.workunit.client.0.smithi042.stdout:removed './252/29' 2023-07-29T02:03:29.751 INFO:tasks.workunit.client.0.smithi042.stdout:removed './252/32' 2023-07-29T02:03:29.751 INFO:tasks.workunit.client.0.smithi042.stdout:removed './252/22' 2023-07-29T02:03:29.752 INFO:tasks.workunit.client.0.smithi042.stdout:removed './252/25' 2023-07-29T02:03:29.752 INFO:tasks.workunit.client.0.smithi042.stdout:removed './252/30' 2023-07-29T02:03:29.752 INFO:tasks.workunit.client.0.smithi042.stdout:removed './252/33' 2023-07-29T02:03:29.752 INFO:tasks.workunit.client.0.smithi042.stdout:removed './252/23' 2023-07-29T02:03:29.752 INFO:tasks.workunit.client.0.smithi042.stdout:removed './252/35' 2023-07-29T02:03:29.752 INFO:tasks.workunit.client.0.smithi042.stdout:removed './252/26' 2023-07-29T02:03:29.752 INFO:tasks.workunit.client.0.smithi042.stdout:removed './252/37' 2023-07-29T02:03:29.752 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './252' 2023-07-29T02:03:29.753 INFO:tasks.workunit.client.0.smithi042.stdout:removed './253/21' 2023-07-29T02:03:29.753 INFO:tasks.workunit.client.0.smithi042.stdout:removed './253/27' 2023-07-29T02:03:29.753 INFO:tasks.workunit.client.0.smithi042.stdout:removed './253/31' 2023-07-29T02:03:29.753 INFO:tasks.workunit.client.0.smithi042.stdout:removed './253/36' 2023-07-29T02:03:29.753 INFO:tasks.workunit.client.0.smithi042.stdout:removed './253/20' 2023-07-29T02:03:29.753 INFO:tasks.workunit.client.0.smithi042.stdout:removed './253/39' 2023-07-29T02:03:29.753 INFO:tasks.workunit.client.0.smithi042.stdout:removed './253/34' 2023-07-29T02:03:29.753 INFO:tasks.workunit.client.0.smithi042.stdout:removed './253/38' 2023-07-29T02:03:29.754 INFO:tasks.workunit.client.0.smithi042.stdout:removed './253/28' 2023-07-29T02:03:29.754 INFO:tasks.workunit.client.0.smithi042.stdout:removed './253/24' 2023-07-29T02:03:29.754 INFO:tasks.workunit.client.0.smithi042.stdout:removed './253/29' 2023-07-29T02:03:29.754 INFO:tasks.workunit.client.0.smithi042.stdout:removed './253/32' 2023-07-29T02:03:29.754 INFO:tasks.workunit.client.0.smithi042.stdout:removed './253/22' 2023-07-29T02:03:29.754 INFO:tasks.workunit.client.0.smithi042.stdout:removed './253/25' 2023-07-29T02:03:29.754 INFO:tasks.workunit.client.0.smithi042.stdout:removed './253/30' 2023-07-29T02:03:29.755 INFO:tasks.workunit.client.0.smithi042.stdout:removed './253/33' 2023-07-29T02:03:29.755 INFO:tasks.workunit.client.0.smithi042.stdout:removed './253/23' 2023-07-29T02:03:29.755 INFO:tasks.workunit.client.0.smithi042.stdout:removed './253/35' 2023-07-29T02:03:29.755 INFO:tasks.workunit.client.0.smithi042.stdout:removed './253/26' 2023-07-29T02:03:29.755 INFO:tasks.workunit.client.0.smithi042.stdout:removed './253/37' 2023-07-29T02:03:29.755 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './253' 2023-07-29T02:03:29.755 INFO:tasks.workunit.client.0.smithi042.stdout:removed './254/21' 2023-07-29T02:03:29.755 INFO:tasks.workunit.client.0.smithi042.stdout:removed './254/27' 2023-07-29T02:03:29.756 INFO:tasks.workunit.client.0.smithi042.stdout:removed './254/31' 2023-07-29T02:03:29.756 INFO:tasks.workunit.client.0.smithi042.stdout:removed './254/36' 2023-07-29T02:03:29.756 INFO:tasks.workunit.client.0.smithi042.stdout:removed './254/20' 2023-07-29T02:03:29.756 INFO:tasks.workunit.client.0.smithi042.stdout:removed './254/39' 2023-07-29T02:03:29.756 INFO:tasks.workunit.client.0.smithi042.stdout:removed './254/34' 2023-07-29T02:03:29.756 INFO:tasks.workunit.client.0.smithi042.stdout:removed './254/38' 2023-07-29T02:03:29.756 INFO:tasks.workunit.client.0.smithi042.stdout:removed './254/28' 2023-07-29T02:03:29.756 INFO:tasks.workunit.client.0.smithi042.stdout:removed './254/24' 2023-07-29T02:03:29.757 INFO:tasks.workunit.client.0.smithi042.stdout:removed './254/29' 2023-07-29T02:03:29.757 INFO:tasks.workunit.client.0.smithi042.stdout:removed './254/32' 2023-07-29T02:03:29.757 INFO:tasks.workunit.client.0.smithi042.stdout:removed './254/22' 2023-07-29T02:03:29.757 INFO:tasks.workunit.client.0.smithi042.stdout:removed './254/25' 2023-07-29T02:03:29.757 INFO:tasks.workunit.client.0.smithi042.stdout:removed './254/30' 2023-07-29T02:03:29.757 INFO:tasks.workunit.client.0.smithi042.stdout:removed './254/33' 2023-07-29T02:03:29.757 INFO:tasks.workunit.client.0.smithi042.stdout:removed './254/23' 2023-07-29T02:03:29.757 INFO:tasks.workunit.client.0.smithi042.stdout:removed './254/35' 2023-07-29T02:03:29.758 INFO:tasks.workunit.client.0.smithi042.stdout:removed './254/26' 2023-07-29T02:03:29.758 INFO:tasks.workunit.client.0.smithi042.stdout:removed './254/37' 2023-07-29T02:03:29.758 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './254' 2023-07-29T02:03:29.758 INFO:tasks.workunit.client.0.smithi042.stdout:removed './255/21' 2023-07-29T02:03:29.758 INFO:tasks.workunit.client.0.smithi042.stdout:removed './255/27' 2023-07-29T02:03:29.758 INFO:tasks.workunit.client.0.smithi042.stdout:removed './255/31' 2023-07-29T02:03:29.758 INFO:tasks.workunit.client.0.smithi042.stdout:removed './255/36' 2023-07-29T02:03:29.758 INFO:tasks.workunit.client.0.smithi042.stdout:removed './255/20' 2023-07-29T02:03:29.759 INFO:tasks.workunit.client.0.smithi042.stdout:removed './255/39' 2023-07-29T02:03:29.759 INFO:tasks.workunit.client.0.smithi042.stdout:removed './255/34' 2023-07-29T02:03:29.759 INFO:tasks.workunit.client.0.smithi042.stdout:removed './255/38' 2023-07-29T02:03:29.759 INFO:tasks.workunit.client.0.smithi042.stdout:removed './255/28' 2023-07-29T02:03:29.759 INFO:tasks.workunit.client.0.smithi042.stdout:removed './255/24' 2023-07-29T02:03:29.759 INFO:tasks.workunit.client.0.smithi042.stdout:removed './255/29' 2023-07-29T02:03:29.759 INFO:tasks.workunit.client.0.smithi042.stdout:removed './255/32' 2023-07-29T02:03:29.759 INFO:tasks.workunit.client.0.smithi042.stdout:removed './255/22' 2023-07-29T02:03:29.760 INFO:tasks.workunit.client.0.smithi042.stdout:removed './255/25' 2023-07-29T02:03:29.760 INFO:tasks.workunit.client.0.smithi042.stdout:removed './255/30' 2023-07-29T02:03:29.760 INFO:tasks.workunit.client.0.smithi042.stdout:removed './255/33' 2023-07-29T02:03:29.760 INFO:tasks.workunit.client.0.smithi042.stdout:removed './255/23' 2023-07-29T02:03:29.760 INFO:tasks.workunit.client.0.smithi042.stdout:removed './255/35' 2023-07-29T02:03:29.760 INFO:tasks.workunit.client.0.smithi042.stdout:removed './255/26' 2023-07-29T02:03:29.760 INFO:tasks.workunit.client.0.smithi042.stdout:removed './255/37' 2023-07-29T02:03:29.760 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './255' 2023-07-29T02:03:29.761 INFO:tasks.workunit.client.0.smithi042.stdout:removed './256/21' 2023-07-29T02:03:29.761 INFO:tasks.workunit.client.0.smithi042.stdout:removed './256/27' 2023-07-29T02:03:29.761 INFO:tasks.workunit.client.0.smithi042.stdout:removed './256/31' 2023-07-29T02:03:29.761 INFO:tasks.workunit.client.0.smithi042.stdout:removed './256/36' 2023-07-29T02:03:29.761 INFO:tasks.workunit.client.0.smithi042.stdout:removed './256/20' 2023-07-29T02:03:29.761 INFO:tasks.workunit.client.0.smithi042.stdout:removed './256/39' 2023-07-29T02:03:29.761 INFO:tasks.workunit.client.0.smithi042.stdout:removed './256/34' 2023-07-29T02:03:29.762 INFO:tasks.workunit.client.0.smithi042.stdout:removed './256/38' 2023-07-29T02:03:29.762 INFO:tasks.workunit.client.0.smithi042.stdout:removed './256/28' 2023-07-29T02:03:29.762 INFO:tasks.workunit.client.0.smithi042.stdout:removed './256/24' 2023-07-29T02:03:29.762 INFO:tasks.workunit.client.0.smithi042.stdout:removed './256/29' 2023-07-29T02:03:29.762 INFO:tasks.workunit.client.0.smithi042.stdout:removed './256/32' 2023-07-29T02:03:29.762 INFO:tasks.workunit.client.0.smithi042.stdout:removed './256/22' 2023-07-29T02:03:29.762 INFO:tasks.workunit.client.0.smithi042.stdout:removed './256/25' 2023-07-29T02:03:29.762 INFO:tasks.workunit.client.0.smithi042.stdout:removed './256/30' 2023-07-29T02:03:30.328 INFO:tasks.workunit.client.0.smithi042.stdout:removed './256/33' 2023-07-29T02:03:30.328 INFO:tasks.workunit.client.0.smithi042.stdout:removed './256/23' 2023-07-29T02:03:30.328 INFO:tasks.workunit.client.0.smithi042.stdout:removed './256/35' 2023-07-29T02:03:30.328 INFO:tasks.workunit.client.0.smithi042.stdout:removed './256/26' 2023-07-29T02:03:30.329 INFO:tasks.workunit.client.0.smithi042.stdout:removed './256/37' 2023-07-29T02:03:30.329 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './256' 2023-07-29T02:03:30.329 INFO:tasks.workunit.client.0.smithi042.stdout:removed './257/21' 2023-07-29T02:03:30.329 INFO:tasks.workunit.client.0.smithi042.stdout:removed './257/27' 2023-07-29T02:03:30.329 INFO:tasks.workunit.client.0.smithi042.stdout:removed './257/31' 2023-07-29T02:03:30.329 INFO:tasks.workunit.client.0.smithi042.stdout:removed './257/36' 2023-07-29T02:03:30.329 INFO:tasks.workunit.client.0.smithi042.stdout:removed './257/20' 2023-07-29T02:03:30.329 INFO:tasks.workunit.client.0.smithi042.stdout:removed './257/39' 2023-07-29T02:03:30.330 INFO:tasks.workunit.client.0.smithi042.stdout:removed './257/34' 2023-07-29T02:03:30.330 INFO:tasks.workunit.client.0.smithi042.stdout:removed './257/38' 2023-07-29T02:03:30.330 INFO:tasks.workunit.client.0.smithi042.stdout:removed './257/28' 2023-07-29T02:03:30.330 INFO:tasks.workunit.client.0.smithi042.stdout:removed './257/24' 2023-07-29T02:03:30.330 INFO:tasks.workunit.client.0.smithi042.stdout:removed './257/29' 2023-07-29T02:03:30.330 INFO:tasks.workunit.client.0.smithi042.stdout:removed './257/32' 2023-07-29T02:03:30.330 INFO:tasks.workunit.client.0.smithi042.stdout:removed './257/22' 2023-07-29T02:03:30.331 INFO:tasks.workunit.client.0.smithi042.stdout:removed './257/25' 2023-07-29T02:03:30.331 INFO:tasks.workunit.client.0.smithi042.stdout:removed './257/30' 2023-07-29T02:03:30.331 INFO:tasks.workunit.client.0.smithi042.stdout:removed './257/33' 2023-07-29T02:03:30.331 INFO:tasks.workunit.client.0.smithi042.stdout:removed './257/23' 2023-07-29T02:03:30.331 INFO:tasks.workunit.client.0.smithi042.stdout:removed './257/35' 2023-07-29T02:03:30.331 INFO:tasks.workunit.client.0.smithi042.stdout:removed './257/26' 2023-07-29T02:03:30.331 INFO:tasks.workunit.client.0.smithi042.stdout:removed './257/37' 2023-07-29T02:03:30.332 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './257' 2023-07-29T02:03:30.332 INFO:tasks.workunit.client.0.smithi042.stdout:removed './258/21' 2023-07-29T02:03:30.332 INFO:tasks.workunit.client.0.smithi042.stdout:removed './258/27' 2023-07-29T02:03:30.332 INFO:tasks.workunit.client.0.smithi042.stdout:removed './258/31' 2023-07-29T02:03:30.332 INFO:tasks.workunit.client.0.smithi042.stdout:removed './258/36' 2023-07-29T02:03:30.332 INFO:tasks.workunit.client.0.smithi042.stdout:removed './258/20' 2023-07-29T02:03:30.332 INFO:tasks.workunit.client.0.smithi042.stdout:removed './258/39' 2023-07-29T02:03:30.333 INFO:tasks.workunit.client.0.smithi042.stdout:removed './258/34' 2023-07-29T02:03:30.333 INFO:tasks.workunit.client.0.smithi042.stdout:removed './258/38' 2023-07-29T02:03:30.333 INFO:tasks.workunit.client.0.smithi042.stdout:removed './258/28' 2023-07-29T02:03:30.333 INFO:tasks.workunit.client.0.smithi042.stdout:removed './258/24' 2023-07-29T02:03:30.333 INFO:tasks.workunit.client.0.smithi042.stdout:removed './258/29' 2023-07-29T02:03:30.333 INFO:tasks.workunit.client.0.smithi042.stdout:removed './258/32' 2023-07-29T02:03:30.334 INFO:tasks.workunit.client.0.smithi042.stdout:removed './258/22' 2023-07-29T02:03:30.334 INFO:tasks.workunit.client.0.smithi042.stdout:removed './258/25' 2023-07-29T02:03:30.334 INFO:tasks.workunit.client.0.smithi042.stdout:removed './258/30' 2023-07-29T02:03:30.334 INFO:tasks.workunit.client.0.smithi042.stdout:removed './258/33' 2023-07-29T02:03:30.334 INFO:tasks.workunit.client.0.smithi042.stdout:removed './258/23' 2023-07-29T02:03:30.335 INFO:tasks.workunit.client.0.smithi042.stdout:removed './258/35' 2023-07-29T02:03:30.335 INFO:tasks.workunit.client.0.smithi042.stdout:removed './258/26' 2023-07-29T02:03:30.335 INFO:tasks.workunit.client.0.smithi042.stdout:removed './258/37' 2023-07-29T02:03:30.335 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './258' 2023-07-29T02:03:30.335 INFO:tasks.workunit.client.0.smithi042.stdout:removed './259/21' 2023-07-29T02:03:30.335 INFO:tasks.workunit.client.0.smithi042.stdout:removed './259/27' 2023-07-29T02:03:30.335 INFO:tasks.workunit.client.0.smithi042.stdout:removed './259/31' 2023-07-29T02:03:30.336 INFO:tasks.workunit.client.0.smithi042.stdout:removed './259/36' 2023-07-29T02:03:30.336 INFO:tasks.workunit.client.0.smithi042.stdout:removed './259/20' 2023-07-29T02:03:30.336 INFO:tasks.workunit.client.0.smithi042.stdout:removed './259/39' 2023-07-29T02:03:30.336 INFO:tasks.workunit.client.0.smithi042.stdout:removed './259/34' 2023-07-29T02:03:30.336 INFO:tasks.workunit.client.0.smithi042.stdout:removed './259/38' 2023-07-29T02:03:30.336 INFO:tasks.workunit.client.0.smithi042.stdout:removed './259/28' 2023-07-29T02:03:30.336 INFO:tasks.workunit.client.0.smithi042.stdout:removed './259/24' 2023-07-29T02:03:30.337 INFO:tasks.workunit.client.0.smithi042.stdout:removed './259/29' 2023-07-29T02:03:30.337 INFO:tasks.workunit.client.0.smithi042.stdout:removed './259/32' 2023-07-29T02:03:30.337 INFO:tasks.workunit.client.0.smithi042.stdout:removed './259/22' 2023-07-29T02:03:30.337 INFO:tasks.workunit.client.0.smithi042.stdout:removed './259/25' 2023-07-29T02:03:30.337 INFO:tasks.workunit.client.0.smithi042.stdout:removed './259/30' 2023-07-29T02:03:30.337 INFO:tasks.workunit.client.0.smithi042.stdout:removed './259/33' 2023-07-29T02:03:30.338 INFO:tasks.workunit.client.0.smithi042.stdout:removed './259/23' 2023-07-29T02:03:30.338 INFO:tasks.workunit.client.0.smithi042.stdout:removed './259/35' 2023-07-29T02:03:30.338 INFO:tasks.workunit.client.0.smithi042.stdout:removed './259/26' 2023-07-29T02:03:30.338 INFO:tasks.workunit.client.0.smithi042.stdout:removed './259/37' 2023-07-29T02:03:30.338 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './259' 2023-07-29T02:03:30.338 INFO:tasks.workunit.client.0.smithi042.stdout:removed './260/21' 2023-07-29T02:03:30.339 INFO:tasks.workunit.client.0.smithi042.stdout:removed './260/27' 2023-07-29T02:03:30.339 INFO:tasks.workunit.client.0.smithi042.stdout:removed './260/31' 2023-07-29T02:03:30.339 INFO:tasks.workunit.client.0.smithi042.stdout:removed './260/36' 2023-07-29T02:03:30.339 INFO:tasks.workunit.client.0.smithi042.stdout:removed './260/20' 2023-07-29T02:03:30.340 INFO:tasks.workunit.client.0.smithi042.stdout:removed './260/39' 2023-07-29T02:03:30.340 INFO:tasks.workunit.client.0.smithi042.stdout:removed './260/34' 2023-07-29T02:03:30.340 INFO:tasks.workunit.client.0.smithi042.stdout:removed './260/38' 2023-07-29T02:03:30.340 INFO:tasks.workunit.client.0.smithi042.stdout:removed './260/28' 2023-07-29T02:03:30.340 INFO:tasks.workunit.client.0.smithi042.stdout:removed './260/24' 2023-07-29T02:03:30.341 INFO:tasks.workunit.client.0.smithi042.stdout:removed './260/29' 2023-07-29T02:03:30.341 INFO:tasks.workunit.client.0.smithi042.stdout:removed './260/32' 2023-07-29T02:03:30.341 INFO:tasks.workunit.client.0.smithi042.stdout:removed './260/22' 2023-07-29T02:03:30.341 INFO:tasks.workunit.client.0.smithi042.stdout:removed './260/25' 2023-07-29T02:03:30.341 INFO:tasks.workunit.client.0.smithi042.stdout:removed './260/30' 2023-07-29T02:03:30.341 INFO:tasks.workunit.client.0.smithi042.stdout:removed './260/33' 2023-07-29T02:03:30.341 INFO:tasks.workunit.client.0.smithi042.stdout:removed './260/23' 2023-07-29T02:03:30.342 INFO:tasks.workunit.client.0.smithi042.stdout:removed './260/35' 2023-07-29T02:03:30.342 INFO:tasks.workunit.client.0.smithi042.stdout:removed './260/26' 2023-07-29T02:03:30.342 INFO:tasks.workunit.client.0.smithi042.stdout:removed './260/37' 2023-07-29T02:03:30.342 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './260' 2023-07-29T02:03:30.342 INFO:tasks.workunit.client.0.smithi042.stdout:removed './261/21' 2023-07-29T02:03:30.342 INFO:tasks.workunit.client.0.smithi042.stdout:removed './261/27' 2023-07-29T02:03:30.343 INFO:tasks.workunit.client.0.smithi042.stdout:removed './261/31' 2023-07-29T02:03:30.343 INFO:tasks.workunit.client.0.smithi042.stdout:removed './261/36' 2023-07-29T02:03:30.343 INFO:tasks.workunit.client.0.smithi042.stdout:removed './261/20' 2023-07-29T02:03:30.343 INFO:tasks.workunit.client.0.smithi042.stdout:removed './261/39' 2023-07-29T02:03:30.343 INFO:tasks.workunit.client.0.smithi042.stdout:removed './261/34' 2023-07-29T02:03:30.343 INFO:tasks.workunit.client.0.smithi042.stdout:removed './261/38' 2023-07-29T02:03:30.344 INFO:tasks.workunit.client.0.smithi042.stdout:removed './261/28' 2023-07-29T02:03:30.344 INFO:tasks.workunit.client.0.smithi042.stdout:removed './261/24' 2023-07-29T02:03:30.344 INFO:tasks.workunit.client.0.smithi042.stdout:removed './261/29' 2023-07-29T02:03:30.344 INFO:tasks.workunit.client.0.smithi042.stdout:removed './261/32' 2023-07-29T02:03:30.344 INFO:tasks.workunit.client.0.smithi042.stdout:removed './261/22' 2023-07-29T02:03:30.344 INFO:tasks.workunit.client.0.smithi042.stdout:removed './261/25' 2023-07-29T02:03:30.344 INFO:tasks.workunit.client.0.smithi042.stdout:removed './261/30' 2023-07-29T02:03:30.345 INFO:tasks.workunit.client.0.smithi042.stdout:removed './261/33' 2023-07-29T02:03:30.345 INFO:tasks.workunit.client.0.smithi042.stdout:removed './261/23' 2023-07-29T02:03:30.345 INFO:tasks.workunit.client.0.smithi042.stdout:removed './261/35' 2023-07-29T02:03:30.345 INFO:tasks.workunit.client.0.smithi042.stdout:removed './261/26' 2023-07-29T02:03:30.345 INFO:tasks.workunit.client.0.smithi042.stdout:removed './261/37' 2023-07-29T02:03:30.346 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './261' 2023-07-29T02:03:30.346 INFO:tasks.workunit.client.0.smithi042.stdout:removed './262/21' 2023-07-29T02:03:30.346 INFO:tasks.workunit.client.0.smithi042.stdout:removed './262/27' 2023-07-29T02:03:30.346 INFO:tasks.workunit.client.0.smithi042.stdout:removed './262/31' 2023-07-29T02:03:30.346 INFO:tasks.workunit.client.0.smithi042.stdout:removed './262/36' 2023-07-29T02:03:30.346 INFO:tasks.workunit.client.0.smithi042.stdout:removed './262/20' 2023-07-29T02:03:30.346 INFO:tasks.workunit.client.0.smithi042.stdout:removed './262/39' 2023-07-29T02:03:30.346 INFO:tasks.workunit.client.0.smithi042.stdout:removed './262/34' 2023-07-29T02:03:30.347 INFO:tasks.workunit.client.0.smithi042.stdout:removed './262/38' 2023-07-29T02:03:30.347 INFO:tasks.workunit.client.0.smithi042.stdout:removed './262/28' 2023-07-29T02:03:30.347 INFO:tasks.workunit.client.0.smithi042.stdout:removed './262/24' 2023-07-29T02:03:30.347 INFO:tasks.workunit.client.0.smithi042.stdout:removed './262/29' 2023-07-29T02:03:30.347 INFO:tasks.workunit.client.0.smithi042.stdout:removed './262/32' 2023-07-29T02:03:30.347 INFO:tasks.workunit.client.0.smithi042.stdout:removed './262/22' 2023-07-29T02:03:30.347 INFO:tasks.workunit.client.0.smithi042.stdout:removed './262/25' 2023-07-29T02:03:30.347 INFO:tasks.workunit.client.0.smithi042.stdout:removed './262/30' 2023-07-29T02:03:30.348 INFO:tasks.workunit.client.0.smithi042.stdout:removed './262/33' 2023-07-29T02:03:30.348 INFO:tasks.workunit.client.0.smithi042.stdout:removed './262/23' 2023-07-29T02:03:30.348 INFO:tasks.workunit.client.0.smithi042.stdout:removed './262/35' 2023-07-29T02:03:30.348 INFO:tasks.workunit.client.0.smithi042.stdout:removed './262/26' 2023-07-29T02:03:30.348 INFO:tasks.workunit.client.0.smithi042.stdout:removed './262/37' 2023-07-29T02:03:30.348 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './262' 2023-07-29T02:03:30.348 INFO:tasks.workunit.client.0.smithi042.stdout:removed './263/21' 2023-07-29T02:03:30.349 INFO:tasks.workunit.client.0.smithi042.stdout:removed './263/27' 2023-07-29T02:03:30.349 INFO:tasks.workunit.client.0.smithi042.stdout:removed './263/31' 2023-07-29T02:03:30.349 INFO:tasks.workunit.client.0.smithi042.stdout:removed './263/36' 2023-07-29T02:03:30.349 INFO:tasks.workunit.client.0.smithi042.stdout:removed './263/20' 2023-07-29T02:03:30.349 INFO:tasks.workunit.client.0.smithi042.stdout:removed './263/39' 2023-07-29T02:03:30.349 INFO:tasks.workunit.client.0.smithi042.stdout:removed './263/34' 2023-07-29T02:03:30.349 INFO:tasks.workunit.client.0.smithi042.stdout:removed './263/38' 2023-07-29T02:03:30.349 INFO:tasks.workunit.client.0.smithi042.stdout:removed './263/28' 2023-07-29T02:03:30.350 INFO:tasks.workunit.client.0.smithi042.stdout:removed './263/24' 2023-07-29T02:03:30.350 INFO:tasks.workunit.client.0.smithi042.stdout:removed './263/29' 2023-07-29T02:03:30.350 INFO:tasks.workunit.client.0.smithi042.stdout:removed './263/32' 2023-07-29T02:03:30.350 INFO:tasks.workunit.client.0.smithi042.stdout:removed './263/22' 2023-07-29T02:03:30.350 INFO:tasks.workunit.client.0.smithi042.stdout:removed './263/25' 2023-07-29T02:03:30.350 INFO:tasks.workunit.client.0.smithi042.stdout:removed './263/30' 2023-07-29T02:03:30.350 INFO:tasks.workunit.client.0.smithi042.stdout:removed './263/33' 2023-07-29T02:03:30.351 INFO:tasks.workunit.client.0.smithi042.stdout:removed './263/23' 2023-07-29T02:03:30.351 INFO:tasks.workunit.client.0.smithi042.stdout:removed './263/35' 2023-07-29T02:03:30.351 INFO:tasks.workunit.client.0.smithi042.stdout:removed './263/26' 2023-07-29T02:03:30.351 INFO:tasks.workunit.client.0.smithi042.stdout:removed './263/37' 2023-07-29T02:03:30.351 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './263' 2023-07-29T02:03:30.351 INFO:tasks.workunit.client.0.smithi042.stdout:removed './264/21' 2023-07-29T02:03:30.351 INFO:tasks.workunit.client.0.smithi042.stdout:removed './264/27' 2023-07-29T02:03:30.352 INFO:tasks.workunit.client.0.smithi042.stdout:removed './264/31' 2023-07-29T02:03:30.352 INFO:tasks.workunit.client.0.smithi042.stdout:removed './264/36' 2023-07-29T02:03:30.352 INFO:tasks.workunit.client.0.smithi042.stdout:removed './264/20' 2023-07-29T02:03:30.352 INFO:tasks.workunit.client.0.smithi042.stdout:removed './264/39' 2023-07-29T02:03:30.352 INFO:tasks.workunit.client.0.smithi042.stdout:removed './264/34' 2023-07-29T02:03:30.352 INFO:tasks.workunit.client.0.smithi042.stdout:removed './264/38' 2023-07-29T02:03:30.352 INFO:tasks.workunit.client.0.smithi042.stdout:removed './264/28' 2023-07-29T02:03:30.353 INFO:tasks.workunit.client.0.smithi042.stdout:removed './264/24' 2023-07-29T02:03:30.353 INFO:tasks.workunit.client.0.smithi042.stdout:removed './264/29' 2023-07-29T02:03:30.353 INFO:tasks.workunit.client.0.smithi042.stdout:removed './264/32' 2023-07-29T02:03:30.353 INFO:tasks.workunit.client.0.smithi042.stdout:removed './264/22' 2023-07-29T02:03:30.353 INFO:tasks.workunit.client.0.smithi042.stdout:removed './264/25' 2023-07-29T02:03:30.353 INFO:tasks.workunit.client.0.smithi042.stdout:removed './264/30' 2023-07-29T02:03:30.354 INFO:tasks.workunit.client.0.smithi042.stdout:removed './264/33' 2023-07-29T02:03:30.354 INFO:tasks.workunit.client.0.smithi042.stdout:removed './264/23' 2023-07-29T02:03:30.354 INFO:tasks.workunit.client.0.smithi042.stdout:removed './264/35' 2023-07-29T02:03:30.354 INFO:tasks.workunit.client.0.smithi042.stdout:removed './264/26' 2023-07-29T02:03:30.354 INFO:tasks.workunit.client.0.smithi042.stdout:removed './264/37' 2023-07-29T02:03:30.354 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './264' 2023-07-29T02:03:30.354 INFO:tasks.workunit.client.0.smithi042.stdout:removed './265/21' 2023-07-29T02:03:30.355 INFO:tasks.workunit.client.0.smithi042.stdout:removed './265/27' 2023-07-29T02:03:30.355 INFO:tasks.workunit.client.0.smithi042.stdout:removed './265/31' 2023-07-29T02:03:30.355 INFO:tasks.workunit.client.0.smithi042.stdout:removed './265/36' 2023-07-29T02:03:30.355 INFO:tasks.workunit.client.0.smithi042.stdout:removed './265/20' 2023-07-29T02:03:30.355 INFO:tasks.workunit.client.0.smithi042.stdout:removed './265/39' 2023-07-29T02:03:30.355 INFO:tasks.workunit.client.0.smithi042.stdout:removed './265/34' 2023-07-29T02:03:30.355 INFO:tasks.workunit.client.0.smithi042.stdout:removed './265/38' 2023-07-29T02:03:30.355 INFO:tasks.workunit.client.0.smithi042.stdout:removed './265/28' 2023-07-29T02:03:30.356 INFO:tasks.workunit.client.0.smithi042.stdout:removed './265/24' 2023-07-29T02:03:30.356 INFO:tasks.workunit.client.0.smithi042.stdout:removed './265/29' 2023-07-29T02:03:30.356 INFO:tasks.workunit.client.0.smithi042.stdout:removed './265/32' 2023-07-29T02:03:30.356 INFO:tasks.workunit.client.0.smithi042.stdout:removed './265/22' 2023-07-29T02:03:30.356 INFO:tasks.workunit.client.0.smithi042.stdout:removed './265/25' 2023-07-29T02:03:30.356 INFO:tasks.workunit.client.0.smithi042.stdout:removed './265/30' 2023-07-29T02:03:30.356 INFO:tasks.workunit.client.0.smithi042.stdout:removed './265/33' 2023-07-29T02:03:30.357 INFO:tasks.workunit.client.0.smithi042.stdout:removed './265/23' 2023-07-29T02:03:30.357 INFO:tasks.workunit.client.0.smithi042.stdout:removed './265/35' 2023-07-29T02:03:30.357 INFO:tasks.workunit.client.0.smithi042.stdout:removed './265/26' 2023-07-29T02:03:30.357 INFO:tasks.workunit.client.0.smithi042.stdout:removed './265/37' 2023-07-29T02:03:30.357 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './265' 2023-07-29T02:03:30.357 INFO:tasks.workunit.client.0.smithi042.stdout:removed './266/21' 2023-07-29T02:03:30.357 INFO:tasks.workunit.client.0.smithi042.stdout:removed './266/27' 2023-07-29T02:03:30.357 INFO:tasks.workunit.client.0.smithi042.stdout:removed './266/31' 2023-07-29T02:03:30.358 INFO:tasks.workunit.client.0.smithi042.stdout:removed './266/36' 2023-07-29T02:03:30.358 INFO:tasks.workunit.client.0.smithi042.stdout:removed './266/20' 2023-07-29T02:03:30.358 INFO:tasks.workunit.client.0.smithi042.stdout:removed './266/39' 2023-07-29T02:03:30.358 INFO:tasks.workunit.client.0.smithi042.stdout:removed './266/34' 2023-07-29T02:03:30.358 INFO:tasks.workunit.client.0.smithi042.stdout:removed './266/38' 2023-07-29T02:03:30.358 INFO:tasks.workunit.client.0.smithi042.stdout:removed './266/28' 2023-07-29T02:03:30.358 INFO:tasks.workunit.client.0.smithi042.stdout:removed './266/24' 2023-07-29T02:03:30.359 INFO:tasks.workunit.client.0.smithi042.stdout:removed './266/29' 2023-07-29T02:03:30.359 INFO:tasks.workunit.client.0.smithi042.stdout:removed './266/32' 2023-07-29T02:03:30.359 INFO:tasks.workunit.client.0.smithi042.stdout:removed './266/22' 2023-07-29T02:03:30.359 INFO:tasks.workunit.client.0.smithi042.stdout:removed './266/25' 2023-07-29T02:03:30.359 INFO:tasks.workunit.client.0.smithi042.stdout:removed './266/30' 2023-07-29T02:03:30.360 INFO:tasks.workunit.client.0.smithi042.stdout:removed './266/33' 2023-07-29T02:03:30.360 INFO:tasks.workunit.client.0.smithi042.stdout:removed './266/23' 2023-07-29T02:03:30.890 INFO:tasks.workunit.client.0.smithi042.stdout:removed './266/35' 2023-07-29T02:03:30.891 INFO:tasks.workunit.client.0.smithi042.stdout:removed './266/26' 2023-07-29T02:03:30.891 INFO:tasks.workunit.client.0.smithi042.stdout:removed './266/37' 2023-07-29T02:03:30.891 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './266' 2023-07-29T02:03:30.891 INFO:tasks.workunit.client.0.smithi042.stdout:removed './267/21' 2023-07-29T02:03:30.891 INFO:tasks.workunit.client.0.smithi042.stdout:removed './267/27' 2023-07-29T02:03:30.892 INFO:tasks.workunit.client.0.smithi042.stdout:removed './267/31' 2023-07-29T02:03:30.892 INFO:tasks.workunit.client.0.smithi042.stdout:removed './267/36' 2023-07-29T02:03:30.892 INFO:tasks.workunit.client.0.smithi042.stdout:removed './267/20' 2023-07-29T02:03:30.892 INFO:tasks.workunit.client.0.smithi042.stdout:removed './267/39' 2023-07-29T02:03:30.892 INFO:tasks.workunit.client.0.smithi042.stdout:removed './267/34' 2023-07-29T02:03:30.892 INFO:tasks.workunit.client.0.smithi042.stdout:removed './267/38' 2023-07-29T02:03:30.892 INFO:tasks.workunit.client.0.smithi042.stdout:removed './267/28' 2023-07-29T02:03:30.893 INFO:tasks.workunit.client.0.smithi042.stdout:removed './267/24' 2023-07-29T02:03:30.893 INFO:tasks.workunit.client.0.smithi042.stdout:removed './267/29' 2023-07-29T02:03:30.893 INFO:tasks.workunit.client.0.smithi042.stdout:removed './267/32' 2023-07-29T02:03:30.893 INFO:tasks.workunit.client.0.smithi042.stdout:removed './267/22' 2023-07-29T02:03:30.893 INFO:tasks.workunit.client.0.smithi042.stdout:removed './267/25' 2023-07-29T02:03:30.893 INFO:tasks.workunit.client.0.smithi042.stdout:removed './267/30' 2023-07-29T02:03:30.893 INFO:tasks.workunit.client.0.smithi042.stdout:removed './267/33' 2023-07-29T02:03:30.893 INFO:tasks.workunit.client.0.smithi042.stdout:removed './267/23' 2023-07-29T02:03:30.894 INFO:tasks.workunit.client.0.smithi042.stdout:removed './267/35' 2023-07-29T02:03:30.894 INFO:tasks.workunit.client.0.smithi042.stdout:removed './267/26' 2023-07-29T02:03:30.894 INFO:tasks.workunit.client.0.smithi042.stdout:removed './267/37' 2023-07-29T02:03:30.894 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './267' 2023-07-29T02:03:30.894 INFO:tasks.workunit.client.0.smithi042.stdout:removed './268/21' 2023-07-29T02:03:30.894 INFO:tasks.workunit.client.0.smithi042.stdout:removed './268/27' 2023-07-29T02:03:30.894 INFO:tasks.workunit.client.0.smithi042.stdout:removed './268/31' 2023-07-29T02:03:30.894 INFO:tasks.workunit.client.0.smithi042.stdout:removed './268/36' 2023-07-29T02:03:30.895 INFO:tasks.workunit.client.0.smithi042.stdout:removed './268/20' 2023-07-29T02:03:30.895 INFO:tasks.workunit.client.0.smithi042.stdout:removed './268/39' 2023-07-29T02:03:30.895 INFO:tasks.workunit.client.0.smithi042.stdout:removed './268/34' 2023-07-29T02:03:30.895 INFO:tasks.workunit.client.0.smithi042.stdout:removed './268/38' 2023-07-29T02:03:30.895 INFO:tasks.workunit.client.0.smithi042.stdout:removed './268/28' 2023-07-29T02:03:30.895 INFO:tasks.workunit.client.0.smithi042.stdout:removed './268/24' 2023-07-29T02:03:30.895 INFO:tasks.workunit.client.0.smithi042.stdout:removed './268/29' 2023-07-29T02:03:30.895 INFO:tasks.workunit.client.0.smithi042.stdout:removed './268/32' 2023-07-29T02:03:30.896 INFO:tasks.workunit.client.0.smithi042.stdout:removed './268/22' 2023-07-29T02:03:30.896 INFO:tasks.workunit.client.0.smithi042.stdout:removed './268/25' 2023-07-29T02:03:30.896 INFO:tasks.workunit.client.0.smithi042.stdout:removed './268/30' 2023-07-29T02:03:30.896 INFO:tasks.workunit.client.0.smithi042.stdout:removed './268/33' 2023-07-29T02:03:30.896 INFO:tasks.workunit.client.0.smithi042.stdout:removed './268/23' 2023-07-29T02:03:30.896 INFO:tasks.workunit.client.0.smithi042.stdout:removed './268/35' 2023-07-29T02:03:30.896 INFO:tasks.workunit.client.0.smithi042.stdout:removed './268/26' 2023-07-29T02:03:30.897 INFO:tasks.workunit.client.0.smithi042.stdout:removed './268/37' 2023-07-29T02:03:30.897 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './268' 2023-07-29T02:03:30.897 INFO:tasks.workunit.client.0.smithi042.stdout:removed './269/21' 2023-07-29T02:03:30.897 INFO:tasks.workunit.client.0.smithi042.stdout:removed './269/27' 2023-07-29T02:03:30.897 INFO:tasks.workunit.client.0.smithi042.stdout:removed './269/31' 2023-07-29T02:03:30.897 INFO:tasks.workunit.client.0.smithi042.stdout:removed './269/36' 2023-07-29T02:03:30.897 INFO:tasks.workunit.client.0.smithi042.stdout:removed './269/20' 2023-07-29T02:03:30.897 INFO:tasks.workunit.client.0.smithi042.stdout:removed './269/39' 2023-07-29T02:03:30.898 INFO:tasks.workunit.client.0.smithi042.stdout:removed './269/34' 2023-07-29T02:03:30.898 INFO:tasks.workunit.client.0.smithi042.stdout:removed './269/38' 2023-07-29T02:03:30.898 INFO:tasks.workunit.client.0.smithi042.stdout:removed './269/28' 2023-07-29T02:03:30.898 INFO:tasks.workunit.client.0.smithi042.stdout:removed './269/24' 2023-07-29T02:03:30.898 INFO:tasks.workunit.client.0.smithi042.stdout:removed './269/29' 2023-07-29T02:03:30.898 INFO:tasks.workunit.client.0.smithi042.stdout:removed './269/32' 2023-07-29T02:03:30.898 INFO:tasks.workunit.client.0.smithi042.stdout:removed './269/22' 2023-07-29T02:03:30.898 INFO:tasks.workunit.client.0.smithi042.stdout:removed './269/25' 2023-07-29T02:03:30.899 INFO:tasks.workunit.client.0.smithi042.stdout:removed './269/30' 2023-07-29T02:03:30.899 INFO:tasks.workunit.client.0.smithi042.stdout:removed './269/33' 2023-07-29T02:03:30.899 INFO:tasks.workunit.client.0.smithi042.stdout:removed './269/23' 2023-07-29T02:03:30.899 INFO:tasks.workunit.client.0.smithi042.stdout:removed './269/35' 2023-07-29T02:03:30.899 INFO:tasks.workunit.client.0.smithi042.stdout:removed './269/26' 2023-07-29T02:03:30.899 INFO:tasks.workunit.client.0.smithi042.stdout:removed './269/37' 2023-07-29T02:03:30.899 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './269' 2023-07-29T02:03:30.899 INFO:tasks.workunit.client.0.smithi042.stdout:removed './270/21' 2023-07-29T02:03:30.900 INFO:tasks.workunit.client.0.smithi042.stdout:removed './270/27' 2023-07-29T02:03:30.900 INFO:tasks.workunit.client.0.smithi042.stdout:removed './270/31' 2023-07-29T02:03:30.900 INFO:tasks.workunit.client.0.smithi042.stdout:removed './270/36' 2023-07-29T02:03:30.900 INFO:tasks.workunit.client.0.smithi042.stdout:removed './270/20' 2023-07-29T02:03:30.900 INFO:tasks.workunit.client.0.smithi042.stdout:removed './270/39' 2023-07-29T02:03:30.900 INFO:tasks.workunit.client.0.smithi042.stdout:removed './270/34' 2023-07-29T02:03:30.900 INFO:tasks.workunit.client.0.smithi042.stdout:removed './270/38' 2023-07-29T02:03:30.900 INFO:tasks.workunit.client.0.smithi042.stdout:removed './270/28' 2023-07-29T02:03:30.901 INFO:tasks.workunit.client.0.smithi042.stdout:removed './270/24' 2023-07-29T02:03:30.901 INFO:tasks.workunit.client.0.smithi042.stdout:removed './270/29' 2023-07-29T02:03:30.901 INFO:tasks.workunit.client.0.smithi042.stdout:removed './270/32' 2023-07-29T02:03:30.901 INFO:tasks.workunit.client.0.smithi042.stdout:removed './270/22' 2023-07-29T02:03:30.901 INFO:tasks.workunit.client.0.smithi042.stdout:removed './270/25' 2023-07-29T02:03:30.901 INFO:tasks.workunit.client.0.smithi042.stdout:removed './270/30' 2023-07-29T02:03:30.901 INFO:tasks.workunit.client.0.smithi042.stdout:removed './270/33' 2023-07-29T02:03:30.901 INFO:tasks.workunit.client.0.smithi042.stdout:removed './270/23' 2023-07-29T02:03:30.902 INFO:tasks.workunit.client.0.smithi042.stdout:removed './270/35' 2023-07-29T02:03:30.902 INFO:tasks.workunit.client.0.smithi042.stdout:removed './270/26' 2023-07-29T02:03:30.902 INFO:tasks.workunit.client.0.smithi042.stdout:removed './270/37' 2023-07-29T02:03:30.902 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './270' 2023-07-29T02:03:30.902 INFO:tasks.workunit.client.0.smithi042.stdout:removed './271/21' 2023-07-29T02:03:30.902 INFO:tasks.workunit.client.0.smithi042.stdout:removed './271/27' 2023-07-29T02:03:30.902 INFO:tasks.workunit.client.0.smithi042.stdout:removed './271/31' 2023-07-29T02:03:30.902 INFO:tasks.workunit.client.0.smithi042.stdout:removed './271/36' 2023-07-29T02:03:30.903 INFO:tasks.workunit.client.0.smithi042.stdout:removed './271/20' 2023-07-29T02:03:30.903 INFO:tasks.workunit.client.0.smithi042.stdout:removed './271/39' 2023-07-29T02:03:30.903 INFO:tasks.workunit.client.0.smithi042.stdout:removed './271/34' 2023-07-29T02:03:30.903 INFO:tasks.workunit.client.0.smithi042.stdout:removed './271/38' 2023-07-29T02:03:30.903 INFO:tasks.workunit.client.0.smithi042.stdout:removed './271/28' 2023-07-29T02:03:30.903 INFO:tasks.workunit.client.0.smithi042.stdout:removed './271/24' 2023-07-29T02:03:30.903 INFO:tasks.workunit.client.0.smithi042.stdout:removed './271/29' 2023-07-29T02:03:30.903 INFO:tasks.workunit.client.0.smithi042.stdout:removed './271/32' 2023-07-29T02:03:30.904 INFO:tasks.workunit.client.0.smithi042.stdout:removed './271/22' 2023-07-29T02:03:30.904 INFO:tasks.workunit.client.0.smithi042.stdout:removed './271/25' 2023-07-29T02:03:30.904 INFO:tasks.workunit.client.0.smithi042.stdout:removed './271/30' 2023-07-29T02:03:30.904 INFO:tasks.workunit.client.0.smithi042.stdout:removed './271/33' 2023-07-29T02:03:30.904 INFO:tasks.workunit.client.0.smithi042.stdout:removed './271/23' 2023-07-29T02:03:30.904 INFO:tasks.workunit.client.0.smithi042.stdout:removed './271/35' 2023-07-29T02:03:30.904 INFO:tasks.workunit.client.0.smithi042.stdout:removed './271/26' 2023-07-29T02:03:30.905 INFO:tasks.workunit.client.0.smithi042.stdout:removed './271/37' 2023-07-29T02:03:30.905 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './271' 2023-07-29T02:03:30.905 INFO:tasks.workunit.client.0.smithi042.stdout:removed './272/21' 2023-07-29T02:03:30.905 INFO:tasks.workunit.client.0.smithi042.stdout:removed './272/27' 2023-07-29T02:03:30.905 INFO:tasks.workunit.client.0.smithi042.stdout:removed './272/31' 2023-07-29T02:03:30.905 INFO:tasks.workunit.client.0.smithi042.stdout:removed './272/36' 2023-07-29T02:03:30.905 INFO:tasks.workunit.client.0.smithi042.stdout:removed './272/20' 2023-07-29T02:03:30.906 INFO:tasks.workunit.client.0.smithi042.stdout:removed './272/39' 2023-07-29T02:03:30.906 INFO:tasks.workunit.client.0.smithi042.stdout:removed './272/34' 2023-07-29T02:03:30.906 INFO:tasks.workunit.client.0.smithi042.stdout:removed './272/38' 2023-07-29T02:03:30.906 INFO:tasks.workunit.client.0.smithi042.stdout:removed './272/28' 2023-07-29T02:03:30.906 INFO:tasks.workunit.client.0.smithi042.stdout:removed './272/24' 2023-07-29T02:03:30.906 INFO:tasks.workunit.client.0.smithi042.stdout:removed './272/29' 2023-07-29T02:03:30.906 INFO:tasks.workunit.client.0.smithi042.stdout:removed './272/32' 2023-07-29T02:03:30.906 INFO:tasks.workunit.client.0.smithi042.stdout:removed './272/22' 2023-07-29T02:03:30.907 INFO:tasks.workunit.client.0.smithi042.stdout:removed './272/25' 2023-07-29T02:03:30.907 INFO:tasks.workunit.client.0.smithi042.stdout:removed './272/30' 2023-07-29T02:03:30.907 INFO:tasks.workunit.client.0.smithi042.stdout:removed './272/33' 2023-07-29T02:03:30.907 INFO:tasks.workunit.client.0.smithi042.stdout:removed './272/23' 2023-07-29T02:03:30.907 INFO:tasks.workunit.client.0.smithi042.stdout:removed './272/35' 2023-07-29T02:03:30.907 INFO:tasks.workunit.client.0.smithi042.stdout:removed './272/26' 2023-07-29T02:03:30.907 INFO:tasks.workunit.client.0.smithi042.stdout:removed './272/37' 2023-07-29T02:03:30.907 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './272' 2023-07-29T02:03:30.908 INFO:tasks.workunit.client.0.smithi042.stdout:removed './273/21' 2023-07-29T02:03:30.908 INFO:tasks.workunit.client.0.smithi042.stdout:removed './273/27' 2023-07-29T02:03:30.908 INFO:tasks.workunit.client.0.smithi042.stdout:removed './273/31' 2023-07-29T02:03:30.908 INFO:tasks.workunit.client.0.smithi042.stdout:removed './273/36' 2023-07-29T02:03:30.908 INFO:tasks.workunit.client.0.smithi042.stdout:removed './273/20' 2023-07-29T02:03:30.908 INFO:tasks.workunit.client.0.smithi042.stdout:removed './273/39' 2023-07-29T02:03:30.908 INFO:tasks.workunit.client.0.smithi042.stdout:removed './273/34' 2023-07-29T02:03:30.909 INFO:tasks.workunit.client.0.smithi042.stdout:removed './273/38' 2023-07-29T02:03:30.909 INFO:tasks.workunit.client.0.smithi042.stdout:removed './273/28' 2023-07-29T02:03:30.909 INFO:tasks.workunit.client.0.smithi042.stdout:removed './273/24' 2023-07-29T02:03:30.909 INFO:tasks.workunit.client.0.smithi042.stdout:removed './273/29' 2023-07-29T02:03:30.909 INFO:tasks.workunit.client.0.smithi042.stdout:removed './273/32' 2023-07-29T02:03:30.909 INFO:tasks.workunit.client.0.smithi042.stdout:removed './273/22' 2023-07-29T02:03:30.909 INFO:tasks.workunit.client.0.smithi042.stdout:removed './273/25' 2023-07-29T02:03:30.909 INFO:tasks.workunit.client.0.smithi042.stdout:removed './273/30' 2023-07-29T02:03:30.910 INFO:tasks.workunit.client.0.smithi042.stdout:removed './273/33' 2023-07-29T02:03:30.910 INFO:tasks.workunit.client.0.smithi042.stdout:removed './273/23' 2023-07-29T02:03:30.910 INFO:tasks.workunit.client.0.smithi042.stdout:removed './273/35' 2023-07-29T02:03:30.910 INFO:tasks.workunit.client.0.smithi042.stdout:removed './273/26' 2023-07-29T02:03:30.910 INFO:tasks.workunit.client.0.smithi042.stdout:removed './273/37' 2023-07-29T02:03:30.910 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './273' 2023-07-29T02:03:30.910 INFO:tasks.workunit.client.0.smithi042.stdout:removed './274/21' 2023-07-29T02:03:30.910 INFO:tasks.workunit.client.0.smithi042.stdout:removed './274/27' 2023-07-29T02:03:30.911 INFO:tasks.workunit.client.0.smithi042.stdout:removed './274/31' 2023-07-29T02:03:30.911 INFO:tasks.workunit.client.0.smithi042.stdout:removed './274/36' 2023-07-29T02:03:30.911 INFO:tasks.workunit.client.0.smithi042.stdout:removed './274/20' 2023-07-29T02:03:30.911 INFO:tasks.workunit.client.0.smithi042.stdout:removed './274/39' 2023-07-29T02:03:30.911 INFO:tasks.workunit.client.0.smithi042.stdout:removed './274/34' 2023-07-29T02:03:30.911 INFO:tasks.workunit.client.0.smithi042.stdout:removed './274/38' 2023-07-29T02:03:30.911 INFO:tasks.workunit.client.0.smithi042.stdout:removed './274/28' 2023-07-29T02:03:30.911 INFO:tasks.workunit.client.0.smithi042.stdout:removed './274/24' 2023-07-29T02:03:30.912 INFO:tasks.workunit.client.0.smithi042.stdout:removed './274/29' 2023-07-29T02:03:30.912 INFO:tasks.workunit.client.0.smithi042.stdout:removed './274/32' 2023-07-29T02:03:30.912 INFO:tasks.workunit.client.0.smithi042.stdout:removed './274/22' 2023-07-29T02:03:30.912 INFO:tasks.workunit.client.0.smithi042.stdout:removed './274/25' 2023-07-29T02:03:30.912 INFO:tasks.workunit.client.0.smithi042.stdout:removed './274/30' 2023-07-29T02:03:30.912 INFO:tasks.workunit.client.0.smithi042.stdout:removed './274/33' 2023-07-29T02:03:30.912 INFO:tasks.workunit.client.0.smithi042.stdout:removed './274/23' 2023-07-29T02:03:30.912 INFO:tasks.workunit.client.0.smithi042.stdout:removed './274/35' 2023-07-29T02:03:30.913 INFO:tasks.workunit.client.0.smithi042.stdout:removed './274/26' 2023-07-29T02:03:30.913 INFO:tasks.workunit.client.0.smithi042.stdout:removed './274/37' 2023-07-29T02:03:30.913 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './274' 2023-07-29T02:03:30.913 INFO:tasks.workunit.client.0.smithi042.stdout:removed './275/21' 2023-07-29T02:03:30.913 INFO:tasks.workunit.client.0.smithi042.stdout:removed './275/27' 2023-07-29T02:03:30.913 INFO:tasks.workunit.client.0.smithi042.stdout:removed './275/31' 2023-07-29T02:03:30.913 INFO:tasks.workunit.client.0.smithi042.stdout:removed './275/36' 2023-07-29T02:03:30.913 INFO:tasks.workunit.client.0.smithi042.stdout:removed './275/20' 2023-07-29T02:03:30.914 INFO:tasks.workunit.client.0.smithi042.stdout:removed './275/39' 2023-07-29T02:03:30.914 INFO:tasks.workunit.client.0.smithi042.stdout:removed './275/34' 2023-07-29T02:03:30.914 INFO:tasks.workunit.client.0.smithi042.stdout:removed './275/38' 2023-07-29T02:03:30.914 INFO:tasks.workunit.client.0.smithi042.stdout:removed './275/28' 2023-07-29T02:03:30.914 INFO:tasks.workunit.client.0.smithi042.stdout:removed './275/24' 2023-07-29T02:03:30.914 INFO:tasks.workunit.client.0.smithi042.stdout:removed './275/29' 2023-07-29T02:03:30.914 INFO:tasks.workunit.client.0.smithi042.stdout:removed './275/32' 2023-07-29T02:03:30.914 INFO:tasks.workunit.client.0.smithi042.stdout:removed './275/22' 2023-07-29T02:03:30.915 INFO:tasks.workunit.client.0.smithi042.stdout:removed './275/25' 2023-07-29T02:03:30.915 INFO:tasks.workunit.client.0.smithi042.stdout:removed './275/30' 2023-07-29T02:03:30.915 INFO:tasks.workunit.client.0.smithi042.stdout:removed './275/33' 2023-07-29T02:03:30.915 INFO:tasks.workunit.client.0.smithi042.stdout:removed './275/23' 2023-07-29T02:03:30.915 INFO:tasks.workunit.client.0.smithi042.stdout:removed './275/35' 2023-07-29T02:03:30.915 INFO:tasks.workunit.client.0.smithi042.stdout:removed './275/26' 2023-07-29T02:03:30.915 INFO:tasks.workunit.client.0.smithi042.stdout:removed './275/37' 2023-07-29T02:03:30.915 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './275' 2023-07-29T02:03:30.916 INFO:tasks.workunit.client.0.smithi042.stdout:removed './276/21' 2023-07-29T02:03:30.916 INFO:tasks.workunit.client.0.smithi042.stdout:removed './276/27' 2023-07-29T02:03:30.916 INFO:tasks.workunit.client.0.smithi042.stdout:removed './276/31' 2023-07-29T02:03:30.916 INFO:tasks.workunit.client.0.smithi042.stdout:removed './276/36' 2023-07-29T02:03:30.916 INFO:tasks.workunit.client.0.smithi042.stdout:removed './276/20' 2023-07-29T02:03:30.916 INFO:tasks.workunit.client.0.smithi042.stdout:removed './276/39' 2023-07-29T02:03:30.916 INFO:tasks.workunit.client.0.smithi042.stdout:removed './276/34' 2023-07-29T02:03:30.917 INFO:tasks.workunit.client.0.smithi042.stdout:removed './276/38' 2023-07-29T02:03:30.917 INFO:tasks.workunit.client.0.smithi042.stdout:removed './276/28' 2023-07-29T02:03:30.917 INFO:tasks.workunit.client.0.smithi042.stdout:removed './276/24' 2023-07-29T02:03:30.917 INFO:tasks.workunit.client.0.smithi042.stdout:removed './276/29' 2023-07-29T02:03:30.917 INFO:tasks.workunit.client.0.smithi042.stdout:removed './276/32' 2023-07-29T02:03:30.917 INFO:tasks.workunit.client.0.smithi042.stdout:removed './276/22' 2023-07-29T02:03:30.917 INFO:tasks.workunit.client.0.smithi042.stdout:removed './276/25' 2023-07-29T02:03:30.917 INFO:tasks.workunit.client.0.smithi042.stdout:removed './276/30' 2023-07-29T02:03:30.918 INFO:tasks.workunit.client.0.smithi042.stdout:removed './276/33' 2023-07-29T02:03:30.918 INFO:tasks.workunit.client.0.smithi042.stdout:removed './276/23' 2023-07-29T02:03:30.918 INFO:tasks.workunit.client.0.smithi042.stdout:removed './276/35' 2023-07-29T02:03:30.918 INFO:tasks.workunit.client.0.smithi042.stdout:removed './276/26' 2023-07-29T02:03:31.454 INFO:tasks.workunit.client.0.smithi042.stdout:removed './276/37' 2023-07-29T02:03:31.454 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './276' 2023-07-29T02:03:31.454 INFO:tasks.workunit.client.0.smithi042.stdout:removed './277/21' 2023-07-29T02:03:31.454 INFO:tasks.workunit.client.0.smithi042.stdout:removed './277/27' 2023-07-29T02:03:31.455 INFO:tasks.workunit.client.0.smithi042.stdout:removed './277/31' 2023-07-29T02:03:31.455 INFO:tasks.workunit.client.0.smithi042.stdout:removed './277/36' 2023-07-29T02:03:31.455 INFO:tasks.workunit.client.0.smithi042.stdout:removed './277/20' 2023-07-29T02:03:31.455 INFO:tasks.workunit.client.0.smithi042.stdout:removed './277/39' 2023-07-29T02:03:31.455 INFO:tasks.workunit.client.0.smithi042.stdout:removed './277/34' 2023-07-29T02:03:31.455 INFO:tasks.workunit.client.0.smithi042.stdout:removed './277/38' 2023-07-29T02:03:31.455 INFO:tasks.workunit.client.0.smithi042.stdout:removed './277/28' 2023-07-29T02:03:31.455 INFO:tasks.workunit.client.0.smithi042.stdout:removed './277/24' 2023-07-29T02:03:31.456 INFO:tasks.workunit.client.0.smithi042.stdout:removed './277/29' 2023-07-29T02:03:31.456 INFO:tasks.workunit.client.0.smithi042.stdout:removed './277/32' 2023-07-29T02:03:31.456 INFO:tasks.workunit.client.0.smithi042.stdout:removed './277/22' 2023-07-29T02:03:31.456 INFO:tasks.workunit.client.0.smithi042.stdout:removed './277/25' 2023-07-29T02:03:31.456 INFO:tasks.workunit.client.0.smithi042.stdout:removed './277/30' 2023-07-29T02:03:31.456 INFO:tasks.workunit.client.0.smithi042.stdout:removed './277/33' 2023-07-29T02:03:31.456 INFO:tasks.workunit.client.0.smithi042.stdout:removed './277/23' 2023-07-29T02:03:31.456 INFO:tasks.workunit.client.0.smithi042.stdout:removed './277/35' 2023-07-29T02:03:31.457 INFO:tasks.workunit.client.0.smithi042.stdout:removed './277/26' 2023-07-29T02:03:31.457 INFO:tasks.workunit.client.0.smithi042.stdout:removed './277/37' 2023-07-29T02:03:31.457 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './277' 2023-07-29T02:03:31.457 INFO:tasks.workunit.client.0.smithi042.stdout:removed './278/21' 2023-07-29T02:03:31.457 INFO:tasks.workunit.client.0.smithi042.stdout:removed './278/27' 2023-07-29T02:03:31.457 INFO:tasks.workunit.client.0.smithi042.stdout:removed './278/31' 2023-07-29T02:03:31.457 INFO:tasks.workunit.client.0.smithi042.stdout:removed './278/36' 2023-07-29T02:03:31.457 INFO:tasks.workunit.client.0.smithi042.stdout:removed './278/20' 2023-07-29T02:03:31.458 INFO:tasks.workunit.client.0.smithi042.stdout:removed './278/39' 2023-07-29T02:03:31.458 INFO:tasks.workunit.client.0.smithi042.stdout:removed './278/34' 2023-07-29T02:03:31.458 INFO:tasks.workunit.client.0.smithi042.stdout:removed './278/38' 2023-07-29T02:03:31.458 INFO:tasks.workunit.client.0.smithi042.stdout:removed './278/28' 2023-07-29T02:03:31.458 INFO:tasks.workunit.client.0.smithi042.stdout:removed './278/24' 2023-07-29T02:03:31.458 INFO:tasks.workunit.client.0.smithi042.stdout:removed './278/29' 2023-07-29T02:03:31.458 INFO:tasks.workunit.client.0.smithi042.stdout:removed './278/32' 2023-07-29T02:03:31.459 INFO:tasks.workunit.client.0.smithi042.stdout:removed './278/22' 2023-07-29T02:03:31.459 INFO:tasks.workunit.client.0.smithi042.stdout:removed './278/25' 2023-07-29T02:03:31.459 INFO:tasks.workunit.client.0.smithi042.stdout:removed './278/30' 2023-07-29T02:03:31.459 INFO:tasks.workunit.client.0.smithi042.stdout:removed './278/33' 2023-07-29T02:03:31.459 INFO:tasks.workunit.client.0.smithi042.stdout:removed './278/23' 2023-07-29T02:03:31.459 INFO:tasks.workunit.client.0.smithi042.stdout:removed './278/35' 2023-07-29T02:03:31.459 INFO:tasks.workunit.client.0.smithi042.stdout:removed './278/26' 2023-07-29T02:03:31.459 INFO:tasks.workunit.client.0.smithi042.stdout:removed './278/37' 2023-07-29T02:03:31.460 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './278' 2023-07-29T02:03:31.460 INFO:tasks.workunit.client.0.smithi042.stdout:removed './279/21' 2023-07-29T02:03:31.460 INFO:tasks.workunit.client.0.smithi042.stdout:removed './279/27' 2023-07-29T02:03:31.460 INFO:tasks.workunit.client.0.smithi042.stdout:removed './279/31' 2023-07-29T02:03:31.460 INFO:tasks.workunit.client.0.smithi042.stdout:removed './279/36' 2023-07-29T02:03:31.460 INFO:tasks.workunit.client.0.smithi042.stdout:removed './279/20' 2023-07-29T02:03:31.460 INFO:tasks.workunit.client.0.smithi042.stdout:removed './279/39' 2023-07-29T02:03:31.461 INFO:tasks.workunit.client.0.smithi042.stdout:removed './279/34' 2023-07-29T02:03:31.461 INFO:tasks.workunit.client.0.smithi042.stdout:removed './279/38' 2023-07-29T02:03:31.461 INFO:tasks.workunit.client.0.smithi042.stdout:removed './279/28' 2023-07-29T02:03:31.461 INFO:tasks.workunit.client.0.smithi042.stdout:removed './279/24' 2023-07-29T02:03:31.461 INFO:tasks.workunit.client.0.smithi042.stdout:removed './279/29' 2023-07-29T02:03:31.461 INFO:tasks.workunit.client.0.smithi042.stdout:removed './279/32' 2023-07-29T02:03:31.461 INFO:tasks.workunit.client.0.smithi042.stdout:removed './279/22' 2023-07-29T02:03:31.461 INFO:tasks.workunit.client.0.smithi042.stdout:removed './279/25' 2023-07-29T02:03:31.462 INFO:tasks.workunit.client.0.smithi042.stdout:removed './279/30' 2023-07-29T02:03:31.462 INFO:tasks.workunit.client.0.smithi042.stdout:removed './279/33' 2023-07-29T02:03:31.462 INFO:tasks.workunit.client.0.smithi042.stdout:removed './279/23' 2023-07-29T02:03:31.462 INFO:tasks.workunit.client.0.smithi042.stdout:removed './279/35' 2023-07-29T02:03:31.462 INFO:tasks.workunit.client.0.smithi042.stdout:removed './279/26' 2023-07-29T02:03:31.462 INFO:tasks.workunit.client.0.smithi042.stdout:removed './279/37' 2023-07-29T02:03:31.462 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './279' 2023-07-29T02:03:31.462 INFO:tasks.workunit.client.0.smithi042.stdout:removed './280/21' 2023-07-29T02:03:31.463 INFO:tasks.workunit.client.0.smithi042.stdout:removed './280/27' 2023-07-29T02:03:31.463 INFO:tasks.workunit.client.0.smithi042.stdout:removed './280/31' 2023-07-29T02:03:31.463 INFO:tasks.workunit.client.0.smithi042.stdout:removed './280/36' 2023-07-29T02:03:31.463 INFO:tasks.workunit.client.0.smithi042.stdout:removed './280/20' 2023-07-29T02:03:31.463 INFO:tasks.workunit.client.0.smithi042.stdout:removed './280/39' 2023-07-29T02:03:31.463 INFO:tasks.workunit.client.0.smithi042.stdout:removed './280/34' 2023-07-29T02:03:31.463 INFO:tasks.workunit.client.0.smithi042.stdout:removed './280/38' 2023-07-29T02:03:31.463 INFO:tasks.workunit.client.0.smithi042.stdout:removed './280/28' 2023-07-29T02:03:31.464 INFO:tasks.workunit.client.0.smithi042.stdout:removed './280/24' 2023-07-29T02:03:31.464 INFO:tasks.workunit.client.0.smithi042.stdout:removed './280/29' 2023-07-29T02:03:31.464 INFO:tasks.workunit.client.0.smithi042.stdout:removed './280/32' 2023-07-29T02:03:31.464 INFO:tasks.workunit.client.0.smithi042.stdout:removed './280/22' 2023-07-29T02:03:31.464 INFO:tasks.workunit.client.0.smithi042.stdout:removed './280/25' 2023-07-29T02:03:31.464 INFO:tasks.workunit.client.0.smithi042.stdout:removed './280/30' 2023-07-29T02:03:31.464 INFO:tasks.workunit.client.0.smithi042.stdout:removed './280/33' 2023-07-29T02:03:31.464 INFO:tasks.workunit.client.0.smithi042.stdout:removed './280/23' 2023-07-29T02:03:31.465 INFO:tasks.workunit.client.0.smithi042.stdout:removed './280/35' 2023-07-29T02:03:31.465 INFO:tasks.workunit.client.0.smithi042.stdout:removed './280/26' 2023-07-29T02:03:31.465 INFO:tasks.workunit.client.0.smithi042.stdout:removed './280/37' 2023-07-29T02:03:31.465 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './280' 2023-07-29T02:03:31.465 INFO:tasks.workunit.client.0.smithi042.stdout:removed './281/21' 2023-07-29T02:03:31.465 INFO:tasks.workunit.client.0.smithi042.stdout:removed './281/27' 2023-07-29T02:03:31.465 INFO:tasks.workunit.client.0.smithi042.stdout:removed './281/31' 2023-07-29T02:03:31.466 INFO:tasks.workunit.client.0.smithi042.stdout:removed './281/36' 2023-07-29T02:03:31.466 INFO:tasks.workunit.client.0.smithi042.stdout:removed './281/20' 2023-07-29T02:03:31.466 INFO:tasks.workunit.client.0.smithi042.stdout:removed './281/39' 2023-07-29T02:03:31.466 INFO:tasks.workunit.client.0.smithi042.stdout:removed './281/34' 2023-07-29T02:03:31.466 INFO:tasks.workunit.client.0.smithi042.stdout:removed './281/38' 2023-07-29T02:03:31.466 INFO:tasks.workunit.client.0.smithi042.stdout:removed './281/28' 2023-07-29T02:03:31.466 INFO:tasks.workunit.client.0.smithi042.stdout:removed './281/24' 2023-07-29T02:03:31.466 INFO:tasks.workunit.client.0.smithi042.stdout:removed './281/29' 2023-07-29T02:03:31.467 INFO:tasks.workunit.client.0.smithi042.stdout:removed './281/32' 2023-07-29T02:03:31.467 INFO:tasks.workunit.client.0.smithi042.stdout:removed './281/22' 2023-07-29T02:03:31.467 INFO:tasks.workunit.client.0.smithi042.stdout:removed './281/25' 2023-07-29T02:03:31.467 INFO:tasks.workunit.client.0.smithi042.stdout:removed './281/30' 2023-07-29T02:03:31.467 INFO:tasks.workunit.client.0.smithi042.stdout:removed './281/33' 2023-07-29T02:03:31.467 INFO:tasks.workunit.client.0.smithi042.stdout:removed './281/23' 2023-07-29T02:03:31.467 INFO:tasks.workunit.client.0.smithi042.stdout:removed './281/35' 2023-07-29T02:03:31.467 INFO:tasks.workunit.client.0.smithi042.stdout:removed './281/26' 2023-07-29T02:03:31.468 INFO:tasks.workunit.client.0.smithi042.stdout:removed './281/37' 2023-07-29T02:03:31.468 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './281' 2023-07-29T02:03:31.468 INFO:tasks.workunit.client.0.smithi042.stdout:removed './282/21' 2023-07-29T02:03:31.468 INFO:tasks.workunit.client.0.smithi042.stdout:removed './282/27' 2023-07-29T02:03:31.468 INFO:tasks.workunit.client.0.smithi042.stdout:removed './282/31' 2023-07-29T02:03:31.468 INFO:tasks.workunit.client.0.smithi042.stdout:removed './282/36' 2023-07-29T02:03:31.468 INFO:tasks.workunit.client.0.smithi042.stdout:removed './282/20' 2023-07-29T02:03:31.468 INFO:tasks.workunit.client.0.smithi042.stdout:removed './282/39' 2023-07-29T02:03:31.469 INFO:tasks.workunit.client.0.smithi042.stdout:removed './282/34' 2023-07-29T02:03:31.469 INFO:tasks.workunit.client.0.smithi042.stdout:removed './282/38' 2023-07-29T02:03:31.469 INFO:tasks.workunit.client.0.smithi042.stdout:removed './282/28' 2023-07-29T02:03:31.469 INFO:tasks.workunit.client.0.smithi042.stdout:removed './282/24' 2023-07-29T02:03:31.469 INFO:tasks.workunit.client.0.smithi042.stdout:removed './282/29' 2023-07-29T02:03:31.469 INFO:tasks.workunit.client.0.smithi042.stdout:removed './282/32' 2023-07-29T02:03:31.469 INFO:tasks.workunit.client.0.smithi042.stdout:removed './282/22' 2023-07-29T02:03:31.469 INFO:tasks.workunit.client.0.smithi042.stdout:removed './282/25' 2023-07-29T02:03:31.470 INFO:tasks.workunit.client.0.smithi042.stdout:removed './282/30' 2023-07-29T02:03:31.470 INFO:tasks.workunit.client.0.smithi042.stdout:removed './282/33' 2023-07-29T02:03:31.470 INFO:tasks.workunit.client.0.smithi042.stdout:removed './282/23' 2023-07-29T02:03:31.470 INFO:tasks.workunit.client.0.smithi042.stdout:removed './282/35' 2023-07-29T02:03:31.470 INFO:tasks.workunit.client.0.smithi042.stdout:removed './282/26' 2023-07-29T02:03:31.470 INFO:tasks.workunit.client.0.smithi042.stdout:removed './282/37' 2023-07-29T02:03:31.470 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './282' 2023-07-29T02:03:31.470 INFO:tasks.workunit.client.0.smithi042.stdout:removed './283/21' 2023-07-29T02:03:31.471 INFO:tasks.workunit.client.0.smithi042.stdout:removed './283/27' 2023-07-29T02:03:31.471 INFO:tasks.workunit.client.0.smithi042.stdout:removed './283/31' 2023-07-29T02:03:31.471 INFO:tasks.workunit.client.0.smithi042.stdout:removed './283/36' 2023-07-29T02:03:31.471 INFO:tasks.workunit.client.0.smithi042.stdout:removed './283/20' 2023-07-29T02:03:31.471 INFO:tasks.workunit.client.0.smithi042.stdout:removed './283/39' 2023-07-29T02:03:31.471 INFO:tasks.workunit.client.0.smithi042.stdout:removed './283/34' 2023-07-29T02:03:31.471 INFO:tasks.workunit.client.0.smithi042.stdout:removed './283/38' 2023-07-29T02:03:31.471 INFO:tasks.workunit.client.0.smithi042.stdout:removed './283/28' 2023-07-29T02:03:31.472 INFO:tasks.workunit.client.0.smithi042.stdout:removed './283/24' 2023-07-29T02:03:31.472 INFO:tasks.workunit.client.0.smithi042.stdout:removed './283/29' 2023-07-29T02:03:31.472 INFO:tasks.workunit.client.0.smithi042.stdout:removed './283/32' 2023-07-29T02:03:31.472 INFO:tasks.workunit.client.0.smithi042.stdout:removed './283/22' 2023-07-29T02:03:31.472 INFO:tasks.workunit.client.0.smithi042.stdout:removed './283/25' 2023-07-29T02:03:31.472 INFO:tasks.workunit.client.0.smithi042.stdout:removed './283/30' 2023-07-29T02:03:31.472 INFO:tasks.workunit.client.0.smithi042.stdout:removed './283/33' 2023-07-29T02:03:31.473 INFO:tasks.workunit.client.0.smithi042.stdout:removed './283/23' 2023-07-29T02:03:31.473 INFO:tasks.workunit.client.0.smithi042.stdout:removed './283/35' 2023-07-29T02:03:31.473 INFO:tasks.workunit.client.0.smithi042.stdout:removed './283/26' 2023-07-29T02:03:31.473 INFO:tasks.workunit.client.0.smithi042.stdout:removed './283/37' 2023-07-29T02:03:31.473 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './283' 2023-07-29T02:03:31.473 INFO:tasks.workunit.client.0.smithi042.stdout:removed './284/21' 2023-07-29T02:03:31.473 INFO:tasks.workunit.client.0.smithi042.stdout:removed './284/27' 2023-07-29T02:03:31.473 INFO:tasks.workunit.client.0.smithi042.stdout:removed './284/31' 2023-07-29T02:03:31.474 INFO:tasks.workunit.client.0.smithi042.stdout:removed './284/36' 2023-07-29T02:03:31.474 INFO:tasks.workunit.client.0.smithi042.stdout:removed './284/20' 2023-07-29T02:03:31.474 INFO:tasks.workunit.client.0.smithi042.stdout:removed './284/39' 2023-07-29T02:03:31.474 INFO:tasks.workunit.client.0.smithi042.stdout:removed './284/34' 2023-07-29T02:03:31.474 INFO:tasks.workunit.client.0.smithi042.stdout:removed './284/38' 2023-07-29T02:03:31.474 INFO:tasks.workunit.client.0.smithi042.stdout:removed './284/28' 2023-07-29T02:03:31.474 INFO:tasks.workunit.client.0.smithi042.stdout:removed './284/24' 2023-07-29T02:03:31.474 INFO:tasks.workunit.client.0.smithi042.stdout:removed './284/29' 2023-07-29T02:03:31.475 INFO:tasks.workunit.client.0.smithi042.stdout:removed './284/32' 2023-07-29T02:03:31.475 INFO:tasks.workunit.client.0.smithi042.stdout:removed './284/22' 2023-07-29T02:03:31.475 INFO:tasks.workunit.client.0.smithi042.stdout:removed './284/25' 2023-07-29T02:03:31.475 INFO:tasks.workunit.client.0.smithi042.stdout:removed './284/30' 2023-07-29T02:03:31.475 INFO:tasks.workunit.client.0.smithi042.stdout:removed './284/33' 2023-07-29T02:03:31.475 INFO:tasks.workunit.client.0.smithi042.stdout:removed './284/23' 2023-07-29T02:03:31.475 INFO:tasks.workunit.client.0.smithi042.stdout:removed './284/35' 2023-07-29T02:03:31.475 INFO:tasks.workunit.client.0.smithi042.stdout:removed './284/26' 2023-07-29T02:03:31.476 INFO:tasks.workunit.client.0.smithi042.stdout:removed './284/37' 2023-07-29T02:03:31.476 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './284' 2023-07-29T02:03:31.476 INFO:tasks.workunit.client.0.smithi042.stdout:removed './285/21' 2023-07-29T02:03:31.476 INFO:tasks.workunit.client.0.smithi042.stdout:removed './285/27' 2023-07-29T02:03:31.476 INFO:tasks.workunit.client.0.smithi042.stdout:removed './285/31' 2023-07-29T02:03:31.476 INFO:tasks.workunit.client.0.smithi042.stdout:removed './285/36' 2023-07-29T02:03:31.476 INFO:tasks.workunit.client.0.smithi042.stdout:removed './285/20' 2023-07-29T02:03:31.477 INFO:tasks.workunit.client.0.smithi042.stdout:removed './285/39' 2023-07-29T02:03:31.477 INFO:tasks.workunit.client.0.smithi042.stdout:removed './285/34' 2023-07-29T02:03:31.477 INFO:tasks.workunit.client.0.smithi042.stdout:removed './285/38' 2023-07-29T02:03:31.477 INFO:tasks.workunit.client.0.smithi042.stdout:removed './285/28' 2023-07-29T02:03:31.477 INFO:tasks.workunit.client.0.smithi042.stdout:removed './285/24' 2023-07-29T02:03:31.477 INFO:tasks.workunit.client.0.smithi042.stdout:removed './285/29' 2023-07-29T02:03:31.477 INFO:tasks.workunit.client.0.smithi042.stdout:removed './285/32' 2023-07-29T02:03:31.477 INFO:tasks.workunit.client.0.smithi042.stdout:removed './285/22' 2023-07-29T02:03:31.478 INFO:tasks.workunit.client.0.smithi042.stdout:removed './285/25' 2023-07-29T02:03:31.478 INFO:tasks.workunit.client.0.smithi042.stdout:removed './285/30' 2023-07-29T02:03:31.478 INFO:tasks.workunit.client.0.smithi042.stdout:removed './285/33' 2023-07-29T02:03:31.478 INFO:tasks.workunit.client.0.smithi042.stdout:removed './285/23' 2023-07-29T02:03:31.478 INFO:tasks.workunit.client.0.smithi042.stdout:removed './285/35' 2023-07-29T02:03:31.478 INFO:tasks.workunit.client.0.smithi042.stdout:removed './285/26' 2023-07-29T02:03:31.478 INFO:tasks.workunit.client.0.smithi042.stdout:removed './285/37' 2023-07-29T02:03:31.478 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './285' 2023-07-29T02:03:31.479 INFO:tasks.workunit.client.0.smithi042.stdout:removed './286/21' 2023-07-29T02:03:31.479 INFO:tasks.workunit.client.0.smithi042.stdout:removed './286/27' 2023-07-29T02:03:31.479 INFO:tasks.workunit.client.0.smithi042.stdout:removed './286/31' 2023-07-29T02:03:31.479 INFO:tasks.workunit.client.0.smithi042.stdout:removed './286/36' 2023-07-29T02:03:31.479 INFO:tasks.workunit.client.0.smithi042.stdout:removed './286/20' 2023-07-29T02:03:31.479 INFO:tasks.workunit.client.0.smithi042.stdout:removed './286/39' 2023-07-29T02:03:31.479 INFO:tasks.workunit.client.0.smithi042.stdout:removed './286/34' 2023-07-29T02:03:31.479 INFO:tasks.workunit.client.0.smithi042.stdout:removed './286/38' 2023-07-29T02:03:31.480 INFO:tasks.workunit.client.0.smithi042.stdout:removed './286/28' 2023-07-29T02:03:31.480 INFO:tasks.workunit.client.0.smithi042.stdout:removed './286/24' 2023-07-29T02:03:31.480 INFO:tasks.workunit.client.0.smithi042.stdout:removed './286/29' 2023-07-29T02:03:31.480 INFO:tasks.workunit.client.0.smithi042.stdout:removed './286/32' 2023-07-29T02:03:31.480 INFO:tasks.workunit.client.0.smithi042.stdout:removed './286/22' 2023-07-29T02:03:31.480 INFO:tasks.workunit.client.0.smithi042.stdout:removed './286/25' 2023-07-29T02:03:31.480 INFO:tasks.workunit.client.0.smithi042.stdout:removed './286/30' 2023-07-29T02:03:31.481 INFO:tasks.workunit.client.0.smithi042.stdout:removed './286/33' 2023-07-29T02:03:31.481 INFO:tasks.workunit.client.0.smithi042.stdout:removed './286/23' 2023-07-29T02:03:31.481 INFO:tasks.workunit.client.0.smithi042.stdout:removed './286/35' 2023-07-29T02:03:31.481 INFO:tasks.workunit.client.0.smithi042.stdout:removed './286/26' 2023-07-29T02:03:31.481 INFO:tasks.workunit.client.0.smithi042.stdout:removed './286/37' 2023-07-29T02:03:31.481 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './286' 2023-07-29T02:03:32.025 INFO:tasks.workunit.client.0.smithi042.stdout:removed './287/21' 2023-07-29T02:03:32.025 INFO:tasks.workunit.client.0.smithi042.stdout:removed './287/27' 2023-07-29T02:03:32.026 INFO:tasks.workunit.client.0.smithi042.stdout:removed './287/31' 2023-07-29T02:03:32.026 INFO:tasks.workunit.client.0.smithi042.stdout:removed './287/36' 2023-07-29T02:03:32.026 INFO:tasks.workunit.client.0.smithi042.stdout:removed './287/20' 2023-07-29T02:03:32.026 INFO:tasks.workunit.client.0.smithi042.stdout:removed './287/39' 2023-07-29T02:03:32.026 INFO:tasks.workunit.client.0.smithi042.stdout:removed './287/34' 2023-07-29T02:03:32.026 INFO:tasks.workunit.client.0.smithi042.stdout:removed './287/38' 2023-07-29T02:03:32.026 INFO:tasks.workunit.client.0.smithi042.stdout:removed './287/28' 2023-07-29T02:03:32.027 INFO:tasks.workunit.client.0.smithi042.stdout:removed './287/24' 2023-07-29T02:03:32.027 INFO:tasks.workunit.client.0.smithi042.stdout:removed './287/29' 2023-07-29T02:03:32.027 INFO:tasks.workunit.client.0.smithi042.stdout:removed './287/32' 2023-07-29T02:03:32.027 INFO:tasks.workunit.client.0.smithi042.stdout:removed './287/22' 2023-07-29T02:03:32.027 INFO:tasks.workunit.client.0.smithi042.stdout:removed './287/25' 2023-07-29T02:03:32.027 INFO:tasks.workunit.client.0.smithi042.stdout:removed './287/30' 2023-07-29T02:03:32.027 INFO:tasks.workunit.client.0.smithi042.stdout:removed './287/33' 2023-07-29T02:03:32.027 INFO:tasks.workunit.client.0.smithi042.stdout:removed './287/23' 2023-07-29T02:03:32.028 INFO:tasks.workunit.client.0.smithi042.stdout:removed './287/35' 2023-07-29T02:03:32.028 INFO:tasks.workunit.client.0.smithi042.stdout:removed './287/26' 2023-07-29T02:03:32.028 INFO:tasks.workunit.client.0.smithi042.stdout:removed './287/37' 2023-07-29T02:03:32.028 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './287' 2023-07-29T02:03:32.028 INFO:tasks.workunit.client.0.smithi042.stdout:removed './288/21' 2023-07-29T02:03:32.028 INFO:tasks.workunit.client.0.smithi042.stdout:removed './288/27' 2023-07-29T02:03:32.028 INFO:tasks.workunit.client.0.smithi042.stdout:removed './288/31' 2023-07-29T02:03:32.029 INFO:tasks.workunit.client.0.smithi042.stdout:removed './288/36' 2023-07-29T02:03:32.029 INFO:tasks.workunit.client.0.smithi042.stdout:removed './288/20' 2023-07-29T02:03:32.029 INFO:tasks.workunit.client.0.smithi042.stdout:removed './288/39' 2023-07-29T02:03:32.029 INFO:tasks.workunit.client.0.smithi042.stdout:removed './288/34' 2023-07-29T02:03:32.029 INFO:tasks.workunit.client.0.smithi042.stdout:removed './288/38' 2023-07-29T02:03:32.029 INFO:tasks.workunit.client.0.smithi042.stdout:removed './288/28' 2023-07-29T02:03:32.029 INFO:tasks.workunit.client.0.smithi042.stdout:removed './288/24' 2023-07-29T02:03:32.029 INFO:tasks.workunit.client.0.smithi042.stdout:removed './288/29' 2023-07-29T02:03:32.030 INFO:tasks.workunit.client.0.smithi042.stdout:removed './288/32' 2023-07-29T02:03:32.030 INFO:tasks.workunit.client.0.smithi042.stdout:removed './288/22' 2023-07-29T02:03:32.030 INFO:tasks.workunit.client.0.smithi042.stdout:removed './288/25' 2023-07-29T02:03:32.030 INFO:tasks.workunit.client.0.smithi042.stdout:removed './288/30' 2023-07-29T02:03:32.030 INFO:tasks.workunit.client.0.smithi042.stdout:removed './288/33' 2023-07-29T02:03:32.030 INFO:tasks.workunit.client.0.smithi042.stdout:removed './288/23' 2023-07-29T02:03:32.030 INFO:tasks.workunit.client.0.smithi042.stdout:removed './288/35' 2023-07-29T02:03:32.030 INFO:tasks.workunit.client.0.smithi042.stdout:removed './288/26' 2023-07-29T02:03:32.031 INFO:tasks.workunit.client.0.smithi042.stdout:removed './288/37' 2023-07-29T02:03:32.031 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './288' 2023-07-29T02:03:32.031 INFO:tasks.workunit.client.0.smithi042.stdout:removed './289/21' 2023-07-29T02:03:32.031 INFO:tasks.workunit.client.0.smithi042.stdout:removed './289/27' 2023-07-29T02:03:32.031 INFO:tasks.workunit.client.0.smithi042.stdout:removed './289/31' 2023-07-29T02:03:32.031 INFO:tasks.workunit.client.0.smithi042.stdout:removed './289/36' 2023-07-29T02:03:32.031 INFO:tasks.workunit.client.0.smithi042.stdout:removed './289/20' 2023-07-29T02:03:32.032 INFO:tasks.workunit.client.0.smithi042.stdout:removed './289/39' 2023-07-29T02:03:32.032 INFO:tasks.workunit.client.0.smithi042.stdout:removed './289/34' 2023-07-29T02:03:32.032 INFO:tasks.workunit.client.0.smithi042.stdout:removed './289/38' 2023-07-29T02:03:32.032 INFO:tasks.workunit.client.0.smithi042.stdout:removed './289/28' 2023-07-29T02:03:32.032 INFO:tasks.workunit.client.0.smithi042.stdout:removed './289/24' 2023-07-29T02:03:32.032 INFO:tasks.workunit.client.0.smithi042.stdout:removed './289/29' 2023-07-29T02:03:32.033 INFO:tasks.workunit.client.0.smithi042.stdout:removed './289/32' 2023-07-29T02:03:32.033 INFO:tasks.workunit.client.0.smithi042.stdout:removed './289/22' 2023-07-29T02:03:32.033 INFO:tasks.workunit.client.0.smithi042.stdout:removed './289/25' 2023-07-29T02:03:32.033 INFO:tasks.workunit.client.0.smithi042.stdout:removed './289/30' 2023-07-29T02:03:32.033 INFO:tasks.workunit.client.0.smithi042.stdout:removed './289/33' 2023-07-29T02:03:32.033 INFO:tasks.workunit.client.0.smithi042.stdout:removed './289/23' 2023-07-29T02:03:32.033 INFO:tasks.workunit.client.0.smithi042.stdout:removed './289/35' 2023-07-29T02:03:32.034 INFO:tasks.workunit.client.0.smithi042.stdout:removed './289/26' 2023-07-29T02:03:32.034 INFO:tasks.workunit.client.0.smithi042.stdout:removed './289/37' 2023-07-29T02:03:32.034 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './289' 2023-07-29T02:03:32.034 INFO:tasks.workunit.client.0.smithi042.stdout:removed './290/21' 2023-07-29T02:03:32.034 INFO:tasks.workunit.client.0.smithi042.stdout:removed './290/27' 2023-07-29T02:03:32.034 INFO:tasks.workunit.client.0.smithi042.stdout:removed './290/31' 2023-07-29T02:03:32.034 INFO:tasks.workunit.client.0.smithi042.stdout:removed './290/36' 2023-07-29T02:03:32.034 INFO:tasks.workunit.client.0.smithi042.stdout:removed './290/20' 2023-07-29T02:03:32.035 INFO:tasks.workunit.client.0.smithi042.stdout:removed './290/39' 2023-07-29T02:03:32.035 INFO:tasks.workunit.client.0.smithi042.stdout:removed './290/34' 2023-07-29T02:03:32.035 INFO:tasks.workunit.client.0.smithi042.stdout:removed './290/38' 2023-07-29T02:03:32.035 INFO:tasks.workunit.client.0.smithi042.stdout:removed './290/28' 2023-07-29T02:03:32.035 INFO:tasks.workunit.client.0.smithi042.stdout:removed './290/24' 2023-07-29T02:03:32.035 INFO:tasks.workunit.client.0.smithi042.stdout:removed './290/29' 2023-07-29T02:03:32.035 INFO:tasks.workunit.client.0.smithi042.stdout:removed './290/32' 2023-07-29T02:03:32.035 INFO:tasks.workunit.client.0.smithi042.stdout:removed './290/22' 2023-07-29T02:03:32.036 INFO:tasks.workunit.client.0.smithi042.stdout:removed './290/25' 2023-07-29T02:03:32.036 INFO:tasks.workunit.client.0.smithi042.stdout:removed './290/30' 2023-07-29T02:03:32.036 INFO:tasks.workunit.client.0.smithi042.stdout:removed './290/33' 2023-07-29T02:03:32.036 INFO:tasks.workunit.client.0.smithi042.stdout:removed './290/23' 2023-07-29T02:03:32.036 INFO:tasks.workunit.client.0.smithi042.stdout:removed './290/35' 2023-07-29T02:03:32.036 INFO:tasks.workunit.client.0.smithi042.stdout:removed './290/26' 2023-07-29T02:03:32.036 INFO:tasks.workunit.client.0.smithi042.stdout:removed './290/37' 2023-07-29T02:03:32.037 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './290' 2023-07-29T02:03:32.037 INFO:tasks.workunit.client.0.smithi042.stdout:removed './291/21' 2023-07-29T02:03:32.037 INFO:tasks.workunit.client.0.smithi042.stdout:removed './291/27' 2023-07-29T02:03:32.037 INFO:tasks.workunit.client.0.smithi042.stdout:removed './291/31' 2023-07-29T02:03:32.037 INFO:tasks.workunit.client.0.smithi042.stdout:removed './291/36' 2023-07-29T02:03:32.037 INFO:tasks.workunit.client.0.smithi042.stdout:removed './291/20' 2023-07-29T02:03:32.037 INFO:tasks.workunit.client.0.smithi042.stdout:removed './291/39' 2023-07-29T02:03:32.037 INFO:tasks.workunit.client.0.smithi042.stdout:removed './291/34' 2023-07-29T02:03:32.038 INFO:tasks.workunit.client.0.smithi042.stdout:removed './291/38' 2023-07-29T02:03:32.038 INFO:tasks.workunit.client.0.smithi042.stdout:removed './291/28' 2023-07-29T02:03:32.038 INFO:tasks.workunit.client.0.smithi042.stdout:removed './291/24' 2023-07-29T02:03:32.038 INFO:tasks.workunit.client.0.smithi042.stdout:removed './291/29' 2023-07-29T02:03:32.038 INFO:tasks.workunit.client.0.smithi042.stdout:removed './291/32' 2023-07-29T02:03:32.038 INFO:tasks.workunit.client.0.smithi042.stdout:removed './291/22' 2023-07-29T02:03:32.038 INFO:tasks.workunit.client.0.smithi042.stdout:removed './291/25' 2023-07-29T02:03:32.038 INFO:tasks.workunit.client.0.smithi042.stdout:removed './291/30' 2023-07-29T02:03:32.039 INFO:tasks.workunit.client.0.smithi042.stdout:removed './291/33' 2023-07-29T02:03:32.039 INFO:tasks.workunit.client.0.smithi042.stdout:removed './291/23' 2023-07-29T02:03:32.039 INFO:tasks.workunit.client.0.smithi042.stdout:removed './291/35' 2023-07-29T02:03:32.039 INFO:tasks.workunit.client.0.smithi042.stdout:removed './291/26' 2023-07-29T02:03:32.039 INFO:tasks.workunit.client.0.smithi042.stdout:removed './291/37' 2023-07-29T02:03:32.039 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './291' 2023-07-29T02:03:32.039 INFO:tasks.workunit.client.0.smithi042.stdout:removed './292/21' 2023-07-29T02:03:32.039 INFO:tasks.workunit.client.0.smithi042.stdout:removed './292/27' 2023-07-29T02:03:32.040 INFO:tasks.workunit.client.0.smithi042.stdout:removed './292/31' 2023-07-29T02:03:32.040 INFO:tasks.workunit.client.0.smithi042.stdout:removed './292/36' 2023-07-29T02:03:32.040 INFO:tasks.workunit.client.0.smithi042.stdout:removed './292/20' 2023-07-29T02:03:32.041 INFO:tasks.workunit.client.0.smithi042.stdout:removed './292/39' 2023-07-29T02:03:32.041 INFO:tasks.workunit.client.0.smithi042.stdout:removed './292/34' 2023-07-29T02:03:32.041 INFO:tasks.workunit.client.0.smithi042.stdout:removed './292/38' 2023-07-29T02:03:32.041 INFO:tasks.workunit.client.0.smithi042.stdout:removed './292/28' 2023-07-29T02:03:32.041 INFO:tasks.workunit.client.0.smithi042.stdout:removed './292/24' 2023-07-29T02:03:32.041 INFO:tasks.workunit.client.0.smithi042.stdout:removed './292/29' 2023-07-29T02:03:32.041 INFO:tasks.workunit.client.0.smithi042.stdout:removed './292/32' 2023-07-29T02:03:32.042 INFO:tasks.workunit.client.0.smithi042.stdout:removed './292/22' 2023-07-29T02:03:32.042 INFO:tasks.workunit.client.0.smithi042.stdout:removed './292/25' 2023-07-29T02:03:32.042 INFO:tasks.workunit.client.0.smithi042.stdout:removed './292/30' 2023-07-29T02:03:32.043 INFO:tasks.workunit.client.0.smithi042.stdout:removed './292/33' 2023-07-29T02:03:32.043 INFO:tasks.workunit.client.0.smithi042.stdout:removed './292/23' 2023-07-29T02:03:32.043 INFO:tasks.workunit.client.0.smithi042.stdout:removed './292/35' 2023-07-29T02:03:32.043 INFO:tasks.workunit.client.0.smithi042.stdout:removed './292/26' 2023-07-29T02:03:32.044 INFO:tasks.workunit.client.0.smithi042.stdout:removed './292/37' 2023-07-29T02:03:32.044 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './292' 2023-07-29T02:03:32.044 INFO:tasks.workunit.client.0.smithi042.stdout:removed './293/21' 2023-07-29T02:03:32.045 INFO:tasks.workunit.client.0.smithi042.stdout:removed './293/27' 2023-07-29T02:03:32.045 INFO:tasks.workunit.client.0.smithi042.stdout:removed './293/31' 2023-07-29T02:03:32.045 INFO:tasks.workunit.client.0.smithi042.stdout:removed './293/36' 2023-07-29T02:03:32.045 INFO:tasks.workunit.client.0.smithi042.stdout:removed './293/20' 2023-07-29T02:03:32.046 INFO:tasks.workunit.client.0.smithi042.stdout:removed './293/39' 2023-07-29T02:03:32.046 INFO:tasks.workunit.client.0.smithi042.stdout:removed './293/34' 2023-07-29T02:03:32.046 INFO:tasks.workunit.client.0.smithi042.stdout:removed './293/38' 2023-07-29T02:03:32.047 INFO:tasks.workunit.client.0.smithi042.stdout:removed './293/28' 2023-07-29T02:03:32.047 INFO:tasks.workunit.client.0.smithi042.stdout:removed './293/24' 2023-07-29T02:03:32.047 INFO:tasks.workunit.client.0.smithi042.stdout:removed './293/29' 2023-07-29T02:03:32.047 INFO:tasks.workunit.client.0.smithi042.stdout:removed './293/32' 2023-07-29T02:03:32.048 INFO:tasks.workunit.client.0.smithi042.stdout:removed './293/22' 2023-07-29T02:03:32.048 INFO:tasks.workunit.client.0.smithi042.stdout:removed './293/25' 2023-07-29T02:03:32.048 INFO:tasks.workunit.client.0.smithi042.stdout:removed './293/30' 2023-07-29T02:03:32.048 INFO:tasks.workunit.client.0.smithi042.stdout:removed './293/33' 2023-07-29T02:03:32.049 INFO:tasks.workunit.client.0.smithi042.stdout:removed './293/23' 2023-07-29T02:03:32.049 INFO:tasks.workunit.client.0.smithi042.stdout:removed './293/35' 2023-07-29T02:03:32.049 INFO:tasks.workunit.client.0.smithi042.stdout:removed './293/26' 2023-07-29T02:03:32.049 INFO:tasks.workunit.client.0.smithi042.stdout:removed './293/37' 2023-07-29T02:03:32.050 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './293' 2023-07-29T02:03:32.050 INFO:tasks.workunit.client.0.smithi042.stdout:removed './294/21' 2023-07-29T02:03:32.050 INFO:tasks.workunit.client.0.smithi042.stdout:removed './294/27' 2023-07-29T02:03:32.051 INFO:tasks.workunit.client.0.smithi042.stdout:removed './294/31' 2023-07-29T02:03:32.051 INFO:tasks.workunit.client.0.smithi042.stdout:removed './294/36' 2023-07-29T02:03:32.051 INFO:tasks.workunit.client.0.smithi042.stdout:removed './294/20' 2023-07-29T02:03:32.051 INFO:tasks.workunit.client.0.smithi042.stdout:removed './294/39' 2023-07-29T02:03:32.051 INFO:tasks.workunit.client.0.smithi042.stdout:removed './294/34' 2023-07-29T02:03:32.051 INFO:tasks.workunit.client.0.smithi042.stdout:removed './294/38' 2023-07-29T02:03:32.052 INFO:tasks.workunit.client.0.smithi042.stdout:removed './294/28' 2023-07-29T02:03:32.052 INFO:tasks.workunit.client.0.smithi042.stdout:removed './294/24' 2023-07-29T02:03:32.052 INFO:tasks.workunit.client.0.smithi042.stdout:removed './294/29' 2023-07-29T02:03:32.052 INFO:tasks.workunit.client.0.smithi042.stdout:removed './294/32' 2023-07-29T02:03:32.052 INFO:tasks.workunit.client.0.smithi042.stdout:removed './294/22' 2023-07-29T02:03:32.052 INFO:tasks.workunit.client.0.smithi042.stdout:removed './294/25' 2023-07-29T02:03:32.052 INFO:tasks.workunit.client.0.smithi042.stdout:removed './294/30' 2023-07-29T02:03:32.053 INFO:tasks.workunit.client.0.smithi042.stdout:removed './294/33' 2023-07-29T02:03:32.053 INFO:tasks.workunit.client.0.smithi042.stdout:removed './294/23' 2023-07-29T02:03:32.053 INFO:tasks.workunit.client.0.smithi042.stdout:removed './294/35' 2023-07-29T02:03:32.053 INFO:tasks.workunit.client.0.smithi042.stdout:removed './294/26' 2023-07-29T02:03:32.053 INFO:tasks.workunit.client.0.smithi042.stdout:removed './294/37' 2023-07-29T02:03:32.053 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './294' 2023-07-29T02:03:32.053 INFO:tasks.workunit.client.0.smithi042.stdout:removed './295/21' 2023-07-29T02:03:32.053 INFO:tasks.workunit.client.0.smithi042.stdout:removed './295/27' 2023-07-29T02:03:32.054 INFO:tasks.workunit.client.0.smithi042.stdout:removed './295/31' 2023-07-29T02:03:32.054 INFO:tasks.workunit.client.0.smithi042.stdout:removed './295/36' 2023-07-29T02:03:32.054 INFO:tasks.workunit.client.0.smithi042.stdout:removed './295/20' 2023-07-29T02:03:32.054 INFO:tasks.workunit.client.0.smithi042.stdout:removed './295/39' 2023-07-29T02:03:32.054 INFO:tasks.workunit.client.0.smithi042.stdout:removed './295/34' 2023-07-29T02:03:32.054 INFO:tasks.workunit.client.0.smithi042.stdout:removed './295/38' 2023-07-29T02:03:32.054 INFO:tasks.workunit.client.0.smithi042.stdout:removed './295/28' 2023-07-29T02:03:32.054 INFO:tasks.workunit.client.0.smithi042.stdout:removed './295/24' 2023-07-29T02:03:32.055 INFO:tasks.workunit.client.0.smithi042.stdout:removed './295/29' 2023-07-29T02:03:32.055 INFO:tasks.workunit.client.0.smithi042.stdout:removed './295/32' 2023-07-29T02:03:32.055 INFO:tasks.workunit.client.0.smithi042.stdout:removed './295/22' 2023-07-29T02:03:32.055 INFO:tasks.workunit.client.0.smithi042.stdout:removed './295/25' 2023-07-29T02:03:32.055 INFO:tasks.workunit.client.0.smithi042.stdout:removed './295/30' 2023-07-29T02:03:32.055 INFO:tasks.workunit.client.0.smithi042.stdout:removed './295/33' 2023-07-29T02:03:32.055 INFO:tasks.workunit.client.0.smithi042.stdout:removed './295/23' 2023-07-29T02:03:32.055 INFO:tasks.workunit.client.0.smithi042.stdout:removed './295/35' 2023-07-29T02:03:32.056 INFO:tasks.workunit.client.0.smithi042.stdout:removed './295/26' 2023-07-29T02:03:32.056 INFO:tasks.workunit.client.0.smithi042.stdout:removed './295/37' 2023-07-29T02:03:32.056 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './295' 2023-07-29T02:03:32.056 INFO:tasks.workunit.client.0.smithi042.stdout:removed './296/21' 2023-07-29T02:03:32.056 INFO:tasks.workunit.client.0.smithi042.stdout:removed './296/27' 2023-07-29T02:03:32.056 INFO:tasks.workunit.client.0.smithi042.stdout:removed './296/31' 2023-07-29T02:03:32.057 INFO:tasks.workunit.client.0.smithi042.stdout:removed './296/36' 2023-07-29T02:03:32.057 INFO:tasks.workunit.client.0.smithi042.stdout:removed './296/20' 2023-07-29T02:03:32.057 INFO:tasks.workunit.client.0.smithi042.stdout:removed './296/39' 2023-07-29T02:03:32.058 INFO:tasks.workunit.client.0.smithi042.stdout:removed './296/34' 2023-07-29T02:03:32.058 INFO:tasks.workunit.client.0.smithi042.stdout:removed './296/38' 2023-07-29T02:03:32.058 INFO:tasks.workunit.client.0.smithi042.stdout:removed './296/28' 2023-07-29T02:03:32.059 INFO:tasks.workunit.client.0.smithi042.stdout:removed './296/24' 2023-07-29T02:03:32.059 INFO:tasks.workunit.client.0.smithi042.stdout:removed './296/29' 2023-07-29T02:03:32.059 INFO:tasks.workunit.client.0.smithi042.stdout:removed './296/32' 2023-07-29T02:03:32.059 INFO:tasks.workunit.client.0.smithi042.stdout:removed './296/22' 2023-07-29T02:03:32.060 INFO:tasks.workunit.client.0.smithi042.stdout:removed './296/25' 2023-07-29T02:03:32.060 INFO:tasks.workunit.client.0.smithi042.stdout:removed './296/30' 2023-07-29T02:03:32.060 INFO:tasks.workunit.client.0.smithi042.stdout:removed './296/33' 2023-07-29T02:03:32.060 INFO:tasks.workunit.client.0.smithi042.stdout:removed './296/23' 2023-07-29T02:03:32.061 INFO:tasks.workunit.client.0.smithi042.stdout:removed './296/35' 2023-07-29T02:03:32.061 INFO:tasks.workunit.client.0.smithi042.stdout:removed './296/26' 2023-07-29T02:03:32.061 INFO:tasks.workunit.client.0.smithi042.stdout:removed './296/37' 2023-07-29T02:03:32.061 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './296' 2023-07-29T02:03:32.061 INFO:tasks.workunit.client.0.smithi042.stdout:removed './297/21' 2023-07-29T02:03:32.062 INFO:tasks.workunit.client.0.smithi042.stdout:removed './297/27' 2023-07-29T02:03:32.313 INFO:tasks.workunit.client.0.smithi042.stdout:removed './297/31' 2023-07-29T02:03:32.313 INFO:tasks.workunit.client.0.smithi042.stdout:removed './297/36' 2023-07-29T02:03:32.314 INFO:tasks.workunit.client.0.smithi042.stdout:removed './297/20' 2023-07-29T02:03:32.314 INFO:tasks.workunit.client.0.smithi042.stdout:removed './297/39' 2023-07-29T02:03:32.314 INFO:tasks.workunit.client.0.smithi042.stdout:removed './297/34' 2023-07-29T02:03:32.314 INFO:tasks.workunit.client.0.smithi042.stdout:removed './297/38' 2023-07-29T02:03:32.314 INFO:tasks.workunit.client.0.smithi042.stdout:removed './297/28' 2023-07-29T02:03:32.314 INFO:tasks.workunit.client.0.smithi042.stdout:removed './297/24' 2023-07-29T02:03:32.314 INFO:tasks.workunit.client.0.smithi042.stdout:removed './297/29' 2023-07-29T02:03:32.315 INFO:tasks.workunit.client.0.smithi042.stdout:removed './297/32' 2023-07-29T02:03:32.315 INFO:tasks.workunit.client.0.smithi042.stdout:removed './297/22' 2023-07-29T02:03:32.315 INFO:tasks.workunit.client.0.smithi042.stdout:removed './297/25' 2023-07-29T02:03:32.315 INFO:tasks.workunit.client.0.smithi042.stdout:removed './297/30' 2023-07-29T02:03:32.316 INFO:tasks.workunit.client.0.smithi042.stdout:removed './297/33' 2023-07-29T02:03:32.316 INFO:tasks.workunit.client.0.smithi042.stdout:removed './297/23' 2023-07-29T02:03:32.316 INFO:tasks.workunit.client.0.smithi042.stdout:removed './297/35' 2023-07-29T02:03:32.316 INFO:tasks.workunit.client.0.smithi042.stdout:removed './297/26' 2023-07-29T02:03:32.316 INFO:tasks.workunit.client.0.smithi042.stdout:removed './297/37' 2023-07-29T02:03:32.316 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './297' 2023-07-29T02:03:32.316 INFO:tasks.workunit.client.0.smithi042.stdout:removed './298/21' 2023-07-29T02:03:32.317 INFO:tasks.workunit.client.0.smithi042.stdout:removed './298/27' 2023-07-29T02:03:32.317 INFO:tasks.workunit.client.0.smithi042.stdout:removed './298/31' 2023-07-29T02:03:32.317 INFO:tasks.workunit.client.0.smithi042.stdout:removed './298/36' 2023-07-29T02:03:32.317 INFO:tasks.workunit.client.0.smithi042.stdout:removed './298/20' 2023-07-29T02:03:32.317 INFO:tasks.workunit.client.0.smithi042.stdout:removed './298/39' 2023-07-29T02:03:32.317 INFO:tasks.workunit.client.0.smithi042.stdout:removed './298/34' 2023-07-29T02:03:32.317 INFO:tasks.workunit.client.0.smithi042.stdout:removed './298/38' 2023-07-29T02:03:32.318 INFO:tasks.workunit.client.0.smithi042.stdout:removed './298/28' 2023-07-29T02:03:32.318 INFO:tasks.workunit.client.0.smithi042.stdout:removed './298/24' 2023-07-29T02:03:32.318 INFO:tasks.workunit.client.0.smithi042.stdout:removed './298/29' 2023-07-29T02:03:32.318 INFO:tasks.workunit.client.0.smithi042.stdout:removed './298/32' 2023-07-29T02:03:32.318 INFO:tasks.workunit.client.0.smithi042.stdout:removed './298/22' 2023-07-29T02:03:32.318 INFO:tasks.workunit.client.0.smithi042.stdout:removed './298/25' 2023-07-29T02:03:32.318 INFO:tasks.workunit.client.0.smithi042.stdout:removed './298/30' 2023-07-29T02:03:32.318 INFO:tasks.workunit.client.0.smithi042.stdout:removed './298/33' 2023-07-29T02:03:32.319 INFO:tasks.workunit.client.0.smithi042.stdout:removed './298/23' 2023-07-29T02:03:32.319 INFO:tasks.workunit.client.0.smithi042.stdout:removed './298/35' 2023-07-29T02:03:32.319 INFO:tasks.workunit.client.0.smithi042.stdout:removed './298/26' 2023-07-29T02:03:32.319 INFO:tasks.workunit.client.0.smithi042.stdout:removed './298/37' 2023-07-29T02:03:32.319 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './298' 2023-07-29T02:03:32.319 INFO:tasks.workunit.client.0.smithi042.stdout:removed './299/21' 2023-07-29T02:03:32.319 INFO:tasks.workunit.client.0.smithi042.stdout:removed './299/27' 2023-07-29T02:03:32.319 INFO:tasks.workunit.client.0.smithi042.stdout:removed './299/31' 2023-07-29T02:03:32.320 INFO:tasks.workunit.client.0.smithi042.stdout:removed './299/36' 2023-07-29T02:03:32.320 INFO:tasks.workunit.client.0.smithi042.stdout:removed './299/20' 2023-07-29T02:03:32.320 INFO:tasks.workunit.client.0.smithi042.stdout:removed './299/39' 2023-07-29T02:03:32.320 INFO:tasks.workunit.client.0.smithi042.stdout:removed './299/34' 2023-07-29T02:03:32.320 INFO:tasks.workunit.client.0.smithi042.stdout:removed './299/38' 2023-07-29T02:03:32.320 INFO:tasks.workunit.client.0.smithi042.stdout:removed './299/28' 2023-07-29T02:03:32.320 INFO:tasks.workunit.client.0.smithi042.stdout:removed './299/24' 2023-07-29T02:03:32.321 INFO:tasks.workunit.client.0.smithi042.stdout:removed './299/29' 2023-07-29T02:03:32.321 INFO:tasks.workunit.client.0.smithi042.stdout:removed './299/32' 2023-07-29T02:03:32.321 INFO:tasks.workunit.client.0.smithi042.stdout:removed './299/22' 2023-07-29T02:03:32.321 INFO:tasks.workunit.client.0.smithi042.stdout:removed './299/25' 2023-07-29T02:03:32.321 INFO:tasks.workunit.client.0.smithi042.stdout:removed './299/30' 2023-07-29T02:03:32.321 INFO:tasks.workunit.client.0.smithi042.stdout:removed './299/33' 2023-07-29T02:03:32.321 INFO:tasks.workunit.client.0.smithi042.stdout:removed './299/23' 2023-07-29T02:03:32.321 INFO:tasks.workunit.client.0.smithi042.stdout:removed './299/35' 2023-07-29T02:03:32.322 INFO:tasks.workunit.client.0.smithi042.stdout:removed './299/26' 2023-07-29T02:03:32.322 INFO:tasks.workunit.client.0.smithi042.stdout:removed './299/37' 2023-07-29T02:03:32.322 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './299' 2023-07-29T02:03:32.322 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/166/19' 2023-07-29T02:03:32.322 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/166/15' 2023-07-29T02:03:32.322 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/166/20' 2023-07-29T02:03:32.322 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/166/12' 2023-07-29T02:03:32.322 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/166/10' 2023-07-29T02:03:32.323 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/166/11' 2023-07-29T02:03:32.323 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/166/16' 2023-07-29T02:03:32.323 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/166/14' 2023-07-29T02:03:32.323 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/166/18' 2023-07-29T02:03:32.323 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/166/13' 2023-07-29T02:03:32.323 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/166/17' 2023-07-29T02:03:32.323 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/166' 2023-07-29T02:03:32.324 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/147/19' 2023-07-29T02:03:32.324 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/147/15' 2023-07-29T02:03:32.324 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/147/20' 2023-07-29T02:03:32.325 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/147/12' 2023-07-29T02:03:32.325 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/147/10' 2023-07-29T02:03:32.325 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/147/11' 2023-07-29T02:03:32.325 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/147/16' 2023-07-29T02:03:32.326 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/147/14' 2023-07-29T02:03:32.326 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/147/18' 2023-07-29T02:03:32.326 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/147/13' 2023-07-29T02:03:32.326 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/147/17' 2023-07-29T02:03:32.327 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/147' 2023-07-29T02:03:32.327 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/151/19' 2023-07-29T02:03:32.327 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/151/15' 2023-07-29T02:03:32.328 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/151/20' 2023-07-29T02:03:32.328 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/151/12' 2023-07-29T02:03:32.328 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/151/10' 2023-07-29T02:03:32.328 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/151/11' 2023-07-29T02:03:32.329 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/151/16' 2023-07-29T02:03:32.329 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/151/14' 2023-07-29T02:03:32.329 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/151/18' 2023-07-29T02:03:32.329 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/151/13' 2023-07-29T02:03:32.330 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/151/17' 2023-07-29T02:03:32.330 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/151' 2023-07-29T02:03:32.330 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/170/19' 2023-07-29T02:03:32.330 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/170/15' 2023-07-29T02:03:32.331 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/170/20' 2023-07-29T02:03:32.331 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/170/12' 2023-07-29T02:03:32.331 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/170/10' 2023-07-29T02:03:32.331 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/170/11' 2023-07-29T02:03:32.332 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/170/16' 2023-07-29T02:03:32.332 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/170/14' 2023-07-29T02:03:32.332 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/170/18' 2023-07-29T02:03:32.332 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/170/13' 2023-07-29T02:03:32.333 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/170/17' 2023-07-29T02:03:32.333 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/170' 2023-07-29T02:03:32.333 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/167/19' 2023-07-29T02:03:32.333 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/167/15' 2023-07-29T02:03:32.333 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/167/20' 2023-07-29T02:03:32.334 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/167/12' 2023-07-29T02:03:32.334 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/167/10' 2023-07-29T02:03:32.334 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/167/11' 2023-07-29T02:03:32.334 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/167/16' 2023-07-29T02:03:32.335 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/167/14' 2023-07-29T02:03:32.335 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/167/18' 2023-07-29T02:03:32.335 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/167/13' 2023-07-29T02:03:32.335 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/167/17' 2023-07-29T02:03:32.335 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/167' 2023-07-29T02:03:32.336 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/140/19' 2023-07-29T02:03:32.336 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/140/15' 2023-07-29T02:03:32.336 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/140/20' 2023-07-29T02:03:32.337 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/140/12' 2023-07-29T02:03:32.337 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/140/10' 2023-07-29T02:03:32.337 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/140/11' 2023-07-29T02:03:32.337 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/140/16' 2023-07-29T02:03:32.338 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/140/14' 2023-07-29T02:03:32.338 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/140/18' 2023-07-29T02:03:32.338 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/140/13' 2023-07-29T02:03:32.338 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/140/17' 2023-07-29T02:03:32.339 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/140' 2023-07-29T02:03:32.339 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/142/19' 2023-07-29T02:03:32.339 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/142/15' 2023-07-29T02:03:32.339 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/142/20' 2023-07-29T02:03:32.340 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/142/12' 2023-07-29T02:03:32.340 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/142/10' 2023-07-29T02:03:32.570 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/142/11' 2023-07-29T02:03:32.570 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/142/16' 2023-07-29T02:03:32.570 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/142/14' 2023-07-29T02:03:32.571 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/142/18' 2023-07-29T02:03:32.571 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/142/13' 2023-07-29T02:03:32.571 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/142/17' 2023-07-29T02:03:32.571 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/142' 2023-07-29T02:03:32.571 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/150/19' 2023-07-29T02:03:32.571 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/150/15' 2023-07-29T02:03:32.571 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/150/20' 2023-07-29T02:03:32.572 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/150/12' 2023-07-29T02:03:32.572 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/150/10' 2023-07-29T02:03:32.572 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/150/11' 2023-07-29T02:03:32.572 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/150/16' 2023-07-29T02:03:32.572 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/150/14' 2023-07-29T02:03:32.572 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/150/18' 2023-07-29T02:03:32.572 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/150/13' 2023-07-29T02:03:32.572 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/150/17' 2023-07-29T02:03:32.573 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/150' 2023-07-29T02:03:32.573 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/105/19' 2023-07-29T02:03:32.573 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/105/15' 2023-07-29T02:03:32.573 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/105/20' 2023-07-29T02:03:32.573 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/105/12' 2023-07-29T02:03:32.573 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/105/10' 2023-07-29T02:03:32.573 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/105/11' 2023-07-29T02:03:32.574 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/105/16' 2023-07-29T02:03:32.574 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/105/14' 2023-07-29T02:03:32.574 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/105/18' 2023-07-29T02:03:32.574 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/105/13' 2023-07-29T02:03:32.574 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/105/17' 2023-07-29T02:03:32.574 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/105' 2023-07-29T02:03:32.574 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/149/19' 2023-07-29T02:03:32.574 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/149/15' 2023-07-29T02:03:32.575 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/149/20' 2023-07-29T02:03:32.575 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/149/12' 2023-07-29T02:03:32.575 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/149/10' 2023-07-29T02:03:32.575 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/149/11' 2023-07-29T02:03:32.575 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/149/16' 2023-07-29T02:03:32.575 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/149/14' 2023-07-29T02:03:32.575 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/149/18' 2023-07-29T02:03:32.575 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/149/13' 2023-07-29T02:03:32.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/149/17' 2023-07-29T02:03:32.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/149' 2023-07-29T02:03:32.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/109/19' 2023-07-29T02:03:32.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/109/15' 2023-07-29T02:03:32.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/109/20' 2023-07-29T02:03:32.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/109/12' 2023-07-29T02:03:32.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/109/10' 2023-07-29T02:03:32.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/109/11' 2023-07-29T02:03:32.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/109/16' 2023-07-29T02:03:32.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/109/14' 2023-07-29T02:03:32.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/109/18' 2023-07-29T02:03:32.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/109/13' 2023-07-29T02:03:32.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/109/17' 2023-07-29T02:03:32.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/109' 2023-07-29T02:03:32.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/158/19' 2023-07-29T02:03:32.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/158/15' 2023-07-29T02:03:32.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/158/20' 2023-07-29T02:03:32.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/158/12' 2023-07-29T02:03:32.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/158/10' 2023-07-29T02:03:32.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/158/11' 2023-07-29T02:03:32.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/158/16' 2023-07-29T02:03:32.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/158/14' 2023-07-29T02:03:32.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/158/18' 2023-07-29T02:03:32.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/158/13' 2023-07-29T02:03:32.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/158/17' 2023-07-29T02:03:32.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/158' 2023-07-29T02:03:32.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/106/19' 2023-07-29T02:03:32.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/106/15' 2023-07-29T02:03:32.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/106/20' 2023-07-29T02:03:32.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/106/12' 2023-07-29T02:03:32.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/106/10' 2023-07-29T02:03:32.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/106/11' 2023-07-29T02:03:32.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/106/16' 2023-07-29T02:03:32.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/106/14' 2023-07-29T02:03:32.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/106/18' 2023-07-29T02:03:32.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/106/13' 2023-07-29T02:03:32.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/106/17' 2023-07-29T02:03:32.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/106' 2023-07-29T02:03:32.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/189/19' 2023-07-29T02:03:32.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/189/15' 2023-07-29T02:03:32.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/189/20' 2023-07-29T02:03:32.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/189/12' 2023-07-29T02:03:32.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/189/10' 2023-07-29T02:03:32.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/189/11' 2023-07-29T02:03:32.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/189/16' 2023-07-29T02:03:32.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/189/14' 2023-07-29T02:03:32.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/189/18' 2023-07-29T02:03:32.582 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/189/13' 2023-07-29T02:03:32.582 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/189/17' 2023-07-29T02:03:32.582 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/189' 2023-07-29T02:03:32.582 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/133/19' 2023-07-29T02:03:32.582 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/133/15' 2023-07-29T02:03:32.582 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/133/20' 2023-07-29T02:03:32.582 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/133/12' 2023-07-29T02:03:32.582 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/133/10' 2023-07-29T02:03:32.583 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/133/11' 2023-07-29T02:03:32.583 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/133/16' 2023-07-29T02:03:32.583 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/133/14' 2023-07-29T02:03:32.583 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/133/18' 2023-07-29T02:03:32.583 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/133/13' 2023-07-29T02:03:32.583 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/133/17' 2023-07-29T02:03:32.583 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/133' 2023-07-29T02:03:32.583 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/173/19' 2023-07-29T02:03:32.584 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/173/15' 2023-07-29T02:03:32.584 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/173/20' 2023-07-29T02:03:32.584 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/173/12' 2023-07-29T02:03:32.584 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/173/10' 2023-07-29T02:03:32.584 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/173/11' 2023-07-29T02:03:32.884 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/173/16' 2023-07-29T02:03:32.884 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/173/14' 2023-07-29T02:03:32.885 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/173/18' 2023-07-29T02:03:32.885 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/173/13' 2023-07-29T02:03:32.885 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/173/17' 2023-07-29T02:03:32.885 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/173' 2023-07-29T02:03:32.885 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/174/19' 2023-07-29T02:03:32.885 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/174/15' 2023-07-29T02:03:32.885 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/174/20' 2023-07-29T02:03:32.886 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/174/12' 2023-07-29T02:03:32.886 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/174/10' 2023-07-29T02:03:32.886 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/174/11' 2023-07-29T02:03:32.886 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/174/16' 2023-07-29T02:03:32.886 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/174/14' 2023-07-29T02:03:32.886 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/174/18' 2023-07-29T02:03:32.886 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/174/13' 2023-07-29T02:03:32.886 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/174/17' 2023-07-29T02:03:32.887 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/174' 2023-07-29T02:03:32.887 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/155/19' 2023-07-29T02:03:32.887 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/155/15' 2023-07-29T02:03:32.887 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/155/20' 2023-07-29T02:03:32.887 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/155/12' 2023-07-29T02:03:32.887 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/155/10' 2023-07-29T02:03:32.887 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/155/11' 2023-07-29T02:03:32.887 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/155/16' 2023-07-29T02:03:32.888 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/155/14' 2023-07-29T02:03:32.888 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/155/18' 2023-07-29T02:03:32.888 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/155/13' 2023-07-29T02:03:32.888 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/155/17' 2023-07-29T02:03:32.888 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/155' 2023-07-29T02:03:32.888 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/114/19' 2023-07-29T02:03:32.888 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/114/15' 2023-07-29T02:03:32.888 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/114/20' 2023-07-29T02:03:32.889 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/114/12' 2023-07-29T02:03:32.889 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/114/10' 2023-07-29T02:03:32.889 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/114/11' 2023-07-29T02:03:32.889 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/114/16' 2023-07-29T02:03:32.889 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/114/14' 2023-07-29T02:03:32.889 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/114/18' 2023-07-29T02:03:32.889 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/114/13' 2023-07-29T02:03:32.890 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/114/17' 2023-07-29T02:03:32.890 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/114' 2023-07-29T02:03:32.890 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/159/19' 2023-07-29T02:03:32.890 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/159/15' 2023-07-29T02:03:32.890 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/159/20' 2023-07-29T02:03:32.890 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/159/12' 2023-07-29T02:03:32.890 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/159/10' 2023-07-29T02:03:32.890 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/159/11' 2023-07-29T02:03:32.891 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/159/16' 2023-07-29T02:03:32.891 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/159/14' 2023-07-29T02:03:32.891 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/159/18' 2023-07-29T02:03:32.891 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/159/13' 2023-07-29T02:03:32.891 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/159/17' 2023-07-29T02:03:32.891 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/159' 2023-07-29T02:03:32.891 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/187/19' 2023-07-29T02:03:32.891 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/187/15' 2023-07-29T02:03:32.892 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/187/20' 2023-07-29T02:03:32.892 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/187/12' 2023-07-29T02:03:32.892 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/187/10' 2023-07-29T02:03:32.892 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/187/11' 2023-07-29T02:03:32.892 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/187/16' 2023-07-29T02:03:32.892 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/187/14' 2023-07-29T02:03:32.892 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/187/18' 2023-07-29T02:03:32.892 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/187/13' 2023-07-29T02:03:32.893 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/187/17' 2023-07-29T02:03:32.893 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/187' 2023-07-29T02:03:32.893 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/185/19' 2023-07-29T02:03:32.893 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/185/15' 2023-07-29T02:03:32.893 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/185/20' 2023-07-29T02:03:32.893 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/185/12' 2023-07-29T02:03:32.893 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/185/10' 2023-07-29T02:03:32.893 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/185/11' 2023-07-29T02:03:32.894 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/185/16' 2023-07-29T02:03:32.894 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/185/14' 2023-07-29T02:03:32.894 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/185/18' 2023-07-29T02:03:32.894 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/185/13' 2023-07-29T02:03:32.894 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/185/17' 2023-07-29T02:03:32.894 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/185' 2023-07-29T02:03:32.894 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/120/19' 2023-07-29T02:03:32.894 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/120/15' 2023-07-29T02:03:32.895 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/120/20' 2023-07-29T02:03:32.895 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/120/12' 2023-07-29T02:03:32.895 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/120/10' 2023-07-29T02:03:32.895 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/120/11' 2023-07-29T02:03:32.895 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/120/16' 2023-07-29T02:03:32.895 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/120/14' 2023-07-29T02:03:32.895 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/120/18' 2023-07-29T02:03:32.895 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/120/13' 2023-07-29T02:03:32.896 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/120/17' 2023-07-29T02:03:32.896 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/120' 2023-07-29T02:03:32.896 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/110/19' 2023-07-29T02:03:32.896 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/110/15' 2023-07-29T02:03:32.896 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/110/20' 2023-07-29T02:03:32.896 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/110/12' 2023-07-29T02:03:32.896 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/110/10' 2023-07-29T02:03:32.897 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/110/11' 2023-07-29T02:03:32.897 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/110/16' 2023-07-29T02:03:32.897 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/110/14' 2023-07-29T02:03:32.897 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/110/18' 2023-07-29T02:03:32.897 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/110/13' 2023-07-29T02:03:32.897 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/110/17' 2023-07-29T02:03:32.897 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/110' 2023-07-29T02:03:32.897 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/137/19' 2023-07-29T02:03:32.898 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/137/15' 2023-07-29T02:03:32.898 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/137/20' 2023-07-29T02:03:32.898 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/137/12' 2023-07-29T02:03:32.898 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/137/10' 2023-07-29T02:03:32.898 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/137/11' 2023-07-29T02:03:32.898 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/137/16' 2023-07-29T02:03:33.182 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/137/14' 2023-07-29T02:03:33.183 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/137/18' 2023-07-29T02:03:33.183 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/137/13' 2023-07-29T02:03:33.183 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/137/17' 2023-07-29T02:03:33.183 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/137' 2023-07-29T02:03:33.183 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/198/19' 2023-07-29T02:03:33.183 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/198/15' 2023-07-29T02:03:33.183 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/198/20' 2023-07-29T02:03:33.183 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/198/12' 2023-07-29T02:03:33.184 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/198/10' 2023-07-29T02:03:33.184 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/198/11' 2023-07-29T02:03:33.184 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/198/16' 2023-07-29T02:03:33.184 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/198/14' 2023-07-29T02:03:33.184 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/198/18' 2023-07-29T02:03:33.184 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/198/13' 2023-07-29T02:03:33.184 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/198/17' 2023-07-29T02:03:33.185 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/198' 2023-07-29T02:03:33.185 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/136/19' 2023-07-29T02:03:33.185 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/136/15' 2023-07-29T02:03:33.185 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/136/20' 2023-07-29T02:03:33.185 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/136/12' 2023-07-29T02:03:33.185 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/136/10' 2023-07-29T02:03:33.185 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/136/11' 2023-07-29T02:03:33.185 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/136/16' 2023-07-29T02:03:33.186 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/136/14' 2023-07-29T02:03:33.186 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/136/18' 2023-07-29T02:03:33.186 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/136/13' 2023-07-29T02:03:33.186 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/136/17' 2023-07-29T02:03:33.186 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/136' 2023-07-29T02:03:33.186 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/125/19' 2023-07-29T02:03:33.186 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/125/15' 2023-07-29T02:03:33.186 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/125/20' 2023-07-29T02:03:33.187 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/125/12' 2023-07-29T02:03:33.187 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/125/10' 2023-07-29T02:03:33.187 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/125/11' 2023-07-29T02:03:33.187 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/125/16' 2023-07-29T02:03:33.187 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/125/14' 2023-07-29T02:03:33.187 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/125/18' 2023-07-29T02:03:33.187 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/125/13' 2023-07-29T02:03:33.187 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/125/17' 2023-07-29T02:03:33.188 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/125' 2023-07-29T02:03:33.188 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/194/19' 2023-07-29T02:03:33.188 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/194/15' 2023-07-29T02:03:33.188 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/194/20' 2023-07-29T02:03:33.188 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/194/12' 2023-07-29T02:03:33.188 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/194/10' 2023-07-29T02:03:33.188 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/194/11' 2023-07-29T02:03:33.188 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/194/16' 2023-07-29T02:03:33.189 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/194/14' 2023-07-29T02:03:33.189 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/194/18' 2023-07-29T02:03:33.189 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/194/13' 2023-07-29T02:03:33.189 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/194/17' 2023-07-29T02:03:33.189 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/194' 2023-07-29T02:03:33.189 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/119/19' 2023-07-29T02:03:33.189 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/119/15' 2023-07-29T02:03:33.190 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/119/20' 2023-07-29T02:03:33.190 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/119/12' 2023-07-29T02:03:33.190 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/119/10' 2023-07-29T02:03:33.190 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/119/11' 2023-07-29T02:03:33.190 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/119/16' 2023-07-29T02:03:33.190 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/119/14' 2023-07-29T02:03:33.190 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/119/18' 2023-07-29T02:03:33.190 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/119/13' 2023-07-29T02:03:33.191 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/119/17' 2023-07-29T02:03:33.191 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/119' 2023-07-29T02:03:33.191 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/157/19' 2023-07-29T02:03:33.191 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/157/15' 2023-07-29T02:03:33.191 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/157/20' 2023-07-29T02:03:33.191 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/157/12' 2023-07-29T02:03:33.191 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/157/10' 2023-07-29T02:03:33.191 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/157/11' 2023-07-29T02:03:33.192 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/157/16' 2023-07-29T02:03:33.192 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/157/14' 2023-07-29T02:03:33.192 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/157/18' 2023-07-29T02:03:33.192 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/157/13' 2023-07-29T02:03:33.192 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/157/17' 2023-07-29T02:03:33.192 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/157' 2023-07-29T02:03:33.192 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/172/19' 2023-07-29T02:03:33.192 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/172/15' 2023-07-29T02:03:33.193 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/172/20' 2023-07-29T02:03:33.193 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/172/12' 2023-07-29T02:03:33.193 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/172/10' 2023-07-29T02:03:33.193 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/172/11' 2023-07-29T02:03:33.193 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/172/16' 2023-07-29T02:03:33.193 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/172/14' 2023-07-29T02:03:33.193 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/172/18' 2023-07-29T02:03:33.193 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/172/13' 2023-07-29T02:03:33.194 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/172/17' 2023-07-29T02:03:33.194 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/172' 2023-07-29T02:03:33.194 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/186/19' 2023-07-29T02:03:33.194 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/186/15' 2023-07-29T02:03:33.194 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/186/20' 2023-07-29T02:03:33.194 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/186/12' 2023-07-29T02:03:33.194 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/186/10' 2023-07-29T02:03:33.194 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/186/11' 2023-07-29T02:03:33.195 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/186/16' 2023-07-29T02:03:33.195 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/186/14' 2023-07-29T02:03:33.195 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/186/18' 2023-07-29T02:03:33.195 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/186/13' 2023-07-29T02:03:33.195 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/186/17' 2023-07-29T02:03:33.195 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/186' 2023-07-29T02:03:33.195 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/190/19' 2023-07-29T02:03:33.196 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/190/15' 2023-07-29T02:03:33.196 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/190/20' 2023-07-29T02:03:33.196 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/190/12' 2023-07-29T02:03:33.196 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/190/10' 2023-07-29T02:03:33.196 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/190/11' 2023-07-29T02:03:33.196 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/190/16' 2023-07-29T02:03:33.196 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/190/14' 2023-07-29T02:03:33.454 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/190/18' 2023-07-29T02:03:33.454 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/190/13' 2023-07-29T02:03:33.454 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/190/17' 2023-07-29T02:03:33.454 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/190' 2023-07-29T02:03:33.455 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/104/19' 2023-07-29T02:03:33.455 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/104/15' 2023-07-29T02:03:33.455 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/104/20' 2023-07-29T02:03:33.455 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/104/12' 2023-07-29T02:03:33.455 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/104/10' 2023-07-29T02:03:33.455 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/104/11' 2023-07-29T02:03:33.455 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/104/16' 2023-07-29T02:03:33.455 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/104/14' 2023-07-29T02:03:33.456 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/104/18' 2023-07-29T02:03:33.456 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/104/13' 2023-07-29T02:03:33.456 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/104/17' 2023-07-29T02:03:33.456 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/104' 2023-07-29T02:03:33.456 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/164/19' 2023-07-29T02:03:33.456 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/164/15' 2023-07-29T02:03:33.456 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/164/20' 2023-07-29T02:03:33.457 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/164/12' 2023-07-29T02:03:33.457 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/164/10' 2023-07-29T02:03:33.457 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/164/11' 2023-07-29T02:03:33.457 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/164/16' 2023-07-29T02:03:33.457 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/164/14' 2023-07-29T02:03:33.457 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/164/18' 2023-07-29T02:03:33.457 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/164/13' 2023-07-29T02:03:33.457 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/164/17' 2023-07-29T02:03:33.458 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/164' 2023-07-29T02:03:33.458 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/112/19' 2023-07-29T02:03:33.458 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/112/15' 2023-07-29T02:03:33.458 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/112/20' 2023-07-29T02:03:33.458 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/112/12' 2023-07-29T02:03:33.458 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/112/10' 2023-07-29T02:03:33.458 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/112/11' 2023-07-29T02:03:33.458 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/112/16' 2023-07-29T02:03:33.459 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/112/14' 2023-07-29T02:03:33.459 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/112/18' 2023-07-29T02:03:33.459 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/112/13' 2023-07-29T02:03:33.459 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/112/17' 2023-07-29T02:03:33.459 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/112' 2023-07-29T02:03:33.459 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/100/19' 2023-07-29T02:03:33.459 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/100/15' 2023-07-29T02:03:33.459 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/100/20' 2023-07-29T02:03:33.460 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/100/12' 2023-07-29T02:03:33.460 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/100/10' 2023-07-29T02:03:33.460 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/100/11' 2023-07-29T02:03:33.460 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/100/16' 2023-07-29T02:03:33.460 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/100/14' 2023-07-29T02:03:33.460 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/100/18' 2023-07-29T02:03:33.460 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/100/13' 2023-07-29T02:03:33.461 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/100/17' 2023-07-29T02:03:33.461 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/100' 2023-07-29T02:03:33.461 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/134/19' 2023-07-29T02:03:33.461 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/134/15' 2023-07-29T02:03:33.461 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/134/20' 2023-07-29T02:03:33.461 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/134/12' 2023-07-29T02:03:33.461 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/134/10' 2023-07-29T02:03:33.461 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/134/11' 2023-07-29T02:03:33.462 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/134/16' 2023-07-29T02:03:33.462 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/134/14' 2023-07-29T02:03:33.462 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/134/18' 2023-07-29T02:03:33.462 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/134/13' 2023-07-29T02:03:33.462 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/134/17' 2023-07-29T02:03:33.462 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/134' 2023-07-29T02:03:33.462 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/115/19' 2023-07-29T02:03:33.462 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/115/15' 2023-07-29T02:03:33.463 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/115/20' 2023-07-29T02:03:33.463 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/115/12' 2023-07-29T02:03:33.463 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/115/10' 2023-07-29T02:03:33.463 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/115/11' 2023-07-29T02:03:33.463 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/115/16' 2023-07-29T02:03:33.463 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/115/14' 2023-07-29T02:03:33.463 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/115/18' 2023-07-29T02:03:33.463 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/115/13' 2023-07-29T02:03:33.464 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/115/17' 2023-07-29T02:03:33.464 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/115' 2023-07-29T02:03:33.464 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/116/19' 2023-07-29T02:03:33.464 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/116/15' 2023-07-29T02:03:33.464 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/116/20' 2023-07-29T02:03:33.464 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/116/12' 2023-07-29T02:03:33.464 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/116/10' 2023-07-29T02:03:33.464 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/116/11' 2023-07-29T02:03:33.465 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/116/16' 2023-07-29T02:03:33.465 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/116/14' 2023-07-29T02:03:33.465 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/116/18' 2023-07-29T02:03:33.465 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/116/13' 2023-07-29T02:03:33.465 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/116/17' 2023-07-29T02:03:33.465 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/116' 2023-07-29T02:03:33.465 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/195/19' 2023-07-29T02:03:33.465 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/195/15' 2023-07-29T02:03:33.466 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/195/20' 2023-07-29T02:03:33.467 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/195/12' 2023-07-29T02:03:33.467 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/195/10' 2023-07-29T02:03:33.467 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/195/11' 2023-07-29T02:03:33.467 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/195/16' 2023-07-29T02:03:33.467 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/195/14' 2023-07-29T02:03:33.467 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/195/18' 2023-07-29T02:03:33.467 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/195/13' 2023-07-29T02:03:33.468 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/195/17' 2023-07-29T02:03:33.468 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/195' 2023-07-29T02:03:33.468 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/138/19' 2023-07-29T02:03:33.468 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/138/15' 2023-07-29T02:03:33.468 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/138/20' 2023-07-29T02:03:33.468 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/138/12' 2023-07-29T02:03:33.468 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/138/10' 2023-07-29T02:03:33.469 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/138/11' 2023-07-29T02:03:33.469 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/138/16' 2023-07-29T02:03:33.469 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/138/14' 2023-07-29T02:03:33.469 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/138/18' 2023-07-29T02:03:33.735 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/138/13' 2023-07-29T02:03:33.735 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/138/17' 2023-07-29T02:03:33.736 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/138' 2023-07-29T02:03:33.736 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/135/19' 2023-07-29T02:03:33.736 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/135/15' 2023-07-29T02:03:33.736 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/135/20' 2023-07-29T02:03:33.736 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/135/12' 2023-07-29T02:03:33.736 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/135/10' 2023-07-29T02:03:33.737 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/135/11' 2023-07-29T02:03:33.737 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/135/16' 2023-07-29T02:03:33.737 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/135/14' 2023-07-29T02:03:33.737 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/135/18' 2023-07-29T02:03:33.737 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/135/13' 2023-07-29T02:03:33.737 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/135/17' 2023-07-29T02:03:33.737 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/135' 2023-07-29T02:03:33.738 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/117/19' 2023-07-29T02:03:33.738 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/117/15' 2023-07-29T02:03:33.738 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/117/20' 2023-07-29T02:03:33.738 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/117/12' 2023-07-29T02:03:33.738 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/117/10' 2023-07-29T02:03:33.738 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/117/11' 2023-07-29T02:03:33.738 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/117/16' 2023-07-29T02:03:33.738 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/117/14' 2023-07-29T02:03:33.739 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/117/18' 2023-07-29T02:03:33.739 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/117/13' 2023-07-29T02:03:33.739 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/117/17' 2023-07-29T02:03:33.739 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/117' 2023-07-29T02:03:33.739 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/143/19' 2023-07-29T02:03:33.739 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/143/15' 2023-07-29T02:03:33.739 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/143/20' 2023-07-29T02:03:33.739 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/143/12' 2023-07-29T02:03:33.740 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/143/10' 2023-07-29T02:03:33.740 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/143/11' 2023-07-29T02:03:33.740 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/143/16' 2023-07-29T02:03:33.740 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/143/14' 2023-07-29T02:03:33.740 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/143/18' 2023-07-29T02:03:33.740 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/143/13' 2023-07-29T02:03:33.740 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/143/17' 2023-07-29T02:03:33.741 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/143' 2023-07-29T02:03:33.741 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/180/19' 2023-07-29T02:03:33.741 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/180/15' 2023-07-29T02:03:33.741 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/180/20' 2023-07-29T02:03:33.741 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/180/12' 2023-07-29T02:03:33.741 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/180/10' 2023-07-29T02:03:33.741 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/180/11' 2023-07-29T02:03:33.741 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/180/16' 2023-07-29T02:03:33.742 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/180/14' 2023-07-29T02:03:33.742 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/180/18' 2023-07-29T02:03:33.742 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/180/13' 2023-07-29T02:03:33.742 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/180/17' 2023-07-29T02:03:33.742 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/180' 2023-07-29T02:03:33.742 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/126/19' 2023-07-29T02:03:33.742 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/126/15' 2023-07-29T02:03:33.742 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/126/20' 2023-07-29T02:03:33.743 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/126/12' 2023-07-29T02:03:33.743 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/126/10' 2023-07-29T02:03:33.743 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/126/11' 2023-07-29T02:03:33.743 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/126/16' 2023-07-29T02:03:33.743 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/126/14' 2023-07-29T02:03:33.743 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/126/18' 2023-07-29T02:03:33.743 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/126/13' 2023-07-29T02:03:33.744 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/126/17' 2023-07-29T02:03:33.744 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/126' 2023-07-29T02:03:33.744 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/161/19' 2023-07-29T02:03:33.744 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/161/15' 2023-07-29T02:03:33.745 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/161/20' 2023-07-29T02:03:33.745 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/161/12' 2023-07-29T02:03:33.745 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/161/10' 2023-07-29T02:03:33.745 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/161/11' 2023-07-29T02:03:33.745 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/161/16' 2023-07-29T02:03:33.745 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/161/14' 2023-07-29T02:03:33.745 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/161/18' 2023-07-29T02:03:33.745 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/161/13' 2023-07-29T02:03:33.746 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/161/17' 2023-07-29T02:03:33.746 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/161' 2023-07-29T02:03:33.746 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/176/19' 2023-07-29T02:03:33.746 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/176/15' 2023-07-29T02:03:33.746 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/176/20' 2023-07-29T02:03:33.746 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/176/12' 2023-07-29T02:03:33.746 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/176/10' 2023-07-29T02:03:33.747 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/176/11' 2023-07-29T02:03:33.747 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/176/16' 2023-07-29T02:03:33.747 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/176/14' 2023-07-29T02:03:33.747 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/176/18' 2023-07-29T02:03:33.747 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/176/13' 2023-07-29T02:03:33.748 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/176/17' 2023-07-29T02:03:33.748 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/176' 2023-07-29T02:03:33.748 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/111/19' 2023-07-29T02:03:33.748 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/111/15' 2023-07-29T02:03:33.748 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/111/20' 2023-07-29T02:03:33.748 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/111/12' 2023-07-29T02:03:33.748 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/111/10' 2023-07-29T02:03:33.749 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/111/11' 2023-07-29T02:03:33.749 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/111/16' 2023-07-29T02:03:33.749 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/111/14' 2023-07-29T02:03:33.749 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/111/18' 2023-07-29T02:03:33.749 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/111/13' 2023-07-29T02:03:33.749 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/111/17' 2023-07-29T02:03:33.749 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/111' 2023-07-29T02:03:33.750 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/191/19' 2023-07-29T02:03:33.750 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/191/15' 2023-07-29T02:03:33.750 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/191/20' 2023-07-29T02:03:33.750 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/191/12' 2023-07-29T02:03:33.750 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/191/10' 2023-07-29T02:03:33.750 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/191/11' 2023-07-29T02:03:33.750 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/191/16' 2023-07-29T02:03:33.751 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/191/14' 2023-07-29T02:03:33.751 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/191/18' 2023-07-29T02:03:33.751 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/191/13' 2023-07-29T02:03:34.100 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/191/17' 2023-07-29T02:03:34.100 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/191' 2023-07-29T02:03:34.100 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/184/19' 2023-07-29T02:03:34.100 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/184/15' 2023-07-29T02:03:34.100 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/184/20' 2023-07-29T02:03:34.101 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/184/12' 2023-07-29T02:03:34.101 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/184/10' 2023-07-29T02:03:34.101 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/184/11' 2023-07-29T02:03:34.101 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/184/16' 2023-07-29T02:03:34.101 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/184/14' 2023-07-29T02:03:34.101 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/184/18' 2023-07-29T02:03:34.101 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/184/13' 2023-07-29T02:03:34.101 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/184/17' 2023-07-29T02:03:34.102 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/184' 2023-07-29T02:03:34.102 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/192/19' 2023-07-29T02:03:34.102 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/192/15' 2023-07-29T02:03:34.102 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/192/20' 2023-07-29T02:03:34.102 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/192/12' 2023-07-29T02:03:34.102 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/192/10' 2023-07-29T02:03:34.102 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/192/11' 2023-07-29T02:03:34.102 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/192/16' 2023-07-29T02:03:34.103 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/192/14' 2023-07-29T02:03:34.103 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/192/18' 2023-07-29T02:03:34.103 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/192/13' 2023-07-29T02:03:34.103 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/192/17' 2023-07-29T02:03:34.103 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/192' 2023-07-29T02:03:34.103 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/103/19' 2023-07-29T02:03:34.103 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/103/15' 2023-07-29T02:03:34.103 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/103/20' 2023-07-29T02:03:34.104 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/103/12' 2023-07-29T02:03:34.104 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/103/10' 2023-07-29T02:03:34.104 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/103/11' 2023-07-29T02:03:34.104 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/103/16' 2023-07-29T02:03:34.104 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/103/14' 2023-07-29T02:03:34.104 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/103/18' 2023-07-29T02:03:34.104 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/103/13' 2023-07-29T02:03:34.105 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/103/17' 2023-07-29T02:03:34.105 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/103' 2023-07-29T02:03:34.105 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/128/19' 2023-07-29T02:03:34.105 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/128/15' 2023-07-29T02:03:34.105 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/128/20' 2023-07-29T02:03:34.105 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/128/12' 2023-07-29T02:03:34.105 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/128/10' 2023-07-29T02:03:34.105 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/128/11' 2023-07-29T02:03:34.106 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/128/16' 2023-07-29T02:03:34.106 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/128/14' 2023-07-29T02:03:34.106 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/128/18' 2023-07-29T02:03:34.106 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/128/13' 2023-07-29T02:03:34.106 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/128/17' 2023-07-29T02:03:34.106 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/128' 2023-07-29T02:03:34.106 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/144/19' 2023-07-29T02:03:34.106 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/144/15' 2023-07-29T02:03:34.107 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/144/20' 2023-07-29T02:03:34.107 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/144/12' 2023-07-29T02:03:34.107 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/144/10' 2023-07-29T02:03:34.107 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/144/11' 2023-07-29T02:03:34.107 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/144/16' 2023-07-29T02:03:34.107 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/144/14' 2023-07-29T02:03:34.107 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/144/18' 2023-07-29T02:03:34.107 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/144/13' 2023-07-29T02:03:34.108 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/144/17' 2023-07-29T02:03:34.108 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/144' 2023-07-29T02:03:34.108 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/146/19' 2023-07-29T02:03:34.108 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/146/15' 2023-07-29T02:03:34.108 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/146/20' 2023-07-29T02:03:34.108 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/146/12' 2023-07-29T02:03:34.108 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/146/10' 2023-07-29T02:03:34.109 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/146/11' 2023-07-29T02:03:34.109 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/146/16' 2023-07-29T02:03:34.109 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/146/14' 2023-07-29T02:03:34.109 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/146/18' 2023-07-29T02:03:34.109 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/146/13' 2023-07-29T02:03:34.109 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/146/17' 2023-07-29T02:03:34.109 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/146' 2023-07-29T02:03:34.109 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/141/19' 2023-07-29T02:03:34.110 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/141/15' 2023-07-29T02:03:34.110 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/141/20' 2023-07-29T02:03:34.110 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/141/12' 2023-07-29T02:03:34.110 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/141/10' 2023-07-29T02:03:34.110 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/141/11' 2023-07-29T02:03:34.110 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/141/16' 2023-07-29T02:03:34.110 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/141/14' 2023-07-29T02:03:34.110 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/141/18' 2023-07-29T02:03:34.111 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/141/13' 2023-07-29T02:03:34.111 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/141/17' 2023-07-29T02:03:34.111 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/141' 2023-07-29T02:03:34.111 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/182/19' 2023-07-29T02:03:34.111 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/182/15' 2023-07-29T02:03:34.111 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/182/20' 2023-07-29T02:03:34.111 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/182/12' 2023-07-29T02:03:34.111 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/182/10' 2023-07-29T02:03:34.112 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/182/11' 2023-07-29T02:03:34.112 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/182/16' 2023-07-29T02:03:34.112 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/182/14' 2023-07-29T02:03:34.112 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/182/18' 2023-07-29T02:03:34.112 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/182/13' 2023-07-29T02:03:34.112 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/182/17' 2023-07-29T02:03:34.112 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/182' 2023-07-29T02:03:34.112 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/107/19' 2023-07-29T02:03:34.113 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/107/15' 2023-07-29T02:03:34.113 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/107/20' 2023-07-29T02:03:34.113 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/107/12' 2023-07-29T02:03:34.113 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/107/10' 2023-07-29T02:03:34.113 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/107/11' 2023-07-29T02:03:34.113 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/107/16' 2023-07-29T02:03:34.113 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/107/14' 2023-07-29T02:03:34.113 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/107/18' 2023-07-29T02:03:34.114 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/107/13' 2023-07-29T02:03:34.114 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/107/17' 2023-07-29T02:03:34.334 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/107' 2023-07-29T02:03:34.334 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/178/19' 2023-07-29T02:03:34.334 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/178/15' 2023-07-29T02:03:34.335 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/178/20' 2023-07-29T02:03:34.335 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/178/12' 2023-07-29T02:03:34.335 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/178/10' 2023-07-29T02:03:34.335 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/178/11' 2023-07-29T02:03:34.335 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/178/16' 2023-07-29T02:03:34.335 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/178/14' 2023-07-29T02:03:34.335 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/178/18' 2023-07-29T02:03:34.336 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/178/13' 2023-07-29T02:03:34.336 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/178/17' 2023-07-29T02:03:34.336 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/178' 2023-07-29T02:03:34.336 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/156/19' 2023-07-29T02:03:34.336 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/156/15' 2023-07-29T02:03:34.336 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/156/20' 2023-07-29T02:03:34.336 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/156/12' 2023-07-29T02:03:34.337 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/156/10' 2023-07-29T02:03:34.337 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/156/11' 2023-07-29T02:03:34.337 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/156/16' 2023-07-29T02:03:34.337 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/156/14' 2023-07-29T02:03:34.337 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/156/18' 2023-07-29T02:03:34.337 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/156/13' 2023-07-29T02:03:34.337 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/156/17' 2023-07-29T02:03:34.337 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/156' 2023-07-29T02:03:34.338 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/131/19' 2023-07-29T02:03:34.338 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/131/15' 2023-07-29T02:03:34.338 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/131/20' 2023-07-29T02:03:34.338 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/131/12' 2023-07-29T02:03:34.338 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/131/10' 2023-07-29T02:03:34.338 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/131/11' 2023-07-29T02:03:34.338 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/131/16' 2023-07-29T02:03:34.339 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/131/14' 2023-07-29T02:03:34.339 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/131/18' 2023-07-29T02:03:34.339 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/131/13' 2023-07-29T02:03:34.339 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/131/17' 2023-07-29T02:03:34.339 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/131' 2023-07-29T02:03:34.339 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/123/19' 2023-07-29T02:03:34.339 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/123/15' 2023-07-29T02:03:34.339 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/123/20' 2023-07-29T02:03:34.340 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/123/12' 2023-07-29T02:03:34.340 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/123/10' 2023-07-29T02:03:34.340 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/123/11' 2023-07-29T02:03:34.340 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/123/16' 2023-07-29T02:03:34.340 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/123/14' 2023-07-29T02:03:34.340 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/123/18' 2023-07-29T02:03:34.340 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/123/13' 2023-07-29T02:03:34.341 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/123/17' 2023-07-29T02:03:34.341 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/123' 2023-07-29T02:03:34.341 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/160/19' 2023-07-29T02:03:34.341 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/160/15' 2023-07-29T02:03:34.341 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/160/20' 2023-07-29T02:03:34.341 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/160/12' 2023-07-29T02:03:34.341 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/160/10' 2023-07-29T02:03:34.342 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/160/11' 2023-07-29T02:03:34.342 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/160/16' 2023-07-29T02:03:34.342 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/160/14' 2023-07-29T02:03:34.342 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/160/18' 2023-07-29T02:03:34.342 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/160/13' 2023-07-29T02:03:34.342 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/160/17' 2023-07-29T02:03:34.342 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/160' 2023-07-29T02:03:34.342 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/165/19' 2023-07-29T02:03:34.343 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/165/15' 2023-07-29T02:03:34.343 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/165/20' 2023-07-29T02:03:34.343 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/165/12' 2023-07-29T02:03:34.343 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/165/10' 2023-07-29T02:03:34.343 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/165/11' 2023-07-29T02:03:34.343 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/165/16' 2023-07-29T02:03:34.343 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/165/14' 2023-07-29T02:03:34.343 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/165/18' 2023-07-29T02:03:34.344 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/165/13' 2023-07-29T02:03:34.344 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/165/17' 2023-07-29T02:03:34.344 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/165' 2023-07-29T02:03:34.344 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/101/19' 2023-07-29T02:03:34.344 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/101/15' 2023-07-29T02:03:34.344 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/101/20' 2023-07-29T02:03:34.345 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/101/12' 2023-07-29T02:03:34.345 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/101/10' 2023-07-29T02:03:34.345 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/101/11' 2023-07-29T02:03:34.345 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/101/16' 2023-07-29T02:03:34.345 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/101/14' 2023-07-29T02:03:34.345 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/101/18' 2023-07-29T02:03:34.345 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/101/13' 2023-07-29T02:03:34.346 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/101/17' 2023-07-29T02:03:34.346 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/101' 2023-07-29T02:03:34.346 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/148/19' 2023-07-29T02:03:34.346 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/148/15' 2023-07-29T02:03:34.346 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/148/20' 2023-07-29T02:03:34.346 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/148/12' 2023-07-29T02:03:34.346 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/148/10' 2023-07-29T02:03:34.346 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/148/11' 2023-07-29T02:03:34.347 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/148/16' 2023-07-29T02:03:34.347 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/148/14' 2023-07-29T02:03:34.347 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/148/18' 2023-07-29T02:03:34.347 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/148/13' 2023-07-29T02:03:34.347 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/148/17' 2023-07-29T02:03:34.347 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/148' 2023-07-29T02:03:34.347 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/168/19' 2023-07-29T02:03:34.347 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/168/15' 2023-07-29T02:03:34.348 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/168/20' 2023-07-29T02:03:34.348 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/168/12' 2023-07-29T02:03:34.348 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/168/10' 2023-07-29T02:03:34.348 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/168/11' 2023-07-29T02:03:34.348 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/168/16' 2023-07-29T02:03:34.348 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/168/14' 2023-07-29T02:03:34.348 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/168/18' 2023-07-29T02:03:34.349 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/168/13' 2023-07-29T02:03:34.349 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/168/17' 2023-07-29T02:03:34.349 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/168' 2023-07-29T02:03:34.575 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/179/19' 2023-07-29T02:03:34.575 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/179/15' 2023-07-29T02:03:34.575 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/179/20' 2023-07-29T02:03:34.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/179/12' 2023-07-29T02:03:34.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/179/10' 2023-07-29T02:03:34.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/179/11' 2023-07-29T02:03:34.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/179/16' 2023-07-29T02:03:34.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/179/14' 2023-07-29T02:03:34.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/179/18' 2023-07-29T02:03:34.576 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/179/13' 2023-07-29T02:03:34.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/179/17' 2023-07-29T02:03:34.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/179' 2023-07-29T02:03:34.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/132/19' 2023-07-29T02:03:34.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/132/15' 2023-07-29T02:03:34.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/132/20' 2023-07-29T02:03:34.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/132/12' 2023-07-29T02:03:34.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/132/10' 2023-07-29T02:03:34.577 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/132/11' 2023-07-29T02:03:34.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/132/16' 2023-07-29T02:03:34.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/132/14' 2023-07-29T02:03:34.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/132/18' 2023-07-29T02:03:34.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/132/13' 2023-07-29T02:03:34.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/132/17' 2023-07-29T02:03:34.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/132' 2023-07-29T02:03:34.578 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/199/19' 2023-07-29T02:03:34.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/199/15' 2023-07-29T02:03:34.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/199/20' 2023-07-29T02:03:34.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/199/12' 2023-07-29T02:03:34.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/199/10' 2023-07-29T02:03:34.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/199/11' 2023-07-29T02:03:34.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/199/16' 2023-07-29T02:03:34.579 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/199/14' 2023-07-29T02:03:34.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/199/18' 2023-07-29T02:03:34.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/199/13' 2023-07-29T02:03:34.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/199/17' 2023-07-29T02:03:34.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/199' 2023-07-29T02:03:34.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/163/19' 2023-07-29T02:03:34.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/163/15' 2023-07-29T02:03:34.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/163/20' 2023-07-29T02:03:34.580 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/163/12' 2023-07-29T02:03:34.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/163/10' 2023-07-29T02:03:34.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/163/11' 2023-07-29T02:03:34.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/163/16' 2023-07-29T02:03:34.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/163/14' 2023-07-29T02:03:34.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/163/18' 2023-07-29T02:03:34.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/163/13' 2023-07-29T02:03:34.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/163/17' 2023-07-29T02:03:34.581 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/163' 2023-07-29T02:03:34.582 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/153/19' 2023-07-29T02:03:34.582 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/153/15' 2023-07-29T02:03:34.582 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/153/20' 2023-07-29T02:03:34.582 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/153/12' 2023-07-29T02:03:34.582 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/153/10' 2023-07-29T02:03:34.582 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/153/11' 2023-07-29T02:03:34.582 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/153/16' 2023-07-29T02:03:34.582 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/153/14' 2023-07-29T02:03:34.583 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/153/18' 2023-07-29T02:03:34.583 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/153/13' 2023-07-29T02:03:34.583 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/153/17' 2023-07-29T02:03:34.583 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/153' 2023-07-29T02:03:34.583 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/122/19' 2023-07-29T02:03:34.583 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/122/15' 2023-07-29T02:03:34.583 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/122/20' 2023-07-29T02:03:34.583 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/122/12' 2023-07-29T02:03:34.584 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/122/10' 2023-07-29T02:03:34.584 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/122/11' 2023-07-29T02:03:34.584 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/122/16' 2023-07-29T02:03:34.584 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/122/14' 2023-07-29T02:03:34.584 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/122/18' 2023-07-29T02:03:34.584 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/122/13' 2023-07-29T02:03:34.584 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/122/17' 2023-07-29T02:03:34.585 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/122' 2023-07-29T02:03:34.585 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/162/19' 2023-07-29T02:03:34.585 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/162/15' 2023-07-29T02:03:34.585 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/162/20' 2023-07-29T02:03:34.585 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/162/12' 2023-07-29T02:03:34.585 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/162/10' 2023-07-29T02:03:34.585 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/162/11' 2023-07-29T02:03:34.585 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/162/16' 2023-07-29T02:03:34.586 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/162/14' 2023-07-29T02:03:34.586 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/162/18' 2023-07-29T02:03:34.586 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/162/13' 2023-07-29T02:03:34.586 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/162/17' 2023-07-29T02:03:34.586 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/162' 2023-07-29T02:03:34.586 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/197/19' 2023-07-29T02:03:34.586 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/197/15' 2023-07-29T02:03:34.586 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/197/20' 2023-07-29T02:03:34.587 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/197/12' 2023-07-29T02:03:34.587 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/197/10' 2023-07-29T02:03:34.587 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/197/11' 2023-07-29T02:03:34.587 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/197/16' 2023-07-29T02:03:34.587 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/197/14' 2023-07-29T02:03:34.587 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/197/18' 2023-07-29T02:03:34.587 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/197/13' 2023-07-29T02:03:34.587 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/197/17' 2023-07-29T02:03:34.588 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/197' 2023-07-29T02:03:34.588 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/113/19' 2023-07-29T02:03:34.588 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/113/15' 2023-07-29T02:03:34.588 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/113/20' 2023-07-29T02:03:34.588 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/113/12' 2023-07-29T02:03:34.588 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/113/10' 2023-07-29T02:03:34.588 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/113/11' 2023-07-29T02:03:34.588 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/113/16' 2023-07-29T02:03:34.589 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/113/14' 2023-07-29T02:03:34.589 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/113/18' 2023-07-29T02:03:34.589 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/113/13' 2023-07-29T02:03:34.589 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/113/17' 2023-07-29T02:03:34.589 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/113' 2023-07-29T02:03:34.589 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/152/19' 2023-07-29T02:03:34.790 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/152/15' 2023-07-29T02:03:34.790 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/152/20' 2023-07-29T02:03:34.790 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/152/12' 2023-07-29T02:03:34.790 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/152/10' 2023-07-29T02:03:34.790 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/152/11' 2023-07-29T02:03:34.791 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/152/16' 2023-07-29T02:03:34.791 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/152/14' 2023-07-29T02:03:34.791 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/152/18' 2023-07-29T02:03:34.791 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/152/13' 2023-07-29T02:03:34.791 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/152/17' 2023-07-29T02:03:34.791 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/152' 2023-07-29T02:03:34.791 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/121/19' 2023-07-29T02:03:34.792 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/121/15' 2023-07-29T02:03:34.792 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/121/20' 2023-07-29T02:03:34.792 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/121/12' 2023-07-29T02:03:34.792 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/121/10' 2023-07-29T02:03:34.792 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/121/11' 2023-07-29T02:03:34.792 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/121/16' 2023-07-29T02:03:34.792 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/121/14' 2023-07-29T02:03:34.793 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/121/18' 2023-07-29T02:03:34.793 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/121/13' 2023-07-29T02:03:34.793 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/121/17' 2023-07-29T02:03:34.793 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/121' 2023-07-29T02:03:34.793 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/118/19' 2023-07-29T02:03:34.793 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/118/15' 2023-07-29T02:03:34.793 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/118/20' 2023-07-29T02:03:34.793 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/118/12' 2023-07-29T02:03:34.794 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/118/10' 2023-07-29T02:03:34.794 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/118/11' 2023-07-29T02:03:34.794 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/118/16' 2023-07-29T02:03:34.794 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/118/14' 2023-07-29T02:03:34.794 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/118/18' 2023-07-29T02:03:34.794 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/118/13' 2023-07-29T02:03:34.794 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/118/17' 2023-07-29T02:03:34.794 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/118' 2023-07-29T02:03:34.795 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/196/19' 2023-07-29T02:03:34.795 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/196/15' 2023-07-29T02:03:34.795 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/196/20' 2023-07-29T02:03:34.795 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/196/12' 2023-07-29T02:03:34.795 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/196/10' 2023-07-29T02:03:34.795 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/196/11' 2023-07-29T02:03:34.795 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/196/16' 2023-07-29T02:03:34.796 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/196/14' 2023-07-29T02:03:34.796 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/196/18' 2023-07-29T02:03:34.796 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/196/13' 2023-07-29T02:03:34.796 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/196/17' 2023-07-29T02:03:34.796 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/196' 2023-07-29T02:03:34.796 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/124/19' 2023-07-29T02:03:34.796 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/124/15' 2023-07-29T02:03:34.797 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/124/20' 2023-07-29T02:03:34.797 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/124/12' 2023-07-29T02:03:34.797 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/124/10' 2023-07-29T02:03:34.797 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/124/11' 2023-07-29T02:03:34.797 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/124/16' 2023-07-29T02:03:34.797 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/124/14' 2023-07-29T02:03:34.797 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/124/18' 2023-07-29T02:03:34.797 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/124/13' 2023-07-29T02:03:34.798 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/124/17' 2023-07-29T02:03:34.798 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/124' 2023-07-29T02:03:34.798 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/188/19' 2023-07-29T02:03:34.798 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/188/15' 2023-07-29T02:03:34.798 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/188/20' 2023-07-29T02:03:34.798 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/188/12' 2023-07-29T02:03:34.798 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/188/10' 2023-07-29T02:03:34.798 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/188/11' 2023-07-29T02:03:34.799 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/188/16' 2023-07-29T02:03:34.799 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/188/14' 2023-07-29T02:03:34.799 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/188/18' 2023-07-29T02:03:34.799 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/188/13' 2023-07-29T02:03:34.799 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/188/17' 2023-07-29T02:03:34.800 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/188' 2023-07-29T02:03:34.800 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/145/19' 2023-07-29T02:03:34.800 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/145/15' 2023-07-29T02:03:34.800 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/145/20' 2023-07-29T02:03:34.800 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/145/12' 2023-07-29T02:03:34.800 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/145/10' 2023-07-29T02:03:34.800 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/145/11' 2023-07-29T02:03:34.800 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/145/16' 2023-07-29T02:03:34.801 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/145/14' 2023-07-29T02:03:34.801 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/145/18' 2023-07-29T02:03:34.801 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/145/13' 2023-07-29T02:03:34.801 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/145/17' 2023-07-29T02:03:34.801 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/145' 2023-07-29T02:03:34.801 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/130/19' 2023-07-29T02:03:34.801 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/130/15' 2023-07-29T02:03:34.801 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/130/20' 2023-07-29T02:03:34.802 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/130/12' 2023-07-29T02:03:34.802 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/130/10' 2023-07-29T02:03:34.802 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/130/11' 2023-07-29T02:03:34.802 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/130/16' 2023-07-29T02:03:34.802 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/130/14' 2023-07-29T02:03:34.802 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/130/18' 2023-07-29T02:03:34.802 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/130/13' 2023-07-29T02:03:34.803 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/130/17' 2023-07-29T02:03:34.803 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/130' 2023-07-29T02:03:34.803 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/193/19' 2023-07-29T02:03:34.803 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/193/15' 2023-07-29T02:03:34.803 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/193/20' 2023-07-29T02:03:34.803 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/193/12' 2023-07-29T02:03:34.803 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/193/10' 2023-07-29T02:03:34.803 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/193/11' 2023-07-29T02:03:34.804 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/193/16' 2023-07-29T02:03:34.804 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/193/14' 2023-07-29T02:03:34.804 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/193/18' 2023-07-29T02:03:34.804 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/193/13' 2023-07-29T02:03:34.804 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/193/17' 2023-07-29T02:03:34.804 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/193' 2023-07-29T02:03:34.804 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/175/19' 2023-07-29T02:03:34.805 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/175/15' 2023-07-29T02:03:35.020 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/175/20' 2023-07-29T02:03:35.021 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/175/12' 2023-07-29T02:03:35.021 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/175/10' 2023-07-29T02:03:35.021 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/175/11' 2023-07-29T02:03:35.021 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/175/16' 2023-07-29T02:03:35.021 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/175/14' 2023-07-29T02:03:35.021 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/175/18' 2023-07-29T02:03:35.022 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/175/13' 2023-07-29T02:03:35.022 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/175/17' 2023-07-29T02:03:35.022 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/175' 2023-07-29T02:03:35.022 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/181/19' 2023-07-29T02:03:35.022 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/181/15' 2023-07-29T02:03:35.022 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/181/20' 2023-07-29T02:03:35.022 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/181/12' 2023-07-29T02:03:35.022 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/181/10' 2023-07-29T02:03:35.023 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/181/11' 2023-07-29T02:03:35.023 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/181/16' 2023-07-29T02:03:35.023 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/181/14' 2023-07-29T02:03:35.023 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/181/18' 2023-07-29T02:03:35.023 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/181/13' 2023-07-29T02:03:35.023 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/181/17' 2023-07-29T02:03:35.023 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/181' 2023-07-29T02:03:35.023 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/127/19' 2023-07-29T02:03:35.024 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/127/15' 2023-07-29T02:03:35.024 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/127/20' 2023-07-29T02:03:35.024 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/127/12' 2023-07-29T02:03:35.024 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/127/10' 2023-07-29T02:03:35.024 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/127/11' 2023-07-29T02:03:35.024 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/127/16' 2023-07-29T02:03:35.024 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/127/14' 2023-07-29T02:03:35.025 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/127/18' 2023-07-29T02:03:35.025 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/127/13' 2023-07-29T02:03:35.025 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/127/17' 2023-07-29T02:03:35.025 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/127' 2023-07-29T02:03:35.025 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/108/19' 2023-07-29T02:03:35.025 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/108/15' 2023-07-29T02:03:35.025 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/108/20' 2023-07-29T02:03:35.025 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/108/12' 2023-07-29T02:03:35.026 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/108/10' 2023-07-29T02:03:35.026 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/108/11' 2023-07-29T02:03:35.026 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/108/16' 2023-07-29T02:03:35.026 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/108/14' 2023-07-29T02:03:35.026 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/108/18' 2023-07-29T02:03:35.026 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/108/13' 2023-07-29T02:03:35.026 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/108/17' 2023-07-29T02:03:35.026 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/108' 2023-07-29T02:03:35.027 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/183/19' 2023-07-29T02:03:35.027 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/183/15' 2023-07-29T02:03:35.027 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/183/20' 2023-07-29T02:03:35.027 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/183/12' 2023-07-29T02:03:35.027 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/183/10' 2023-07-29T02:03:35.027 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/183/11' 2023-07-29T02:03:35.027 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/183/16' 2023-07-29T02:03:35.027 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/183/14' 2023-07-29T02:03:35.028 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/183/18' 2023-07-29T02:03:35.028 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/183/13' 2023-07-29T02:03:35.028 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/183/17' 2023-07-29T02:03:35.028 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/183' 2023-07-29T02:03:35.028 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/177/19' 2023-07-29T02:03:35.028 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/177/15' 2023-07-29T02:03:35.028 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/177/20' 2023-07-29T02:03:35.029 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/177/12' 2023-07-29T02:03:35.029 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/177/10' 2023-07-29T02:03:35.029 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/177/11' 2023-07-29T02:03:35.029 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/177/16' 2023-07-29T02:03:35.029 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/177/14' 2023-07-29T02:03:35.029 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/177/18' 2023-07-29T02:03:35.029 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/177/13' 2023-07-29T02:03:35.029 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/177/17' 2023-07-29T02:03:35.030 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/177' 2023-07-29T02:03:35.030 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/169/19' 2023-07-29T02:03:35.030 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/169/15' 2023-07-29T02:03:35.030 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/169/20' 2023-07-29T02:03:35.030 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/169/12' 2023-07-29T02:03:35.030 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/169/10' 2023-07-29T02:03:35.030 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/169/11' 2023-07-29T02:03:35.030 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/169/16' 2023-07-29T02:03:35.031 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/169/14' 2023-07-29T02:03:35.031 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/169/18' 2023-07-29T02:03:35.031 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/169/13' 2023-07-29T02:03:35.031 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/169/17' 2023-07-29T02:03:35.031 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/169' 2023-07-29T02:03:35.031 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/154/19' 2023-07-29T02:03:35.032 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/154/15' 2023-07-29T02:03:35.032 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/154/20' 2023-07-29T02:03:35.032 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/154/12' 2023-07-29T02:03:35.032 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/154/10' 2023-07-29T02:03:35.033 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/154/11' 2023-07-29T02:03:35.033 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/154/16' 2023-07-29T02:03:35.033 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/154/14' 2023-07-29T02:03:35.034 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/154/18' 2023-07-29T02:03:35.034 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/154/13' 2023-07-29T02:03:35.034 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/154/17' 2023-07-29T02:03:35.034 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/154' 2023-07-29T02:03:35.035 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/171/19' 2023-07-29T02:03:35.035 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/171/15' 2023-07-29T02:03:35.035 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/171/20' 2023-07-29T02:03:35.036 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/171/12' 2023-07-29T02:03:35.036 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/171/10' 2023-07-29T02:03:35.036 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/171/11' 2023-07-29T02:03:35.037 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/171/16' 2023-07-29T02:03:35.037 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/171/14' 2023-07-29T02:03:35.037 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/171/18' 2023-07-29T02:03:35.038 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/171/13' 2023-07-29T02:03:35.038 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/171/17' 2023-07-29T02:03:35.038 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/171' 2023-07-29T02:03:35.038 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/139/19' 2023-07-29T02:03:35.038 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/139/15' 2023-07-29T02:03:35.039 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/139/20' 2023-07-29T02:03:35.114 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/139/12' 2023-07-29T02:03:35.114 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/139/10' 2023-07-29T02:03:35.114 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/139/11' 2023-07-29T02:03:35.115 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/139/16' 2023-07-29T02:03:35.115 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/139/14' 2023-07-29T02:03:35.115 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/139/18' 2023-07-29T02:03:35.115 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/139/13' 2023-07-29T02:03:35.115 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/139/17' 2023-07-29T02:03:35.115 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/139' 2023-07-29T02:03:35.115 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/102/19' 2023-07-29T02:03:35.115 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/102/15' 2023-07-29T02:03:35.116 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/102/20' 2023-07-29T02:03:35.116 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/102/12' 2023-07-29T02:03:35.116 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/102/10' 2023-07-29T02:03:35.116 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/102/11' 2023-07-29T02:03:35.116 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/102/16' 2023-07-29T02:03:35.116 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/102/14' 2023-07-29T02:03:35.116 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/102/18' 2023-07-29T02:03:35.117 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/102/13' 2023-07-29T02:03:35.117 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/102/17' 2023-07-29T02:03:35.117 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/102' 2023-07-29T02:03:35.117 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/129/19' 2023-07-29T02:03:35.117 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/129/15' 2023-07-29T02:03:35.117 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/129/20' 2023-07-29T02:03:35.117 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/129/12' 2023-07-29T02:03:35.117 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/129/10' 2023-07-29T02:03:35.118 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/129/11' 2023-07-29T02:03:35.118 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/129/16' 2023-07-29T02:03:35.118 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/129/14' 2023-07-29T02:03:35.118 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/129/18' 2023-07-29T02:03:35.118 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/129/13' 2023-07-29T02:03:35.118 INFO:tasks.workunit.client.0.smithi042.stdout:removed './copyofsnap1/test1/129/17' 2023-07-29T02:03:35.118 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1/129' 2023-07-29T02:03:35.119 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1/test1' 2023-07-29T02:03:35.119 INFO:tasks.workunit.client.0.smithi042.stdout:removed directory './copyofsnap1' 2023-07-29T02:03:35.119 INFO:tasks.workunit.client.0.smithi042.stdout:OK 2023-07-29T02:03:35.119 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-07-29T02:03:35.119 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-07-29T02:03:35.153 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-authwb.sh... 2023-07-29T02:03:35.154 DEBUG:teuthology.orchestra.run.smithi042:workunit test fs/snaps/snaptest-authwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0484097b0572e96f42cf6402cbe0ac8dcb046577 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-authwb.sh 2023-07-29T02:03:35.217 INFO:tasks.workunit.client.0.smithi042.stderr:+ set -e 2023-07-29T02:03:35.217 INFO:tasks.workunit.client.0.smithi042.stderr:+ touch foo 2023-07-29T02:03:35.218 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod +x foo 2023-07-29T02:03:35.219 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir .snap/s 2023-07-29T02:03:35.246 INFO:tasks.workunit.client.0.smithi042.stderr:+ find .snap/s/foo -executable 2023-07-29T02:03:35.246 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep foo 2023-07-29T02:03:35.251 INFO:tasks.workunit.client.0.smithi042.stdout:.snap/s/foo 2023-07-29T02:03:35.252 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir .snap/s 2023-07-29T02:03:35.263 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm foo 2023-07-29T02:03:35.266 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo OK 2023-07-29T02:03:35.267 INFO:tasks.workunit.client.0.smithi042.stdout:OK 2023-07-29T02:03:35.267 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-07-29T02:03:35.268 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-07-29T02:03:35.340 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-capwb.sh... 2023-07-29T02:03:35.341 DEBUG:teuthology.orchestra.run.smithi042:workunit test fs/snaps/snaptest-capwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0484097b0572e96f42cf6402cbe0ac8dcb046577 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-capwb.sh 2023-07-29T02:03:35.402 INFO:tasks.workunit.client.0.smithi042.stderr:+ set -e 2023-07-29T02:03:35.403 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir foo 2023-07-29T02:03:35.404 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo x 2023-07-29T02:03:35.404 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:36.332 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:03:36.334 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:03:47.595 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir foo/.snap/ss 2023-07-29T02:03:47.619 INFO:tasks.workunit.client.0.smithi042.stderr:+ ln foo/x foo/xx 2023-07-29T02:03:47.691 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat foo/.snap/ss/x 2023-07-29T02:03:50.493 INFO:tasks.workunit.client.0.smithi042.stdout:x 2023-07-29T02:03:50.493 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir foo/.snap/ss 2023-07-29T02:03:50.500 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo a 2023-07-29T02:03:50.501 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo b 2023-07-29T02:03:50.502 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir foo/.snap/s 2023-07-29T02:03:50.529 INFO:tasks.workunit.client.0.smithi042.stderr:++ cat foo/.snap/s/a 2023-07-29T02:03:50.548 INFO:tasks.workunit.client.0.smithi042.stderr:+ r=a 2023-07-29T02:03:50.549 INFO:tasks.workunit.client.0.smithi042.stderr:+ '[' -z a ']' 2023-07-29T02:03:50.549 INFO:tasks.workunit.client.0.smithi042.stderr:+ ln foo/b foo/b2 2023-07-29T02:03:50.550 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat foo/.snap/s/b 2023-07-29T02:03:50.558 INFO:tasks.workunit.client.0.smithi042.stdout:b 2023-07-29T02:03:50.559 INFO:tasks.workunit.client.0.smithi042.stdout:this used to hang: 2023-07-29T02:03:50.559 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'this used to hang:' 2023-07-29T02:03:50.559 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo more 2023-07-29T02:03:50.560 INFO:tasks.workunit.client.0.smithi042.stdout:oh, it didn't hang! good job. 2023-07-29T02:03:50.560 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'oh, it didn'\''t hang! good job.' 2023-07-29T02:03:50.560 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat foo/b 2023-07-29T02:03:50.561 INFO:tasks.workunit.client.0.smithi042.stdout:b 2023-07-29T02:03:50.561 INFO:tasks.workunit.client.0.smithi042.stdout:more 2023-07-29T02:03:50.561 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir foo/.snap/s 2023-07-29T02:03:50.564 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm -r foo 2023-07-29T02:03:50.578 INFO:tasks.workunit.client.0.smithi042.stdout:OK 2023-07-29T02:03:50.579 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo OK 2023-07-29T02:03:50.580 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-07-29T02:03:50.580 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-07-29T02:03:50.615 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-dir-rename.sh... 2023-07-29T02:03:50.615 DEBUG:teuthology.orchestra.run.smithi042:workunit test fs/snaps/snaptest-dir-rename.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0484097b0572e96f42cf6402cbe0ac8dcb046577 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-dir-rename.sh 2023-07-29T02:03:50.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ set -e 2023-07-29T02:03:50.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:50.679 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir .snap/bar 2023-07-29T02:03:50.705 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/foo 2023-07-29T02:03:50.741 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/foo 2023-07-29T02:03:50.755 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:50.758 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/bar/a 2023-07-29T02:03:50.761 INFO:tasks.workunit.client.0.smithi042.stdout: File: .snap/bar/a 2023-07-29T02:03:50.761 INFO:tasks.workunit.client.0.smithi042.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-07-29T02:03:50.761 INFO:tasks.workunit.client.0.smithi042.stdout:Device: 100001h/1048577d Inode: 1099511633797 Links: 2 2023-07-29T02:03:50.762 INFO:tasks.workunit.client.0.smithi042.stdout:Access: (0775/drwxrwxr-x) Uid: ( 1000/ ubuntu) Gid: ( 1265/ ubuntu) 2023-07-29T02:03:50.762 INFO:tasks.workunit.client.0.smithi042.stdout:Context: unconfined_u:object_r:cephfs_t:s0 2023-07-29T02:03:50.762 INFO:tasks.workunit.client.0.smithi042.stdout:Access: 2023-07-29 02:03:50.694487162 +0000 2023-07-29T02:03:50.762 INFO:tasks.workunit.client.0.smithi042.stdout:Modify: 2023-07-29 02:03:50.694487162 +0000 2023-07-29T02:03:50.762 INFO:tasks.workunit.client.0.smithi042.stdout:Change: 2023-07-29 02:03:50.694487162 +0000 2023-07-29T02:03:50.762 INFO:tasks.workunit.client.0.smithi042.stdout: Birth: 2023-07-29 02:03:50.694487162 +0000 2023-07-29T02:03:50.763 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir .snap/bar 2023-07-29T02:03:50.768 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo OK 2023-07-29T02:03:50.769 INFO:tasks.workunit.client.0.smithi042.stdout:OK 2023-07-29T02:03:50.769 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-07-29T02:03:50.769 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-07-29T02:03:50.839 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-double-null.sh... 2023-07-29T02:03:50.839 DEBUG:teuthology.orchestra.run.smithi042:workunit test fs/snaps/snaptest-double-null.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0484097b0572e96f42cf6402cbe0ac8dcb046577 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-double-null.sh 2023-07-29T02:03:50.901 INFO:tasks.workunit.client.0.smithi042.stderr:+ set -e 2023-07-29T02:03:50.904 INFO:tasks.workunit.client.0.smithi042.stderr:++ seq 1 20 2023-07-29T02:03:50.905 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 20` 2023-07-29T02:03:50.906 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:50.906 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/one 2023-07-29T02:03:50.906 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat 2023-07-29T02:03:50.931 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/two 2023-07-29T02:03:50.964 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod 777 a/foo 2023-07-29T02:03:50.965 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:51.101 INFO:tasks.workunit.client.0.smithi042.stderr:+ ps 2023-07-29T02:03:51.127 INFO:tasks.workunit.client.0.smithi042.stdout: PID TTY TIME CMD 2023-07-29T02:03:51.128 INFO:tasks.workunit.client.0.smithi042.stdout: 1892 ? 00:00:00 systemd 2023-07-29T02:03:51.128 INFO:tasks.workunit.client.0.smithi042.stdout: 1895 ? 00:00:00 (sd-pam) 2023-07-29T02:03:51.128 INFO:tasks.workunit.client.0.smithi042.stdout: 87098 ? 00:00:00 sshd 2023-07-29T02:03:51.128 INFO:tasks.workunit.client.0.smithi042.stdout: 146566 ? 00:00:00 timeout 2023-07-29T02:03:51.128 INFO:tasks.workunit.client.0.smithi042.stdout: 146587 ? 00:00:00 snaptest-double 2023-07-29T02:03:51.129 INFO:tasks.workunit.client.0.smithi042.stdout: 146595 ? 00:00:00 ps 2023-07-29T02:03:51.129 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/one a/.snap/two 2023-07-29T02:03:51.138 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm a/foo 2023-07-29T02:03:51.140 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:51.146 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 20` 2023-07-29T02:03:51.147 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:51.148 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/one 2023-07-29T02:03:51.148 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat 2023-07-29T02:03:51.176 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/two 2023-07-29T02:03:51.208 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod 777 a/foo 2023-07-29T02:03:51.212 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:51.332 INFO:tasks.workunit.client.0.smithi042.stderr:+ ps 2023-07-29T02:03:51.351 INFO:tasks.workunit.client.0.smithi042.stdout: PID TTY TIME CMD 2023-07-29T02:03:51.352 INFO:tasks.workunit.client.0.smithi042.stdout: 1892 ? 00:00:00 systemd 2023-07-29T02:03:51.352 INFO:tasks.workunit.client.0.smithi042.stdout: 1895 ? 00:00:00 (sd-pam) 2023-07-29T02:03:51.352 INFO:tasks.workunit.client.0.smithi042.stdout: 87098 ? 00:00:00 sshd 2023-07-29T02:03:51.352 INFO:tasks.workunit.client.0.smithi042.stdout: 146566 ? 00:00:00 timeout 2023-07-29T02:03:51.353 INFO:tasks.workunit.client.0.smithi042.stdout: 146587 ? 00:00:00 snaptest-double 2023-07-29T02:03:51.353 INFO:tasks.workunit.client.0.smithi042.stdout: 146605 ? 00:00:00 ps 2023-07-29T02:03:51.353 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/one a/.snap/two 2023-07-29T02:03:51.364 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm a/foo 2023-07-29T02:03:51.365 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:51.371 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 20` 2023-07-29T02:03:51.371 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:51.373 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/one 2023-07-29T02:03:51.373 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat 2023-07-29T02:03:51.399 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/two 2023-07-29T02:03:51.432 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod 777 a/foo 2023-07-29T02:03:51.434 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:51.506 INFO:tasks.workunit.client.0.smithi042.stderr:+ ps 2023-07-29T02:03:51.525 INFO:tasks.workunit.client.0.smithi042.stdout: PID TTY TIME CMD 2023-07-29T02:03:51.525 INFO:tasks.workunit.client.0.smithi042.stdout: 1892 ? 00:00:00 systemd 2023-07-29T02:03:51.525 INFO:tasks.workunit.client.0.smithi042.stdout: 1895 ? 00:00:00 (sd-pam) 2023-07-29T02:03:51.525 INFO:tasks.workunit.client.0.smithi042.stdout: 87098 ? 00:00:00 sshd 2023-07-29T02:03:51.526 INFO:tasks.workunit.client.0.smithi042.stdout: 146566 ? 00:00:00 timeout 2023-07-29T02:03:51.526 INFO:tasks.workunit.client.0.smithi042.stdout: 146587 ? 00:00:00 snaptest-double 2023-07-29T02:03:51.526 INFO:tasks.workunit.client.0.smithi042.stdout: 146615 ? 00:00:00 ps 2023-07-29T02:03:51.526 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/one a/.snap/two 2023-07-29T02:03:51.535 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm a/foo 2023-07-29T02:03:51.537 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:51.543 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 20` 2023-07-29T02:03:51.543 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:51.545 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/one 2023-07-29T02:03:51.545 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat 2023-07-29T02:03:51.563 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/two 2023-07-29T02:03:51.584 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod 777 a/foo 2023-07-29T02:03:51.588 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:51.706 INFO:tasks.workunit.client.0.smithi042.stderr:+ ps 2023-07-29T02:03:51.725 INFO:tasks.workunit.client.0.smithi042.stdout: PID TTY TIME CMD 2023-07-29T02:03:51.726 INFO:tasks.workunit.client.0.smithi042.stdout: 1892 ? 00:00:00 systemd 2023-07-29T02:03:51.726 INFO:tasks.workunit.client.0.smithi042.stdout: 1895 ? 00:00:00 (sd-pam) 2023-07-29T02:03:51.726 INFO:tasks.workunit.client.0.smithi042.stdout: 87098 ? 00:00:00 sshd 2023-07-29T02:03:51.726 INFO:tasks.workunit.client.0.smithi042.stdout: 146566 ? 00:00:00 timeout 2023-07-29T02:03:51.726 INFO:tasks.workunit.client.0.smithi042.stdout: 146587 ? 00:00:00 snaptest-double 2023-07-29T02:03:51.726 INFO:tasks.workunit.client.0.smithi042.stdout: 146625 ? 00:00:00 ps 2023-07-29T02:03:51.727 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/one a/.snap/two 2023-07-29T02:03:51.737 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm a/foo 2023-07-29T02:03:51.740 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:51.747 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 20` 2023-07-29T02:03:51.747 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:51.749 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/one 2023-07-29T02:03:51.750 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat 2023-07-29T02:03:51.769 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/two 2023-07-29T02:03:51.794 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod 777 a/foo 2023-07-29T02:03:51.796 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:51.857 INFO:tasks.workunit.client.0.smithi042.stderr:+ ps 2023-07-29T02:03:51.877 INFO:tasks.workunit.client.0.smithi042.stdout: PID TTY TIME CMD 2023-07-29T02:03:51.877 INFO:tasks.workunit.client.0.smithi042.stdout: 1892 ? 00:00:00 systemd 2023-07-29T02:03:51.877 INFO:tasks.workunit.client.0.smithi042.stdout: 1895 ? 00:00:00 (sd-pam) 2023-07-29T02:03:51.877 INFO:tasks.workunit.client.0.smithi042.stdout: 87098 ? 00:00:00 sshd 2023-07-29T02:03:51.878 INFO:tasks.workunit.client.0.smithi042.stdout: 146566 ? 00:00:00 timeout 2023-07-29T02:03:51.878 INFO:tasks.workunit.client.0.smithi042.stdout: 146587 ? 00:00:00 snaptest-double 2023-07-29T02:03:51.878 INFO:tasks.workunit.client.0.smithi042.stdout: 146635 ? 00:00:00 ps 2023-07-29T02:03:51.878 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/one a/.snap/two 2023-07-29T02:03:51.887 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm a/foo 2023-07-29T02:03:51.889 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:51.895 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 20` 2023-07-29T02:03:51.895 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:51.897 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/one 2023-07-29T02:03:51.897 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat 2023-07-29T02:03:51.919 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/two 2023-07-29T02:03:51.942 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod 777 a/foo 2023-07-29T02:03:51.943 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:52.024 INFO:tasks.workunit.client.0.smithi042.stderr:+ ps 2023-07-29T02:03:52.042 INFO:tasks.workunit.client.0.smithi042.stdout: PID TTY TIME CMD 2023-07-29T02:03:52.043 INFO:tasks.workunit.client.0.smithi042.stdout: 1892 ? 00:00:00 systemd 2023-07-29T02:03:52.043 INFO:tasks.workunit.client.0.smithi042.stdout: 1895 ? 00:00:00 (sd-pam) 2023-07-29T02:03:52.043 INFO:tasks.workunit.client.0.smithi042.stdout: 87098 ? 00:00:00 sshd 2023-07-29T02:03:52.043 INFO:tasks.workunit.client.0.smithi042.stdout: 146566 ? 00:00:00 timeout 2023-07-29T02:03:52.043 INFO:tasks.workunit.client.0.smithi042.stdout: 146587 ? 00:00:00 snaptest-double 2023-07-29T02:03:52.044 INFO:tasks.workunit.client.0.smithi042.stdout: 146645 ? 00:00:00 ps 2023-07-29T02:03:52.044 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/one a/.snap/two 2023-07-29T02:03:52.053 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm a/foo 2023-07-29T02:03:52.055 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:52.065 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 20` 2023-07-29T02:03:52.065 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:52.068 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/one 2023-07-29T02:03:52.068 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat 2023-07-29T02:03:52.091 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/two 2023-07-29T02:03:52.113 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod 777 a/foo 2023-07-29T02:03:52.117 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:52.223 INFO:tasks.workunit.client.0.smithi042.stderr:+ ps 2023-07-29T02:03:52.243 INFO:tasks.workunit.client.0.smithi042.stdout: PID TTY TIME CMD 2023-07-29T02:03:52.243 INFO:tasks.workunit.client.0.smithi042.stdout: 1892 ? 00:00:00 systemd 2023-07-29T02:03:52.243 INFO:tasks.workunit.client.0.smithi042.stdout: 1895 ? 00:00:00 (sd-pam) 2023-07-29T02:03:52.243 INFO:tasks.workunit.client.0.smithi042.stdout: 87098 ? 00:00:00 sshd 2023-07-29T02:03:52.244 INFO:tasks.workunit.client.0.smithi042.stdout: 146566 ? 00:00:00 timeout 2023-07-29T02:03:52.244 INFO:tasks.workunit.client.0.smithi042.stdout: 146587 ? 00:00:00 snaptest-double 2023-07-29T02:03:52.244 INFO:tasks.workunit.client.0.smithi042.stdout: 146655 ? 00:00:00 ps 2023-07-29T02:03:52.244 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/one a/.snap/two 2023-07-29T02:03:52.253 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm a/foo 2023-07-29T02:03:52.255 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:52.261 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 20` 2023-07-29T02:03:52.261 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:52.263 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/one 2023-07-29T02:03:52.264 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat 2023-07-29T02:03:52.285 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/two 2023-07-29T02:03:52.309 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod 777 a/foo 2023-07-29T02:03:52.311 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:52.390 INFO:tasks.workunit.client.0.smithi042.stderr:+ ps 2023-07-29T02:03:52.410 INFO:tasks.workunit.client.0.smithi042.stdout: PID TTY TIME CMD 2023-07-29T02:03:52.410 INFO:tasks.workunit.client.0.smithi042.stdout: 1892 ? 00:00:00 systemd 2023-07-29T02:03:52.410 INFO:tasks.workunit.client.0.smithi042.stdout: 1895 ? 00:00:00 (sd-pam) 2023-07-29T02:03:52.410 INFO:tasks.workunit.client.0.smithi042.stdout: 87098 ? 00:00:00 sshd 2023-07-29T02:03:52.411 INFO:tasks.workunit.client.0.smithi042.stdout: 146566 ? 00:00:00 timeout 2023-07-29T02:03:52.411 INFO:tasks.workunit.client.0.smithi042.stdout: 146587 ? 00:00:00 snaptest-double 2023-07-29T02:03:52.411 INFO:tasks.workunit.client.0.smithi042.stdout: 146665 ? 00:00:00 ps 2023-07-29T02:03:52.411 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/one a/.snap/two 2023-07-29T02:03:52.422 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm a/foo 2023-07-29T02:03:52.424 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:52.431 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 20` 2023-07-29T02:03:52.431 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:52.434 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/one 2023-07-29T02:03:52.434 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat 2023-07-29T02:03:52.453 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/two 2023-07-29T02:03:52.476 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod 777 a/foo 2023-07-29T02:03:52.480 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:52.540 INFO:tasks.workunit.client.0.smithi042.stderr:+ ps 2023-07-29T02:03:52.560 INFO:tasks.workunit.client.0.smithi042.stdout: PID TTY TIME CMD 2023-07-29T02:03:52.560 INFO:tasks.workunit.client.0.smithi042.stdout: 1892 ? 00:00:00 systemd 2023-07-29T02:03:52.560 INFO:tasks.workunit.client.0.smithi042.stdout: 1895 ? 00:00:00 (sd-pam) 2023-07-29T02:03:52.561 INFO:tasks.workunit.client.0.smithi042.stdout: 87098 ? 00:00:00 sshd 2023-07-29T02:03:52.561 INFO:tasks.workunit.client.0.smithi042.stdout: 146566 ? 00:00:00 timeout 2023-07-29T02:03:52.561 INFO:tasks.workunit.client.0.smithi042.stdout: 146587 ? 00:00:00 snaptest-double 2023-07-29T02:03:52.561 INFO:tasks.workunit.client.0.smithi042.stdout: 146676 ? 00:00:00 ps 2023-07-29T02:03:52.561 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/one a/.snap/two 2023-07-29T02:03:52.571 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm a/foo 2023-07-29T02:03:52.573 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:52.578 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 20` 2023-07-29T02:03:52.578 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:52.580 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/one 2023-07-29T02:03:52.580 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat 2023-07-29T02:03:52.600 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/two 2023-07-29T02:03:52.633 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod 777 a/foo 2023-07-29T02:03:52.635 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:52.768 INFO:tasks.workunit.client.0.smithi042.stderr:+ ps 2023-07-29T02:03:52.787 INFO:tasks.workunit.client.0.smithi042.stdout: PID TTY TIME CMD 2023-07-29T02:03:52.788 INFO:tasks.workunit.client.0.smithi042.stdout: 1892 ? 00:00:00 systemd 2023-07-29T02:03:52.788 INFO:tasks.workunit.client.0.smithi042.stdout: 1895 ? 00:00:00 (sd-pam) 2023-07-29T02:03:52.788 INFO:tasks.workunit.client.0.smithi042.stdout: 87098 ? 00:00:00 sshd 2023-07-29T02:03:52.788 INFO:tasks.workunit.client.0.smithi042.stdout: 146566 ? 00:00:00 timeout 2023-07-29T02:03:52.788 INFO:tasks.workunit.client.0.smithi042.stdout: 146587 ? 00:00:00 snaptest-double 2023-07-29T02:03:52.788 INFO:tasks.workunit.client.0.smithi042.stdout: 146686 ? 00:00:00 ps 2023-07-29T02:03:52.789 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/one a/.snap/two 2023-07-29T02:03:52.798 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm a/foo 2023-07-29T02:03:52.800 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:52.809 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 20` 2023-07-29T02:03:52.809 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:52.810 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/one 2023-07-29T02:03:52.811 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat 2023-07-29T02:03:52.837 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/two 2023-07-29T02:03:52.868 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod 777 a/foo 2023-07-29T02:03:52.870 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:52.943 INFO:tasks.workunit.client.0.smithi042.stderr:+ ps 2023-07-29T02:03:52.962 INFO:tasks.workunit.client.0.smithi042.stdout: PID TTY TIME CMD 2023-07-29T02:03:52.962 INFO:tasks.workunit.client.0.smithi042.stdout: 1892 ? 00:00:00 systemd 2023-07-29T02:03:52.962 INFO:tasks.workunit.client.0.smithi042.stdout: 1895 ? 00:00:00 (sd-pam) 2023-07-29T02:03:52.963 INFO:tasks.workunit.client.0.smithi042.stdout: 87098 ? 00:00:00 sshd 2023-07-29T02:03:52.963 INFO:tasks.workunit.client.0.smithi042.stdout: 146566 ? 00:00:00 timeout 2023-07-29T02:03:52.963 INFO:tasks.workunit.client.0.smithi042.stdout: 146587 ? 00:00:00 snaptest-double 2023-07-29T02:03:52.963 INFO:tasks.workunit.client.0.smithi042.stdout: 146696 ? 00:00:00 ps 2023-07-29T02:03:52.964 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/one a/.snap/two 2023-07-29T02:03:52.974 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm a/foo 2023-07-29T02:03:52.975 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:52.980 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 20` 2023-07-29T02:03:52.981 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:52.982 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/one 2023-07-29T02:03:52.983 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat 2023-07-29T02:03:53.007 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/two 2023-07-29T02:03:53.042 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod 777 a/foo 2023-07-29T02:03:53.044 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:53.128 INFO:tasks.workunit.client.0.smithi042.stderr:+ ps 2023-07-29T02:03:53.147 INFO:tasks.workunit.client.0.smithi042.stdout: PID TTY TIME CMD 2023-07-29T02:03:53.147 INFO:tasks.workunit.client.0.smithi042.stdout: 1892 ? 00:00:00 systemd 2023-07-29T02:03:53.147 INFO:tasks.workunit.client.0.smithi042.stdout: 1895 ? 00:00:00 (sd-pam) 2023-07-29T02:03:53.147 INFO:tasks.workunit.client.0.smithi042.stdout: 87098 ? 00:00:00 sshd 2023-07-29T02:03:53.147 INFO:tasks.workunit.client.0.smithi042.stdout: 146566 ? 00:00:00 timeout 2023-07-29T02:03:53.148 INFO:tasks.workunit.client.0.smithi042.stdout: 146587 ? 00:00:00 snaptest-double 2023-07-29T02:03:53.148 INFO:tasks.workunit.client.0.smithi042.stdout: 146706 ? 00:00:00 ps 2023-07-29T02:03:53.148 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/one a/.snap/two 2023-07-29T02:03:53.156 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm a/foo 2023-07-29T02:03:53.158 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:53.164 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 20` 2023-07-29T02:03:53.164 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:53.166 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/one 2023-07-29T02:03:53.166 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat 2023-07-29T02:03:53.192 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/two 2023-07-29T02:03:53.225 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod 777 a/foo 2023-07-29T02:03:53.228 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:53.293 INFO:tasks.workunit.client.0.smithi042.stderr:+ ps 2023-07-29T02:03:53.312 INFO:tasks.workunit.client.0.smithi042.stdout: PID TTY TIME CMD 2023-07-29T02:03:53.312 INFO:tasks.workunit.client.0.smithi042.stdout: 1892 ? 00:00:00 systemd 2023-07-29T02:03:53.313 INFO:tasks.workunit.client.0.smithi042.stdout: 1895 ? 00:00:00 (sd-pam) 2023-07-29T02:03:53.313 INFO:tasks.workunit.client.0.smithi042.stdout: 87098 ? 00:00:00 sshd 2023-07-29T02:03:53.313 INFO:tasks.workunit.client.0.smithi042.stdout: 146566 ? 00:00:00 timeout 2023-07-29T02:03:53.313 INFO:tasks.workunit.client.0.smithi042.stdout: 146587 ? 00:00:00 snaptest-double 2023-07-29T02:03:53.313 INFO:tasks.workunit.client.0.smithi042.stdout: 146716 ? 00:00:00 ps 2023-07-29T02:03:53.314 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/one a/.snap/two 2023-07-29T02:03:53.322 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm a/foo 2023-07-29T02:03:53.324 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:53.329 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 20` 2023-07-29T02:03:53.329 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:53.331 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/one 2023-07-29T02:03:53.331 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat 2023-07-29T02:03:53.360 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/two 2023-07-29T02:03:53.396 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod 777 a/foo 2023-07-29T02:03:53.397 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:53.469 INFO:tasks.workunit.client.0.smithi042.stderr:+ ps 2023-07-29T02:03:53.489 INFO:tasks.workunit.client.0.smithi042.stdout: PID TTY TIME CMD 2023-07-29T02:03:53.489 INFO:tasks.workunit.client.0.smithi042.stdout: 1892 ? 00:00:00 systemd 2023-07-29T02:03:53.489 INFO:tasks.workunit.client.0.smithi042.stdout: 1895 ? 00:00:00 (sd-pam) 2023-07-29T02:03:53.489 INFO:tasks.workunit.client.0.smithi042.stdout: 87098 ? 00:00:00 sshd 2023-07-29T02:03:53.489 INFO:tasks.workunit.client.0.smithi042.stdout: 146566 ? 00:00:00 timeout 2023-07-29T02:03:53.490 INFO:tasks.workunit.client.0.smithi042.stdout: 146587 ? 00:00:00 snaptest-double 2023-07-29T02:03:53.490 INFO:tasks.workunit.client.0.smithi042.stdout: 146726 ? 00:00:00 ps 2023-07-29T02:03:53.490 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/one a/.snap/two 2023-07-29T02:03:53.499 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm a/foo 2023-07-29T02:03:53.501 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:53.506 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 20` 2023-07-29T02:03:53.506 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:53.509 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/one 2023-07-29T02:03:53.509 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat 2023-07-29T02:03:53.535 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/two 2023-07-29T02:03:53.565 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod 777 a/foo 2023-07-29T02:03:53.566 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:53.634 INFO:tasks.workunit.client.0.smithi042.stderr:+ ps 2023-07-29T02:03:53.654 INFO:tasks.workunit.client.0.smithi042.stdout: PID TTY TIME CMD 2023-07-29T02:03:53.654 INFO:tasks.workunit.client.0.smithi042.stdout: 1892 ? 00:00:00 systemd 2023-07-29T02:03:53.654 INFO:tasks.workunit.client.0.smithi042.stdout: 1895 ? 00:00:00 (sd-pam) 2023-07-29T02:03:53.654 INFO:tasks.workunit.client.0.smithi042.stdout: 87098 ? 00:00:00 sshd 2023-07-29T02:03:53.654 INFO:tasks.workunit.client.0.smithi042.stdout: 146566 ? 00:00:00 timeout 2023-07-29T02:03:53.655 INFO:tasks.workunit.client.0.smithi042.stdout: 146587 ? 00:00:00 snaptest-double 2023-07-29T02:03:53.655 INFO:tasks.workunit.client.0.smithi042.stdout: 146736 ? 00:00:00 ps 2023-07-29T02:03:53.655 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/one a/.snap/two 2023-07-29T02:03:53.665 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm a/foo 2023-07-29T02:03:53.667 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:53.674 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 20` 2023-07-29T02:03:53.675 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:53.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/one 2023-07-29T02:03:53.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat 2023-07-29T02:03:53.697 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/two 2023-07-29T02:03:53.721 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod 777 a/foo 2023-07-29T02:03:53.723 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:53.803 INFO:tasks.workunit.client.0.smithi042.stderr:+ ps 2023-07-29T02:03:53.822 INFO:tasks.workunit.client.0.smithi042.stdout: PID TTY TIME CMD 2023-07-29T02:03:53.822 INFO:tasks.workunit.client.0.smithi042.stdout: 1892 ? 00:00:00 systemd 2023-07-29T02:03:53.822 INFO:tasks.workunit.client.0.smithi042.stdout: 1895 ? 00:00:00 (sd-pam) 2023-07-29T02:03:53.822 INFO:tasks.workunit.client.0.smithi042.stdout: 87098 ? 00:00:00 sshd 2023-07-29T02:03:53.823 INFO:tasks.workunit.client.0.smithi042.stdout: 146566 ? 00:00:00 timeout 2023-07-29T02:03:53.823 INFO:tasks.workunit.client.0.smithi042.stdout: 146587 ? 00:00:00 snaptest-double 2023-07-29T02:03:53.823 INFO:tasks.workunit.client.0.smithi042.stdout: 146746 ? 00:00:00 ps 2023-07-29T02:03:53.823 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/one a/.snap/two 2023-07-29T02:03:53.835 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm a/foo 2023-07-29T02:03:53.838 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:53.845 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 20` 2023-07-29T02:03:53.845 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:53.848 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/one 2023-07-29T02:03:53.848 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat 2023-07-29T02:03:53.867 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/two 2023-07-29T02:03:53.893 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod 777 a/foo 2023-07-29T02:03:53.895 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:53.985 INFO:tasks.workunit.client.0.smithi042.stderr:+ ps 2023-07-29T02:03:54.005 INFO:tasks.workunit.client.0.smithi042.stdout: PID TTY TIME CMD 2023-07-29T02:03:54.006 INFO:tasks.workunit.client.0.smithi042.stdout: 1892 ? 00:00:00 systemd 2023-07-29T02:03:54.006 INFO:tasks.workunit.client.0.smithi042.stdout: 1895 ? 00:00:00 (sd-pam) 2023-07-29T02:03:54.006 INFO:tasks.workunit.client.0.smithi042.stdout: 87098 ? 00:00:00 sshd 2023-07-29T02:03:54.006 INFO:tasks.workunit.client.0.smithi042.stdout: 146566 ? 00:00:00 timeout 2023-07-29T02:03:54.006 INFO:tasks.workunit.client.0.smithi042.stdout: 146587 ? 00:00:00 snaptest-double 2023-07-29T02:03:54.006 INFO:tasks.workunit.client.0.smithi042.stdout: 146756 ? 00:00:00 ps 2023-07-29T02:03:54.007 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/one a/.snap/two 2023-07-29T02:03:54.016 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm a/foo 2023-07-29T02:03:54.018 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:54.023 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 20` 2023-07-29T02:03:54.023 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:54.025 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/one 2023-07-29T02:03:54.026 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat 2023-07-29T02:03:54.044 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/two 2023-07-29T02:03:54.070 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod 777 a/foo 2023-07-29T02:03:54.072 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:54.135 INFO:tasks.workunit.client.0.smithi042.stderr:+ ps 2023-07-29T02:03:54.155 INFO:tasks.workunit.client.0.smithi042.stdout: PID TTY TIME CMD 2023-07-29T02:03:54.155 INFO:tasks.workunit.client.0.smithi042.stdout: 1892 ? 00:00:00 systemd 2023-07-29T02:03:54.155 INFO:tasks.workunit.client.0.smithi042.stdout: 1895 ? 00:00:00 (sd-pam) 2023-07-29T02:03:54.156 INFO:tasks.workunit.client.0.smithi042.stdout: 87098 ? 00:00:00 sshd 2023-07-29T02:03:54.156 INFO:tasks.workunit.client.0.smithi042.stdout: 146566 ? 00:00:00 timeout 2023-07-29T02:03:54.156 INFO:tasks.workunit.client.0.smithi042.stdout: 146587 ? 00:00:00 snaptest-double 2023-07-29T02:03:54.156 INFO:tasks.workunit.client.0.smithi042.stdout: 146766 ? 00:00:00 ps 2023-07-29T02:03:54.157 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/one a/.snap/two 2023-07-29T02:03:54.164 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm a/foo 2023-07-29T02:03:54.167 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:54.174 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 20` 2023-07-29T02:03:54.175 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:54.177 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/one 2023-07-29T02:03:54.178 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat 2023-07-29T02:03:54.197 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/two 2023-07-29T02:03:54.222 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod 777 a/foo 2023-07-29T02:03:54.224 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:54.302 INFO:tasks.workunit.client.0.smithi042.stderr:+ ps 2023-07-29T02:03:54.321 INFO:tasks.workunit.client.0.smithi042.stdout: PID TTY TIME CMD 2023-07-29T02:03:54.322 INFO:tasks.workunit.client.0.smithi042.stdout: 1892 ? 00:00:00 systemd 2023-07-29T02:03:54.322 INFO:tasks.workunit.client.0.smithi042.stdout: 1895 ? 00:00:00 (sd-pam) 2023-07-29T02:03:54.322 INFO:tasks.workunit.client.0.smithi042.stdout: 87098 ? 00:00:00 sshd 2023-07-29T02:03:54.323 INFO:tasks.workunit.client.0.smithi042.stdout: 146566 ? 00:00:00 timeout 2023-07-29T02:03:54.323 INFO:tasks.workunit.client.0.smithi042.stdout: 146587 ? 00:00:00 snaptest-double 2023-07-29T02:03:54.323 INFO:tasks.workunit.client.0.smithi042.stdout: 146776 ? 00:00:00 ps 2023-07-29T02:03:54.324 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/one a/.snap/two 2023-07-29T02:03:54.333 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm a/foo 2023-07-29T02:03:54.336 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:54.343 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 20` 2023-07-29T02:03:54.343 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a 2023-07-29T02:03:54.346 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/one 2023-07-29T02:03:54.346 INFO:tasks.workunit.client.0.smithi042.stderr:+ cat 2023-07-29T02:03:54.364 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir a/.snap/two 2023-07-29T02:03:54.396 INFO:tasks.workunit.client.0.smithi042.stderr:+ chmod 777 a/foo 2023-07-29T02:03:54.398 INFO:tasks.workunit.client.0.smithi042.stderr:+ sync 2023-07-29T02:03:54.470 INFO:tasks.workunit.client.0.smithi042.stderr:+ ps 2023-07-29T02:03:54.489 INFO:tasks.workunit.client.0.smithi042.stdout: PID TTY TIME CMD 2023-07-29T02:03:54.490 INFO:tasks.workunit.client.0.smithi042.stdout: 1892 ? 00:00:00 systemd 2023-07-29T02:03:54.490 INFO:tasks.workunit.client.0.smithi042.stdout: 1895 ? 00:00:00 (sd-pam) 2023-07-29T02:03:54.490 INFO:tasks.workunit.client.0.smithi042.stdout: 87098 ? 00:00:00 sshd 2023-07-29T02:03:54.490 INFO:tasks.workunit.client.0.smithi042.stdout: 146566 ? 00:00:00 timeout 2023-07-29T02:03:54.490 INFO:tasks.workunit.client.0.smithi042.stdout: 146587 ? 00:00:00 snaptest-double 2023-07-29T02:03:54.491 INFO:tasks.workunit.client.0.smithi042.stdout: 146786 ? 00:00:00 ps 2023-07-29T02:03:54.491 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a/.snap/one a/.snap/two 2023-07-29T02:03:54.499 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm a/foo 2023-07-29T02:03:54.501 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir a 2023-07-29T02:03:54.506 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo OK 2023-07-29T02:03:54.507 INFO:tasks.workunit.client.0.smithi042.stdout:OK 2023-07-29T02:03:54.507 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-07-29T02:03:54.508 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-07-29T02:03:54.581 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-estale.sh... 2023-07-29T02:03:54.581 DEBUG:teuthology.orchestra.run.smithi042:workunit test fs/snaps/snaptest-estale.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0484097b0572e96f42cf6402cbe0ac8dcb046577 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-estale.sh 2023-07-29T02:03:54.643 INFO:tasks.workunit.client.0.smithi042.stderr:+ mkdir .snap/foo 2023-07-29T02:03:54.660 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo 'We want ENOENT, not ESTALE, here.' 2023-07-29T02:03:54.661 INFO:tasks.workunit.client.0.smithi042.stdout:We want ENOENT, not ESTALE, here. 2023-07-29T02:03:54.661 INFO:tasks.workunit.client.0.smithi042.stderr:++ seq 1 100 2023-07-29T02:03:54.662 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.663 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/1 2023-07-29T02:03:54.663 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.668 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/1': No such file or directory 2023-07-29T02:03:54.669 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.669 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/2 2023-07-29T02:03:54.669 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.671 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/2': No such file or directory 2023-07-29T02:03:54.672 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.672 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/3 2023-07-29T02:03:54.672 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.674 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/3': No such file or directory 2023-07-29T02:03:54.674 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.675 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/4 2023-07-29T02:03:54.675 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.676 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/4': No such file or directory 2023-07-29T02:03:54.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/5 2023-07-29T02:03:54.677 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.678 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/5': No such file or directory 2023-07-29T02:03:54.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/6 2023-07-29T02:03:54.678 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.679 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/6': No such file or directory 2023-07-29T02:03:54.679 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.679 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/7 2023-07-29T02:03:54.680 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.680 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/7': No such file or directory 2023-07-29T02:03:54.680 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.681 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/8 2023-07-29T02:03:54.681 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.681 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/8': No such file or directory 2023-07-29T02:03:54.682 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.682 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/9 2023-07-29T02:03:54.682 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.682 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/9': No such file or directory 2023-07-29T02:03:54.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/10 2023-07-29T02:03:54.683 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.684 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/10': No such file or directory 2023-07-29T02:03:54.684 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.684 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/11 2023-07-29T02:03:54.684 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.685 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/11': No such file or directory 2023-07-29T02:03:54.685 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.685 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/12 2023-07-29T02:03:54.686 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.686 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/12': No such file or directory 2023-07-29T02:03:54.686 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.687 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/13 2023-07-29T02:03:54.687 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.687 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/13': No such file or directory 2023-07-29T02:03:54.688 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.688 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/14 2023-07-29T02:03:54.688 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.688 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/14': No such file or directory 2023-07-29T02:03:54.689 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.689 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/15 2023-07-29T02:03:54.689 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.689 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/15': No such file or directory 2023-07-29T02:03:54.690 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.690 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/16 2023-07-29T02:03:54.690 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.691 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/16': No such file or directory 2023-07-29T02:03:54.691 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.691 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/17 2023-07-29T02:03:54.692 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.692 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/17': No such file or directory 2023-07-29T02:03:54.692 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.693 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/18 2023-07-29T02:03:54.693 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.693 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/18': No such file or directory 2023-07-29T02:03:54.694 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.694 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/19 2023-07-29T02:03:54.694 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.694 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/19': No such file or directory 2023-07-29T02:03:54.695 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.695 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/20 2023-07-29T02:03:54.695 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.695 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/20': No such file or directory 2023-07-29T02:03:54.696 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.696 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/21 2023-07-29T02:03:54.696 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.697 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/21': No such file or directory 2023-07-29T02:03:54.697 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.697 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/22 2023-07-29T02:03:54.697 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.698 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/22': No such file or directory 2023-07-29T02:03:54.698 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.699 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/23 2023-07-29T02:03:54.699 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.699 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/23': No such file or directory 2023-07-29T02:03:54.700 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.700 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/24 2023-07-29T02:03:54.700 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.700 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/24': No such file or directory 2023-07-29T02:03:54.701 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.701 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/25 2023-07-29T02:03:54.701 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.701 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/25': No such file or directory 2023-07-29T02:03:54.702 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.702 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/26 2023-07-29T02:03:54.702 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.703 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/26': No such file or directory 2023-07-29T02:03:54.703 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.703 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/27 2023-07-29T02:03:54.703 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.704 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/27': No such file or directory 2023-07-29T02:03:54.704 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.704 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/28 2023-07-29T02:03:54.705 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.705 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/28': No such file or directory 2023-07-29T02:03:54.705 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.706 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/29 2023-07-29T02:03:54.706 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.706 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/29': No such file or directory 2023-07-29T02:03:54.707 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.707 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/30 2023-07-29T02:03:54.707 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.707 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/30': No such file or directory 2023-07-29T02:03:54.708 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.708 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/31 2023-07-29T02:03:54.708 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.708 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/31': No such file or directory 2023-07-29T02:03:54.709 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.709 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/32 2023-07-29T02:03:54.709 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.710 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/32': No such file or directory 2023-07-29T02:03:54.710 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.710 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/33 2023-07-29T02:03:54.710 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.711 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/33': No such file or directory 2023-07-29T02:03:54.711 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.711 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/34 2023-07-29T02:03:54.711 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.712 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/34': No such file or directory 2023-07-29T02:03:54.712 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.713 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/35 2023-07-29T02:03:54.713 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.713 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/35': No such file or directory 2023-07-29T02:03:54.714 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.714 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/36 2023-07-29T02:03:54.714 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.714 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/36': No such file or directory 2023-07-29T02:03:54.715 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.715 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/37 2023-07-29T02:03:54.715 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.715 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/37': No such file or directory 2023-07-29T02:03:54.716 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.716 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/38 2023-07-29T02:03:54.716 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.716 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/38': No such file or directory 2023-07-29T02:03:54.717 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.717 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/39 2023-07-29T02:03:54.717 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.718 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/39': No such file or directory 2023-07-29T02:03:54.718 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.718 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/40 2023-07-29T02:03:54.718 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.719 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/40': No such file or directory 2023-07-29T02:03:54.719 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.719 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/41 2023-07-29T02:03:54.720 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.720 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/41': No such file or directory 2023-07-29T02:03:54.720 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.721 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/42 2023-07-29T02:03:54.721 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.721 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/42': No such file or directory 2023-07-29T02:03:54.722 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.722 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/43 2023-07-29T02:03:54.722 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.722 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/43': No such file or directory 2023-07-29T02:03:54.723 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.723 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/44 2023-07-29T02:03:54.723 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.723 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/44': No such file or directory 2023-07-29T02:03:54.724 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.724 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/45 2023-07-29T02:03:54.724 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.725 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/45': No such file or directory 2023-07-29T02:03:54.725 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.725 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/46 2023-07-29T02:03:54.725 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.726 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/46': No such file or directory 2023-07-29T02:03:54.726 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.726 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/47 2023-07-29T02:03:54.727 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.727 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/47': No such file or directory 2023-07-29T02:03:54.727 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.727 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/48 2023-07-29T02:03:54.728 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.728 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/48': No such file or directory 2023-07-29T02:03:54.729 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.729 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/49 2023-07-29T02:03:54.729 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.729 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/49': No such file or directory 2023-07-29T02:03:54.730 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.730 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/50 2023-07-29T02:03:54.730 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.730 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/50': No such file or directory 2023-07-29T02:03:54.731 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.731 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/51 2023-07-29T02:03:54.731 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.731 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/51': No such file or directory 2023-07-29T02:03:54.732 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.732 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/52 2023-07-29T02:03:54.732 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.733 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/52': No such file or directory 2023-07-29T02:03:54.733 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.733 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/53 2023-07-29T02:03:54.733 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.734 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/53': No such file or directory 2023-07-29T02:03:54.734 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.734 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/54 2023-07-29T02:03:54.735 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.735 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/54': No such file or directory 2023-07-29T02:03:54.735 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.736 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/55 2023-07-29T02:03:54.736 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.736 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/55': No such file or directory 2023-07-29T02:03:54.737 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.737 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/56 2023-07-29T02:03:54.737 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.737 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/56': No such file or directory 2023-07-29T02:03:54.738 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.738 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/57 2023-07-29T02:03:54.738 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.739 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/57': No such file or directory 2023-07-29T02:03:54.740 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.740 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/58 2023-07-29T02:03:54.740 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.741 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/58': No such file or directory 2023-07-29T02:03:54.741 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.741 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/59 2023-07-29T02:03:54.741 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.742 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/59': No such file or directory 2023-07-29T02:03:54.742 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.742 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/60 2023-07-29T02:03:54.742 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.743 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/60': No such file or directory 2023-07-29T02:03:54.743 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.743 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/61 2023-07-29T02:03:54.744 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.744 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/61': No such file or directory 2023-07-29T02:03:54.744 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.745 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/62 2023-07-29T02:03:54.745 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.745 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/62': No such file or directory 2023-07-29T02:03:54.745 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.746 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/63 2023-07-29T02:03:54.746 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.746 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/63': No such file or directory 2023-07-29T02:03:54.747 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.747 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/64 2023-07-29T02:03:54.747 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.747 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/64': No such file or directory 2023-07-29T02:03:54.748 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.748 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/65 2023-07-29T02:03:54.748 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.748 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/65': No such file or directory 2023-07-29T02:03:54.749 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.749 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/66 2023-07-29T02:03:54.749 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.749 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/66': No such file or directory 2023-07-29T02:03:54.750 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.750 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/67 2023-07-29T02:03:54.750 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.750 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/67': No such file or directory 2023-07-29T02:03:54.751 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.751 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/68 2023-07-29T02:03:54.751 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.752 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/68': No such file or directory 2023-07-29T02:03:54.752 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.752 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/69 2023-07-29T02:03:54.752 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.753 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/69': No such file or directory 2023-07-29T02:03:54.753 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.753 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/70 2023-07-29T02:03:54.753 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.754 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/70': No such file or directory 2023-07-29T02:03:54.754 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.754 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/71 2023-07-29T02:03:54.755 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.755 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/71': No such file or directory 2023-07-29T02:03:54.755 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.756 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/72 2023-07-29T02:03:54.756 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.756 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/72': No such file or directory 2023-07-29T02:03:54.756 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.757 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/73 2023-07-29T02:03:54.757 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.757 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/73': No such file or directory 2023-07-29T02:03:54.758 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.758 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/74 2023-07-29T02:03:54.758 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.758 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/74': No such file or directory 2023-07-29T02:03:54.759 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.759 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/75 2023-07-29T02:03:54.759 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.759 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/75': No such file or directory 2023-07-29T02:03:54.760 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.760 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/76 2023-07-29T02:03:54.760 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.761 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/76': No such file or directory 2023-07-29T02:03:54.761 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.761 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/77 2023-07-29T02:03:54.761 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.762 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/77': No such file or directory 2023-07-29T02:03:54.762 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.762 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/78 2023-07-29T02:03:54.763 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.763 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/78': No such file or directory 2023-07-29T02:03:54.763 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.763 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/79 2023-07-29T02:03:54.764 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.764 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/79': No such file or directory 2023-07-29T02:03:54.764 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.765 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/80 2023-07-29T02:03:54.765 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.765 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/80': No such file or directory 2023-07-29T02:03:54.766 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.766 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/81 2023-07-29T02:03:54.766 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.766 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/81': No such file or directory 2023-07-29T02:03:54.767 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.767 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/82 2023-07-29T02:03:54.767 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.767 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/82': No such file or directory 2023-07-29T02:03:54.768 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.768 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/83 2023-07-29T02:03:54.768 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.769 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/83': No such file or directory 2023-07-29T02:03:54.769 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.769 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/84 2023-07-29T02:03:54.769 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.770 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/84': No such file or directory 2023-07-29T02:03:54.770 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.770 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/85 2023-07-29T02:03:54.771 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.771 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/85': No such file or directory 2023-07-29T02:03:54.771 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.772 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/86 2023-07-29T02:03:54.772 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.772 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/86': No such file or directory 2023-07-29T02:03:54.773 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.773 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/87 2023-07-29T02:03:54.773 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.773 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/87': No such file or directory 2023-07-29T02:03:54.774 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.774 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/88 2023-07-29T02:03:54.774 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.774 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/88': No such file or directory 2023-07-29T02:03:54.775 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.775 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/89 2023-07-29T02:03:54.775 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.776 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/89': No such file or directory 2023-07-29T02:03:54.776 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.776 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/90 2023-07-29T02:03:54.776 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.777 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/90': No such file or directory 2023-07-29T02:03:54.777 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.777 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/91 2023-07-29T02:03:54.778 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.778 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/91': No such file or directory 2023-07-29T02:03:54.778 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.779 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/92 2023-07-29T02:03:54.779 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.779 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/92': No such file or directory 2023-07-29T02:03:54.780 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.780 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/93 2023-07-29T02:03:54.780 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.780 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/93': No such file or directory 2023-07-29T02:03:54.781 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.781 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/94 2023-07-29T02:03:54.781 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.781 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/94': No such file or directory 2023-07-29T02:03:54.782 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.782 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/95 2023-07-29T02:03:54.782 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.783 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/95': No such file or directory 2023-07-29T02:03:54.783 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.783 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/96 2023-07-29T02:03:54.784 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.784 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/96': No such file or directory 2023-07-29T02:03:54.784 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.785 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/97 2023-07-29T02:03:54.785 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.785 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/97': No such file or directory 2023-07-29T02:03:54.786 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.786 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/98 2023-07-29T02:03:54.786 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.786 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/98': No such file or directory 2023-07-29T02:03:54.787 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.787 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/99 2023-07-29T02:03:54.787 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.787 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/99': No such file or directory 2023-07-29T02:03:54.788 INFO:tasks.workunit.client.0.smithi042.stderr:+ for f in `seq 1 100` 2023-07-29T02:03:54.788 INFO:tasks.workunit.client.0.smithi042.stderr:+ stat .snap/foo/100 2023-07-29T02:03:54.788 INFO:tasks.workunit.client.0.smithi042.stderr:+ grep 'No such file' 2023-07-29T02:03:54.789 INFO:tasks.workunit.client.0.smithi042.stdout:stat: cannot statx '.snap/foo/100': No such file or directory 2023-07-29T02:03:54.789 INFO:tasks.workunit.client.0.smithi042.stderr:+ rmdir .snap/foo 2023-07-29T02:03:54.793 INFO:tasks.workunit.client.0.smithi042.stdout:OK 2023-07-29T02:03:54.794 INFO:tasks.workunit.client.0.smithi042.stderr:+ echo OK 2023-07-29T02:03:54.794 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-07-29T02:03:54.794 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-07-29T02:03:54.863 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-git-ceph.sh... 2023-07-29T02:03:54.864 DEBUG:teuthology.orchestra.run.smithi042:workunit test fs/snaps/snaptest-git-ceph.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0484097b0572e96f42cf6402cbe0ac8dcb046577 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh 2023-07-29T02:03:54.926 INFO:tasks.workunit.client.0.smithi042.stderr:+ set -e 2023-07-29T02:03:54.926 INFO:tasks.workunit.client.0.smithi042.stderr:+ retried=false 2023-07-29T02:03:54.927 INFO:tasks.workunit.client.0.smithi042.stderr:+ trap -- retry EXIT 2023-07-29T02:03:54.927 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm -rf ceph 2023-07-29T02:03:54.927 INFO:tasks.workunit.client.0.smithi042.stderr:+ timeout 1800 git clone https://git.ceph.com/ceph.git 2023-07-29T02:03:54.929 INFO:tasks.workunit.client.0.smithi042.stderr:Cloning into 'ceph'... 2023-07-29T02:04:03.566 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:04:03.713 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.728+0000 7f4f9f192700 1 Processor -- start 2023-07-29T02:04:03.713 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.729+0000 7f4f9f192700 1 -- start start 2023-07-29T02:04:03.715 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.729+0000 7f4f9f192700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4f980af920 0x7f4f980c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:03.715 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.729+0000 7f4f9f192700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f9815b3d0 0x7f4f980c23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:03.715 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.729+0000 7f4f9f192700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4f980c28e0 0x7f4f98151080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:03.715 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.729+0000 7f4f9f192700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f980ca860 con 0x7f4f980c28e0 2023-07-29T02:04:03.715 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.729+0000 7f4f9f192700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f980c3dc0 con 0x7f4f980af920 2023-07-29T02:04:03.716 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.729+0000 7f4f9f192700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f980ca2a0 con 0x7f4f9815b3d0 2023-07-29T02:04:03.716 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.729+0000 7f4f9d72f700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4f980c28e0 0x7f4f98151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:03.716 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.729+0000 7f4f9d72f700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f4f980c28e0 0x7f4f98151080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57840/0 (socket says 172.21.15.42:57840) 2023-07-29T02:04:03.716 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.730+0000 7f4f9d72f700 1 -- 172.21.15.42:0/115372844 learned_addr learned my addr 172.21.15.42:0/115372844 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:03.716 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.730+0000 7f4f97fff700 1 --2- 172.21.15.42:0/115372844 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f9815b3d0 0x7f4f980c23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:03.716 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.730+0000 7f4f9cf2e700 1 --2- 172.21.15.42:0/115372844 >> v2:172.21.15.144:3300/0 conn(0x7f4f980af920 0x7f4f980c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:03.716 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.730+0000 7f4f9d72f700 1 -- 172.21.15.42:0/115372844 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f9815b3d0 msgr2=0x7f4f980c23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:04:03.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.730+0000 7f4f9d72f700 1 --2- 172.21.15.42:0/115372844 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f9815b3d0 0x7f4f980c23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:03.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.730+0000 7f4f9d72f700 1 -- 172.21.15.42:0/115372844 >> v2:172.21.15.144:3300/0 conn(0x7f4f980af920 msgr2=0x7f4f980c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:04:03.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.730+0000 7f4f9d72f700 1 --2- 172.21.15.42:0/115372844 >> v2:172.21.15.144:3300/0 conn(0x7f4f980af920 0x7f4f980c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:03.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.730+0000 7f4f9d72f700 1 -- 172.21.15.42:0/115372844 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f980ca580 con 0x7f4f980c28e0 2023-07-29T02:04:03.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.730+0000 7f4f9d72f700 1 --2- 172.21.15.42:0/115372844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f980c28e0 0x7f4f98151080 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4f980c9d50 tx=0x7f4f9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=584e939cbc416390 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:03.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.730+0000 7f4f977fe700 1 -- 172.21.15.42:0/115372844 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9000e070 con 0x7f4f980c28e0 2023-07-29T02:04:03.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.730+0000 7f4f977fe700 1 -- 172.21.15.42:0/115372844 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9000b9c0 con 0x7f4f980c28e0 2023-07-29T02:04:03.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.730+0000 7f4f977fe700 1 -- 172.21.15.42:0/115372844 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9000bd70 con 0x7f4f980c28e0 2023-07-29T02:04:03.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.731+0000 7f4f9f192700 1 -- 172.21.15.42:0/115372844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f980c28e0 msgr2=0x7f4f98151080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:03.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.731+0000 7f4f9f192700 1 --2- 172.21.15.42:0/115372844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f980c28e0 0x7f4f98151080 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4f980c9d50 tx=0x7f4f9000b330 comp rx=0 tx=0).stop 2023-07-29T02:04:03.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.731+0000 7f4f9f192700 1 -- 172.21.15.42:0/115372844 shutdown_connections 2023-07-29T02:04:03.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.731+0000 7f4f9f192700 1 --2- 172.21.15.42:0/115372844 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f980c28e0 0x7f4f98151080 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:03.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.731+0000 7f4f9f192700 1 --2- 172.21.15.42:0/115372844 >> v2:172.21.15.144:3300/0 conn(0x7f4f980af920 0x7f4f980c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:03.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.731+0000 7f4f9f192700 1 --2- 172.21.15.42:0/115372844 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f9815b3d0 0x7f4f980c23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:03.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.731+0000 7f4f9f192700 1 -- 172.21.15.42:0/115372844 >> 172.21.15.42:0/115372844 conn(0x7f4f98061190 msgr2=0x7f4f98061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:03.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.731+0000 7f4f9f192700 1 -- 172.21.15.42:0/115372844 shutdown_connections 2023-07-29T02:04:03.719 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.731+0000 7f4f9f192700 1 -- 172.21.15.42:0/115372844 wait complete. 2023-07-29T02:04:03.721 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.732+0000 7f4f9f192700 1 Processor -- start 2023-07-29T02:04:03.721 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.732+0000 7f4f9f192700 1 -- start start 2023-07-29T02:04:03.721 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.733+0000 7f4f9f192700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f980af920 0x7f4f9814c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:03.721 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.733+0000 7f4f9f192700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f980c28e0 0x7f4f98156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:03.721 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.733+0000 7f4f9f192700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f9815b3d0 0x7f4f981f00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:03.721 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.734+0000 7f4f9f192700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f981522c0 con 0x7f4f9815b3d0 2023-07-29T02:04:03.721 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.734+0000 7f4f9f192700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f980cb0f0 con 0x7f4f980af920 2023-07-29T02:04:03.722 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.734+0000 7f4f9f192700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f980cb820 con 0x7f4f980c28e0 2023-07-29T02:04:03.722 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.734+0000 7f4f9d72f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f9815b3d0 0x7f4f981f00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:03.722 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.734+0000 7f4f9d72f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f9815b3d0 0x7f4f981f00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57846/0 (socket says 172.21.15.42:57846) 2023-07-29T02:04:03.722 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.734+0000 7f4f9d72f700 1 -- 172.21.15.42:0/3594758889 learned_addr learned my addr 172.21.15.42:0/3594758889 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:03.722 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.734+0000 7f4f97fff700 1 --2- 172.21.15.42:0/3594758889 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f980c28e0 0x7f4f98156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:03.722 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.734+0000 7f4f9cf2e700 1 --2- 172.21.15.42:0/3594758889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f980af920 0x7f4f9814c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:03.722 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.734+0000 7f4f9d72f700 1 -- 172.21.15.42:0/3594758889 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f980c28e0 msgr2=0x7f4f98156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:03.723 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.734+0000 7f4f9d72f700 1 --2- 172.21.15.42:0/3594758889 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f980c28e0 0x7f4f98156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:03.723 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.734+0000 7f4f9d72f700 1 -- 172.21.15.42:0/3594758889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f980af920 msgr2=0x7f4f9814c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:03.723 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.734+0000 7f4f9d72f700 1 --2- 172.21.15.42:0/3594758889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f980af920 0x7f4f9814c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:03.723 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.734+0000 7f4f9d72f700 1 -- 172.21.15.42:0/3594758889 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f90009b30 con 0x7f4f9815b3d0 2023-07-29T02:04:03.723 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.734+0000 7f4f9d72f700 1 --2- 172.21.15.42:0/3594758889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f9815b3d0 0x7f4f981f00c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4f9806b680 tx=0x7f4f90004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:03.723 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.734+0000 7f4f957fa700 1 -- 172.21.15.42:0/3594758889 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f900099b0 con 0x7f4f9815b3d0 2023-07-29T02:04:03.723 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.734+0000 7f4f957fa700 1 -- 172.21.15.42:0/3594758889 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f90004250 con 0x7f4f9815b3d0 2023-07-29T02:04:03.724 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.734+0000 7f4f957fa700 1 -- 172.21.15.42:0/3594758889 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90004600 con 0x7f4f9815b3d0 2023-07-29T02:04:03.724 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.734+0000 7f4f9f192700 1 -- 172.21.15.42:0/3594758889 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f981f0cd0 con 0x7f4f9815b3d0 2023-07-29T02:04:03.724 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.734+0000 7f4f9f192700 1 -- 172.21.15.42:0/3594758889 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f981541c0 con 0x7f4f9815b3d0 2023-07-29T02:04:03.724 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.735+0000 7f4f9f192700 1 -- 172.21.15.42:0/3594758889 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f980c35c0 con 0x7f4f9815b3d0 2023-07-29T02:04:03.724 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.736+0000 7f4f957fa700 1 -- 172.21.15.42:0/3594758889 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f4f90004760 con 0x7f4f9815b3d0 2023-07-29T02:04:03.724 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.736+0000 7f4f957fa700 1 --2- 172.21.15.42:0/3594758889 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4f7c06a660 0x7f4f7c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:03.724 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.736+0000 7f4f957fa700 1 -- 172.21.15.42:0/3594758889 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 7134+0+0 (secure 0 0 0) 0x7f4f9008a2b0 con 0x7f4f9815b3d0 2023-07-29T02:04:03.725 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.736+0000 7f4f9cf2e700 1 --2- 172.21.15.42:0/3594758889 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4f7c06a660 0x7f4f7c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:03.725 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.737+0000 7f4f9cf2e700 1 --2- 172.21.15.42:0/3594758889 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4f7c06a660 0x7f4f7c06cb10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009950 tx=0x7f4f8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:03.725 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.741+0000 7f4f957fa700 1 -- 172.21.15.42:0/3594758889 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f4f900553c0 con 0x7f4f9815b3d0 2023-07-29T02:04:03.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.990+0000 7f4f9f192700 1 -- 172.21.15.42:0/3594758889 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f98070720 con 0x7f4f9815b3d0 2023-07-29T02:04:03.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.991+0000 7f4f957fa700 1 -- 172.21.15.42:0/3594758889 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6169 (secure 0 0 0) 0x7f4f900589e0 con 0x7f4f9815b3d0 2023-07-29T02:04:03.975 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:04:03.975 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:02:40.487146+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5142":{"gid":5142,"name":"e","rank":0,"incarnation":16,"state":"up:active","state_seq":14,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:04:03.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.993+0000 7f4f9f192700 1 -- 172.21.15.42:0/3594758889 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4f7c06a660 msgr2=0x7f4f7c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:03.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.993+0000 7f4f9f192700 1 --2- 172.21.15.42:0/3594758889 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4f7c06a660 0x7f4f7c06cb10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009950 tx=0x7f4f8c008040 comp rx=0 tx=0).stop 2023-07-29T02:04:03.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.993+0000 7f4f9f192700 1 -- 172.21.15.42:0/3594758889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f9815b3d0 msgr2=0x7f4f981f00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:03.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.993+0000 7f4f9f192700 1 --2- 172.21.15.42:0/3594758889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f9815b3d0 0x7f4f981f00c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4f9806b680 tx=0x7f4f90004ad0 comp rx=0 tx=0).stop 2023-07-29T02:04:03.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.993+0000 7f4f9f192700 1 -- 172.21.15.42:0/3594758889 shutdown_connections 2023-07-29T02:04:03.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.993+0000 7f4f9f192700 1 --2- 172.21.15.42:0/3594758889 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4f7c06a660 0x7f4f7c06cb10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:03.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.993+0000 7f4f9f192700 1 --2- 172.21.15.42:0/3594758889 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4f9815b3d0 0x7f4f981f00c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:03.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.993+0000 7f4f9f192700 1 --2- 172.21.15.42:0/3594758889 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4f980af920 0x7f4f9814c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:03.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.993+0000 7f4f9f192700 1 --2- 172.21.15.42:0/3594758889 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4f980c28e0 0x7f4f98156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:03.979 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.993+0000 7f4f9f192700 1 -- 172.21.15.42:0/3594758889 >> 172.21.15.42:0/3594758889 conn(0x7f4f98061190 msgr2=0x7f4f980b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:03.979 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.993+0000 7f4f9f192700 1 -- 172.21.15.42:0/3594758889 shutdown_connections 2023-07-29T02:04:03.979 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:03.993+0000 7f4f9f192700 1 -- 172.21.15.42:0/3594758889 wait complete. 2023-07-29T02:04:03.979 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 20 2023-07-29T02:04:03.989 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.e (rank=0) 2023-07-29T02:04:03.990 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2023-07-29T02:04:03.990 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:04:04.002 INFO:tasks.ceph.mds.e:Stopped 2023-07-29T02:04:04.003 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:04:04.167 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.183+0000 7ff9ef7bd700 1 Processor -- start 2023-07-29T02:04:04.168 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.184+0000 7ff9ef7bd700 1 -- start start 2023-07-29T02:04:04.169 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.184+0000 7ff9ef7bd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9e81533f0 0x7ff9e8072980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:04.169 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.184+0000 7ff9ef7bd700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff9e80c8450 0x7ff9e80719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:04.169 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.184+0000 7ff9ef7bd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff9e806d2c0 0x7ff9e806a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:04.169 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.184+0000 7ff9ef7bd700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e8071190 con 0x7ff9e806d2c0 2023-07-29T02:04:04.170 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.184+0000 7ff9ef7bd700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e8071410 con 0x7ff9e80c8450 2023-07-29T02:04:04.170 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.184+0000 7ff9ef7bd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e80716f0 con 0x7ff9e81533f0 2023-07-29T02:04:04.170 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.185+0000 7ff9edd5a700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff9e806d2c0 0x7ff9e806a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:04.170 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.185+0000 7ff9edd5a700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff9e806d2c0 0x7ff9e806a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57854/0 (socket says 172.21.15.42:57854) 2023-07-29T02:04:04.170 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.185+0000 7ff9edd5a700 1 -- 172.21.15.42:0/4201464544 learned_addr learned my addr 172.21.15.42:0/4201464544 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:04.170 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.185+0000 7ff9ed559700 1 --2- 172.21.15.42:0/4201464544 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9e81533f0 0x7ff9e8072980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:04.170 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.185+0000 7ff9ecd58700 1 --2- 172.21.15.42:0/4201464544 >> v2:172.21.15.144:3300/0 conn(0x7ff9e80c8450 0x7ff9e80719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:04.171 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.185+0000 7ff9ed559700 1 -- 172.21.15.42:0/4201464544 >> v2:172.21.15.144:3300/0 conn(0x7ff9e80c8450 msgr2=0x7ff9e80719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:04:04.171 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.185+0000 7ff9ed559700 1 --2- 172.21.15.42:0/4201464544 >> v2:172.21.15.144:3300/0 conn(0x7ff9e80c8450 0x7ff9e80719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:04.171 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.185+0000 7ff9ed559700 1 -- 172.21.15.42:0/4201464544 >> v2:172.21.15.42:3300/0 conn(0x7ff9e806d2c0 msgr2=0x7ff9e806a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:04:04.171 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.185+0000 7ff9ed559700 1 --2- 172.21.15.42:0/4201464544 >> v2:172.21.15.42:3300/0 conn(0x7ff9e806d2c0 0x7ff9e806a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:04.171 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.185+0000 7ff9ed559700 1 -- 172.21.15.42:0/4201464544 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e80c68d0 con 0x7ff9e81533f0 2023-07-29T02:04:04.171 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.185+0000 7ff9edd5a700 1 --2- 172.21.15.42:0/4201464544 >> v2:172.21.15.42:3300/0 conn(0x7ff9e806d2c0 0x7ff9e806a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:04:04.171 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.185+0000 7ff9ed559700 1 --2- 172.21.15.42:0/4201464544 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9e81533f0 0x7ff9e8072980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff9e806fbe0 tx=0x7ff9e4009b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=732059d8d555c210 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:04.171 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.185+0000 7ff9dffff700 1 -- 172.21.15.42:0/4201464544 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4011830 con 0x7ff9e81533f0 2023-07-29T02:04:04.172 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.185+0000 7ff9dffff700 1 -- 172.21.15.42:0/4201464544 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e4011990 con 0x7ff9e81533f0 2023-07-29T02:04:04.172 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.185+0000 7ff9dffff700 1 -- 172.21.15.42:0/4201464544 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4011d20 con 0x7ff9e81533f0 2023-07-29T02:04:04.174 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.186+0000 7ff9ef7bd700 1 -- 172.21.15.42:0/4201464544 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9e81533f0 msgr2=0x7ff9e8072980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:04.174 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.186+0000 7ff9ef7bd700 1 --2- 172.21.15.42:0/4201464544 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9e81533f0 0x7ff9e8072980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff9e806fbe0 tx=0x7ff9e4009b20 comp rx=0 tx=0).stop 2023-07-29T02:04:04.174 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.186+0000 7ff9ef7bd700 1 -- 172.21.15.42:0/4201464544 shutdown_connections 2023-07-29T02:04:04.174 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.186+0000 7ff9ef7bd700 1 --2- 172.21.15.42:0/4201464544 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9e81533f0 0x7ff9e8072980 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:04.174 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.186+0000 7ff9ef7bd700 1 --2- 172.21.15.42:0/4201464544 >> v2:172.21.15.42:3300/0 conn(0x7ff9e806d2c0 0x7ff9e806a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:04.175 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.186+0000 7ff9ef7bd700 1 --2- 172.21.15.42:0/4201464544 >> v2:172.21.15.144:3300/0 conn(0x7ff9e80c8450 0x7ff9e80719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:04.175 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.186+0000 7ff9ef7bd700 1 -- 172.21.15.42:0/4201464544 >> 172.21.15.42:0/4201464544 conn(0x7ff9e80c8930 msgr2=0x7ff9e80c8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:04.175 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.186+0000 7ff9ef7bd700 1 -- 172.21.15.42:0/4201464544 shutdown_connections 2023-07-29T02:04:04.175 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.186+0000 7ff9ef7bd700 1 -- 172.21.15.42:0/4201464544 wait complete. 2023-07-29T02:04:04.175 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.188+0000 7ff9ef7bd700 1 Processor -- start 2023-07-29T02:04:04.175 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.188+0000 7ff9ef7bd700 1 -- start start 2023-07-29T02:04:04.175 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9ef7bd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9e806d2c0 0x7ff9e814d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:04.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9ef7bd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9e81533f0 0x7ff9e8144d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:04.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9ef7bd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9e814b170 0x7ff9e80c0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:04.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9ef7bd700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e80c1ca0 con 0x7ff9e814b170 2023-07-29T02:04:04.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9ef7bd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e8145270 con 0x7ff9e806d2c0 2023-07-29T02:04:04.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9ef7bd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e81f2d60 con 0x7ff9e81533f0 2023-07-29T02:04:04.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9edd5a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9e814b170 0x7ff9e80c0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:04.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9edd5a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9e814b170 0x7ff9e80c0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57860/0 (socket says 172.21.15.42:57860) 2023-07-29T02:04:04.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9edd5a700 1 -- 172.21.15.42:0/318836500 learned_addr learned my addr 172.21.15.42:0/318836500 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:04.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9ed559700 1 --2- 172.21.15.42:0/318836500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9e806d2c0 0x7ff9e814d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:04.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9ecd58700 1 --2- 172.21.15.42:0/318836500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9e81533f0 0x7ff9e8144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:04.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9edd5a700 1 -- 172.21.15.42:0/318836500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9e81533f0 msgr2=0x7ff9e8144d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:04.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9edd5a700 1 --2- 172.21.15.42:0/318836500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9e81533f0 0x7ff9e8144d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:04.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9edd5a700 1 -- 172.21.15.42:0/318836500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9e806d2c0 msgr2=0x7ff9e814d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:04.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9edd5a700 1 --2- 172.21.15.42:0/318836500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9e806d2c0 0x7ff9e814d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:04.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9edd5a700 1 -- 172.21.15.42:0/318836500 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e0009b30 con 0x7ff9e814b170 2023-07-29T02:04:04.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9edd5a700 1 --2- 172.21.15.42:0/318836500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9e814b170 0x7ff9e80c0e50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000eed0 tx=0x7ff9e000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:04.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9ddffb700 1 -- 172.21.15.42:0/318836500 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0018070 con 0x7ff9e814b170 2023-07-29T02:04:04.179 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9ddffb700 1 -- 172.21.15.42:0/318836500 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9e0003a20 con 0x7ff9e814b170 2023-07-29T02:04:04.179 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9ef7bd700 1 -- 172.21.15.42:0/318836500 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e40094a0 con 0x7ff9e814b170 2023-07-29T02:04:04.179 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.189+0000 7ff9ddffb700 1 -- 172.21.15.42:0/318836500 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0010040 con 0x7ff9e814b170 2023-07-29T02:04:04.179 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.190+0000 7ff9ef7bd700 1 -- 172.21.15.42:0/318836500 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e81f2150 con 0x7ff9e814b170 2023-07-29T02:04:04.180 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.191+0000 7ff9ef7bd700 1 -- 172.21.15.42:0/318836500 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e81f2f10 con 0x7ff9e814b170 2023-07-29T02:04:04.180 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.191+0000 7ff9ddffb700 1 -- 172.21.15.42:0/318836500 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7ff9e000b920 con 0x7ff9e814b170 2023-07-29T02:04:04.180 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.191+0000 7ff9ddffb700 1 --2- 172.21.15.42:0/318836500 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff9cc06a660 0x7ff9cc06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:04.180 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.191+0000 7ff9ddffb700 1 -- 172.21.15.42:0/318836500 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 7134+0+0 (secure 0 0 0) 0x7ff9e0088c40 con 0x7ff9e814b170 2023-07-29T02:04:04.180 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.191+0000 7ff9ed559700 1 --2- 172.21.15.42:0/318836500 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff9cc06a660 0x7ff9cc06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:04.181 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.192+0000 7ff9ed559700 1 --2- 172.21.15.42:0/318836500 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff9cc06a660 0x7ff9cc06cb10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff9e40090b0 tx=0x7ff9e4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:04.181 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.196+0000 7ff9ddffb700 1 -- 172.21.15.42:0/318836500 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7ff9e81f2f10 con 0x7ff9e814b170 2023-07-29T02:04:04.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.454+0000 7ff9ef7bd700 1 -- 172.21.15.42:0/318836500 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9e81f2ed0 con 0x7ff9e814b170 2023-07-29T02:04:04.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.454+0000 7ff9ddffb700 1 -- 172.21.15.42:0/318836500 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6169 (secure 0 0 0) 0x7ff9e0053ca0 con 0x7ff9e814b170 2023-07-29T02:04:04.438 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:04:04.439 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:02:40.487146+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5142":{"gid":5142,"name":"e","rank":0,"incarnation":16,"state":"up:active","state_seq":14,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:04:04.440 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.456+0000 7ff9ef7bd700 1 -- 172.21.15.42:0/318836500 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff9cc06a660 msgr2=0x7ff9cc06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:04.440 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.456+0000 7ff9ef7bd700 1 --2- 172.21.15.42:0/318836500 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff9cc06a660 0x7ff9cc06cb10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff9e40090b0 tx=0x7ff9e4008030 comp rx=0 tx=0).stop 2023-07-29T02:04:04.441 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.456+0000 7ff9ef7bd700 1 -- 172.21.15.42:0/318836500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9e814b170 msgr2=0x7ff9e80c0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:04.441 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.456+0000 7ff9ef7bd700 1 --2- 172.21.15.42:0/318836500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9e814b170 0x7ff9e80c0e50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff9e000eed0 tx=0x7ff9e000b390 comp rx=0 tx=0).stop 2023-07-29T02:04:04.441 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.456+0000 7ff9ef7bd700 1 -- 172.21.15.42:0/318836500 shutdown_connections 2023-07-29T02:04:04.441 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.456+0000 7ff9ef7bd700 1 --2- 172.21.15.42:0/318836500 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff9cc06a660 0x7ff9cc06cb10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:04.441 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.456+0000 7ff9ef7bd700 1 --2- 172.21.15.42:0/318836500 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff9e814b170 0x7ff9e80c0e50 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:04.441 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.456+0000 7ff9ef7bd700 1 --2- 172.21.15.42:0/318836500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff9e806d2c0 0x7ff9e814d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:04.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.456+0000 7ff9ef7bd700 1 --2- 172.21.15.42:0/318836500 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff9e81533f0 0x7ff9e8144d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:04.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.456+0000 7ff9ef7bd700 1 -- 172.21.15.42:0/318836500 >> 172.21.15.42:0/318836500 conn(0x7ff9e80c8930 msgr2=0x7ff9e80c8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:04.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.456+0000 7ff9ef7bd700 1 -- 172.21.15.42:0/318836500 shutdown_connections 2023-07-29T02:04:04.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:04.456+0000 7ff9ef7bd700 1 -- 172.21.15.42:0/318836500 wait complete. 2023-07-29T02:04:04.442 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 20 2023-07-29T02:04:04.453 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2023-07-29T02:04:06.454 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:04:06.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.610+0000 7f7cc7543700 1 Processor -- start 2023-07-29T02:04:06.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.611+0000 7f7cc7543700 1 -- start start 2023-07-29T02:04:06.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.611+0000 7f7cc7543700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7cc00b2b30 0x7f7cc0157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:06.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.611+0000 7f7cc7543700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7cc0157d40 0x7f7cc006fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:06.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.611+0000 7f7cc7543700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc00c1fb0 con 0x7f7cc014dce0 2023-07-29T02:04:06.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.611+0000 7f7cc7543700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc0157370 con 0x7f7cc0157d40 2023-07-29T02:04:06.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.611+0000 7f7cc7543700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc00c80a0 con 0x7f7cc00b2b30 2023-07-29T02:04:06.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.612+0000 7f7cc5ae0700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7cc0157d40 0x7f7cc006fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:06.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.612+0000 7f7cc5ae0700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f7cc0157d40 0x7f7cc006fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57876/0 (socket says 172.21.15.42:57876) 2023-07-29T02:04:06.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.612+0000 7f7cc5ae0700 1 -- 172.21.15.42:0/2897642928 learned_addr learned my addr 172.21.15.42:0/2897642928 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:06.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.612+0000 7f7cc4ade700 1 --2- 172.21.15.42:0/2897642928 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7cc00b2b30 0x7f7cc0157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:06.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.612+0000 7f7cc5ae0700 1 -- 172.21.15.42:0/2897642928 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7cc00b2b30 msgr2=0x7f7cc0157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:04:06.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.612+0000 7f7cc5ae0700 1 --2- 172.21.15.42:0/2897642928 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7cc00b2b30 0x7f7cc0157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:06.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.612+0000 7f7cc5ae0700 1 -- 172.21.15.42:0/2897642928 >> v1:172.21.15.144:6789/0 conn(0x7f7cc014dce0 legacy=0x7f7cc00c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:06.598 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.612+0000 7f7cc5ae0700 1 -- 172.21.15.42:0/2897642928 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc00c2200 con 0x7f7cc0157d40 2023-07-29T02:04:06.598 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.612+0000 7f7cc5ae0700 1 --2- 172.21.15.42:0/2897642928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cc0157d40 0x7f7cc006fe60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8009e50 tx=0x7f7cb800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a4978dd321cccc server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:06.598 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.612+0000 7f7cb3fff700 1 -- 172.21.15.42:0/2897642928 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb800e070 con 0x7f7cc0157d40 2023-07-29T02:04:06.598 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.612+0000 7f7cb3fff700 1 -- 172.21.15.42:0/2897642928 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb800b9c0 con 0x7f7cc0157d40 2023-07-29T02:04:06.598 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.612+0000 7f7cb3fff700 1 -- 172.21.15.42:0/2897642928 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb800bd70 con 0x7f7cc0157d40 2023-07-29T02:04:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.613+0000 7f7cc7543700 1 -- 172.21.15.42:0/2897642928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cc0157d40 msgr2=0x7f7cc006fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.613+0000 7f7cc7543700 1 --2- 172.21.15.42:0/2897642928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cc0157d40 0x7f7cc006fe60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8009e50 tx=0x7f7cb800b330 comp rx=0 tx=0).stop 2023-07-29T02:04:06.600 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.613+0000 7f7cc7543700 1 -- 172.21.15.42:0/2897642928 shutdown_connections 2023-07-29T02:04:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.613+0000 7f7cc7543700 1 --2- 172.21.15.42:0/2897642928 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cc0157d40 0x7f7cc006fe60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.613+0000 7f7cc7543700 1 --2- 172.21.15.42:0/2897642928 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7cc00b2b30 0x7f7cc0157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.613+0000 7f7cc7543700 1 -- 172.21.15.42:0/2897642928 >> 172.21.15.42:0/2897642928 conn(0x7f7cc006a750 msgr2=0x7f7cc006ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.613+0000 7f7cc7543700 1 -- 172.21.15.42:0/2897642928 shutdown_connections 2023-07-29T02:04:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.613+0000 7f7cc7543700 1 -- 172.21.15.42:0/2897642928 wait complete. 2023-07-29T02:04:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.614+0000 7f7cc7543700 1 Processor -- start 2023-07-29T02:04:06.601 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.614+0000 7f7cc7543700 1 -- start start 2023-07-29T02:04:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.615+0000 7f7cc7543700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7cc00b2b30 0x7f7cc01470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.615+0000 7f7cc7543700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cc014dce0 0x7f7cc0145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.615+0000 7f7cc7543700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7cc0157d40 0x7f7cc0148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.615+0000 7f7cc7543700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc01481e0 con 0x7f7cc014dce0 2023-07-29T02:04:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.615+0000 7f7cc7543700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc01475e0 con 0x7f7cc0157d40 2023-07-29T02:04:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.615+0000 7f7cc7543700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc00c9c70 con 0x7f7cc00b2b30 2023-07-29T02:04:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.615+0000 7f7cc4ade700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cc014dce0 0x7f7cc0145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:06.602 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.615+0000 7f7cc4ade700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cc014dce0 0x7f7cc0145e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57880/0 (socket says 172.21.15.42:57880) 2023-07-29T02:04:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.615+0000 7f7cc4ade700 1 -- 172.21.15.42:0/1372510399 learned_addr learned my addr 172.21.15.42:0/1372510399 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.615+0000 7f7cc52df700 1 --2- 172.21.15.42:0/1372510399 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7cc00b2b30 0x7f7cc01470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.615+0000 7f7cc5ae0700 1 --2- 172.21.15.42:0/1372510399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7cc0157d40 0x7f7cc0148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.615+0000 7f7cc4ade700 1 -- 172.21.15.42:0/1372510399 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7cc00b2b30 msgr2=0x7f7cc01470a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.615+0000 7f7cc4ade700 1 --2- 172.21.15.42:0/1372510399 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7cc00b2b30 0x7f7cc01470a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.615+0000 7f7cc4ade700 1 -- 172.21.15.42:0/1372510399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7cc0157d40 msgr2=0x7f7cc0148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.615+0000 7f7cc4ade700 1 --2- 172.21.15.42:0/1372510399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7cc0157d40 0x7f7cc0148600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:06.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.615+0000 7f7cc4ade700 1 -- 172.21.15.42:0/1372510399 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb8009b30 con 0x7f7cc014dce0 2023-07-29T02:04:06.604 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.615+0000 7f7cc5ae0700 1 --2- 172.21.15.42:0/1372510399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7cc0157d40 0x7f7cc0148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:04:06.604 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.616+0000 7f7cc4ade700 1 --2- 172.21.15.42:0/1372510399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cc014dce0 0x7f7cc0145e60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400e810 tx=0x7f7cb400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:06.604 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.616+0000 7f7cb1ffb700 1 -- 172.21.15.42:0/1372510399 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4013610 con 0x7f7cc014dce0 2023-07-29T02:04:06.604 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.616+0000 7f7cb1ffb700 1 -- 172.21.15.42:0/1372510399 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb4013770 con 0x7f7cc014dce0 2023-07-29T02:04:06.604 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.616+0000 7f7cb1ffb700 1 -- 172.21.15.42:0/1372510399 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4013ae0 con 0x7f7cc014dce0 2023-07-29T02:04:06.604 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.616+0000 7f7cc7543700 1 -- 172.21.15.42:0/1372510399 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc00cd940 con 0x7f7cc014dce0 2023-07-29T02:04:06.604 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.616+0000 7f7cc7543700 1 -- 172.21.15.42:0/1372510399 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc0147e00 con 0x7f7cc014dce0 2023-07-29T02:04:06.605 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.617+0000 7f7cc7543700 1 -- 172.21.15.42:0/1372510399 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc0147c40 con 0x7f7cc014dce0 2023-07-29T02:04:06.605 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.617+0000 7f7cb1ffb700 1 -- 172.21.15.42:0/1372510399 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f7cb4013c40 con 0x7f7cc014dce0 2023-07-29T02:04:06.606 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.618+0000 7f7cb1ffb700 1 --2- 172.21.15.42:0/1372510399 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7ca406a690 0x7f7ca406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:06.606 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.618+0000 7f7cb1ffb700 1 -- 172.21.15.42:0/1372510399 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7078+0+0 (secure 0 0 0) 0x7f7cb4088c90 con 0x7f7cc014dce0 2023-07-29T02:04:06.606 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.618+0000 7f7cc52df700 1 --2- 172.21.15.42:0/1372510399 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7ca406a690 0x7f7ca406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:06.606 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.619+0000 7f7cc52df700 1 --2- 172.21.15.42:0/1372510399 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7ca406a690 0x7f7ca406cb40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc000f60 tx=0x7f7cbc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:06.606 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.622+0000 7f7cb1ffb700 1 -- 172.21.15.42:0/1372510399 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f7cb4053bf0 con 0x7f7cc014dce0 2023-07-29T02:04:06.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.869+0000 7f7cc7543700 1 -- 172.21.15.42:0/1372510399 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7cc004ea50 con 0x7f7cc014dce0 2023-07-29T02:04:06.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.870+0000 7f7cb1ffb700 1 -- 172.21.15.42:0/1372510399 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6169 (secure 0 0 0) 0x7f7cb4057210 con 0x7f7cc014dce0 2023-07-29T02:04:06.854 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:04:06.854 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:02:40.487146+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5142":{"gid":5142,"name":"e","rank":0,"incarnation":16,"state":"up:active","state_seq":14,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:04:06.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.872+0000 7f7cc7543700 1 -- 172.21.15.42:0/1372510399 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7ca406a690 msgr2=0x7f7ca406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:06.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.872+0000 7f7cc7543700 1 --2- 172.21.15.42:0/1372510399 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7ca406a690 0x7f7ca406cb40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc000f60 tx=0x7f7cbc009040 comp rx=0 tx=0).stop 2023-07-29T02:04:06.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.872+0000 7f7cc7543700 1 -- 172.21.15.42:0/1372510399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cc014dce0 msgr2=0x7f7cc0145e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:06.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.872+0000 7f7cc7543700 1 --2- 172.21.15.42:0/1372510399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cc014dce0 0x7f7cc0145e60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400e810 tx=0x7f7cb400ebd0 comp rx=0 tx=0).stop 2023-07-29T02:04:06.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.872+0000 7f7cc7543700 1 -- 172.21.15.42:0/1372510399 shutdown_connections 2023-07-29T02:04:06.857 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.872+0000 7f7cc7543700 1 --2- 172.21.15.42:0/1372510399 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f7ca406a690 0x7f7ca406cb40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:06.857 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.872+0000 7f7cc7543700 1 --2- 172.21.15.42:0/1372510399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7cc0157d40 0x7f7cc0148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:06.857 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.872+0000 7f7cc7543700 1 --2- 172.21.15.42:0/1372510399 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7cc00b2b30 0x7f7cc01470a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:06.857 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.872+0000 7f7cc7543700 1 --2- 172.21.15.42:0/1372510399 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7cc014dce0 0x7f7cc0145e60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:06.857 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.872+0000 7f7cc7543700 1 -- 172.21.15.42:0/1372510399 >> 172.21.15.42:0/1372510399 conn(0x7f7cc006a750 msgr2=0x7f7cc006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:06.857 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.872+0000 7f7cc7543700 1 -- 172.21.15.42:0/1372510399 shutdown_connections 2023-07-29T02:04:06.857 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:06.872+0000 7f7cc7543700 1 -- 172.21.15.42:0/1372510399 wait complete. 2023-07-29T02:04:06.858 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 20 2023-07-29T02:04:06.868 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2023-07-29T02:04:06.986 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:04:06.989 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:04:08.869 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:04:09.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.024+0000 7f8c6f3fd700 1 Processor -- start 2023-07-29T02:04:09.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.025+0000 7f8c6f3fd700 1 -- start start 2023-07-29T02:04:09.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.025+0000 7f8c6f3fd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c6814dce0 0x7f8c680c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:09.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.026+0000 7f8c6f3fd700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c680c1fb0 con 0x7f8c680b2b30 2023-07-29T02:04:09.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.026+0000 7f8c6f3fd700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c68157370 con 0x7f8c680c7ed0 2023-07-29T02:04:09.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.026+0000 7f8c6f3fd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c680c2200 con 0x7f8c6814dce0 2023-07-29T02:04:09.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.026+0000 7f8c6d99a700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f8c680b2b30 0x7f8c6806fe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51696/0 (socket says 172.21.15.42:51696) 2023-07-29T02:04:09.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.026+0000 7f8c6d99a700 1 -- 172.21.15.42:0/474083726 learned_addr learned my addr 172.21.15.42:0/474083726 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:04:09.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.026+0000 7f8c6d199700 1 --2- 172.21.15.42:0/474083726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c6814dce0 0x7f8c680c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:09.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.026+0000 7f8c5bfff700 1 -- 172.21.15.42:0/474083726 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753356325 0 0) 0x7f8c680c1fb0 con 0x7f8c680b2b30 2023-07-29T02:04:09.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.026+0000 7f8c5bfff700 1 -- 172.21.15.42:0/474083726 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c540035b0 con 0x7f8c680b2b30 2023-07-29T02:04:09.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.026+0000 7f8c5bfff700 1 -- 172.21.15.42:0/474083726 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3366699466 0 0) 0x7f8c68157370 con 0x7f8c680c7ed0 2023-07-29T02:04:09.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.026+0000 7f8c5bfff700 1 -- 172.21.15.42:0/474083726 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c680c1fb0 con 0x7f8c680c7ed0 2023-07-29T02:04:09.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.026+0000 7f8c6d199700 1 -- 172.21.15.42:0/474083726 >> v1:172.21.15.144:6789/0 conn(0x7f8c680c7ed0 legacy=0x7f8c68157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:09.012 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.026+0000 7f8c6d199700 1 -- 172.21.15.42:0/474083726 >> v1:172.21.15.42:6789/0 conn(0x7f8c680b2b30 legacy=0x7f8c6806fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:09.012 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.026+0000 7f8c5bfff700 1 -- 172.21.15.42:0/474083726 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 346195539 0 0) 0x7f8c540035b0 con 0x7f8c680b2b30 2023-07-29T02:04:09.012 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.026+0000 7f8c6d199700 1 -- 172.21.15.42:0/474083726 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c680c24e0 con 0x7f8c6814dce0 2023-07-29T02:04:09.014 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.027+0000 7f8c6d199700 1 --2- 172.21.15.42:0/474083726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c6814dce0 0x7f8c680c7990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8c64009870 tx=0x7f8c64009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4674bfc21be102f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:09.014 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.027+0000 7f8c5bfff700 1 -- 172.21.15.42:0/474083726 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c600019f0 con 0x7f8c6814dce0 2023-07-29T02:04:09.014 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.027+0000 7f8c5bfff700 1 -- 172.21.15.42:0/474083726 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c64004030 con 0x7f8c6814dce0 2023-07-29T02:04:09.014 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.027+0000 7f8c5bfff700 1 -- 172.21.15.42:0/474083726 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c640043c0 con 0x7f8c6814dce0 2023-07-29T02:04:09.015 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.027+0000 7f8c6f3fd700 1 -- 172.21.15.42:0/474083726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c6814dce0 msgr2=0x7f8c680c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:09.015 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.027+0000 7f8c6f3fd700 1 --2- 172.21.15.42:0/474083726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c6814dce0 0x7f8c680c7990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8c64009870 tx=0x7f8c64009b80 comp rx=0 tx=0).stop 2023-07-29T02:04:09.015 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.027+0000 7f8c6f3fd700 1 -- 172.21.15.42:0/474083726 shutdown_connections 2023-07-29T02:04:09.015 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.027+0000 7f8c6f3fd700 1 --2- 172.21.15.42:0/474083726 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c6814dce0 0x7f8c680c7990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:09.015 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.027+0000 7f8c6f3fd700 1 -- 172.21.15.42:0/474083726 >> 172.21.15.42:0/474083726 conn(0x7f8c6806a750 msgr2=0x7f8c6806ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:09.015 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.028+0000 7f8c6f3fd700 1 -- 172.21.15.42:0/474083726 shutdown_connections 2023-07-29T02:04:09.015 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.028+0000 7f8c6f3fd700 1 -- 172.21.15.42:0/474083726 wait complete. 2023-07-29T02:04:09.015 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.029+0000 7f8c6f3fd700 1 Processor -- start 2023-07-29T02:04:09.016 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.029+0000 7f8c6f3fd700 1 -- start start 2023-07-29T02:04:09.016 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.029+0000 7f8c6f3fd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c680b2b30 0x7f8c681ef2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:09.016 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c6f3fd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c680c7ed0 0x7f8c680cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:09.016 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c6f3fd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c6814dce0 0x7f8c680c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:09.016 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c6f3fd700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c681eeeb0 con 0x7f8c6814dce0 2023-07-29T02:04:09.016 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c6f3fd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c68150f40 con 0x7f8c680b2b30 2023-07-29T02:04:09.016 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c6f3fd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c681ee830 con 0x7f8c680c7ed0 2023-07-29T02:04:09.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c6d99a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c6814dce0 0x7f8c680c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:09.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c6d99a700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c6814dce0 0x7f8c680c9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57898/0 (socket says 172.21.15.42:57898) 2023-07-29T02:04:09.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c6d99a700 1 -- 172.21.15.42:0/4194416405 learned_addr learned my addr 172.21.15.42:0/4194416405 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:09.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c6c998700 1 --2- 172.21.15.42:0/4194416405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c680c7ed0 0x7f8c680cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:09.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c6d199700 1 --2- 172.21.15.42:0/4194416405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c680b2b30 0x7f8c681ef2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:09.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c6d99a700 1 -- 172.21.15.42:0/4194416405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c680c7ed0 msgr2=0x7f8c680cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:09.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c6d99a700 1 --2- 172.21.15.42:0/4194416405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c680c7ed0 0x7f8c680cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:09.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c6d99a700 1 -- 172.21.15.42:0/4194416405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c680b2b30 msgr2=0x7f8c681ef2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:09.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c6d99a700 1 --2- 172.21.15.42:0/4194416405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c680b2b30 0x7f8c681ef2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:09.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c6d99a700 1 -- 172.21.15.42:0/4194416405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c640094a0 con 0x7f8c6814dce0 2023-07-29T02:04:09.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c6c998700 1 --2- 172.21.15.42:0/4194416405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c680c7ed0 0x7f8c680cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:04:09.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c6d99a700 1 --2- 172.21.15.42:0/4194416405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c6814dce0 0x7f8c680c9ee0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8c600017f0 tx=0x7f8c6000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:09.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c59ffb700 1 -- 172.21.15.42:0/4194416405 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c600019f0 con 0x7f8c6814dce0 2023-07-29T02:04:09.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c59ffb700 1 -- 172.21.15.42:0/4194416405 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6000ae00 con 0x7f8c6814dce0 2023-07-29T02:04:09.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c6f3fd700 1 -- 172.21.15.42:0/4194416405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c681511e0 con 0x7f8c6814dce0 2023-07-29T02:04:09.019 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.030+0000 7f8c59ffb700 1 -- 172.21.15.42:0/4194416405 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60007310 con 0x7f8c6814dce0 2023-07-29T02:04:09.019 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.031+0000 7f8c6f3fd700 1 -- 172.21.15.42:0/4194416405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c681514c0 con 0x7f8c6814dce0 2023-07-29T02:04:09.020 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.031+0000 7f8c6f3fd700 1 -- 172.21.15.42:0/4194416405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c681eeff0 con 0x7f8c6814dce0 2023-07-29T02:04:09.020 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.032+0000 7f8c59ffb700 1 -- 172.21.15.42:0/4194416405 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f8c60007470 con 0x7f8c6814dce0 2023-07-29T02:04:09.020 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.032+0000 7f8c59ffb700 1 --2- 172.21.15.42:0/4194416405 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c4c06a660 0x7f8c4c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:09.020 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.032+0000 7f8c59ffb700 1 -- 172.21.15.42:0/4194416405 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7078+0+0 (secure 0 0 0) 0x7f8c60088ee0 con 0x7f8c6814dce0 2023-07-29T02:04:09.020 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.033+0000 7f8c6d199700 1 --2- 172.21.15.42:0/4194416405 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c4c06a660 0x7f8c4c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:09.020 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.033+0000 7f8c6d199700 1 --2- 172.21.15.42:0/4194416405 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c4c06a660 0x7f8c4c06cb10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8c640097c0 tx=0x7f8c64013040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:09.021 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.037+0000 7f8c59ffb700 1 -- 172.21.15.42:0/4194416405 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f8c681eeff0 con 0x7f8c6814dce0 2023-07-29T02:04:09.264 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.280+0000 7f8c6f3fd700 1 -- 172.21.15.42:0/4194416405 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c681eeff0 con 0x7f8c6814dce0 2023-07-29T02:04:09.265 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.281+0000 7f8c59ffb700 1 -- 172.21.15.42:0/4194416405 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6169 (secure 0 0 0) 0x7f8c681eeff0 con 0x7f8c6814dce0 2023-07-29T02:04:09.265 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:04:09.265 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:02:40.487146+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5142":{"gid":5142,"name":"e","rank":0,"incarnation":16,"state":"up:active","state_seq":14,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:04:09.267 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.283+0000 7f8c6f3fd700 1 -- 172.21.15.42:0/4194416405 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c4c06a660 msgr2=0x7f8c4c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:09.267 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.283+0000 7f8c6f3fd700 1 --2- 172.21.15.42:0/4194416405 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c4c06a660 0x7f8c4c06cb10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8c640097c0 tx=0x7f8c64013040 comp rx=0 tx=0).stop 2023-07-29T02:04:09.267 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.283+0000 7f8c6f3fd700 1 -- 172.21.15.42:0/4194416405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c6814dce0 msgr2=0x7f8c680c9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:09.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.283+0000 7f8c6f3fd700 1 --2- 172.21.15.42:0/4194416405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c6814dce0 0x7f8c680c9ee0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8c600017f0 tx=0x7f8c6000a340 comp rx=0 tx=0).stop 2023-07-29T02:04:09.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.283+0000 7f8c6f3fd700 1 -- 172.21.15.42:0/4194416405 shutdown_connections 2023-07-29T02:04:09.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.283+0000 7f8c6f3fd700 1 --2- 172.21.15.42:0/4194416405 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8c4c06a660 0x7f8c4c06cb10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:09.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.283+0000 7f8c6f3fd700 1 --2- 172.21.15.42:0/4194416405 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8c6814dce0 0x7f8c680c9ee0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:09.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.283+0000 7f8c6f3fd700 1 --2- 172.21.15.42:0/4194416405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c680b2b30 0x7f8c681ef2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:09.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.283+0000 7f8c6f3fd700 1 --2- 172.21.15.42:0/4194416405 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8c680c7ed0 0x7f8c680cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:09.268 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.283+0000 7f8c6f3fd700 1 -- 172.21.15.42:0/4194416405 >> 172.21.15.42:0/4194416405 conn(0x7f8c6806a750 msgr2=0x7f8c680738a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:09.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.283+0000 7f8c6f3fd700 1 -- 172.21.15.42:0/4194416405 shutdown_connections 2023-07-29T02:04:09.269 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:09.283+0000 7f8c6f3fd700 1 -- 172.21.15.42:0/4194416405 wait complete. 2023-07-29T02:04:09.269 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 20 2023-07-29T02:04:09.279 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2023-07-29T02:04:11.281 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:04:11.420 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.436+0000 7f9a325ea700 1 Processor -- start 2023-07-29T02:04:11.420 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.436+0000 7f9a325ea700 1 -- start start 2023-07-29T02:04:11.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.437+0000 7f9a325ea700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9a2c153460 0x7f9a2c06de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:11.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.437+0000 7f9a325ea700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9a2c06e950 0x7f9a2c159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:11.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.437+0000 7f9a325ea700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2c15c770 con 0x7f9a2c0cdc70 2023-07-29T02:04:11.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.437+0000 7f9a325ea700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a2c15c9c0 con 0x7f9a2c153460 2023-07-29T02:04:11.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.437+0000 7f9a325ea700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a2c15cca0 con 0x7f9a2c06e950 2023-07-29T02:04:11.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.437+0000 7f9a2bfff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9a2c153460 0x7f9a2c06de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:11.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.437+0000 7f9a2b7fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f9a2c0cdc70 0x7f9a2c06d090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51708/0 (socket says 172.21.15.42:51708) 2023-07-29T02:04:11.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.437+0000 7f9a2b7fe700 1 -- 172.21.15.42:0/246795645 learned_addr learned my addr 172.21.15.42:0/246795645 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:04:11.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.438+0000 7f9a30b87700 1 --2- 172.21.15.42:0/246795645 >> v2:172.21.15.144:3300/0 conn(0x7f9a2c06e950 0x7f9a2c159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:11.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.438+0000 7f9a2bfff700 1 -- 172.21.15.42:0/246795645 >> v2:172.21.15.144:3300/0 conn(0x7f9a2c06e950 msgr2=0x7f9a2c159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:04:11.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.438+0000 7f9a2bfff700 1 --2- 172.21.15.42:0/246795645 >> v2:172.21.15.144:3300/0 conn(0x7f9a2c06e950 0x7f9a2c159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:11.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.438+0000 7f9a2bfff700 1 -- 172.21.15.42:0/246795645 >> v1:172.21.15.42:6789/0 conn(0x7f9a2c0cdc70 legacy=0x7f9a2c06d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:11.423 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.438+0000 7f9a2affd700 1 -- 172.21.15.42:0/246795645 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834965606 0 0) 0x7f9a2c15c770 con 0x7f9a2c0cdc70 2023-07-29T02:04:11.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.438+0000 7f9a2bfff700 1 -- 172.21.15.42:0/246795645 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c15cf80 con 0x7f9a2c153460 2023-07-29T02:04:11.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.438+0000 7f9a2bfff700 1 --2- 172.21.15.42:0/246795645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a2c153460 0x7f9a2c06de30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c06c810 tx=0x7f9a14009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee013414ea039357 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:11.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.438+0000 7f9a2affd700 1 -- 172.21.15.42:0/246795645 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14011830 con 0x7f9a2c153460 2023-07-29T02:04:11.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.438+0000 7f9a2affd700 1 -- 172.21.15.42:0/246795645 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a14011990 con 0x7f9a2c153460 2023-07-29T02:04:11.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.438+0000 7f9a2affd700 1 -- 172.21.15.42:0/246795645 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14011d20 con 0x7f9a2c153460 2023-07-29T02:04:11.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.439+0000 7f9a325ea700 1 -- 172.21.15.42:0/246795645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a2c153460 msgr2=0x7f9a2c06de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:11.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.439+0000 7f9a325ea700 1 --2- 172.21.15.42:0/246795645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a2c153460 0x7f9a2c06de30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c06c810 tx=0x7f9a14009b20 comp rx=0 tx=0).stop 2023-07-29T02:04:11.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.439+0000 7f9a325ea700 1 -- 172.21.15.42:0/246795645 shutdown_connections 2023-07-29T02:04:11.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.439+0000 7f9a325ea700 1 --2- 172.21.15.42:0/246795645 >> v2:172.21.15.144:3300/0 conn(0x7f9a2c06e950 0x7f9a2c159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:11.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.439+0000 7f9a325ea700 1 --2- 172.21.15.42:0/246795645 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a2c153460 0x7f9a2c06de30 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:11.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.439+0000 7f9a325ea700 1 -- 172.21.15.42:0/246795645 >> 172.21.15.42:0/246795645 conn(0x7f9a2c061190 msgr2=0x7f9a2c061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:11.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.439+0000 7f9a325ea700 1 -- 172.21.15.42:0/246795645 shutdown_connections 2023-07-29T02:04:11.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.439+0000 7f9a325ea700 1 -- 172.21.15.42:0/246795645 wait complete. 2023-07-29T02:04:11.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.440+0000 7f9a325ea700 1 Processor -- start 2023-07-29T02:04:11.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.440+0000 7f9a325ea700 1 -- start start 2023-07-29T02:04:11.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.441+0000 7f9a325ea700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a2c06e950 0x7f9a2c14e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:11.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.441+0000 7f9a325ea700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a2c0cdc70 0x7f9a2c155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:11.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.441+0000 7f9a325ea700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a2c153460 0x7f9a2c155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:11.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.441+0000 7f9a325ea700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c153cf0 con 0x7f9a2c0cdc70 2023-07-29T02:04:11.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.441+0000 7f9a325ea700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c153fd0 con 0x7f9a2c06e950 2023-07-29T02:04:11.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.441+0000 7f9a325ea700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c1542b0 con 0x7f9a2c153460 2023-07-29T02:04:11.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.441+0000 7f9a2b7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a2c0cdc70 0x7f9a2c155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:11.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.441+0000 7f9a2b7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a2c0cdc70 0x7f9a2c155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57908/0 (socket says 172.21.15.42:57908) 2023-07-29T02:04:11.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.441+0000 7f9a2b7fe700 1 -- 172.21.15.42:0/3365791477 learned_addr learned my addr 172.21.15.42:0/3365791477 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:11.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.441+0000 7f9a2bfff700 1 --2- 172.21.15.42:0/3365791477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a2c06e950 0x7f9a2c14e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:11.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.441+0000 7f9a30b87700 1 --2- 172.21.15.42:0/3365791477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a2c153460 0x7f9a2c155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:11.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.441+0000 7f9a2b7fe700 1 -- 172.21.15.42:0/3365791477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a2c153460 msgr2=0x7f9a2c155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:11.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.441+0000 7f9a2b7fe700 1 --2- 172.21.15.42:0/3365791477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a2c153460 0x7f9a2c155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:11.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.441+0000 7f9a2b7fe700 1 -- 172.21.15.42:0/3365791477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a2c06e950 msgr2=0x7f9a2c14e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:11.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.441+0000 7f9a2b7fe700 1 --2- 172.21.15.42:0/3365791477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a2c06e950 0x7f9a2c14e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:11.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.442+0000 7f9a2b7fe700 1 -- 172.21.15.42:0/3365791477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a140094a0 con 0x7f9a2c0cdc70 2023-07-29T02:04:11.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.442+0000 7f9a30b87700 1 --2- 172.21.15.42:0/3365791477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a2c153460 0x7f9a2c155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:04:11.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.442+0000 7f9a2b7fe700 1 --2- 172.21.15.42:0/3365791477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a2c0cdc70 0x7f9a2c155070 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0011e0 tx=0x7f9a1c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:11.430 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.442+0000 7f9a28ff9700 1 -- 172.21.15.42:0/3365791477 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c004c80 con 0x7f9a2c0cdc70 2023-07-29T02:04:11.431 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.442+0000 7f9a28ff9700 1 -- 172.21.15.42:0/3365791477 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c004de0 con 0x7f9a2c0cdc70 2023-07-29T02:04:11.431 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.442+0000 7f9a325ea700 1 -- 172.21.15.42:0/3365791477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2c154590 con 0x7f9a2c0cdc70 2023-07-29T02:04:11.431 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.442+0000 7f9a28ff9700 1 -- 172.21.15.42:0/3365791477 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c007310 con 0x7f9a2c0cdc70 2023-07-29T02:04:11.431 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.442+0000 7f9a325ea700 1 -- 172.21.15.42:0/3365791477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2c154b50 con 0x7f9a2c0cdc70 2023-07-29T02:04:11.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.443+0000 7f9a325ea700 1 -- 172.21.15.42:0/3365791477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a2c04ea50 con 0x7f9a2c0cdc70 2023-07-29T02:04:11.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.443+0000 7f9a28ff9700 1 -- 172.21.15.42:0/3365791477 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f9a1c007470 con 0x7f9a2c0cdc70 2023-07-29T02:04:11.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.444+0000 7f9a28ff9700 1 --2- 172.21.15.42:0/3365791477 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a0c06a660 0x7f9a0c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:11.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.444+0000 7f9a28ff9700 1 -- 172.21.15.42:0/3365791477 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7078+0+0 (secure 0 0 0) 0x7f9a1c088ba0 con 0x7f9a2c0cdc70 2023-07-29T02:04:11.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.444+0000 7f9a2bfff700 1 --2- 172.21.15.42:0/3365791477 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a0c06a660 0x7f9a0c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:11.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.445+0000 7f9a2bfff700 1 --2- 172.21.15.42:0/3365791477 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a0c06a660 0x7f9a0c06cb10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9a140090b0 tx=0x7f9a1401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:11.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.448+0000 7f9a28ff9700 1 -- 172.21.15.42:0/3365791477 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f9a1c053b90 con 0x7f9a2c0cdc70 2023-07-29T02:04:11.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.693+0000 7f9a325ea700 1 -- 172.21.15.42:0/3365791477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a2c06e730 con 0x7f9a2c0cdc70 2023-07-29T02:04:11.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.694+0000 7f9a28ff9700 1 -- 172.21.15.42:0/3365791477 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6169 (secure 0 0 0) 0x7f9a1c0571b0 con 0x7f9a2c0cdc70 2023-07-29T02:04:11.678 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:04:11.678 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:02:40.487146+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5142":{"gid":5142,"name":"e","rank":0,"incarnation":16,"state":"up:active","state_seq":14,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:04:11.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.696+0000 7f9a325ea700 1 -- 172.21.15.42:0/3365791477 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a0c06a660 msgr2=0x7f9a0c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:11.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.696+0000 7f9a325ea700 1 --2- 172.21.15.42:0/3365791477 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a0c06a660 0x7f9a0c06cb10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9a140090b0 tx=0x7f9a1401c040 comp rx=0 tx=0).stop 2023-07-29T02:04:11.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.696+0000 7f9a325ea700 1 -- 172.21.15.42:0/3365791477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a2c0cdc70 msgr2=0x7f9a2c155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:11.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.696+0000 7f9a325ea700 1 --2- 172.21.15.42:0/3365791477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a2c0cdc70 0x7f9a2c155070 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c0011e0 tx=0x7f9a1c00ca30 comp rx=0 tx=0).stop 2023-07-29T02:04:11.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.696+0000 7f9a325ea700 1 -- 172.21.15.42:0/3365791477 shutdown_connections 2023-07-29T02:04:11.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.696+0000 7f9a325ea700 1 --2- 172.21.15.42:0/3365791477 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9a0c06a660 0x7f9a0c06cb10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:11.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.696+0000 7f9a325ea700 1 --2- 172.21.15.42:0/3365791477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9a2c153460 0x7f9a2c155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:11.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.696+0000 7f9a325ea700 1 --2- 172.21.15.42:0/3365791477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a2c06e950 0x7f9a2c14e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:11.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.696+0000 7f9a325ea700 1 --2- 172.21.15.42:0/3365791477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9a2c0cdc70 0x7f9a2c155070 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:11.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.696+0000 7f9a325ea700 1 -- 172.21.15.42:0/3365791477 >> 172.21.15.42:0/3365791477 conn(0x7f9a2c061190 msgr2=0x7f9a2c157070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:11.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.696+0000 7f9a325ea700 1 -- 172.21.15.42:0/3365791477 shutdown_connections 2023-07-29T02:04:11.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:11.696+0000 7f9a325ea700 1 -- 172.21.15.42:0/3365791477 wait complete. 2023-07-29T02:04:11.682 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 20 2023-07-29T02:04:11.693 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2023-07-29T02:04:13.694 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:04:13.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.850+0000 7fe28563d700 1 Processor -- start 2023-07-29T02:04:13.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.850+0000 7fe28563d700 1 -- start start 2023-07-29T02:04:13.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.851+0000 7fe28563d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe28014d9c0 0x7fe2800ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:13.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.851+0000 7fe28563d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe2800c2b40 0x7fe28006fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:13.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.851+0000 7fe28563d700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe28015ac60 con 0x7fe28006df80 2023-07-29T02:04:13.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.851+0000 7fe28563d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe280157860 con 0x7fe2800c2b40 2023-07-29T02:04:13.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.851+0000 7fe28563d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe280157b40 con 0x7fe28014d9c0 2023-07-29T02:04:13.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.851+0000 7fe27f7fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe28006df80 0x7fe2800c3160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51724/0 (socket says 172.21.15.42:51724) 2023-07-29T02:04:13.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.851+0000 7fe27f7fe700 1 -- 172.21.15.42:0/1558885457 learned_addr learned my addr 172.21.15.42:0/1558885457 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:04:13.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.851+0000 7fe27e7fc700 1 --2- 172.21.15.42:0/1558885457 >> v2:172.21.15.144:3300/0 conn(0x7fe2800c2b40 0x7fe28006fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:13.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.851+0000 7fe27effd700 1 --2- 172.21.15.42:0/1558885457 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe28014d9c0 0x7fe2800ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:13.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.851+0000 7fe27dffb700 1 -- 172.21.15.42:0/1558885457 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2087294870 0 0) 0x7fe28015ac60 con 0x7fe28006df80 2023-07-29T02:04:13.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.851+0000 7fe27dffb700 1 -- 172.21.15.42:0/1558885457 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2680035b0 con 0x7fe28006df80 2023-07-29T02:04:13.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.852+0000 7fe27e7fc700 1 -- 172.21.15.42:0/1558885457 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe28014d9c0 msgr2=0x7fe2800ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:04:13.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.852+0000 7fe27e7fc700 1 --2- 172.21.15.42:0/1558885457 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe28014d9c0 0x7fe2800ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:13.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.852+0000 7fe27e7fc700 1 -- 172.21.15.42:0/1558885457 >> v1:172.21.15.42:6789/0 conn(0x7fe28006df80 legacy=0x7fe2800c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:13.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.852+0000 7fe27e7fc700 1 -- 172.21.15.42:0/1558885457 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28015a330 con 0x7fe2800c2b40 2023-07-29T02:04:13.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.852+0000 7fe27effd700 1 --2- 172.21.15.42:0/1558885457 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe28014d9c0 0x7fe2800ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:04:13.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.852+0000 7fe27e7fc700 1 --2- 172.21.15.42:0/1558885457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2800c2b40 0x7fe28006fb50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe270009840 tx=0x7fe270009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd024d7ad0542c37 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:13.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.852+0000 7fe27dffb700 1 -- 172.21.15.42:0/1558885457 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe270011830 con 0x7fe2800c2b40 2023-07-29T02:04:13.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.852+0000 7fe27dffb700 1 -- 172.21.15.42:0/1558885457 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe270011990 con 0x7fe2800c2b40 2023-07-29T02:04:13.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.852+0000 7fe27dffb700 1 -- 172.21.15.42:0/1558885457 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe270011d20 con 0x7fe2800c2b40 2023-07-29T02:04:13.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.853+0000 7fe28563d700 1 -- 172.21.15.42:0/1558885457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2800c2b40 msgr2=0x7fe28006fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:13.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.853+0000 7fe28563d700 1 --2- 172.21.15.42:0/1558885457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2800c2b40 0x7fe28006fb50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe270009840 tx=0x7fe270009b50 comp rx=0 tx=0).stop 2023-07-29T02:04:13.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.853+0000 7fe28563d700 1 -- 172.21.15.42:0/1558885457 shutdown_connections 2023-07-29T02:04:13.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.853+0000 7fe28563d700 1 --2- 172.21.15.42:0/1558885457 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe28014d9c0 0x7fe2800ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:13.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.853+0000 7fe28563d700 1 --2- 172.21.15.42:0/1558885457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2800c2b40 0x7fe28006fb50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:13.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.853+0000 7fe28563d700 1 -- 172.21.15.42:0/1558885457 >> 172.21.15.42:0/1558885457 conn(0x7fe280072180 msgr2=0x7fe280072580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:13.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.853+0000 7fe28563d700 1 -- 172.21.15.42:0/1558885457 shutdown_connections 2023-07-29T02:04:13.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.853+0000 7fe28563d700 1 -- 172.21.15.42:0/1558885457 wait complete. 2023-07-29T02:04:13.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.854+0000 7fe28563d700 1 Processor -- start 2023-07-29T02:04:13.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.854+0000 7fe28563d700 1 -- start start 2023-07-29T02:04:13.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.855+0000 7fe28563d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe28006df80 0x7fe2801e1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:13.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.855+0000 7fe28563d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2800c2b40 0x7fe2800c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:13.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.855+0000 7fe28563d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe28014d9c0 0x7fe2800c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:13.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.855+0000 7fe28563d700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28014bdd0 con 0x7fe28014d9c0 2023-07-29T02:04:13.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.855+0000 7fe28563d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28014c200 con 0x7fe2800c2b40 2023-07-29T02:04:13.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.855+0000 7fe28563d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28014b830 con 0x7fe28006df80 2023-07-29T02:04:13.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.855+0000 7fe27f7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe28014d9c0 0x7fe2800c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:13.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.855+0000 7fe27f7fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe28014d9c0 0x7fe2800c5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57926/0 (socket says 172.21.15.42:57926) 2023-07-29T02:04:13.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.855+0000 7fe27f7fe700 1 -- 172.21.15.42:0/367849978 learned_addr learned my addr 172.21.15.42:0/367849978 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:13.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.855+0000 7fe27e7fc700 1 --2- 172.21.15.42:0/367849978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2800c2b40 0x7fe2800c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:13.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.855+0000 7fe27effd700 1 --2- 172.21.15.42:0/367849978 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe28006df80 0x7fe2801e1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:13.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.855+0000 7fe27f7fe700 1 -- 172.21.15.42:0/367849978 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe28006df80 msgr2=0x7fe2801e1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:13.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.855+0000 7fe27f7fe700 1 --2- 172.21.15.42:0/367849978 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe28006df80 0x7fe2801e1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:13.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.855+0000 7fe27f7fe700 1 -- 172.21.15.42:0/367849978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2800c2b40 msgr2=0x7fe2800c5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:13.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.855+0000 7fe27f7fe700 1 --2- 172.21.15.42:0/367849978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2800c2b40 0x7fe2800c5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:13.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.856+0000 7fe27f7fe700 1 -- 172.21.15.42:0/367849978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2740094a0 con 0x7fe28014d9c0 2023-07-29T02:04:13.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.856+0000 7fe27f7fe700 1 --2- 172.21.15.42:0/367849978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe28014d9c0 0x7fe2800c5bc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe27800cb40 tx=0x7fe27800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:13.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.856+0000 7fe2677fe700 1 -- 172.21.15.42:0/367849978 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27800a9e0 con 0x7fe28014d9c0 2023-07-29T02:04:13.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.856+0000 7fe2677fe700 1 -- 172.21.15.42:0/367849978 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27800ab40 con 0x7fe28014d9c0 2023-07-29T02:04:13.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.856+0000 7fe28563d700 1 -- 172.21.15.42:0/367849978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2700094a0 con 0x7fe28014d9c0 2023-07-29T02:04:13.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.856+0000 7fe2677fe700 1 -- 172.21.15.42:0/367849978 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe278012400 con 0x7fe28014d9c0 2023-07-29T02:04:13.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.856+0000 7fe28563d700 1 -- 172.21.15.42:0/367849978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28014baf0 con 0x7fe28014d9c0 2023-07-29T02:04:13.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.857+0000 7fe28563d700 1 -- 172.21.15.42:0/367849978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28004ea50 con 0x7fe28014d9c0 2023-07-29T02:04:13.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.857+0000 7fe2677fe700 1 -- 172.21.15.42:0/367849978 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fe27801b3b0 con 0x7fe28014d9c0 2023-07-29T02:04:13.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.858+0000 7fe2677fe700 1 --2- 172.21.15.42:0/367849978 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe26c06a690 0x7fe26c06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:13.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.858+0000 7fe2677fe700 1 -- 172.21.15.42:0/367849978 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7078+0+0 (secure 0 0 0) 0x7fe278088a00 con 0x7fe28014d9c0 2023-07-29T02:04:13.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.858+0000 7fe27effd700 1 --2- 172.21.15.42:0/367849978 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe26c06a690 0x7fe26c06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:13.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.858+0000 7fe27effd700 1 --2- 172.21.15.42:0/367849978 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe26c06a690 0x7fe26c06cb40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe274009cd0 tx=0x7fe274009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:13.847 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:13.862+0000 7fe2677fe700 1 -- 172.21.15.42:0/367849978 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fe27804c2c0 con 0x7fe28014d9c0 2023-07-29T02:04:14.096 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:14.112+0000 7fe28563d700 1 -- 172.21.15.42:0/367849978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe28006efe0 con 0x7fe28014d9c0 2023-07-29T02:04:14.096 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:14.113+0000 7fe2677fe700 1 -- 172.21.15.42:0/367849978 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6169 (secure 0 0 0) 0x7fe278053ab0 con 0x7fe28014d9c0 2023-07-29T02:04:14.097 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:04:14.097 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:02:40.487146+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5142":{"gid":5142,"name":"e","rank":0,"incarnation":16,"state":"up:active","state_seq":14,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:04:14.098 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:14.115+0000 7fe28563d700 1 -- 172.21.15.42:0/367849978 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe26c06a690 msgr2=0x7fe26c06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:14.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:14.115+0000 7fe28563d700 1 --2- 172.21.15.42:0/367849978 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe26c06a690 0x7fe26c06cb40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe274009cd0 tx=0x7fe274009210 comp rx=0 tx=0).stop 2023-07-29T02:04:14.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:14.115+0000 7fe28563d700 1 -- 172.21.15.42:0/367849978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe28014d9c0 msgr2=0x7fe2800c5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:14.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:14.115+0000 7fe28563d700 1 --2- 172.21.15.42:0/367849978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe28014d9c0 0x7fe2800c5bc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe27800cb40 tx=0x7fe27800ce50 comp rx=0 tx=0).stop 2023-07-29T02:04:14.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:14.115+0000 7fe28563d700 1 -- 172.21.15.42:0/367849978 shutdown_connections 2023-07-29T02:04:14.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:14.115+0000 7fe28563d700 1 --2- 172.21.15.42:0/367849978 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe26c06a690 0x7fe26c06cb40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:14.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:14.115+0000 7fe28563d700 1 --2- 172.21.15.42:0/367849978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe28014d9c0 0x7fe2800c5bc0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:14.099 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:14.115+0000 7fe28563d700 1 --2- 172.21.15.42:0/367849978 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe28006df80 0x7fe2801e1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:14.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:14.115+0000 7fe28563d700 1 --2- 172.21.15.42:0/367849978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2800c2b40 0x7fe2800c5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:14.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:14.115+0000 7fe28563d700 1 -- 172.21.15.42:0/367849978 >> 172.21.15.42:0/367849978 conn(0x7fe280072180 msgr2=0x7fe2800c3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:14.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:14.115+0000 7fe28563d700 1 -- 172.21.15.42:0/367849978 shutdown_connections 2023-07-29T02:04:14.100 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:14.115+0000 7fe28563d700 1 -- 172.21.15.42:0/367849978 wait complete. 2023-07-29T02:04:14.100 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 20 2023-07-29T02:04:14.111 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2023-07-29T02:04:16.112 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:04:16.252 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.268+0000 7ff54af39700 1 Processor -- start 2023-07-29T02:04:16.252 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.268+0000 7ff54af39700 1 -- start start 2023-07-29T02:04:16.253 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.269+0000 7ff54af39700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff5440c5e00 0x7ff54406c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:16.253 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.269+0000 7ff54af39700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff54415a3e0 0x7ff54406a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:16.254 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.269+0000 7ff54af39700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5440c6a90 con 0x7ff5440b1e10 2023-07-29T02:04:16.254 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.269+0000 7ff54af39700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5440b19f0 con 0x7ff54415a3e0 2023-07-29T02:04:16.254 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.269+0000 7ff54af39700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff54406b4a0 con 0x7ff5440c5e00 2023-07-29T02:04:16.254 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.269+0000 7ff5494d6700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff54415a3e0 0x7ff54406a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:16.254 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.269+0000 7ff5494d6700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff54415a3e0 0x7ff54406a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57934/0 (socket says 172.21.15.42:57934) 2023-07-29T02:04:16.254 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.269+0000 7ff5494d6700 1 -- 172.21.15.42:0/2775456077 learned_addr learned my addr 172.21.15.42:0/2775456077 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:16.254 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.269+0000 7ff548cd5700 1 --2- 172.21.15.42:0/2775456077 >> v2:172.21.15.144:3300/0 conn(0x7ff5440c5e00 0x7ff54406c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:16.255 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.269+0000 7ff5494d6700 1 -- 172.21.15.42:0/2775456077 >> v2:172.21.15.144:3300/0 conn(0x7ff5440c5e00 msgr2=0x7ff54406c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:04:16.255 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.269+0000 7ff5494d6700 1 --2- 172.21.15.42:0/2775456077 >> v2:172.21.15.144:3300/0 conn(0x7ff5440c5e00 0x7ff54406c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:16.255 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.269+0000 7ff5494d6700 1 -- 172.21.15.42:0/2775456077 >> v1:172.21.15.144:6789/0 conn(0x7ff5440b1e10 legacy=0x7ff544157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:16.255 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.269+0000 7ff5494d6700 1 -- 172.21.15.42:0/2775456077 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5440c6cf0 con 0x7ff54415a3e0 2023-07-29T02:04:16.255 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.269+0000 7ff5494d6700 1 --2- 172.21.15.42:0/2775456077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff54415a3e0 0x7ff54406a750 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff5440cd020 tx=0x7ff53c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e669762c920d30c server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:16.255 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.270+0000 7ff5437fe700 1 -- 172.21.15.42:0/2775456077 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c00e070 con 0x7ff54415a3e0 2023-07-29T02:04:16.255 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.270+0000 7ff5437fe700 1 -- 172.21.15.42:0/2775456077 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c00b910 con 0x7ff54415a3e0 2023-07-29T02:04:16.256 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.270+0000 7ff5437fe700 1 -- 172.21.15.42:0/2775456077 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c00bcc0 con 0x7ff54415a3e0 2023-07-29T02:04:16.257 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.270+0000 7ff54af39700 1 -- 172.21.15.42:0/2775456077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff54415a3e0 msgr2=0x7ff54406a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:16.258 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.270+0000 7ff54af39700 1 --2- 172.21.15.42:0/2775456077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff54415a3e0 0x7ff54406a750 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff5440cd020 tx=0x7ff53c00b330 comp rx=0 tx=0).stop 2023-07-29T02:04:16.258 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.270+0000 7ff54af39700 1 -- 172.21.15.42:0/2775456077 shutdown_connections 2023-07-29T02:04:16.258 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.270+0000 7ff54af39700 1 --2- 172.21.15.42:0/2775456077 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff54415a3e0 0x7ff54406a750 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:16.258 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.270+0000 7ff54af39700 1 --2- 172.21.15.42:0/2775456077 >> v2:172.21.15.144:3300/0 conn(0x7ff5440c5e00 0x7ff54406c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:16.258 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.270+0000 7ff54af39700 1 -- 172.21.15.42:0/2775456077 >> 172.21.15.42:0/2775456077 conn(0x7ff54406f850 msgr2=0x7ff5440cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:16.258 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.270+0000 7ff54af39700 1 -- 172.21.15.42:0/2775456077 shutdown_connections 2023-07-29T02:04:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.270+0000 7ff54af39700 1 -- 172.21.15.42:0/2775456077 wait complete. 2023-07-29T02:04:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.271+0000 7ff54af39700 1 Processor -- start 2023-07-29T02:04:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.272+0000 7ff54af39700 1 -- start start 2023-07-29T02:04:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.272+0000 7ff54af39700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5440b1e10 0x7ff544158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.272+0000 7ff54af39700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5440c5e00 0x7ff544155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.272+0000 7ff54af39700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff54415a3e0 0x7ff5441efb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.272+0000 7ff54af39700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff544158030 con 0x7ff54415a3e0 2023-07-29T02:04:16.259 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.272+0000 7ff54af39700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54414a8b0 con 0x7ff5440c5e00 2023-07-29T02:04:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.272+0000 7ff54af39700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54414d770 con 0x7ff5440b1e10 2023-07-29T02:04:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.273+0000 7ff5494d6700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff54415a3e0 0x7ff5441efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.273+0000 7ff5494d6700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff54415a3e0 0x7ff5441efb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57940/0 (socket says 172.21.15.42:57940) 2023-07-29T02:04:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.273+0000 7ff5494d6700 1 -- 172.21.15.42:0/2218204552 learned_addr learned my addr 172.21.15.42:0/2218204552 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.273+0000 7ff548cd5700 1 --2- 172.21.15.42:0/2218204552 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5440b1e10 0x7ff544158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.273+0000 7ff543fff700 1 --2- 172.21.15.42:0/2218204552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5440c5e00 0x7ff544155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:16.260 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.273+0000 7ff5494d6700 1 -- 172.21.15.42:0/2218204552 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5440b1e10 msgr2=0x7ff544158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:16.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.273+0000 7ff5494d6700 1 --2- 172.21.15.42:0/2218204552 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5440b1e10 0x7ff544158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:16.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.273+0000 7ff5494d6700 1 -- 172.21.15.42:0/2218204552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5440c5e00 msgr2=0x7ff544155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:16.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.273+0000 7ff5494d6700 1 --2- 172.21.15.42:0/2218204552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5440c5e00 0x7ff544155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:16.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.273+0000 7ff5494d6700 1 -- 172.21.15.42:0/2218204552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c009b30 con 0x7ff54415a3e0 2023-07-29T02:04:16.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.273+0000 7ff5494d6700 1 --2- 172.21.15.42:0/2218204552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff54415a3e0 0x7ff5441efb80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00b680 tx=0x7ff53c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:16.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.273+0000 7ff5417fa700 1 -- 172.21.15.42:0/2218204552 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c004870 con 0x7ff54415a3e0 2023-07-29T02:04:16.261 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.273+0000 7ff5417fa700 1 -- 172.21.15.42:0/2218204552 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53c0099b0 con 0x7ff54415a3e0 2023-07-29T02:04:16.262 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.273+0000 7ff5417fa700 1 -- 172.21.15.42:0/2218204552 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c01b670 con 0x7ff54415a3e0 2023-07-29T02:04:16.262 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.273+0000 7ff54af39700 1 -- 172.21.15.42:0/2218204552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff544157d50 con 0x7ff54415a3e0 2023-07-29T02:04:16.262 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.273+0000 7ff54af39700 1 -- 172.21.15.42:0/2218204552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54414cc90 con 0x7ff54415a3e0 2023-07-29T02:04:16.263 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.274+0000 7ff54af39700 1 -- 172.21.15.42:0/2218204552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff54404ea50 con 0x7ff54415a3e0 2023-07-29T02:04:16.263 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.275+0000 7ff5417fa700 1 -- 172.21.15.42:0/2218204552 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7ff53c01b7d0 con 0x7ff54415a3e0 2023-07-29T02:04:16.263 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.275+0000 7ff5417fa700 1 --2- 172.21.15.42:0/2218204552 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff52806a660 0x7ff52806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:16.263 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.276+0000 7ff5417fa700 1 -- 172.21.15.42:0/2218204552 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7078+0+0 (secure 0 0 0) 0x7ff53c08a430 con 0x7ff54415a3e0 2023-07-29T02:04:16.263 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.276+0000 7ff548cd5700 1 --2- 172.21.15.42:0/2218204552 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff52806a660 0x7ff52806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:16.263 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.276+0000 7ff548cd5700 1 --2- 172.21.15.42:0/2218204552 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff52806a660 0x7ff52806cb10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff538009be0 tx=0x7ff538009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:16.264 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.280+0000 7ff5417fa700 1 -- 172.21.15.42:0/2218204552 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7ff53c055310 con 0x7ff54415a3e0 2023-07-29T02:04:16.511 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.527+0000 7ff54af39700 1 -- 172.21.15.42:0/2218204552 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff544073ff0 con 0x7ff54415a3e0 2023-07-29T02:04:16.512 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.528+0000 7ff5417fa700 1 -- 172.21.15.42:0/2218204552 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6169 (secure 0 0 0) 0x7ff53c058930 con 0x7ff54415a3e0 2023-07-29T02:04:16.512 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:04:16.512 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:02:40.487146+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5142":{"gid":5142,"name":"e","rank":0,"incarnation":16,"state":"up:active","state_seq":14,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:04:16.514 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.530+0000 7ff54af39700 1 -- 172.21.15.42:0/2218204552 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff52806a660 msgr2=0x7ff52806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:16.514 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.530+0000 7ff54af39700 1 --2- 172.21.15.42:0/2218204552 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff52806a660 0x7ff52806cb10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff538009be0 tx=0x7ff538009210 comp rx=0 tx=0).stop 2023-07-29T02:04:16.514 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.530+0000 7ff54af39700 1 -- 172.21.15.42:0/2218204552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff54415a3e0 msgr2=0x7ff5441efb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:16.514 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.530+0000 7ff54af39700 1 --2- 172.21.15.42:0/2218204552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff54415a3e0 0x7ff5441efb80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00b680 tx=0x7ff53c004ad0 comp rx=0 tx=0).stop 2023-07-29T02:04:16.515 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.530+0000 7ff54af39700 1 -- 172.21.15.42:0/2218204552 shutdown_connections 2023-07-29T02:04:16.515 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.530+0000 7ff54af39700 1 --2- 172.21.15.42:0/2218204552 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff52806a660 0x7ff52806cb10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:16.515 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.530+0000 7ff54af39700 1 --2- 172.21.15.42:0/2218204552 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff54415a3e0 0x7ff5441efb80 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:16.515 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.530+0000 7ff54af39700 1 --2- 172.21.15.42:0/2218204552 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5440b1e10 0x7ff544158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:16.515 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.530+0000 7ff54af39700 1 --2- 172.21.15.42:0/2218204552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5440c5e00 0x7ff544155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:16.515 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.530+0000 7ff54af39700 1 -- 172.21.15.42:0/2218204552 >> 172.21.15.42:0/2218204552 conn(0x7ff54406f850 msgr2=0x7ff544150ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:16.515 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.530+0000 7ff54af39700 1 -- 172.21.15.42:0/2218204552 shutdown_connections 2023-07-29T02:04:16.516 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:16.530+0000 7ff54af39700 1 -- 172.21.15.42:0/2218204552 wait complete. 2023-07-29T02:04:16.516 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 20 2023-07-29T02:04:16.526 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2023-07-29T02:04:18.527 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:04:18.667 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.683+0000 7f9e0f955700 1 Processor -- start 2023-07-29T02:04:18.667 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.683+0000 7f9e0f955700 1 -- start start 2023-07-29T02:04:18.668 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.684+0000 7f9e0f955700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9e0806fe60 0x7f9e08070300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:18.668 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.684+0000 7f9e0f955700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e080c1fb0 con 0x7f9e0814dce0 2023-07-29T02:04:18.668 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.684+0000 7f9e0f955700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e08157370 con 0x7f9e080b2b30 2023-07-29T02:04:18.668 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.684+0000 7f9e0f955700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e080c80a0 con 0x7f9e0806fe60 2023-07-29T02:04:18.668 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.684+0000 7f9e0def2700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9e0806fe60 0x7f9e08070300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:18.669 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.684+0000 7f9e0d6f1700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f9e0814dce0 0x7f9e080c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51748/0 (socket says 172.21.15.42:51748) 2023-07-29T02:04:18.669 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.684+0000 7f9e0d6f1700 1 -- 172.21.15.42:0/1524479067 learned_addr learned my addr 172.21.15.42:0/1524479067 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:04:18.669 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.684+0000 7f9e0def2700 1 -- 172.21.15.42:0/1524479067 >> v1:172.21.15.144:6789/0 conn(0x7f9e080b2b30 legacy=0x7f9e08157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:18.669 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.684+0000 7f9e0def2700 1 -- 172.21.15.42:0/1524479067 >> v1:172.21.15.42:6789/0 conn(0x7f9e0814dce0 legacy=0x7f9e080c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:18.669 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.684+0000 7f9e0def2700 1 -- 172.21.15.42:0/1524479067 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e080c2200 con 0x7f9e0806fe60 2023-07-29T02:04:18.670 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.685+0000 7f9e0def2700 1 --2- 172.21.15.42:0/1524479067 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e0806fe60 0x7f9e08070300 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009d90 tx=0x7f9e0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363e778da53cb257 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:18.671 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.685+0000 7f9dfbfff700 1 -- 172.21.15.42:0/1524479067 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0000e070 con 0x7f9e0806fe60 2023-07-29T02:04:18.671 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.685+0000 7f9dfbfff700 1 -- 172.21.15.42:0/1524479067 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0000bbd0 con 0x7f9e0806fe60 2023-07-29T02:04:18.671 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.685+0000 7f9dfbfff700 1 -- 172.21.15.42:0/1524479067 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e00012430 con 0x7f9e0806fe60 2023-07-29T02:04:18.671 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.685+0000 7f9e0f955700 1 -- 172.21.15.42:0/1524479067 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e0806fe60 msgr2=0x7f9e08070300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:18.671 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.685+0000 7f9e0f955700 1 --2- 172.21.15.42:0/1524479067 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e0806fe60 0x7f9e08070300 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9e00009d90 tx=0x7f9e0000b330 comp rx=0 tx=0).stop 2023-07-29T02:04:18.671 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.685+0000 7f9e0f955700 1 -- 172.21.15.42:0/1524479067 shutdown_connections 2023-07-29T02:04:18.672 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.685+0000 7f9e0f955700 1 --2- 172.21.15.42:0/1524479067 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e0806fe60 0x7f9e08070300 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:18.672 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.685+0000 7f9e0f955700 1 -- 172.21.15.42:0/1524479067 >> 172.21.15.42:0/1524479067 conn(0x7f9e0806a750 msgr2=0x7f9e0806ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:18.672 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.686+0000 7f9e0f955700 1 -- 172.21.15.42:0/1524479067 shutdown_connections 2023-07-29T02:04:18.672 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.686+0000 7f9e0f955700 1 -- 172.21.15.42:0/1524479067 wait complete. 2023-07-29T02:04:18.672 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.687+0000 7f9e0f955700 1 Processor -- start 2023-07-29T02:04:18.672 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.687+0000 7f9e0f955700 1 -- start start 2023-07-29T02:04:18.676 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.687+0000 7f9e0f955700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e0806fe60 0x7f9e0806ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:18.676 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.687+0000 7f9e0f955700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e080b2b30 0x7f9e08159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:18.676 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.687+0000 7f9e0f955700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9e0814dce0 0x7f9e08150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:18.676 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.687+0000 7f9e0f955700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0814ea90 con 0x7f9e080b2b30 2023-07-29T02:04:18.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.687+0000 7f9e0f955700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e080720a0 con 0x7f9e0806fe60 2023-07-29T02:04:18.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.687+0000 7f9e0f955700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0806bfb0 con 0x7f9e0814dce0 2023-07-29T02:04:18.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.688+0000 7f9e0cef0700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e080b2b30 0x7f9e08159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:18.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.688+0000 7f9e0cef0700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e080b2b30 0x7f9e08159100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57950/0 (socket says 172.21.15.42:57950) 2023-07-29T02:04:18.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.688+0000 7f9e0cef0700 1 -- 172.21.15.42:0/2338412130 learned_addr learned my addr 172.21.15.42:0/2338412130 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:18.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.688+0000 7f9e0d6f1700 1 --2- 172.21.15.42:0/2338412130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e0806fe60 0x7f9e0806ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:18.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.688+0000 7f9e0def2700 1 --2- 172.21.15.42:0/2338412130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9e0814dce0 0x7f9e08150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:18.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.688+0000 7f9e0cef0700 1 -- 172.21.15.42:0/2338412130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9e0814dce0 msgr2=0x7f9e08150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:18.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.688+0000 7f9e0cef0700 1 --2- 172.21.15.42:0/2338412130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9e0814dce0 0x7f9e08150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:18.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.688+0000 7f9e0cef0700 1 -- 172.21.15.42:0/2338412130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e0806fe60 msgr2=0x7f9e0806ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:18.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.688+0000 7f9e0cef0700 1 --2- 172.21.15.42:0/2338412130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e0806fe60 0x7f9e0806ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:18.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.688+0000 7f9e0cef0700 1 -- 172.21.15.42:0/2338412130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e00009a70 con 0x7f9e080b2b30 2023-07-29T02:04:18.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.688+0000 7f9e0def2700 1 --2- 172.21.15.42:0/2338412130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9e0814dce0 0x7f9e08150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:04:18.678 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.688+0000 7f9e0cef0700 1 --2- 172.21.15.42:0/2338412130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e080b2b30 0x7f9e08159100 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400c4b0 tx=0x7f9e0400c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:18.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.688+0000 7f9df9ffb700 1 -- 172.21.15.42:0/2338412130 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e040052d0 con 0x7f9e080b2b30 2023-07-29T02:04:18.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.688+0000 7f9df9ffb700 1 -- 172.21.15.42:0/2338412130 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e04005430 con 0x7f9e080b2b30 2023-07-29T02:04:18.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.688+0000 7f9e0f955700 1 -- 172.21.15.42:0/2338412130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0806c210 con 0x7f9e080b2b30 2023-07-29T02:04:18.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.688+0000 7f9df9ffb700 1 -- 172.21.15.42:0/2338412130 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e040038c0 con 0x7f9e080b2b30 2023-07-29T02:04:18.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.688+0000 7f9e0f955700 1 -- 172.21.15.42:0/2338412130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0806c770 con 0x7f9e080b2b30 2023-07-29T02:04:18.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.689+0000 7f9e0f955700 1 -- 172.21.15.42:0/2338412130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0804ea50 con 0x7f9e080b2b30 2023-07-29T02:04:18.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.690+0000 7f9df9ffb700 1 -- 172.21.15.42:0/2338412130 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f9e04003a20 con 0x7f9e080b2b30 2023-07-29T02:04:18.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.690+0000 7f9df9ffb700 1 --2- 172.21.15.42:0/2338412130 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9dec06a660 0x7f9dec06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:18.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.691+0000 7f9df9ffb700 1 -- 172.21.15.42:0/2338412130 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 7078+0+0 (secure 0 0 0) 0x7f9e04088270 con 0x7f9e080b2b30 2023-07-29T02:04:18.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.691+0000 7f9e0d6f1700 1 --2- 172.21.15.42:0/2338412130 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9dec06a660 0x7f9dec06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:18.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.691+0000 7f9e0d6f1700 1 --2- 172.21.15.42:0/2338412130 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9dec06a660 0x7f9dec06cb10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc005910 tx=0x7f9dfc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:18.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.695+0000 7f9df9ffb700 1 -- 172.21.15.42:0/2338412130 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f9e04053270 con 0x7f9e080b2b30 2023-07-29T02:04:18.924 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.940+0000 7f9e0f955700 1 -- 172.21.15.42:0/2338412130 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e0806e220 con 0x7f9e080b2b30 2023-07-29T02:04:18.924 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.941+0000 7f9df9ffb700 1 -- 172.21.15.42:0/2338412130 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6169 (secure 0 0 0) 0x7f9e04056890 con 0x7f9e080b2b30 2023-07-29T02:04:18.925 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:04:18.925 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:02:40.487146+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5142},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5142":{"gid":5142,"name":"e","rank":0,"incarnation":16,"state":"up:active","state_seq":14,"addr":"172.21.15.42:6837/2695599859","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":2695599859},{"type":"v1","addr":"172.21.15.42:6837","nonce":2695599859}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:04:18.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.943+0000 7f9e0f955700 1 -- 172.21.15.42:0/2338412130 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9dec06a660 msgr2=0x7f9dec06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:18.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.943+0000 7f9e0f955700 1 --2- 172.21.15.42:0/2338412130 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9dec06a660 0x7f9dec06cb10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc005910 tx=0x7f9dfc009040 comp rx=0 tx=0).stop 2023-07-29T02:04:18.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.943+0000 7f9e0f955700 1 -- 172.21.15.42:0/2338412130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e080b2b30 msgr2=0x7f9e08159100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:18.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.943+0000 7f9e0f955700 1 --2- 172.21.15.42:0/2338412130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e080b2b30 0x7f9e08159100 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9e0400c4b0 tx=0x7f9e0400c7c0 comp rx=0 tx=0).stop 2023-07-29T02:04:18.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.943+0000 7f9e0f955700 1 -- 172.21.15.42:0/2338412130 shutdown_connections 2023-07-29T02:04:18.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.943+0000 7f9e0f955700 1 --2- 172.21.15.42:0/2338412130 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9dec06a660 0x7f9dec06cb10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:18.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.943+0000 7f9e0f955700 1 --2- 172.21.15.42:0/2338412130 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9e0814dce0 0x7f9e08150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:18.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.943+0000 7f9e0f955700 1 --2- 172.21.15.42:0/2338412130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e0806fe60 0x7f9e0806ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:18.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.943+0000 7f9e0f955700 1 --2- 172.21.15.42:0/2338412130 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9e080b2b30 0x7f9e08159100 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:18.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.943+0000 7f9e0f955700 1 -- 172.21.15.42:0/2338412130 >> 172.21.15.42:0/2338412130 conn(0x7f9e0806a750 msgr2=0x7f9e080c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:18.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.943+0000 7f9e0f955700 1 -- 172.21.15.42:0/2338412130 shutdown_connections 2023-07-29T02:04:18.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:18.943+0000 7f9e0f955700 1 -- 172.21.15.42:0/2338412130 wait complete. 2023-07-29T02:04:18.931 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 20 2023-07-29T02:04:18.939 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2023-07-29T02:04:20.940 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:04:21.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.095+0000 7efe24dab700 1 Processor -- start 2023-07-29T02:04:21.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.095+0000 7efe24dab700 1 -- start start 2023-07-29T02:04:21.081 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.096+0000 7efe24dab700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efe20151500 0x7efe2006dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:21.081 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.096+0000 7efe24dab700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efe200c7f40 0x7efe2006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:21.082 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.096+0000 7efe24dab700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe2006e950 0x7efe20157490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:21.082 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.096+0000 7efe24dab700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe200cd140 con 0x7efe20151500 2023-07-29T02:04:21.082 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.096+0000 7efe24dab700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe200c2370 con 0x7efe200c7f40 2023-07-29T02:04:21.082 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.096+0000 7efe24dab700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe20156f90 con 0x7efe2006e950 2023-07-29T02:04:21.082 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.096+0000 7efe1e59c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efe20151500 0x7efe2006dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:21.082 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.096+0000 7efe1e59c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efe20151500 0x7efe2006dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57956/0 (socket says 172.21.15.42:57956) 2023-07-29T02:04:21.082 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.096+0000 7efe1e59c700 1 -- 172.21.15.42:0/2570090955 learned_addr learned my addr 172.21.15.42:0/2570090955 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:21.083 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.096+0000 7efe1dd9b700 1 --2- 172.21.15.42:0/2570090955 >> v2:172.21.15.144:3300/0 conn(0x7efe200c7f40 0x7efe2006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:21.083 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.096+0000 7efe1ed9d700 1 --2- 172.21.15.42:0/2570090955 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe2006e950 0x7efe20157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:21.083 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.097+0000 7efe1e59c700 1 -- 172.21.15.42:0/2570090955 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe2006e950 msgr2=0x7efe20157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:04:21.083 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.097+0000 7efe1e59c700 1 --2- 172.21.15.42:0/2570090955 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe2006e950 0x7efe20157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.083 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.097+0000 7efe1e59c700 1 -- 172.21.15.42:0/2570090955 >> v2:172.21.15.144:3300/0 conn(0x7efe200c7f40 msgr2=0x7efe2006e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:04:21.083 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.097+0000 7efe1e59c700 1 --2- 172.21.15.42:0/2570090955 >> v2:172.21.15.144:3300/0 conn(0x7efe200c7f40 0x7efe2006e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.083 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.097+0000 7efe1e59c700 1 -- 172.21.15.42:0/2570090955 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe200cd390 con 0x7efe20151500 2023-07-29T02:04:21.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.097+0000 7efe1e59c700 1 --2- 172.21.15.42:0/2570090955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe20151500 0x7efe2006dc60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7efe20071e90 tx=0x7efe10009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd11b827b85f8949 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:21.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.097+0000 7efe1d59a700 1 -- 172.21.15.42:0/2570090955 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe10011830 con 0x7efe20151500 2023-07-29T02:04:21.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.097+0000 7efe1d59a700 1 -- 172.21.15.42:0/2570090955 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe10011990 con 0x7efe20151500 2023-07-29T02:04:21.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.097+0000 7efe1d59a700 1 -- 172.21.15.42:0/2570090955 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe10011d20 con 0x7efe20151500 2023-07-29T02:04:21.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.098+0000 7efe24dab700 1 -- 172.21.15.42:0/2570090955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe20151500 msgr2=0x7efe2006dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:21.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.098+0000 7efe24dab700 1 --2- 172.21.15.42:0/2570090955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe20151500 0x7efe2006dc60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7efe20071e90 tx=0x7efe10009bd0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.098+0000 7efe24dab700 1 -- 172.21.15.42:0/2570090955 shutdown_connections 2023-07-29T02:04:21.085 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.098+0000 7efe24dab700 1 --2- 172.21.15.42:0/2570090955 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe2006e950 0x7efe20157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.085 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.098+0000 7efe24dab700 1 --2- 172.21.15.42:0/2570090955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe20151500 0x7efe2006dc60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.085 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.098+0000 7efe24dab700 1 --2- 172.21.15.42:0/2570090955 >> v2:172.21.15.144:3300/0 conn(0x7efe200c7f40 0x7efe2006e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.085 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.098+0000 7efe24dab700 1 -- 172.21.15.42:0/2570090955 >> 172.21.15.42:0/2570090955 conn(0x7efe20061190 msgr2=0x7efe20061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:21.085 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.098+0000 7efe24dab700 1 -- 172.21.15.42:0/2570090955 shutdown_connections 2023-07-29T02:04:21.085 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.098+0000 7efe24dab700 1 -- 172.21.15.42:0/2570090955 wait complete. 2023-07-29T02:04:21.087 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.099+0000 7efe24dab700 1 Processor -- start 2023-07-29T02:04:21.087 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.099+0000 7efe24dab700 1 -- start start 2023-07-29T02:04:21.088 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.100+0000 7efe24dab700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe2006e950 0x7efe20147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:21.088 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.100+0000 7efe24dab700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe200c7f40 0x7efe2014ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:21.088 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.100+0000 7efe24dab700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe20151500 0x7efe2014d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:21.088 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.100+0000 7efe24dab700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2006cd10 con 0x7efe200c7f40 2023-07-29T02:04:21.088 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.100+0000 7efe24dab700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2006cf90 con 0x7efe20151500 2023-07-29T02:04:21.088 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.100+0000 7efe24dab700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2006d270 con 0x7efe2006e950 2023-07-29T02:04:21.088 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.100+0000 7efe1dd9b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe200c7f40 0x7efe2014ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:21.089 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.100+0000 7efe1dd9b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe200c7f40 0x7efe2014ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57964/0 (socket says 172.21.15.42:57964) 2023-07-29T02:04:21.089 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.100+0000 7efe1dd9b700 1 -- 172.21.15.42:0/1314485477 learned_addr learned my addr 172.21.15.42:0/1314485477 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:21.089 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.101+0000 7efe1ed9d700 1 --2- 172.21.15.42:0/1314485477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe20151500 0x7efe2014d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:21.089 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.101+0000 7efe1e59c700 1 --2- 172.21.15.42:0/1314485477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe2006e950 0x7efe20147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:21.089 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.101+0000 7efe1dd9b700 1 -- 172.21.15.42:0/1314485477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe2006e950 msgr2=0x7efe20147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:21.089 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.101+0000 7efe1dd9b700 1 --2- 172.21.15.42:0/1314485477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe2006e950 0x7efe20147050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.089 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.101+0000 7efe1dd9b700 1 -- 172.21.15.42:0/1314485477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe20151500 msgr2=0x7efe2014d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.101+0000 7efe1dd9b700 1 --2- 172.21.15.42:0/1314485477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe20151500 0x7efe2014d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.101+0000 7efe1dd9b700 1 -- 172.21.15.42:0/1314485477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe10009550 con 0x7efe200c7f40 2023-07-29T02:04:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.101+0000 7efe1e59c700 1 --2- 172.21.15.42:0/1314485477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe2006e950 0x7efe20147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:04:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.101+0000 7efe1dd9b700 1 --2- 172.21.15.42:0/1314485477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe200c7f40 0x7efe2014ce90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7efe0800e870 tx=0x7efe0800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.101+0000 7efe16ffd700 1 -- 172.21.15.42:0/1314485477 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe08009590 con 0x7efe200c7f40 2023-07-29T02:04:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.101+0000 7efe16ffd700 1 -- 172.21.15.42:0/1314485477 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe08013680 con 0x7efe200c7f40 2023-07-29T02:04:21.090 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.101+0000 7efe24dab700 1 -- 172.21.15.42:0/1314485477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2006d550 con 0x7efe200c7f40 2023-07-29T02:04:21.091 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.101+0000 7efe16ffd700 1 -- 172.21.15.42:0/1314485477 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe080139f0 con 0x7efe200c7f40 2023-07-29T02:04:21.091 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.101+0000 7efe24dab700 1 -- 172.21.15.42:0/1314485477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2014c970 con 0x7efe200c7f40 2023-07-29T02:04:21.091 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.102+0000 7efe24dab700 1 -- 172.21.15.42:0/1314485477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2014cb60 con 0x7efe200c7f40 2023-07-29T02:04:21.091 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.103+0000 7efe16ffd700 1 -- 172.21.15.42:0/1314485477 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7efe08013b50 con 0x7efe200c7f40 2023-07-29T02:04:21.091 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.103+0000 7efe16ffd700 1 --2- 172.21.15.42:0/1314485477 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efe0006a690 0x7efe0006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:21.091 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.103+0000 7efe16ffd700 1 -- 172.21.15.42:0/1314485477 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7efe08088d10 con 0x7efe200c7f40 2023-07-29T02:04:21.091 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.103+0000 7efe1e59c700 1 --2- 172.21.15.42:0/1314485477 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efe0006a690 0x7efe0006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:21.091 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.104+0000 7efe1e59c700 1 --2- 172.21.15.42:0/1314485477 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efe0006a690 0x7efe0006cb40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efe10009840 tx=0x7efe10008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:21.092 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.107+0000 7efe16ffd700 1 -- 172.21.15.42:0/1314485477 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7efe08053d80 con 0x7efe200c7f40 2023-07-29T02:04:21.335 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.351+0000 7efe24dab700 1 -- 172.21.15.42:0/1314485477 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe2004ea50 con 0x7efe200c7f40 2023-07-29T02:04:21.336 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.352+0000 7efe16ffd700 1 -- 172.21.15.42:0/1314485477 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5411 (secure 0 0 0) 0x7efe080573a0 con 0x7efe200c7f40 2023-07-29T02:04:21.336 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:04:21.336 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:04:19.440110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4874":{"gid":4874,"name":"d","rank":0,"incarnation":21,"state":"up:replay","state_seq":1,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:04:21.338 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.354+0000 7efe24dab700 1 -- 172.21.15.42:0/1314485477 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efe0006a690 msgr2=0x7efe0006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:21.338 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.354+0000 7efe24dab700 1 --2- 172.21.15.42:0/1314485477 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efe0006a690 0x7efe0006cb40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efe10009840 tx=0x7efe10008030 comp rx=0 tx=0).stop 2023-07-29T02:04:21.338 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.354+0000 7efe24dab700 1 -- 172.21.15.42:0/1314485477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe200c7f40 msgr2=0x7efe2014ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:21.338 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.354+0000 7efe24dab700 1 --2- 172.21.15.42:0/1314485477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe200c7f40 0x7efe2014ce90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7efe0800e870 tx=0x7efe0800eb80 comp rx=0 tx=0).stop 2023-07-29T02:04:21.338 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.354+0000 7efe24dab700 1 -- 172.21.15.42:0/1314485477 shutdown_connections 2023-07-29T02:04:21.338 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.354+0000 7efe24dab700 1 --2- 172.21.15.42:0/1314485477 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efe0006a690 0x7efe0006cb40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.338 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.354+0000 7efe24dab700 1 --2- 172.21.15.42:0/1314485477 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe20151500 0x7efe2014d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.339 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.354+0000 7efe24dab700 1 --2- 172.21.15.42:0/1314485477 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efe2006e950 0x7efe20147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.339 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.354+0000 7efe24dab700 1 --2- 172.21.15.42:0/1314485477 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efe200c7f40 0x7efe2014ce90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.339 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.354+0000 7efe24dab700 1 -- 172.21.15.42:0/1314485477 >> 172.21.15.42:0/1314485477 conn(0x7efe20061190 msgr2=0x7efe201e3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:21.339 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.354+0000 7efe24dab700 1 -- 172.21.15.42:0/1314485477 shutdown_connections 2023-07-29T02:04:21.339 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.354+0000 7efe24dab700 1 -- 172.21.15.42:0/1314485477 wait complete. 2023-07-29T02:04:21.340 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 21 2023-07-29T02:04:21.350 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e down, removed from mdsmap 2023-07-29T02:04:21.350 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2023-07-29T02:04:21.351 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:04:21.476 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.492+0000 7f2ceefdc700 1 Processor -- start 2023-07-29T02:04:21.476 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.492+0000 7f2ceefdc700 1 -- start start 2023-07-29T02:04:21.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.493+0000 7f2ceefdc700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2ce8072a90 0x7f2ce8164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:21.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.493+0000 7f2ceefdc700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce80c7700 con 0x7f2ce81567d0 2023-07-29T02:04:21.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.493+0000 7f2ceefdc700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce8159170 con 0x7f2ce80c7210 2023-07-29T02:04:21.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.493+0000 7f2ceefdc700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce806b160 con 0x7f2ce8072a90 2023-07-29T02:04:21.478 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.493+0000 7f2cecd78700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f2ce81567d0 0x7f2ce8159950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51774/0 (socket says 172.21.15.42:51774) 2023-07-29T02:04:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.493+0000 7f2cecd78700 1 -- 172.21.15.42:0/1771769565 learned_addr learned my addr 172.21.15.42:0/1771769565 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:04:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.493+0000 7f2ced579700 1 --2- 172.21.15.42:0/1771769565 >> v2:172.21.15.144:3300/0 conn(0x7f2ce8072a90 0x7f2ce8164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.493+0000 7f2ce77fe700 1 -- 172.21.15.42:0/1771769565 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118848024 0 0) 0x7f2ce80c7700 con 0x7f2ce81567d0 2023-07-29T02:04:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.493+0000 7f2ce77fe700 1 -- 172.21.15.42:0/1771769565 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cd80035b0 con 0x7f2ce81567d0 2023-07-29T02:04:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.493+0000 7f2ce77fe700 1 -- 172.21.15.42:0/1771769565 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1221674321 0 0) 0x7f2cd80035b0 con 0x7f2ce81567d0 2023-07-29T02:04:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.493+0000 7f2ced579700 1 -- 172.21.15.42:0/1771769565 >> v1:172.21.15.144:6789/0 conn(0x7f2ce80c7210 legacy=0x7f2ce806cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:21.479 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.493+0000 7f2ced579700 1 -- 172.21.15.42:0/1771769565 >> v1:172.21.15.42:6789/0 conn(0x7f2ce81567d0 legacy=0x7f2ce8159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:21.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.493+0000 7f2ced579700 1 -- 172.21.15.42:0/1771769565 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce8156ba0 con 0x7f2ce8072a90 2023-07-29T02:04:21.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.494+0000 7f2ced579700 1 --2- 172.21.15.42:0/1771769565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ce8072a90 0x7f2ce8164a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009d90 tx=0x7f2ce000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fbb33aef790e661 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:21.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.494+0000 7f2ce77fe700 1 -- 172.21.15.42:0/1771769565 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce000e070 con 0x7f2ce8072a90 2023-07-29T02:04:21.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.494+0000 7f2ce77fe700 1 -- 172.21.15.42:0/1771769565 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce0003a20 con 0x7f2ce8072a90 2023-07-29T02:04:21.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.494+0000 7f2ce77fe700 1 -- 172.21.15.42:0/1771769565 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc001670 con 0x7f2ce8072a90 2023-07-29T02:04:21.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.494+0000 7f2ceefdc700 1 -- 172.21.15.42:0/1771769565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ce8072a90 msgr2=0x7f2ce8164a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:21.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.494+0000 7f2ceefdc700 1 --2- 172.21.15.42:0/1771769565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ce8072a90 0x7f2ce8164a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009d90 tx=0x7f2ce000b330 comp rx=0 tx=0).stop 2023-07-29T02:04:21.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.494+0000 7f2ceefdc700 1 -- 172.21.15.42:0/1771769565 shutdown_connections 2023-07-29T02:04:21.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.494+0000 7f2ceefdc700 1 --2- 172.21.15.42:0/1771769565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ce8072a90 0x7f2ce8164a20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.494+0000 7f2ceefdc700 1 -- 172.21.15.42:0/1771769565 >> 172.21.15.42:0/1771769565 conn(0x7f2ce80c8970 msgr2=0x7f2ce80c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:21.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.494+0000 7f2ceefdc700 1 -- 172.21.15.42:0/1771769565 shutdown_connections 2023-07-29T02:04:21.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.494+0000 7f2ceefdc700 1 -- 172.21.15.42:0/1771769565 wait complete. 2023-07-29T02:04:21.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.496+0000 7f2ceefdc700 1 Processor -- start 2023-07-29T02:04:21.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.496+0000 7f2ceefdc700 1 -- start start 2023-07-29T02:04:21.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.496+0000 7f2ceefdc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ce8072a90 0x7f2ce81e5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:21.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.496+0000 7f2ceefdc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ce80c7210 0x7f2ce80ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:21.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.496+0000 7f2ceefdc700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ce81567d0 0x7f2ce8151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:21.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.496+0000 7f2ceefdc700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce80b02a0 con 0x7f2ce80c7210 2023-07-29T02:04:21.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.496+0000 7f2ceefdc700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce80ad900 con 0x7f2ce81567d0 2023-07-29T02:04:21.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.496+0000 7f2ceefdc700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce80adbe0 con 0x7f2ce8072a90 2023-07-29T02:04:21.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.496+0000 7f2ce7fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ce80c7210 0x7f2ce80ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:21.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.497+0000 7f2ce7fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ce80c7210 0x7f2ce80ae9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57978/0 (socket says 172.21.15.42:57978) 2023-07-29T02:04:21.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.497+0000 7f2ce7fff700 1 -- 172.21.15.42:0/3137743433 learned_addr learned my addr 172.21.15.42:0/3137743433 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:21.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.497+0000 7f2cecd78700 1 --2- 172.21.15.42:0/3137743433 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ce8072a90 0x7f2ce81e5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:21.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.497+0000 7f2ced579700 1 --2- 172.21.15.42:0/3137743433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ce81567d0 0x7f2ce8151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:21.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.497+0000 7f2ce7fff700 1 -- 172.21.15.42:0/3137743433 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ce8072a90 msgr2=0x7f2ce81e5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:21.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.497+0000 7f2ce7fff700 1 --2- 172.21.15.42:0/3137743433 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ce8072a90 0x7f2ce81e5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.497+0000 7f2ce7fff700 1 -- 172.21.15.42:0/3137743433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ce81567d0 msgr2=0x7f2ce8151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:21.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.497+0000 7f2ce7fff700 1 --2- 172.21.15.42:0/3137743433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ce81567d0 0x7f2ce8151380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.486 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.497+0000 7f2ce7fff700 1 -- 172.21.15.42:0/3137743433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce0009a70 con 0x7f2ce80c7210 2023-07-29T02:04:21.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.497+0000 7f2ce7fff700 1 --2- 172.21.15.42:0/3137743433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ce80c7210 0x7f2ce80ae9a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400c490 tx=0x7f2cd400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:21.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.497+0000 7f2ce57fa700 1 -- 172.21.15.42:0/3137743433 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd40052d0 con 0x7f2ce80c7210 2023-07-29T02:04:21.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.497+0000 7f2ce57fa700 1 -- 172.21.15.42:0/3137743433 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd4005450 con 0x7f2ce80c7210 2023-07-29T02:04:21.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.497+0000 7f2ce57fa700 1 -- 172.21.15.42:0/3137743433 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4006aa0 con 0x7f2ce80c7210 2023-07-29T02:04:21.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.497+0000 7f2ceefdc700 1 -- 172.21.15.42:0/3137743433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce80adec0 con 0x7f2ce80c7210 2023-07-29T02:04:21.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.497+0000 7f2ceefdc700 1 -- 172.21.15.42:0/3137743433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce80ae480 con 0x7f2ce80c7210 2023-07-29T02:04:21.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.498+0000 7f2ceefdc700 1 -- 172.21.15.42:0/3137743433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce8074740 con 0x7f2ce80c7210 2023-07-29T02:04:21.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.499+0000 7f2ce57fa700 1 -- 172.21.15.42:0/3137743433 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f2cd4003680 con 0x7f2ce80c7210 2023-07-29T02:04:21.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.499+0000 7f2ce57fa700 1 --2- 172.21.15.42:0/3137743433 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2ccc06a660 0x7f2ccc06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:21.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.499+0000 7f2ce57fa700 1 -- 172.21.15.42:0/3137743433 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f2cd40881d0 con 0x7f2ce80c7210 2023-07-29T02:04:21.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.499+0000 7f2cecd78700 1 --2- 172.21.15.42:0/3137743433 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2ccc06a660 0x7f2ccc06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:21.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.500+0000 7f2cecd78700 1 --2- 172.21.15.42:0/3137743433 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2ccc06a660 0x7f2ccc06cb10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc0011e0 tx=0x7f2cdc001da0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:21.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.504+0000 7f2ce57fa700 1 -- 172.21.15.42:0/3137743433 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f2cd404b2c0 con 0x7f2ce80c7210 2023-07-29T02:04:21.736 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.752+0000 7f2ceefdc700 1 -- 172.21.15.42:0/3137743433 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ce804ea50 con 0x7f2ce80c7210 2023-07-29T02:04:21.737 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.753+0000 7f2ce57fa700 1 -- 172.21.15.42:0/3137743433 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5411 (secure 0 0 0) 0x7f2cd4053120 con 0x7f2ce80c7210 2023-07-29T02:04:21.737 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:04:21.737 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:04:19.440110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4874":{"gid":4874,"name":"d","rank":0,"incarnation":21,"state":"up:replay","state_seq":1,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:04:21.738 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.755+0000 7f2ceefdc700 1 -- 172.21.15.42:0/3137743433 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2ccc06a660 msgr2=0x7f2ccc06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:21.738 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.755+0000 7f2ceefdc700 1 --2- 172.21.15.42:0/3137743433 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2ccc06a660 0x7f2ccc06cb10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc0011e0 tx=0x7f2cdc001da0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.739 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.755+0000 7f2ceefdc700 1 -- 172.21.15.42:0/3137743433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ce80c7210 msgr2=0x7f2ce80ae9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:21.739 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.755+0000 7f2ceefdc700 1 --2- 172.21.15.42:0/3137743433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ce80c7210 0x7f2ce80ae9a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400c490 tx=0x7f2cd400c7a0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.739 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.755+0000 7f2ceefdc700 1 -- 172.21.15.42:0/3137743433 shutdown_connections 2023-07-29T02:04:21.739 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.755+0000 7f2ceefdc700 1 --2- 172.21.15.42:0/3137743433 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2ccc06a660 0x7f2ccc06cb10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.739 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.755+0000 7f2ceefdc700 1 --2- 172.21.15.42:0/3137743433 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ce81567d0 0x7f2ce8151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.739 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.755+0000 7f2ceefdc700 1 --2- 172.21.15.42:0/3137743433 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ce8072a90 0x7f2ce81e5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.739 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.755+0000 7f2ceefdc700 1 --2- 172.21.15.42:0/3137743433 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ce80c7210 0x7f2ce80ae9a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:21.740 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.755+0000 7f2ceefdc700 1 -- 172.21.15.42:0/3137743433 >> 172.21.15.42:0/3137743433 conn(0x7f2ce80c8970 msgr2=0x7f2ce80c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:21.740 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.755+0000 7f2ceefdc700 1 -- 172.21.15.42:0/3137743433 shutdown_connections 2023-07-29T02:04:21.740 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:21.755+0000 7f2ceefdc700 1 -- 172.21.15.42:0/3137743433 wait complete. 2023-07-29T02:04:21.740 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 21 2023-07-29T02:04:21.751 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 21, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-07-29T01:59:57.946839+0000", "damaged": [], "data_pools": [ 4, 5 ], "enabled": true, "epoch": 21, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4874": { "addr": "172.21.15.144:6839/4219857785", "addrs": { "addrvec": [ { "addr": "172.21.15.144:6837", "nonce": 4219857785, "type": "v2" }, { "addr": "172.21.15.144:6839", "nonce": 4219857785, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4874, "incarnation": 21, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 39, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 3, "modified": "2023-07-29T02:04:19.440110+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4874 } } } ], "standbys": [ { "addr": "172.21.15.42:6833/3242692321", "addrs": { "addrvec": [ { "addr": "172.21.15.42:6832", "nonce": 3242692321, "type": "v2" }, { "addr": "172.21.15.42:6833", "nonce": 3242692321, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4263, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.42:6835/1860885615", "addrs": { "addrvec": [ { "addr": "172.21.15.42:6834", "nonce": 1860885615, "type": "v2" }, { "addr": "172.21.15.42:6835", "nonce": 1860885615, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4266, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.144:6835/400694688", "addrs": { "addrvec": [ { "addr": "172.21.15.144:6834", "nonce": 400694688, "type": "v2" }, { "addr": "172.21.15.144:6835", "nonce": 400694688, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4291, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.144:6838/2604441175", "addrs": { "addrvec": [ { "addr": "172.21.15.144:6836", "nonce": 2604441175, "type": "v2" }, { "addr": "172.21.15.144:6838", "nonce": 2604441175, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4294, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-07-29T02:04:23.752 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:04:23.892 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.908+0000 7f872f87d700 1 Processor -- start 2023-07-29T02:04:23.892 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.908+0000 7f872f87d700 1 -- start start 2023-07-29T02:04:23.899 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.909+0000 7f872f87d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f872814fd20 0x7f8728071950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:23.899 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.909+0000 7f872f87d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f872806c3f0 0x7f8728071e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:23.900 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.909+0000 7f872f87d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f872806ef60 con 0x7f87280c57a0 2023-07-29T02:04:23.900 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.909+0000 7f872f87d700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8728061740 con 0x7f872814fd20 2023-07-29T02:04:23.900 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.909+0000 7f872f87d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8728155d10 con 0x7f872806c3f0 2023-07-29T02:04:23.901 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.909+0000 7f872d619700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f872814fd20 0x7f8728071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:23.901 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.909+0000 7f872d619700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f872814fd20 0x7f8728071950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57984/0 (socket says 172.21.15.42:57984) 2023-07-29T02:04:23.901 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.909+0000 7f872d619700 1 -- 172.21.15.42:0/2629653017 learned_addr learned my addr 172.21.15.42:0/2629653017 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:23.901 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.909+0000 7f872de1a700 1 --2- 172.21.15.42:0/2629653017 >> v2:172.21.15.144:3300/0 conn(0x7f872806c3f0 0x7f8728071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:23.901 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.909+0000 7f872d619700 1 -- 172.21.15.42:0/2629653017 >> v2:172.21.15.144:3300/0 conn(0x7f872806c3f0 msgr2=0x7f8728071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:04:23.901 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.909+0000 7f872d619700 1 --2- 172.21.15.42:0/2629653017 >> v2:172.21.15.144:3300/0 conn(0x7f872806c3f0 0x7f8728071e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:23.901 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.909+0000 7f872d619700 1 -- 172.21.15.42:0/2629653017 >> v1:172.21.15.144:6789/0 conn(0x7f87280c57a0 legacy=0x7f872806bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:23.902 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.909+0000 7f872d619700 1 -- 172.21.15.42:0/2629653017 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872806b850 con 0x7f872814fd20 2023-07-29T02:04:23.902 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.910+0000 7f872de1a700 1 --2- 172.21.15.42:0/2629653017 >> v2:172.21.15.144:3300/0 conn(0x7f872806c3f0 0x7f8728071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:04:23.902 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.910+0000 7f872d619700 1 --2- 172.21.15.42:0/2629653017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f872814fd20 0x7f8728071950 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f87280c9130 tx=0x7f8724009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846ae28378d117e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:23.902 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.910+0000 7f871ffff700 1 -- 172.21.15.42:0/2629653017 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872400b870 con 0x7f872814fd20 2023-07-29T02:04:23.902 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.910+0000 7f871ffff700 1 -- 172.21.15.42:0/2629653017 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872400b9d0 con 0x7f872814fd20 2023-07-29T02:04:23.902 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.910+0000 7f871ffff700 1 -- 172.21.15.42:0/2629653017 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872400bd60 con 0x7f872814fd20 2023-07-29T02:04:23.902 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.910+0000 7f872f87d700 1 -- 172.21.15.42:0/2629653017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f872814fd20 msgr2=0x7f8728071950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:23.903 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.911+0000 7f872f87d700 1 --2- 172.21.15.42:0/2629653017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f872814fd20 0x7f8728071950 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f87280c9130 tx=0x7f8724009bd0 comp rx=0 tx=0).stop 2023-07-29T02:04:23.903 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.911+0000 7f872f87d700 1 -- 172.21.15.42:0/2629653017 shutdown_connections 2023-07-29T02:04:23.903 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.911+0000 7f872f87d700 1 --2- 172.21.15.42:0/2629653017 >> v2:172.21.15.144:3300/0 conn(0x7f872806c3f0 0x7f8728071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:23.903 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.911+0000 7f872f87d700 1 --2- 172.21.15.42:0/2629653017 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f872814fd20 0x7f8728071950 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:23.903 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.911+0000 7f872f87d700 1 -- 172.21.15.42:0/2629653017 >> 172.21.15.42:0/2629653017 conn(0x7f87280c80e0 msgr2=0x7f87280c84e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:23.903 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.911+0000 7f872f87d700 1 -- 172.21.15.42:0/2629653017 shutdown_connections 2023-07-29T02:04:23.903 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.911+0000 7f872f87d700 1 -- 172.21.15.42:0/2629653017 wait complete. 2023-07-29T02:04:23.903 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.912+0000 7f872f87d700 1 Processor -- start 2023-07-29T02:04:23.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.912+0000 7f872f87d700 1 -- start start 2023-07-29T02:04:23.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.913+0000 7f872f87d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f872806c3f0 0x7f8728145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:23.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.913+0000 7f872f87d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87280c57a0 0x7f8728147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:23.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.913+0000 7f872f87d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f872814fd20 0x7f87280c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:23.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.913+0000 7f872f87d700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8728155240 con 0x7f87280c57a0 2023-07-29T02:04:23.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.913+0000 7f872f87d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87281555d0 con 0x7f872814fd20 2023-07-29T02:04:23.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.913+0000 7f872f87d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87280cae60 con 0x7f872806c3f0 2023-07-29T02:04:23.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.913+0000 7f872ce18700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87280c57a0 0x7f8728147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:23.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.913+0000 7f872ce18700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87280c57a0 0x7f8728147330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:57992/0 (socket says 172.21.15.42:57992) 2023-07-29T02:04:23.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.913+0000 7f872ce18700 1 -- 172.21.15.42:0/3945671255 learned_addr learned my addr 172.21.15.42:0/3945671255 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:23.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.913+0000 7f872d619700 1 --2- 172.21.15.42:0/3945671255 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f872806c3f0 0x7f8728145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:23.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.913+0000 7f872de1a700 1 --2- 172.21.15.42:0/3945671255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f872814fd20 0x7f87280c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:23.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.913+0000 7f872ce18700 1 -- 172.21.15.42:0/3945671255 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f872806c3f0 msgr2=0x7f8728145030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:23.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.913+0000 7f872ce18700 1 --2- 172.21.15.42:0/3945671255 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f872806c3f0 0x7f8728145030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:23.906 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.913+0000 7f872ce18700 1 -- 172.21.15.42:0/3945671255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f872814fd20 msgr2=0x7f87280c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:23.906 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.913+0000 7f872ce18700 1 --2- 172.21.15.42:0/3945671255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f872814fd20 0x7f87280c9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:23.906 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.913+0000 7f872ce18700 1 -- 172.21.15.42:0/3945671255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8724009550 con 0x7f87280c57a0 2023-07-29T02:04:23.906 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.913+0000 7f872ce18700 1 --2- 172.21.15.42:0/3945671255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87280c57a0 0x7f8728147330 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f871800c4e0 tx=0x7f871800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:23.906 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.913+0000 7f871dffb700 1 -- 172.21.15.42:0/3945671255 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87180052d0 con 0x7f87280c57a0 2023-07-29T02:04:23.906 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.913+0000 7f871dffb700 1 -- 172.21.15.42:0/3945671255 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871800ce90 con 0x7f87280c57a0 2023-07-29T02:04:23.906 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.914+0000 7f872f87d700 1 -- 172.21.15.42:0/3945671255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8728153080 con 0x7f87280c57a0 2023-07-29T02:04:23.907 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.914+0000 7f871dffb700 1 -- 172.21.15.42:0/3945671255 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8718003680 con 0x7f87280c57a0 2023-07-29T02:04:23.907 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.914+0000 7f872f87d700 1 -- 172.21.15.42:0/3945671255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87280c9550 con 0x7f87280c57a0 2023-07-29T02:04:23.907 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.915+0000 7f872f87d700 1 -- 172.21.15.42:0/3945671255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8728147050 con 0x7f87280c57a0 2023-07-29T02:04:23.907 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.915+0000 7f871dffb700 1 -- 172.21.15.42:0/3945671255 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f87180037e0 con 0x7f87280c57a0 2023-07-29T02:04:23.907 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.915+0000 7f871dffb700 1 --2- 172.21.15.42:0/3945671255 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f870c06a660 0x7f870c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:23.907 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.916+0000 7f871dffb700 1 -- 172.21.15.42:0/3945671255 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f8718088230 con 0x7f87280c57a0 2023-07-29T02:04:23.907 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.916+0000 7f872d619700 1 --2- 172.21.15.42:0/3945671255 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f870c06a660 0x7f870c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:23.908 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.916+0000 7f872d619700 1 --2- 172.21.15.42:0/3945671255 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f870c06a660 0x7f870c06cb10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8724000c00 tx=0x7f8724008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:23.908 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:23.920+0000 7f871dffb700 1 -- 172.21.15.42:0/3945671255 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f8728147050 con 0x7f87280c57a0 2023-07-29T02:04:24.144 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:24.161+0000 7f872f87d700 1 -- 172.21.15.42:0/3945671255 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8728147050 con 0x7f87280c57a0 2023-07-29T02:04:24.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:24.162+0000 7f871dffb700 1 -- 172.21.15.42:0/3945671255 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5411 (secure 0 0 0) 0x7f8728147050 con 0x7f87280c57a0 2023-07-29T02:04:24.145 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:04:24.145 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:04:19.440110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4874":{"gid":4874,"name":"d","rank":0,"incarnation":21,"state":"up:replay","state_seq":1,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:04:24.147 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:24.164+0000 7f872f87d700 1 -- 172.21.15.42:0/3945671255 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f870c06a660 msgr2=0x7f870c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:24.148 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:24.164+0000 7f872f87d700 1 --2- 172.21.15.42:0/3945671255 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f870c06a660 0x7f870c06cb10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8724000c00 tx=0x7f8724008030 comp rx=0 tx=0).stop 2023-07-29T02:04:24.148 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:24.164+0000 7f872f87d700 1 -- 172.21.15.42:0/3945671255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87280c57a0 msgr2=0x7f8728147330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:24.148 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:24.164+0000 7f872f87d700 1 --2- 172.21.15.42:0/3945671255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87280c57a0 0x7f8728147330 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f871800c4e0 tx=0x7f871800c7f0 comp rx=0 tx=0).stop 2023-07-29T02:04:24.148 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:24.164+0000 7f872f87d700 1 -- 172.21.15.42:0/3945671255 shutdown_connections 2023-07-29T02:04:24.148 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:24.164+0000 7f872f87d700 1 --2- 172.21.15.42:0/3945671255 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f870c06a660 0x7f870c06cb10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:24.148 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:24.164+0000 7f872f87d700 1 --2- 172.21.15.42:0/3945671255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f872814fd20 0x7f87280c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:24.148 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:24.164+0000 7f872f87d700 1 --2- 172.21.15.42:0/3945671255 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f872806c3f0 0x7f8728145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:24.149 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:24.164+0000 7f872f87d700 1 --2- 172.21.15.42:0/3945671255 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87280c57a0 0x7f8728147330 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:24.149 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:24.164+0000 7f872f87d700 1 -- 172.21.15.42:0/3945671255 >> 172.21.15.42:0/3945671255 conn(0x7f87280c80e0 msgr2=0x7f87280c6770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:24.149 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:24.164+0000 7f872f87d700 1 -- 172.21.15.42:0/3945671255 shutdown_connections 2023-07-29T02:04:24.149 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:24.164+0000 7f872f87d700 1 -- 172.21.15.42:0/3945671255 wait complete. 2023-07-29T02:04:24.149 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 21 2023-07-29T02:04:24.160 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2023-07-29T02:04:26.160 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:04:26.301 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.317+0000 7f87bffff700 1 Processor -- start 2023-07-29T02:04:26.301 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.317+0000 7f87bffff700 1 -- start start 2023-07-29T02:04:26.302 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.318+0000 7f87bffff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87c0153180 0x7f87c00c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:26.303 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.318+0000 7f87bffff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f87c00c8fb0 0x7f87c00c1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:26.303 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.318+0000 7f87bffff700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c00725e0 con 0x7f87c0072a70 2023-07-29T02:04:26.303 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.318+0000 7f87bffff700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c0153550 con 0x7f87c00c8fb0 2023-07-29T02:04:26.303 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.318+0000 7f87bffff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c0159f10 con 0x7f87c0153180 2023-07-29T02:04:26.303 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.318+0000 7f87bf7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f87c00c8fb0 0x7f87c00c1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:26.303 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.318+0000 7f87be7fc700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f87c0072a70 0x7f87c00c0e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51804/0 (socket says 172.21.15.42:51804) 2023-07-29T02:04:26.304 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.318+0000 7f87be7fc700 1 -- 172.21.15.42:0/3557791819 learned_addr learned my addr 172.21.15.42:0/3557791819 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:04:26.304 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.318+0000 7f87beffd700 1 --2- 172.21.15.42:0/3557791819 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87c0153180 0x7f87c00c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:26.304 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.319+0000 7f87bf7fe700 1 -- 172.21.15.42:0/3557791819 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87c0153180 msgr2=0x7f87c00c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:04:26.304 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.319+0000 7f87bf7fe700 1 --2- 172.21.15.42:0/3557791819 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87c0153180 0x7f87c00c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:26.304 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.319+0000 7f87bf7fe700 1 -- 172.21.15.42:0/3557791819 >> v1:172.21.15.42:6789/0 conn(0x7f87c0072a70 legacy=0x7f87c00c0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:26.304 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.319+0000 7f87bf7fe700 1 -- 172.21.15.42:0/3557791819 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c00719d0 con 0x7f87c00c8fb0 2023-07-29T02:04:26.304 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.319+0000 7f87bdffb700 1 -- 172.21.15.42:0/3557791819 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3404680882 0 0) 0x7f87c00725e0 con 0x7f87c0072a70 2023-07-29T02:04:26.305 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.319+0000 7f87bf7fe700 1 --2- 172.21.15.42:0/3557791819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c00c8fb0 0x7f87c00c1560 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009d90 tx=0x7f87b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b848fd549ebe4225 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:26.305 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.319+0000 7f87bdffb700 1 -- 172.21.15.42:0/3557791819 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b800e070 con 0x7f87c00c8fb0 2023-07-29T02:04:26.305 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.319+0000 7f87bdffb700 1 -- 172.21.15.42:0/3557791819 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b800bb20 con 0x7f87c00c8fb0 2023-07-29T02:04:26.305 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.319+0000 7f87bdffb700 1 -- 172.21.15.42:0/3557791819 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b8012430 con 0x7f87c00c8fb0 2023-07-29T02:04:26.307 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.320+0000 7f87bffff700 1 -- 172.21.15.42:0/3557791819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c00c8fb0 msgr2=0x7f87c00c1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:26.307 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.320+0000 7f87bffff700 1 --2- 172.21.15.42:0/3557791819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c00c8fb0 0x7f87c00c1560 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009d90 tx=0x7f87b800b330 comp rx=0 tx=0).stop 2023-07-29T02:04:26.308 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.320+0000 7f87bffff700 1 -- 172.21.15.42:0/3557791819 shutdown_connections 2023-07-29T02:04:26.308 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.320+0000 7f87bffff700 1 --2- 172.21.15.42:0/3557791819 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c00c8fb0 0x7f87c00c1560 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:26.308 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.320+0000 7f87bffff700 1 --2- 172.21.15.42:0/3557791819 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87c0153180 0x7f87c00c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:26.308 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.320+0000 7f87bffff700 1 -- 172.21.15.42:0/3557791819 >> 172.21.15.42:0/3557791819 conn(0x7f87c00cc980 msgr2=0x7f87c00c8780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:26.308 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.320+0000 7f87bffff700 1 -- 172.21.15.42:0/3557791819 shutdown_connections 2023-07-29T02:04:26.309 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.320+0000 7f87bffff700 1 -- 172.21.15.42:0/3557791819 wait complete. 2023-07-29T02:04:26.309 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.321+0000 7f87bffff700 1 Processor -- start 2023-07-29T02:04:26.309 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.322+0000 7f87bffff700 1 -- start start 2023-07-29T02:04:26.309 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.323+0000 7f87bffff700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87c0072a70 0x7f87c0154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:26.309 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.323+0000 7f87bffff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c00c8fb0 0x7f87c006b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:26.309 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.323+0000 7f87bffff700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87c0153180 0x7f87c00ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:26.310 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.323+0000 7f87bffff700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c01ef690 con 0x7f87c00c8fb0 2023-07-29T02:04:26.310 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.323+0000 7f87bffff700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c0154570 con 0x7f87c0153180 2023-07-29T02:04:26.310 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.323+0000 7f87bffff700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c01efb80 con 0x7f87c0072a70 2023-07-29T02:04:26.310 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.323+0000 7f87be7fc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c00c8fb0 0x7f87c006b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:26.310 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.323+0000 7f87beffd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87c0072a70 0x7f87c0154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:26.310 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.323+0000 7f87be7fc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c00c8fb0 0x7f87c006b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58006/0 (socket says 172.21.15.42:58006) 2023-07-29T02:04:26.310 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.323+0000 7f87be7fc700 1 -- 172.21.15.42:0/2429573015 learned_addr learned my addr 172.21.15.42:0/2429573015 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:26.311 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.323+0000 7f87bf7fe700 1 --2- 172.21.15.42:0/2429573015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87c0153180 0x7f87c00ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:26.311 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.323+0000 7f87beffd700 1 -- 172.21.15.42:0/2429573015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87c0153180 msgr2=0x7f87c00ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:26.311 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.323+0000 7f87beffd700 1 --2- 172.21.15.42:0/2429573015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87c0153180 0x7f87c00ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:26.311 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.323+0000 7f87beffd700 1 -- 172.21.15.42:0/2429573015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c00c8fb0 msgr2=0x7f87c006b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:26.311 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.323+0000 7f87beffd700 1 --2- 172.21.15.42:0/2429573015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c00c8fb0 0x7f87c006b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:26.312 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.323+0000 7f87beffd700 1 -- 172.21.15.42:0/2429573015 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b8009a70 con 0x7f87c0072a70 2023-07-29T02:04:26.312 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.323+0000 7f87beffd700 1 --2- 172.21.15.42:0/2429573015 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87c0072a70 0x7f87c0154030 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f87b400e900 tx=0x7f87b400ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:26.312 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.324+0000 7f87a7fff700 1 -- 172.21.15.42:0/2429573015 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b4013680 con 0x7f87c0072a70 2023-07-29T02:04:26.312 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.324+0000 7f87a7fff700 1 -- 172.21.15.42:0/2429573015 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b40137e0 con 0x7f87c0072a70 2023-07-29T02:04:26.312 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.324+0000 7f87bffff700 1 -- 172.21.15.42:0/2429573015 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c00c9c10 con 0x7f87c0072a70 2023-07-29T02:04:26.312 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.324+0000 7f87a7fff700 1 -- 172.21.15.42:0/2429573015 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b4013b50 con 0x7f87c0072a70 2023-07-29T02:04:26.313 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.324+0000 7f87bffff700 1 -- 172.21.15.42:0/2429573015 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c01ef8a0 con 0x7f87c0072a70 2023-07-29T02:04:26.313 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.325+0000 7f87bffff700 1 -- 172.21.15.42:0/2429573015 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c0074cb0 con 0x7f87c0072a70 2023-07-29T02:04:26.314 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.325+0000 7f87a7fff700 1 -- 172.21.15.42:0/2429573015 <== mon.2 v2:172.21.15.144:3301/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f87b4013cb0 con 0x7f87c0072a70 2023-07-29T02:04:26.314 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.325+0000 7f87a7fff700 1 --2- 172.21.15.42:0/2429573015 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f87ac06a690 0x7f87ac06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:26.314 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.326+0000 7f87a7fff700 1 -- 172.21.15.42:0/2429573015 <== mon.2 v2:172.21.15.144:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f87b40890e0 con 0x7f87c0072a70 2023-07-29T02:04:26.314 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.326+0000 7f87be7fc700 1 --2- 172.21.15.42:0/2429573015 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f87ac06a690 0x7f87ac06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:26.314 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.326+0000 7f87be7fc700 1 --2- 172.21.15.42:0/2429573015 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f87ac06a690 0x7f87ac06cb40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f87c00cb550 tx=0x7f87b0007f30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:26.315 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.331+0000 7f87a7fff700 1 -- 172.21.15.42:0/2429573015 <== mon.2 v2:172.21.15.144:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f87b4057bc0 con 0x7f87c0072a70 2023-07-29T02:04:26.564 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.581+0000 7f87bffff700 1 -- 172.21.15.42:0/2429573015 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87c0071f60 con 0x7f87c0072a70 2023-07-29T02:04:26.565 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.581+0000 7f87a7fff700 1 -- 172.21.15.42:0/2429573015 <== mon.2 v2:172.21.15.144:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5411 (secure 0 0 0) 0x7f87b4057750 con 0x7f87c0072a70 2023-07-29T02:04:26.565 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:04:26.565 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:04:19.440110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4874":{"gid":4874,"name":"d","rank":0,"incarnation":21,"state":"up:replay","state_seq":1,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:04:26.567 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.584+0000 7f87bffff700 1 -- 172.21.15.42:0/2429573015 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f87ac06a690 msgr2=0x7f87ac06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:26.568 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.584+0000 7f87bffff700 1 --2- 172.21.15.42:0/2429573015 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f87ac06a690 0x7f87ac06cb40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f87c00cb550 tx=0x7f87b0007f30 comp rx=0 tx=0).stop 2023-07-29T02:04:26.568 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.584+0000 7f87bffff700 1 -- 172.21.15.42:0/2429573015 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87c0072a70 msgr2=0x7f87c0154030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:26.568 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.584+0000 7f87bffff700 1 --2- 172.21.15.42:0/2429573015 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87c0072a70 0x7f87c0154030 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f87b400e900 tx=0x7f87b400ec10 comp rx=0 tx=0).stop 2023-07-29T02:04:26.568 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.584+0000 7f87bffff700 1 -- 172.21.15.42:0/2429573015 shutdown_connections 2023-07-29T02:04:26.568 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.584+0000 7f87bffff700 1 --2- 172.21.15.42:0/2429573015 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f87ac06a690 0x7f87ac06cb40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:26.568 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.584+0000 7f87bffff700 1 --2- 172.21.15.42:0/2429573015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f87c0153180 0x7f87c00ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.584+0000 7f87bffff700 1 --2- 172.21.15.42:0/2429573015 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f87c0072a70 0x7f87c0154030 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.584+0000 7f87bffff700 1 --2- 172.21.15.42:0/2429573015 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f87c00c8fb0 0x7f87c006b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.584+0000 7f87bffff700 1 -- 172.21.15.42:0/2429573015 >> 172.21.15.42:0/2429573015 conn(0x7f87c00cc980 msgr2=0x7f87c006e630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.584+0000 7f87bffff700 1 -- 172.21.15.42:0/2429573015 shutdown_connections 2023-07-29T02:04:26.569 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:26.584+0000 7f87bffff700 1 -- 172.21.15.42:0/2429573015 wait complete. 2023-07-29T02:04:26.570 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 21 2023-07-29T02:04:26.580 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2023-07-29T02:04:28.582 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:04:28.719 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.735+0000 7f2e4102c700 1 Processor -- start 2023-07-29T02:04:28.719 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.736+0000 7f2e4102c700 1 -- start start 2023-07-29T02:04:28.721 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.736+0000 7f2e4102c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2e3c1567d0 0x7f2e3c159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:28.722 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.736+0000 7f2e4102c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2e3c0c7210 0x7f2e3c06cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:28.722 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.736+0000 7f2e4102c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3c0c7700 con 0x7f2e3c159e90 2023-07-29T02:04:28.722 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.736+0000 7f2e4102c700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3c06b160 con 0x7f2e3c0c7210 2023-07-29T02:04:28.722 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.736+0000 7f2e4102c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3c159170 con 0x7f2e3c1567d0 2023-07-29T02:04:28.722 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.736+0000 7f2e3a59c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2e3c0c7210 0x7f2e3c06cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:28.722 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.737+0000 7f2e3a59c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f2e3c0c7210 0x7f2e3c06cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58014/0 (socket says 172.21.15.42:58014) 2023-07-29T02:04:28.722 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.737+0000 7f2e3a59c700 1 -- 172.21.15.42:0/1024260554 learned_addr learned my addr 172.21.15.42:0/1024260554 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:28.723 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.737+0000 7f2e3ad9d700 1 --2- 172.21.15.42:0/1024260554 >> v2:172.21.15.144:3300/0 conn(0x7f2e3c1567d0 0x7f2e3c159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:28.723 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.737+0000 7f2e3a59c700 1 -- 172.21.15.42:0/1024260554 >> v2:172.21.15.144:3300/0 conn(0x7f2e3c1567d0 msgr2=0x7f2e3c159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:04:28.723 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.737+0000 7f2e3a59c700 1 --2- 172.21.15.42:0/1024260554 >> v2:172.21.15.144:3300/0 conn(0x7f2e3c1567d0 0x7f2e3c159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:28.723 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.737+0000 7f2e3a59c700 1 -- 172.21.15.42:0/1024260554 >> v1:172.21.15.144:6789/0 conn(0x7f2e3c159e90 legacy=0x7f2e3c15c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:04:28.723 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.737+0000 7f2e3a59c700 1 -- 172.21.15.42:0/1024260554 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c156ba0 con 0x7f2e3c0c7210 2023-07-29T02:04:28.723 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.737+0000 7f2e3ad9d700 1 --2- 172.21.15.42:0/1024260554 >> v2:172.21.15.144:3300/0 conn(0x7f2e3c1567d0 0x7f2e3c159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:04:28.723 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.737+0000 7f2e3a59c700 1 --2- 172.21.15.42:0/1024260554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e3c0c7210 0x7f2e3c06cd10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0704b0 tx=0x7f2e2c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d36fe3d5628c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:28.723 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.737+0000 7f2e39d9b700 1 -- 172.21.15.42:0/1024260554 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c004230 con 0x7f2e3c0c7210 2023-07-29T02:04:28.724 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.737+0000 7f2e39d9b700 1 -- 172.21.15.42:0/1024260554 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2c004390 con 0x7f2e3c0c7210 2023-07-29T02:04:28.724 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.737+0000 7f2e39d9b700 1 -- 172.21.15.42:0/1024260554 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2c0036a0 con 0x7f2e3c0c7210 2023-07-29T02:04:28.724 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.738+0000 7f2e4102c700 1 -- 172.21.15.42:0/1024260554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e3c0c7210 msgr2=0x7f2e3c06cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:28.724 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.738+0000 7f2e4102c700 1 --2- 172.21.15.42:0/1024260554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e3c0c7210 0x7f2e3c06cd10 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0704b0 tx=0x7f2e2c009bd0 comp rx=0 tx=0).stop 2023-07-29T02:04:28.724 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.738+0000 7f2e4102c700 1 -- 172.21.15.42:0/1024260554 shutdown_connections 2023-07-29T02:04:28.724 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.738+0000 7f2e4102c700 1 --2- 172.21.15.42:0/1024260554 >> v2:172.21.15.144:3300/0 conn(0x7f2e3c1567d0 0x7f2e3c159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:28.724 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.738+0000 7f2e4102c700 1 --2- 172.21.15.42:0/1024260554 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e3c0c7210 0x7f2e3c06cd10 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:28.725 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.738+0000 7f2e4102c700 1 -- 172.21.15.42:0/1024260554 >> 172.21.15.42:0/1024260554 conn(0x7f2e3c0c8970 msgr2=0x7f2e3c0c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:28.725 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.738+0000 7f2e4102c700 1 -- 172.21.15.42:0/1024260554 shutdown_connections 2023-07-29T02:04:28.725 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.738+0000 7f2e4102c700 1 -- 172.21.15.42:0/1024260554 wait complete. 2023-07-29T02:04:28.727 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.739+0000 7f2e4102c700 1 Processor -- start 2023-07-29T02:04:28.727 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.739+0000 7f2e4102c700 1 -- start start 2023-07-29T02:04:28.727 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.740+0000 7f2e4102c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e3c0c7210 0x7f2e3c1559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:28.727 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.740+0000 7f2e4102c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e3c1567d0 0x7f2e3c151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:28.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.740+0000 7f2e4102c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e3c159e90 0x7f2e3c0c4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:28.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.740+0000 7f2e4102c700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c1555f0 con 0x7f2e3c0c7210 2023-07-29T02:04:28.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.740+0000 7f2e4102c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c14ca30 con 0x7f2e3c1567d0 2023-07-29T02:04:28.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.740+0000 7f2e4102c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c1f2ce0 con 0x7f2e3c159e90 2023-07-29T02:04:28.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.740+0000 7f2e3ad9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e3c0c7210 0x7f2e3c1559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:28.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.740+0000 7f2e3ad9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e3c0c7210 0x7f2e3c1559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58018/0 (socket says 172.21.15.42:58018) 2023-07-29T02:04:28.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.740+0000 7f2e3ad9d700 1 -- 172.21.15.42:0/2922252824 learned_addr learned my addr 172.21.15.42:0/2922252824 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:28.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.740+0000 7f2e3b59e700 1 --2- 172.21.15.42:0/2922252824 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e3c159e90 0x7f2e3c0c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:28.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.740+0000 7f2e3a59c700 1 --2- 172.21.15.42:0/2922252824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e3c1567d0 0x7f2e3c151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:28.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.741+0000 7f2e3ad9d700 1 -- 172.21.15.42:0/2922252824 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e3c159e90 msgr2=0x7f2e3c0c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:28.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.741+0000 7f2e3ad9d700 1 --2- 172.21.15.42:0/2922252824 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e3c159e90 0x7f2e3c0c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:28.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.741+0000 7f2e3ad9d700 1 -- 172.21.15.42:0/2922252824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e3c1567d0 msgr2=0x7f2e3c151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:28.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.741+0000 7f2e3ad9d700 1 --2- 172.21.15.42:0/2922252824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e3c1567d0 0x7f2e3c151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:28.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.741+0000 7f2e3ad9d700 1 -- 172.21.15.42:0/2922252824 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c009550 con 0x7f2e3c0c7210 2023-07-29T02:04:28.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.741+0000 7f2e3b59e700 1 --2- 172.21.15.42:0/2922252824 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e3c159e90 0x7f2e3c0c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:04:28.730 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.741+0000 7f2e3ad9d700 1 --2- 172.21.15.42:0/2922252824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e3c0c7210 0x7f2e3c1559b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400c750 tx=0x7f2e2400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:28.730 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.741+0000 7f2e337fe700 1 -- 172.21.15.42:0/2922252824 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24011800 con 0x7f2e3c0c7210 2023-07-29T02:04:28.730 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.741+0000 7f2e337fe700 1 -- 172.21.15.42:0/2922252824 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e24011960 con 0x7f2e3c0c7210 2023-07-29T02:04:28.730 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.741+0000 7f2e4102c700 1 -- 172.21.15.42:0/2922252824 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e3c1f2fc0 con 0x7f2e3c0c7210 2023-07-29T02:04:28.730 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.741+0000 7f2e337fe700 1 -- 172.21.15.42:0/2922252824 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e24011cd0 con 0x7f2e3c0c7210 2023-07-29T02:04:28.730 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.741+0000 7f2e4102c700 1 -- 172.21.15.42:0/2922252824 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3c0c3940 con 0x7f2e3c0c7210 2023-07-29T02:04:28.730 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.742+0000 7f2e4102c700 1 -- 172.21.15.42:0/2922252824 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3c074740 con 0x7f2e3c0c7210 2023-07-29T02:04:28.730 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.742+0000 7f2e337fe700 1 -- 172.21.15.42:0/2922252824 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f2e24021350 con 0x7f2e3c0c7210 2023-07-29T02:04:28.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.743+0000 7f2e337fe700 1 --2- 172.21.15.42:0/2922252824 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2e1c06a690 0x7f2e1c06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:28.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.743+0000 7f2e337fe700 1 -- 172.21.15.42:0/2922252824 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f2e24088e30 con 0x7f2e3c0c7210 2023-07-29T02:04:28.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.743+0000 7f2e3a59c700 1 --2- 172.21.15.42:0/2922252824 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2e1c06a690 0x7f2e1c06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:28.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.743+0000 7f2e3a59c700 1 --2- 172.21.15.42:0/2922252824 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2e1c06a690 0x7f2e1c06cb40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c009130 tx=0x7f2e2c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:28.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.747+0000 7f2e337fe700 1 -- 172.21.15.42:0/2922252824 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f2e24053ea0 con 0x7f2e3c0c7210 2023-07-29T02:04:28.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.993+0000 7f2e4102c700 1 -- 172.21.15.42:0/2922252824 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e3c06fa60 con 0x7f2e3c0c7210 2023-07-29T02:04:28.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.994+0000 7f2e337fe700 1 -- 172.21.15.42:0/2922252824 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5415 (secure 0 0 0) 0x7f2e240574c0 con 0x7f2e3c0c7210 2023-07-29T02:04:28.977 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:04:28.978 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:04:28.556536+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4874":{"gid":4874,"name":"d","rank":0,"incarnation":21,"state":"up:reconnect","state_seq":26,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:04:28.979 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.996+0000 7f2e4102c700 1 -- 172.21.15.42:0/2922252824 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2e1c06a690 msgr2=0x7f2e1c06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:28.980 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.996+0000 7f2e4102c700 1 --2- 172.21.15.42:0/2922252824 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2e1c06a690 0x7f2e1c06cb40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c009130 tx=0x7f2e2c008030 comp rx=0 tx=0).stop 2023-07-29T02:04:28.980 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.996+0000 7f2e4102c700 1 -- 172.21.15.42:0/2922252824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e3c0c7210 msgr2=0x7f2e3c1559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:28.980 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.996+0000 7f2e4102c700 1 --2- 172.21.15.42:0/2922252824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e3c0c7210 0x7f2e3c1559b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2e2400c750 tx=0x7f2e2400cb10 comp rx=0 tx=0).stop 2023-07-29T02:04:28.980 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.996+0000 7f2e4102c700 1 -- 172.21.15.42:0/2922252824 shutdown_connections 2023-07-29T02:04:28.980 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.996+0000 7f2e4102c700 1 --2- 172.21.15.42:0/2922252824 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2e1c06a690 0x7f2e1c06cb40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:28.980 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.996+0000 7f2e4102c700 1 --2- 172.21.15.42:0/2922252824 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e3c159e90 0x7f2e3c0c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:28.980 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.996+0000 7f2e4102c700 1 --2- 172.21.15.42:0/2922252824 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e3c0c7210 0x7f2e3c1559b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:28.981 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.996+0000 7f2e4102c700 1 --2- 172.21.15.42:0/2922252824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e3c1567d0 0x7f2e3c151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:28.981 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.996+0000 7f2e4102c700 1 -- 172.21.15.42:0/2922252824 >> 172.21.15.42:0/2922252824 conn(0x7f2e3c0c8970 msgr2=0x7f2e3c0c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:28.981 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.996+0000 7f2e4102c700 1 -- 172.21.15.42:0/2922252824 shutdown_connections 2023-07-29T02:04:28.981 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:28.996+0000 7f2e4102c700 1 -- 172.21.15.42:0/2922252824 wait complete. 2023-07-29T02:04:28.981 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 22 2023-07-29T02:04:28.992 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2023-07-29T02:04:30.993 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:04:31.133 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.150+0000 7ff750773700 1 Processor -- start 2023-07-29T02:04:31.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.150+0000 7ff750773700 1 -- start start 2023-07-29T02:04:31.135 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.151+0000 7ff750773700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff7480716c0 0x7ff748156920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:31.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.151+0000 7ff750773700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7480c24d0 0x7ff7480b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:31.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.151+0000 7ff750773700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff748156e60 con 0x7ff7480c2100 2023-07-29T02:04:31.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.151+0000 7ff750773700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74806c8f0 con 0x7ff7480716c0 2023-07-29T02:04:31.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.151+0000 7ff750773700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74806ba00 con 0x7ff7480c24d0 2023-07-29T02:04:31.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.151+0000 7ff74e50f700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff7480c2100 0x7ff748070fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51830/0 (socket says 172.21.15.42:51830) 2023-07-29T02:04:31.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.151+0000 7ff74e50f700 1 -- 172.21.15.42:0/3447064053 learned_addr learned my addr 172.21.15.42:0/3447064053 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:04:31.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.151+0000 7ff74ed10700 1 --2- 172.21.15.42:0/3447064053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7480c24d0 0x7ff7480b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:31.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.151+0000 7ff74dd0e700 1 --2- 172.21.15.42:0/3447064053 >> v2:172.21.15.144:3300/0 conn(0x7ff7480716c0 0x7ff748156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:31.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.152+0000 7ff74d50d700 1 -- 172.21.15.42:0/3447064053 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039117116 0 0) 0x7ff738001110 con 0x7ff7480c2100 2023-07-29T02:04:31.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.152+0000 7ff74d50d700 1 -- 172.21.15.42:0/3447064053 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7340035b0 con 0x7ff7480c2100 2023-07-29T02:04:31.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.152+0000 7ff74d50d700 1 -- 172.21.15.42:0/3447064053 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3755349722 0 0) 0x7ff7340035b0 con 0x7ff7480c2100 2023-07-29T02:04:31.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.152+0000 7ff74dd0e700 1 -- 172.21.15.42:0/3447064053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7480c24d0 msgr2=0x7ff7480b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:04:31.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.152+0000 7ff74dd0e700 1 --2- 172.21.15.42:0/3447064053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7480c24d0 0x7ff7480b17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:31.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.152+0000 7ff74dd0e700 1 -- 172.21.15.42:0/3447064053 >> v1:172.21.15.42:6789/0 conn(0x7ff7480c2100 legacy=0x7ff748070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:31.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.152+0000 7ff74dd0e700 1 -- 172.21.15.42:0/3447064053 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74806bce0 con 0x7ff7480716c0 2023-07-29T02:04:31.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.152+0000 7ff74ed10700 1 --2- 172.21.15.42:0/3447064053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7480c24d0 0x7ff7480b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:04:31.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.152+0000 7ff74dd0e700 1 --2- 172.21.15.42:0/3447064053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7480716c0 0x7ff748156920 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff744009840 tx=0x7ff744009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3df52be45e556067 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:31.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.152+0000 7ff74d50d700 1 -- 172.21.15.42:0/3447064053 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff738001800 con 0x7ff7480716c0 2023-07-29T02:04:31.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.152+0000 7ff74d50d700 1 -- 172.21.15.42:0/3447064053 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff744004030 con 0x7ff7480716c0 2023-07-29T02:04:31.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.152+0000 7ff74d50d700 1 -- 172.21.15.42:0/3447064053 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7440043c0 con 0x7ff7480716c0 2023-07-29T02:04:31.140 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.153+0000 7ff750773700 1 -- 172.21.15.42:0/3447064053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7480716c0 msgr2=0x7ff748156920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:31.141 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.153+0000 7ff750773700 1 --2- 172.21.15.42:0/3447064053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7480716c0 0x7ff748156920 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff744009840 tx=0x7ff744009b50 comp rx=0 tx=0).stop 2023-07-29T02:04:31.141 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.153+0000 7ff750773700 1 -- 172.21.15.42:0/3447064053 shutdown_connections 2023-07-29T02:04:31.141 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.153+0000 7ff750773700 1 --2- 172.21.15.42:0/3447064053 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7480c24d0 0x7ff7480b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:31.141 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.153+0000 7ff750773700 1 --2- 172.21.15.42:0/3447064053 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7480716c0 0x7ff748156920 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:31.142 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.153+0000 7ff750773700 1 -- 172.21.15.42:0/3447064053 >> 172.21.15.42:0/3447064053 conn(0x7ff74806f850 msgr2=0x7ff7480cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:31.142 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.153+0000 7ff750773700 1 -- 172.21.15.42:0/3447064053 shutdown_connections 2023-07-29T02:04:31.142 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.153+0000 7ff750773700 1 -- 172.21.15.42:0/3447064053 wait complete. 2023-07-29T02:04:31.142 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.154+0000 7ff750773700 1 Processor -- start 2023-07-29T02:04:31.142 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.154+0000 7ff750773700 1 -- start start 2023-07-29T02:04:31.143 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.155+0000 7ff750773700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7480716c0 0x7ff7481e0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:31.143 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.155+0000 7ff750773700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7480c2100 0x7ff74806a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:31.143 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.155+0000 7ff750773700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7480c24d0 0x7ff7481e1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:31.143 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.155+0000 7ff750773700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7481ef4b0 con 0x7ff7480716c0 2023-07-29T02:04:31.143 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.155+0000 7ff750773700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7481ef9e0 con 0x7ff7480c2100 2023-07-29T02:04:31.143 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.155+0000 7ff750773700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7481e0d40 con 0x7ff7480c24d0 2023-07-29T02:04:31.143 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.155+0000 7ff74e50f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7480716c0 0x7ff7481e0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:31.144 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.155+0000 7ff74e50f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7480716c0 0x7ff7481e0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58032/0 (socket says 172.21.15.42:58032) 2023-07-29T02:04:31.144 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.155+0000 7ff74e50f700 1 -- 172.21.15.42:0/2897255056 learned_addr learned my addr 172.21.15.42:0/2897255056 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:31.144 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.155+0000 7ff74dd0e700 1 --2- 172.21.15.42:0/2897255056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7480c2100 0x7ff74806a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:31.144 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.155+0000 7ff74ed10700 1 --2- 172.21.15.42:0/2897255056 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7480c24d0 0x7ff7481e1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:31.144 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.155+0000 7ff74e50f700 1 -- 172.21.15.42:0/2897255056 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7480c24d0 msgr2=0x7ff7481e1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:31.144 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.155+0000 7ff74e50f700 1 --2- 172.21.15.42:0/2897255056 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7480c24d0 0x7ff7481e1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:31.144 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.155+0000 7ff74e50f700 1 -- 172.21.15.42:0/2897255056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7480c2100 msgr2=0x7ff74806a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:31.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.155+0000 7ff74e50f700 1 --2- 172.21.15.42:0/2897255056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7480c2100 0x7ff74806a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:31.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.155+0000 7ff74e50f700 1 -- 172.21.15.42:0/2897255056 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff740009a70 con 0x7ff7480716c0 2023-07-29T02:04:31.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.155+0000 7ff74ed10700 1 --2- 172.21.15.42:0/2897255056 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7480c24d0 0x7ff7481e1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:04:31.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.156+0000 7ff74e50f700 1 --2- 172.21.15.42:0/2897255056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7480716c0 0x7ff7481e0330 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff73800c750 tx=0x7ff73800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:31.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.156+0000 7ff73effd700 1 -- 172.21.15.42:0/2897255056 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff738004c80 con 0x7ff7480716c0 2023-07-29T02:04:31.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.156+0000 7ff73effd700 1 -- 172.21.15.42:0/2897255056 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff738004de0 con 0x7ff7480716c0 2023-07-29T02:04:31.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.156+0000 7ff73effd700 1 -- 172.21.15.42:0/2897255056 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7380072d0 con 0x7ff7480716c0 2023-07-29T02:04:31.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.156+0000 7ff750773700 1 -- 172.21.15.42:0/2897255056 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7440094a0 con 0x7ff7480716c0 2023-07-29T02:04:31.146 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.156+0000 7ff750773700 1 -- 172.21.15.42:0/2897255056 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7481ef700 con 0x7ff7480716c0 2023-07-29T02:04:31.146 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.157+0000 7ff750773700 1 -- 172.21.15.42:0/2897255056 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff74804ea50 con 0x7ff7480716c0 2023-07-29T02:04:31.146 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.157+0000 7ff73effd700 1 -- 172.21.15.42:0/2897255056 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7ff738007430 con 0x7ff7480716c0 2023-07-29T02:04:31.147 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.158+0000 7ff73effd700 1 --2- 172.21.15.42:0/2897255056 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff72c06a660 0x7ff72c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:31.147 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.158+0000 7ff73effd700 1 -- 172.21.15.42:0/2897255056 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7ff738088b60 con 0x7ff7480716c0 2023-07-29T02:04:31.147 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.158+0000 7ff74dd0e700 1 --2- 172.21.15.42:0/2897255056 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff72c06a660 0x7ff72c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:31.147 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.158+0000 7ff74dd0e700 1 --2- 172.21.15.42:0/2897255056 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff72c06a660 0x7ff72c06cb10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff7440090b0 tx=0x7ff744008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:31.147 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.162+0000 7ff73effd700 1 -- 172.21.15.42:0/2897255056 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7ff738053bd0 con 0x7ff7480716c0 2023-07-29T02:04:31.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.405+0000 7ff750773700 1 -- 172.21.15.42:0/2897255056 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff748156e60 con 0x7ff7480716c0 2023-07-29T02:04:31.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.405+0000 7ff73effd700 1 -- 172.21.15.42:0/2897255056 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5415 (secure 0 0 0) 0x7ff748156e60 con 0x7ff7480716c0 2023-07-29T02:04:31.389 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:04:31.389 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:04:28.556536+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4874":{"gid":4874,"name":"d","rank":0,"incarnation":21,"state":"up:reconnect","state_seq":26,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:04:31.391 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.407+0000 7ff750773700 1 -- 172.21.15.42:0/2897255056 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff72c06a660 msgr2=0x7ff72c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:31.391 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.407+0000 7ff750773700 1 --2- 172.21.15.42:0/2897255056 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff72c06a660 0x7ff72c06cb10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff7440090b0 tx=0x7ff744008030 comp rx=0 tx=0).stop 2023-07-29T02:04:31.391 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.407+0000 7ff750773700 1 -- 172.21.15.42:0/2897255056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7480716c0 msgr2=0x7ff7481e0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:31.392 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.407+0000 7ff750773700 1 --2- 172.21.15.42:0/2897255056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7480716c0 0x7ff7481e0330 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff73800c750 tx=0x7ff73800ca60 comp rx=0 tx=0).stop 2023-07-29T02:04:31.392 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.407+0000 7ff750773700 1 -- 172.21.15.42:0/2897255056 shutdown_connections 2023-07-29T02:04:31.392 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.407+0000 7ff750773700 1 --2- 172.21.15.42:0/2897255056 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff72c06a660 0x7ff72c06cb10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:31.392 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.407+0000 7ff750773700 1 --2- 172.21.15.42:0/2897255056 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff7480c24d0 0x7ff7481e1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:31.392 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.408+0000 7ff750773700 1 --2- 172.21.15.42:0/2897255056 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff7480716c0 0x7ff7481e0330 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:31.392 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.408+0000 7ff750773700 1 --2- 172.21.15.42:0/2897255056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7480c2100 0x7ff74806a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:31.392 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.408+0000 7ff750773700 1 -- 172.21.15.42:0/2897255056 >> 172.21.15.42:0/2897255056 conn(0x7ff74806f850 msgr2=0x7ff7480cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:31.393 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.408+0000 7ff750773700 1 -- 172.21.15.42:0/2897255056 shutdown_connections 2023-07-29T02:04:31.393 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:31.408+0000 7ff750773700 1 -- 172.21.15.42:0/2897255056 wait complete. 2023-07-29T02:04:31.393 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 22 2023-07-29T02:04:31.403 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2023-07-29T02:04:33.404 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:04:33.544 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.561+0000 7f7680b8c700 1 Processor -- start 2023-07-29T02:04:33.545 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.561+0000 7f7680b8c700 1 -- start start 2023-07-29T02:04:33.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.562+0000 7f7680b8c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f767c1510a0 0x7f767c0b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:33.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.562+0000 7f7680b8c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f767c151470 0x7f767c157650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:33.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.562+0000 7f7680b8c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f767c15a510 con 0x7f767c0c7990 2023-07-29T02:04:33.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.562+0000 7f7680b8c700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f767c0c3530 con 0x7f767c1510a0 2023-07-29T02:04:33.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.562+0000 7f7680b8c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c156f40 con 0x7f767c151470 2023-07-29T02:04:33.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.562+0000 7f767a59c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f767c1510a0 0x7f767c0b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:33.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.562+0000 7f767a59c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f767c1510a0 0x7f767c0b2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58040/0 (socket says 172.21.15.42:58040) 2023-07-29T02:04:33.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.562+0000 7f767a59c700 1 -- 172.21.15.42:0/2738434322 learned_addr learned my addr 172.21.15.42:0/2738434322 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:33.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.562+0000 7f7679d9b700 1 --2- 172.21.15.42:0/2738434322 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f767c151470 0x7f767c157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:33.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.562+0000 7f767a59c700 1 -- 172.21.15.42:0/2738434322 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f767c151470 msgr2=0x7f767c157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:04:33.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.562+0000 7f767a59c700 1 --2- 172.21.15.42:0/2738434322 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f767c151470 0x7f767c157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:33.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.562+0000 7f767a59c700 1 -- 172.21.15.42:0/2738434322 >> v1:172.21.15.144:6789/0 conn(0x7f767c0c7990 legacy=0x7f767c06fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:33.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.562+0000 7f767a59c700 1 -- 172.21.15.42:0/2738434322 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c0c9f00 con 0x7f767c1510a0 2023-07-29T02:04:33.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.562+0000 7f7679d9b700 1 --2- 172.21.15.42:0/2738434322 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f767c151470 0x7f767c157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:04:33.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.563+0000 7f767a59c700 1 --2- 172.21.15.42:0/2738434322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f767c1510a0 0x7f767c0b2ac0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f766c0098f0 tx=0x7f766c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d88ea9839a15089 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:33.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.563+0000 7f767959a700 1 -- 172.21.15.42:0/2738434322 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c00b8a0 con 0x7f767c1510a0 2023-07-29T02:04:33.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.563+0000 7f767959a700 1 -- 172.21.15.42:0/2738434322 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c00ba00 con 0x7f767c1510a0 2023-07-29T02:04:33.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.563+0000 7f767959a700 1 -- 172.21.15.42:0/2738434322 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c00bd90 con 0x7f767c1510a0 2023-07-29T02:04:33.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.563+0000 7f7680b8c700 1 -- 172.21.15.42:0/2738434322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f767c1510a0 msgr2=0x7f767c0b2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:33.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.563+0000 7f7680b8c700 1 --2- 172.21.15.42:0/2738434322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f767c1510a0 0x7f767c0b2ac0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f766c0098f0 tx=0x7f766c009c00 comp rx=0 tx=0).stop 2023-07-29T02:04:33.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.564+0000 7f7680b8c700 1 -- 172.21.15.42:0/2738434322 shutdown_connections 2023-07-29T02:04:33.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.564+0000 7f7680b8c700 1 --2- 172.21.15.42:0/2738434322 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f767c1510a0 0x7f767c0b2ac0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:33.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.564+0000 7f7680b8c700 1 --2- 172.21.15.42:0/2738434322 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f767c151470 0x7f767c157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:33.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.564+0000 7f7680b8c700 1 -- 172.21.15.42:0/2738434322 >> 172.21.15.42:0/2738434322 conn(0x7f767c06a750 msgr2=0x7f767c06ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:33.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.564+0000 7f7680b8c700 1 -- 172.21.15.42:0/2738434322 shutdown_connections 2023-07-29T02:04:33.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.564+0000 7f7680b8c700 1 -- 172.21.15.42:0/2738434322 wait complete. 2023-07-29T02:04:33.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.565+0000 7f7680b8c700 1 Processor -- start 2023-07-29T02:04:33.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.565+0000 7f7680b8c700 1 -- start start 2023-07-29T02:04:33.553 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.566+0000 7f7680b8c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f767c0c7990 0x7f767c0c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:33.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.566+0000 7f7680b8c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f767c1510a0 0x7f767c1558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:33.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.566+0000 7f7680b8c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f767c151470 0x7f767c1ee810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:33.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.566+0000 7f7680b8c700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c0cdc90 con 0x7f767c1510a0 2023-07-29T02:04:33.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.566+0000 7f7680b8c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767c0c6e80 con 0x7f767c0c7990 2023-07-29T02:04:33.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.566+0000 7f7680b8c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767c0cd0c0 con 0x7f767c151470 2023-07-29T02:04:33.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.566+0000 7f7679d9b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f767c1510a0 0x7f767c1558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:33.554 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.566+0000 7f7679d9b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f767c1510a0 0x7f767c1558d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58048/0 (socket says 172.21.15.42:58048) 2023-07-29T02:04:33.555 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.566+0000 7f7679d9b700 1 -- 172.21.15.42:0/3663965838 learned_addr learned my addr 172.21.15.42:0/3663965838 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:33.555 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.566+0000 7f767a59c700 1 --2- 172.21.15.42:0/3663965838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f767c0c7990 0x7f767c0c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:33.555 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.566+0000 7f767ad9d700 1 --2- 172.21.15.42:0/3663965838 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f767c151470 0x7f767c1ee810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:33.555 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.566+0000 7f7679d9b700 1 -- 172.21.15.42:0/3663965838 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f767c151470 msgr2=0x7f767c1ee810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:33.555 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.566+0000 7f7679d9b700 1 --2- 172.21.15.42:0/3663965838 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f767c151470 0x7f767c1ee810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:33.555 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.566+0000 7f7679d9b700 1 -- 172.21.15.42:0/3663965838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f767c0c7990 msgr2=0x7f767c0c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:33.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.566+0000 7f7679d9b700 1 --2- 172.21.15.42:0/3663965838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f767c0c7990 0x7f767c0c6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:33.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.566+0000 7f7679d9b700 1 -- 172.21.15.42:0/3663965838 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c009550 con 0x7f767c1510a0 2023-07-29T02:04:33.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.566+0000 7f7679d9b700 1 --2- 172.21.15.42:0/3663965838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f767c1510a0 0x7f767c1558d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f767000e7e0 tx=0x7f767000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:33.556 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.567+0000 7f766affd700 1 -- 172.21.15.42:0/3663965838 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767000c030 con 0x7f767c1510a0 2023-07-29T02:04:33.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.567+0000 7f766affd700 1 -- 172.21.15.42:0/3663965838 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7670004220 con 0x7f767c1510a0 2023-07-29T02:04:33.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.567+0000 7f766affd700 1 -- 172.21.15.42:0/3663965838 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670004590 con 0x7f767c1510a0 2023-07-29T02:04:33.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.567+0000 7f7680b8c700 1 -- 172.21.15.42:0/3663965838 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f767c0ccbe0 con 0x7f767c1510a0 2023-07-29T02:04:33.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.567+0000 7f7680b8c700 1 -- 172.21.15.42:0/3663965838 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767c0cd640 con 0x7f767c1510a0 2023-07-29T02:04:33.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.568+0000 7f7680b8c700 1 -- 172.21.15.42:0/3663965838 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767c04ea50 con 0x7f767c1510a0 2023-07-29T02:04:33.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.569+0000 7f766affd700 1 -- 172.21.15.42:0/3663965838 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f76700036a0 con 0x7f767c1510a0 2023-07-29T02:04:33.557 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.570+0000 7f766affd700 1 --2- 172.21.15.42:0/3663965838 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f765c06a660 0x7f765c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:33.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.570+0000 7f766affd700 1 -- 172.21.15.42:0/3663965838 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f7670088d70 con 0x7f767c1510a0 2023-07-29T02:04:33.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.570+0000 7f767a59c700 1 --2- 172.21.15.42:0/3663965838 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f765c06a660 0x7f765c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:33.558 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.571+0000 7f767a59c700 1 --2- 172.21.15.42:0/3663965838 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f765c06a660 0x7f765c06cb10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f766c009c40 tx=0x7f766c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:33.563 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.580+0000 7f766affd700 1 -- 172.21.15.42:0/3663965838 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f7670053cd0 con 0x7f767c1510a0 2023-07-29T02:04:33.812 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.829+0000 7f7680b8c700 1 -- 172.21.15.42:0/3663965838 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f767c06e220 con 0x7f767c1510a0 2023-07-29T02:04:33.813 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.830+0000 7f766affd700 1 -- 172.21.15.42:0/3663965838 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+5412 (secure 0 0 0) 0x7f76700572f0 con 0x7f767c1510a0 2023-07-29T02:04:33.813 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:04:33.814 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:04:33.579865+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4874":{"gid":4874,"name":"d","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":28,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:04:33.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.831+0000 7f7680b8c700 1 -- 172.21.15.42:0/3663965838 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f765c06a660 msgr2=0x7f765c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:33.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.831+0000 7f7680b8c700 1 --2- 172.21.15.42:0/3663965838 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f765c06a660 0x7f765c06cb10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f766c009c40 tx=0x7f766c008030 comp rx=0 tx=0).stop 2023-07-29T02:04:33.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.831+0000 7f7680b8c700 1 -- 172.21.15.42:0/3663965838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f767c1510a0 msgr2=0x7f767c1558d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:33.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.831+0000 7f7680b8c700 1 --2- 172.21.15.42:0/3663965838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f767c1510a0 0x7f767c1558d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f767000e7e0 tx=0x7f767000eaf0 comp rx=0 tx=0).stop 2023-07-29T02:04:33.816 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.831+0000 7f7680b8c700 1 -- 172.21.15.42:0/3663965838 shutdown_connections 2023-07-29T02:04:33.816 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.832+0000 7f7680b8c700 1 --2- 172.21.15.42:0/3663965838 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f765c06a660 0x7f765c06cb10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:33.816 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.832+0000 7f7680b8c700 1 --2- 172.21.15.42:0/3663965838 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f767c151470 0x7f767c1ee810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:33.816 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.832+0000 7f7680b8c700 1 --2- 172.21.15.42:0/3663965838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f767c0c7990 0x7f767c0c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:33.816 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.832+0000 7f7680b8c700 1 --2- 172.21.15.42:0/3663965838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f767c1510a0 0x7f767c1558d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:33.816 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.832+0000 7f7680b8c700 1 -- 172.21.15.42:0/3663965838 >> 172.21.15.42:0/3663965838 conn(0x7f767c06a750 msgr2=0x7f767c14d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:33.817 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.832+0000 7f7680b8c700 1 -- 172.21.15.42:0/3663965838 shutdown_connections 2023-07-29T02:04:33.817 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:33.832+0000 7f7680b8c700 1 -- 172.21.15.42:0/3663965838 wait complete. 2023-07-29T02:04:33.817 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 23 2023-07-29T02:04:33.827 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 23, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-07-29T01:59:57.946839+0000", "damaged": [], "data_pools": [ 4, 5 ], "enabled": true, "epoch": 23, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_4874": { "addr": "172.21.15.144:6839/4219857785", "addrs": { "addrvec": [ { "addr": "172.21.15.144:6837", "nonce": 4219857785, "type": "v2" }, { "addr": "172.21.15.144:6839", "nonce": 4219857785, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4874, "incarnation": 21, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:rejoin", "state_seq": 28 } }, "last_failure": 0, "last_failure_osd_epoch": 39, "max_file_size": 1099511627776, "max_mds": 1, "metadata_pool": 3, "modified": "2023-07-29T02:04:33.579865+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4874 } } } ], "standbys": [ { "addr": "172.21.15.42:6833/3242692321", "addrs": { "addrvec": [ { "addr": "172.21.15.42:6832", "nonce": 3242692321, "type": "v2" }, { "addr": "172.21.15.42:6833", "nonce": 3242692321, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4263, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.42:6835/1860885615", "addrs": { "addrvec": [ { "addr": "172.21.15.42:6834", "nonce": 1860885615, "type": "v2" }, { "addr": "172.21.15.42:6835", "nonce": 1860885615, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4266, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.144:6835/400694688", "addrs": { "addrvec": [ { "addr": "172.21.15.144:6834", "nonce": 400694688, "type": "v2" }, { "addr": "172.21.15.144:6835", "nonce": 400694688, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4291, "incarnation": 0, "join_fscid": -1, "name": "f", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.144:6838/2604441175", "addrs": { "addrvec": [ { "addr": "172.21.15.144:6836", "nonce": 2604441175, "type": "v2" }, { "addr": "172.21.15.144:6838", "nonce": 2604441175, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4294, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-07-29T02:04:35.829 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:04:35.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.985+0000 7f5651538700 1 Processor -- start 2023-07-29T02:04:35.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.985+0000 7f5651538700 1 -- start start 2023-07-29T02:04:35.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.986+0000 7f5651538700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f564c0c7f40 0x7f564c157490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:35.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.986+0000 7f5651538700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f564c06e950 0x7f564c1579d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:35.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.986+0000 7f5651538700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564c0cd140 con 0x7f564c151500 2023-07-29T02:04:35.970 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.986+0000 7f5651538700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564c0c2370 con 0x7f564c06e950 2023-07-29T02:04:35.971 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.986+0000 7f5651538700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564c156f90 con 0x7f564c0c7f40 2023-07-29T02:04:35.971 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.987+0000 7f564a7fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f564c0c7f40 0x7f564c157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:35.971 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.987+0000 7f564a7fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f564c0c7f40 0x7f564c157490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:58570/0 (socket says 172.21.15.42:58570) 2023-07-29T02:04:35.971 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.987+0000 7f564a7fc700 1 -- 172.21.15.42:0/602128872 learned_addr learned my addr 172.21.15.42:0/602128872 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:35.971 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.987+0000 7f564b7fe700 1 --2- 172.21.15.42:0/602128872 >> v2:172.21.15.144:3300/0 conn(0x7f564c06e950 0x7f564c1579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:35.971 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.987+0000 7f564a7fc700 1 -- 172.21.15.42:0/602128872 >> v2:172.21.15.144:3300/0 conn(0x7f564c06e950 msgr2=0x7f564c1579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:04:35.971 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.987+0000 7f564a7fc700 1 --2- 172.21.15.42:0/602128872 >> v2:172.21.15.144:3300/0 conn(0x7f564c06e950 0x7f564c1579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:35.971 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.987+0000 7f564a7fc700 1 -- 172.21.15.42:0/602128872 >> v1:172.21.15.144:6789/0 conn(0x7f564c151500 legacy=0x7f564c06dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:35.972 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.987+0000 7f564a7fc700 1 -- 172.21.15.42:0/602128872 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c0cd390 con 0x7f564c0c7f40 2023-07-29T02:04:35.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.987+0000 7f564a7fc700 1 --2- 172.21.15.42:0/602128872 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f564c0c7f40 0x7f564c157490 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f56340098f0 tx=0x7f5634009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19cfe3035742c5a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:35.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.987+0000 7f5649ffb700 1 -- 172.21.15.42:0/602128872 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5634011830 con 0x7f564c0c7f40 2023-07-29T02:04:35.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.987+0000 7f5649ffb700 1 -- 172.21.15.42:0/602128872 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5634011990 con 0x7f564c0c7f40 2023-07-29T02:04:35.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.987+0000 7f5649ffb700 1 -- 172.21.15.42:0/602128872 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5634011d20 con 0x7f564c0c7f40 2023-07-29T02:04:35.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.988+0000 7f5651538700 1 -- 172.21.15.42:0/602128872 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f564c0c7f40 msgr2=0x7f564c157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:35.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.988+0000 7f5651538700 1 --2- 172.21.15.42:0/602128872 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f564c0c7f40 0x7f564c157490 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f56340098f0 tx=0x7f5634009c00 comp rx=0 tx=0).stop 2023-07-29T02:04:35.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.988+0000 7f5651538700 1 -- 172.21.15.42:0/602128872 shutdown_connections 2023-07-29T02:04:35.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.988+0000 7f5651538700 1 --2- 172.21.15.42:0/602128872 >> v2:172.21.15.144:3300/0 conn(0x7f564c06e950 0x7f564c1579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:35.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.988+0000 7f5651538700 1 --2- 172.21.15.42:0/602128872 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f564c0c7f40 0x7f564c157490 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:35.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.988+0000 7f5651538700 1 -- 172.21.15.42:0/602128872 >> 172.21.15.42:0/602128872 conn(0x7f564c061190 msgr2=0x7f564c061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:35.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.988+0000 7f5651538700 1 -- 172.21.15.42:0/602128872 shutdown_connections 2023-07-29T02:04:35.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.988+0000 7f5651538700 1 -- 172.21.15.42:0/602128872 wait complete. 2023-07-29T02:04:35.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.989+0000 7f5651538700 1 Processor -- start 2023-07-29T02:04:35.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.989+0000 7f5651538700 1 -- start start 2023-07-29T02:04:35.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.990+0000 7f5651538700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f564c06e950 0x7f564c0c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:35.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.990+0000 7f5651538700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f564c0c7f40 0x7f564c1ef8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:35.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.990+0000 7f5651538700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f564c151500 0x7f564c1e0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:35.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.990+0000 7f5651538700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564c1eee20 con 0x7f564c0c7f40 2023-07-29T02:04:35.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.990+0000 7f5651538700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564c0ca1b0 con 0x7f564c06e950 2023-07-29T02:04:35.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.990+0000 7f5651538700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564c0ca490 con 0x7f564c151500 2023-07-29T02:04:35.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.990+0000 7f564a7fc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f564c0c7f40 0x7f564c1ef8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:35.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.990+0000 7f564a7fc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f564c0c7f40 0x7f564c1ef8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58062/0 (socket says 172.21.15.42:58062) 2023-07-29T02:04:35.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.990+0000 7f564a7fc700 1 -- 172.21.15.42:0/1234559571 learned_addr learned my addr 172.21.15.42:0/1234559571 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:35.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.991+0000 7f564b7fe700 1 --2- 172.21.15.42:0/1234559571 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f564c151500 0x7f564c1e0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:35.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.991+0000 7f564affd700 1 --2- 172.21.15.42:0/1234559571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f564c06e950 0x7f564c0c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:35.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.991+0000 7f564a7fc700 1 -- 172.21.15.42:0/1234559571 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f564c151500 msgr2=0x7f564c1e0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:35.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.991+0000 7f564a7fc700 1 --2- 172.21.15.42:0/1234559571 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f564c151500 0x7f564c1e0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:35.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.991+0000 7f564a7fc700 1 -- 172.21.15.42:0/1234559571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f564c06e950 msgr2=0x7f564c0c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:35.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.991+0000 7f564a7fc700 1 --2- 172.21.15.42:0/1234559571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f564c06e950 0x7f564c0c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:35.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.991+0000 7f564a7fc700 1 -- 172.21.15.42:0/1234559571 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5634009550 con 0x7f564c0c7f40 2023-07-29T02:04:35.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.991+0000 7f564a7fc700 1 --2- 172.21.15.42:0/1234559571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f564c0c7f40 0x7f564c1ef8e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5634000c00 tx=0x7f5634004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:35.979 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.991+0000 7f56437fe700 1 -- 172.21.15.42:0/1234559571 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5634004400 con 0x7f564c0c7f40 2023-07-29T02:04:35.979 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.991+0000 7f56437fe700 1 -- 172.21.15.42:0/1234559571 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563401f070 con 0x7f564c0c7f40 2023-07-29T02:04:35.979 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.991+0000 7f5651538700 1 -- 172.21.15.42:0/1234559571 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564c1ef0e0 con 0x7f564c0c7f40 2023-07-29T02:04:35.979 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.991+0000 7f56437fe700 1 -- 172.21.15.42:0/1234559571 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56340038c0 con 0x7f564c0c7f40 2023-07-29T02:04:35.979 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.991+0000 7f5651538700 1 -- 172.21.15.42:0/1234559571 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564c14e7b0 con 0x7f564c0c7f40 2023-07-29T02:04:35.979 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.992+0000 7f5651538700 1 -- 172.21.15.42:0/1234559571 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564c1ef600 con 0x7f564c0c7f40 2023-07-29T02:04:35.979 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.992+0000 7f56437fe700 1 -- 172.21.15.42:0/1234559571 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f5634021030 con 0x7f564c0c7f40 2023-07-29T02:04:35.980 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.993+0000 7f56437fe700 1 --2- 172.21.15.42:0/1234559571 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f562c06a660 0x7f562c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:35.980 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.993+0000 7f56437fe700 1 -- 172.21.15.42:0/1234559571 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f563408a320 con 0x7f564c0c7f40 2023-07-29T02:04:35.980 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.993+0000 7f564affd700 1 --2- 172.21.15.42:0/1234559571 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f562c06a660 0x7f562c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:35.980 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.994+0000 7f564affd700 1 --2- 172.21.15.42:0/1234559571 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f562c06a660 0x7f562c06cb10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f563c000f60 tx=0x7f563c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:35.981 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:35.997+0000 7f56437fe700 1 -- 172.21.15.42:0/1234559571 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f564c1ef600 con 0x7f564c0c7f40 2023-07-29T02:04:36.223 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:36.239+0000 7f5651538700 1 -- 172.21.15.42:0/1234559571 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f564c1ef600 con 0x7f564c0c7f40 2023-07-29T02:04:36.223 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:36.240+0000 7f56437fe700 1 -- 172.21.15.42:0/1234559571 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+5412 (secure 0 0 0) 0x7f564c1ef600 con 0x7f564c0c7f40 2023-07-29T02:04:36.224 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:04:36.224 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:04:33.579865+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4874":{"gid":4874,"name":"d","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":28,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:04:36.225 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:36.242+0000 7f5651538700 1 -- 172.21.15.42:0/1234559571 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f562c06a660 msgr2=0x7f562c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:36.242+0000 7f5651538700 1 --2- 172.21.15.42:0/1234559571 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f562c06a660 0x7f562c06cb10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f563c000f60 tx=0x7f563c009040 comp rx=0 tx=0).stop 2023-07-29T02:04:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:36.242+0000 7f5651538700 1 -- 172.21.15.42:0/1234559571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f564c0c7f40 msgr2=0x7f564c1ef8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:36.242+0000 7f5651538700 1 --2- 172.21.15.42:0/1234559571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f564c0c7f40 0x7f564c1ef8e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5634000c00 tx=0x7f5634004750 comp rx=0 tx=0).stop 2023-07-29T02:04:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:36.242+0000 7f5651538700 1 -- 172.21.15.42:0/1234559571 shutdown_connections 2023-07-29T02:04:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:36.242+0000 7f5651538700 1 --2- 172.21.15.42:0/1234559571 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f562c06a660 0x7f562c06cb10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:36.242+0000 7f5651538700 1 --2- 172.21.15.42:0/1234559571 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f564c151500 0x7f564c1e0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:36.226 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:36.242+0000 7f5651538700 1 --2- 172.21.15.42:0/1234559571 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f564c06e950 0x7f564c0c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:36.227 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:36.242+0000 7f5651538700 1 --2- 172.21.15.42:0/1234559571 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f564c0c7f40 0x7f564c1ef8e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:36.227 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:36.242+0000 7f5651538700 1 -- 172.21.15.42:0/1234559571 >> 172.21.15.42:0/1234559571 conn(0x7f564c061190 msgr2=0x7f564c155ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:36.227 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:36.242+0000 7f5651538700 1 -- 172.21.15.42:0/1234559571 shutdown_connections 2023-07-29T02:04:36.227 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:36.242+0000 7f5651538700 1 -- 172.21.15.42:0/1234559571 wait complete. 2023-07-29T02:04:36.227 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 23 2023-07-29T02:04:36.239 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2023-07-29T02:04:37.076 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:04:37.079 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:04:38.240 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:04:38.379 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.395+0000 7f36781fe700 1 Processor -- start 2023-07-29T02:04:38.379 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.396+0000 7f36781fe700 1 -- start start 2023-07-29T02:04:38.383 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.396+0000 7f36781fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f367014dce0 0x7f36700c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:38.383 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.396+0000 7f36781fe700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36700c1fb0 con 0x7f36700c7ed0 2023-07-29T02:04:38.383 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.396+0000 7f36781fe700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3670157370 con 0x7f36700b2b30 2023-07-29T02:04:38.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.396+0000 7f36781fe700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36700c2200 con 0x7f367014dce0 2023-07-29T02:04:38.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.397+0000 7f3675799700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f36700c7ed0 0x7f3670157800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51872/0 (socket says 172.21.15.42:51872) 2023-07-29T02:04:38.384 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.397+0000 7f3675799700 1 -- 172.21.15.42:0/174458244 learned_addr learned my addr 172.21.15.42:0/174458244 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:04:38.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.397+0000 7f3675f9a700 1 --2- 172.21.15.42:0/174458244 >> v2:172.21.15.144:3300/0 conn(0x7f367014dce0 0x7f36700c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:38.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.397+0000 7f3674f98700 1 -- 172.21.15.42:0/174458244 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1872768120 0 0) 0x7f36700c1fb0 con 0x7f36700c7ed0 2023-07-29T02:04:38.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.397+0000 7f3674f98700 1 -- 172.21.15.42:0/174458244 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f365c0035b0 con 0x7f36700c7ed0 2023-07-29T02:04:38.385 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.397+0000 7f3674f98700 1 -- 172.21.15.42:0/174458244 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3583333384 0 0) 0x7f365c0035b0 con 0x7f36700c7ed0 2023-07-29T02:04:38.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.397+0000 7f3675f9a700 1 -- 172.21.15.42:0/174458244 >> v1:172.21.15.144:6789/0 conn(0x7f36700b2b30 legacy=0x7f367006fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:38.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.397+0000 7f3675f9a700 1 -- 172.21.15.42:0/174458244 >> v1:172.21.15.42:6789/0 conn(0x7f36700c7ed0 legacy=0x7f3670157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:38.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.397+0000 7f3675f9a700 1 -- 172.21.15.42:0/174458244 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36700c24e0 con 0x7f367014dce0 2023-07-29T02:04:38.386 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.397+0000 7f3675f9a700 1 --2- 172.21.15.42:0/174458244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f367014dce0 0x7f36700c7990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f366c009840 tx=0x7f366c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=859ca31646bdbaf4 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:38.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.398+0000 7f3674f98700 1 -- 172.21.15.42:0/174458244 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660001670 con 0x7f367014dce0 2023-07-29T02:04:38.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.398+0000 7f3674f98700 1 -- 172.21.15.42:0/174458244 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366c004030 con 0x7f367014dce0 2023-07-29T02:04:38.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.398+0000 7f3674f98700 1 -- 172.21.15.42:0/174458244 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c0043c0 con 0x7f367014dce0 2023-07-29T02:04:38.387 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.398+0000 7f36781fe700 1 -- 172.21.15.42:0/174458244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f367014dce0 msgr2=0x7f36700c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:38.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.398+0000 7f36781fe700 1 --2- 172.21.15.42:0/174458244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f367014dce0 0x7f36700c7990 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f366c009840 tx=0x7f366c009b50 comp rx=0 tx=0).stop 2023-07-29T02:04:38.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.398+0000 7f36781fe700 1 -- 172.21.15.42:0/174458244 shutdown_connections 2023-07-29T02:04:38.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.398+0000 7f36781fe700 1 --2- 172.21.15.42:0/174458244 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f367014dce0 0x7f36700c7990 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:38.388 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.398+0000 7f36781fe700 1 -- 172.21.15.42:0/174458244 >> 172.21.15.42:0/174458244 conn(0x7f367006a750 msgr2=0x7f367006ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:38.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.398+0000 7f36781fe700 1 -- 172.21.15.42:0/174458244 shutdown_connections 2023-07-29T02:04:38.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.398+0000 7f36781fe700 1 -- 172.21.15.42:0/174458244 wait complete. 2023-07-29T02:04:38.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.399+0000 7f36781fe700 1 Processor -- start 2023-07-29T02:04:38.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.400+0000 7f36781fe700 1 -- start start 2023-07-29T02:04:38.393 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.400+0000 7f36781fe700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36700b2b30 0x7f36701ed050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:38.393 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.400+0000 7f36781fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36700c7ed0 0x7f36700c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:38.394 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.400+0000 7f36781fe700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f367014dce0 0x7f3670148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:38.394 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.400+0000 7f36781fe700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3670147b10 con 0x7f36700c7ed0 2023-07-29T02:04:38.394 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.400+0000 7f36781fe700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3670148aa0 con 0x7f36700b2b30 2023-07-29T02:04:38.394 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.400+0000 7f36781fe700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3670146630 con 0x7f367014dce0 2023-07-29T02:04:38.395 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.400+0000 7f3675799700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36700c7ed0 0x7f36700c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:38.395 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.400+0000 7f3675799700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36700c7ed0 0x7f36700c6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58074/0 (socket says 172.21.15.42:58074) 2023-07-29T02:04:38.395 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.400+0000 7f3675799700 1 -- 172.21.15.42:0/1425901270 learned_addr learned my addr 172.21.15.42:0/1425901270 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:38.395 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.401+0000 7f3675f9a700 1 --2- 172.21.15.42:0/1425901270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36700b2b30 0x7f36701ed050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:38.396 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.401+0000 7f367679b700 1 --2- 172.21.15.42:0/1425901270 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f367014dce0 0x7f3670148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:38.396 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.401+0000 7f3675799700 1 -- 172.21.15.42:0/1425901270 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f367014dce0 msgr2=0x7f3670148560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:38.396 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.401+0000 7f3675799700 1 --2- 172.21.15.42:0/1425901270 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f367014dce0 0x7f3670148560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:38.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.401+0000 7f3675799700 1 -- 172.21.15.42:0/1425901270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36700b2b30 msgr2=0x7f36701ed050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:38.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.401+0000 7f3675799700 1 --2- 172.21.15.42:0/1425901270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36700b2b30 0x7f36701ed050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:38.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.401+0000 7f3675799700 1 -- 172.21.15.42:0/1425901270 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c0094a0 con 0x7f36700c7ed0 2023-07-29T02:04:38.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.401+0000 7f367679b700 1 --2- 172.21.15.42:0/1425901270 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f367014dce0 0x7f3670148560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:04:38.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.401+0000 7f3675799700 1 --2- 172.21.15.42:0/1425901270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36700c7ed0 0x7f36700c6e40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f366000c750 tx=0x7f366000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:38.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.401+0000 7f36667fc700 1 -- 172.21.15.42:0/1425901270 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660004c80 con 0x7f36700c7ed0 2023-07-29T02:04:38.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.401+0000 7f36667fc700 1 -- 172.21.15.42:0/1425901270 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3660004de0 con 0x7f36700c7ed0 2023-07-29T02:04:38.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.401+0000 7f36781fe700 1 -- 172.21.15.42:0/1425901270 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3670146910 con 0x7f36700c7ed0 2023-07-29T02:04:38.399 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.401+0000 7f36667fc700 1 -- 172.21.15.42:0/1425901270 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3660007310 con 0x7f36700c7ed0 2023-07-29T02:04:38.399 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.401+0000 7f36781fe700 1 -- 172.21.15.42:0/1425901270 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3670147d60 con 0x7f36700c7ed0 2023-07-29T02:04:38.399 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.402+0000 7f36781fe700 1 -- 172.21.15.42:0/1425901270 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f367004ea50 con 0x7f36700c7ed0 2023-07-29T02:04:38.399 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.403+0000 7f36667fc700 1 -- 172.21.15.42:0/1425901270 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f3660007470 con 0x7f36700c7ed0 2023-07-29T02:04:38.400 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.403+0000 7f36667fc700 1 --2- 172.21.15.42:0/1425901270 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f365406a660 0x7f365406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:38.400 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.403+0000 7f36667fc700 1 -- 172.21.15.42:0/1425901270 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f3660088ca0 con 0x7f36700c7ed0 2023-07-29T02:04:38.400 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.403+0000 7f3675f9a700 1 --2- 172.21.15.42:0/1425901270 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f365406a660 0x7f365406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:38.400 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.404+0000 7f3675f9a700 1 --2- 172.21.15.42:0/1425901270 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f365406a660 0x7f365406cb10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f366c00a010 tx=0x7f366c013040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:38.401 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.407+0000 7f36667fc700 1 -- 172.21.15.42:0/1425901270 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f3660053c80 con 0x7f36700c7ed0 2023-07-29T02:04:38.635 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.652+0000 7f36781fe700 1 -- 172.21.15.42:0/1425901270 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f367014c4a0 con 0x7f36700c7ed0 2023-07-29T02:04:38.636 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.652+0000 7f36667fc700 1 -- 172.21.15.42:0/1425901270 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+5412 (secure 0 0 0) 0x7f36600572a0 con 0x7f36700c7ed0 2023-07-29T02:04:38.636 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:04:38.636 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:04:33.579865+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4874":{"gid":4874,"name":"d","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":28,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:04:38.638 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.654+0000 7f36781fe700 1 -- 172.21.15.42:0/1425901270 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f365406a660 msgr2=0x7f365406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:38.638 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.654+0000 7f36781fe700 1 --2- 172.21.15.42:0/1425901270 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f365406a660 0x7f365406cb10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f366c00a010 tx=0x7f366c013040 comp rx=0 tx=0).stop 2023-07-29T02:04:38.638 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.655+0000 7f36781fe700 1 -- 172.21.15.42:0/1425901270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36700c7ed0 msgr2=0x7f36700c6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:38.639 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.655+0000 7f36781fe700 1 --2- 172.21.15.42:0/1425901270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36700c7ed0 0x7f36700c6e40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f366000c750 tx=0x7f366000cb10 comp rx=0 tx=0).stop 2023-07-29T02:04:38.639 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.655+0000 7f36781fe700 1 -- 172.21.15.42:0/1425901270 shutdown_connections 2023-07-29T02:04:38.639 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.655+0000 7f36781fe700 1 --2- 172.21.15.42:0/1425901270 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f365406a660 0x7f365406cb10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:38.639 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.655+0000 7f36781fe700 1 --2- 172.21.15.42:0/1425901270 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f367014dce0 0x7f3670148560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:38.639 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.655+0000 7f36781fe700 1 --2- 172.21.15.42:0/1425901270 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36700b2b30 0x7f36701ed050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:38.639 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.655+0000 7f36781fe700 1 --2- 172.21.15.42:0/1425901270 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f36700c7ed0 0x7f36700c6e40 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:38.639 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.655+0000 7f36781fe700 1 -- 172.21.15.42:0/1425901270 >> 172.21.15.42:0/1425901270 conn(0x7f367006a750 msgr2=0x7f36700738a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:38.640 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.655+0000 7f36781fe700 1 -- 172.21.15.42:0/1425901270 shutdown_connections 2023-07-29T02:04:38.640 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:38.655+0000 7f36781fe700 1 -- 172.21.15.42:0/1425901270 wait complete. 2023-07-29T02:04:38.640 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 23 2023-07-29T02:04:38.650 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2023-07-29T02:04:40.651 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:04:40.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.806+0000 7fbadf6e6700 1 Processor -- start 2023-07-29T02:04:40.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.807+0000 7fbadf6e6700 1 -- start start 2023-07-29T02:04:40.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.808+0000 7fbadf6e6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbad80710b0 0x7fbad8159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:40.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.808+0000 7fbadf6e6700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad80c9900 con 0x7fbad80c8140 2023-07-29T02:04:40.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.808+0000 7fbadf6e6700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad815a210 con 0x7fbad8156740 2023-07-29T02:04:40.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.808+0000 7fbadf6e6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad80c46f0 con 0x7fbad80710b0 2023-07-29T02:04:40.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.808+0000 7fbaddc83700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fbad80c8140 0x7fbad80c6e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51888/0 (socket says 172.21.15.42:51888) 2023-07-29T02:04:40.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.808+0000 7fbaddc83700 1 -- 172.21.15.42:0/2650989962 learned_addr learned my addr 172.21.15.42:0/2650989962 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:04:40.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.808+0000 7fbadcc81700 1 --2- 172.21.15.42:0/2650989962 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbad80710b0 0x7fbad8159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:40.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.808+0000 7fbacbfff700 1 -- 172.21.15.42:0/2650989962 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396188012 0 0) 0x7fbad80c9900 con 0x7fbad80c8140 2023-07-29T02:04:40.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.808+0000 7fbacbfff700 1 -- 172.21.15.42:0/2650989962 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbac40035b0 con 0x7fbad80c8140 2023-07-29T02:04:40.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.808+0000 7fbacbfff700 1 -- 172.21.15.42:0/2650989962 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 605345318 0 0) 0x7fbad4001160 con 0x7fbad8156740 2023-07-29T02:04:40.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.808+0000 7fbacbfff700 1 -- 172.21.15.42:0/2650989962 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbad80c9900 con 0x7fbad8156740 2023-07-29T02:04:40.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.808+0000 7fbadcc81700 1 -- 172.21.15.42:0/2650989962 >> v1:172.21.15.144:6789/0 conn(0x7fbad8156740 legacy=0x7fbad80c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:40.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.808+0000 7fbadcc81700 1 -- 172.21.15.42:0/2650989962 >> v1:172.21.15.42:6789/0 conn(0x7fbad80c8140 legacy=0x7fbad80c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:40.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.808+0000 7fbacbfff700 1 -- 172.21.15.42:0/2650989962 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1636303332 0 0) 0x7fbac40035b0 con 0x7fbad80c8140 2023-07-29T02:04:40.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.808+0000 7fbadcc81700 1 -- 172.21.15.42:0/2650989962 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad80c3460 con 0x7fbad80710b0 2023-07-29T02:04:40.795 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.809+0000 7fbadcc81700 1 --2- 172.21.15.42:0/2650989962 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbad80710b0 0x7fbad8159cd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbacc009870 tx=0x7fbacc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1a56d4500bea85b server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:40.795 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.809+0000 7fbacbfff700 1 -- 172.21.15.42:0/2650989962 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad00019f0 con 0x7fbad80710b0 2023-07-29T02:04:40.795 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.809+0000 7fbacbfff700 1 -- 172.21.15.42:0/2650989962 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbacc004030 con 0x7fbad80710b0 2023-07-29T02:04:40.795 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.809+0000 7fbacbfff700 1 -- 172.21.15.42:0/2650989962 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc0043c0 con 0x7fbad80710b0 2023-07-29T02:04:40.797 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.809+0000 7fbadf6e6700 1 -- 172.21.15.42:0/2650989962 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbad80710b0 msgr2=0x7fbad8159cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:40.798 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.809+0000 7fbadf6e6700 1 --2- 172.21.15.42:0/2650989962 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbad80710b0 0x7fbad8159cd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbacc009870 tx=0x7fbacc009b80 comp rx=0 tx=0).stop 2023-07-29T02:04:40.798 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.809+0000 7fbadf6e6700 1 -- 172.21.15.42:0/2650989962 shutdown_connections 2023-07-29T02:04:40.798 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.809+0000 7fbadf6e6700 1 --2- 172.21.15.42:0/2650989962 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbad80710b0 0x7fbad8159cd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:40.798 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.809+0000 7fbadf6e6700 1 -- 172.21.15.42:0/2650989962 >> 172.21.15.42:0/2650989962 conn(0x7fbad80c8970 msgr2=0x7fbad80c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:40.798 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.809+0000 7fbadf6e6700 1 -- 172.21.15.42:0/2650989962 shutdown_connections 2023-07-29T02:04:40.798 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.809+0000 7fbadf6e6700 1 -- 172.21.15.42:0/2650989962 wait complete. 2023-07-29T02:04:40.798 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.811+0000 7fbadf6e6700 1 Processor -- start 2023-07-29T02:04:40.799 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.811+0000 7fbadf6e6700 1 -- start start 2023-07-29T02:04:40.799 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.811+0000 7fbadf6e6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbad80710b0 0x7fbad814e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:40.799 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.811+0000 7fbadf6e6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbad80c8140 0x7fbad815cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:40.799 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.811+0000 7fbadf6e6700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbad8156740 0x7fbad81f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:40.799 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.811+0000 7fbadf6e6700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad815ac00 con 0x7fbad8156740 2023-07-29T02:04:40.799 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.811+0000 7fbadf6e6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad815b8d0 con 0x7fbad80710b0 2023-07-29T02:04:40.799 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.811+0000 7fbadf6e6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad815cbf0 con 0x7fbad80c8140 2023-07-29T02:04:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.811+0000 7fbaddc83700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbad8156740 0x7fbad81f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.811+0000 7fbaddc83700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbad8156740 0x7fbad81f2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58090/0 (socket says 172.21.15.42:58090) 2023-07-29T02:04:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.812+0000 7fbaddc83700 1 -- 172.21.15.42:0/3901453098 learned_addr learned my addr 172.21.15.42:0/3901453098 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.812+0000 7fbadcc81700 1 --2- 172.21.15.42:0/3901453098 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbad80c8140 0x7fbad815cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.812+0000 7fbadd482700 1 --2- 172.21.15.42:0/3901453098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbad80710b0 0x7fbad814e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.812+0000 7fbaddc83700 1 -- 172.21.15.42:0/3901453098 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbad80c8140 msgr2=0x7fbad815cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:40.800 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.812+0000 7fbaddc83700 1 --2- 172.21.15.42:0/3901453098 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbad80c8140 0x7fbad815cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.812+0000 7fbaddc83700 1 -- 172.21.15.42:0/3901453098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbad80710b0 msgr2=0x7fbad814e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.812+0000 7fbaddc83700 1 --2- 172.21.15.42:0/3901453098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbad80710b0 0x7fbad814e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.812+0000 7fbaddc83700 1 -- 172.21.15.42:0/3901453098 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc0094a0 con 0x7fbad8156740 2023-07-29T02:04:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.812+0000 7fbaddc83700 1 --2- 172.21.15.42:0/3901453098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbad8156740 0x7fbad81f2210 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbad00017f0 tx=0x7fbad000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.812+0000 7fbac9ffb700 1 -- 172.21.15.42:0/3901453098 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad000ab70 con 0x7fbad8156740 2023-07-29T02:04:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.812+0000 7fbac9ffb700 1 -- 172.21.15.42:0/3901453098 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad000acf0 con 0x7fbad8156740 2023-07-29T02:04:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.812+0000 7fbadf6e6700 1 -- 172.21.15.42:0/3901453098 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad815a920 con 0x7fbad8156740 2023-07-29T02:04:40.801 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.812+0000 7fbac9ffb700 1 -- 172.21.15.42:0/3901453098 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad0007310 con 0x7fbad8156740 2023-07-29T02:04:40.802 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.812+0000 7fbadf6e6700 1 -- 172.21.15.42:0/3901453098 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad815c630 con 0x7fbad8156740 2023-07-29T02:04:40.802 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.813+0000 7fbadf6e6700 1 -- 172.21.15.42:0/3901453098 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad80c79d0 con 0x7fbad8156740 2023-07-29T02:04:40.802 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.814+0000 7fbac9ffb700 1 -- 172.21.15.42:0/3901453098 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fbad0007470 con 0x7fbad8156740 2023-07-29T02:04:40.802 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.814+0000 7fbac9ffb700 1 --2- 172.21.15.42:0/3901453098 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbabc06a660 0x7fbabc06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:40.802 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.814+0000 7fbac9ffb700 1 -- 172.21.15.42:0/3901453098 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7fbad0088d40 con 0x7fbad8156740 2023-07-29T02:04:40.802 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.814+0000 7fbadd482700 1 --2- 172.21.15.42:0/3901453098 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbabc06a660 0x7fbabc06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:40.803 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.815+0000 7fbadd482700 1 --2- 172.21.15.42:0/3901453098 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbabc06a660 0x7fbabc06cb10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbad40013c0 tx=0x7fbad4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:40.803 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:40.819+0000 7fbac9ffb700 1 -- 172.21.15.42:0/3901453098 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fbad0053d20 con 0x7fbad8156740 2023-07-29T02:04:41.041 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:41.058+0000 7fbadf6e6700 1 -- 172.21.15.42:0/3901453098 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbad80c5ba0 con 0x7fbad8156740 2023-07-29T02:04:41.041 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:41.058+0000 7fbac9ffb700 1 -- 172.21.15.42:0/3901453098 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+5412 (secure 0 0 0) 0x7fbad0018090 con 0x7fbad8156740 2023-07-29T02:04:41.042 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:04:41.042 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:04:39.593871+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4874":{"gid":4874,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":30,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:04:41.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:41.060+0000 7fbadf6e6700 1 -- 172.21.15.42:0/3901453098 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbabc06a660 msgr2=0x7fbabc06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:41.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:41.060+0000 7fbadf6e6700 1 --2- 172.21.15.42:0/3901453098 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbabc06a660 0x7fbabc06cb10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbad40013c0 tx=0x7fbad4009040 comp rx=0 tx=0).stop 2023-07-29T02:04:41.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:41.060+0000 7fbadf6e6700 1 -- 172.21.15.42:0/3901453098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbad8156740 msgr2=0x7fbad81f2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:41.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:41.060+0000 7fbadf6e6700 1 --2- 172.21.15.42:0/3901453098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbad8156740 0x7fbad81f2210 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbad00017f0 tx=0x7fbad000a060 comp rx=0 tx=0).stop 2023-07-29T02:04:41.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:41.060+0000 7fbadf6e6700 1 -- 172.21.15.42:0/3901453098 shutdown_connections 2023-07-29T02:04:41.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:41.060+0000 7fbadf6e6700 1 --2- 172.21.15.42:0/3901453098 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbabc06a660 0x7fbabc06cb10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:41.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:41.060+0000 7fbadf6e6700 1 --2- 172.21.15.42:0/3901453098 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbad8156740 0x7fbad81f2210 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:41.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:41.060+0000 7fbadf6e6700 1 --2- 172.21.15.42:0/3901453098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbad80710b0 0x7fbad814e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:41.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:41.060+0000 7fbadf6e6700 1 --2- 172.21.15.42:0/3901453098 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbad80c8140 0x7fbad815cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:41.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:41.060+0000 7fbadf6e6700 1 -- 172.21.15.42:0/3901453098 >> 172.21.15.42:0/3901453098 conn(0x7fbad80c8970 msgr2=0x7fbad80cb690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:41.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:41.060+0000 7fbadf6e6700 1 -- 172.21.15.42:0/3901453098 shutdown_connections 2023-07-29T02:04:41.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:41.060+0000 7fbadf6e6700 1 -- 172.21.15.42:0/3901453098 wait complete. 2023-07-29T02:04:41.046 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 24 2023-07-29T02:04:41.056 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d has gained rank=0, replacing gid=5142 2023-07-29T02:04:41.056 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 8 secs before reviving mds.e 2023-07-29T02:04:44.848 INFO:tasks.workunit.client.0.smithi042.stderr:error: RPC failed; curl 18 transfer closed with outstanding read data remaining 2023-07-29T02:04:44.849 INFO:tasks.workunit.client.0.smithi042.stderr:fetch-pack: unexpected disconnect while reading sideband packet 2023-07-29T02:04:44.851 INFO:tasks.workunit.client.0.smithi042.stderr:fatal: early EOF 2023-07-29T02:04:44.851 INFO:tasks.workunit.client.0.smithi042.stderr:fatal: fetch-pack: invalid index-pack output 2023-07-29T02:04:44.946 INFO:tasks.workunit.client.0.smithi042.stderr:+ retry 2023-07-29T02:04:44.946 INFO:tasks.workunit.client.0.smithi042.stderr:+ rm -rf ceph 2023-07-29T02:04:44.947 INFO:tasks.workunit.client.0.smithi042.stderr:+ timeout 3600 git clone https://git.ceph.com/ceph.git 2023-07-29T02:04:44.949 INFO:tasks.workunit.client.0.smithi042.stderr:Cloning into 'ceph'... 2023-07-29T02:04:45.502 INFO:tasks.ceph.mds.d.smithi144.stderr:2023-07-29T02:04:45.519+0000 7f2e0ce55700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-29T02:04:49.057 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.e 2023-07-29T02:04:49.058 INFO:tasks.ceph.mds.e:Restarting daemon 2023-07-29T02:04:49.058 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2023-07-29T02:04:49.061 INFO:tasks.ceph.mds.e:Started 2023-07-29T02:04:49.061 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:04:49.155 INFO:tasks.ceph.mds.e.smithi042.stdout:starting mds.e at 2023-07-29T02:04:49.201 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.218+0000 7f00e9523700 1 Processor -- start 2023-07-29T02:04:49.201 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.218+0000 7f00e9523700 1 -- start start 2023-07-29T02:04:49.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.219+0000 7f00e9523700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00e406fe60 0x7f00e40702d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:49.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.219+0000 7f00e9523700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e40c1fb0 con 0x7f00e40b2b30 2023-07-29T02:04:49.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.219+0000 7f00e9523700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00e4157370 con 0x7f00e414dce0 2023-07-29T02:04:49.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.219+0000 7f00e9523700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e40c80a0 con 0x7f00e406fe60 2023-07-29T02:04:49.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.219+0000 7f00e27fc700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f00e40b2b30 0x7f00e4157800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51912/0 (socket says 172.21.15.42:51912) 2023-07-29T02:04:49.203 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.219+0000 7f00e27fc700 1 -- 172.21.15.42:0/660789592 learned_addr learned my addr 172.21.15.42:0/660789592 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:04:49.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.219+0000 7f00e37fe700 1 --2- 172.21.15.42:0/660789592 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00e406fe60 0x7f00e40702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:49.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.219+0000 7f00e1ffb700 1 -- 172.21.15.42:0/660789592 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384755903 0 0) 0x7f00e40c1fb0 con 0x7f00e40b2b30 2023-07-29T02:04:49.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.219+0000 7f00e1ffb700 1 -- 172.21.15.42:0/660789592 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00d00035b0 con 0x7f00e40b2b30 2023-07-29T02:04:49.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.219+0000 7f00e1ffb700 1 -- 172.21.15.42:0/660789592 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539575670 0 0) 0x7f00e4157370 con 0x7f00e414dce0 2023-07-29T02:04:49.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.219+0000 7f00e1ffb700 1 -- 172.21.15.42:0/660789592 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00e40c1fb0 con 0x7f00e414dce0 2023-07-29T02:04:49.204 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.219+0000 7f00e37fe700 1 -- 172.21.15.42:0/660789592 >> v1:172.21.15.144:6789/0 conn(0x7f00e414dce0 legacy=0x7f00e40c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:49.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.219+0000 7f00e37fe700 1 -- 172.21.15.42:0/660789592 >> v1:172.21.15.42:6789/0 conn(0x7f00e40b2b30 legacy=0x7f00e4157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:49.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.220+0000 7f00e37fe700 1 -- 172.21.15.42:0/660789592 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e40c2200 con 0x7f00e406fe60 2023-07-29T02:04:49.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.220+0000 7f00e37fe700 1 --2- 172.21.15.42:0/660789592 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00e406fe60 0x7f00e40702d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009870 tx=0x7f00d4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14ce9ff0bf92e5a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:49.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.220+0000 7f00e1ffb700 1 -- 172.21.15.42:0/660789592 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4011830 con 0x7f00e406fe60 2023-07-29T02:04:49.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.220+0000 7f00e1ffb700 1 -- 172.21.15.42:0/660789592 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d4011990 con 0x7f00e406fe60 2023-07-29T02:04:49.205 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.220+0000 7f00e1ffb700 1 -- 172.21.15.42:0/660789592 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4011d20 con 0x7f00e406fe60 2023-07-29T02:04:49.207 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.220+0000 7f00e9523700 1 -- 172.21.15.42:0/660789592 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00e406fe60 msgr2=0x7f00e40702d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:49.207 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.220+0000 7f00e9523700 1 --2- 172.21.15.42:0/660789592 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00e406fe60 0x7f00e40702d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009870 tx=0x7f00d4009b80 comp rx=0 tx=0).stop 2023-07-29T02:04:49.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.220+0000 7f00e9523700 1 -- 172.21.15.42:0/660789592 shutdown_connections 2023-07-29T02:04:49.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.220+0000 7f00e9523700 1 --2- 172.21.15.42:0/660789592 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00e406fe60 0x7f00e40702d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:49.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.220+0000 7f00e9523700 1 -- 172.21.15.42:0/660789592 >> 172.21.15.42:0/660789592 conn(0x7f00e406a750 msgr2=0x7f00e406ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:49.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.221+0000 7f00e9523700 1 -- 172.21.15.42:0/660789592 shutdown_connections 2023-07-29T02:04:49.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.221+0000 7f00e9523700 1 -- 172.21.15.42:0/660789592 wait complete. 2023-07-29T02:04:49.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.222+0000 7f00e9523700 1 Processor -- start 2023-07-29T02:04:49.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.222+0000 7f00e9523700 1 -- start start 2023-07-29T02:04:49.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.223+0000 7f00e9523700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00e406fe60 0x7f00e41ed3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:49.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.223+0000 7f00e9523700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00e40b2b30 0x7f00e40c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:49.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.223+0000 7f00e9523700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00e414dce0 0x7f00e40cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:49.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.223+0000 7f00e9523700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e414eb20 con 0x7f00e40b2b30 2023-07-29T02:04:49.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.223+0000 7f00e9523700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e414e790 con 0x7f00e406fe60 2023-07-29T02:04:49.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.223+0000 7f00e9523700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00e41ed8f0 con 0x7f00e414dce0 2023-07-29T02:04:49.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.223+0000 7f00e27fc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00e40b2b30 0x7f00e40c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:49.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.223+0000 7f00e27fc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00e40b2b30 0x7f00e40c4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58114/0 (socket says 172.21.15.42:58114) 2023-07-29T02:04:49.210 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.223+0000 7f00e27fc700 1 -- 172.21.15.42:0/70120967 learned_addr learned my addr 172.21.15.42:0/70120967 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:49.210 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.224+0000 7f00e2ffd700 1 --2- 172.21.15.42:0/70120967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00e406fe60 0x7f00e41ed3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:49.210 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.224+0000 7f00e37fe700 1 --2- 172.21.15.42:0/70120967 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00e414dce0 0x7f00e40cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:49.210 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.224+0000 7f00e27fc700 1 -- 172.21.15.42:0/70120967 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00e414dce0 msgr2=0x7f00e40cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:49.210 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.224+0000 7f00e27fc700 1 --2- 172.21.15.42:0/70120967 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00e414dce0 0x7f00e40cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:49.210 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.224+0000 7f00e27fc700 1 -- 172.21.15.42:0/70120967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00e406fe60 msgr2=0x7f00e41ed3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:49.210 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.224+0000 7f00e27fc700 1 --2- 172.21.15.42:0/70120967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00e406fe60 0x7f00e41ed3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:49.211 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.224+0000 7f00e27fc700 1 -- 172.21.15.42:0/70120967 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d40094a0 con 0x7f00e40b2b30 2023-07-29T02:04:49.211 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.224+0000 7f00e2ffd700 1 --2- 172.21.15.42:0/70120967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00e406fe60 0x7f00e41ed3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:04:49.211 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.224+0000 7f00e27fc700 1 --2- 172.21.15.42:0/70120967 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00e40b2b30 0x7f00e40c4370 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00c700 tx=0x7f00cc00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:49.211 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.224+0000 7f00db7fe700 1 -- 172.21.15.42:0/70120967 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc005d70 con 0x7f00e40b2b30 2023-07-29T02:04:49.211 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.224+0000 7f00db7fe700 1 -- 172.21.15.42:0/70120967 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc0070d0 con 0x7f00e40b2b30 2023-07-29T02:04:49.212 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.224+0000 7f00e9523700 1 -- 172.21.15.42:0/70120967 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e4150540 con 0x7f00e40b2b30 2023-07-29T02:04:49.212 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.224+0000 7f00db7fe700 1 -- 172.21.15.42:0/70120967 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc007480 con 0x7f00e40b2b30 2023-07-29T02:04:49.212 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.224+0000 7f00e9523700 1 -- 172.21.15.42:0/70120967 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e414fc80 con 0x7f00e40b2b30 2023-07-29T02:04:49.213 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.225+0000 7f00e9523700 1 -- 172.21.15.42:0/70120967 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e41506d0 con 0x7f00e40b2b30 2023-07-29T02:04:49.213 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.226+0000 7f00db7fe700 1 -- 172.21.15.42:0/70120967 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f00cc0075e0 con 0x7f00e40b2b30 2023-07-29T02:04:49.213 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.226+0000 7f00db7fe700 1 --2- 172.21.15.42:0/70120967 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f00c406a660 0x7f00c406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:49.213 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.226+0000 7f00db7fe700 1 -- 172.21.15.42:0/70120967 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f00cc0884f0 con 0x7f00e40b2b30 2023-07-29T02:04:49.213 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.226+0000 7f00e2ffd700 1 --2- 172.21.15.42:0/70120967 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f00c406a660 0x7f00c406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:49.213 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.227+0000 7f00e2ffd700 1 --2- 172.21.15.42:0/70120967 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f00c406a660 0x7f00c406cb10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f00dc001560 tx=0x7f00dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:49.214 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.231+0000 7f00db7fe700 1 -- 172.21.15.42:0/70120967 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f00cc0534e0 con 0x7f00e40b2b30 2023-07-29T02:04:49.456 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.473+0000 7f00e9523700 1 -- 172.21.15.42:0/70120967 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00e40c27c0 con 0x7f00e40b2b30 2023-07-29T02:04:49.457 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.474+0000 7f00db7fe700 1 -- 172.21.15.42:0/70120967 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+5412 (secure 0 0 0) 0x7f00cc056b00 con 0x7f00e40b2b30 2023-07-29T02:04:49.457 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:04:49.458 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:04:39.593871+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4874":{"gid":4874,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":30,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:04:49.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.476+0000 7f00e9523700 1 -- 172.21.15.42:0/70120967 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f00c406a660 msgr2=0x7f00c406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:49.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.476+0000 7f00e9523700 1 --2- 172.21.15.42:0/70120967 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f00c406a660 0x7f00c406cb10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f00dc001560 tx=0x7f00dc009040 comp rx=0 tx=0).stop 2023-07-29T02:04:49.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.476+0000 7f00e9523700 1 -- 172.21.15.42:0/70120967 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00e40b2b30 msgr2=0x7f00e40c4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:49.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.476+0000 7f00e9523700 1 --2- 172.21.15.42:0/70120967 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00e40b2b30 0x7f00e40c4370 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00c700 tx=0x7f00cc00cac0 comp rx=0 tx=0).stop 2023-07-29T02:04:49.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.476+0000 7f00e9523700 1 -- 172.21.15.42:0/70120967 shutdown_connections 2023-07-29T02:04:49.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.476+0000 7f00e9523700 1 --2- 172.21.15.42:0/70120967 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f00c406a660 0x7f00c406cb10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:49.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.476+0000 7f00e9523700 1 --2- 172.21.15.42:0/70120967 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f00e414dce0 0x7f00e40cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:49.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.476+0000 7f00e9523700 1 --2- 172.21.15.42:0/70120967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f00e406fe60 0x7f00e41ed3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:49.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.476+0000 7f00e9523700 1 --2- 172.21.15.42:0/70120967 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f00e40b2b30 0x7f00e40c4370 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:49.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.476+0000 7f00e9523700 1 -- 172.21.15.42:0/70120967 >> 172.21.15.42:0/70120967 conn(0x7f00e406a750 msgr2=0x7f00e415a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:49.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.476+0000 7f00e9523700 1 -- 172.21.15.42:0/70120967 shutdown_connections 2023-07-29T02:04:49.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:49.476+0000 7f00e9523700 1 -- 172.21.15.42:0/70120967 wait complete. 2023-07-29T02:04:49.461 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 24 2023-07-29T02:04:49.471 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is in active, standby or standby-replay 2023-07-29T02:04:51.472 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:04:51.612 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.629+0000 7f980a032700 1 Processor -- start 2023-07-29T02:04:51.612 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.629+0000 7f980a032700 1 -- start start 2023-07-29T02:04:51.613 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.629+0000 7f980a032700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f980414c630 0x7f980406c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:51.613 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.629+0000 7f980a032700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f980414ca00 0x7f98040c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:51.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.629+0000 7f980a032700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980406ce40 con 0x7f98040c7270 2023-07-29T02:04:51.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.629+0000 7f980a032700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9804155d50 con 0x7f980414ca00 2023-07-29T02:04:51.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.629+0000 7f980a032700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9804156010 con 0x7f980414c630 2023-07-29T02:04:51.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.630+0000 7f9802ffd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f980414ca00 0x7f98040c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:51.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.630+0000 7f9802ffd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f980414ca00 0x7f98040c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58122/0 (socket says 172.21.15.42:58122) 2023-07-29T02:04:51.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.630+0000 7f9802ffd700 1 -- 172.21.15.42:0/3997720973 learned_addr learned my addr 172.21.15.42:0/3997720973 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:51.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.630+0000 7f98037fe700 1 --2- 172.21.15.42:0/3997720973 >> v2:172.21.15.144:3300/0 conn(0x7f980414c630 0x7f980406c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.630+0000 7f9802ffd700 1 -- 172.21.15.42:0/3997720973 >> v2:172.21.15.144:3300/0 conn(0x7f980414c630 msgr2=0x7f980406c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:04:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.630+0000 7f9802ffd700 1 --2- 172.21.15.42:0/3997720973 >> v2:172.21.15.144:3300/0 conn(0x7f980414c630 0x7f980406c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.630+0000 7f9802ffd700 1 -- 172.21.15.42:0/3997720973 >> v1:172.21.15.144:6789/0 conn(0x7f98040c7270 legacy=0x7f980406d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:04:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.630+0000 7f9802ffd700 1 -- 172.21.15.42:0/3997720973 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98041562f0 con 0x7f980414ca00 2023-07-29T02:04:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.630+0000 7f98037fe700 1 --2- 172.21.15.42:0/3997720973 >> v2:172.21.15.144:3300/0 conn(0x7f980414c630 0x7f980406c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:04:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.630+0000 7f9802ffd700 1 --2- 172.21.15.42:0/3997720973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980414ca00 0x7f98040c6770 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9804070da0 tx=0x7f97f4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a4ac3aadbe6333 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:51.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.630+0000 7f98027fc700 1 -- 172.21.15.42:0/3997720973 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f4004230 con 0x7f980414ca00 2023-07-29T02:04:51.616 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.630+0000 7f98027fc700 1 -- 172.21.15.42:0/3997720973 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f4004390 con 0x7f980414ca00 2023-07-29T02:04:51.616 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.630+0000 7f98027fc700 1 -- 172.21.15.42:0/3997720973 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f40036a0 con 0x7f980414ca00 2023-07-29T02:04:51.618 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.631+0000 7f980a032700 1 -- 172.21.15.42:0/3997720973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980414ca00 msgr2=0x7f98040c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:51.618 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.631+0000 7f980a032700 1 --2- 172.21.15.42:0/3997720973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980414ca00 0x7f98040c6770 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9804070da0 tx=0x7f97f4009bd0 comp rx=0 tx=0).stop 2023-07-29T02:04:51.618 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.631+0000 7f980a032700 1 -- 172.21.15.42:0/3997720973 shutdown_connections 2023-07-29T02:04:51.618 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.631+0000 7f980a032700 1 --2- 172.21.15.42:0/3997720973 >> v2:172.21.15.144:3300/0 conn(0x7f980414c630 0x7f980406c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:51.618 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.631+0000 7f980a032700 1 --2- 172.21.15.42:0/3997720973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980414ca00 0x7f98040c6770 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.631+0000 7f980a032700 1 -- 172.21.15.42:0/3997720973 >> 172.21.15.42:0/3997720973 conn(0x7f98040c8970 msgr2=0x7f98040c8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.631+0000 7f980a032700 1 -- 172.21.15.42:0/3997720973 shutdown_connections 2023-07-29T02:04:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.631+0000 7f980a032700 1 -- 172.21.15.42:0/3997720973 wait complete. 2023-07-29T02:04:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.632+0000 7f980a032700 1 Processor -- start 2023-07-29T02:04:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.632+0000 7f980a032700 1 -- start start 2023-07-29T02:04:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.633+0000 7f980a032700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98040c7270 0x7f98041415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.633+0000 7f980a032700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f980414c630 0x7f98041e3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:51.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.633+0000 7f980a032700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980414bc50 0x7f98041e3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.633+0000 7f980a032700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9804141b30 con 0x7f980414bc50 2023-07-29T02:04:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.633+0000 7f980a032700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980406b240 con 0x7f98040c7270 2023-07-29T02:04:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.633+0000 7f980a032700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9804150010 con 0x7f980414c630 2023-07-29T02:04:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.633+0000 7f9803fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980414bc50 0x7f98041e3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.633+0000 7f9803fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980414bc50 0x7f98041e3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58132/0 (socket says 172.21.15.42:58132) 2023-07-29T02:04:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.633+0000 7f9803fff700 1 -- 172.21.15.42:0/3151993271 learned_addr learned my addr 172.21.15.42:0/3151993271 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:04:51.620 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.633+0000 7f98037fe700 1 --2- 172.21.15.42:0/3151993271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98040c7270 0x7f98041415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:51.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.634+0000 7f9802ffd700 1 --2- 172.21.15.42:0/3151993271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f980414c630 0x7f98041e3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:51.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.634+0000 7f9803fff700 1 -- 172.21.15.42:0/3151993271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f980414c630 msgr2=0x7f98041e3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:51.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.634+0000 7f9803fff700 1 --2- 172.21.15.42:0/3151993271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f980414c630 0x7f98041e3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:51.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.634+0000 7f9803fff700 1 -- 172.21.15.42:0/3151993271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98040c7270 msgr2=0x7f98041415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:51.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.634+0000 7f9803fff700 1 --2- 172.21.15.42:0/3151993271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98040c7270 0x7f98041415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:51.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.634+0000 7f9803fff700 1 -- 172.21.15.42:0/3151993271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f4009550 con 0x7f980414bc50 2023-07-29T02:04:51.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.634+0000 7f9802ffd700 1 --2- 172.21.15.42:0/3151993271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f980414c630 0x7f98041e3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:04:51.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.634+0000 7f9803fff700 1 --2- 172.21.15.42:0/3151993271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980414bc50 0x7f98041e3ab0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f97fc00cc10 tx=0x7f97fc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:51.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.634+0000 7f97ebfff700 1 -- 172.21.15.42:0/3151993271 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc00abb0 con 0x7f980414bc50 2023-07-29T02:04:51.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.634+0000 7f97ebfff700 1 -- 172.21.15.42:0/3151993271 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc00ad10 con 0x7f980414bc50 2023-07-29T02:04:51.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.634+0000 7f97ebfff700 1 -- 172.21.15.42:0/3151993271 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc012660 con 0x7f980414bc50 2023-07-29T02:04:51.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.634+0000 7f980a032700 1 -- 172.21.15.42:0/3151993271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98040cb090 con 0x7f980414bc50 2023-07-29T02:04:51.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.634+0000 7f980a032700 1 -- 172.21.15.42:0/3151993271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98040cb610 con 0x7f980414bc50 2023-07-29T02:04:51.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.635+0000 7f980a032700 1 -- 172.21.15.42:0/3151993271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9804074740 con 0x7f980414bc50 2023-07-29T02:04:51.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.636+0000 7f97ebfff700 1 -- 172.21.15.42:0/3151993271 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f97fc0127c0 con 0x7f980414bc50 2023-07-29T02:04:51.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.636+0000 7f97ebfff700 1 --2- 172.21.15.42:0/3151993271 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f97f006a660 0x7f97f006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:04:51.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.636+0000 7f97ebfff700 1 -- 172.21.15.42:0/3151993271 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f97fc089620 con 0x7f980414bc50 2023-07-29T02:04:51.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.636+0000 7f98037fe700 1 --2- 172.21.15.42:0/3151993271 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f97f006a660 0x7f97f006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:04:51.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.637+0000 7f98037fe700 1 --2- 172.21.15.42:0/3151993271 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f97f006a660 0x7f97f006cb10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009930 tx=0x7f97f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:04:51.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.641+0000 7f97ebfff700 1 -- 172.21.15.42:0/3151993271 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f97fc054600 con 0x7f980414bc50 2023-07-29T02:04:51.867 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.885+0000 7f980a032700 1 -- 172.21.15.42:0/3151993271 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f980404ea50 con 0x7f980414bc50 2023-07-29T02:04:51.868 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.885+0000 7f97ebfff700 1 -- 172.21.15.42:0/3151993271 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+6169 (secure 0 0 0) 0x7f97fc057c20 con 0x7f980414bc50 2023-07-29T02:04:51.869 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:04:51.869 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5394,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/3070427916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3070427916},{"type":"v1","addr":"172.21.15.42:6837","nonce":3070427916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:04:39.593871+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4874":{"gid":4874,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":30,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:04:51.870 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.887+0000 7f980a032700 1 -- 172.21.15.42:0/3151993271 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f97f006a660 msgr2=0x7f97f006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:51.870 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.887+0000 7f980a032700 1 --2- 172.21.15.42:0/3151993271 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f97f006a660 0x7f97f006cb10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009930 tx=0x7f97f8008040 comp rx=0 tx=0).stop 2023-07-29T02:04:51.871 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.887+0000 7f980a032700 1 -- 172.21.15.42:0/3151993271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980414bc50 msgr2=0x7f98041e3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:04:51.871 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.887+0000 7f980a032700 1 --2- 172.21.15.42:0/3151993271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980414bc50 0x7f98041e3ab0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f97fc00cc10 tx=0x7f97fc00a060 comp rx=0 tx=0).stop 2023-07-29T02:04:51.871 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.887+0000 7f980a032700 1 -- 172.21.15.42:0/3151993271 shutdown_connections 2023-07-29T02:04:51.871 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.887+0000 7f980a032700 1 --2- 172.21.15.42:0/3151993271 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f97f006a660 0x7f97f006cb10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:51.871 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.887+0000 7f980a032700 1 --2- 172.21.15.42:0/3151993271 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f980414bc50 0x7f98041e3ab0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:51.872 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.887+0000 7f980a032700 1 --2- 172.21.15.42:0/3151993271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98040c7270 0x7f98041415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:51.872 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.887+0000 7f980a032700 1 --2- 172.21.15.42:0/3151993271 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f980414c630 0x7f98041e3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:04:51.872 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.887+0000 7f980a032700 1 -- 172.21.15.42:0/3151993271 >> 172.21.15.42:0/3151993271 conn(0x7f98040c8970 msgr2=0x7f98040711d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:04:51.872 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.887+0000 7f980a032700 1 -- 172.21.15.42:0/3151993271 shutdown_connections 2023-07-29T02:04:51.872 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:04:51.887+0000 7f980a032700 1 -- 172.21.15.42:0/3151993271 wait complete. 2023-07-29T02:04:51.872 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 25 2023-07-29T02:04:51.882 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e reported in up:standby state 2023-07-29T02:04:51.882 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 114 secs before thrashing 2023-07-29T02:05:07.146 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:05:07.149 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:05:37.215 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:05:37.218 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:05:56.232 INFO:tasks.workunit.client.0.smithi042.stderr:Updating files: 6% (811/11869) Updating files: 7% (831/11869) Updating files: 8% (950/11869) Updating files: 9% (1069/11869) Updating files: 10% (1187/11869) Updating files: 11% (1306/11869) Updating files: 12% (1425/11869) Updating files: 13% (1543/11869) Updating files: 13% (1634/11869) Updating files: 14% (1662/11869) Updating files: 15% (1781/11869) Updating files: 16% (1900/11869) Updating files: 17% (2018/11869) Updating files: 18% (2137/11869) Updating files: 19% (2256/11869) Updating files: 20% (2374/11869) Updating files: 20% (2380/11869) Updating files: 21% (2493/11869) Updating files: 22% (2612/11869) Updating files: 23% (2730/11869) Updating files: 24% (2849/11869) Updating files: 25% (2968/11869) Updating files: 25% (3048/11869) Updating files: 26% (3086/11869) Updating files: 27% (3205/11869) Updating files: 28% (3324/11869) Updating files: 29% (3443/11869) Updating files: 30% (3561/11869) Updating files: 31% (3680/11869) Updating files: 31% (3753/11869) Updating files: 32% (3799/11869) Updating files: 33% (3917/11869) Updating files: 34% (4036/11869) Updating files: 35% (4155/11869) Updating files: 36% (4273/11869) Updating files: 37% (4392/11869) Updating files: 38% (4511/11869) Updating files: 38% (4520/11869) Updating files: 39% (4629/11869) Updating files: 40% (4748/11869) Updating files: 41% (4867/11869) Updating files: 42% (4985/11869) Updating files: 43% (5104/11869) Updating files: 44% (5223/11869) Updating files: 44% (5319/11869) Updating files: 45% (5342/11869) Updating files: 46% (5460/11869) Updating files: 46% (5558/11869) Updating files: 47% (5579/11869) Updating files: 48% (5698/11869) Updating files: 49% (5816/11869) Updating files: 50% (5935/11869) Updating files: 51% (6054/11869) Updating files: 52% (6172/11869) Updating files: 52% (6223/11869) Updating files: 53% (6291/11869) Updating files: 54% (6410/11869) Updating files: 55% (6528/11869) Updating files: 56% (6647/11869) Updating files: 57% (6766/11869) Updating files: 58% (6885/11869) Updating files: 59% (7003/11869) Updating files: 60% (7122/11869) Updating files: 60% (7132/11869) Updating files: 61% (7241/11869) Updating files: 62% (7359/11869) Updating files: 63% (7478/11869) Updating files: 64% (7597/11869) Updating files: 65% (7715/11869) Updating files: 66% (7834/11869) Updating files: 66% (7926/11869) Updating files: 67% (7953/11869) Updating files: 68% (8071/11869) Updating files: 69% (8190/11869) Updating files: 70% (8309/11869) Updating files: 71% (8427/11869) Updating files: 72% (8546/11869) Updating files: 72% (8564/11869) Updating files: 73% (8665/11869) Updating files: 74% (8784/11869) Updating files: 75% (8902/11869) Updating files: 76% (9021/11869) Updating files: 77% (9140/11869) Updating files: 78% (9258/11869) Updating files: 78% (9373/11869) Updating files: 79% (9377/11869) Updating files: 80% (9496/11869) Updating files: 81% (9614/11869) Updating files: 82% (9733/11869) Updating files: 83% (9852/11869) Updating files: 84% (9970/11869) Updating files: 84% (9999/11869) Updating files: 85% (10089/11869) Updating files: 86% (10208/11869) Updating files: 87% (10327/11869) Updating files: 88% (10445/11869) Updating files: 88% (10472/11869) Updating files: 89% (10564/11869) Updating files: 90% (10683/11869) Updating files: 91% (10801/11869) Updating files: 92% (10920/11869) Updating files: 93% (11039/11869) Updating files: 93% (11051/11869) Updating files: 94% (11157/11869) Updating files: 95% (11276/11869) Updating files: 96% (11395/11869) Updating files: 97% (11513/11869) Updating files: 98% (11632/11869) Updating files: 99% (11751/11869) Updating files: 100% (11869/11869) Updating files: 100% (11869/11869), done. 2023-07-29T02:05:56.257 DEBUG:teuthology.orchestra.run:got remote process result: 128 2023-07-29T02:05:56.258 INFO:tasks.workunit:Stopping ['fs/snaps'] on client.0... 2023-07-29T02:05:56.258 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-07-29T02:05:56.532 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi042 with status 128: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0484097b0572e96f42cf6402cbe0ac8dcb046577 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh' 2023-07-29T02:05:56.602 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=f8caac81bd1745ca996c3f84743b8773 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi042 with status 128: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0484097b0572e96f42cf6402cbe0ac8dcb046577 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh' 2023-07-29T02:05:56.605 DEBUG:teuthology.run_tasks:Unwinding manager mds_thrash 2023-07-29T02:05:56.614 INFO:tasks.mds_thrash:joining mds_thrasher 2023-07-29T02:05:56.617 INFO:tasks.mds_thrash.fs.[cephfs]:stat['max_mds'] = 0 2023-07-29T02:05:56.618 INFO:tasks.mds_thrash.fs.[cephfs]:stat['deactivate'] = 0 2023-07-29T02:05:56.618 INFO:tasks.mds_thrash.fs.[cephfs]:stat['kill'] = 3 2023-07-29T02:05:56.618 INFO:tasks.mds_thrash:done joining 2023-07-29T02:05:56.619 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-07-29T02:05:56.644 INFO:tasks.kclient:Unmounting kernel clients... 2023-07-29T02:05:56.644 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T02:05:56.645 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-29T02:06:01.765 DEBUG:teuthology.orchestra.run.smithi042:> set -ex 2023-07-29T02:06:01.765 DEBUG:teuthology.orchestra.run.smithi042:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-29T02:06:01.826 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T02:06:02.004 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.023+0000 7fc3d0364700 1 Processor -- start 2023-07-29T02:06:02.005 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.023+0000 7fc3d0364700 1 -- start start 2023-07-29T02:06:02.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.024+0000 7fc3d0364700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc3c814dce0 0x7fc3c80c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.024+0000 7fc3d0364700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc3c80c7ed0 0x7fc3c8157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.024+0000 7fc3d0364700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c8157d40 0x7fc3c806fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.024+0000 7fc3d0364700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c80c1fb0 con 0x7fc3c814dce0 2023-07-29T02:06:02.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.024+0000 7fc3d0364700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c8157370 con 0x7fc3c80c7ed0 2023-07-29T02:06:02.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.024+0000 7fc3d0364700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80c2200 con 0x7fc3c8157d40 2023-07-29T02:06:02.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.024+0000 7fc3ce100700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc3c814dce0 0x7fc3c80c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.024+0000 7fc3ce100700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fc3c814dce0 0x7fc3c80c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58136/0 (socket says 172.21.15.42:58136) 2023-07-29T02:06:02.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.024+0000 7fc3ce100700 1 -- 172.21.15.42:0/3814175783 learned_addr learned my addr 172.21.15.42:0/3814175783 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:02.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.024+0000 7fc3ce901700 1 --2- 172.21.15.42:0/3814175783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c8157d40 0x7fc3c806fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.024+0000 7fc3cd8ff700 1 --2- 172.21.15.42:0/3814175783 >> v2:172.21.15.144:3300/0 conn(0x7fc3c80c7ed0 0x7fc3c8157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.024+0000 7fc3ce100700 1 -- 172.21.15.42:0/3814175783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c8157d40 msgr2=0x7fc3c806fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:02.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.024+0000 7fc3ce100700 1 --2- 172.21.15.42:0/3814175783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c8157d40 0x7fc3c806fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.024+0000 7fc3ce100700 1 -- 172.21.15.42:0/3814175783 >> v2:172.21.15.144:3300/0 conn(0x7fc3c80c7ed0 msgr2=0x7fc3c8157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:02.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.024+0000 7fc3ce100700 1 --2- 172.21.15.42:0/3814175783 >> v2:172.21.15.144:3300/0 conn(0x7fc3c80c7ed0 0x7fc3c8157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.024+0000 7fc3ce100700 1 -- 172.21.15.42:0/3814175783 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c80c24e0 con 0x7fc3c814dce0 2023-07-29T02:06:02.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.024+0000 7fc3ce901700 1 --2- 172.21.15.42:0/3814175783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c8157d40 0x7fc3c806fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:06:02.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.025+0000 7fc3ce100700 1 --2- 172.21.15.42:0/3814175783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3c814dce0 0x7fc3c80c7990 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8069bc0 tx=0x7fc3c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5dae096d259835 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:02.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.025+0000 7fc3cd0fe700 1 -- 172.21.15.42:0/3814175783 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c400b870 con 0x7fc3c814dce0 2023-07-29T02:06:02.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.025+0000 7fc3cd0fe700 1 -- 172.21.15.42:0/3814175783 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c400b9d0 con 0x7fc3c814dce0 2023-07-29T02:06:02.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.025+0000 7fc3cd0fe700 1 -- 172.21.15.42:0/3814175783 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c400bd60 con 0x7fc3c814dce0 2023-07-29T02:06:02.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.025+0000 7fc3d0364700 1 -- 172.21.15.42:0/3814175783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3c814dce0 msgr2=0x7fc3c80c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:02.012 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.025+0000 7fc3d0364700 1 --2- 172.21.15.42:0/3814175783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3c814dce0 0x7fc3c80c7990 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8069bc0 tx=0x7fc3c4009bd0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.012 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.025+0000 7fc3d0364700 1 -- 172.21.15.42:0/3814175783 shutdown_connections 2023-07-29T02:06:02.012 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.025+0000 7fc3d0364700 1 --2- 172.21.15.42:0/3814175783 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c8157d40 0x7fc3c806fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.012 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.025+0000 7fc3d0364700 1 --2- 172.21.15.42:0/3814175783 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3c814dce0 0x7fc3c80c7990 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.013 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.025+0000 7fc3d0364700 1 --2- 172.21.15.42:0/3814175783 >> v2:172.21.15.144:3300/0 conn(0x7fc3c80c7ed0 0x7fc3c8157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.013 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.025+0000 7fc3d0364700 1 -- 172.21.15.42:0/3814175783 >> 172.21.15.42:0/3814175783 conn(0x7fc3c806a750 msgr2=0x7fc3c806ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:02.013 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.025+0000 7fc3d0364700 1 -- 172.21.15.42:0/3814175783 shutdown_connections 2023-07-29T02:06:02.013 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.025+0000 7fc3d0364700 1 -- 172.21.15.42:0/3814175783 wait complete. 2023-07-29T02:06:02.015 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.027+0000 7fc3d0364700 1 Processor -- start 2023-07-29T02:06:02.016 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.027+0000 7fc3d0364700 1 -- start start 2023-07-29T02:06:02.016 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.027+0000 7fc3d0364700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c80c7ed0 0x7fc3c80c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.016 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.027+0000 7fc3d0364700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3c814dce0 0x7fc3c814a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.016 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.027+0000 7fc3d0364700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3c8157d40 0x7fc3c80c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.027+0000 7fc3d0364700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c814aa60 con 0x7fc3c8157d40 2023-07-29T02:06:02.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.027+0000 7fc3d0364700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c80c49f0 con 0x7fc3c814dce0 2023-07-29T02:06:02.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.027+0000 7fc3d0364700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c8149740 con 0x7fc3c80c7ed0 2023-07-29T02:06:02.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.027+0000 7fc3ce901700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3c8157d40 0x7fc3c80c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.027+0000 7fc3ce901700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3c8157d40 0x7fc3c80c5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58144/0 (socket says 172.21.15.42:58144) 2023-07-29T02:06:02.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.027+0000 7fc3ce901700 1 -- 172.21.15.42:0/2433036453 learned_addr learned my addr 172.21.15.42:0/2433036453 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:02.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.028+0000 7fc3ce100700 1 --2- 172.21.15.42:0/2433036453 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c80c7ed0 0x7fc3c80c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.028+0000 7fc3cd8ff700 1 --2- 172.21.15.42:0/2433036453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3c814dce0 0x7fc3c814a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.028+0000 7fc3ce901700 1 -- 172.21.15.42:0/2433036453 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c80c7ed0 msgr2=0x7fc3c80c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:02.019 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.028+0000 7fc3ce901700 1 --2- 172.21.15.42:0/2433036453 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c80c7ed0 0x7fc3c80c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.019 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.028+0000 7fc3ce901700 1 -- 172.21.15.42:0/2433036453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3c814dce0 msgr2=0x7fc3c814a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:02.019 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.028+0000 7fc3ce901700 1 --2- 172.21.15.42:0/2433036453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3c814dce0 0x7fc3c814a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.019 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.028+0000 7fc3ce901700 1 -- 172.21.15.42:0/2433036453 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c4009550 con 0x7fc3c8157d40 2023-07-29T02:06:02.019 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.028+0000 7fc3cd8ff700 1 --2- 172.21.15.42:0/2433036453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3c814dce0 0x7fc3c814a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:06:02.020 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.028+0000 7fc3ce901700 1 --2- 172.21.15.42:0/2433036453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3c8157d40 0x7fc3c80c5250 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0007df0 tx=0x7fc3c000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:02.020 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.028+0000 7fc3beffd700 1 -- 172.21.15.42:0/2433036453 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c000ddd0 con 0x7fc3c8157d40 2023-07-29T02:06:02.020 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.028+0000 7fc3beffd700 1 -- 172.21.15.42:0/2433036453 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c000f040 con 0x7fc3c8157d40 2023-07-29T02:06:02.020 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.028+0000 7fc3beffd700 1 -- 172.21.15.42:0/2433036453 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0003c60 con 0x7fc3c8157d40 2023-07-29T02:06:02.020 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.028+0000 7fc3d0364700 1 -- 172.21.15.42:0/2433036453 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c81499e0 con 0x7fc3c8157d40 2023-07-29T02:06:02.021 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.028+0000 7fc3d0364700 1 -- 172.21.15.42:0/2433036453 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c80c40c0 con 0x7fc3c8157d40 2023-07-29T02:06:02.021 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.029+0000 7fc3d0364700 1 -- 172.21.15.42:0/2433036453 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c80c4ba0 con 0x7fc3c8157d40 2023-07-29T02:06:02.021 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.030+0000 7fc3beffd700 1 -- 172.21.15.42:0/2433036453 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fc3c0004030 con 0x7fc3c8157d40 2023-07-29T02:06:02.021 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.030+0000 7fc3beffd700 1 --2- 172.21.15.42:0/2433036453 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc3ac06a660 0x7fc3ac06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.022 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.030+0000 7fc3beffd700 1 -- 172.21.15.42:0/2433036453 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7fc3c0088f80 con 0x7fc3c8157d40 2023-07-29T02:06:02.022 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.030+0000 7fc3ce100700 1 --2- 172.21.15.42:0/2433036453 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc3ac06a660 0x7fc3ac06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.022 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.031+0000 7fc3ce100700 1 --2- 172.21.15.42:0/2433036453 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc3ac06a660 0x7fc3ac06cb10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4000c00 tx=0x7fc3c4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:02.023 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.035+0000 7fc3beffd700 1 -- 172.21.15.42:0/2433036453 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fc3c80c4ba0 con 0x7fc3c8157d40 2023-07-29T02:06:02.215 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.234+0000 7fc3d0364700 1 -- 172.21.15.42:0/2433036453 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3c80c4ba0 con 0x7fc3c8157d40 2023-07-29T02:06:02.217 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.235+0000 7fc3beffd700 1 -- 172.21.15.42:0/2433036453 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+20196 (secure 0 0 0) 0x7fc3c80c4ba0 con 0x7fc3c8157d40 2023-07-29T02:06:02.217 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:06:02.218 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":39,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T02:04:19.439695+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T01:59:55.827461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T01:59:56.924040+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-29T01:59:59.996470+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2},{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6836/2695599859":"2023-07-30T02:04:19.439641+0000","172.21.15.42:6837/2695599859":"2023-07-30T02:04:19.439641+0000","172.21.15.144:6837/3824722756":"2023-07-30T02:02:24.415811+0000","172.21.15.42:6836/1851767861":"2023-07-30T02:01:34.406178+0000","172.21.15.144:6839/3824722756":"2023-07-30T02:02:24.415811+0000","172.21.15.42:6837/1851767861":"2023-07-30T02:01:34.406178+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T02:06:02.219 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.237+0000 7fc3d0364700 1 -- 172.21.15.42:0/2433036453 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc3ac06a660 msgr2=0x7fc3ac06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:02.219 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.237+0000 7fc3d0364700 1 --2- 172.21.15.42:0/2433036453 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc3ac06a660 0x7fc3ac06cb10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4000c00 tx=0x7fc3c4008030 comp rx=0 tx=0).stop 2023-07-29T02:06:02.220 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.237+0000 7fc3d0364700 1 -- 172.21.15.42:0/2433036453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3c8157d40 msgr2=0x7fc3c80c5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:02.220 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.237+0000 7fc3d0364700 1 --2- 172.21.15.42:0/2433036453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3c8157d40 0x7fc3c80c5250 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0007df0 tx=0x7fc3c000d3b0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.220 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.237+0000 7fc3d0364700 1 -- 172.21.15.42:0/2433036453 shutdown_connections 2023-07-29T02:06:02.220 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.237+0000 7fc3d0364700 1 --2- 172.21.15.42:0/2433036453 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc3ac06a660 0x7fc3ac06cb10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.221 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.237+0000 7fc3d0364700 1 --2- 172.21.15.42:0/2433036453 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc3c8157d40 0x7fc3c80c5250 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.221 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.237+0000 7fc3d0364700 1 --2- 172.21.15.42:0/2433036453 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc3c80c7ed0 0x7fc3c80c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.221 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.237+0000 7fc3d0364700 1 --2- 172.21.15.42:0/2433036453 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc3c814dce0 0x7fc3c814a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.221 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.237+0000 7fc3d0364700 1 -- 172.21.15.42:0/2433036453 >> 172.21.15.42:0/2433036453 conn(0x7fc3c806a750 msgr2=0x7fc3c815ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:02.222 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.238+0000 7fc3d0364700 1 -- 172.21.15.42:0/2433036453 shutdown_connections 2023-07-29T02:06:02.222 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.238+0000 7fc3d0364700 1 -- 172.21.15.42:0/2433036453 wait complete. 2023-07-29T02:06:02.232 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-29T01:59:50.906228+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-29T01:59:51.290583+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-29T01:59:55.827461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-29T01:59:56.924040+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 505, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-29T01:59:59.996470+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 505, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-29T02:06:02.233 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-29T02:06:02.361 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.380+0000 7ff27746c700 1 Processor -- start 2023-07-29T02:06:02.362 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.380+0000 7ff27746c700 1 -- start start 2023-07-29T02:06:02.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.381+0000 7ff27746c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff27006f530 0x7ff2700cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.381+0000 7ff27746c700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27015b1d0 con 0x7ff2700ccfa0 2023-07-29T02:06:02.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.381+0000 7ff27746c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27015a650 con 0x7ff2700c3890 2023-07-29T02:06:02.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.381+0000 7ff27746c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2700c9820 con 0x7ff27006f530 2023-07-29T02:06:02.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.381+0000 7ff275208700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff2700ccfa0 0x7ff27006dc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:51952/0 (socket says 172.21.15.42:51952) 2023-07-29T02:06:02.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.381+0000 7ff275208700 1 -- 172.21.15.42:0/161314328 learned_addr learned my addr 172.21.15.42:0/161314328 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:06:02.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.381+0000 7ff274a07700 1 --2- 172.21.15.42:0/161314328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff27006f530 0x7ff2700cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.381+0000 7ff267fff700 1 -- 172.21.15.42:0/161314328 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124840254 0 0) 0x7ff27015b1d0 con 0x7ff2700ccfa0 2023-07-29T02:06:02.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.381+0000 7ff267fff700 1 -- 172.21.15.42:0/161314328 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff25c0035b0 con 0x7ff2700ccfa0 2023-07-29T02:06:02.366 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.381+0000 7ff267fff700 1 -- 172.21.15.42:0/161314328 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 622297610 0 0) 0x7ff25c0035b0 con 0x7ff2700ccfa0 2023-07-29T02:06:02.366 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.381+0000 7ff267fff700 1 -- 172.21.15.42:0/161314328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff27006f530 msgr2=0x7ff2700cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:02.366 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.381+0000 7ff267fff700 1 --2- 172.21.15.42:0/161314328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff27006f530 0x7ff2700cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.366 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.381+0000 7ff267fff700 1 -- 172.21.15.42:0/161314328 >> v1:172.21.15.144:6789/0 conn(0x7ff2700c3890 legacy=0x7ff2701615a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:02.366 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.381+0000 7ff267fff700 1 -- 172.21.15.42:0/161314328 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27015a930 con 0x7ff2700ccfa0 2023-07-29T02:06:02.367 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.381+0000 7ff267fff700 1 -- 172.21.15.42:0/161314328 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7ff26c0017f0 con 0x7ff2700ccfa0 2023-07-29T02:06:02.367 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.382+0000 7ff267fff700 1 -- 172.21.15.42:0/161314328 >> v1:172.21.15.42:6789/0 conn(0x7ff2700ccfa0 legacy=0x7ff27006dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:02.367 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.382+0000 7ff267fff700 1 --2- 172.21.15.42:0/161314328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff27006f530 0x7ff25c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.367 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.382+0000 7ff267fff700 1 --2- 172.21.15.42:0/161314328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff25c003fb0 0x7ff25c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.367 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.382+0000 7ff267fff700 1 --2- 172.21.15.42:0/161314328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff25c004d90 0x7ff25c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.382+0000 7ff267fff700 1 -- 172.21.15.42:0/161314328 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2700c9820 con 0x7ff25c004d90 2023-07-29T02:06:02.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.382+0000 7ff267fff700 1 -- 172.21.15.42:0/161314328 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c00bb80 con 0x7ff25c003fb0 2023-07-29T02:06:02.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.382+0000 7ff267fff700 1 -- 172.21.15.42:0/161314328 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c00bd40 con 0x7ff27006f530 2023-07-29T02:06:02.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.382+0000 7ff275a09700 1 --2- 172.21.15.42:0/161314328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff25c004d90 0x7ff25c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.382+0000 7ff275208700 1 --2- 172.21.15.42:0/161314328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff27006f530 0x7ff25c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.382+0000 7ff274a07700 1 --2- 172.21.15.42:0/161314328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff25c003fb0 0x7ff25c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.382+0000 7ff275a09700 1 -- 172.21.15.42:0/161314328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff27006f530 msgr2=0x7ff25c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:02.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.382+0000 7ff275a09700 1 --2- 172.21.15.42:0/161314328 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff27006f530 0x7ff25c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.382+0000 7ff275a09700 1 -- 172.21.15.42:0/161314328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff25c003fb0 msgr2=0x7ff25c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:02.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.382+0000 7ff275a09700 1 --2- 172.21.15.42:0/161314328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff25c003fb0 0x7ff25c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.382+0000 7ff275a09700 1 -- 172.21.15.42:0/161314328 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c0035b0 con 0x7ff25c004d90 2023-07-29T02:06:02.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.382+0000 7ff275a09700 1 --2- 172.21.15.42:0/161314328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff25c004d90 0x7ff25c005200 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff26800c210 tx=0x7ff25c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f42346709f59524 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:02.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.382+0000 7ff267fff700 1 -- 172.21.15.42:0/161314328 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff268001df0 con 0x7ff25c004d90 2023-07-29T02:06:02.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.382+0000 7ff267fff700 1 -- 172.21.15.42:0/161314328 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26800cd70 con 0x7ff25c004d90 2023-07-29T02:06:02.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.382+0000 7ff267fff700 1 -- 172.21.15.42:0/161314328 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff268003c40 con 0x7ff25c004d90 2023-07-29T02:06:02.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.383+0000 7ff27746c700 1 -- 172.21.15.42:0/161314328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff25c004d90 msgr2=0x7ff25c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:02.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.383+0000 7ff27746c700 1 --2- 172.21.15.42:0/161314328 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff25c004d90 0x7ff25c005200 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff26800c210 tx=0x7ff25c005880 comp rx=0 tx=0).stop 2023-07-29T02:06:02.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.383+0000 7ff275a09700 1 -- 172.21.15.42:0/161314328 reap_dead start 2023-07-29T02:06:02.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.383+0000 7ff27746c700 1 -- 172.21.15.42:0/161314328 shutdown_connections 2023-07-29T02:06:02.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.383+0000 7ff27746c700 1 -- 172.21.15.42:0/161314328 >> 172.21.15.42:0/161314328 conn(0x7ff270061190 msgr2=0x7ff270061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:02.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.383+0000 7ff27746c700 1 -- 172.21.15.42:0/161314328 shutdown_connections 2023-07-29T02:06:02.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.383+0000 7ff27746c700 1 -- 172.21.15.42:0/161314328 wait complete. 2023-07-29T02:06:02.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.384+0000 7ff27746c700 1 Processor -- start 2023-07-29T02:06:02.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.384+0000 7ff27746c700 1 -- start start 2023-07-29T02:06:02.375 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.385+0000 7ff27746c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2701e23e0 0x7ff2701459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.375 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.385+0000 7ff27746c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff2701e27b0 0x7ff2701ed350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.375 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.385+0000 7ff27746c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff270157da0 0x7ff270157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.375 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.385+0000 7ff27746c700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27014fa70 con 0x7ff270157da0 2023-07-29T02:06:02.375 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.385+0000 7ff27746c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff270145f10 con 0x7ff2701e23e0 2023-07-29T02:06:02.376 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.385+0000 7ff27746c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2701585c0 con 0x7ff2701e27b0 2023-07-29T02:06:02.376 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.385+0000 7ff275a09700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff270157da0 0x7ff270157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.376 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.385+0000 7ff275a09700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff270157da0 0x7ff270157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58164/0 (socket says 172.21.15.42:58164) 2023-07-29T02:06:02.376 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.385+0000 7ff275a09700 1 -- 172.21.15.42:0/4257745767 learned_addr learned my addr 172.21.15.42:0/4257745767 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:02.376 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.385+0000 7ff275208700 1 --2- 172.21.15.42:0/4257745767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2701e23e0 0x7ff2701459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.385+0000 7ff274a07700 1 --2- 172.21.15.42:0/4257745767 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff2701e27b0 0x7ff2701ed350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.385+0000 7ff275a09700 1 -- 172.21.15.42:0/4257745767 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff2701e27b0 msgr2=0x7ff2701ed350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:02.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.385+0000 7ff275a09700 1 --2- 172.21.15.42:0/4257745767 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff2701e27b0 0x7ff2701ed350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.385+0000 7ff275a09700 1 -- 172.21.15.42:0/4257745767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2701e23e0 msgr2=0x7ff2701459d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:02.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.385+0000 7ff275a09700 1 --2- 172.21.15.42:0/4257745767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2701e23e0 0x7ff2701459d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.385+0000 7ff275a09700 1 -- 172.21.15.42:0/4257745767 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2701588a0 con 0x7ff270157da0 2023-07-29T02:06:02.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.385+0000 7ff274a07700 1 --2- 172.21.15.42:0/4257745767 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff2701e27b0 0x7ff2701ed350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:06:02.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.385+0000 7ff275208700 1 --2- 172.21.15.42:0/4257745767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2701e23e0 0x7ff2701459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:06:02.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.385+0000 7ff275a09700 1 --2- 172.21.15.42:0/4257745767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff270157da0 0x7ff270157020 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff268015040 tx=0x7ff2680014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:02.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.386+0000 7ff265ffb700 1 -- 172.21.15.42:0/4257745767 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff268003e10 con 0x7ff270157da0 2023-07-29T02:06:02.379 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.386+0000 7ff265ffb700 1 -- 172.21.15.42:0/4257745767 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2680050d0 con 0x7ff270157da0 2023-07-29T02:06:02.379 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.386+0000 7ff27746c700 1 -- 172.21.15.42:0/4257745767 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff270158b80 con 0x7ff270157da0 2023-07-29T02:06:02.379 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.386+0000 7ff265ffb700 1 -- 172.21.15.42:0/4257745767 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff268005480 con 0x7ff270157da0 2023-07-29T02:06:02.379 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.386+0000 7ff27746c700 1 -- 172.21.15.42:0/4257745767 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2701ecb50 con 0x7ff270157da0 2023-07-29T02:06:02.379 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.387+0000 7ff27746c700 1 -- 172.21.15.42:0/4257745767 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27004ea50 con 0x7ff270157da0 2023-07-29T02:06:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.387+0000 7ff265ffb700 1 -- 172.21.15.42:0/4257745767 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7ff268019040 con 0x7ff270157da0 2023-07-29T02:06:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.388+0000 7ff265ffb700 1 --2- 172.21.15.42:0/4257745767 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff25406a690 0x7ff25406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.388+0000 7ff265ffb700 1 -- 172.21.15.42:0/4257745767 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7ff268089d50 con 0x7ff270157da0 2023-07-29T02:06:02.380 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.388+0000 7ff275208700 1 --2- 172.21.15.42:0/4257745767 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff25406a690 0x7ff25406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.381 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.388+0000 7ff275208700 1 --2- 172.21.15.42:0/4257745767 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff25406a690 0x7ff25406cb40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff26c000fd0 tx=0x7ff26c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:02.381 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.392+0000 7ff265ffb700 1 -- 172.21.15.42:0/4257745767 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7ff268054d20 con 0x7ff270157da0 2023-07-29T02:06:02.572 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.590+0000 7ff27746c700 1 -- 172.21.15.42:0/4257745767 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff27006e7d0 con 0x7ff270157da0 2023-07-29T02:06:02.573 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.590+0000 7ff265ffb700 1 -- 172.21.15.42:0/4257745767 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff268058340 con 0x7ff270157da0 2023-07-29T02:06:02.573 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 8 2023-07-29T02:06:02.575 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.593+0000 7ff27746c700 1 -- 172.21.15.42:0/4257745767 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff25406a690 msgr2=0x7ff25406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:02.575 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.593+0000 7ff27746c700 1 --2- 172.21.15.42:0/4257745767 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff25406a690 0x7ff25406cb40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff26c000fd0 tx=0x7ff26c009040 comp rx=0 tx=0).stop 2023-07-29T02:06:02.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.593+0000 7ff27746c700 1 -- 172.21.15.42:0/4257745767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff270157da0 msgr2=0x7ff270157020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:02.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.593+0000 7ff27746c700 1 --2- 172.21.15.42:0/4257745767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff270157da0 0x7ff270157020 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff268015040 tx=0x7ff2680014a0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.593+0000 7ff27746c700 1 -- 172.21.15.42:0/4257745767 shutdown_connections 2023-07-29T02:06:02.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.593+0000 7ff27746c700 1 --2- 172.21.15.42:0/4257745767 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff25406a690 0x7ff25406cb40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.593+0000 7ff27746c700 1 --2- 172.21.15.42:0/4257745767 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff270157da0 0x7ff270157020 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.593+0000 7ff27746c700 1 --2- 172.21.15.42:0/4257745767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2701e23e0 0x7ff2701459d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.593+0000 7ff27746c700 1 --2- 172.21.15.42:0/4257745767 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff2701e27b0 0x7ff2701ed350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.593+0000 7ff27746c700 1 -- 172.21.15.42:0/4257745767 >> 172.21.15.42:0/4257745767 conn(0x7ff270061190 msgr2=0x7ff2700cbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:02.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.593+0000 7ff27746c700 1 -- 172.21.15.42:0/4257745767 shutdown_connections 2023-07-29T02:06:02.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.593+0000 7ff27746c700 1 -- 172.21.15.42:0/4257745767 wait complete. 2023-07-29T02:06:02.586 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-29T02:06:02.715 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.733+0000 7f9f085e5700 1 Processor -- start 2023-07-29T02:06:02.715 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.733+0000 7f9f085e5700 1 -- start start 2023-07-29T02:06:02.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.734+0000 7f9f085e5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f000b0f00 0x7f9f000c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.717 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.734+0000 7f9f085e5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9f000b12d0 0x7f9f001590e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.734+0000 7f9f085e5700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9f000c0fa0 0x7f9f00159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.734+0000 7f9f085e5700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f0006d6f0 con 0x7f9f000c0fa0 2023-07-29T02:06:02.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.734+0000 7f9f085e5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f000c7450 con 0x7f9f000b12d0 2023-07-29T02:06:02.718 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.734+0000 7f9f085e5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f000c7730 con 0x7f9f000b0f00 2023-07-29T02:06:02.719 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.734+0000 7f9f06b82700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9f000c0fa0 0x7f9f00159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.719 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.734+0000 7f9f06b82700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f9f000c0fa0 0x7f9f00159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58170/0 (socket says 172.21.15.42:58170) 2023-07-29T02:06:02.719 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.734+0000 7f9f06b82700 1 -- 172.21.15.42:0/2260672724 learned_addr learned my addr 172.21.15.42:0/2260672724 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:02.719 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.735+0000 7f9f06381700 1 --2- 172.21.15.42:0/2260672724 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f000b0f00 0x7f9f000c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.720 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.735+0000 7f9f05b80700 1 --2- 172.21.15.42:0/2260672724 >> v2:172.21.15.144:3300/0 conn(0x7f9f000b12d0 0x7f9f001590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.720 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.735+0000 7f9f06b82700 1 -- 172.21.15.42:0/2260672724 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f000b0f00 msgr2=0x7f9f000c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:02.720 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.735+0000 7f9f06b82700 1 --2- 172.21.15.42:0/2260672724 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f000b0f00 0x7f9f000c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.720 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.735+0000 7f9f06b82700 1 -- 172.21.15.42:0/2260672724 >> v2:172.21.15.144:3300/0 conn(0x7f9f000b12d0 msgr2=0x7f9f001590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:02.720 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.735+0000 7f9f06b82700 1 --2- 172.21.15.42:0/2260672724 >> v2:172.21.15.144:3300/0 conn(0x7f9f000b12d0 0x7f9f001590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.721 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.735+0000 7f9f06b82700 1 -- 172.21.15.42:0/2260672724 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0006cdc0 con 0x7f9f000c0fa0 2023-07-29T02:06:02.721 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.735+0000 7f9f06381700 1 --2- 172.21.15.42:0/2260672724 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f000b0f00 0x7f9f000c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:06:02.721 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.735+0000 7f9f06b82700 1 --2- 172.21.15.42:0/2260672724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f000c0fa0 0x7f9f00159620 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9f00070a30 tx=0x7f9ef800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d92823124fd81a server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:02.721 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.735+0000 7f9f0537f700 1 -- 172.21.15.42:0/2260672724 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef800e070 con 0x7f9f000c0fa0 2023-07-29T02:06:02.721 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.735+0000 7f9f0537f700 1 -- 172.21.15.42:0/2260672724 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef800b9c0 con 0x7f9f000c0fa0 2023-07-29T02:06:02.722 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.735+0000 7f9f0537f700 1 -- 172.21.15.42:0/2260672724 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef800bd70 con 0x7f9f000c0fa0 2023-07-29T02:06:02.722 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.736+0000 7f9f085e5700 1 -- 172.21.15.42:0/2260672724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f000c0fa0 msgr2=0x7f9f00159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:02.722 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.736+0000 7f9f085e5700 1 --2- 172.21.15.42:0/2260672724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f000c0fa0 0x7f9f00159620 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9f00070a30 tx=0x7f9ef800b330 comp rx=0 tx=0).stop 2023-07-29T02:06:02.722 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.736+0000 7f9f085e5700 1 -- 172.21.15.42:0/2260672724 shutdown_connections 2023-07-29T02:06:02.723 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.736+0000 7f9f085e5700 1 --2- 172.21.15.42:0/2260672724 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f000b0f00 0x7f9f000c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.723 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.736+0000 7f9f085e5700 1 --2- 172.21.15.42:0/2260672724 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f000c0fa0 0x7f9f00159620 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.723 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.736+0000 7f9f085e5700 1 --2- 172.21.15.42:0/2260672724 >> v2:172.21.15.144:3300/0 conn(0x7f9f000b12d0 0x7f9f001590e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.723 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.736+0000 7f9f085e5700 1 -- 172.21.15.42:0/2260672724 >> 172.21.15.42:0/2260672724 conn(0x7f9f000ccc50 msgr2=0x7f9f0006ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:02.723 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.736+0000 7f9f085e5700 1 -- 172.21.15.42:0/2260672724 shutdown_connections 2023-07-29T02:06:02.724 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.736+0000 7f9f085e5700 1 -- 172.21.15.42:0/2260672724 wait complete. 2023-07-29T02:06:02.726 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.737+0000 7f9f085e5700 1 Processor -- start 2023-07-29T02:06:02.726 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.737+0000 7f9f085e5700 1 -- start start 2023-07-29T02:06:02.726 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9f085e5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f000b0f00 0x7f9f0006b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.726 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9f085e5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f000b12d0 0x7f9f001e19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.727 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9f085e5700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f000c0fa0 0x7f9f001e1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.727 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9f085e5700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f000cbc60 con 0x7f9f000c0fa0 2023-07-29T02:06:02.727 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9f085e5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f001f2f90 con 0x7f9f000b0f00 2023-07-29T02:06:02.727 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9f085e5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f001f2410 con 0x7f9f000b12d0 2023-07-29T02:06:02.727 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9f06b82700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f000c0fa0 0x7f9f001e1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9f06b82700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f000c0fa0 0x7f9f001e1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58176/0 (socket says 172.21.15.42:58176) 2023-07-29T02:06:02.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9f06b82700 1 -- 172.21.15.42:0/3712413955 learned_addr learned my addr 172.21.15.42:0/3712413955 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:02.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9f06381700 1 --2- 172.21.15.42:0/3712413955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f000b0f00 0x7f9f0006b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.728 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9f05b80700 1 --2- 172.21.15.42:0/3712413955 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f000b12d0 0x7f9f001e19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9f06b82700 1 -- 172.21.15.42:0/3712413955 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f000b12d0 msgr2=0x7f9f001e19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:02.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9f06b82700 1 --2- 172.21.15.42:0/3712413955 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f000b12d0 0x7f9f001e19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9f06b82700 1 -- 172.21.15.42:0/3712413955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f000b0f00 msgr2=0x7f9f0006b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:02.729 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9f06b82700 1 --2- 172.21.15.42:0/3712413955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f000b0f00 0x7f9f0006b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.730 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9f06b82700 1 -- 172.21.15.42:0/3712413955 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef8009b30 con 0x7f9f000c0fa0 2023-07-29T02:06:02.730 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9f05b80700 1 --2- 172.21.15.42:0/3712413955 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f000b12d0 0x7f9f001e19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:06:02.730 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9f06b82700 1 --2- 172.21.15.42:0/3712413955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f000c0fa0 0x7f9f001e1f20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8012000 tx=0x7f9ef8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:02.730 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9ef6ffd700 1 -- 172.21.15.42:0/3712413955 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8004250 con 0x7f9f000c0fa0 2023-07-29T02:06:02.730 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9ef6ffd700 1 -- 172.21.15.42:0/3712413955 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef80043d0 con 0x7f9f000c0fa0 2023-07-29T02:06:02.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9ef6ffd700 1 -- 172.21.15.42:0/3712413955 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8004780 con 0x7f9f000c0fa0 2023-07-29T02:06:02.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.738+0000 7f9f085e5700 1 -- 172.21.15.42:0/3712413955 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f001f26f0 con 0x7f9f000c0fa0 2023-07-29T02:06:02.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.739+0000 7f9f085e5700 1 -- 172.21.15.42:0/3712413955 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f001f2cb0 con 0x7f9f000c0fa0 2023-07-29T02:06:02.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.740+0000 7f9f085e5700 1 -- 172.21.15.42:0/3712413955 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0004ea50 con 0x7f9f000c0fa0 2023-07-29T02:06:02.731 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.740+0000 7f9ef6ffd700 1 -- 172.21.15.42:0/3712413955 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f9ef801b430 con 0x7f9f000c0fa0 2023-07-29T02:06:02.732 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.741+0000 7f9ef6ffd700 1 --2- 172.21.15.42:0/3712413955 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9ee406a660 0x7f9ee406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:02.732 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.741+0000 7f9ef6ffd700 1 -- 172.21.15.42:0/3712413955 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f9ef8089e60 con 0x7f9f000c0fa0 2023-07-29T02:06:02.732 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.741+0000 7f9f06381700 1 --2- 172.21.15.42:0/3712413955 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9ee406a660 0x7f9ee406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:02.732 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.741+0000 7f9f06381700 1 --2- 172.21.15.42:0/3712413955 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9ee406a660 0x7f9ee406cb10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00038f0 tx=0x7f9ef0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:02.733 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.745+0000 7f9ef6ffd700 1 -- 172.21.15.42:0/3712413955 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f9ef8054dc0 con 0x7f9f000c0fa0 2023-07-29T02:06:02.923 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.941+0000 7f9f085e5700 1 -- 172.21.15.42:0/3712413955 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f0014de50 con 0x7f9f000c0fa0 2023-07-29T02:06:02.924 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.942+0000 7f9ef6ffd700 1 -- 172.21.15.42:0/3712413955 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ef801f070 con 0x7f9f000c0fa0 2023-07-29T02:06:02.924 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 1 2023-07-29T02:06:02.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.944+0000 7f9f085e5700 1 -- 172.21.15.42:0/3712413955 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9ee406a660 msgr2=0x7f9ee406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:02.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.944+0000 7f9f085e5700 1 --2- 172.21.15.42:0/3712413955 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9ee406a660 0x7f9ee406cb10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00038f0 tx=0x7f9ef0008040 comp rx=0 tx=0).stop 2023-07-29T02:06:02.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.944+0000 7f9f085e5700 1 -- 172.21.15.42:0/3712413955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f000c0fa0 msgr2=0x7f9f001e1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:02.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.944+0000 7f9f085e5700 1 --2- 172.21.15.42:0/3712413955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f000c0fa0 0x7f9f001e1f20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8012000 tx=0x7f9ef8004ad0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.944+0000 7f9f085e5700 1 -- 172.21.15.42:0/3712413955 shutdown_connections 2023-07-29T02:06:02.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.944+0000 7f9f085e5700 1 --2- 172.21.15.42:0/3712413955 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9ee406a660 0x7f9ee406cb10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.944+0000 7f9f085e5700 1 --2- 172.21.15.42:0/3712413955 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9f000c0fa0 0x7f9f001e1f20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.944+0000 7f9f085e5700 1 --2- 172.21.15.42:0/3712413955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f000b0f00 0x7f9f0006b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.944+0000 7f9f085e5700 1 --2- 172.21.15.42:0/3712413955 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9f000b12d0 0x7f9f001e19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:02.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.944+0000 7f9f085e5700 1 -- 172.21.15.42:0/3712413955 >> 172.21.15.42:0/3712413955 conn(0x7f9f000ccc50 msgr2=0x7f9f00071120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:02.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.944+0000 7f9f085e5700 1 -- 172.21.15.42:0/3712413955 shutdown_connections 2023-07-29T02:06:02.928 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:02.944+0000 7f9f085e5700 1 -- 172.21.15.42:0/3712413955 wait complete. 2023-07-29T02:06:02.938 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-29T02:06:03.066 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.085+0000 7f52c4f23700 1 Processor -- start 2023-07-29T02:06:03.067 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.085+0000 7f52c4f23700 1 -- start start 2023-07-29T02:06:03.068 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.086+0000 7f52c4f23700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f52c00b2d20 0x7f52c00c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:03.068 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.086+0000 7f52c4f23700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52c00ca6d0 0x7f52c006fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:03.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.086+0000 7f52c4f23700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c00c4150 con 0x7f52c00b2950 2023-07-29T02:06:03.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.086+0000 7f52c4f23700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c00c1f40 con 0x7f52c00b2d20 2023-07-29T02:06:03.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.086+0000 7f52c4f23700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00ca040 con 0x7f52c00ca6d0 2023-07-29T02:06:03.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.086+0000 7f52bdd9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f52c00b2d20 0x7f52c00c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:03.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.086+0000 7f52bed9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52c00ca6d0 0x7f52c006fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:03.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.086+0000 7f52bed9d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52c00ca6d0 0x7f52c006fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:58698/0 (socket says 172.21.15.42:58698) 2023-07-29T02:06:03.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.086+0000 7f52bdd9b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f52c00b2d20 0x7f52c00c91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:41560/0 (socket says 172.21.15.42:41560) 2023-07-29T02:06:03.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.086+0000 7f52bed9d700 1 -- 172.21.15.42:0/3968981992 learned_addr learned my addr 172.21.15.42:0/3968981992 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:03.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.086+0000 7f52bed9d700 1 -- 172.21.15.42:0/3968981992 >> v2:172.21.15.144:3300/0 conn(0x7f52c00b2d20 msgr2=0x7f52c00c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:03.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.086+0000 7f52bed9d700 1 --2- 172.21.15.42:0/3968981992 >> v2:172.21.15.144:3300/0 conn(0x7f52c00b2d20 0x7f52c00c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.086+0000 7f52bed9d700 1 -- 172.21.15.42:0/3968981992 >> v1:172.21.15.144:6789/0 conn(0x7f52c00b2950 legacy=0x7f52c0150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:03.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.086+0000 7f52bed9d700 1 -- 172.21.15.42:0/3968981992 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c00ca320 con 0x7f52c00ca6d0 2023-07-29T02:06:03.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.086+0000 7f52bdd9b700 1 --2- 172.21.15.42:0/3968981992 >> v2:172.21.15.144:3300/0 conn(0x7f52c00b2d20 0x7f52c00c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:06:03.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.087+0000 7f52bed9d700 1 --2- 172.21.15.42:0/3968981992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52c00ca6d0 0x7f52c006fc40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009e50 tx=0x7f52b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=146951b04b3f451c server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:03.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.087+0000 7f52bd59a700 1 -- 172.21.15.42:0/3968981992 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b800e070 con 0x7f52c00ca6d0 2023-07-29T02:06:03.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.087+0000 7f52bd59a700 1 -- 172.21.15.42:0/3968981992 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b800b910 con 0x7f52c00ca6d0 2023-07-29T02:06:03.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.087+0000 7f52bd59a700 1 -- 172.21.15.42:0/3968981992 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b800bcc0 con 0x7f52c00ca6d0 2023-07-29T02:06:03.074 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.087+0000 7f52c4f23700 1 -- 172.21.15.42:0/3968981992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52c00ca6d0 msgr2=0x7f52c006fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:03.074 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.087+0000 7f52c4f23700 1 --2- 172.21.15.42:0/3968981992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52c00ca6d0 0x7f52c006fc40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009e50 tx=0x7f52b800b330 comp rx=0 tx=0).stop 2023-07-29T02:06:03.075 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.087+0000 7f52c4f23700 1 -- 172.21.15.42:0/3968981992 shutdown_connections 2023-07-29T02:06:03.075 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.087+0000 7f52c4f23700 1 --2- 172.21.15.42:0/3968981992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52c00ca6d0 0x7f52c006fc40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.075 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.087+0000 7f52c4f23700 1 --2- 172.21.15.42:0/3968981992 >> v2:172.21.15.144:3300/0 conn(0x7f52c00b2d20 0x7f52c00c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.075 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.087+0000 7f52c4f23700 1 -- 172.21.15.42:0/3968981992 >> 172.21.15.42:0/3968981992 conn(0x7f52c00721c0 msgr2=0x7f52c00725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:03.075 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.087+0000 7f52c4f23700 1 -- 172.21.15.42:0/3968981992 shutdown_connections 2023-07-29T02:06:03.076 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.087+0000 7f52c4f23700 1 -- 172.21.15.42:0/3968981992 wait complete. 2023-07-29T02:06:03.076 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.089+0000 7f52c4f23700 1 Processor -- start 2023-07-29T02:06:03.076 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.089+0000 7f52c4f23700 1 -- start start 2023-07-29T02:06:03.076 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52c4f23700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52c00b2950 0x7f52c013bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:03.076 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52c4f23700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52c00b2d20 0x7f52c00cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:03.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52c4f23700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52c00ca6d0 0x7f52c006fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:03.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52c4f23700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c01f0b80 con 0x7f52c00b2d20 2023-07-29T02:06:03.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52c4f23700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c01efe00 con 0x7f52c00ca6d0 2023-07-29T02:06:03.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52c4f23700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c0140310 con 0x7f52c00b2950 2023-07-29T02:06:03.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52bdd9b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52c00b2d20 0x7f52c00cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52bdd9b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52c00b2d20 0x7f52c00cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58188/0 (socket says 172.21.15.42:58188) 2023-07-29T02:06:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52bdd9b700 1 -- 172.21.15.42:0/3831499365 learned_addr learned my addr 172.21.15.42:0/3831499365 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52be59c700 1 --2- 172.21.15.42:0/3831499365 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52c00b2950 0x7f52c013bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52bed9d700 1 --2- 172.21.15.42:0/3831499365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52c00ca6d0 0x7f52c006fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:03.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52bdd9b700 1 -- 172.21.15.42:0/3831499365 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52c00b2950 msgr2=0x7f52c013bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:03.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52bdd9b700 1 --2- 172.21.15.42:0/3831499365 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52c00b2950 0x7f52c013bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52bdd9b700 1 -- 172.21.15.42:0/3831499365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52c00ca6d0 msgr2=0x7f52c006fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:03.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52bdd9b700 1 --2- 172.21.15.42:0/3831499365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52c00ca6d0 0x7f52c006fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.080 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52bdd9b700 1 -- 172.21.15.42:0/3831499365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b40094a0 con 0x7f52c00b2d20 2023-07-29T02:06:03.080 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52bdd9b700 1 --2- 172.21.15.42:0/3831499365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52c00b2d20 0x7f52c00cb530 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f52b400ebe0 tx=0x7f52b400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:03.080 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52aeffd700 1 -- 172.21.15.42:0/3831499365 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b40097a0 con 0x7f52c00b2d20 2023-07-29T02:06:03.080 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52aeffd700 1 -- 172.21.15.42:0/3831499365 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b400c850 con 0x7f52c00b2d20 2023-07-29T02:06:03.080 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52c4f23700 1 -- 172.21.15.42:0/3831499365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b8009b30 con 0x7f52c00b2d20 2023-07-29T02:06:03.081 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.090+0000 7f52aeffd700 1 -- 172.21.15.42:0/3831499365 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b400cbe0 con 0x7f52c00b2d20 2023-07-29T02:06:03.081 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.091+0000 7f52c4f23700 1 -- 172.21.15.42:0/3831499365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c01f0380 con 0x7f52c00b2d20 2023-07-29T02:06:03.081 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.091+0000 7f52c4f23700 1 -- 172.21.15.42:0/3831499365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c004ea50 con 0x7f52c00b2d20 2023-07-29T02:06:03.081 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.092+0000 7f52aeffd700 1 -- 172.21.15.42:0/3831499365 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f52b400cd40 con 0x7f52c00b2d20 2023-07-29T02:06:03.081 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.092+0000 7f52aeffd700 1 --2- 172.21.15.42:0/3831499365 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f52a006a660 0x7f52a006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.093+0000 7f52aeffd700 1 -- 172.21.15.42:0/3831499365 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f52b4088b90 con 0x7f52c00b2d20 2023-07-29T02:06:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.093+0000 7f52be59c700 1 --2- 172.21.15.42:0/3831499365 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f52a006a660 0x7f52a006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:03.082 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.093+0000 7f52be59c700 1 --2- 172.21.15.42:0/3831499365 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f52a006a660 0x7f52a006cb10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f52b0007fd0 tx=0x7f52b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:03.083 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.097+0000 7f52aeffd700 1 -- 172.21.15.42:0/3831499365 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f52b4053b70 con 0x7f52c00b2d20 2023-07-29T02:06:03.279 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.297+0000 7f52c4f23700 1 -- 172.21.15.42:0/3831499365 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f52c00c2400 con 0x7f52c00b2d20 2023-07-29T02:06:03.279 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.297+0000 7f52aeffd700 1 -- 172.21.15.42:0/3831499365 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f52b4057190 con 0x7f52c00b2d20 2023-07-29T02:06:03.280 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2023-07-29T02:06:03.281 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.300+0000 7f52c4f23700 1 -- 172.21.15.42:0/3831499365 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f52a006a660 msgr2=0x7f52a006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:03.282 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.300+0000 7f52c4f23700 1 --2- 172.21.15.42:0/3831499365 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f52a006a660 0x7f52a006cb10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f52b0007fd0 tx=0x7f52b0009040 comp rx=0 tx=0).stop 2023-07-29T02:06:03.282 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.300+0000 7f52c4f23700 1 -- 172.21.15.42:0/3831499365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52c00b2d20 msgr2=0x7f52c00cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:03.282 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.300+0000 7f52c4f23700 1 --2- 172.21.15.42:0/3831499365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52c00b2d20 0x7f52c00cb530 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f52b400ebe0 tx=0x7f52b400eef0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.282 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.300+0000 7f52c4f23700 1 -- 172.21.15.42:0/3831499365 shutdown_connections 2023-07-29T02:06:03.282 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.300+0000 7f52c4f23700 1 --2- 172.21.15.42:0/3831499365 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f52a006a660 0x7f52a006cb10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.283 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.300+0000 7f52c4f23700 1 --2- 172.21.15.42:0/3831499365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f52c00ca6d0 0x7f52c006fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.283 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.300+0000 7f52c4f23700 1 --2- 172.21.15.42:0/3831499365 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f52c00b2950 0x7f52c013bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.283 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.300+0000 7f52c4f23700 1 --2- 172.21.15.42:0/3831499365 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f52c00b2d20 0x7f52c00cb530 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.283 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.300+0000 7f52c4f23700 1 -- 172.21.15.42:0/3831499365 >> 172.21.15.42:0/3831499365 conn(0x7f52c00721c0 msgr2=0x7f52c01e1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:03.283 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.300+0000 7f52c4f23700 1 -- 172.21.15.42:0/3831499365 shutdown_connections 2023-07-29T02:06:03.284 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.300+0000 7f52c4f23700 1 -- 172.21.15.42:0/3831499365 wait complete. 2023-07-29T02:06:03.293 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-29T02:06:03.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.440+0000 7f6d32ebd700 1 Processor -- start 2023-07-29T02:06:03.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.440+0000 7f6d32ebd700 1 -- start start 2023-07-29T02:06:03.424 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.441+0000 7f6d32ebd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d2c06c760 0x7f6d2c15a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.441+0000 7f6d32ebd700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6d2c06f670 0x7f6d2c1615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.441+0000 7f6d32ebd700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d2c06f1e0 con 0x7f6d2c1510f0 2023-07-29T02:06:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.441+0000 7f6d32ebd700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d2c0c7280 con 0x7f6d2c06f670 2023-07-29T02:06:03.425 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.441+0000 7f6d32ebd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c06faf0 con 0x7f6d2c06c760 2023-07-29T02:06:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.441+0000 7f6d3145a700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6d2c06f670 0x7f6d2c1615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.441+0000 7f6d3145a700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6d2c06f670 0x7f6d2c1615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58198/0 (socket says 172.21.15.42:58198) 2023-07-29T02:06:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.441+0000 7f6d3145a700 1 -- 172.21.15.42:0/683852619 learned_addr learned my addr 172.21.15.42:0/683852619 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.441+0000 7f6d2bfff700 1 --2- 172.21.15.42:0/683852619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d2c06c760 0x7f6d2c15a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:03.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.442+0000 7f6d3145a700 1 -- 172.21.15.42:0/683852619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d2c06c760 msgr2=0x7f6d2c15a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.442+0000 7f6d3145a700 1 --2- 172.21.15.42:0/683852619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d2c06c760 0x7f6d2c15a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.442+0000 7f6d3145a700 1 -- 172.21.15.42:0/683852619 >> v1:172.21.15.144:6789/0 conn(0x7f6d2c1510f0 legacy=0x7f6d2c06a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.442+0000 7f6d3145a700 1 -- 172.21.15.42:0/683852619 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2c06ebd0 con 0x7f6d2c06f670 2023-07-29T02:06:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.442+0000 7f6d3145a700 1 --2- 172.21.15.42:0/683852619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c06f670 0x7f6d2c1615e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009e80 tx=0x7f6d2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7445facc6b92e420 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:03.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.442+0000 7f6d2b7fe700 1 -- 172.21.15.42:0/683852619 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2400e070 con 0x7f6d2c06f670 2023-07-29T02:06:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.442+0000 7f6d2b7fe700 1 -- 172.21.15.42:0/683852619 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2400b8d0 con 0x7f6d2c06f670 2023-07-29T02:06:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.442+0000 7f6d2b7fe700 1 -- 172.21.15.42:0/683852619 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2400bc80 con 0x7f6d2c06f670 2023-07-29T02:06:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.442+0000 7f6d32ebd700 1 -- 172.21.15.42:0/683852619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c06f670 msgr2=0x7f6d2c1615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.442+0000 7f6d32ebd700 1 --2- 172.21.15.42:0/683852619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c06f670 0x7f6d2c1615e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009e80 tx=0x7f6d2400b330 comp rx=0 tx=0).stop 2023-07-29T02:06:03.428 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.442+0000 7f6d32ebd700 1 -- 172.21.15.42:0/683852619 shutdown_connections 2023-07-29T02:06:03.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.442+0000 7f6d32ebd700 1 --2- 172.21.15.42:0/683852619 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c06f670 0x7f6d2c1615e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.442+0000 7f6d32ebd700 1 --2- 172.21.15.42:0/683852619 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d2c06c760 0x7f6d2c15a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.442+0000 7f6d32ebd700 1 -- 172.21.15.42:0/683852619 >> 172.21.15.42:0/683852619 conn(0x7f6d2c0cbf10 msgr2=0x7f6d2c0cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:03.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.443+0000 7f6d32ebd700 1 -- 172.21.15.42:0/683852619 shutdown_connections 2023-07-29T02:06:03.429 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.443+0000 7f6d32ebd700 1 -- 172.21.15.42:0/683852619 wait complete. 2023-07-29T02:06:03.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.444+0000 7f6d32ebd700 1 Processor -- start 2023-07-29T02:06:03.432 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.444+0000 7f6d32ebd700 1 -- start start 2023-07-29T02:06:03.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.445+0000 7f6d32ebd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c06c760 0x7f6d2c14a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:03.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.445+0000 7f6d32ebd700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d2c06f670 0x7f6d2c1ec620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:03.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.445+0000 7f6d32ebd700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d2c1510f0 0x7f6d2c1427e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:03.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.445+0000 7f6d32ebd700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c14bd40 con 0x7f6d2c06c760 2023-07-29T02:06:03.433 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.445+0000 7f6d32ebd700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c0cb140 con 0x7f6d2c1510f0 2023-07-29T02:06:03.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.445+0000 7f6d32ebd700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2c14b7c0 con 0x7f6d2c06f670 2023-07-29T02:06:03.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.445+0000 7f6d30c59700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c06c760 0x7f6d2c14a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:03.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.445+0000 7f6d30c59700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c06c760 0x7f6d2c14a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58200/0 (socket says 172.21.15.42:58200) 2023-07-29T02:06:03.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.445+0000 7f6d30c59700 1 -- 172.21.15.42:0/1627378106 learned_addr learned my addr 172.21.15.42:0/1627378106 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:03.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.446+0000 7f6d2bfff700 1 --2- 172.21.15.42:0/1627378106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d2c06f670 0x7f6d2c1ec620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:03.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.446+0000 7f6d3145a700 1 --2- 172.21.15.42:0/1627378106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d2c1510f0 0x7f6d2c1427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:03.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.446+0000 7f6d30c59700 1 -- 172.21.15.42:0/1627378106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d2c06f670 msgr2=0x7f6d2c1ec620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:03.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.446+0000 7f6d30c59700 1 --2- 172.21.15.42:0/1627378106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d2c06f670 0x7f6d2c1ec620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.446+0000 7f6d30c59700 1 -- 172.21.15.42:0/1627378106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d2c1510f0 msgr2=0x7f6d2c1427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:03.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.446+0000 7f6d30c59700 1 --2- 172.21.15.42:0/1627378106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d2c1510f0 0x7f6d2c1427e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.446+0000 7f6d30c59700 1 -- 172.21.15.42:0/1627378106 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d24009b30 con 0x7f6d2c06c760 2023-07-29T02:06:03.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.446+0000 7f6d30c59700 1 --2- 172.21.15.42:0/1627378106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c06c760 0x7f6d2c14a960 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6d2000c4e0 tx=0x7f6d2000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:03.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.446+0000 7f6d297fa700 1 -- 172.21.15.42:0/1627378106 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d200052d0 con 0x7f6d2c06c760 2023-07-29T02:06:03.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.446+0000 7f6d297fa700 1 -- 172.21.15.42:0/1627378106 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d20005430 con 0x7f6d2c06c760 2023-07-29T02:06:03.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.446+0000 7f6d297fa700 1 -- 172.21.15.42:0/1627378106 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d200038c0 con 0x7f6d2c06c760 2023-07-29T02:06:03.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.446+0000 7f6d32ebd700 1 -- 172.21.15.42:0/1627378106 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d2c1f0740 con 0x7f6d2c06c760 2023-07-29T02:06:03.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.446+0000 7f6d32ebd700 1 -- 172.21.15.42:0/1627378106 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d2c0cb670 con 0x7f6d2c06c760 2023-07-29T02:06:03.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.447+0000 7f6d32ebd700 1 -- 172.21.15.42:0/1627378106 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d2c0cb4b0 con 0x7f6d2c06c760 2023-07-29T02:06:03.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.447+0000 7f6d297fa700 1 -- 172.21.15.42:0/1627378106 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f6d20003a20 con 0x7f6d2c06c760 2023-07-29T02:06:03.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.448+0000 7f6d297fa700 1 --2- 172.21.15.42:0/1627378106 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6d1006a690 0x7f6d1006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:03.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.448+0000 7f6d297fa700 1 -- 172.21.15.42:0/1627378106 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f6d20088270 con 0x7f6d2c06c760 2023-07-29T02:06:03.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.448+0000 7f6d2bfff700 1 --2- 172.21.15.42:0/1627378106 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6d1006a690 0x7f6d1006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:03.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.449+0000 7f6d2bfff700 1 --2- 172.21.15.42:0/1627378106 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6d1006a690 0x7f6d1006cb40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c072710 tx=0x7f6d18009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:03.439 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.452+0000 7f6d297fa700 1 -- 172.21.15.42:0/1627378106 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f6d20053250 con 0x7f6d2c06c760 2023-07-29T02:06:03.633 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.651+0000 7f6d32ebd700 1 -- 172.21.15.42:0/1627378106 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6d2c04ea50 con 0x7f6d2c06c760 2023-07-29T02:06:03.633 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.652+0000 7f6d297fa700 1 -- 172.21.15.42:0/1627378106 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6d20056870 con 0x7f6d2c06c760 2023-07-29T02:06:03.634 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 64 2023-07-29T02:06:03.635 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.653+0000 7f6d32ebd700 1 -- 172.21.15.42:0/1627378106 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6d1006a690 msgr2=0x7f6d1006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:03.635 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.653+0000 7f6d32ebd700 1 --2- 172.21.15.42:0/1627378106 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6d1006a690 0x7f6d1006cb40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c072710 tx=0x7f6d18009210 comp rx=0 tx=0).stop 2023-07-29T02:06:03.636 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.653+0000 7f6d32ebd700 1 -- 172.21.15.42:0/1627378106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c06c760 msgr2=0x7f6d2c14a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:03.636 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.653+0000 7f6d32ebd700 1 --2- 172.21.15.42:0/1627378106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c06c760 0x7f6d2c14a960 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6d2000c4e0 tx=0x7f6d2000c7f0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.636 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.654+0000 7f6d32ebd700 1 -- 172.21.15.42:0/1627378106 shutdown_connections 2023-07-29T02:06:03.636 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.654+0000 7f6d32ebd700 1 --2- 172.21.15.42:0/1627378106 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6d1006a690 0x7f6d1006cb40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.637 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.654+0000 7f6d32ebd700 1 --2- 172.21.15.42:0/1627378106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d2c1510f0 0x7f6d2c1427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.637 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.654+0000 7f6d32ebd700 1 --2- 172.21.15.42:0/1627378106 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6d2c06c760 0x7f6d2c14a960 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.637 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.654+0000 7f6d32ebd700 1 --2- 172.21.15.42:0/1627378106 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6d2c06f670 0x7f6d2c1ec620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.637 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.654+0000 7f6d32ebd700 1 -- 172.21.15.42:0/1627378106 >> 172.21.15.42:0/1627378106 conn(0x7f6d2c0cbf10 msgr2=0x7f6d2c14ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:03.637 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.654+0000 7f6d32ebd700 1 -- 172.21.15.42:0/1627378106 shutdown_connections 2023-07-29T02:06:03.638 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.654+0000 7f6d32ebd700 1 -- 172.21.15.42:0/1627378106 wait complete. 2023-07-29T02:06:03.647 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-29T02:06:03.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.794+0000 7fa6aca7d700 1 Processor -- start 2023-07-29T02:06:03.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.794+0000 7fa6aca7d700 1 -- start start 2023-07-29T02:06:03.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.795+0000 7fa6aca7d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fa6a80cd370 0x7fa6a81625b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:03.779 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.795+0000 7fa6aca7d700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a815b1d0 con 0x7fa6a80ccfa0 2023-07-29T02:06:03.779 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.795+0000 7fa6aca7d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a80cd810 con 0x7fa6a806f530 2023-07-29T02:06:03.779 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.795+0000 7fa6aca7d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a80c9820 con 0x7fa6a80cd370 2023-07-29T02:06:03.779 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.795+0000 7fa6a659c700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fa6a80ccfa0 0x7fa6a806dc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52012/0 (socket says 172.21.15.42:52012) 2023-07-29T02:06:03.780 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.795+0000 7fa6a659c700 1 -- 172.21.15.42:0/1602241323 learned_addr learned my addr 172.21.15.42:0/1602241323 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:06:03.780 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.795+0000 7fa6a6d9d700 1 --2- 172.21.15.42:0/1602241323 >> v2:172.21.15.144:3300/0 conn(0x7fa6a80cd370 0x7fa6a81625b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:03.780 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.795+0000 7fa6a559a700 1 -- 172.21.15.42:0/1602241323 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 982558588 0 0) 0x7fa6a815b1d0 con 0x7fa6a80ccfa0 2023-07-29T02:06:03.780 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.795+0000 7fa6a559a700 1 -- 172.21.15.42:0/1602241323 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6900035b0 con 0x7fa6a80ccfa0 2023-07-29T02:06:03.780 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.795+0000 7fa6a559a700 1 -- 172.21.15.42:0/1602241323 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1889925099 0 0) 0x7fa6900035b0 con 0x7fa6a80ccfa0 2023-07-29T02:06:03.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.795+0000 7fa6a559a700 1 -- 172.21.15.42:0/1602241323 >> v2:172.21.15.144:3300/0 conn(0x7fa6a80cd370 msgr2=0x7fa6a81625b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:03.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.795+0000 7fa6a559a700 1 --2- 172.21.15.42:0/1602241323 >> v2:172.21.15.144:3300/0 conn(0x7fa6a80cd370 0x7fa6a81625b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.795+0000 7fa6a559a700 1 -- 172.21.15.42:0/1602241323 >> v1:172.21.15.144:6789/0 conn(0x7fa6a806f530 legacy=0x7fa6a80c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:03.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.795+0000 7fa6a559a700 1 -- 172.21.15.42:0/1602241323 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a815a650 con 0x7fa6a80ccfa0 2023-07-29T02:06:03.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.795+0000 7fa6a559a700 1 -- 172.21.15.42:0/1602241323 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7fa6980017f0 con 0x7fa6a80ccfa0 2023-07-29T02:06:03.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.796+0000 7fa6a559a700 1 -- 172.21.15.42:0/1602241323 >> v1:172.21.15.42:6789/0 conn(0x7fa6a80ccfa0 legacy=0x7fa6a806dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:03.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.796+0000 7fa6a559a700 1 --2- 172.21.15.42:0/1602241323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa690003a00 0x7fa690003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:03.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.796+0000 7fa6a559a700 1 --2- 172.21.15.42:0/1602241323 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa690004850 0x7fa690004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:03.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.796+0000 7fa6a559a700 1 --2- 172.21.15.42:0/1602241323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa690005200 0x7fa69000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:03.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.796+0000 7fa6a559a700 1 -- 172.21.15.42:0/1602241323 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a80c9820 con 0x7fa690005200 2023-07-29T02:06:03.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.796+0000 7fa6a559a700 1 -- 172.21.15.42:0/1602241323 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69000c060 con 0x7fa690003a00 2023-07-29T02:06:03.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.796+0000 7fa6a559a700 1 -- 172.21.15.42:0/1602241323 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69000c220 con 0x7fa690004850 2023-07-29T02:06:03.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.796+0000 7fa6a6d9d700 1 --2- 172.21.15.42:0/1602241323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa690005200 0x7fa69000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:03.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.796+0000 7fa6a659c700 1 --2- 172.21.15.42:0/1602241323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa690003a00 0x7fa690003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:03.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.796+0000 7fa6a5d9b700 1 --2- 172.21.15.42:0/1602241323 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa690004850 0x7fa690004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:03.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.796+0000 7fa6a6d9d700 1 -- 172.21.15.42:0/1602241323 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa690004850 msgr2=0x7fa690004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:03.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.796+0000 7fa6a6d9d700 1 --2- 172.21.15.42:0/1602241323 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa690004850 0x7fa690004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.796+0000 7fa6a6d9d700 1 -- 172.21.15.42:0/1602241323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa690003a00 msgr2=0x7fa690003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:03.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.796+0000 7fa6a6d9d700 1 --2- 172.21.15.42:0/1602241323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa690003a00 0x7fa690003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.796+0000 7fa6a6d9d700 1 -- 172.21.15.42:0/1602241323 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6900035b0 con 0x7fa690005200 2023-07-29T02:06:03.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.796+0000 7fa6a6d9d700 1 -- 172.21.15.42:0/1602241323 reap_dead start 2023-07-29T02:06:03.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.796+0000 7fa6a6d9d700 1 --2- 172.21.15.42:0/1602241323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa690005200 0x7fa69000ba10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009fc0 tx=0x7fa690005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855dd0b30eec4116 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:03.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.796+0000 7fa6a559a700 1 -- 172.21.15.42:0/1602241323 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0003a20 con 0x7fa690005200 2023-07-29T02:06:03.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.796+0000 7fa6a559a700 1 -- 172.21.15.42:0/1602241323 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a000f040 con 0x7fa690005200 2023-07-29T02:06:03.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.796+0000 7fa6a559a700 1 -- 172.21.15.42:0/1602241323 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0003da0 con 0x7fa690005200 2023-07-29T02:06:03.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.797+0000 7fa6aca7d700 1 -- 172.21.15.42:0/1602241323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa690005200 msgr2=0x7fa69000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:03.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.797+0000 7fa6aca7d700 1 --2- 172.21.15.42:0/1602241323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa690005200 0x7fa69000ba10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009fc0 tx=0x7fa690005880 comp rx=0 tx=0).stop 2023-07-29T02:06:03.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.797+0000 7fa6aca7d700 1 -- 172.21.15.42:0/1602241323 shutdown_connections 2023-07-29T02:06:03.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.797+0000 7fa6aca7d700 1 --2- 172.21.15.42:0/1602241323 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa690005200 0x7fa69000ba10 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.797+0000 7fa6aca7d700 1 -- 172.21.15.42:0/1602241323 >> 172.21.15.42:0/1602241323 conn(0x7fa6a8061190 msgr2=0x7fa6a8061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:03.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.797+0000 7fa6aca7d700 1 -- 172.21.15.42:0/1602241323 shutdown_connections 2023-07-29T02:06:03.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.797+0000 7fa6aca7d700 1 -- 172.21.15.42:0/1602241323 wait complete. 2023-07-29T02:06:03.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.799+0000 7fa6aca7d700 1 Processor -- start 2023-07-29T02:06:03.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.799+0000 7fa6aca7d700 1 -- start start 2023-07-29T02:06:03.789 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.800+0000 7fa6aca7d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa690005200 0x7fa6a8142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:03.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.800+0000 7fa6aca7d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6a81543d0 0x7fa6a81ec500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:03.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.800+0000 7fa6aca7d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6a81515d0 0x7fa6a81eca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:03.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.800+0000 7fa6aca7d700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a8152130 con 0x7fa6a81515d0 2023-07-29T02:06:03.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.800+0000 7fa6aca7d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a81424e0 con 0x7fa690005200 2023-07-29T02:06:03.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.800+0000 7fa6aca7d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a8144700 con 0x7fa6a81543d0 2023-07-29T02:06:03.791 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.800+0000 7fa6a6d9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6a81515d0 0x7fa6a81eca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:03.791 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.800+0000 7fa6a6d9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6a81515d0 0x7fa6a81eca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58224/0 (socket says 172.21.15.42:58224) 2023-07-29T02:06:03.791 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.800+0000 7fa6a6d9d700 1 -- 172.21.15.42:0/3420852217 learned_addr learned my addr 172.21.15.42:0/3420852217 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:03.791 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.800+0000 7fa6a5d9b700 1 --2- 172.21.15.42:0/3420852217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6a81543d0 0x7fa6a81ec500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:03.791 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.800+0000 7fa6a659c700 1 --2- 172.21.15.42:0/3420852217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa690005200 0x7fa6a8142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:03.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.800+0000 7fa6a6d9d700 1 -- 172.21.15.42:0/3420852217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6a81543d0 msgr2=0x7fa6a81ec500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:03.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.800+0000 7fa6a6d9d700 1 --2- 172.21.15.42:0/3420852217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6a81543d0 0x7fa6a81ec500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.800+0000 7fa6a6d9d700 1 -- 172.21.15.42:0/3420852217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa690005200 msgr2=0x7fa6a8142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:03.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.800+0000 7fa6a6d9d700 1 --2- 172.21.15.42:0/3420852217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa690005200 0x7fa6a8142e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.800+0000 7fa6a6d9d700 1 -- 172.21.15.42:0/3420852217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a81429f0 con 0x7fa6a81515d0 2023-07-29T02:06:03.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.800+0000 7fa6a6d9d700 1 --2- 172.21.15.42:0/3420852217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6a81515d0 0x7fa6a81eca40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000eeb0 tx=0x7fa6a0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:03.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.800+0000 7fa696ffd700 1 -- 172.21.15.42:0/3420852217 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0003e90 con 0x7fa6a81515d0 2023-07-29T02:06:03.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.801+0000 7fa696ffd700 1 -- 172.21.15.42:0/3420852217 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a0004250 con 0x7fa6a81515d0 2023-07-29T02:06:03.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.801+0000 7fa6aca7d700 1 -- 172.21.15.42:0/3420852217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a814af10 con 0x7fa6a81515d0 2023-07-29T02:06:03.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.801+0000 7fa696ffd700 1 -- 172.21.15.42:0/3420852217 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0004600 con 0x7fa6a81515d0 2023-07-29T02:06:03.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.801+0000 7fa6aca7d700 1 -- 172.21.15.42:0/3420852217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a8143dd0 con 0x7fa6a81515d0 2023-07-29T02:06:03.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.801+0000 7fa6aca7d700 1 -- 172.21.15.42:0/3420852217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a804ea50 con 0x7fa6a81515d0 2023-07-29T02:06:03.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.802+0000 7fa696ffd700 1 -- 172.21.15.42:0/3420852217 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fa6a0004760 con 0x7fa6a81515d0 2023-07-29T02:06:03.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.802+0000 7fa696ffd700 1 --2- 172.21.15.42:0/3420852217 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa68806a690 0x7fa68806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:03.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.802+0000 7fa696ffd700 1 -- 172.21.15.42:0/3420852217 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7fa6a008a6b0 con 0x7fa6a81515d0 2023-07-29T02:06:03.795 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.803+0000 7fa6a659c700 1 --2- 172.21.15.42:0/3420852217 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa68806a690 0x7fa68806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:03.795 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.803+0000 7fa6a659c700 1 --2- 172.21.15.42:0/3420852217 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa68806a690 0x7fa68806cb40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa6980011d0 tx=0x7fa698009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:03.795 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:03.807+0000 7fa696ffd700 1 -- 172.21.15.42:0/3420852217 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fa6a0055720 con 0x7fa6a81515d0 2023-07-29T02:06:03.984 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.003+0000 7fa6aca7d700 1 -- 172.21.15.42:0/3420852217 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa6a806e7d0 con 0x7fa6a81515d0 2023-07-29T02:06:03.985 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.003+0000 7fa696ffd700 1 -- 172.21.15.42:0/3420852217 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v39) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa6a0058d40 con 0x7fa6a81515d0 2023-07-29T02:06:03.985 INFO:teuthology.orchestra.run.smithi042.stdout:pg_num: 32 2023-07-29T02:06:03.987 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.005+0000 7fa6aca7d700 1 -- 172.21.15.42:0/3420852217 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa68806a690 msgr2=0x7fa68806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:03.987 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.005+0000 7fa6aca7d700 1 --2- 172.21.15.42:0/3420852217 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa68806a690 0x7fa68806cb40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa6980011d0 tx=0x7fa698009040 comp rx=0 tx=0).stop 2023-07-29T02:06:03.988 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.005+0000 7fa6aca7d700 1 -- 172.21.15.42:0/3420852217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6a81515d0 msgr2=0x7fa6a81eca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:03.988 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.005+0000 7fa6aca7d700 1 --2- 172.21.15.42:0/3420852217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6a81515d0 0x7fa6a81eca40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000eeb0 tx=0x7fa6a0009750 comp rx=0 tx=0).stop 2023-07-29T02:06:03.988 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.005+0000 7fa6aca7d700 1 -- 172.21.15.42:0/3420852217 shutdown_connections 2023-07-29T02:06:03.988 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.005+0000 7fa6aca7d700 1 --2- 172.21.15.42:0/3420852217 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fa68806a690 0x7fa68806cb40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.988 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.005+0000 7fa6aca7d700 1 --2- 172.21.15.42:0/3420852217 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fa6a81515d0 0x7fa6a81eca40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.006+0000 7fa6aca7d700 1 --2- 172.21.15.42:0/3420852217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa690005200 0x7fa6a8142e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.006+0000 7fa6aca7d700 1 --2- 172.21.15.42:0/3420852217 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fa6a81543d0 0x7fa6a81ec500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:03.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.006+0000 7fa6aca7d700 1 -- 172.21.15.42:0/3420852217 >> 172.21.15.42:0/3420852217 conn(0x7fa6a8061190 msgr2=0x7fa6a80cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:03.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.006+0000 7fa6aca7d700 1 -- 172.21.15.42:0/3420852217 shutdown_connections 2023-07-29T02:06:03.989 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.006+0000 7fa6aca7d700 1 -- 172.21.15.42:0/3420852217 wait complete. 2023-07-29T02:06:03.999 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-29T02:06:04.125 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.144+0000 7f3e0d7e2700 1 Processor -- start 2023-07-29T02:06:04.126 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.144+0000 7f3e0d7e2700 1 -- start start 2023-07-29T02:06:04.127 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.145+0000 7f3e0d7e2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e080c9bd0 0x7f3e081590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:04.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.145+0000 7f3e0d7e2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e080c91f0 0x7f3e081595e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:04.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.145+0000 7f3e0d7e2700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e080c68f0 con 0x7f3e081532e0 2023-07-29T02:06:04.128 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.145+0000 7f3e0d7e2700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e080cb2e0 con 0x7f3e080c91f0 2023-07-29T02:06:04.129 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.145+0000 7f3e0d7e2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e081536b0 con 0x7f3e080c9bd0 2023-07-29T02:06:04.129 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.145+0000 7f3e067fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e080c9bd0 0x7f3e081590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:04.129 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.145+0000 7f3e077fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e080c91f0 0x7f3e081595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:04.129 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.145+0000 7f3e067fc700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e080c9bd0 0x7f3e081590a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:58744/0 (socket says 172.21.15.42:58744) 2023-07-29T02:06:04.130 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.145+0000 7f3e077fe700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3e080c91f0 0x7f3e081595e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:41610/0 (socket says 172.21.15.42:41610) 2023-07-29T02:06:04.130 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.145+0000 7f3e067fc700 1 -- 172.21.15.42:0/1258222281 learned_addr learned my addr 172.21.15.42:0/1258222281 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:04.130 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.145+0000 7f3e077fe700 1 -- 172.21.15.42:0/1258222281 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e080c9bd0 msgr2=0x7f3e081590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:04.130 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.145+0000 7f3e077fe700 1 --2- 172.21.15.42:0/1258222281 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e080c9bd0 0x7f3e081590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:04.130 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.145+0000 7f3e077fe700 1 -- 172.21.15.42:0/1258222281 >> v1:172.21.15.144:6789/0 conn(0x7f3e081532e0 legacy=0x7f3e080cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:04.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.145+0000 7f3e077fe700 1 -- 172.21.15.42:0/1258222281 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e080ca130 con 0x7f3e080c91f0 2023-07-29T02:06:04.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.145+0000 7f3e067fc700 1 --2- 172.21.15.42:0/1258222281 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e080c9bd0 0x7f3e081590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:06:04.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.146+0000 7f3e077fe700 1 --2- 172.21.15.42:0/1258222281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e080c91f0 0x7f3e081595e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009d90 tx=0x7f3e0000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a7562187722aa70 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:04.131 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.146+0000 7f3e05ffb700 1 -- 172.21.15.42:0/1258222281 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0000e070 con 0x7f3e080c91f0 2023-07-29T02:06:04.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.146+0000 7f3e05ffb700 1 -- 172.21.15.42:0/1258222281 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0000bb20 con 0x7f3e080c91f0 2023-07-29T02:06:04.132 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.146+0000 7f3e05ffb700 1 -- 172.21.15.42:0/1258222281 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e00012430 con 0x7f3e080c91f0 2023-07-29T02:06:04.134 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.146+0000 7f3e0d7e2700 1 -- 172.21.15.42:0/1258222281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e080c91f0 msgr2=0x7f3e081595e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:04.135 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.146+0000 7f3e0d7e2700 1 --2- 172.21.15.42:0/1258222281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e080c91f0 0x7f3e081595e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009d90 tx=0x7f3e0000b330 comp rx=0 tx=0).stop 2023-07-29T02:06:04.135 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.146+0000 7f3e0d7e2700 1 -- 172.21.15.42:0/1258222281 shutdown_connections 2023-07-29T02:06:04.135 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.146+0000 7f3e0d7e2700 1 --2- 172.21.15.42:0/1258222281 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e080c91f0 0x7f3e081595e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:04.135 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.146+0000 7f3e0d7e2700 1 --2- 172.21.15.42:0/1258222281 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e080c9bd0 0x7f3e081590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:04.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.146+0000 7f3e0d7e2700 1 -- 172.21.15.42:0/1258222281 >> 172.21.15.42:0/1258222281 conn(0x7f3e08061190 msgr2=0x7f3e08061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:04.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.146+0000 7f3e0d7e2700 1 -- 172.21.15.42:0/1258222281 shutdown_connections 2023-07-29T02:06:04.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.146+0000 7f3e0d7e2700 1 -- 172.21.15.42:0/1258222281 wait complete. 2023-07-29T02:06:04.136 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.148+0000 7f3e0d7e2700 1 Processor -- start 2023-07-29T02:06:04.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.148+0000 7f3e0d7e2700 1 -- start start 2023-07-29T02:06:04.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.148+0000 7f3e0d7e2700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e080c91f0 0x7f3e081ef120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:04.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.148+0000 7f3e0d7e2700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e080c9bd0 0x7f3e080b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:04.137 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.148+0000 7f3e0d7e2700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e081532e0 0x7f3e081f2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:04.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.148+0000 7f3e0d7e2700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e080ce1b0 con 0x7f3e080c9bd0 2023-07-29T02:06:04.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.148+0000 7f3e0d7e2700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e080ce400 con 0x7f3e081532e0 2023-07-29T02:06:04.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.148+0000 7f3e0d7e2700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e080ce6e0 con 0x7f3e080c91f0 2023-07-29T02:06:04.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.149+0000 7f3e067fc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e080c9bd0 0x7f3e080b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:04.138 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.149+0000 7f3e067fc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e080c9bd0 0x7f3e080b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58236/0 (socket says 172.21.15.42:58236) 2023-07-29T02:06:04.139 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.149+0000 7f3e067fc700 1 -- 172.21.15.42:0/1930069781 learned_addr learned my addr 172.21.15.42:0/1930069781 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:04.139 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.149+0000 7f3e077fe700 1 --2- 172.21.15.42:0/1930069781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e081532e0 0x7f3e081f2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:04.139 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.149+0000 7f3e06ffd700 1 --2- 172.21.15.42:0/1930069781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e080c91f0 0x7f3e081ef120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:04.139 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.149+0000 7f3e067fc700 1 -- 172.21.15.42:0/1930069781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e080c91f0 msgr2=0x7f3e081ef120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:04.139 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.149+0000 7f3e067fc700 1 --2- 172.21.15.42:0/1930069781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e080c91f0 0x7f3e081ef120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:04.140 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.149+0000 7f3e067fc700 1 -- 172.21.15.42:0/1930069781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e081532e0 msgr2=0x7f3e081f2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:04.140 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.149+0000 7f3e067fc700 1 --2- 172.21.15.42:0/1930069781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e081532e0 0x7f3e081f2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:04.140 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.149+0000 7f3e067fc700 1 -- 172.21.15.42:0/1930069781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dfc009550 con 0x7f3e080c9bd0 2023-07-29T02:06:04.140 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.149+0000 7f3e067fc700 1 --2- 172.21.15.42:0/1930069781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e080c9bd0 0x7f3e080b34b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00ebe0 tx=0x7f3dfc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:04.141 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.149+0000 7f3def7fe700 1 -- 172.21.15.42:0/1930069781 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc00c850 con 0x7f3e080c9bd0 2023-07-29T02:06:04.141 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.149+0000 7f3def7fe700 1 -- 172.21.15.42:0/1930069781 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dfc00c9b0 con 0x7f3e080c9bd0 2023-07-29T02:06:04.141 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.149+0000 7f3e0d7e2700 1 -- 172.21.15.42:0/1930069781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e00009a70 con 0x7f3e080c9bd0 2023-07-29T02:06:04.141 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.149+0000 7f3def7fe700 1 -- 172.21.15.42:0/1930069781 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc00cd40 con 0x7f3e080c9bd0 2023-07-29T02:06:04.141 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.149+0000 7f3e0d7e2700 1 -- 172.21.15.42:0/1930069781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e081ee920 con 0x7f3e080c9bd0 2023-07-29T02:06:04.142 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.150+0000 7f3e0d7e2700 1 -- 172.21.15.42:0/1930069781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e0804ea50 con 0x7f3e080c9bd0 2023-07-29T02:06:04.142 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.151+0000 7f3def7fe700 1 -- 172.21.15.42:0/1930069781 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f3dfc013470 con 0x7f3e080c9bd0 2023-07-29T02:06:04.142 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.151+0000 7f3def7fe700 1 --2- 172.21.15.42:0/1930069781 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3df406a660 0x7f3df406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:04.142 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.151+0000 7f3def7fe700 1 -- 172.21.15.42:0/1930069781 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f3dfc089090 con 0x7f3e080c9bd0 2023-07-29T02:06:04.142 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.151+0000 7f3e06ffd700 1 --2- 172.21.15.42:0/1930069781 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3df406a660 0x7f3df406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:04.143 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.152+0000 7f3e06ffd700 1 --2- 172.21.15.42:0/1930069781 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3df406a660 0x7f3df406cb10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3df8007fd0 tx=0x7f3df8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:04.143 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.155+0000 7f3def7fe700 1 -- 172.21.15.42:0/1930069781 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f3dfc053fd0 con 0x7f3e080c9bd0 2023-07-29T02:06:04.349 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.368+0000 7f3e0d7e2700 1 -- 172.21.15.42:0/1930069781 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3e08156920 con 0x7f3e080c9bd0 2023-07-29T02:06:04.350 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.368+0000 7f3def7fe700 1 -- 172.21.15.42:0/1930069781 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v39) v1 ==== 80+0+368 (secure 0 0 0) 0x7f3dfc0575f0 con 0x7f3e080c9bd0 2023-07-29T02:06:04.351 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6836/2695599859 2023-07-30T02:04:19.439641+0000 2023-07-29T02:06:04.351 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6837/2695599859 2023-07-30T02:04:19.439641+0000 2023-07-29T02:06:04.351 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.144:6837/3824722756 2023-07-30T02:02:24.415811+0000 2023-07-29T02:06:04.351 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6836/1851767861 2023-07-30T02:01:34.406178+0000 2023-07-29T02:06:04.352 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.144:6839/3824722756 2023-07-30T02:02:24.415811+0000 2023-07-29T02:06:04.352 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42:6837/1851767861 2023-07-30T02:01:34.406178+0000 2023-07-29T02:06:04.353 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.370+0000 7f3e0d7e2700 1 -- 172.21.15.42:0/1930069781 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3df406a660 msgr2=0x7f3df406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:04.353 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.370+0000 7f3e0d7e2700 1 --2- 172.21.15.42:0/1930069781 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3df406a660 0x7f3df406cb10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3df8007fd0 tx=0x7f3df8009040 comp rx=0 tx=0).stop 2023-07-29T02:06:04.354 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.370+0000 7f3e0d7e2700 1 -- 172.21.15.42:0/1930069781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e080c9bd0 msgr2=0x7f3e080b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:04.354 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.370+0000 7f3e0d7e2700 1 --2- 172.21.15.42:0/1930069781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e080c9bd0 0x7f3e080b34b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc00ebe0 tx=0x7f3dfc00eef0 comp rx=0 tx=0).stop 2023-07-29T02:06:04.354 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.370+0000 7f3e0d7e2700 1 -- 172.21.15.42:0/1930069781 shutdown_connections 2023-07-29T02:06:04.354 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.370+0000 7f3e0d7e2700 1 --2- 172.21.15.42:0/1930069781 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3df406a660 0x7f3df406cb10 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:04.354 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.370+0000 7f3e0d7e2700 1 --2- 172.21.15.42:0/1930069781 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3e081532e0 0x7f3e081f2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:04.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.370+0000 7f3e0d7e2700 1 --2- 172.21.15.42:0/1930069781 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3e080c91f0 0x7f3e081ef120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:04.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.370+0000 7f3e0d7e2700 1 --2- 172.21.15.42:0/1930069781 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3e080c9bd0 0x7f3e080b34b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:04.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.370+0000 7f3e0d7e2700 1 -- 172.21.15.42:0/1930069781 >> 172.21.15.42:0/1930069781 conn(0x7f3e08061190 msgr2=0x7f3e08156d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:04.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.370+0000 7f3e0d7e2700 1 -- 172.21.15.42:0/1930069781 shutdown_connections 2023-07-29T02:06:04.355 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:04.370+0000 7f3e0d7e2700 1 -- 172.21.15.42:0/1930069781 wait complete. 2023-07-29T02:06:04.356 INFO:teuthology.orchestra.run.smithi042.stderr:listed 6 entries 2023-07-29T02:06:04.364 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-29T02:06:04.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:06:04.365 DEBUG:teuthology.orchestra.run.smithi042:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-29T02:06:07.277 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:06:07.286 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:06:18.765 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi042.front.sepia.ceph.com 2023-07-29T02:06:18.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:06:18.766 DEBUG:teuthology.orchestra.run.smithi042:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-29T02:06:18.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:06:18.788 DEBUG:teuthology.orchestra.run.smithi042:> ip netns list 2023-07-29T02:06:18.847 INFO:teuthology.orchestra.run.smithi042.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-29T02:06:18.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:06:18.848 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-29T02:06:18.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-29T02:06:18.938 DEBUG:teuthology.orchestra.run.smithi042:> sudo ip link delete ceph-brx 2023-07-29T02:06:19.035 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-07-29T02:06:19.045 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-29T02:06:19.045 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T02:06:19.173 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.191+0000 7f8d123a0700 1 Processor -- start 2023-07-29T02:06:19.173 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.191+0000 7f8d123a0700 1 -- start start 2023-07-29T02:06:19.175 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.192+0000 7f8d123a0700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8d0c0c6e50 0x7f8d0c0bfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:19.175 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.192+0000 7f8d123a0700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8d0c0c7220 0x7f8d0c155e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:19.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.192+0000 7f8d123a0700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d0c0b0f50 con 0x7f8d0c0c0dd0 2023-07-29T02:06:19.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.192+0000 7f8d123a0700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0c070900 con 0x7f8d0c0c7220 2023-07-29T02:06:19.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.192+0000 7f8d123a0700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0c156350 con 0x7f8d0c0c6e50 2023-07-29T02:06:19.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.192+0000 7f8d0b7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8d0c0c7220 0x7f8d0c155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:19.176 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.192+0000 7f8d0b7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f8d0c0c7220 0x7f8d0c155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58242/0 (socket says 172.21.15.42:58242) 2023-07-29T02:06:19.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.192+0000 7f8d0b7fe700 1 -- 172.21.15.42:0/618802231 learned_addr learned my addr 172.21.15.42:0/618802231 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:19.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.193+0000 7f8d0bfff700 1 --2- 172.21.15.42:0/618802231 >> v2:172.21.15.144:3300/0 conn(0x7f8d0c0c6e50 0x7f8d0c0bfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:19.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.193+0000 7f8d0b7fe700 1 -- 172.21.15.42:0/618802231 >> v2:172.21.15.144:3300/0 conn(0x7f8d0c0c6e50 msgr2=0x7f8d0c0bfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:19.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.193+0000 7f8d0b7fe700 1 --2- 172.21.15.42:0/618802231 >> v2:172.21.15.144:3300/0 conn(0x7f8d0c0c6e50 0x7f8d0c0bfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:19.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.193+0000 7f8d0b7fe700 1 -- 172.21.15.42:0/618802231 >> v1:172.21.15.144:6789/0 conn(0x7f8d0c0c0dd0 legacy=0x7f8d0c06cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:19.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.193+0000 7f8d0b7fe700 1 -- 172.21.15.42:0/618802231 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c06d320 con 0x7f8d0c0c7220 2023-07-29T02:06:19.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.193+0000 7f8d0b7fe700 1 --2- 172.21.15.42:0/618802231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0c0c7220 0x7f8d0c155e10 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0cb760 tx=0x7f8cf4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a108940df0648f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:19.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.193+0000 7f8d0affd700 1 -- 172.21.15.42:0/618802231 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf400b870 con 0x7f8d0c0c7220 2023-07-29T02:06:19.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.193+0000 7f8d0affd700 1 -- 172.21.15.42:0/618802231 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf400b9d0 con 0x7f8d0c0c7220 2023-07-29T02:06:19.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.193+0000 7f8d0affd700 1 -- 172.21.15.42:0/618802231 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf400bd60 con 0x7f8d0c0c7220 2023-07-29T02:06:19.179 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.194+0000 7f8d123a0700 1 -- 172.21.15.42:0/618802231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0c0c7220 msgr2=0x7f8d0c155e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:19.179 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.194+0000 7f8d123a0700 1 --2- 172.21.15.42:0/618802231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0c0c7220 0x7f8d0c155e10 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0cb760 tx=0x7f8cf4009bd0 comp rx=0 tx=0).stop 2023-07-29T02:06:19.179 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.194+0000 7f8d123a0700 1 -- 172.21.15.42:0/618802231 shutdown_connections 2023-07-29T02:06:19.179 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.194+0000 7f8d123a0700 1 --2- 172.21.15.42:0/618802231 >> v2:172.21.15.144:3300/0 conn(0x7f8d0c0c6e50 0x7f8d0c0bfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:19.179 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.194+0000 7f8d123a0700 1 --2- 172.21.15.42:0/618802231 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0c0c7220 0x7f8d0c155e10 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:19.180 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.194+0000 7f8d123a0700 1 -- 172.21.15.42:0/618802231 >> 172.21.15.42:0/618802231 conn(0x7f8d0c06b3e0 msgr2=0x7f8d0c0cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:19.180 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.194+0000 7f8d123a0700 1 -- 172.21.15.42:0/618802231 shutdown_connections 2023-07-29T02:06:19.180 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.194+0000 7f8d123a0700 1 -- 172.21.15.42:0/618802231 wait complete. 2023-07-29T02:06:19.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.195+0000 7f8d123a0700 1 Processor -- start 2023-07-29T02:06:19.182 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.195+0000 7f8d123a0700 1 -- start start 2023-07-29T02:06:19.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.196+0000 7f8d123a0700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d0c0c0dd0 0x7f8d0c1eeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:19.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.196+0000 7f8d123a0700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d0c0c6e50 0x7f8d0c0c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:19.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.196+0000 7f8d123a0700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0c0c7220 0x7f8d0c14d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:19.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.196+0000 7f8d123a0700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c14bec0 con 0x7f8d0c0c7220 2023-07-29T02:06:19.183 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.196+0000 7f8d123a0700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c0ca5e0 con 0x7f8d0c0c0dd0 2023-07-29T02:06:19.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.196+0000 7f8d123a0700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c0ca8c0 con 0x7f8d0c0c6e50 2023-07-29T02:06:19.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.196+0000 7f8d1093d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0c0c7220 0x7f8d0c14d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:19.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.196+0000 7f8d1093d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0c0c7220 0x7f8d0c14d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58252/0 (socket says 172.21.15.42:58252) 2023-07-29T02:06:19.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.196+0000 7f8d1093d700 1 -- 172.21.15.42:0/4118344411 learned_addr learned my addr 172.21.15.42:0/4118344411 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:19.184 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.196+0000 7f8d0b7fe700 1 --2- 172.21.15.42:0/4118344411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d0c0c6e50 0x7f8d0c0c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:19.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.196+0000 7f8d0bfff700 1 --2- 172.21.15.42:0/4118344411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d0c0c0dd0 0x7f8d0c1eeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:19.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.196+0000 7f8d1093d700 1 -- 172.21.15.42:0/4118344411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d0c0c6e50 msgr2=0x7f8d0c0c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:19.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.196+0000 7f8d1093d700 1 --2- 172.21.15.42:0/4118344411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d0c0c6e50 0x7f8d0c0c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:19.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.196+0000 7f8d1093d700 1 -- 172.21.15.42:0/4118344411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d0c0c0dd0 msgr2=0x7f8d0c1eeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:19.185 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.196+0000 7f8d1093d700 1 --2- 172.21.15.42:0/4118344411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d0c0c0dd0 0x7f8d0c1eeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:19.186 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.196+0000 7f8d1093d700 1 -- 172.21.15.42:0/4118344411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf4009550 con 0x7f8d0c0c7220 2023-07-29T02:06:19.186 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.196+0000 7f8d0b7fe700 1 --2- 172.21.15.42:0/4118344411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d0c0c6e50 0x7f8d0c0c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:06:19.186 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.196+0000 7f8d0bfff700 1 --2- 172.21.15.42:0/4118344411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d0c0c0dd0 0x7f8d0c1eeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:06:19.186 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.197+0000 7f8d1093d700 1 --2- 172.21.15.42:0/4118344411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0c0c7220 0x7f8d0c14d560 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400cb50 tx=0x7f8d0400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:19.186 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.197+0000 7f8d08ff9700 1 -- 172.21.15.42:0/4118344411 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d04003c00 con 0x7f8d0c0c7220 2023-07-29T02:06:19.187 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.197+0000 7f8d08ff9700 1 -- 172.21.15.42:0/4118344411 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d04003d60 con 0x7f8d0c0c7220 2023-07-29T02:06:19.187 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.197+0000 7f8d123a0700 1 -- 172.21.15.42:0/4118344411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d0c1f22a0 con 0x7f8d0c0c7220 2023-07-29T02:06:19.187 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.197+0000 7f8d08ff9700 1 -- 172.21.15.42:0/4118344411 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0400ab70 con 0x7f8d0c0c7220 2023-07-29T02:06:19.187 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.197+0000 7f8d123a0700 1 -- 172.21.15.42:0/4118344411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d0c1f2860 con 0x7f8d0c0c7220 2023-07-29T02:06:19.187 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.198+0000 7f8d123a0700 1 -- 172.21.15.42:0/4118344411 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0c1f2100 con 0x7f8d0c0c7220 2023-07-29T02:06:19.188 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.198+0000 7f8d08ff9700 1 -- 172.21.15.42:0/4118344411 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f8d0400acd0 con 0x7f8d0c0c7220 2023-07-29T02:06:19.188 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.199+0000 7f8d08ff9700 1 --2- 172.21.15.42:0/4118344411 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8cec06a630 0x7f8cec06cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:19.188 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.199+0000 7f8d08ff9700 1 -- 172.21.15.42:0/4118344411 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f8d04089000 con 0x7f8d0c0c7220 2023-07-29T02:06:19.188 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.199+0000 7f8d0bfff700 1 --2- 172.21.15.42:0/4118344411 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8cec06a630 0x7f8cec06cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:19.188 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.199+0000 7f8d0bfff700 1 --2- 172.21.15.42:0/4118344411 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8cec06a630 0x7f8cec06cae0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc009a00 tx=0x7f8cfc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:19.189 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.203+0000 7f8d08ff9700 1 -- 172.21.15.42:0/4118344411 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f8d0c1f2100 con 0x7f8d0c0c7220 2023-07-29T02:06:19.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.397+0000 7f8d123a0700 1 -- 172.21.15.42:0/4118344411 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8d0c0c0460 con 0x7f8cec06a630 2023-07-29T02:06:19.389 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.408+0000 7f8d08ff9700 1 -- 172.21.15.42:0/4118344411 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+396921 (secure 0 0 0) 0x7f8cfc009610 con 0x7f8cec06a630 2023-07-29T02:06:19.394 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:06:19.396 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.412+0000 7f8d123a0700 1 -- 172.21.15.42:0/4118344411 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8cec06a630 msgr2=0x7f8cec06cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:19.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.412+0000 7f8d123a0700 1 --2- 172.21.15.42:0/4118344411 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8cec06a630 0x7f8cec06cae0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc009a00 tx=0x7f8cfc008040 comp rx=0 tx=0).stop 2023-07-29T02:06:19.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.412+0000 7f8d123a0700 1 -- 172.21.15.42:0/4118344411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0c0c7220 msgr2=0x7f8d0c14d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:19.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.412+0000 7f8d123a0700 1 --2- 172.21.15.42:0/4118344411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0c0c7220 0x7f8d0c14d560 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400cb50 tx=0x7f8d0400cf10 comp rx=0 tx=0).stop 2023-07-29T02:06:19.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.412+0000 7f8d123a0700 1 -- 172.21.15.42:0/4118344411 shutdown_connections 2023-07-29T02:06:19.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.412+0000 7f8d123a0700 1 --2- 172.21.15.42:0/4118344411 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f8cec06a630 0x7f8cec06cae0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:19.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.412+0000 7f8d123a0700 1 --2- 172.21.15.42:0/4118344411 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8d0c0c7220 0x7f8d0c14d560 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:19.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.412+0000 7f8d123a0700 1 --2- 172.21.15.42:0/4118344411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8d0c0c0dd0 0x7f8d0c1eeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:19.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.412+0000 7f8d123a0700 1 --2- 172.21.15.42:0/4118344411 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f8d0c0c6e50 0x7f8d0c0c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:19.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.412+0000 7f8d123a0700 1 -- 172.21.15.42:0/4118344411 >> 172.21.15.42:0/4118344411 conn(0x7f8d0c06b3e0 msgr2=0x7f8d0c153d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:19.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.412+0000 7f8d123a0700 1 -- 172.21.15.42:0/4118344411 shutdown_connections 2023-07-29T02:06:19.399 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.412+0000 7f8d123a0700 1 -- 172.21.15.42:0/4118344411 wait complete. 2023-07-29T02:06:19.399 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2023-07-29T02:06:19.405 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2023-07-29T02:06:19.339590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1133187055,"num_objects":10297,"num_object_clones":0,"num_object_copies":40910,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10297,"num_whiteouts":0,"num_read":1674,"num_read_kb":517456,"num_write":24004,"num_write_kb":1256728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29227,"ondisk_log_size":29227,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2486732,"kb_used_data":1845388,"kb_used_omap":0,"kb_used_meta":641280,"kb_avail":752487988,"statfs":{"total":773094113280,"available":770547699712,"internally_reserved":0,"allocated":1889677312,"data_stored":2380556255,"data_compressed":176342060,"data_compressed_allocated":205963264,"data_compressed_original":698687488,"omap_allocated":0,"internal_metadata":656670720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":201304347,"num_objects":9970,"num_object_clones":0,"num_object_copies":39868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9970,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10105,"num_write_kb":201488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002566"},"pg_stats":[{"pgid":"4.3f","version":"35'78","reported_seq":2129,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.614917+0000","last_change":"2023-07-29T02:03:56.956160+0000","last_active":"2023-07-29T02:04:20.614917+0000","last_peered":"2023-07-29T02:04:20.614917+0000","last_clean":"2023-07-29T02:04:20.614917+0000","last_became_active":"2023-07-29T01:59:57.957742+0000","last_became_peered":"2023-07-29T01:59:57.957742+0000","last_unstale":"2023-07-29T02:04:20.614917+0000","last_undegraded":"2023-07-29T02:04:20.614917+0000","last_fullsized":"2023-07-29T02:04:20.614917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:32.550358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46739399700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"39'71","reported_seq":2122,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.634369+0000","last_change":"2023-07-29T02:03:56.795813+0000","last_active":"2023-07-29T02:04:47.634369+0000","last_peered":"2023-07-29T02:04:47.634369+0000","last_clean":"2023-07-29T02:04:47.634369+0000","last_became_active":"2023-07-29T01:59:57.974338+0000","last_became_peered":"2023-07-29T01:59:57.974338+0000","last_unstale":"2023-07-29T02:04:47.634369+0000","last_undegraded":"2023-07-29T02:04:47.634369+0000","last_fullsized":"2023-07-29T02:04:47.634369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30630966300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"36'83","reported_seq":2134,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.979284+0000","last_change":"2023-07-29T02:03:57.108039+0000","last_active":"2023-07-29T02:04:21.979284+0000","last_peered":"2023-07-29T02:04:21.979284+0000","last_clean":"2023-07-29T02:04:21.979284+0000","last_became_active":"2023-07-29T01:59:57.973406+0000","last_became_peered":"2023-07-29T01:59:57.973406+0000","last_unstale":"2023-07-29T02:04:21.979284+0000","last_undegraded":"2023-07-29T02:04:21.979284+0000","last_fullsized":"2023-07-29T02:04:21.979284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:08:23.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37359432399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"37'67","reported_seq":2118,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.446364+0000","last_change":"2023-07-29T02:03:56.955565+0000","last_active":"2023-07-29T02:04:19.446364+0000","last_peered":"2023-07-29T02:04:19.446364+0000","last_clean":"2023-07-29T02:04:19.446364+0000","last_became_active":"2023-07-29T01:59:57.964865+0000","last_became_peered":"2023-07-29T01:59:57.964865+0000","last_unstale":"2023-07-29T02:04:19.446364+0000","last_undegraded":"2023-07-29T02:04:19.446364+0000","last_fullsized":"2023-07-29T02:04:19.446364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:32.905717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22913951599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"35'98","reported_seq":2148,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.413848+0000","last_change":"2023-07-29T02:03:57.038137+0000","last_active":"2023-07-29T02:04:20.413848+0000","last_peered":"2023-07-29T02:04:20.413848+0000","last_clean":"2023-07-29T02:04:20.413848+0000","last_became_active":"2023-07-29T01:59:57.970733+0000","last_became_peered":"2023-07-29T01:59:57.970733+0000","last_unstale":"2023-07-29T02:04:20.413848+0000","last_undegraded":"2023-07-29T02:04:20.413848+0000","last_fullsized":"2023-07-29T02:04:20.413848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55358088100000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"35'86","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.978766+0000","last_change":"2023-07-29T02:03:57.111935+0000","last_active":"2023-07-29T02:04:21.978766+0000","last_peered":"2023-07-29T02:04:21.978766+0000","last_clean":"2023-07-29T02:04:21.978766+0000","last_became_active":"2023-07-29T01:59:57.964993+0000","last_became_peered":"2023-07-29T01:59:57.964993+0000","last_unstale":"2023-07-29T02:04:21.978766+0000","last_undegraded":"2023-07-29T02:04:21.978766+0000","last_fullsized":"2023-07-29T02:04:21.978766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35033357399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"39'100","reported_seq":2150,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.633716+0000","last_change":"2023-07-29T02:03:56.697037+0000","last_active":"2023-07-29T02:04:47.633716+0000","last_peered":"2023-07-29T02:04:47.633716+0000","last_clean":"2023-07-29T02:04:47.633716+0000","last_became_active":"2023-07-29T01:59:57.970232+0000","last_became_peered":"2023-07-29T01:59:57.970232+0000","last_unstale":"2023-07-29T02:04:47.633716+0000","last_undegraded":"2023-07-29T02:04:47.633716+0000","last_fullsized":"2023-07-29T02:04:47.633716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18952802499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"36'65","reported_seq":2115,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.815684+0000","last_change":"2023-07-29T02:03:56.788754+0000","last_active":"2023-07-29T02:04:21.815684+0000","last_peered":"2023-07-29T02:04:21.815684+0000","last_clean":"2023-07-29T02:04:21.815684+0000","last_became_active":"2023-07-29T01:59:57.962884+0000","last_became_peered":"2023-07-29T01:59:57.962884+0000","last_unstale":"2023-07-29T02:04:21.815684+0000","last_undegraded":"2023-07-29T02:04:21.815684+0000","last_fullsized":"2023-07-29T02:04:21.815684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30152641200000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"39'73","reported_seq":2123,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.635152+0000","last_change":"2023-07-29T02:03:57.034522+0000","last_active":"2023-07-29T02:04:47.635152+0000","last_peered":"2023-07-29T02:04:47.635152+0000","last_clean":"2023-07-29T02:04:47.635152+0000","last_became_active":"2023-07-29T01:59:57.971640+0000","last_became_peered":"2023-07-29T01:59:57.971640+0000","last_unstale":"2023-07-29T02:04:47.635152+0000","last_undegraded":"2023-07-29T02:04:47.635152+0000","last_fullsized":"2023-07-29T02:04:47.635152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54966345000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'83","reported_seq":2133,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.816709+0000","last_change":"2023-07-29T02:03:56.796189+0000","last_active":"2023-07-29T02:04:21.816709+0000","last_peered":"2023-07-29T02:04:21.816709+0000","last_clean":"2023-07-29T02:04:21.816709+0000","last_became_active":"2023-07-29T01:59:57.962799+0000","last_became_peered":"2023-07-29T01:59:57.962799+0000","last_unstale":"2023-07-29T02:04:21.816709+0000","last_undegraded":"2023-07-29T02:04:21.816709+0000","last_fullsized":"2023-07-29T02:04:21.816709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30635943199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"35'84","reported_seq":2134,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.979809+0000","last_change":"2023-07-29T02:03:57.107266+0000","last_active":"2023-07-29T02:04:21.979809+0000","last_peered":"2023-07-29T02:04:21.979809+0000","last_clean":"2023-07-29T02:04:21.979809+0000","last_became_active":"2023-07-29T01:59:57.969868+0000","last_became_peered":"2023-07-29T01:59:57.969868+0000","last_unstale":"2023-07-29T02:04:21.979809+0000","last_undegraded":"2023-07-29T02:04:21.979809+0000","last_fullsized":"2023-07-29T02:04:21.979809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37294171199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"36'69","reported_seq":2119,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.614635+0000","last_change":"2023-07-29T02:03:56.957883+0000","last_active":"2023-07-29T02:04:20.614635+0000","last_peered":"2023-07-29T02:04:20.614635+0000","last_clean":"2023-07-29T02:04:20.614635+0000","last_became_active":"2023-07-29T01:59:57.963902+0000","last_became_peered":"2023-07-29T01:59:57.963902+0000","last_unstale":"2023-07-29T02:04:20.614635+0000","last_undegraded":"2023-07-29T02:04:20.614635+0000","last_fullsized":"2023-07-29T02:04:20.614635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:51.691001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46909700500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"36'71","reported_seq":2121,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.613803+0000","last_change":"2023-07-29T02:03:56.954586+0000","last_active":"2023-07-29T02:04:20.613803+0000","last_peered":"2023-07-29T02:04:20.613803+0000","last_clean":"2023-07-29T02:04:20.613803+0000","last_became_active":"2023-07-29T01:59:57.963239+0000","last_became_peered":"2023-07-29T01:59:57.963239+0000","last_unstale":"2023-07-29T02:04:20.613803+0000","last_undegraded":"2023-07-29T02:04:20.613803+0000","last_fullsized":"2023-07-29T02:04:20.613803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:08.001986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46603159700000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"39'85","reported_seq":2135,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:39.452612+0000","last_change":"2023-07-29T02:03:56.789592+0000","last_active":"2023-07-29T02:04:39.452612+0000","last_peered":"2023-07-29T02:04:39.452612+0000","last_clean":"2023-07-29T02:04:39.452612+0000","last_became_active":"2023-07-29T01:59:57.960709+0000","last_became_peered":"2023-07-29T01:59:57.960709+0000","last_unstale":"2023-07-29T02:04:39.452612+0000","last_undegraded":"2023-07-29T02:04:39.452612+0000","last_fullsized":"2023-07-29T02:04:39.452612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30181124199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"35'78","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444090+0000","last_change":"2023-07-29T02:03:56.696099+0000","last_active":"2023-07-29T02:04:19.444090+0000","last_peered":"2023-07-29T02:04:19.444090+0000","last_clean":"2023-07-29T02:04:19.444090+0000","last_became_active":"2023-07-29T01:59:57.970263+0000","last_became_peered":"2023-07-29T01:59:57.970263+0000","last_unstale":"2023-07-29T02:04:19.444090+0000","last_undegraded":"2023-07-29T02:04:19.444090+0000","last_fullsized":"2023-07-29T02:04:19.444090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18892089500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"39'88","reported_seq":2138,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:39.442116+0000","last_change":"2023-07-29T02:03:57.113982+0000","last_active":"2023-07-29T02:04:39.442116+0000","last_peered":"2023-07-29T02:04:39.442116+0000","last_clean":"2023-07-29T02:04:39.442116+0000","last_became_active":"2023-07-29T01:59:57.964696+0000","last_became_peered":"2023-07-29T01:59:57.964696+0000","last_unstale":"2023-07-29T02:04:39.442116+0000","last_undegraded":"2023-07-29T02:04:39.442116+0000","last_fullsized":"2023-07-29T02:04:39.442116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:19:14.641252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.32990576199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"39'86","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:39.436873+0000","last_change":"2023-07-29T02:03:57.029741+0000","last_active":"2023-07-29T02:04:39.436873+0000","last_peered":"2023-07-29T02:04:39.436873+0000","last_clean":"2023-07-29T02:04:39.436873+0000","last_became_active":"2023-07-29T01:59:57.968885+0000","last_became_peered":"2023-07-29T01:59:57.968885+0000","last_unstale":"2023-07-29T02:04:39.436873+0000","last_undegraded":"2023-07-29T02:04:39.436873+0000","last_fullsized":"2023-07-29T02:04:39.436873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54488360899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"36'78","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.979073+0000","last_change":"2023-07-29T02:03:57.081083+0000","last_active":"2023-07-29T02:04:21.979073+0000","last_peered":"2023-07-29T02:04:21.979073+0000","last_clean":"2023-07-29T02:04:21.979073+0000","last_became_active":"2023-07-29T01:59:57.962919+0000","last_became_peered":"2023-07-29T01:59:57.962919+0000","last_unstale":"2023-07-29T02:04:21.979073+0000","last_undegraded":"2023-07-29T02:04:21.979073+0000","last_fullsized":"2023-07-29T02:04:21.979073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:16:58.718803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36591080100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"35'78","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.614282+0000","last_change":"2023-07-29T02:03:56.960427+0000","last_active":"2023-07-29T02:04:20.614282+0000","last_peered":"2023-07-29T02:04:20.614282+0000","last_clean":"2023-07-29T02:04:20.614282+0000","last_became_active":"2023-07-29T01:59:57.960111+0000","last_became_peered":"2023-07-29T01:59:57.960111+0000","last_unstale":"2023-07-29T02:04:20.614282+0000","last_undegraded":"2023-07-29T02:04:20.614282+0000","last_fullsized":"2023-07-29T02:04:20.614282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:45.956813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.47199195399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"39'90","reported_seq":2140,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:29.440975+0000","last_change":"2023-07-29T02:03:57.111175+0000","last_active":"2023-07-29T02:04:29.440975+0000","last_peered":"2023-07-29T02:04:29.440975+0000","last_clean":"2023-07-29T02:04:29.440975+0000","last_became_active":"2023-07-29T01:59:57.961655+0000","last_became_peered":"2023-07-29T01:59:57.961655+0000","last_unstale":"2023-07-29T02:04:29.440975+0000","last_undegraded":"2023-07-29T02:04:29.440975+0000","last_fullsized":"2023-07-29T02:04:29.440975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.203628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36267924800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"39'78","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:29.440537+0000","last_change":"2023-07-29T02:03:56.694890+0000","last_active":"2023-07-29T02:04:29.440537+0000","last_peered":"2023-07-29T02:04:29.440537+0000","last_clean":"2023-07-29T02:04:29.440537+0000","last_became_active":"2023-07-29T01:59:57.970757+0000","last_became_peered":"2023-07-29T01:59:57.970757+0000","last_unstale":"2023-07-29T02:04:29.440537+0000","last_undegraded":"2023-07-29T02:04:29.440537+0000","last_fullsized":"2023-07-29T02:04:29.440537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18738185399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"39'85","reported_seq":2135,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.636550+0000","last_change":"2023-07-29T02:03:57.025876+0000","last_active":"2023-07-29T02:04:47.636550+0000","last_peered":"2023-07-29T02:04:47.636550+0000","last_clean":"2023-07-29T02:04:47.636550+0000","last_became_active":"2023-07-29T01:59:57.974436+0000","last_became_peered":"2023-07-29T01:59:57.974436+0000","last_unstale":"2023-07-29T02:04:47.636550+0000","last_undegraded":"2023-07-29T02:04:47.636550+0000","last_fullsized":"2023-07-29T02:04:47.636550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54184882499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"35'84","reported_seq":2134,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.443274+0000","last_change":"2023-07-29T02:03:57.173218+0000","last_active":"2023-07-29T02:04:19.443274+0000","last_peered":"2023-07-29T02:04:19.443274+0000","last_clean":"2023-07-29T02:04:19.443274+0000","last_became_active":"2023-07-29T01:59:57.966987+0000","last_became_peered":"2023-07-29T01:59:57.966987+0000","last_unstale":"2023-07-29T02:04:19.443274+0000","last_undegraded":"2023-07-29T02:04:19.443274+0000","last_fullsized":"2023-07-29T02:04:19.443274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38162062000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"39'86","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.632776+0000","last_change":"2023-07-29T02:03:56.697590+0000","last_active":"2023-07-29T02:04:47.632776+0000","last_peered":"2023-07-29T02:04:47.632776+0000","last_clean":"2023-07-29T02:04:47.632776+0000","last_became_active":"2023-07-29T01:59:57.971733+0000","last_became_peered":"2023-07-29T01:59:57.971733+0000","last_unstale":"2023-07-29T02:04:47.632776+0000","last_undegraded":"2023-07-29T02:04:47.632776+0000","last_fullsized":"2023-07-29T02:04:47.632776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.189164111,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"36'81","reported_seq":2131,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.433572+0000","last_change":"2023-07-29T02:03:57.054022+0000","last_active":"2023-07-29T02:04:19.433572+0000","last_peered":"2023-07-29T02:04:19.433572+0000","last_clean":"2023-07-29T02:04:19.433572+0000","last_became_active":"2023-07-29T01:59:57.969742+0000","last_became_peered":"2023-07-29T01:59:57.969742+0000","last_unstale":"2023-07-29T02:04:19.433572+0000","last_undegraded":"2023-07-29T02:04:19.433572+0000","last_fullsized":"2023-07-29T02:04:19.433572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53981922100000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"35'94","reported_seq":2144,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.433559+0000","last_change":"2023-07-29T02:03:57.052073+0000","last_active":"2023-07-29T02:04:19.433559+0000","last_peered":"2023-07-29T02:04:19.433559+0000","last_clean":"2023-07-29T02:04:19.433559+0000","last_became_active":"2023-07-29T01:59:57.969409+0000","last_became_peered":"2023-07-29T01:59:57.969409+0000","last_unstale":"2023-07-29T02:04:19.433559+0000","last_undegraded":"2023-07-29T02:04:19.433559+0000","last_fullsized":"2023-07-29T02:04:19.433559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53315132300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"39'68","reported_seq":2118,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.816142+0000","last_change":"2023-07-29T02:03:56.792528+0000","last_active":"2023-07-29T02:04:21.816142+0000","last_peered":"2023-07-29T02:04:21.816142+0000","last_clean":"2023-07-29T02:04:21.816142+0000","last_became_active":"2023-07-29T01:59:57.963774+0000","last_became_peered":"2023-07-29T01:59:57.963774+0000","last_unstale":"2023-07-29T02:04:21.816142+0000","last_undegraded":"2023-07-29T02:04:21.816142+0000","last_fullsized":"2023-07-29T02:04:21.816142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30426659299999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"39'632","reported_seq":2711,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.903446+0000","last_change":"2023-07-29T02:03:57.112265+0000","last_active":"2023-07-29T02:06:07.903446+0000","last_peered":"2023-07-29T02:06:07.903446+0000","last_clean":"2023-07-29T02:06:07.903446+0000","last_became_active":"2023-07-29T02:00:01.993731+0000","last_became_peered":"2023-07-29T02:00:01.993731+0000","last_unstale":"2023-07-29T02:06:07.903446+0000","last_undegraded":"2023-07-29T02:06:07.903446+0000","last_fullsized":"2023-07-29T02:06:07.903446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:14:25.422754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35725884499999999,"stat_sum":{"num_bytes":48336376,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":31,"num_read_kb":16407,"num_write":630,"num_write_kb":51633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"39'156","reported_seq":190,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:08.990208+0000","last_change":"2023-07-29T01:59:57.552913+0000","last_active":"2023-07-29T02:06:08.990208+0000","last_peered":"2023-07-29T02:06:08.990208+0000","last_clean":"2023-07-29T02:06:08.990208+0000","last_became_active":"2023-07-29T01:59:57.552673+0000","last_became_peered":"2023-07-29T01:59:57.552673+0000","last_unstale":"2023-07-29T02:06:08.990208+0000","last_undegraded":"2023-07-29T02:06:08.990208+0000","last_fullsized":"2023-07-29T02:06:08.990208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:49:56.335019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":154,"num_write_kb":16499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"39'75","reported_seq":2125,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:50.633095+0000","last_change":"2023-07-29T02:03:57.172635+0000","last_active":"2023-07-29T02:04:50.633095+0000","last_peered":"2023-07-29T02:04:50.633095+0000","last_clean":"2023-07-29T02:04:50.633095+0000","last_became_active":"2023-07-29T01:59:57.969821+0000","last_became_peered":"2023-07-29T01:59:57.969821+0000","last_unstale":"2023-07-29T02:04:50.633095+0000","last_undegraded":"2023-07-29T02:04:50.633095+0000","last_fullsized":"2023-07-29T02:04:50.633095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.40087768200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'628","reported_seq":2717,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.103880+0000","last_change":"2023-07-29T02:03:56.981521+0000","last_active":"2023-07-29T02:06:07.103880+0000","last_peered":"2023-07-29T02:06:07.103880+0000","last_clean":"2023-07-29T02:06:07.103880+0000","last_became_active":"2023-07-29T02:00:01.992338+0000","last_became_peered":"2023-07-29T02:00:01.992338+0000","last_unstale":"2023-07-29T02:06:07.103880+0000","last_undegraded":"2023-07-29T02:06:07.103880+0000","last_fullsized":"2023-07-29T02:06:07.103880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:37.968145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20956234600000001,"stat_sum":{"num_bytes":44446362,"num_objects":309,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":41,"num_read_kb":16418,"num_write":628,"num_write_kb":43687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"39'20","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:49.437568+0000","last_change":"2023-07-29T01:59:57.547793+0000","last_active":"2023-07-29T02:04:49.437568+0000","last_peered":"2023-07-29T02:04:49.437568+0000","last_clean":"2023-07-29T02:04:49.437568+0000","last_became_active":"2023-07-29T01:59:57.547455+0000","last_became_peered":"2023-07-29T01:59:57.547455+0000","last_unstale":"2023-07-29T02:04:49.437568+0000","last_undegraded":"2023-07-29T02:04:49.437568+0000","last_fullsized":"2023-07-29T02:04:49.437568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":4125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"35'87","reported_seq":2138,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.413318+0000","last_change":"2023-07-29T02:03:57.037080+0000","last_active":"2023-07-29T02:04:20.413318+0000","last_peered":"2023-07-29T02:04:20.413318+0000","last_clean":"2023-07-29T02:04:20.413318+0000","last_became_active":"2023-07-29T01:59:57.964393+0000","last_became_peered":"2023-07-29T01:59:57.964393+0000","last_unstale":"2023-07-29T02:04:20.413318+0000","last_undegraded":"2023-07-29T02:04:20.413318+0000","last_fullsized":"2023-07-29T02:04:20.413318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55267013499999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"39'624","reported_seq":2705,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.294411+0000","last_change":"2023-07-29T02:03:57.037730+0000","last_active":"2023-07-29T02:06:07.294411+0000","last_peered":"2023-07-29T02:06:07.294411+0000","last_clean":"2023-07-29T02:06:07.294411+0000","last_became_active":"2023-07-29T02:00:01.982042+0000","last_became_peered":"2023-07-29T02:00:01.982042+0000","last_unstale":"2023-07-29T02:06:07.294411+0000","last_undegraded":"2023-07-29T02:06:07.294411+0000","last_fullsized":"2023-07-29T02:06:07.294411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55323541600000004,"stat_sum":{"num_bytes":17887936,"num_objects":308,"num_object_clones":0,"num_object_copies":1232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":308,"num_whiteouts":0,"num_read":32,"num_read_kb":5104,"num_write":624,"num_write_kb":17797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"39'130","reported_seq":163,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.544484+0000","last_change":"2023-07-29T01:59:57.535286+0000","last_active":"2023-07-29T02:05:51.544484+0000","last_peered":"2023-07-29T02:05:51.544484+0000","last_clean":"2023-07-29T02:05:51.544484+0000","last_became_active":"2023-07-29T01:59:57.533523+0000","last_became_peered":"2023-07-29T01:59:57.533523+0000","last_unstale":"2023-07-29T02:05:51.544484+0000","last_undegraded":"2023-07-29T02:05:51.544484+0000","last_fullsized":"2023-07-29T02:05:51.544484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":129,"num_write_kb":12373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"36'81","reported_seq":2132,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.445928+0000","last_change":"2023-07-29T02:03:56.982121+0000","last_active":"2023-07-29T02:04:19.445928+0000","last_peered":"2023-07-29T02:04:19.445928+0000","last_clean":"2023-07-29T02:04:19.445928+0000","last_became_active":"2023-07-29T01:59:57.963466+0000","last_became_peered":"2023-07-29T01:59:57.963466+0000","last_unstale":"2023-07-29T02:04:19.445928+0000","last_undegraded":"2023-07-29T02:04:19.445928+0000","last_fullsized":"2023-07-29T02:04:19.445928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:28.048947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.209911193,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"39'697","reported_seq":2784,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.146401+0000","last_change":"2023-07-29T02:03:56.977076+0000","last_active":"2023-07-29T02:06:07.146401+0000","last_peered":"2023-07-29T02:06:07.146401+0000","last_clean":"2023-07-29T02:06:07.146401+0000","last_became_active":"2023-07-29T02:00:01.984000+0000","last_became_peered":"2023-07-29T02:00:01.984000+0000","last_unstale":"2023-07-29T02:06:07.146401+0000","last_undegraded":"2023-07-29T02:06:07.146401+0000","last_fullsized":"2023-07-29T02:06:07.146401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.218444052,"stat_sum":{"num_bytes":33480822,"num_objects":367,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":39,"num_read_kb":11040,"num_write":700,"num_write_kb":41165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"39'3","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:49.438002+0000","last_change":"2023-07-29T01:59:57.537082+0000","last_active":"2023-07-29T02:04:49.438002+0000","last_peered":"2023-07-29T02:04:49.438002+0000","last_clean":"2023-07-29T02:04:49.438002+0000","last_became_active":"2023-07-29T01:59:57.536732+0000","last_became_peered":"2023-07-29T01:59:57.536732+0000","last_unstale":"2023-07-29T02:04:49.438002+0000","last_undegraded":"2023-07-29T02:04:49.438002+0000","last_fullsized":"2023-07-29T02:04:49.438002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"39'82","reported_seq":2132,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:39.451721+0000","last_change":"2023-07-29T02:03:57.174184+0000","last_active":"2023-07-29T02:04:39.451721+0000","last_peered":"2023-07-29T02:04:39.451721+0000","last_clean":"2023-07-29T02:04:39.451721+0000","last_became_active":"2023-07-29T01:59:57.970902+0000","last_became_peered":"2023-07-29T01:59:57.970902+0000","last_unstale":"2023-07-29T02:04:39.451721+0000","last_undegraded":"2023-07-29T02:04:39.451721+0000","last_fullsized":"2023-07-29T02:04:39.451721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.3723399,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'665","reported_seq":2750,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.428896+0000","last_change":"2023-07-29T02:03:56.697947+0000","last_active":"2023-07-29T02:06:07.428896+0000","last_peered":"2023-07-29T02:06:07.428896+0000","last_clean":"2023-07-29T02:06:07.428896+0000","last_became_active":"2023-07-29T02:00:01.989456+0000","last_became_peered":"2023-07-29T02:00:01.989456+0000","last_unstale":"2023-07-29T02:06:07.428896+0000","last_undegraded":"2023-07-29T02:06:07.428896+0000","last_fullsized":"2023-07-29T02:06:07.428896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.189839176,"stat_sum":{"num_bytes":37359948,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":38,"num_read_kb":16417,"num_write":659,"num_write_kb":40721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"39'35","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:10.160718+0000","last_change":"2023-07-29T01:59:57.540572+0000","last_active":"2023-07-29T02:06:10.160718+0000","last_peered":"2023-07-29T02:06:10.160718+0000","last_clean":"2023-07-29T02:06:10.160718+0000","last_became_active":"2023-07-29T01:59:57.540113+0000","last_became_peered":"2023-07-29T01:59:57.540113+0000","last_unstale":"2023-07-29T02:06:10.160718+0000","last_undegraded":"2023-07-29T02:06:10.160718+0000","last_fullsized":"2023-07-29T02:06:10.160718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":31,"num_write_kb":12312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"39'85","reported_seq":2135,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:39.451754+0000","last_change":"2023-07-29T02:03:57.171853+0000","last_active":"2023-07-29T02:04:39.451754+0000","last_peered":"2023-07-29T02:04:39.451754+0000","last_clean":"2023-07-29T02:04:39.451754+0000","last_became_active":"2023-07-29T01:59:57.967083+0000","last_became_peered":"2023-07-29T01:59:57.967083+0000","last_unstale":"2023-07-29T02:04:39.451754+0000","last_undegraded":"2023-07-29T02:04:39.451754+0000","last_fullsized":"2023-07-29T02:04:39.451754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38037237200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"39'632","reported_seq":2724,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:06.764691+0000","last_change":"2023-07-29T02:03:57.161825+0000","last_active":"2023-07-29T02:06:06.764691+0000","last_peered":"2023-07-29T02:06:06.764691+0000","last_clean":"2023-07-29T02:06:06.764691+0000","last_became_active":"2023-07-29T02:00:01.996035+0000","last_became_peered":"2023-07-29T02:00:01.996035+0000","last_unstale":"2023-07-29T02:06:06.764691+0000","last_undegraded":"2023-07-29T02:06:06.764691+0000","last_fullsized":"2023-07-29T02:06:06.764691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.39874443399999998,"stat_sum":{"num_bytes":20875244,"num_objects":313,"num_object_clones":0,"num_object_copies":1252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":44,"num_read_kb":4139,"num_write":632,"num_write_kb":28878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"39'67","reported_seq":107,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:12.525117+0000","last_change":"2023-07-29T01:59:57.548665+0000","last_active":"2023-07-29T02:06:12.525117+0000","last_peered":"2023-07-29T02:06:12.525117+0000","last_clean":"2023-07-29T02:06:12.525117+0000","last_became_active":"2023-07-29T01:59:57.547803+0000","last_became_peered":"2023-07-29T01:59:57.547803+0000","last_unstale":"2023-07-29T02:06:12.525117+0000","last_undegraded":"2023-07-29T02:06:12.525117+0000","last_fullsized":"2023-07-29T02:06:12.525117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":4114,"num_write":65,"num_write_kb":8245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"35'76","reported_seq":2126,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.926154+0000","last_change":"2023-07-29T02:03:57.049617+0000","last_active":"2023-07-29T02:04:21.926154+0000","last_peered":"2023-07-29T02:04:21.926154+0000","last_clean":"2023-07-29T02:04:21.926154+0000","last_became_active":"2023-07-29T01:59:57.969006+0000","last_became_peered":"2023-07-29T01:59:57.969006+0000","last_unstale":"2023-07-29T02:04:21.926154+0000","last_undegraded":"2023-07-29T02:04:21.926154+0000","last_fullsized":"2023-07-29T02:04:21.926154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:30:28.393515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53746501300000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"39'641","reported_seq":2734,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.766377+0000","last_change":"2023-07-29T02:03:57.052276+0000","last_active":"2023-07-29T02:06:07.766377+0000","last_peered":"2023-07-29T02:06:07.766377+0000","last_clean":"2023-07-29T02:06:07.766377+0000","last_became_active":"2023-07-29T02:00:01.995757+0000","last_became_peered":"2023-07-29T02:00:01.995757+0000","last_unstale":"2023-07-29T02:06:07.766377+0000","last_undegraded":"2023-07-29T02:06:07.766377+0000","last_fullsized":"2023-07-29T02:06:07.766377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:24:03.881006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.539926876,"stat_sum":{"num_bytes":20101741,"num_objects":314,"num_object_clones":0,"num_object_copies":1256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":45,"num_read_kb":20517,"num_write":638,"num_write_kb":32247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"39'124","reported_seq":173,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:48.029338+0000","last_change":"2023-07-29T01:59:57.541936+0000","last_active":"2023-07-29T02:05:48.029338+0000","last_peered":"2023-07-29T02:05:48.029338+0000","last_clean":"2023-07-29T02:05:48.029338+0000","last_became_active":"2023-07-29T01:59:57.541434+0000","last_became_peered":"2023-07-29T01:59:57.541434+0000","last_unstale":"2023-07-29T02:05:48.029338+0000","last_undegraded":"2023-07-29T02:05:48.029338+0000","last_fullsized":"2023-07-29T02:05:48.029338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":12324,"num_write":118,"num_write_kb":12357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"35'86","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.979595+0000","last_change":"2023-07-29T02:03:57.112781+0000","last_active":"2023-07-29T02:04:21.979595+0000","last_peered":"2023-07-29T02:04:21.979595+0000","last_clean":"2023-07-29T02:04:21.979595+0000","last_became_active":"2023-07-29T01:59:57.962459+0000","last_became_peered":"2023-07-29T01:59:57.962459+0000","last_unstale":"2023-07-29T02:04:21.979595+0000","last_undegraded":"2023-07-29T02:04:21.979595+0000","last_fullsized":"2023-07-29T02:04:21.979595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.34937986999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'591","reported_seq":2679,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.695555+0000","last_change":"2023-07-29T02:03:56.797439+0000","last_active":"2023-07-29T02:06:07.695555+0000","last_peered":"2023-07-29T02:06:07.695555+0000","last_clean":"2023-07-29T02:06:07.695555+0000","last_became_active":"2023-07-29T02:00:01.995827+0000","last_became_peered":"2023-07-29T02:00:01.995827+0000","last_unstale":"2023-07-29T02:06:07.695555+0000","last_undegraded":"2023-07-29T02:06:07.695555+0000","last_fullsized":"2023-07-29T02:06:07.695555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30893240100000002,"stat_sum":{"num_bytes":24035129,"num_objects":268,"num_object_clones":0,"num_object_copies":1072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":40,"num_read_kb":8228,"num_write":590,"num_write_kb":23787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"39'12","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.543460+0000","last_change":"2023-07-29T01:59:57.545705+0000","last_active":"2023-07-29T02:05:51.543460+0000","last_peered":"2023-07-29T02:05:51.543460+0000","last_clean":"2023-07-29T02:05:51.543460+0000","last_became_active":"2023-07-29T01:59:57.545406+0000","last_became_peered":"2023-07-29T01:59:57.545406+0000","last_unstale":"2023-07-29T02:05:51.543460+0000","last_undegraded":"2023-07-29T02:05:51.543460+0000","last_fullsized":"2023-07-29T02:05:51.543460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:31.903601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":8216,"num_write":11,"num_write_kb":8201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"39'75","reported_seq":2119,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:50.633311+0000","last_change":"2023-07-29T02:03:56.957227+0000","last_active":"2023-07-29T02:04:50.633311+0000","last_peered":"2023-07-29T02:04:50.633311+0000","last_clean":"2023-07-29T02:04:50.633311+0000","last_became_active":"2023-07-29T02:00:46.525331+0000","last_became_peered":"2023-07-29T02:00:46.525331+0000","last_unstale":"2023-07-29T02:04:50.633311+0000","last_undegraded":"2023-07-29T02:04:50.633311+0000","last_fullsized":"2023-07-29T02:04:50.633311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:44:39.930253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46925831499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"39'589","reported_seq":2661,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.254795+0000","last_change":"2023-07-29T02:03:57.172129+0000","last_active":"2023-07-29T02:06:07.254795+0000","last_peered":"2023-07-29T02:06:07.254795+0000","last_clean":"2023-07-29T02:06:07.254795+0000","last_became_active":"2023-07-29T02:00:01.996969+0000","last_became_peered":"2023-07-29T02:00:01.996969+0000","last_unstale":"2023-07-29T02:06:07.254795+0000","last_undegraded":"2023-07-29T02:06:07.254795+0000","last_fullsized":"2023-07-29T02:06:07.254795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:46:37.088979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.40090650999999999,"stat_sum":{"num_bytes":23342582,"num_objects":297,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":297,"num_whiteouts":0,"num_read":24,"num_read_kb":4119,"num_write":587,"num_write_kb":31305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"39'4","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.333735+0000","last_change":"2023-07-29T01:59:57.541115+0000","last_active":"2023-07-29T02:05:51.333735+0000","last_peered":"2023-07-29T02:05:51.333735+0000","last_clean":"2023-07-29T02:05:51.333735+0000","last_became_active":"2023-07-29T01:59:57.540800+0000","last_became_peered":"2023-07-29T01:59:57.540800+0000","last_unstale":"2023-07-29T02:05:51.333735+0000","last_undegraded":"2023-07-29T02:05:51.333735+0000","last_fullsized":"2023-07-29T02:05:51.333735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"39'77","reported_seq":2127,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.634663+0000","last_change":"2023-07-29T02:03:56.792291+0000","last_active":"2023-07-29T02:04:47.634663+0000","last_peered":"2023-07-29T02:04:47.634663+0000","last_clean":"2023-07-29T02:04:47.634663+0000","last_became_active":"2023-07-29T01:59:57.963510+0000","last_became_peered":"2023-07-29T01:59:57.963510+0000","last_unstale":"2023-07-29T02:04:47.634663+0000","last_undegraded":"2023-07-29T02:04:47.634663+0000","last_fullsized":"2023-07-29T02:04:47.634663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30420630999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"39'628","reported_seq":2717,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.247603+0000","last_change":"2023-07-29T02:03:57.173787+0000","last_active":"2023-07-29T02:06:07.247603+0000","last_peered":"2023-07-29T02:06:07.247603+0000","last_clean":"2023-07-29T02:06:07.247603+0000","last_became_active":"2023-07-29T02:00:01.996084+0000","last_became_peered":"2023-07-29T02:00:01.996084+0000","last_unstale":"2023-07-29T02:06:07.247603+0000","last_undegraded":"2023-07-29T02:06:07.247603+0000","last_fullsized":"2023-07-29T02:06:07.247603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:59:57.581952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38362237100000002,"stat_sum":{"num_bytes":15782931,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":41,"num_read_kb":8234,"num_write":627,"num_write_kb":19844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"39'2","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.887924+0000","last_change":"2023-07-29T01:59:57.548464+0000","last_active":"2023-07-29T02:05:51.887924+0000","last_peered":"2023-07-29T02:05:51.887924+0000","last_clean":"2023-07-29T02:05:51.887924+0000","last_became_active":"2023-07-29T01:59:57.548109+0000","last_became_peered":"2023-07-29T01:59:57.548109+0000","last_unstale":"2023-07-29T02:05:51.887924+0000","last_undegraded":"2023-07-29T02:05:51.887924+0000","last_fullsized":"2023-07-29T02:05:51.887924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:13.433053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"35'95","reported_seq":2145,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.414033+0000","last_change":"2023-07-29T02:03:57.037255+0000","last_active":"2023-07-29T02:04:20.414033+0000","last_peered":"2023-07-29T02:04:20.414033+0000","last_clean":"2023-07-29T02:04:20.414033+0000","last_became_active":"2023-07-29T01:59:57.961759+0000","last_became_peered":"2023-07-29T01:59:57.961759+0000","last_unstale":"2023-07-29T02:04:20.414033+0000","last_undegraded":"2023-07-29T02:04:20.414033+0000","last_fullsized":"2023-07-29T02:04:20.414033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55180089099999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"39'661","reported_seq":2754,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.775569+0000","last_change":"2023-07-29T02:03:56.798905+0000","last_active":"2023-07-29T02:06:07.775569+0000","last_peered":"2023-07-29T02:06:07.775569+0000","last_clean":"2023-07-29T02:06:07.775569+0000","last_became_active":"2023-07-29T02:00:01.992592+0000","last_became_peered":"2023-07-29T02:00:01.992592+0000","last_unstale":"2023-07-29T02:06:07.775569+0000","last_undegraded":"2023-07-29T02:06:07.775569+0000","last_fullsized":"2023-07-29T02:06:07.775569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:14:06.353802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30939737499999997,"stat_sum":{"num_bytes":46419699,"num_objects":303,"num_object_clones":0,"num_object_copies":1212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":303,"num_whiteouts":0,"num_read":45,"num_read_kb":20516,"num_write":660,"num_write_kb":45624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"39'98","reported_seq":151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:44.468105+0000","last_change":"2023-07-29T01:59:57.543707+0000","last_active":"2023-07-29T02:05:44.468105+0000","last_peered":"2023-07-29T02:05:44.468105+0000","last_clean":"2023-07-29T02:05:44.468105+0000","last_became_active":"2023-07-29T01:59:57.543398+0000","last_became_peered":"2023-07-29T01:59:57.543398+0000","last_unstale":"2023-07-29T02:05:44.468105+0000","last_undegraded":"2023-07-29T02:05:44.468105+0000","last_fullsized":"2023-07-29T02:05:44.468105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":8252,"num_write":102,"num_write_kb":8255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"39'81","reported_seq":2131,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:49.453150+0000","last_change":"2023-07-29T02:03:57.171910+0000","last_active":"2023-07-29T02:04:49.453150+0000","last_peered":"2023-07-29T02:04:49.453150+0000","last_clean":"2023-07-29T02:04:49.453150+0000","last_became_active":"2023-07-29T01:59:57.965962+0000","last_became_peered":"2023-07-29T01:59:57.965962+0000","last_unstale":"2023-07-29T02:04:49.453150+0000","last_undegraded":"2023-07-29T02:04:49.453150+0000","last_fullsized":"2023-07-29T02:04:49.453150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38151887499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"39'670","reported_seq":2767,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.907936+0000","last_change":"2023-07-29T02:03:56.698091+0000","last_active":"2023-07-29T02:06:07.907936+0000","last_peered":"2023-07-29T02:06:07.907936+0000","last_clean":"2023-07-29T02:06:07.907936+0000","last_became_active":"2023-07-29T02:00:01.992384+0000","last_became_peered":"2023-07-29T02:00:01.992384+0000","last_unstale":"2023-07-29T02:06:07.907936+0000","last_undegraded":"2023-07-29T02:06:07.907936+0000","last_fullsized":"2023-07-29T02:06:07.907936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19044205,"stat_sum":{"num_bytes":36575402,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":49,"num_read_kb":16426,"num_write":669,"num_write_kb":40161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"39'26","reported_seq":61,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:46.612297+0000","last_change":"2023-07-29T01:59:57.548392+0000","last_active":"2023-07-29T02:05:46.612297+0000","last_peered":"2023-07-29T02:05:46.612297+0000","last_clean":"2023-07-29T02:05:46.612297+0000","last_became_active":"2023-07-29T01:59:57.548084+0000","last_became_peered":"2023-07-29T01:59:57.548084+0000","last_unstale":"2023-07-29T02:05:46.612297+0000","last_undegraded":"2023-07-29T02:05:46.612297+0000","last_fullsized":"2023-07-29T02:05:46.612297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":27,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"35'83","reported_seq":2133,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.449967+0000","last_change":"2023-07-29T02:03:56.784306+0000","last_active":"2023-07-29T02:04:19.449967+0000","last_peered":"2023-07-29T02:04:19.449967+0000","last_clean":"2023-07-29T02:04:19.449967+0000","last_became_active":"2023-07-29T01:59:57.964626+0000","last_became_peered":"2023-07-29T01:59:57.964626+0000","last_unstale":"2023-07-29T02:04:19.449967+0000","last_undegraded":"2023-07-29T02:04:19.449967+0000","last_fullsized":"2023-07-29T02:04:19.449967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.297089139,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"39'673","reported_seq":2761,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.225534+0000","last_change":"2023-07-29T02:03:56.961858+0000","last_active":"2023-07-29T02:06:07.225534+0000","last_peered":"2023-07-29T02:06:07.225534+0000","last_clean":"2023-07-29T02:06:07.225534+0000","last_became_active":"2023-07-29T02:00:01.990579+0000","last_became_peered":"2023-07-29T02:00:01.990579+0000","last_unstale":"2023-07-29T02:06:07.225534+0000","last_undegraded":"2023-07-29T02:06:07.225534+0000","last_fullsized":"2023-07-29T02:06:07.225534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:11:53.398210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.47400464199999998,"stat_sum":{"num_bytes":32895626,"num_objects":333,"num_object_clones":0,"num_object_copies":1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":333,"num_whiteouts":0,"num_read":40,"num_read_kb":14736,"num_write":673,"num_write_kb":36572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"39'242","reported_seq":279,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.546339+0000","last_change":"2023-07-29T01:59:57.549270+0000","last_active":"2023-07-29T02:05:51.546339+0000","last_peered":"2023-07-29T02:05:51.546339+0000","last_clean":"2023-07-29T02:05:51.546339+0000","last_became_active":"2023-07-29T01:59:57.548981+0000","last_became_peered":"2023-07-29T01:59:57.548981+0000","last_unstale":"2023-07-29T02:05:51.546339+0000","last_undegraded":"2023-07-29T02:05:51.546339+0000","last_fullsized":"2023-07-29T02:05:51.546339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:05.783369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":244,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"39'91","reported_seq":2141,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.978727+0000","last_change":"2023-07-29T02:03:57.111934+0000","last_active":"2023-07-29T02:04:21.978727+0000","last_peered":"2023-07-29T02:04:21.978727+0000","last_clean":"2023-07-29T02:04:21.978727+0000","last_became_active":"2023-07-29T01:59:57.969501+0000","last_became_peered":"2023-07-29T01:59:57.969501+0000","last_unstale":"2023-07-29T02:04:21.978727+0000","last_undegraded":"2023-07-29T02:04:21.978727+0000","last_fullsized":"2023-07-29T02:04:21.978727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35565022000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"39'641","reported_seq":2727,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.163523+0000","last_change":"2023-07-29T02:03:56.959814+0000","last_active":"2023-07-29T02:06:07.163523+0000","last_peered":"2023-07-29T02:06:07.163523+0000","last_clean":"2023-07-29T02:06:07.163523+0000","last_became_active":"2023-07-29T02:00:01.989364+0000","last_became_peered":"2023-07-29T02:00:01.989364+0000","last_unstale":"2023-07-29T02:06:07.163523+0000","last_undegraded":"2023-07-29T02:06:07.163523+0000","last_fullsized":"2023-07-29T02:06:07.163523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:01:14.849757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.47145374600000001,"stat_sum":{"num_bytes":24224399,"num_objects":325,"num_object_clones":0,"num_object_copies":1300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":38,"num_read_kb":8228,"num_write":641,"num_write_kb":23994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"39'6","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:44.468681+0000","last_change":"2023-07-29T01:59:57.541329+0000","last_active":"2023-07-29T02:05:44.468681+0000","last_peered":"2023-07-29T02:05:44.468681+0000","last_clean":"2023-07-29T02:05:44.468681+0000","last_became_active":"2023-07-29T01:59:57.541056+0000","last_became_peered":"2023-07-29T01:59:57.541056+0000","last_unstale":"2023-07-29T02:05:44.468681+0000","last_undegraded":"2023-07-29T02:05:44.468681+0000","last_fullsized":"2023-07-29T02:05:44.468681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":8,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"35'83","reported_seq":2133,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444936+0000","last_change":"2023-07-29T02:03:56.982964+0000","last_active":"2023-07-29T02:04:19.444936+0000","last_peered":"2023-07-29T02:04:19.444936+0000","last_clean":"2023-07-29T02:04:19.444936+0000","last_became_active":"2023-07-29T01:59:57.974998+0000","last_became_peered":"2023-07-29T01:59:57.974998+0000","last_unstale":"2023-07-29T02:04:19.444936+0000","last_undegraded":"2023-07-29T02:04:19.444936+0000","last_fullsized":"2023-07-29T02:04:19.444936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:14.435169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20531364299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"39'660","reported_seq":2739,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.341472+0000","last_change":"2023-07-29T02:03:56.963785+0000","last_active":"2023-07-29T02:06:07.341472+0000","last_peered":"2023-07-29T02:06:07.341472+0000","last_clean":"2023-07-29T02:06:07.341472+0000","last_became_active":"2023-07-29T02:00:01.990276+0000","last_became_peered":"2023-07-29T02:00:01.990276+0000","last_unstale":"2023-07-29T02:06:07.341472+0000","last_undegraded":"2023-07-29T02:06:07.341472+0000","last_fullsized":"2023-07-29T02:06:07.341472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.47581172799999999,"stat_sum":{"num_bytes":20642551,"num_objects":321,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":321,"num_whiteouts":0,"num_read":31,"num_read_kb":1050,"num_write":661,"num_write_kb":24562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"39'8","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.543673+0000","last_change":"2023-07-29T01:59:57.544524+0000","last_active":"2023-07-29T02:05:51.543673+0000","last_peered":"2023-07-29T02:05:51.543673+0000","last_clean":"2023-07-29T02:05:51.543673+0000","last_became_active":"2023-07-29T01:59:57.544231+0000","last_became_peered":"2023-07-29T01:59:57.544231+0000","last_unstale":"2023-07-29T02:05:51.543673+0000","last_undegraded":"2023-07-29T02:05:51.543673+0000","last_fullsized":"2023-07-29T02:05:51.543673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"39'80","reported_seq":2130,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:29.435534+0000","last_change":"2023-07-29T02:03:57.033536+0000","last_active":"2023-07-29T02:04:29.435534+0000","last_peered":"2023-07-29T02:04:29.435534+0000","last_clean":"2023-07-29T02:04:29.435534+0000","last_became_active":"2023-07-29T01:59:57.974525+0000","last_became_peered":"2023-07-29T01:59:57.974525+0000","last_unstale":"2023-07-29T02:04:29.435534+0000","last_undegraded":"2023-07-29T02:04:29.435534+0000","last_fullsized":"2023-07-29T02:04:29.435534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.549422509,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"39'632","reported_seq":2721,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.136824+0000","last_change":"2023-07-29T02:03:56.961596+0000","last_active":"2023-07-29T02:06:07.136824+0000","last_peered":"2023-07-29T02:06:07.136824+0000","last_clean":"2023-07-29T02:06:07.136824+0000","last_became_active":"2023-07-29T02:00:01.988486+0000","last_became_peered":"2023-07-29T02:00:01.988486+0000","last_unstale":"2023-07-29T02:06:07.136824+0000","last_undegraded":"2023-07-29T02:06:07.136824+0000","last_fullsized":"2023-07-29T02:06:07.136824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:07.842328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.473472642,"stat_sum":{"num_bytes":32792736,"num_objects":300,"num_object_clones":0,"num_object_copies":1200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":300,"num_whiteouts":0,"num_read":41,"num_read_kb":18442,"num_write":630,"num_write_kb":40548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"39'375","reported_seq":411,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:55.655087+0000","last_change":"2023-07-29T01:59:57.535498+0000","last_active":"2023-07-29T02:05:55.655087+0000","last_peered":"2023-07-29T02:05:55.655087+0000","last_clean":"2023-07-29T02:05:55.655087+0000","last_became_active":"2023-07-29T01:59:57.534813+0000","last_became_peered":"2023-07-29T01:59:57.534813+0000","last_unstale":"2023-07-29T02:05:55.655087+0000","last_undegraded":"2023-07-29T02:05:55.655087+0000","last_fullsized":"2023-07-29T02:05:55.655087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":8198,"num_write":371,"num_write_kb":12605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"39'90","reported_seq":2140,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:29.440937+0000","last_change":"2023-07-29T02:03:57.110073+0000","last_active":"2023-07-29T02:04:29.440937+0000","last_peered":"2023-07-29T02:04:29.440937+0000","last_clean":"2023-07-29T02:04:29.440937+0000","last_became_active":"2023-07-29T01:59:57.962184+0000","last_became_peered":"2023-07-29T01:59:57.962184+0000","last_unstale":"2023-07-29T02:04:29.440937+0000","last_undegraded":"2023-07-29T02:04:29.440937+0000","last_fullsized":"2023-07-29T02:04:29.440937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36182750899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"39'688","reported_seq":2776,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.851869+0000","last_change":"2023-07-29T02:03:57.053859+0000","last_active":"2023-07-29T02:06:07.851869+0000","last_peered":"2023-07-29T02:06:07.851869+0000","last_clean":"2023-07-29T02:06:07.851869+0000","last_became_active":"2023-07-29T02:00:01.989151+0000","last_became_peered":"2023-07-29T02:00:01.989151+0000","last_unstale":"2023-07-29T02:06:07.851869+0000","last_undegraded":"2023-07-29T02:06:07.851869+0000","last_fullsized":"2023-07-29T02:06:07.851869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:21:35.031304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54490939800000004,"stat_sum":{"num_bytes":33219663,"num_objects":326,"num_object_clones":0,"num_object_copies":1304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":326,"num_whiteouts":0,"num_read":40,"num_read_kb":16418,"num_write":687,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"39'156","reported_seq":188,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:06.987414+0000","last_change":"2023-07-29T01:59:57.544466+0000","last_active":"2023-07-29T02:06:06.987414+0000","last_peered":"2023-07-29T02:06:06.987414+0000","last_clean":"2023-07-29T02:06:06.987414+0000","last_became_active":"2023-07-29T01:59:57.544120+0000","last_became_peered":"2023-07-29T01:59:57.544120+0000","last_unstale":"2023-07-29T02:06:06.987414+0000","last_undegraded":"2023-07-29T02:06:06.987414+0000","last_fullsized":"2023-07-29T02:06:06.987414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":155,"num_write_kb":8287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"39'86","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:29.441011+0000","last_change":"2023-07-29T02:03:57.107586+0000","last_active":"2023-07-29T02:04:29.441011+0000","last_peered":"2023-07-29T02:04:29.441011+0000","last_clean":"2023-07-29T02:04:29.441011+0000","last_became_active":"2023-07-29T01:59:57.961975+0000","last_became_peered":"2023-07-29T01:59:57.961975+0000","last_unstale":"2023-07-29T02:04:29.441011+0000","last_undegraded":"2023-07-29T02:04:29.441011+0000","last_fullsized":"2023-07-29T02:04:29.441011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:27:01.059953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37361334099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"39'646","reported_seq":2738,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.799960+0000","last_change":"2023-07-29T02:03:56.800119+0000","last_active":"2023-07-29T02:06:07.799960+0000","last_peered":"2023-07-29T02:06:07.799960+0000","last_clean":"2023-07-29T02:06:07.799960+0000","last_became_active":"2023-07-29T02:00:01.988155+0000","last_became_peered":"2023-07-29T02:00:01.988155+0000","last_unstale":"2023-07-29T02:06:07.799960+0000","last_undegraded":"2023-07-29T02:06:07.799960+0000","last_fullsized":"2023-07-29T02:06:07.799960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30982225000000002,"stat_sum":{"num_bytes":22073203,"num_objects":313,"num_object_clones":0,"num_object_copies":1252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":44,"num_read_kb":12328,"num_write":643,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"39'63","reported_seq":95,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:44.477329+0000","last_change":"2023-07-29T01:59:57.549764+0000","last_active":"2023-07-29T02:05:44.477329+0000","last_peered":"2023-07-29T02:05:44.477329+0000","last_clean":"2023-07-29T02:05:44.477329+0000","last_became_active":"2023-07-29T01:59:57.549470+0000","last_became_peered":"2023-07-29T01:59:57.549470+0000","last_unstale":"2023-07-29T02:05:44.477329+0000","last_undegraded":"2023-07-29T02:05:44.477329+0000","last_fullsized":"2023-07-29T02:05:44.477329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":64,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"35'60","reported_seq":2110,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.980241+0000","last_change":"2023-07-29T02:03:57.081019+0000","last_active":"2023-07-29T02:04:21.980241+0000","last_peered":"2023-07-29T02:04:21.980241+0000","last_clean":"2023-07-29T02:04:21.980241+0000","last_became_active":"2023-07-29T01:59:57.962016+0000","last_became_peered":"2023-07-29T01:59:57.962016+0000","last_unstale":"2023-07-29T02:04:21.980241+0000","last_undegraded":"2023-07-29T02:04:21.980241+0000","last_fullsized":"2023-07-29T02:04:21.980241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:08.813083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36599154900000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"39'565","reported_seq":2653,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.767129+0000","last_change":"2023-07-29T02:03:57.082127+0000","last_active":"2023-07-29T02:06:07.767129+0000","last_peered":"2023-07-29T02:06:07.767129+0000","last_clean":"2023-07-29T02:06:07.767129+0000","last_became_active":"2023-07-29T02:00:01.992042+0000","last_became_peered":"2023-07-29T02:00:01.992042+0000","last_unstale":"2023-07-29T02:06:07.767129+0000","last_undegraded":"2023-07-29T02:06:07.767129+0000","last_fullsized":"2023-07-29T02:06:07.767129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:24:44.331640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36734029699999998,"stat_sum":{"num_bytes":17472104,"num_objects":288,"num_object_clones":0,"num_object_copies":1152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":40,"num_read_kb":12324,"num_write":565,"num_write_kb":21394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"39'10","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.552303+0000","last_change":"2023-07-29T01:59:57.537045+0000","last_active":"2023-07-29T02:05:51.552303+0000","last_peered":"2023-07-29T02:05:51.552303+0000","last_clean":"2023-07-29T02:05:51.552303+0000","last_became_active":"2023-07-29T01:59:57.535762+0000","last_became_peered":"2023-07-29T01:59:57.535762+0000","last_unstale":"2023-07-29T02:05:51.552303+0000","last_undegraded":"2023-07-29T02:05:51.552303+0000","last_fullsized":"2023-07-29T02:05:51.552303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":13,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"36'78","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.927518+0000","last_change":"2023-07-29T02:03:57.049662+0000","last_active":"2023-07-29T02:04:21.927518+0000","last_peered":"2023-07-29T02:04:21.927518+0000","last_clean":"2023-07-29T02:04:21.927518+0000","last_became_active":"2023-07-29T01:59:57.974834+0000","last_became_peered":"2023-07-29T01:59:57.974834+0000","last_unstale":"2023-07-29T02:04:21.927518+0000","last_undegraded":"2023-07-29T02:04:21.927518+0000","last_fullsized":"2023-07-29T02:04:21.927518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53560260199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"39'713","reported_seq":2791,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:08.028422+0000","last_change":"2023-07-29T02:03:57.112720+0000","last_active":"2023-07-29T02:06:08.028422+0000","last_peered":"2023-07-29T02:06:08.028422+0000","last_clean":"2023-07-29T02:06:08.028422+0000","last_became_active":"2023-07-29T02:00:01.990464+0000","last_became_peered":"2023-07-29T02:00:01.990464+0000","last_unstale":"2023-07-29T02:06:08.028422+0000","last_undegraded":"2023-07-29T02:06:08.028422+0000","last_fullsized":"2023-07-29T02:06:08.028422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:16:46.676860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.356278702,"stat_sum":{"num_bytes":25950589,"num_objects":363,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":363,"num_whiteouts":0,"num_read":30,"num_read_kb":4124,"num_write":712,"num_write_kb":29793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"39'162","reported_seq":199,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:54.757116+0000","last_change":"2023-07-29T01:59:57.540561+0000","last_active":"2023-07-29T02:05:54.757116+0000","last_peered":"2023-07-29T02:05:54.757116+0000","last_clean":"2023-07-29T02:05:54.757116+0000","last_became_active":"2023-07-29T01:59:57.540292+0000","last_became_peered":"2023-07-29T01:59:57.540292+0000","last_unstale":"2023-07-29T02:05:54.757116+0000","last_undegraded":"2023-07-29T02:05:54.757116+0000","last_fullsized":"2023-07-29T02:05:54.757116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":162,"num_write_kb":4206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.981740+0000","last_change":"2023-07-29T01:59:52.448098+0000","last_active":"2023-07-29T02:04:21.981740+0000","last_peered":"2023-07-29T02:04:21.981740+0000","last_clean":"2023-07-29T02:04:21.981740+0000","last_became_active":"2023-07-29T01:59:52.447782+0000","last_became_peered":"2023-07-29T01:59:52.447782+0000","last_unstale":"2023-07-29T02:04:21.981740+0000","last_undegraded":"2023-07-29T02:04:21.981740+0000","last_fullsized":"2023-07-29T02:04:21.981740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:31.981804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"35'75","reported_seq":2126,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.442789+0000","last_change":"2023-07-29T02:03:57.173984+0000","last_active":"2023-07-29T02:04:19.442789+0000","last_peered":"2023-07-29T02:04:19.442789+0000","last_clean":"2023-07-29T02:04:19.442789+0000","last_became_active":"2023-07-29T01:59:57.966065+0000","last_became_peered":"2023-07-29T01:59:57.966065+0000","last_unstale":"2023-07-29T02:04:19.442789+0000","last_undegraded":"2023-07-29T02:04:19.442789+0000","last_fullsized":"2023-07-29T02:04:19.442789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37241656400000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"39'677","reported_seq":2773,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:06.908171+0000","last_change":"2023-07-29T02:03:57.174632+0000","last_active":"2023-07-29T02:06:06.908171+0000","last_peered":"2023-07-29T02:06:06.908171+0000","last_clean":"2023-07-29T02:06:06.908171+0000","last_became_active":"2023-07-29T02:00:01.995963+0000","last_became_peered":"2023-07-29T02:00:01.995963+0000","last_unstale":"2023-07-29T02:06:06.908171+0000","last_undegraded":"2023-07-29T02:06:06.908171+0000","last_fullsized":"2023-07-29T02:06:06.908171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:06:19.130853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.373304892,"stat_sum":{"num_bytes":14135733,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":47,"num_read_kb":4140,"num_write":679,"num_write_kb":14069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444185+0000","last_change":"2023-07-29T01:59:52.445649+0000","last_active":"2023-07-29T02:04:19.444185+0000","last_peered":"2023-07-29T02:04:19.444185+0000","last_clean":"2023-07-29T02:04:19.444185+0000","last_became_active":"2023-07-29T01:59:52.445337+0000","last_became_peered":"2023-07-29T01:59:52.445337+0000","last_unstale":"2023-07-29T02:04:19.444185+0000","last_undegraded":"2023-07-29T02:04:19.444185+0000","last_fullsized":"2023-07-29T02:04:19.444185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"39'36","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:04.716354+0000","last_change":"2023-07-29T01:59:57.537863+0000","last_active":"2023-07-29T02:06:04.716354+0000","last_peered":"2023-07-29T02:06:04.716354+0000","last_clean":"2023-07-29T02:06:04.716354+0000","last_became_active":"2023-07-29T01:59:57.537581+0000","last_became_peered":"2023-07-29T01:59:57.537581+0000","last_unstale":"2023-07-29T02:06:04.716354+0000","last_undegraded":"2023-07-29T02:06:04.716354+0000","last_fullsized":"2023-07-29T02:06:04.716354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:02:57.137574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8,"num_write":80,"num_write_kb":1322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"36'77","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.980339+0000","last_change":"2023-07-29T02:03:57.112487+0000","last_active":"2023-07-29T02:04:21.980339+0000","last_peered":"2023-07-29T02:04:21.980339+0000","last_clean":"2023-07-29T02:04:21.980339+0000","last_became_active":"2023-07-29T01:59:57.961298+0000","last_became_peered":"2023-07-29T01:59:57.961298+0000","last_unstale":"2023-07-29T02:04:21.980339+0000","last_undegraded":"2023-07-29T02:04:21.980339+0000","last_fullsized":"2023-07-29T02:04:21.980339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:11:49.956637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35104021600000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"39'622","reported_seq":2707,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.797342+0000","last_change":"2023-07-29T02:03:56.799516+0000","last_active":"2023-07-29T02:06:07.797342+0000","last_peered":"2023-07-29T02:06:07.797342+0000","last_clean":"2023-07-29T02:06:07.797342+0000","last_became_active":"2023-07-29T02:00:01.986915+0000","last_became_peered":"2023-07-29T02:00:01.986915+0000","last_unstale":"2023-07-29T02:06:07.797342+0000","last_undegraded":"2023-07-29T02:06:07.797342+0000","last_fullsized":"2023-07-29T02:06:07.797342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:35:48.256508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30985112500000001,"stat_sum":{"num_bytes":28815426,"num_objects":291,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":291,"num_whiteouts":0,"num_read":37,"num_read_kb":4131,"num_write":621,"num_write_kb":32518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.926459+0000","last_change":"2023-07-29T01:59:52.448423+0000","last_active":"2023-07-29T02:04:21.926459+0000","last_peered":"2023-07-29T02:04:21.926459+0000","last_clean":"2023-07-29T02:04:21.926459+0000","last_became_active":"2023-07-29T01:59:52.448052+0000","last_became_peered":"2023-07-29T01:59:52.448052+0000","last_unstale":"2023-07-29T02:04:21.926459+0000","last_undegraded":"2023-07-29T02:04:21.926459+0000","last_fullsized":"2023-07-29T02:04:21.926459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:31.981804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":185,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444525+0000","last_change":"2023-07-29T01:59:52.450730+0000","last_active":"2023-07-29T02:04:19.444525+0000","last_peered":"2023-07-29T02:04:19.444525+0000","last_clean":"2023-07-29T02:04:19.444525+0000","last_became_active":"2023-07-29T01:59:52.449582+0000","last_became_peered":"2023-07-29T01:59:52.449582+0000","last_unstale":"2023-07-29T02:04:19.444525+0000","last_undegraded":"2023-07-29T02:04:19.444525+0000","last_fullsized":"2023-07-29T02:04:19.444525+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:01:27.099648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"39'65","reported_seq":161,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:38.653219+0000","last_change":"2023-07-29T01:59:57.546474+0000","last_active":"2023-07-29T02:05:38.653219+0000","last_peered":"2023-07-29T02:05:38.653219+0000","last_clean":"2023-07-29T02:05:38.653219+0000","last_became_active":"2023-07-29T01:59:57.546179+0000","last_became_peered":"2023-07-29T01:59:57.546179+0000","last_unstale":"2023-07-29T02:05:38.653219+0000","last_undegraded":"2023-07-29T02:05:38.653219+0000","last_fullsized":"2023-07-29T02:05:38.653219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576046,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":608,"num_write":63,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"36'86","reported_seq":2136,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.434643+0000","last_change":"2023-07-29T02:03:57.038626+0000","last_active":"2023-07-29T02:04:19.434643+0000","last_peered":"2023-07-29T02:04:19.434643+0000","last_clean":"2023-07-29T02:04:19.434643+0000","last_became_active":"2023-07-29T01:59:57.975078+0000","last_became_peered":"2023-07-29T01:59:57.975078+0000","last_unstale":"2023-07-29T02:04:19.434643+0000","last_undegraded":"2023-07-29T02:04:19.434643+0000","last_fullsized":"2023-07-29T02:04:19.434643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55319968200000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"39'709","reported_seq":2807,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.742045+0000","last_change":"2023-07-29T02:03:56.966106+0000","last_active":"2023-07-29T02:06:07.742045+0000","last_peered":"2023-07-29T02:06:07.742045+0000","last_clean":"2023-07-29T02:06:07.742045+0000","last_became_active":"2023-07-29T02:00:01.986937+0000","last_became_peered":"2023-07-29T02:00:01.986937+0000","last_unstale":"2023-07-29T02:06:07.742045+0000","last_undegraded":"2023-07-29T02:06:07.742045+0000","last_fullsized":"2023-07-29T02:06:07.742045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:53.580244+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.47715394799999999,"stat_sum":{"num_bytes":40554601,"num_objects":344,"num_object_clones":0,"num_object_copies":1376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":344,"num_whiteouts":0,"num_read":51,"num_read_kb":15453,"num_write":703,"num_write_kb":39978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444967+0000","last_change":"2023-07-29T01:59:53.171806+0000","last_active":"2023-07-29T02:04:19.444967+0000","last_peered":"2023-07-29T02:04:19.444967+0000","last_clean":"2023-07-29T02:04:19.444967+0000","last_became_active":"2023-07-29T01:59:53.171467+0000","last_became_peered":"2023-07-29T01:59:53.171467+0000","last_unstale":"2023-07-29T02:04:19.444967+0000","last_undegraded":"2023-07-29T02:04:19.444967+0000","last_fullsized":"2023-07-29T02:04:19.444967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"39'249","reported_seq":285,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.552980+0000","last_change":"2023-07-29T01:59:57.549442+0000","last_active":"2023-07-29T02:05:51.552980+0000","last_peered":"2023-07-29T02:05:51.552980+0000","last_clean":"2023-07-29T02:05:51.552980+0000","last_became_active":"2023-07-29T01:59:57.549151+0000","last_became_peered":"2023-07-29T01:59:57.549151+0000","last_unstale":"2023-07-29T02:05:51.552980+0000","last_undegraded":"2023-07-29T02:05:51.552980+0000","last_fullsized":"2023-07-29T02:05:51.552980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":11035,"num_write":246,"num_write_kb":12456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"39'83","reported_seq":2133,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.927123+0000","last_change":"2023-07-29T02:03:57.051306+0000","last_active":"2023-07-29T02:04:21.927123+0000","last_peered":"2023-07-29T02:04:21.927123+0000","last_clean":"2023-07-29T02:04:21.927123+0000","last_became_active":"2023-07-29T01:59:57.969273+0000","last_became_peered":"2023-07-29T01:59:57.969273+0000","last_unstale":"2023-07-29T02:04:21.927123+0000","last_undegraded":"2023-07-29T02:04:21.927123+0000","last_fullsized":"2023-07-29T02:04:21.927123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:56:07.949649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53741308300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"39'638","reported_seq":2718,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.440171+0000","last_change":"2023-07-29T02:03:56.696365+0000","last_active":"2023-07-29T02:06:07.440171+0000","last_peered":"2023-07-29T02:06:07.440171+0000","last_clean":"2023-07-29T02:06:07.440171+0000","last_became_active":"2023-07-29T02:00:01.992406+0000","last_became_peered":"2023-07-29T02:00:01.992406+0000","last_unstale":"2023-07-29T02:06:07.440171+0000","last_undegraded":"2023-07-29T02:06:07.440171+0000","last_fullsized":"2023-07-29T02:06:07.440171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:12.254656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18856821800000001,"stat_sum":{"num_bytes":24793019,"num_objects":324,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":324,"num_whiteouts":0,"num_read":32,"num_read_kb":11492,"num_write":638,"num_write_kb":27823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444207+0000","last_change":"2023-07-29T01:59:53.171746+0000","last_active":"2023-07-29T02:04:19.444207+0000","last_peered":"2023-07-29T02:04:19.444207+0000","last_clean":"2023-07-29T02:04:19.444207+0000","last_became_active":"2023-07-29T01:59:53.171440+0000","last_became_peered":"2023-07-29T01:59:53.171440+0000","last_unstale":"2023-07-29T02:04:19.444207+0000","last_undegraded":"2023-07-29T02:04:19.444207+0000","last_fullsized":"2023-07-29T02:04:19.444207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:17:56.960611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"39'5","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:44.477182+0000","last_change":"2023-07-29T01:59:57.537970+0000","last_active":"2023-07-29T02:05:44.477182+0000","last_peered":"2023-07-29T02:05:44.477182+0000","last_clean":"2023-07-29T02:05:44.477182+0000","last_became_active":"2023-07-29T01:59:57.537665+0000","last_became_peered":"2023-07-29T01:59:57.537665+0000","last_unstale":"2023-07-29T02:05:44.477182+0000","last_undegraded":"2023-07-29T02:05:44.477182+0000","last_fullsized":"2023-07-29T02:05:44.477182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":4,"num_write_kb":8199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"35'79","reported_seq":2130,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.445095+0000","last_change":"2023-07-29T02:03:56.981337+0000","last_active":"2023-07-29T02:04:19.445095+0000","last_peered":"2023-07-29T02:04:19.445095+0000","last_clean":"2023-07-29T02:04:19.445095+0000","last_became_active":"2023-07-29T01:59:57.968373+0000","last_became_peered":"2023-07-29T01:59:57.968373+0000","last_unstale":"2023-07-29T02:04:19.445095+0000","last_undegraded":"2023-07-29T02:04:19.445095+0000","last_fullsized":"2023-07-29T02:04:19.445095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:06.785485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21661398800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"39'634","reported_seq":2720,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.594640+0000","last_change":"2023-07-29T02:03:57.040708+0000","last_active":"2023-07-29T02:06:07.594640+0000","last_peered":"2023-07-29T02:06:07.594640+0000","last_clean":"2023-07-29T02:06:07.594640+0000","last_became_active":"2023-07-29T02:00:01.984476+0000","last_became_peered":"2023-07-29T02:00:01.984476+0000","last_unstale":"2023-07-29T02:06:07.594640+0000","last_undegraded":"2023-07-29T02:06:07.594640+0000","last_fullsized":"2023-07-29T02:06:07.594640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55548792300000005,"stat_sum":{"num_bytes":35592378,"num_objects":339,"num_object_clones":0,"num_object_copies":1356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":339,"num_whiteouts":0,"num_read":38,"num_read_kb":16563,"num_write":635,"num_write_kb":39103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.815399+0000","last_change":"2023-07-29T01:59:53.172039+0000","last_active":"2023-07-29T02:04:21.815399+0000","last_peered":"2023-07-29T02:04:21.815399+0000","last_clean":"2023-07-29T02:04:21.815399+0000","last_became_active":"2023-07-29T01:59:53.171617+0000","last_became_peered":"2023-07-29T01:59:53.171617+0000","last_unstale":"2023-07-29T02:04:21.815399+0000","last_undegraded":"2023-07-29T02:04:21.815399+0000","last_fullsized":"2023-07-29T02:04:21.815399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"39'14","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:54.756200+0000","last_change":"2023-07-29T01:59:57.540888+0000","last_active":"2023-07-29T02:05:54.756200+0000","last_peered":"2023-07-29T02:05:54.756200+0000","last_clean":"2023-07-29T02:05:54.756200+0000","last_became_active":"2023-07-29T01:59:57.540449+0000","last_became_peered":"2023-07-29T01:59:57.540449+0000","last_unstale":"2023-07-29T02:05:54.756200+0000","last_undegraded":"2023-07-29T02:05:54.756200+0000","last_fullsized":"2023-07-29T02:05:54.756200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"35'81","reported_seq":2132,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.926453+0000","last_change":"2023-07-29T02:03:57.049030+0000","last_active":"2023-07-29T02:04:21.926453+0000","last_peered":"2023-07-29T02:04:21.926453+0000","last_clean":"2023-07-29T02:04:21.926453+0000","last_became_active":"2023-07-29T01:59:57.967933+0000","last_became_peered":"2023-07-29T01:59:57.967933+0000","last_unstale":"2023-07-29T02:04:21.926453+0000","last_undegraded":"2023-07-29T02:04:21.926453+0000","last_fullsized":"2023-07-29T02:04:21.926453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54069509900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"39'665","reported_seq":2750,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.868250+0000","last_change":"2023-07-29T02:03:56.982796+0000","last_active":"2023-07-29T02:06:07.868250+0000","last_peered":"2023-07-29T02:06:07.868250+0000","last_clean":"2023-07-29T02:06:07.868250+0000","last_became_active":"2023-07-29T02:00:01.984691+0000","last_became_peered":"2023-07-29T02:00:01.984691+0000","last_unstale":"2023-07-29T02:06:07.868250+0000","last_undegraded":"2023-07-29T02:06:07.868250+0000","last_fullsized":"2023-07-29T02:06:07.868250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:54.400954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.204776021,"stat_sum":{"num_bytes":24859419,"num_objects":316,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":316,"num_whiteouts":0,"num_read":37,"num_read_kb":6702,"num_write":664,"num_write_kb":28713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:14.449534+0000","last_change":"2023-07-29T01:59:53.171808+0000","last_active":"2023-07-29T02:04:14.449534+0000","last_peered":"2023-07-29T02:04:14.449534+0000","last_clean":"2023-07-29T02:04:14.449534+0000","last_became_active":"2023-07-29T01:59:53.171463+0000","last_became_peered":"2023-07-29T01:59:53.171463+0000","last_unstale":"2023-07-29T02:04:14.449534+0000","last_undegraded":"2023-07-29T02:04:14.449534+0000","last_fullsized":"2023-07-29T02:04:14.449534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:07:59.559814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"39'7","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:54.755973+0000","last_change":"2023-07-29T01:59:57.549468+0000","last_active":"2023-07-29T02:05:54.755973+0000","last_peered":"2023-07-29T02:05:54.755973+0000","last_clean":"2023-07-29T02:05:54.755973+0000","last_became_active":"2023-07-29T01:59:57.549181+0000","last_became_peered":"2023-07-29T01:59:57.549181+0000","last_unstale":"2023-07-29T02:05:54.755973+0000","last_undegraded":"2023-07-29T02:05:54.755973+0000","last_fullsized":"2023-07-29T02:05:54.755973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"39'90","reported_seq":2141,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:38.656184+0000","last_change":"2023-07-29T02:03:57.036363+0000","last_active":"2023-07-29T02:05:38.656184+0000","last_peered":"2023-07-29T02:05:38.656184+0000","last_clean":"2023-07-29T02:05:38.656184+0000","last_became_active":"2023-07-29T01:59:57.963659+0000","last_became_peered":"2023-07-29T01:59:57.963659+0000","last_unstale":"2023-07-29T02:05:38.656184+0000","last_undegraded":"2023-07-29T02:05:38.656184+0000","last_fullsized":"2023-07-29T02:05:38.656184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55193447900000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"39'682","reported_seq":2770,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.773690+0000","last_change":"2023-07-29T02:03:57.036172+0000","last_active":"2023-07-29T02:06:07.773690+0000","last_peered":"2023-07-29T02:06:07.773690+0000","last_clean":"2023-07-29T02:06:07.773690+0000","last_became_active":"2023-07-29T02:00:01.983744+0000","last_became_peered":"2023-07-29T02:00:01.983744+0000","last_unstale":"2023-07-29T02:06:07.773690+0000","last_undegraded":"2023-07-29T02:06:07.773690+0000","last_fullsized":"2023-07-29T02:06:07.773690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.552203522,"stat_sum":{"num_bytes":32278530,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":40,"num_read_kb":16416,"num_write":683,"num_write_kb":31830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:14.449587+0000","last_change":"2023-07-29T01:59:52.449102+0000","last_active":"2023-07-29T02:04:14.449587+0000","last_peered":"2023-07-29T02:04:14.449587+0000","last_clean":"2023-07-29T02:04:14.449587+0000","last_became_active":"2023-07-29T01:59:52.448814+0000","last_became_peered":"2023-07-29T01:59:52.448814+0000","last_unstale":"2023-07-29T02:04:14.449587+0000","last_undegraded":"2023-07-29T02:04:14.449587+0000","last_fullsized":"2023-07-29T02:04:14.449587+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"39'425","reported_seq":458,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:47.148677+0000","last_change":"2023-07-29T01:59:57.544590+0000","last_active":"2023-07-29T02:05:47.148677+0000","last_peered":"2023-07-29T02:05:47.148677+0000","last_clean":"2023-07-29T02:05:47.148677+0000","last_became_active":"2023-07-29T01:59:57.544317+0000","last_became_peered":"2023-07-29T01:59:57.544317+0000","last_unstale":"2023-07-29T02:05:47.148677+0000","last_undegraded":"2023-07-29T02:05:47.148677+0000","last_fullsized":"2023-07-29T02:05:47.148677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":424,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"39'82","reported_seq":2133,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.637540+0000","last_change":"2023-07-29T02:03:57.049937+0000","last_active":"2023-07-29T02:04:47.637540+0000","last_peered":"2023-07-29T02:04:47.637540+0000","last_clean":"2023-07-29T02:04:47.637540+0000","last_became_active":"2023-07-29T01:59:57.969642+0000","last_became_peered":"2023-07-29T01:59:57.969642+0000","last_unstale":"2023-07-29T02:04:47.637540+0000","last_undegraded":"2023-07-29T02:04:47.637540+0000","last_fullsized":"2023-07-29T02:04:47.637540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53741660000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"39'637","reported_seq":2730,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.912007+0000","last_change":"2023-07-29T02:03:57.053813+0000","last_active":"2023-07-29T02:06:07.912007+0000","last_peered":"2023-07-29T02:06:07.912007+0000","last_clean":"2023-07-29T02:06:07.912007+0000","last_became_active":"2023-07-29T02:00:01.998715+0000","last_became_peered":"2023-07-29T02:00:01.998715+0000","last_unstale":"2023-07-29T02:06:07.912007+0000","last_undegraded":"2023-07-29T02:06:07.912007+0000","last_fullsized":"2023-07-29T02:06:07.912007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54131381700000003,"stat_sum":{"num_bytes":21401745,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":45,"num_read_kb":12330,"num_write":635,"num_write_kb":33528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"39'136","reported_seq":168,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:44.477484+0000","last_change":"2023-07-29T01:59:57.545933+0000","last_active":"2023-07-29T02:05:44.477484+0000","last_peered":"2023-07-29T02:05:44.477484+0000","last_clean":"2023-07-29T02:05:44.477484+0000","last_became_active":"2023-07-29T01:59:57.545744+0000","last_became_peered":"2023-07-29T01:59:57.545744+0000","last_unstale":"2023-07-29T02:05:44.477484+0000","last_undegraded":"2023-07-29T02:05:44.477484+0000","last_fullsized":"2023-07-29T02:05:44.477484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":139,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"39'83","reported_seq":2133,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:38.656358+0000","last_change":"2023-07-29T02:03:56.956561+0000","last_active":"2023-07-29T02:05:38.656358+0000","last_peered":"2023-07-29T02:05:38.656358+0000","last_clean":"2023-07-29T02:05:38.656358+0000","last_became_active":"2023-07-29T01:59:57.970252+0000","last_became_peered":"2023-07-29T01:59:57.970252+0000","last_unstale":"2023-07-29T02:05:38.656358+0000","last_undegraded":"2023-07-29T02:05:38.656358+0000","last_fullsized":"2023-07-29T02:05:38.656358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:09.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46822948199999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"39'637","reported_seq":2723,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.452647+0000","last_change":"2023-07-29T02:03:56.694563+0000","last_active":"2023-07-29T02:06:07.452647+0000","last_peered":"2023-07-29T02:06:07.452647+0000","last_clean":"2023-07-29T02:06:07.452647+0000","last_became_active":"2023-07-29T02:00:01.989481+0000","last_became_peered":"2023-07-29T02:00:01.989481+0000","last_unstale":"2023-07-29T02:06:07.452647+0000","last_undegraded":"2023-07-29T02:06:07.452647+0000","last_fullsized":"2023-07-29T02:06:07.452647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.187630984,"stat_sum":{"num_bytes":25047033,"num_objects":309,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":38,"num_read_kb":8227,"num_write":637,"num_write_kb":24796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"39'112","reported_seq":149,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.553859+0000","last_change":"2023-07-29T01:59:57.543782+0000","last_active":"2023-07-29T02:05:51.553859+0000","last_peered":"2023-07-29T02:05:51.553859+0000","last_clean":"2023-07-29T02:05:51.553859+0000","last_became_active":"2023-07-29T01:59:57.543445+0000","last_became_peered":"2023-07-29T01:59:57.543445+0000","last_unstale":"2023-07-29T02:05:51.553859+0000","last_undegraded":"2023-07-29T02:05:51.553859+0000","last_fullsized":"2023-07-29T02:05:51.553859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":114,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"39'82","reported_seq":2132,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:45.626039+0000","last_change":"2023-07-29T02:03:57.113153+0000","last_active":"2023-07-29T02:04:45.626039+0000","last_peered":"2023-07-29T02:04:45.626039+0000","last_clean":"2023-07-29T02:04:45.626039+0000","last_became_active":"2023-07-29T01:59:57.964925+0000","last_became_peered":"2023-07-29T01:59:57.964925+0000","last_unstale":"2023-07-29T02:04:45.626039+0000","last_undegraded":"2023-07-29T02:04:45.626039+0000","last_fullsized":"2023-07-29T02:04:45.626039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35003659399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'665","reported_seq":2749,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:08.030901+0000","last_change":"2023-07-29T02:03:56.799552+0000","last_active":"2023-07-29T02:06:08.030901+0000","last_peered":"2023-07-29T02:06:08.030901+0000","last_clean":"2023-07-29T02:06:08.030901+0000","last_became_active":"2023-07-29T02:00:01.985310+0000","last_became_peered":"2023-07-29T02:00:01.985310+0000","last_unstale":"2023-07-29T02:06:08.030901+0000","last_undegraded":"2023-07-29T02:06:08.030901+0000","last_fullsized":"2023-07-29T02:06:08.030901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.31035642899999999,"stat_sum":{"num_bytes":19557603,"num_objects":304,"num_object_clones":0,"num_object_copies":1216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":304,"num_whiteouts":0,"num_read":36,"num_read_kb":35,"num_write":665,"num_write_kb":19402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"39'86","reported_seq":125,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:11.297549+0000","last_change":"2023-07-29T01:59:57.541908+0000","last_active":"2023-07-29T02:06:11.297549+0000","last_peered":"2023-07-29T02:06:11.297549+0000","last_clean":"2023-07-29T02:06:11.297549+0000","last_became_active":"2023-07-29T01:59:57.541633+0000","last_became_peered":"2023-07-29T01:59:57.541633+0000","last_unstale":"2023-07-29T02:06:11.297549+0000","last_undegraded":"2023-07-29T02:06:11.297549+0000","last_fullsized":"2023-07-29T02:06:11.297549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":18,"num_read_kb":12303,"num_write":84,"num_write_kb":16462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'78","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.979692+0000","last_change":"2023-07-29T02:03:57.113037+0000","last_active":"2023-07-29T02:04:21.979692+0000","last_peered":"2023-07-29T02:04:21.979692+0000","last_clean":"2023-07-29T02:04:21.979692+0000","last_became_active":"2023-07-29T01:59:57.965383+0000","last_became_peered":"2023-07-29T01:59:57.965383+0000","last_unstale":"2023-07-29T02:04:21.979692+0000","last_undegraded":"2023-07-29T02:04:21.979692+0000","last_fullsized":"2023-07-29T02:04:21.979692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.352110162,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"39'676","reported_seq":2763,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:08.039437+0000","last_change":"2023-07-29T02:03:57.114115+0000","last_active":"2023-07-29T02:06:08.039437+0000","last_peered":"2023-07-29T02:06:08.039437+0000","last_clean":"2023-07-29T02:06:08.039437+0000","last_became_active":"2023-07-29T02:00:01.993454+0000","last_became_peered":"2023-07-29T02:00:01.993454+0000","last_unstale":"2023-07-29T02:06:08.039437+0000","last_undegraded":"2023-07-29T02:06:08.039437+0000","last_fullsized":"2023-07-29T02:06:08.039437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:46.998657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.33100711700000002,"stat_sum":{"num_bytes":33339861,"num_objects":341,"num_object_clones":0,"num_object_copies":1364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":0,"num_read":39,"num_read_kb":19097,"num_write":677,"num_write_kb":41065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"39'102","reported_seq":135,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.348314+0000","last_change":"2023-07-29T01:59:57.539625+0000","last_active":"2023-07-29T02:06:07.348314+0000","last_peered":"2023-07-29T02:06:07.348314+0000","last_clean":"2023-07-29T02:06:07.348314+0000","last_became_active":"2023-07-29T01:59:57.539181+0000","last_became_peered":"2023-07-29T01:59:57.539181+0000","last_unstale":"2023-07-29T02:06:07.348314+0000","last_undegraded":"2023-07-29T02:06:07.348314+0000","last_fullsized":"2023-07-29T02:06:07.348314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:02:57.137574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":98,"num_write_kb":8257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'81","reported_seq":2131,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.442789+0000","last_change":"2023-07-29T02:03:57.171546+0000","last_active":"2023-07-29T02:04:19.442789+0000","last_peered":"2023-07-29T02:04:19.442789+0000","last_clean":"2023-07-29T02:04:19.442789+0000","last_became_active":"2023-07-29T01:59:57.966580+0000","last_became_peered":"2023-07-29T01:59:57.966580+0000","last_unstale":"2023-07-29T02:04:19.442789+0000","last_undegraded":"2023-07-29T02:04:19.442789+0000","last_fullsized":"2023-07-29T02:04:19.442789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.203628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38010548900000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"39'649","reported_seq":2735,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.663320+0000","last_change":"2023-07-29T02:03:57.046097+0000","last_active":"2023-07-29T02:06:07.663320+0000","last_peered":"2023-07-29T02:06:07.663320+0000","last_clean":"2023-07-29T02:06:07.663320+0000","last_became_active":"2023-07-29T02:00:01.985554+0000","last_became_peered":"2023-07-29T02:00:01.985554+0000","last_unstale":"2023-07-29T02:06:07.663320+0000","last_undegraded":"2023-07-29T02:06:07.663320+0000","last_fullsized":"2023-07-29T02:06:07.663320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:50:50.164635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53877218400000004,"stat_sum":{"num_bytes":39819276,"num_objects":290,"num_object_clones":0,"num_object_copies":1160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":290,"num_whiteouts":0,"num_read":38,"num_read_kb":16418,"num_write":646,"num_write_kb":43313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"39'135","reported_seq":174,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:55.844482+0000","last_change":"2023-07-29T01:59:57.537754+0000","last_active":"2023-07-29T02:05:55.844482+0000","last_peered":"2023-07-29T02:05:55.844482+0000","last_clean":"2023-07-29T02:05:55.844482+0000","last_became_active":"2023-07-29T01:59:57.537457+0000","last_became_peered":"2023-07-29T01:59:57.537457+0000","last_unstale":"2023-07-29T02:05:55.844482+0000","last_undegraded":"2023-07-29T02:05:55.844482+0000","last_fullsized":"2023-07-29T02:05:55.844482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":132,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"35'101","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.978778+0000","last_change":"2023-07-29T02:03:57.113779+0000","last_active":"2023-07-29T02:04:21.978778+0000","last_peered":"2023-07-29T02:04:21.978778+0000","last_clean":"2023-07-29T02:04:21.978778+0000","last_became_active":"2023-07-29T01:59:57.960318+0000","last_became_peered":"2023-07-29T01:59:57.960318+0000","last_unstale":"2023-07-29T02:04:21.978778+0000","last_undegraded":"2023-07-29T02:04:21.978778+0000","last_fullsized":"2023-07-29T02:04:21.978778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:01:11.408184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.32984874600000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"39'98","reported_seq":2149,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:45.626430+0000","last_change":"2023-07-29T02:03:56.970824+0000","last_active":"2023-07-29T02:04:45.626430+0000","last_peered":"2023-07-29T02:04:45.626430+0000","last_clean":"2023-07-29T02:04:45.626430+0000","last_became_active":"2023-07-29T01:59:57.959960+0000","last_became_peered":"2023-07-29T01:59:57.959960+0000","last_unstale":"2023-07-29T02:04:45.626430+0000","last_undegraded":"2023-07-29T02:04:45.626430+0000","last_fullsized":"2023-07-29T02:04:45.626430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22491762700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"35'98","reported_seq":2149,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.443452+0000","last_change":"2023-07-29T02:03:57.173410+0000","last_active":"2023-07-29T02:04:19.443452+0000","last_peered":"2023-07-29T02:04:19.443452+0000","last_clean":"2023-07-29T02:04:19.443452+0000","last_became_active":"2023-07-29T01:59:57.975384+0000","last_became_peered":"2023-07-29T01:59:57.975384+0000","last_unstale":"2023-07-29T02:04:19.443452+0000","last_undegraded":"2023-07-29T02:04:19.443452+0000","last_fullsized":"2023-07-29T02:04:19.443452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38175464599999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"35'93","reported_seq":2144,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.978776+0000","last_change":"2023-07-29T02:03:57.112576+0000","last_active":"2023-07-29T02:04:21.978776+0000","last_peered":"2023-07-29T02:04:21.978776+0000","last_clean":"2023-07-29T02:04:21.978776+0000","last_became_active":"2023-07-29T01:59:57.967603+0000","last_became_peered":"2023-07-29T01:59:57.967603+0000","last_unstale":"2023-07-29T02:04:21.978776+0000","last_undegraded":"2023-07-29T02:04:21.978776+0000","last_fullsized":"2023-07-29T02:04:21.978776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:24:00.439433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.350807488,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"35'92","reported_seq":2143,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.442970+0000","last_change":"2023-07-29T02:03:57.150968+0000","last_active":"2023-07-29T02:04:19.442970+0000","last_peered":"2023-07-29T02:04:19.442970+0000","last_clean":"2023-07-29T02:04:19.442970+0000","last_became_active":"2023-07-29T01:59:57.966672+0000","last_became_peered":"2023-07-29T01:59:57.966672+0000","last_unstale":"2023-07-29T02:04:19.442970+0000","last_undegraded":"2023-07-29T02:04:19.442970+0000","last_fullsized":"2023-07-29T02:04:19.442970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.39433596799999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'75","reported_seq":2125,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.433509+0000","last_change":"2023-07-29T02:03:57.048829+0000","last_active":"2023-07-29T02:04:19.433509+0000","last_peered":"2023-07-29T02:04:19.433509+0000","last_clean":"2023-07-29T02:04:19.433509+0000","last_became_active":"2023-07-29T01:59:57.968449+0000","last_became_peered":"2023-07-29T01:59:57.968449+0000","last_unstale":"2023-07-29T02:04:19.433509+0000","last_undegraded":"2023-07-29T02:04:19.433509+0000","last_fullsized":"2023-07-29T02:04:19.433509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54020755499999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":918109667,"num_objects":10158,"num_object_clones":0,"num_object_copies":40632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10158,"num_whiteouts":0,"num_read":1251,"num_read_kb":366219,"num_write":20739,"num_write_kb":1040888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1801621504,"data_stored":1952874496,"data_compressed":122947712,"data_compressed_allocated":138481664,"data_compressed_original":289734656,"omap_allocated":0,"internal_metadata":0},"log_size":20767,"ondisk_log_size":20767,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5272,"ondisk_log_size":5272,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":214487020,"num_objects":137,"num_object_clones":0,"num_object_copies":274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":137,"num_whiteouts":0,"num_read":307,"num_read_kb":151137,"num_write":3106,"num_write_kb":213424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":85409792,"data_stored":428974040,"data_compressed":54140070,"data_compressed_allocated":68378624,"data_compressed_original":412000256,"omap_allocated":0,"internal_metadata":0},"log_size":3071,"ondisk_log_size":3071,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":287904,"kb_used_data":220760,"kb_used_omap":0,"kb_used_meta":67136,"kb_avail":94083936,"statfs":{"total":96636764160,"available":96341950464,"internally_reserved":0,"allocated":226058240,"data_stored":291929737,"data_compressed":24027719,"data_compressed_allocated":28098560,"data_compressed_original":94220288,"omap_allocated":0,"internal_metadata":68747264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.56000000000000005,"15min":0.51300000000000001},"min":{"1min":0.26400000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.751,"5min":6.0650000000000004,"15min":6.0650000000000004},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.54900000000000004,"15min":0.51700000000000002},"min":{"1min":0.30199999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61599999999999999,"5min":3.988,"15min":3.988},"last":0.28999999999999998}]},{"osd":1,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.66400000000000003,"15min":0.56200000000000006},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.70099999999999996,"5min":10.303000000000001,"15min":10.303000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.79800000000000004,"15min":0.625},"min":{"1min":0.32900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.80100000000000005,"5min":19.527999999999999,"15min":19.527999999999999},"last":0.27500000000000002}]},{"osd":2,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.63400000000000001,"15min":0.59299999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70499999999999996,"5min":6.9720000000000004,"15min":6.9720000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.58399999999999996,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63400000000000001,"5min":3.8260000000000001,"15min":3.8260000000000001},"last":0.40200000000000002}]},{"osd":3,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72999999999999998,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.57799999999999996,"15min":0.60599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.77700000000000002,"5min":1.22,"15min":1.22},"last":0.39100000000000001}]},{"osd":4,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47899999999999998,"15min":0.52700000000000002},"min":{"1min":0.32200000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66100000000000003,"5min":1.454,"15min":1.454},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.51100000000000001,"15min":0.55900000000000005},"min":{"1min":0.30599999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.0249999999999999,"5min":1.244,"15min":1.244},"last":0.31900000000000001}]},{"osd":5,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.50900000000000001,"15min":0.55900000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70799999999999996,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.53400000000000003,"15min":0.57099999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75800000000000001,"5min":3.621,"15min":3.621},"last":0.41399999999999998}]},{"osd":6,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55600000000000005,"15min":0.60299999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.74399999999999999,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.372},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.58099999999999996,"15min":0.627},"min":{"1min":0.37,"5min":0.312,"15min":0.312},"max":{"1min":0.79600000000000004,"5min":3.488,"15min":3.488},"last":0.45800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":239676,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":245428224,"data_stored":280369393,"data_compressed":17301447,"data_compressed_allocated":19628032,"data_compressed_original":54792192,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.57699999999999996,"15min":0.54000000000000004},"min":{"1min":0.33200000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.65300000000000002,"5min":7,"15min":7},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.627,"15min":0.56100000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.59399999999999997,"5min":6.4619999999999997,"15min":6.4619999999999997},"last":0.64900000000000002}]},{"osd":1,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.64700000000000002,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70199999999999996,"5min":12.462,"15min":12.462},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.626,"15min":0.58899999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.63900000000000001,"5min":6.4130000000000003,"15min":6.4130000000000003},"last":0.61099999999999999}]},{"osd":2,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.629,"5min":1.367,"15min":1.367},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.60299999999999998,"15min":0.57499999999999996},"min":{"1min":0.39800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.65600000000000003,"5min":5.5330000000000004,"15min":5.5330000000000004},"last":0.52400000000000002}]},{"osd":3,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.65700000000000003,"15min":0.59899999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70799999999999996,"5min":6.4889999999999999,"15min":6.4889999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.64500000000000002,"15min":0.61499999999999999},"min":{"1min":0.40400000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.69599999999999995,"5min":6.8559999999999999,"15min":6.8559999999999999},"last":0.46400000000000002}]},{"osd":4,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.68600000000000005,"15min":0.58799999999999997},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68000000000000005,"5min":24.123999999999999,"15min":24.123999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.32700000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.70999999999999996,"5min":6.3710000000000004,"15min":6.3710000000000004},"last":0.41799999999999998}]},{"osd":5,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48499999999999999,"15min":0.53900000000000003},"min":{"1min":0.33900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68899999999999995,"5min":0.82999999999999996,"15min":1.1140000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59499999999999997,"15min":0.58299999999999996},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73199999999999998,"5min":6.9669999999999996,"15min":6.9669999999999996},"last":0.33600000000000002}]},{"osd":7,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.34999999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73299999999999998,"5min":5.484,"15min":5.484},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59599999999999997,"15min":0.61699999999999999},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.71299999999999997,"5min":5.2300000000000004,"15min":5.2300000000000004},"last":0.39700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371428,"kb_used_data":268188,"kb_used_omap":0,"kb_used_meta":103232,"kb_avail":94000412,"statfs":{"total":96636764160,"available":96256421888,"internally_reserved":0,"allocated":274624512,"data_stored":329542417,"data_compressed":22309908,"data_compressed_allocated":25948160,"data_compressed_original":81092608,"omap_allocated":0,"internal_metadata":105709568},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.39000000000000001,"15min":0.51400000000000001},"min":{"1min":0.25,"5min":0.20799999999999999,"15min":0.20399999999999999},"max":{"1min":0.441,"5min":3.7989999999999999,"15min":7.1299999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.38600000000000001,"15min":0.51000000000000001},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57099999999999995,"5min":0.94599999999999995,"15min":5.4779999999999998},"last":0.38700000000000001}]},{"osd":2,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.61299999999999999,"15min":0.88900000000000001},"min":{"1min":0.23300000000000001,"5min":0.214,"15min":0.20899999999999999},"max":{"1min":0.47799999999999998,"5min":22.483000000000001,"15min":22.483000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.44,"15min":0.67800000000000005},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56599999999999995,"5min":3.0619999999999998,"15min":11.028},"last":0.434}]},{"osd":3,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46899999999999997,"15min":0.59999999999999998},"min":{"1min":0.33300000000000002,"5min":0.27000000000000002,"15min":0.26800000000000002},"max":{"1min":0.54200000000000004,"5min":2.9900000000000002,"15min":7.1699999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.41999999999999998,"15min":0.39600000000000002},"min":{"1min":0.28399999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.51500000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.63}]},{"osd":4,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.70199999999999996,"15min":1.048},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78500000000000003,"5min":5.7809999999999997,"15min":17.925000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.625,"15min":0.86699999999999999},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79800000000000004,"5min":3.0329999999999999,"15min":10.961},"last":0.59599999999999997}]},{"osd":5,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.60599999999999998,"15min":0.71099999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79700000000000004,"5min":0.878,"15min":5.391},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.70699999999999996,"15min":1.0880000000000001},"min":{"1min":0.45100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86399999999999999,"5min":5.8849999999999998,"15min":17.994},"last":0.50900000000000001}]},{"osd":6,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.629,"15min":0.73999999999999999},"min":{"1min":0.40100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80800000000000005,"5min":0.91300000000000003,"15min":5.452},"last":0.755},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.72499999999999998,"15min":1.077},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82999999999999996,"5min":5.8540000000000001,"15min":17.963999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.67400000000000004,"15min":0.89000000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.755,"5min":3.0880000000000001,"15min":10.994},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67300000000000004,"15min":0.76300000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83499999999999996,"5min":2.9889999999999999,"15min":5.4249999999999998},"last":0.72799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":327772,"kb_used_data":238484,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94044068,"statfs":{"total":96636764160,"available":96301125632,"internally_reserved":0,"allocated":244207616,"data_stored":304944485,"data_compressed":22705554,"data_compressed_allocated":26374144,"data_compressed_original":87339008,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.77600000000000002,"15min":0.47799999999999998},"min":{"1min":0.20999999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.55500000000000005,"5min":39.070999999999998,"15min":39.070999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.435,"15min":0.38900000000000001},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.439,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":0.39900000000000002}]},{"osd":2,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.54600000000000004,"15min":0.45200000000000001},"min":{"1min":0.311,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.58899999999999997,"5min":10.438000000000001,"15min":10.438000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.55900000000000005,"15min":0.45700000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51700000000000002,"5min":10.802,"15min":10.802},"last":0.45900000000000002}]},{"osd":3,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.46500000000000002,"15min":0.39900000000000002},"min":{"1min":0.251,"5min":0.246,"15min":0.246},"max":{"1min":0.48699999999999999,"5min":4.6879999999999997,"15min":4.6879999999999997},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.50900000000000001,"15min":0.45300000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63600000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.48499999999999999}]},{"osd":4,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74099999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.67300000000000004,"15min":0.629},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.84599999999999997,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.52800000000000002}]},{"osd":5,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.374,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76900000000000002,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.63,"15min":0.624},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84999999999999998,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.57599999999999996}]},{"osd":6,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.68000000000000005,"15min":0.64700000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92200000000000004,"5min":1.663,"15min":1.663},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.40500000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.74099999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.67500000000000004,"15min":0.65000000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":1.496,"15min":1.496},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.67800000000000005,"15min":0.66100000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.61899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263968,"kb_used_data":200920,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":94107872,"statfs":{"total":96636764160,"available":96366460928,"internally_reserved":0,"allocated":205742080,"data_stored":235444465,"data_compressed":13107136,"data_compressed_allocated":15015936,"data_compressed_original":44941312,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.46300000000000002,"15min":0.39600000000000002},"min":{"1min":0.22800000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.53600000000000003,"5min":10.795999999999999,"15min":10.795999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.53700000000000003,"15min":0.66100000000000003},"min":{"1min":0.253,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.496,"5min":16.536999999999999,"15min":16.536999999999999},"last":0.30199999999999999}]},{"osd":1,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44900000000000001,"15min":0.55700000000000005},"min":{"1min":0.28499999999999998,"5min":0.223,"15min":0.223},"max":{"1min":0.68400000000000005,"5min":5.2160000000000002,"15min":6.1040000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.47599999999999998,"15min":0.435},"min":{"1min":0.311,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.53900000000000003,"5min":7.4880000000000004,"15min":7.4880000000000004},"last":0.39300000000000002}]},{"osd":3,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42699999999999999,"15min":0.40500000000000003},"min":{"1min":0.28599999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53800000000000003,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.504,"15min":0.61399999999999999},"min":{"1min":0.31,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.60399999999999998,"5min":5.4240000000000004,"15min":6.0620000000000003},"last":0.55400000000000005}]},{"osd":4,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.63700000000000001,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71299999999999997,"5min":5.2919999999999998,"15min":5.2919999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.67100000000000004,"15min":0.65900000000000003},"min":{"1min":0.42199999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77200000000000002,"5min":6.3300000000000001,"15min":6.3300000000000001},"last":0.48099999999999998}]},{"osd":5,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67700000000000005,"15min":0.65800000000000003},"min":{"1min":0.39200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.77300000000000002,"5min":6.149,"15min":6.149},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.89300000000000002,"15min":0.92800000000000005},"min":{"1min":0.38100000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77900000000000003,"5min":28.702000000000002,"15min":28.702000000000002},"last":0.49299999999999999}]},{"osd":6,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65100000000000002,"15min":0.85799999999999998},"min":{"1min":0.40300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.76400000000000001,"5min":4.5179999999999998,"15min":9.1199999999999992},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67800000000000005,"15min":0.65800000000000003},"min":{"1min":0.442,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86899999999999999,"5min":5.2530000000000001,"15min":5.2530000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.69399999999999995,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80100000000000005,"5min":6.2930000000000001,"15min":6.2930000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.67900000000000005,"15min":0.88500000000000001},"min":{"1min":0.433,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79400000000000004,"5min":4.4809999999999999,"15min":9.1620000000000008},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284232,"kb_used_data":199040,"kb_used_omap":0,"kb_used_meta":85184,"kb_avail":94087608,"statfs":{"total":96636764160,"available":96345710592,"internally_reserved":0,"allocated":203816960,"data_stored":281896330,"data_compressed":24201301,"data_compressed_allocated":28655616,"data_compressed_original":106958848,"omap_allocated":0,"internal_metadata":87228416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.36599999999999999,"15min":0.34100000000000003},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.57099999999999995,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35699999999999998,"15min":0.36599999999999999},"min":{"1min":0.24299999999999999,"5min":0.23200000000000001,"15min":0.22900000000000001},"max":{"1min":0.54100000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.38500000000000001}]},{"osd":1,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.44700000000000001,"15min":0.38600000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54000000000000004,"5min":9.7289999999999992,"15min":9.7289999999999992},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.47599999999999998,"15min":0.41399999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.21299999999999999},"max":{"1min":0.58199999999999996,"5min":7.4989999999999997,"15min":7.4989999999999997},"last":0.56599999999999995}]},{"osd":2,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40899999999999997,"15min":0.40699999999999997},"min":{"1min":0.28399999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.59999999999999998,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.45000000000000001,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68600000000000005,"5min":1.603,"15min":1.603},"last":0.48199999999999998}]},{"osd":4,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.34399999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81699999999999995,"5min":0.95899999999999996,"15min":0.96599999999999997},"last":0.505},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.68500000000000005,"15min":0.64000000000000001},"min":{"1min":0.375,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.74399999999999999,"5min":8.6869999999999994,"15min":8.6869999999999994},"last":0.498}]},{"osd":5,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67900000000000005,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.63400000000000001,"15min":0.60799999999999998},"min":{"1min":0.38,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88100000000000001,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.54000000000000004}]},{"osd":6,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67800000000000005,"15min":0.64700000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81200000000000006,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.65100000000000002,"15min":0.65600000000000003},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.61299999999999999}]},{"osd":7,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.70799999999999996,"15min":0.64400000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84899999999999998,"5min":8.7289999999999992,"15min":8.7289999999999992},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86499999999999999,"5min":1.0309999999999999,"15min":1.119},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":355056,"kb_used_data":251816,"kb_used_omap":0,"kb_used_meta":103232,"kb_avail":94016784,"statfs":{"total":96636764160,"available":96273186816,"internally_reserved":0,"allocated":257859584,"data_stored":353359351,"data_compressed":29870574,"data_compressed_allocated":35307520,"data_compressed_original":131047424,"omap_allocated":0,"internal_metadata":105709568},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.61099999999999999,"15min":0.54000000000000004},"min":{"1min":0.31900000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.68200000000000005,"5min":4.4800000000000004,"15min":4.4800000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.57299999999999995,"15min":0.84499999999999997},"min":{"1min":0.28399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.69499999999999995,"5min":7.2679999999999998,"15min":12.231999999999999},"last":0.66000000000000003}]},{"osd":1,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.55700000000000005,"15min":0.51500000000000001},"min":{"1min":0.29399999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.65100000000000002,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.54700000000000004,"15min":0.53100000000000003},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66700000000000004,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.58699999999999997}]},{"osd":2,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.34200000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68400000000000005,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65900000000000003,"5min":0.874,"15min":0.874},"last":0.63400000000000001}]},{"osd":3,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63200000000000001,"5min":3.9969999999999999,"15min":3.9969999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.96199999999999997,"15min":0.69199999999999995},"min":{"1min":0.40899999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67100000000000004,"5min":28.837,"15min":28.837},"last":0.52600000000000002}]},{"osd":5,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.48099999999999998,"15min":0.496},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.69499999999999995,"5min":1.8,"15min":1.8},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48699999999999999,"15min":0.501},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60199999999999998,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.36099999999999999}]},{"osd":6,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51800000000000002,"15min":0.50800000000000001},"min":{"1min":0.314,"5min":0.311,"15min":0.311},"max":{"1min":0.623,"5min":1.006,"15min":1.006},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54100000000000004,"15min":0.54900000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71999999999999997,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.40300000000000002}]},{"osd":7,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64300000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57599999999999996},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67500000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.45600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574929,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":293648,"kb_used_data":226504,"kb_used_omap":0,"kb_used_meta":67136,"kb_avail":94078192,"statfs":{"total":96636764160,"available":96336068608,"internally_reserved":0,"allocated":231940096,"data_stored":303070077,"data_compressed":22818421,"data_compressed_allocated":26935296,"data_compressed_original":98295808,"omap_allocated":0,"internal_metadata":68747264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54400000000000004,"15min":0.51400000000000001},"min":{"1min":0.23000000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.626,"15min":0.54200000000000004},"min":{"1min":0.29699999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":8.2590000000000003,"5min":8.2590000000000003,"15min":8.2590000000000003},"last":0.46600000000000003}]},{"osd":1,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.58099999999999996,"15min":0.51100000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.9179999999999999,"5min":5.9119999999999999,"15min":5.9119999999999999},"last":0.497},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.58199999999999996,"15min":0.54800000000000004},"min":{"1min":0.32200000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":3.996,"5min":3.996,"15min":3.996},"last":0.441}]},{"osd":2,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.51500000000000001},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":2.8929999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.70199999999999996,"15min":0.59999999999999998},"min":{"1min":0.33100000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":9.8360000000000003,"5min":9.8360000000000003,"15min":9.8360000000000003},"last":0.41299999999999998}]},{"osd":3,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.57899999999999996,"15min":0.55500000000000005},"min":{"1min":0.32100000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.83699999999999997,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.70099999999999996,"15min":0.60399999999999998},"min":{"1min":0.34300000000000003,"5min":0.314,"15min":0.314},"max":{"1min":8.1940000000000008,"5min":8.1940000000000008,"15min":8.1940000000000008},"last":0.42699999999999999}]},{"osd":4,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.49299999999999999,"15min":0.51300000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.498,"15min":0.53200000000000003},"min":{"1min":0.318,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.73299999999999998,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.48299999999999998}]},{"osd":6,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.51700000000000002,"15min":0.54100000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.55600000000000005},"min":{"1min":0.35499999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.45200000000000001}]},{"osd":7,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56899999999999995,"15min":0.58999999999999997},"min":{"1min":0.40699999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":0.50900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11333632,"data_stored":50908276,"data_compressed":6612732,"data_compressed_allocated":8208384,"data_compressed_original":47788032,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7892992,"data_stored":41943040,"data_compressed":5179048,"data_compressed_allocated":6578176,"data_compressed_original":40628224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":20971520,"data_compressed":2599703,"data_compressed_allocated":3166208,"data_compressed_original":19935232,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15769600,"data_stored":75497562,"data_compressed":9642572,"data_compressed_allocated":12136448,"data_compressed_original":71868416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16830464,"data_stored":88657158,"data_compressed":10773719,"data_compressed_allocated":13713408,"data_compressed_original":85557248,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12902400,"data_stored":67109516,"data_compressed":8592718,"data_compressed_allocated":10850304,"data_compressed_original":65064960,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5103616,"data_stored":25165824,"data_compressed":3204864,"data_compressed_allocated":4030464,"data_compressed_original":24092672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11374592,"data_stored":58721144,"data_compressed":7534714,"data_compressed_allocated":9695232,"data_compressed_original":57065472,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":232435712,"data_stored":253820928,"data_compressed":16092822,"data_compressed_allocated":18165760,"data_compressed_original":39550976,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":266227712,"data_stored":286793728,"data_compressed":17098430,"data_compressed_allocated":19324928,"data_compressed_original":39890944,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":201101312,"data_stored":214257664,"data_compressed":10507433,"data_compressed_allocated":11849728,"data_compressed_original":25006080,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":187613184,"data_stored":206184448,"data_compressed":14558729,"data_compressed_allocated":16519168,"data_compressed_original":35090432,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":240590848,"data_stored":264486912,"data_compressed":19096855,"data_compressed_allocated":21594112,"data_compressed_original":45490176,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":219586560,"data_stored":239939584,"data_compressed":15036285,"data_compressed_allocated":17072128,"data_compressed_original":37425152,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":239886336,"data_stored":254988288,"data_compressed":14096583,"data_compressed_allocated":15597568,"data_compressed_original":30699520,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":214179840,"data_stored":232402944,"data_compressed":16460575,"data_compressed_allocated":18358272,"data_compressed_original":36581376,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T02:06:19.421 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T02:06:19.570 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.589+0000 7fc1c98d3700 1 Processor -- start 2023-07-29T02:06:19.571 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.589+0000 7fc1c98d3700 1 -- start start 2023-07-29T02:06:19.574 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.590+0000 7fc1c98d3700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc1c414dce0 0x7fc1c40c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:19.575 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.590+0000 7fc1c98d3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1c40c7ed0 0x7fc1c4157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:19.575 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.590+0000 7fc1c98d3700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c40c1fb0 con 0x7fc1c4157d40 2023-07-29T02:06:19.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.590+0000 7fc1c98d3700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c4157370 con 0x7fc1c414dce0 2023-07-29T02:06:19.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.590+0000 7fc1c98d3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40c2200 con 0x7fc1c40c7ed0 2023-07-29T02:06:19.576 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.590+0000 7fc1c37fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc1c4157d40 0x7fc1c406fe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52062/0 (socket says 172.21.15.42:52062) 2023-07-29T02:06:19.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.590+0000 7fc1c37fe700 1 -- 172.21.15.42:0/1413276013 learned_addr learned my addr 172.21.15.42:0/1413276013 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:06:19.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.590+0000 7fc1c27fc700 1 --2- 172.21.15.42:0/1413276013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1c40c7ed0 0x7fc1c4157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:19.577 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.590+0000 7fc1c2ffd700 1 --2- 172.21.15.42:0/1413276013 >> v2:172.21.15.144:3300/0 conn(0x7fc1c414dce0 0x7fc1c40c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:19.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.591+0000 7fc1c1ffb700 1 -- 172.21.15.42:0/1413276013 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215704778 0 0) 0x7fc1c40c1fb0 con 0x7fc1c4157d40 2023-07-29T02:06:19.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.591+0000 7fc1c1ffb700 1 -- 172.21.15.42:0/1413276013 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1ac0035b0 con 0x7fc1c4157d40 2023-07-29T02:06:19.578 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.591+0000 7fc1c27fc700 1 -- 172.21.15.42:0/1413276013 >> v2:172.21.15.144:3300/0 conn(0x7fc1c414dce0 msgr2=0x7fc1c40c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:19.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.591+0000 7fc1c27fc700 1 --2- 172.21.15.42:0/1413276013 >> v2:172.21.15.144:3300/0 conn(0x7fc1c414dce0 0x7fc1c40c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:19.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.591+0000 7fc1c27fc700 1 -- 172.21.15.42:0/1413276013 >> v1:172.21.15.42:6789/0 conn(0x7fc1c4157d40 legacy=0x7fc1c406fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:19.579 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.591+0000 7fc1c27fc700 1 -- 172.21.15.42:0/1413276013 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c40c24e0 con 0x7fc1c40c7ed0 2023-07-29T02:06:19.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.591+0000 7fc1c2ffd700 1 --2- 172.21.15.42:0/1413276013 >> v2:172.21.15.144:3300/0 conn(0x7fc1c414dce0 0x7fc1c40c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:06:19.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.591+0000 7fc1c27fc700 1 --2- 172.21.15.42:0/1413276013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1c40c7ed0 0x7fc1c4157800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8009840 tx=0x7fc1b8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c239443f728583b server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:19.580 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.591+0000 7fc1c1ffb700 1 -- 172.21.15.42:0/1413276013 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8011830 con 0x7fc1c40c7ed0 2023-07-29T02:06:19.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.591+0000 7fc1c1ffb700 1 -- 172.21.15.42:0/1413276013 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b8011990 con 0x7fc1c40c7ed0 2023-07-29T02:06:19.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.591+0000 7fc1c1ffb700 1 -- 172.21.15.42:0/1413276013 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8011d20 con 0x7fc1c40c7ed0 2023-07-29T02:06:19.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.592+0000 7fc1c98d3700 1 -- 172.21.15.42:0/1413276013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1c40c7ed0 msgr2=0x7fc1c4157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:19.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.592+0000 7fc1c98d3700 1 --2- 172.21.15.42:0/1413276013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1c40c7ed0 0x7fc1c4157800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8009840 tx=0x7fc1b8009b50 comp rx=0 tx=0).stop 2023-07-29T02:06:19.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.592+0000 7fc1c98d3700 1 -- 172.21.15.42:0/1413276013 shutdown_connections 2023-07-29T02:06:19.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.592+0000 7fc1c98d3700 1 --2- 172.21.15.42:0/1413276013 >> v2:172.21.15.144:3300/0 conn(0x7fc1c414dce0 0x7fc1c40c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:19.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.592+0000 7fc1c98d3700 1 --2- 172.21.15.42:0/1413276013 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1c40c7ed0 0x7fc1c4157800 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:19.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.592+0000 7fc1c98d3700 1 -- 172.21.15.42:0/1413276013 >> 172.21.15.42:0/1413276013 conn(0x7fc1c406a750 msgr2=0x7fc1c406ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:19.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.592+0000 7fc1c98d3700 1 -- 172.21.15.42:0/1413276013 shutdown_connections 2023-07-29T02:06:19.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.592+0000 7fc1c98d3700 1 -- 172.21.15.42:0/1413276013 wait complete. 2023-07-29T02:06:19.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.593+0000 7fc1c98d3700 1 Processor -- start 2023-07-29T02:06:19.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.593+0000 7fc1c98d3700 1 -- start start 2023-07-29T02:06:19.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.594+0000 7fc1c98d3700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1c40c7ed0 0x7fc1c4147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:19.588 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.594+0000 7fc1c98d3700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1c414dce0 0x7fc1c4145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:19.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.594+0000 7fc1c98d3700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1c4157d40 0x7fc1c40cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:19.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.594+0000 7fc1c98d3700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40cda90 con 0x7fc1c414dce0 2023-07-29T02:06:19.589 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.594+0000 7fc1c98d3700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c4147c90 con 0x7fc1c40c7ed0 2023-07-29T02:06:19.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.594+0000 7fc1c98d3700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c4147f70 con 0x7fc1c4157d40 2023-07-29T02:06:19.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.594+0000 7fc1c27fc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1c414dce0 0x7fc1c4145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:19.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.594+0000 7fc1c27fc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1c414dce0 0x7fc1c4145f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58264/0 (socket says 172.21.15.42:58264) 2023-07-29T02:06:19.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.594+0000 7fc1c27fc700 1 -- 172.21.15.42:0/1379041684 learned_addr learned my addr 172.21.15.42:0/1379041684 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:19.591 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.594+0000 7fc1c37fe700 1 --2- 172.21.15.42:0/1379041684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1c4157d40 0x7fc1c40cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:19.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.594+0000 7fc1c27fc700 1 -- 172.21.15.42:0/1379041684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1c4157d40 msgr2=0x7fc1c40cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:19.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.594+0000 7fc1c2ffd700 1 --2- 172.21.15.42:0/1379041684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1c40c7ed0 0x7fc1c4147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:19.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.594+0000 7fc1c27fc700 1 --2- 172.21.15.42:0/1379041684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1c4157d40 0x7fc1c40cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:19.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.594+0000 7fc1c27fc700 1 -- 172.21.15.42:0/1379041684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1c40c7ed0 msgr2=0x7fc1c4147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:19.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.594+0000 7fc1c27fc700 1 --2- 172.21.15.42:0/1379041684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1c40c7ed0 0x7fc1c4147180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:19.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.594+0000 7fc1c27fc700 1 -- 172.21.15.42:0/1379041684 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b40094a0 con 0x7fc1c414dce0 2023-07-29T02:06:19.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.594+0000 7fc1c37fe700 1 --2- 172.21.15.42:0/1379041684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1c4157d40 0x7fc1c40cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:06:19.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.595+0000 7fc1c27fc700 1 --2- 172.21.15.42:0/1379041684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1c414dce0 0x7fc1c4145f80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80090b0 tx=0x7fc1b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:19.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.595+0000 7fc1abfff700 1 -- 172.21.15.42:0/1379041684 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b80036a0 con 0x7fc1c414dce0 2023-07-29T02:06:19.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.595+0000 7fc1abfff700 1 -- 172.21.15.42:0/1379041684 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b801f070 con 0x7fc1c414dce0 2023-07-29T02:06:19.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.595+0000 7fc1c98d3700 1 -- 172.21.15.42:0/1379041684 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b80094a0 con 0x7fc1c414dce0 2023-07-29T02:06:19.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.595+0000 7fc1abfff700 1 -- 172.21.15.42:0/1379041684 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b8003a00 con 0x7fc1c414dce0 2023-07-29T02:06:19.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.595+0000 7fc1c98d3700 1 -- 172.21.15.42:0/1379041684 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c4148530 con 0x7fc1c414dce0 2023-07-29T02:06:19.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.596+0000 7fc1c98d3700 1 -- 172.21.15.42:0/1379041684 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1c4068060 con 0x7fc1c414dce0 2023-07-29T02:06:19.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.596+0000 7fc1abfff700 1 -- 172.21.15.42:0/1379041684 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fc1b8003b60 con 0x7fc1c414dce0 2023-07-29T02:06:19.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.597+0000 7fc1abfff700 1 --2- 172.21.15.42:0/1379041684 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc1b006a660 0x7fc1b006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:19.595 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.597+0000 7fc1abfff700 1 -- 172.21.15.42:0/1379041684 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7fc1b8021070 con 0x7fc1c414dce0 2023-07-29T02:06:19.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.597+0000 7fc1c2ffd700 1 --2- 172.21.15.42:0/1379041684 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc1b006a660 0x7fc1b006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:19.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.597+0000 7fc1c2ffd700 1 --2- 172.21.15.42:0/1379041684 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc1b006a660 0x7fc1b006cb10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009c20 tx=0x7fc1b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:19.596 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.601+0000 7fc1abfff700 1 -- 172.21.15.42:0/1379041684 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fc1b80558a0 con 0x7fc1c414dce0 2023-07-29T02:06:19.798 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.817+0000 7fc1c98d3700 1 -- 172.21.15.42:0/1379041684 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1c40c27c0 con 0x7fc1b006a660 2023-07-29T02:06:19.814 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.832+0000 7fc1abfff700 1 -- 172.21.15.42:0/1379041684 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+396921 (secure 0 0 0) 0x7fc1b40108a0 con 0x7fc1b006a660 2023-07-29T02:06:19.817 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:06:19.820 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.836+0000 7fc1c98d3700 1 -- 172.21.15.42:0/1379041684 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc1b006a660 msgr2=0x7fc1b006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:19.820 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.836+0000 7fc1c98d3700 1 --2- 172.21.15.42:0/1379041684 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc1b006a660 0x7fc1b006cb10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc1b4009c20 tx=0x7fc1b4008040 comp rx=0 tx=0).stop 2023-07-29T02:06:19.820 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.836+0000 7fc1c98d3700 1 -- 172.21.15.42:0/1379041684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1c414dce0 msgr2=0x7fc1c4145f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:19.821 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.836+0000 7fc1c98d3700 1 --2- 172.21.15.42:0/1379041684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1c414dce0 0x7fc1c4145f80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc1b80090b0 tx=0x7fc1b8004750 comp rx=0 tx=0).stop 2023-07-29T02:06:19.821 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.837+0000 7fc1c98d3700 1 -- 172.21.15.42:0/1379041684 shutdown_connections 2023-07-29T02:06:19.821 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.837+0000 7fc1c98d3700 1 --2- 172.21.15.42:0/1379041684 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc1b006a660 0x7fc1b006cb10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:19.821 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.837+0000 7fc1c98d3700 1 --2- 172.21.15.42:0/1379041684 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1c4157d40 0x7fc1c40cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:19.822 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.837+0000 7fc1c98d3700 1 --2- 172.21.15.42:0/1379041684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1c40c7ed0 0x7fc1c4147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:19.822 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.837+0000 7fc1c98d3700 1 --2- 172.21.15.42:0/1379041684 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1c414dce0 0x7fc1c4145f80 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:19.822 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.837+0000 7fc1c98d3700 1 -- 172.21.15.42:0/1379041684 >> 172.21.15.42:0/1379041684 conn(0x7fc1c406a750 msgr2=0x7fc1c406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:19.822 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.837+0000 7fc1c98d3700 1 -- 172.21.15.42:0/1379041684 shutdown_connections 2023-07-29T02:06:19.822 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:19.837+0000 7fc1c98d3700 1 -- 172.21.15.42:0/1379041684 wait complete. 2023-07-29T02:06:19.823 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2023-07-29T02:06:19.831 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2023-07-29T02:06:19.339590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1133187055,"num_objects":10297,"num_object_clones":0,"num_object_copies":40910,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10297,"num_whiteouts":0,"num_read":1674,"num_read_kb":517456,"num_write":24004,"num_write_kb":1256728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29227,"ondisk_log_size":29227,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2486732,"kb_used_data":1845388,"kb_used_omap":0,"kb_used_meta":641280,"kb_avail":752487988,"statfs":{"total":773094113280,"available":770547699712,"internally_reserved":0,"allocated":1889677312,"data_stored":2380556255,"data_compressed":176342060,"data_compressed_allocated":205963264,"data_compressed_original":698687488,"omap_allocated":0,"internal_metadata":656670720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":201304347,"num_objects":9970,"num_object_clones":0,"num_object_copies":39868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9970,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10105,"num_write_kb":201488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002566"},"pg_stats":[{"pgid":"4.3f","version":"35'78","reported_seq":2129,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.614917+0000","last_change":"2023-07-29T02:03:56.956160+0000","last_active":"2023-07-29T02:04:20.614917+0000","last_peered":"2023-07-29T02:04:20.614917+0000","last_clean":"2023-07-29T02:04:20.614917+0000","last_became_active":"2023-07-29T01:59:57.957742+0000","last_became_peered":"2023-07-29T01:59:57.957742+0000","last_unstale":"2023-07-29T02:04:20.614917+0000","last_undegraded":"2023-07-29T02:04:20.614917+0000","last_fullsized":"2023-07-29T02:04:20.614917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:32.550358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46739399700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"39'71","reported_seq":2122,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.634369+0000","last_change":"2023-07-29T02:03:56.795813+0000","last_active":"2023-07-29T02:04:47.634369+0000","last_peered":"2023-07-29T02:04:47.634369+0000","last_clean":"2023-07-29T02:04:47.634369+0000","last_became_active":"2023-07-29T01:59:57.974338+0000","last_became_peered":"2023-07-29T01:59:57.974338+0000","last_unstale":"2023-07-29T02:04:47.634369+0000","last_undegraded":"2023-07-29T02:04:47.634369+0000","last_fullsized":"2023-07-29T02:04:47.634369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30630966300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"36'83","reported_seq":2134,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.979284+0000","last_change":"2023-07-29T02:03:57.108039+0000","last_active":"2023-07-29T02:04:21.979284+0000","last_peered":"2023-07-29T02:04:21.979284+0000","last_clean":"2023-07-29T02:04:21.979284+0000","last_became_active":"2023-07-29T01:59:57.973406+0000","last_became_peered":"2023-07-29T01:59:57.973406+0000","last_unstale":"2023-07-29T02:04:21.979284+0000","last_undegraded":"2023-07-29T02:04:21.979284+0000","last_fullsized":"2023-07-29T02:04:21.979284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:08:23.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37359432399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"37'67","reported_seq":2118,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.446364+0000","last_change":"2023-07-29T02:03:56.955565+0000","last_active":"2023-07-29T02:04:19.446364+0000","last_peered":"2023-07-29T02:04:19.446364+0000","last_clean":"2023-07-29T02:04:19.446364+0000","last_became_active":"2023-07-29T01:59:57.964865+0000","last_became_peered":"2023-07-29T01:59:57.964865+0000","last_unstale":"2023-07-29T02:04:19.446364+0000","last_undegraded":"2023-07-29T02:04:19.446364+0000","last_fullsized":"2023-07-29T02:04:19.446364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:32.905717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22913951599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"35'98","reported_seq":2148,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.413848+0000","last_change":"2023-07-29T02:03:57.038137+0000","last_active":"2023-07-29T02:04:20.413848+0000","last_peered":"2023-07-29T02:04:20.413848+0000","last_clean":"2023-07-29T02:04:20.413848+0000","last_became_active":"2023-07-29T01:59:57.970733+0000","last_became_peered":"2023-07-29T01:59:57.970733+0000","last_unstale":"2023-07-29T02:04:20.413848+0000","last_undegraded":"2023-07-29T02:04:20.413848+0000","last_fullsized":"2023-07-29T02:04:20.413848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55358088100000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"35'86","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.978766+0000","last_change":"2023-07-29T02:03:57.111935+0000","last_active":"2023-07-29T02:04:21.978766+0000","last_peered":"2023-07-29T02:04:21.978766+0000","last_clean":"2023-07-29T02:04:21.978766+0000","last_became_active":"2023-07-29T01:59:57.964993+0000","last_became_peered":"2023-07-29T01:59:57.964993+0000","last_unstale":"2023-07-29T02:04:21.978766+0000","last_undegraded":"2023-07-29T02:04:21.978766+0000","last_fullsized":"2023-07-29T02:04:21.978766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35033357399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"39'100","reported_seq":2150,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.633716+0000","last_change":"2023-07-29T02:03:56.697037+0000","last_active":"2023-07-29T02:04:47.633716+0000","last_peered":"2023-07-29T02:04:47.633716+0000","last_clean":"2023-07-29T02:04:47.633716+0000","last_became_active":"2023-07-29T01:59:57.970232+0000","last_became_peered":"2023-07-29T01:59:57.970232+0000","last_unstale":"2023-07-29T02:04:47.633716+0000","last_undegraded":"2023-07-29T02:04:47.633716+0000","last_fullsized":"2023-07-29T02:04:47.633716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18952802499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"36'65","reported_seq":2115,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.815684+0000","last_change":"2023-07-29T02:03:56.788754+0000","last_active":"2023-07-29T02:04:21.815684+0000","last_peered":"2023-07-29T02:04:21.815684+0000","last_clean":"2023-07-29T02:04:21.815684+0000","last_became_active":"2023-07-29T01:59:57.962884+0000","last_became_peered":"2023-07-29T01:59:57.962884+0000","last_unstale":"2023-07-29T02:04:21.815684+0000","last_undegraded":"2023-07-29T02:04:21.815684+0000","last_fullsized":"2023-07-29T02:04:21.815684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30152641200000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"39'73","reported_seq":2123,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.635152+0000","last_change":"2023-07-29T02:03:57.034522+0000","last_active":"2023-07-29T02:04:47.635152+0000","last_peered":"2023-07-29T02:04:47.635152+0000","last_clean":"2023-07-29T02:04:47.635152+0000","last_became_active":"2023-07-29T01:59:57.971640+0000","last_became_peered":"2023-07-29T01:59:57.971640+0000","last_unstale":"2023-07-29T02:04:47.635152+0000","last_undegraded":"2023-07-29T02:04:47.635152+0000","last_fullsized":"2023-07-29T02:04:47.635152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54966345000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'83","reported_seq":2133,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.816709+0000","last_change":"2023-07-29T02:03:56.796189+0000","last_active":"2023-07-29T02:04:21.816709+0000","last_peered":"2023-07-29T02:04:21.816709+0000","last_clean":"2023-07-29T02:04:21.816709+0000","last_became_active":"2023-07-29T01:59:57.962799+0000","last_became_peered":"2023-07-29T01:59:57.962799+0000","last_unstale":"2023-07-29T02:04:21.816709+0000","last_undegraded":"2023-07-29T02:04:21.816709+0000","last_fullsized":"2023-07-29T02:04:21.816709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30635943199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"35'84","reported_seq":2134,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.979809+0000","last_change":"2023-07-29T02:03:57.107266+0000","last_active":"2023-07-29T02:04:21.979809+0000","last_peered":"2023-07-29T02:04:21.979809+0000","last_clean":"2023-07-29T02:04:21.979809+0000","last_became_active":"2023-07-29T01:59:57.969868+0000","last_became_peered":"2023-07-29T01:59:57.969868+0000","last_unstale":"2023-07-29T02:04:21.979809+0000","last_undegraded":"2023-07-29T02:04:21.979809+0000","last_fullsized":"2023-07-29T02:04:21.979809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37294171199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"36'69","reported_seq":2119,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.614635+0000","last_change":"2023-07-29T02:03:56.957883+0000","last_active":"2023-07-29T02:04:20.614635+0000","last_peered":"2023-07-29T02:04:20.614635+0000","last_clean":"2023-07-29T02:04:20.614635+0000","last_became_active":"2023-07-29T01:59:57.963902+0000","last_became_peered":"2023-07-29T01:59:57.963902+0000","last_unstale":"2023-07-29T02:04:20.614635+0000","last_undegraded":"2023-07-29T02:04:20.614635+0000","last_fullsized":"2023-07-29T02:04:20.614635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:51.691001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46909700500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"36'71","reported_seq":2121,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.613803+0000","last_change":"2023-07-29T02:03:56.954586+0000","last_active":"2023-07-29T02:04:20.613803+0000","last_peered":"2023-07-29T02:04:20.613803+0000","last_clean":"2023-07-29T02:04:20.613803+0000","last_became_active":"2023-07-29T01:59:57.963239+0000","last_became_peered":"2023-07-29T01:59:57.963239+0000","last_unstale":"2023-07-29T02:04:20.613803+0000","last_undegraded":"2023-07-29T02:04:20.613803+0000","last_fullsized":"2023-07-29T02:04:20.613803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:08.001986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46603159700000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"39'85","reported_seq":2135,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:39.452612+0000","last_change":"2023-07-29T02:03:56.789592+0000","last_active":"2023-07-29T02:04:39.452612+0000","last_peered":"2023-07-29T02:04:39.452612+0000","last_clean":"2023-07-29T02:04:39.452612+0000","last_became_active":"2023-07-29T01:59:57.960709+0000","last_became_peered":"2023-07-29T01:59:57.960709+0000","last_unstale":"2023-07-29T02:04:39.452612+0000","last_undegraded":"2023-07-29T02:04:39.452612+0000","last_fullsized":"2023-07-29T02:04:39.452612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30181124199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"35'78","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444090+0000","last_change":"2023-07-29T02:03:56.696099+0000","last_active":"2023-07-29T02:04:19.444090+0000","last_peered":"2023-07-29T02:04:19.444090+0000","last_clean":"2023-07-29T02:04:19.444090+0000","last_became_active":"2023-07-29T01:59:57.970263+0000","last_became_peered":"2023-07-29T01:59:57.970263+0000","last_unstale":"2023-07-29T02:04:19.444090+0000","last_undegraded":"2023-07-29T02:04:19.444090+0000","last_fullsized":"2023-07-29T02:04:19.444090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18892089500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"39'88","reported_seq":2138,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:39.442116+0000","last_change":"2023-07-29T02:03:57.113982+0000","last_active":"2023-07-29T02:04:39.442116+0000","last_peered":"2023-07-29T02:04:39.442116+0000","last_clean":"2023-07-29T02:04:39.442116+0000","last_became_active":"2023-07-29T01:59:57.964696+0000","last_became_peered":"2023-07-29T01:59:57.964696+0000","last_unstale":"2023-07-29T02:04:39.442116+0000","last_undegraded":"2023-07-29T02:04:39.442116+0000","last_fullsized":"2023-07-29T02:04:39.442116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:19:14.641252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.32990576199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"39'86","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:39.436873+0000","last_change":"2023-07-29T02:03:57.029741+0000","last_active":"2023-07-29T02:04:39.436873+0000","last_peered":"2023-07-29T02:04:39.436873+0000","last_clean":"2023-07-29T02:04:39.436873+0000","last_became_active":"2023-07-29T01:59:57.968885+0000","last_became_peered":"2023-07-29T01:59:57.968885+0000","last_unstale":"2023-07-29T02:04:39.436873+0000","last_undegraded":"2023-07-29T02:04:39.436873+0000","last_fullsized":"2023-07-29T02:04:39.436873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54488360899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"36'78","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.979073+0000","last_change":"2023-07-29T02:03:57.081083+0000","last_active":"2023-07-29T02:04:21.979073+0000","last_peered":"2023-07-29T02:04:21.979073+0000","last_clean":"2023-07-29T02:04:21.979073+0000","last_became_active":"2023-07-29T01:59:57.962919+0000","last_became_peered":"2023-07-29T01:59:57.962919+0000","last_unstale":"2023-07-29T02:04:21.979073+0000","last_undegraded":"2023-07-29T02:04:21.979073+0000","last_fullsized":"2023-07-29T02:04:21.979073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:16:58.718803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36591080100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"35'78","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.614282+0000","last_change":"2023-07-29T02:03:56.960427+0000","last_active":"2023-07-29T02:04:20.614282+0000","last_peered":"2023-07-29T02:04:20.614282+0000","last_clean":"2023-07-29T02:04:20.614282+0000","last_became_active":"2023-07-29T01:59:57.960111+0000","last_became_peered":"2023-07-29T01:59:57.960111+0000","last_unstale":"2023-07-29T02:04:20.614282+0000","last_undegraded":"2023-07-29T02:04:20.614282+0000","last_fullsized":"2023-07-29T02:04:20.614282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:45.956813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.47199195399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"39'90","reported_seq":2140,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:29.440975+0000","last_change":"2023-07-29T02:03:57.111175+0000","last_active":"2023-07-29T02:04:29.440975+0000","last_peered":"2023-07-29T02:04:29.440975+0000","last_clean":"2023-07-29T02:04:29.440975+0000","last_became_active":"2023-07-29T01:59:57.961655+0000","last_became_peered":"2023-07-29T01:59:57.961655+0000","last_unstale":"2023-07-29T02:04:29.440975+0000","last_undegraded":"2023-07-29T02:04:29.440975+0000","last_fullsized":"2023-07-29T02:04:29.440975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.203628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36267924800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"39'78","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:29.440537+0000","last_change":"2023-07-29T02:03:56.694890+0000","last_active":"2023-07-29T02:04:29.440537+0000","last_peered":"2023-07-29T02:04:29.440537+0000","last_clean":"2023-07-29T02:04:29.440537+0000","last_became_active":"2023-07-29T01:59:57.970757+0000","last_became_peered":"2023-07-29T01:59:57.970757+0000","last_unstale":"2023-07-29T02:04:29.440537+0000","last_undegraded":"2023-07-29T02:04:29.440537+0000","last_fullsized":"2023-07-29T02:04:29.440537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18738185399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"39'85","reported_seq":2135,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.636550+0000","last_change":"2023-07-29T02:03:57.025876+0000","last_active":"2023-07-29T02:04:47.636550+0000","last_peered":"2023-07-29T02:04:47.636550+0000","last_clean":"2023-07-29T02:04:47.636550+0000","last_became_active":"2023-07-29T01:59:57.974436+0000","last_became_peered":"2023-07-29T01:59:57.974436+0000","last_unstale":"2023-07-29T02:04:47.636550+0000","last_undegraded":"2023-07-29T02:04:47.636550+0000","last_fullsized":"2023-07-29T02:04:47.636550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54184882499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"35'84","reported_seq":2134,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.443274+0000","last_change":"2023-07-29T02:03:57.173218+0000","last_active":"2023-07-29T02:04:19.443274+0000","last_peered":"2023-07-29T02:04:19.443274+0000","last_clean":"2023-07-29T02:04:19.443274+0000","last_became_active":"2023-07-29T01:59:57.966987+0000","last_became_peered":"2023-07-29T01:59:57.966987+0000","last_unstale":"2023-07-29T02:04:19.443274+0000","last_undegraded":"2023-07-29T02:04:19.443274+0000","last_fullsized":"2023-07-29T02:04:19.443274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38162062000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"39'86","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.632776+0000","last_change":"2023-07-29T02:03:56.697590+0000","last_active":"2023-07-29T02:04:47.632776+0000","last_peered":"2023-07-29T02:04:47.632776+0000","last_clean":"2023-07-29T02:04:47.632776+0000","last_became_active":"2023-07-29T01:59:57.971733+0000","last_became_peered":"2023-07-29T01:59:57.971733+0000","last_unstale":"2023-07-29T02:04:47.632776+0000","last_undegraded":"2023-07-29T02:04:47.632776+0000","last_fullsized":"2023-07-29T02:04:47.632776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.189164111,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"36'81","reported_seq":2131,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.433572+0000","last_change":"2023-07-29T02:03:57.054022+0000","last_active":"2023-07-29T02:04:19.433572+0000","last_peered":"2023-07-29T02:04:19.433572+0000","last_clean":"2023-07-29T02:04:19.433572+0000","last_became_active":"2023-07-29T01:59:57.969742+0000","last_became_peered":"2023-07-29T01:59:57.969742+0000","last_unstale":"2023-07-29T02:04:19.433572+0000","last_undegraded":"2023-07-29T02:04:19.433572+0000","last_fullsized":"2023-07-29T02:04:19.433572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53981922100000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"35'94","reported_seq":2144,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.433559+0000","last_change":"2023-07-29T02:03:57.052073+0000","last_active":"2023-07-29T02:04:19.433559+0000","last_peered":"2023-07-29T02:04:19.433559+0000","last_clean":"2023-07-29T02:04:19.433559+0000","last_became_active":"2023-07-29T01:59:57.969409+0000","last_became_peered":"2023-07-29T01:59:57.969409+0000","last_unstale":"2023-07-29T02:04:19.433559+0000","last_undegraded":"2023-07-29T02:04:19.433559+0000","last_fullsized":"2023-07-29T02:04:19.433559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53315132300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"39'68","reported_seq":2118,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.816142+0000","last_change":"2023-07-29T02:03:56.792528+0000","last_active":"2023-07-29T02:04:21.816142+0000","last_peered":"2023-07-29T02:04:21.816142+0000","last_clean":"2023-07-29T02:04:21.816142+0000","last_became_active":"2023-07-29T01:59:57.963774+0000","last_became_peered":"2023-07-29T01:59:57.963774+0000","last_unstale":"2023-07-29T02:04:21.816142+0000","last_undegraded":"2023-07-29T02:04:21.816142+0000","last_fullsized":"2023-07-29T02:04:21.816142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30426659299999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"39'632","reported_seq":2711,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.903446+0000","last_change":"2023-07-29T02:03:57.112265+0000","last_active":"2023-07-29T02:06:07.903446+0000","last_peered":"2023-07-29T02:06:07.903446+0000","last_clean":"2023-07-29T02:06:07.903446+0000","last_became_active":"2023-07-29T02:00:01.993731+0000","last_became_peered":"2023-07-29T02:00:01.993731+0000","last_unstale":"2023-07-29T02:06:07.903446+0000","last_undegraded":"2023-07-29T02:06:07.903446+0000","last_fullsized":"2023-07-29T02:06:07.903446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:14:25.422754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35725884499999999,"stat_sum":{"num_bytes":48336376,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":31,"num_read_kb":16407,"num_write":630,"num_write_kb":51633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"39'156","reported_seq":190,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:08.990208+0000","last_change":"2023-07-29T01:59:57.552913+0000","last_active":"2023-07-29T02:06:08.990208+0000","last_peered":"2023-07-29T02:06:08.990208+0000","last_clean":"2023-07-29T02:06:08.990208+0000","last_became_active":"2023-07-29T01:59:57.552673+0000","last_became_peered":"2023-07-29T01:59:57.552673+0000","last_unstale":"2023-07-29T02:06:08.990208+0000","last_undegraded":"2023-07-29T02:06:08.990208+0000","last_fullsized":"2023-07-29T02:06:08.990208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:49:56.335019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":154,"num_write_kb":16499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"39'75","reported_seq":2125,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:50.633095+0000","last_change":"2023-07-29T02:03:57.172635+0000","last_active":"2023-07-29T02:04:50.633095+0000","last_peered":"2023-07-29T02:04:50.633095+0000","last_clean":"2023-07-29T02:04:50.633095+0000","last_became_active":"2023-07-29T01:59:57.969821+0000","last_became_peered":"2023-07-29T01:59:57.969821+0000","last_unstale":"2023-07-29T02:04:50.633095+0000","last_undegraded":"2023-07-29T02:04:50.633095+0000","last_fullsized":"2023-07-29T02:04:50.633095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.40087768200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'628","reported_seq":2717,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.103880+0000","last_change":"2023-07-29T02:03:56.981521+0000","last_active":"2023-07-29T02:06:07.103880+0000","last_peered":"2023-07-29T02:06:07.103880+0000","last_clean":"2023-07-29T02:06:07.103880+0000","last_became_active":"2023-07-29T02:00:01.992338+0000","last_became_peered":"2023-07-29T02:00:01.992338+0000","last_unstale":"2023-07-29T02:06:07.103880+0000","last_undegraded":"2023-07-29T02:06:07.103880+0000","last_fullsized":"2023-07-29T02:06:07.103880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:37.968145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20956234600000001,"stat_sum":{"num_bytes":44446362,"num_objects":309,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":41,"num_read_kb":16418,"num_write":628,"num_write_kb":43687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"39'20","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:49.437568+0000","last_change":"2023-07-29T01:59:57.547793+0000","last_active":"2023-07-29T02:04:49.437568+0000","last_peered":"2023-07-29T02:04:49.437568+0000","last_clean":"2023-07-29T02:04:49.437568+0000","last_became_active":"2023-07-29T01:59:57.547455+0000","last_became_peered":"2023-07-29T01:59:57.547455+0000","last_unstale":"2023-07-29T02:04:49.437568+0000","last_undegraded":"2023-07-29T02:04:49.437568+0000","last_fullsized":"2023-07-29T02:04:49.437568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":4125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"35'87","reported_seq":2138,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.413318+0000","last_change":"2023-07-29T02:03:57.037080+0000","last_active":"2023-07-29T02:04:20.413318+0000","last_peered":"2023-07-29T02:04:20.413318+0000","last_clean":"2023-07-29T02:04:20.413318+0000","last_became_active":"2023-07-29T01:59:57.964393+0000","last_became_peered":"2023-07-29T01:59:57.964393+0000","last_unstale":"2023-07-29T02:04:20.413318+0000","last_undegraded":"2023-07-29T02:04:20.413318+0000","last_fullsized":"2023-07-29T02:04:20.413318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55267013499999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"39'624","reported_seq":2705,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.294411+0000","last_change":"2023-07-29T02:03:57.037730+0000","last_active":"2023-07-29T02:06:07.294411+0000","last_peered":"2023-07-29T02:06:07.294411+0000","last_clean":"2023-07-29T02:06:07.294411+0000","last_became_active":"2023-07-29T02:00:01.982042+0000","last_became_peered":"2023-07-29T02:00:01.982042+0000","last_unstale":"2023-07-29T02:06:07.294411+0000","last_undegraded":"2023-07-29T02:06:07.294411+0000","last_fullsized":"2023-07-29T02:06:07.294411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55323541600000004,"stat_sum":{"num_bytes":17887936,"num_objects":308,"num_object_clones":0,"num_object_copies":1232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":308,"num_whiteouts":0,"num_read":32,"num_read_kb":5104,"num_write":624,"num_write_kb":17797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"39'130","reported_seq":163,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.544484+0000","last_change":"2023-07-29T01:59:57.535286+0000","last_active":"2023-07-29T02:05:51.544484+0000","last_peered":"2023-07-29T02:05:51.544484+0000","last_clean":"2023-07-29T02:05:51.544484+0000","last_became_active":"2023-07-29T01:59:57.533523+0000","last_became_peered":"2023-07-29T01:59:57.533523+0000","last_unstale":"2023-07-29T02:05:51.544484+0000","last_undegraded":"2023-07-29T02:05:51.544484+0000","last_fullsized":"2023-07-29T02:05:51.544484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":129,"num_write_kb":12373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"36'81","reported_seq":2132,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.445928+0000","last_change":"2023-07-29T02:03:56.982121+0000","last_active":"2023-07-29T02:04:19.445928+0000","last_peered":"2023-07-29T02:04:19.445928+0000","last_clean":"2023-07-29T02:04:19.445928+0000","last_became_active":"2023-07-29T01:59:57.963466+0000","last_became_peered":"2023-07-29T01:59:57.963466+0000","last_unstale":"2023-07-29T02:04:19.445928+0000","last_undegraded":"2023-07-29T02:04:19.445928+0000","last_fullsized":"2023-07-29T02:04:19.445928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:28.048947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.209911193,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"39'697","reported_seq":2784,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.146401+0000","last_change":"2023-07-29T02:03:56.977076+0000","last_active":"2023-07-29T02:06:07.146401+0000","last_peered":"2023-07-29T02:06:07.146401+0000","last_clean":"2023-07-29T02:06:07.146401+0000","last_became_active":"2023-07-29T02:00:01.984000+0000","last_became_peered":"2023-07-29T02:00:01.984000+0000","last_unstale":"2023-07-29T02:06:07.146401+0000","last_undegraded":"2023-07-29T02:06:07.146401+0000","last_fullsized":"2023-07-29T02:06:07.146401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.218444052,"stat_sum":{"num_bytes":33480822,"num_objects":367,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":39,"num_read_kb":11040,"num_write":700,"num_write_kb":41165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"39'3","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:49.438002+0000","last_change":"2023-07-29T01:59:57.537082+0000","last_active":"2023-07-29T02:04:49.438002+0000","last_peered":"2023-07-29T02:04:49.438002+0000","last_clean":"2023-07-29T02:04:49.438002+0000","last_became_active":"2023-07-29T01:59:57.536732+0000","last_became_peered":"2023-07-29T01:59:57.536732+0000","last_unstale":"2023-07-29T02:04:49.438002+0000","last_undegraded":"2023-07-29T02:04:49.438002+0000","last_fullsized":"2023-07-29T02:04:49.438002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"39'82","reported_seq":2132,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:39.451721+0000","last_change":"2023-07-29T02:03:57.174184+0000","last_active":"2023-07-29T02:04:39.451721+0000","last_peered":"2023-07-29T02:04:39.451721+0000","last_clean":"2023-07-29T02:04:39.451721+0000","last_became_active":"2023-07-29T01:59:57.970902+0000","last_became_peered":"2023-07-29T01:59:57.970902+0000","last_unstale":"2023-07-29T02:04:39.451721+0000","last_undegraded":"2023-07-29T02:04:39.451721+0000","last_fullsized":"2023-07-29T02:04:39.451721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.3723399,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'665","reported_seq":2750,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.428896+0000","last_change":"2023-07-29T02:03:56.697947+0000","last_active":"2023-07-29T02:06:07.428896+0000","last_peered":"2023-07-29T02:06:07.428896+0000","last_clean":"2023-07-29T02:06:07.428896+0000","last_became_active":"2023-07-29T02:00:01.989456+0000","last_became_peered":"2023-07-29T02:00:01.989456+0000","last_unstale":"2023-07-29T02:06:07.428896+0000","last_undegraded":"2023-07-29T02:06:07.428896+0000","last_fullsized":"2023-07-29T02:06:07.428896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.189839176,"stat_sum":{"num_bytes":37359948,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":38,"num_read_kb":16417,"num_write":659,"num_write_kb":40721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"39'35","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:10.160718+0000","last_change":"2023-07-29T01:59:57.540572+0000","last_active":"2023-07-29T02:06:10.160718+0000","last_peered":"2023-07-29T02:06:10.160718+0000","last_clean":"2023-07-29T02:06:10.160718+0000","last_became_active":"2023-07-29T01:59:57.540113+0000","last_became_peered":"2023-07-29T01:59:57.540113+0000","last_unstale":"2023-07-29T02:06:10.160718+0000","last_undegraded":"2023-07-29T02:06:10.160718+0000","last_fullsized":"2023-07-29T02:06:10.160718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":31,"num_write_kb":12312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"39'85","reported_seq":2135,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:39.451754+0000","last_change":"2023-07-29T02:03:57.171853+0000","last_active":"2023-07-29T02:04:39.451754+0000","last_peered":"2023-07-29T02:04:39.451754+0000","last_clean":"2023-07-29T02:04:39.451754+0000","last_became_active":"2023-07-29T01:59:57.967083+0000","last_became_peered":"2023-07-29T01:59:57.967083+0000","last_unstale":"2023-07-29T02:04:39.451754+0000","last_undegraded":"2023-07-29T02:04:39.451754+0000","last_fullsized":"2023-07-29T02:04:39.451754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38037237200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"39'632","reported_seq":2724,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:06.764691+0000","last_change":"2023-07-29T02:03:57.161825+0000","last_active":"2023-07-29T02:06:06.764691+0000","last_peered":"2023-07-29T02:06:06.764691+0000","last_clean":"2023-07-29T02:06:06.764691+0000","last_became_active":"2023-07-29T02:00:01.996035+0000","last_became_peered":"2023-07-29T02:00:01.996035+0000","last_unstale":"2023-07-29T02:06:06.764691+0000","last_undegraded":"2023-07-29T02:06:06.764691+0000","last_fullsized":"2023-07-29T02:06:06.764691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.39874443399999998,"stat_sum":{"num_bytes":20875244,"num_objects":313,"num_object_clones":0,"num_object_copies":1252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":44,"num_read_kb":4139,"num_write":632,"num_write_kb":28878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"39'67","reported_seq":107,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:12.525117+0000","last_change":"2023-07-29T01:59:57.548665+0000","last_active":"2023-07-29T02:06:12.525117+0000","last_peered":"2023-07-29T02:06:12.525117+0000","last_clean":"2023-07-29T02:06:12.525117+0000","last_became_active":"2023-07-29T01:59:57.547803+0000","last_became_peered":"2023-07-29T01:59:57.547803+0000","last_unstale":"2023-07-29T02:06:12.525117+0000","last_undegraded":"2023-07-29T02:06:12.525117+0000","last_fullsized":"2023-07-29T02:06:12.525117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":4114,"num_write":65,"num_write_kb":8245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"35'76","reported_seq":2126,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.926154+0000","last_change":"2023-07-29T02:03:57.049617+0000","last_active":"2023-07-29T02:04:21.926154+0000","last_peered":"2023-07-29T02:04:21.926154+0000","last_clean":"2023-07-29T02:04:21.926154+0000","last_became_active":"2023-07-29T01:59:57.969006+0000","last_became_peered":"2023-07-29T01:59:57.969006+0000","last_unstale":"2023-07-29T02:04:21.926154+0000","last_undegraded":"2023-07-29T02:04:21.926154+0000","last_fullsized":"2023-07-29T02:04:21.926154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:30:28.393515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53746501300000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"39'641","reported_seq":2734,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.766377+0000","last_change":"2023-07-29T02:03:57.052276+0000","last_active":"2023-07-29T02:06:07.766377+0000","last_peered":"2023-07-29T02:06:07.766377+0000","last_clean":"2023-07-29T02:06:07.766377+0000","last_became_active":"2023-07-29T02:00:01.995757+0000","last_became_peered":"2023-07-29T02:00:01.995757+0000","last_unstale":"2023-07-29T02:06:07.766377+0000","last_undegraded":"2023-07-29T02:06:07.766377+0000","last_fullsized":"2023-07-29T02:06:07.766377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:24:03.881006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.539926876,"stat_sum":{"num_bytes":20101741,"num_objects":314,"num_object_clones":0,"num_object_copies":1256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":45,"num_read_kb":20517,"num_write":638,"num_write_kb":32247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"39'124","reported_seq":173,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:48.029338+0000","last_change":"2023-07-29T01:59:57.541936+0000","last_active":"2023-07-29T02:05:48.029338+0000","last_peered":"2023-07-29T02:05:48.029338+0000","last_clean":"2023-07-29T02:05:48.029338+0000","last_became_active":"2023-07-29T01:59:57.541434+0000","last_became_peered":"2023-07-29T01:59:57.541434+0000","last_unstale":"2023-07-29T02:05:48.029338+0000","last_undegraded":"2023-07-29T02:05:48.029338+0000","last_fullsized":"2023-07-29T02:05:48.029338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":12324,"num_write":118,"num_write_kb":12357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"35'86","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.979595+0000","last_change":"2023-07-29T02:03:57.112781+0000","last_active":"2023-07-29T02:04:21.979595+0000","last_peered":"2023-07-29T02:04:21.979595+0000","last_clean":"2023-07-29T02:04:21.979595+0000","last_became_active":"2023-07-29T01:59:57.962459+0000","last_became_peered":"2023-07-29T01:59:57.962459+0000","last_unstale":"2023-07-29T02:04:21.979595+0000","last_undegraded":"2023-07-29T02:04:21.979595+0000","last_fullsized":"2023-07-29T02:04:21.979595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.34937986999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'591","reported_seq":2679,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.695555+0000","last_change":"2023-07-29T02:03:56.797439+0000","last_active":"2023-07-29T02:06:07.695555+0000","last_peered":"2023-07-29T02:06:07.695555+0000","last_clean":"2023-07-29T02:06:07.695555+0000","last_became_active":"2023-07-29T02:00:01.995827+0000","last_became_peered":"2023-07-29T02:00:01.995827+0000","last_unstale":"2023-07-29T02:06:07.695555+0000","last_undegraded":"2023-07-29T02:06:07.695555+0000","last_fullsized":"2023-07-29T02:06:07.695555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30893240100000002,"stat_sum":{"num_bytes":24035129,"num_objects":268,"num_object_clones":0,"num_object_copies":1072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":40,"num_read_kb":8228,"num_write":590,"num_write_kb":23787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"39'12","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.543460+0000","last_change":"2023-07-29T01:59:57.545705+0000","last_active":"2023-07-29T02:05:51.543460+0000","last_peered":"2023-07-29T02:05:51.543460+0000","last_clean":"2023-07-29T02:05:51.543460+0000","last_became_active":"2023-07-29T01:59:57.545406+0000","last_became_peered":"2023-07-29T01:59:57.545406+0000","last_unstale":"2023-07-29T02:05:51.543460+0000","last_undegraded":"2023-07-29T02:05:51.543460+0000","last_fullsized":"2023-07-29T02:05:51.543460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:31.903601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":8216,"num_write":11,"num_write_kb":8201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"39'75","reported_seq":2119,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:50.633311+0000","last_change":"2023-07-29T02:03:56.957227+0000","last_active":"2023-07-29T02:04:50.633311+0000","last_peered":"2023-07-29T02:04:50.633311+0000","last_clean":"2023-07-29T02:04:50.633311+0000","last_became_active":"2023-07-29T02:00:46.525331+0000","last_became_peered":"2023-07-29T02:00:46.525331+0000","last_unstale":"2023-07-29T02:04:50.633311+0000","last_undegraded":"2023-07-29T02:04:50.633311+0000","last_fullsized":"2023-07-29T02:04:50.633311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:44:39.930253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46925831499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"39'589","reported_seq":2661,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.254795+0000","last_change":"2023-07-29T02:03:57.172129+0000","last_active":"2023-07-29T02:06:07.254795+0000","last_peered":"2023-07-29T02:06:07.254795+0000","last_clean":"2023-07-29T02:06:07.254795+0000","last_became_active":"2023-07-29T02:00:01.996969+0000","last_became_peered":"2023-07-29T02:00:01.996969+0000","last_unstale":"2023-07-29T02:06:07.254795+0000","last_undegraded":"2023-07-29T02:06:07.254795+0000","last_fullsized":"2023-07-29T02:06:07.254795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:46:37.088979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.40090650999999999,"stat_sum":{"num_bytes":23342582,"num_objects":297,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":297,"num_whiteouts":0,"num_read":24,"num_read_kb":4119,"num_write":587,"num_write_kb":31305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"39'4","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.333735+0000","last_change":"2023-07-29T01:59:57.541115+0000","last_active":"2023-07-29T02:05:51.333735+0000","last_peered":"2023-07-29T02:05:51.333735+0000","last_clean":"2023-07-29T02:05:51.333735+0000","last_became_active":"2023-07-29T01:59:57.540800+0000","last_became_peered":"2023-07-29T01:59:57.540800+0000","last_unstale":"2023-07-29T02:05:51.333735+0000","last_undegraded":"2023-07-29T02:05:51.333735+0000","last_fullsized":"2023-07-29T02:05:51.333735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"39'77","reported_seq":2127,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.634663+0000","last_change":"2023-07-29T02:03:56.792291+0000","last_active":"2023-07-29T02:04:47.634663+0000","last_peered":"2023-07-29T02:04:47.634663+0000","last_clean":"2023-07-29T02:04:47.634663+0000","last_became_active":"2023-07-29T01:59:57.963510+0000","last_became_peered":"2023-07-29T01:59:57.963510+0000","last_unstale":"2023-07-29T02:04:47.634663+0000","last_undegraded":"2023-07-29T02:04:47.634663+0000","last_fullsized":"2023-07-29T02:04:47.634663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30420630999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"39'628","reported_seq":2717,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.247603+0000","last_change":"2023-07-29T02:03:57.173787+0000","last_active":"2023-07-29T02:06:07.247603+0000","last_peered":"2023-07-29T02:06:07.247603+0000","last_clean":"2023-07-29T02:06:07.247603+0000","last_became_active":"2023-07-29T02:00:01.996084+0000","last_became_peered":"2023-07-29T02:00:01.996084+0000","last_unstale":"2023-07-29T02:06:07.247603+0000","last_undegraded":"2023-07-29T02:06:07.247603+0000","last_fullsized":"2023-07-29T02:06:07.247603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:59:57.581952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38362237100000002,"stat_sum":{"num_bytes":15782931,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":41,"num_read_kb":8234,"num_write":627,"num_write_kb":19844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"39'2","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.887924+0000","last_change":"2023-07-29T01:59:57.548464+0000","last_active":"2023-07-29T02:05:51.887924+0000","last_peered":"2023-07-29T02:05:51.887924+0000","last_clean":"2023-07-29T02:05:51.887924+0000","last_became_active":"2023-07-29T01:59:57.548109+0000","last_became_peered":"2023-07-29T01:59:57.548109+0000","last_unstale":"2023-07-29T02:05:51.887924+0000","last_undegraded":"2023-07-29T02:05:51.887924+0000","last_fullsized":"2023-07-29T02:05:51.887924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:13.433053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"35'95","reported_seq":2145,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.414033+0000","last_change":"2023-07-29T02:03:57.037255+0000","last_active":"2023-07-29T02:04:20.414033+0000","last_peered":"2023-07-29T02:04:20.414033+0000","last_clean":"2023-07-29T02:04:20.414033+0000","last_became_active":"2023-07-29T01:59:57.961759+0000","last_became_peered":"2023-07-29T01:59:57.961759+0000","last_unstale":"2023-07-29T02:04:20.414033+0000","last_undegraded":"2023-07-29T02:04:20.414033+0000","last_fullsized":"2023-07-29T02:04:20.414033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55180089099999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"39'661","reported_seq":2754,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.775569+0000","last_change":"2023-07-29T02:03:56.798905+0000","last_active":"2023-07-29T02:06:07.775569+0000","last_peered":"2023-07-29T02:06:07.775569+0000","last_clean":"2023-07-29T02:06:07.775569+0000","last_became_active":"2023-07-29T02:00:01.992592+0000","last_became_peered":"2023-07-29T02:00:01.992592+0000","last_unstale":"2023-07-29T02:06:07.775569+0000","last_undegraded":"2023-07-29T02:06:07.775569+0000","last_fullsized":"2023-07-29T02:06:07.775569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:14:06.353802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30939737499999997,"stat_sum":{"num_bytes":46419699,"num_objects":303,"num_object_clones":0,"num_object_copies":1212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":303,"num_whiteouts":0,"num_read":45,"num_read_kb":20516,"num_write":660,"num_write_kb":45624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"39'98","reported_seq":151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:44.468105+0000","last_change":"2023-07-29T01:59:57.543707+0000","last_active":"2023-07-29T02:05:44.468105+0000","last_peered":"2023-07-29T02:05:44.468105+0000","last_clean":"2023-07-29T02:05:44.468105+0000","last_became_active":"2023-07-29T01:59:57.543398+0000","last_became_peered":"2023-07-29T01:59:57.543398+0000","last_unstale":"2023-07-29T02:05:44.468105+0000","last_undegraded":"2023-07-29T02:05:44.468105+0000","last_fullsized":"2023-07-29T02:05:44.468105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":8252,"num_write":102,"num_write_kb":8255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"39'81","reported_seq":2131,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:49.453150+0000","last_change":"2023-07-29T02:03:57.171910+0000","last_active":"2023-07-29T02:04:49.453150+0000","last_peered":"2023-07-29T02:04:49.453150+0000","last_clean":"2023-07-29T02:04:49.453150+0000","last_became_active":"2023-07-29T01:59:57.965962+0000","last_became_peered":"2023-07-29T01:59:57.965962+0000","last_unstale":"2023-07-29T02:04:49.453150+0000","last_undegraded":"2023-07-29T02:04:49.453150+0000","last_fullsized":"2023-07-29T02:04:49.453150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38151887499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"39'670","reported_seq":2767,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.907936+0000","last_change":"2023-07-29T02:03:56.698091+0000","last_active":"2023-07-29T02:06:07.907936+0000","last_peered":"2023-07-29T02:06:07.907936+0000","last_clean":"2023-07-29T02:06:07.907936+0000","last_became_active":"2023-07-29T02:00:01.992384+0000","last_became_peered":"2023-07-29T02:00:01.992384+0000","last_unstale":"2023-07-29T02:06:07.907936+0000","last_undegraded":"2023-07-29T02:06:07.907936+0000","last_fullsized":"2023-07-29T02:06:07.907936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19044205,"stat_sum":{"num_bytes":36575402,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":49,"num_read_kb":16426,"num_write":669,"num_write_kb":40161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"39'26","reported_seq":61,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:46.612297+0000","last_change":"2023-07-29T01:59:57.548392+0000","last_active":"2023-07-29T02:05:46.612297+0000","last_peered":"2023-07-29T02:05:46.612297+0000","last_clean":"2023-07-29T02:05:46.612297+0000","last_became_active":"2023-07-29T01:59:57.548084+0000","last_became_peered":"2023-07-29T01:59:57.548084+0000","last_unstale":"2023-07-29T02:05:46.612297+0000","last_undegraded":"2023-07-29T02:05:46.612297+0000","last_fullsized":"2023-07-29T02:05:46.612297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":27,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"35'83","reported_seq":2133,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.449967+0000","last_change":"2023-07-29T02:03:56.784306+0000","last_active":"2023-07-29T02:04:19.449967+0000","last_peered":"2023-07-29T02:04:19.449967+0000","last_clean":"2023-07-29T02:04:19.449967+0000","last_became_active":"2023-07-29T01:59:57.964626+0000","last_became_peered":"2023-07-29T01:59:57.964626+0000","last_unstale":"2023-07-29T02:04:19.449967+0000","last_undegraded":"2023-07-29T02:04:19.449967+0000","last_fullsized":"2023-07-29T02:04:19.449967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.297089139,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"39'673","reported_seq":2761,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.225534+0000","last_change":"2023-07-29T02:03:56.961858+0000","last_active":"2023-07-29T02:06:07.225534+0000","last_peered":"2023-07-29T02:06:07.225534+0000","last_clean":"2023-07-29T02:06:07.225534+0000","last_became_active":"2023-07-29T02:00:01.990579+0000","last_became_peered":"2023-07-29T02:00:01.990579+0000","last_unstale":"2023-07-29T02:06:07.225534+0000","last_undegraded":"2023-07-29T02:06:07.225534+0000","last_fullsized":"2023-07-29T02:06:07.225534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:11:53.398210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.47400464199999998,"stat_sum":{"num_bytes":32895626,"num_objects":333,"num_object_clones":0,"num_object_copies":1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":333,"num_whiteouts":0,"num_read":40,"num_read_kb":14736,"num_write":673,"num_write_kb":36572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"39'242","reported_seq":279,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.546339+0000","last_change":"2023-07-29T01:59:57.549270+0000","last_active":"2023-07-29T02:05:51.546339+0000","last_peered":"2023-07-29T02:05:51.546339+0000","last_clean":"2023-07-29T02:05:51.546339+0000","last_became_active":"2023-07-29T01:59:57.548981+0000","last_became_peered":"2023-07-29T01:59:57.548981+0000","last_unstale":"2023-07-29T02:05:51.546339+0000","last_undegraded":"2023-07-29T02:05:51.546339+0000","last_fullsized":"2023-07-29T02:05:51.546339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:05.783369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":244,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"39'91","reported_seq":2141,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.978727+0000","last_change":"2023-07-29T02:03:57.111934+0000","last_active":"2023-07-29T02:04:21.978727+0000","last_peered":"2023-07-29T02:04:21.978727+0000","last_clean":"2023-07-29T02:04:21.978727+0000","last_became_active":"2023-07-29T01:59:57.969501+0000","last_became_peered":"2023-07-29T01:59:57.969501+0000","last_unstale":"2023-07-29T02:04:21.978727+0000","last_undegraded":"2023-07-29T02:04:21.978727+0000","last_fullsized":"2023-07-29T02:04:21.978727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35565022000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"39'641","reported_seq":2727,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.163523+0000","last_change":"2023-07-29T02:03:56.959814+0000","last_active":"2023-07-29T02:06:07.163523+0000","last_peered":"2023-07-29T02:06:07.163523+0000","last_clean":"2023-07-29T02:06:07.163523+0000","last_became_active":"2023-07-29T02:00:01.989364+0000","last_became_peered":"2023-07-29T02:00:01.989364+0000","last_unstale":"2023-07-29T02:06:07.163523+0000","last_undegraded":"2023-07-29T02:06:07.163523+0000","last_fullsized":"2023-07-29T02:06:07.163523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:01:14.849757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.47145374600000001,"stat_sum":{"num_bytes":24224399,"num_objects":325,"num_object_clones":0,"num_object_copies":1300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":38,"num_read_kb":8228,"num_write":641,"num_write_kb":23994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"39'6","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:44.468681+0000","last_change":"2023-07-29T01:59:57.541329+0000","last_active":"2023-07-29T02:05:44.468681+0000","last_peered":"2023-07-29T02:05:44.468681+0000","last_clean":"2023-07-29T02:05:44.468681+0000","last_became_active":"2023-07-29T01:59:57.541056+0000","last_became_peered":"2023-07-29T01:59:57.541056+0000","last_unstale":"2023-07-29T02:05:44.468681+0000","last_undegraded":"2023-07-29T02:05:44.468681+0000","last_fullsized":"2023-07-29T02:05:44.468681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":8,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"35'83","reported_seq":2133,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444936+0000","last_change":"2023-07-29T02:03:56.982964+0000","last_active":"2023-07-29T02:04:19.444936+0000","last_peered":"2023-07-29T02:04:19.444936+0000","last_clean":"2023-07-29T02:04:19.444936+0000","last_became_active":"2023-07-29T01:59:57.974998+0000","last_became_peered":"2023-07-29T01:59:57.974998+0000","last_unstale":"2023-07-29T02:04:19.444936+0000","last_undegraded":"2023-07-29T02:04:19.444936+0000","last_fullsized":"2023-07-29T02:04:19.444936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:14.435169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20531364299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"39'660","reported_seq":2739,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.341472+0000","last_change":"2023-07-29T02:03:56.963785+0000","last_active":"2023-07-29T02:06:07.341472+0000","last_peered":"2023-07-29T02:06:07.341472+0000","last_clean":"2023-07-29T02:06:07.341472+0000","last_became_active":"2023-07-29T02:00:01.990276+0000","last_became_peered":"2023-07-29T02:00:01.990276+0000","last_unstale":"2023-07-29T02:06:07.341472+0000","last_undegraded":"2023-07-29T02:06:07.341472+0000","last_fullsized":"2023-07-29T02:06:07.341472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.47581172799999999,"stat_sum":{"num_bytes":20642551,"num_objects":321,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":321,"num_whiteouts":0,"num_read":31,"num_read_kb":1050,"num_write":661,"num_write_kb":24562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"39'8","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.543673+0000","last_change":"2023-07-29T01:59:57.544524+0000","last_active":"2023-07-29T02:05:51.543673+0000","last_peered":"2023-07-29T02:05:51.543673+0000","last_clean":"2023-07-29T02:05:51.543673+0000","last_became_active":"2023-07-29T01:59:57.544231+0000","last_became_peered":"2023-07-29T01:59:57.544231+0000","last_unstale":"2023-07-29T02:05:51.543673+0000","last_undegraded":"2023-07-29T02:05:51.543673+0000","last_fullsized":"2023-07-29T02:05:51.543673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"39'80","reported_seq":2130,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:29.435534+0000","last_change":"2023-07-29T02:03:57.033536+0000","last_active":"2023-07-29T02:04:29.435534+0000","last_peered":"2023-07-29T02:04:29.435534+0000","last_clean":"2023-07-29T02:04:29.435534+0000","last_became_active":"2023-07-29T01:59:57.974525+0000","last_became_peered":"2023-07-29T01:59:57.974525+0000","last_unstale":"2023-07-29T02:04:29.435534+0000","last_undegraded":"2023-07-29T02:04:29.435534+0000","last_fullsized":"2023-07-29T02:04:29.435534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.549422509,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"39'632","reported_seq":2721,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.136824+0000","last_change":"2023-07-29T02:03:56.961596+0000","last_active":"2023-07-29T02:06:07.136824+0000","last_peered":"2023-07-29T02:06:07.136824+0000","last_clean":"2023-07-29T02:06:07.136824+0000","last_became_active":"2023-07-29T02:00:01.988486+0000","last_became_peered":"2023-07-29T02:00:01.988486+0000","last_unstale":"2023-07-29T02:06:07.136824+0000","last_undegraded":"2023-07-29T02:06:07.136824+0000","last_fullsized":"2023-07-29T02:06:07.136824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:07.842328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.473472642,"stat_sum":{"num_bytes":32792736,"num_objects":300,"num_object_clones":0,"num_object_copies":1200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":300,"num_whiteouts":0,"num_read":41,"num_read_kb":18442,"num_write":630,"num_write_kb":40548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"39'375","reported_seq":411,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:55.655087+0000","last_change":"2023-07-29T01:59:57.535498+0000","last_active":"2023-07-29T02:05:55.655087+0000","last_peered":"2023-07-29T02:05:55.655087+0000","last_clean":"2023-07-29T02:05:55.655087+0000","last_became_active":"2023-07-29T01:59:57.534813+0000","last_became_peered":"2023-07-29T01:59:57.534813+0000","last_unstale":"2023-07-29T02:05:55.655087+0000","last_undegraded":"2023-07-29T02:05:55.655087+0000","last_fullsized":"2023-07-29T02:05:55.655087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":8198,"num_write":371,"num_write_kb":12605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"39'90","reported_seq":2140,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:29.440937+0000","last_change":"2023-07-29T02:03:57.110073+0000","last_active":"2023-07-29T02:04:29.440937+0000","last_peered":"2023-07-29T02:04:29.440937+0000","last_clean":"2023-07-29T02:04:29.440937+0000","last_became_active":"2023-07-29T01:59:57.962184+0000","last_became_peered":"2023-07-29T01:59:57.962184+0000","last_unstale":"2023-07-29T02:04:29.440937+0000","last_undegraded":"2023-07-29T02:04:29.440937+0000","last_fullsized":"2023-07-29T02:04:29.440937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36182750899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"39'688","reported_seq":2776,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.851869+0000","last_change":"2023-07-29T02:03:57.053859+0000","last_active":"2023-07-29T02:06:07.851869+0000","last_peered":"2023-07-29T02:06:07.851869+0000","last_clean":"2023-07-29T02:06:07.851869+0000","last_became_active":"2023-07-29T02:00:01.989151+0000","last_became_peered":"2023-07-29T02:00:01.989151+0000","last_unstale":"2023-07-29T02:06:07.851869+0000","last_undegraded":"2023-07-29T02:06:07.851869+0000","last_fullsized":"2023-07-29T02:06:07.851869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:21:35.031304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54490939800000004,"stat_sum":{"num_bytes":33219663,"num_objects":326,"num_object_clones":0,"num_object_copies":1304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":326,"num_whiteouts":0,"num_read":40,"num_read_kb":16418,"num_write":687,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"39'156","reported_seq":188,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:06.987414+0000","last_change":"2023-07-29T01:59:57.544466+0000","last_active":"2023-07-29T02:06:06.987414+0000","last_peered":"2023-07-29T02:06:06.987414+0000","last_clean":"2023-07-29T02:06:06.987414+0000","last_became_active":"2023-07-29T01:59:57.544120+0000","last_became_peered":"2023-07-29T01:59:57.544120+0000","last_unstale":"2023-07-29T02:06:06.987414+0000","last_undegraded":"2023-07-29T02:06:06.987414+0000","last_fullsized":"2023-07-29T02:06:06.987414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":155,"num_write_kb":8287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"39'86","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:29.441011+0000","last_change":"2023-07-29T02:03:57.107586+0000","last_active":"2023-07-29T02:04:29.441011+0000","last_peered":"2023-07-29T02:04:29.441011+0000","last_clean":"2023-07-29T02:04:29.441011+0000","last_became_active":"2023-07-29T01:59:57.961975+0000","last_became_peered":"2023-07-29T01:59:57.961975+0000","last_unstale":"2023-07-29T02:04:29.441011+0000","last_undegraded":"2023-07-29T02:04:29.441011+0000","last_fullsized":"2023-07-29T02:04:29.441011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:27:01.059953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37361334099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"39'646","reported_seq":2738,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.799960+0000","last_change":"2023-07-29T02:03:56.800119+0000","last_active":"2023-07-29T02:06:07.799960+0000","last_peered":"2023-07-29T02:06:07.799960+0000","last_clean":"2023-07-29T02:06:07.799960+0000","last_became_active":"2023-07-29T02:00:01.988155+0000","last_became_peered":"2023-07-29T02:00:01.988155+0000","last_unstale":"2023-07-29T02:06:07.799960+0000","last_undegraded":"2023-07-29T02:06:07.799960+0000","last_fullsized":"2023-07-29T02:06:07.799960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30982225000000002,"stat_sum":{"num_bytes":22073203,"num_objects":313,"num_object_clones":0,"num_object_copies":1252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":44,"num_read_kb":12328,"num_write":643,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"39'63","reported_seq":95,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:44.477329+0000","last_change":"2023-07-29T01:59:57.549764+0000","last_active":"2023-07-29T02:05:44.477329+0000","last_peered":"2023-07-29T02:05:44.477329+0000","last_clean":"2023-07-29T02:05:44.477329+0000","last_became_active":"2023-07-29T01:59:57.549470+0000","last_became_peered":"2023-07-29T01:59:57.549470+0000","last_unstale":"2023-07-29T02:05:44.477329+0000","last_undegraded":"2023-07-29T02:05:44.477329+0000","last_fullsized":"2023-07-29T02:05:44.477329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":64,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"35'60","reported_seq":2110,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.980241+0000","last_change":"2023-07-29T02:03:57.081019+0000","last_active":"2023-07-29T02:04:21.980241+0000","last_peered":"2023-07-29T02:04:21.980241+0000","last_clean":"2023-07-29T02:04:21.980241+0000","last_became_active":"2023-07-29T01:59:57.962016+0000","last_became_peered":"2023-07-29T01:59:57.962016+0000","last_unstale":"2023-07-29T02:04:21.980241+0000","last_undegraded":"2023-07-29T02:04:21.980241+0000","last_fullsized":"2023-07-29T02:04:21.980241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:08.813083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36599154900000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"39'565","reported_seq":2653,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.767129+0000","last_change":"2023-07-29T02:03:57.082127+0000","last_active":"2023-07-29T02:06:07.767129+0000","last_peered":"2023-07-29T02:06:07.767129+0000","last_clean":"2023-07-29T02:06:07.767129+0000","last_became_active":"2023-07-29T02:00:01.992042+0000","last_became_peered":"2023-07-29T02:00:01.992042+0000","last_unstale":"2023-07-29T02:06:07.767129+0000","last_undegraded":"2023-07-29T02:06:07.767129+0000","last_fullsized":"2023-07-29T02:06:07.767129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:24:44.331640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36734029699999998,"stat_sum":{"num_bytes":17472104,"num_objects":288,"num_object_clones":0,"num_object_copies":1152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":40,"num_read_kb":12324,"num_write":565,"num_write_kb":21394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"39'10","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.552303+0000","last_change":"2023-07-29T01:59:57.537045+0000","last_active":"2023-07-29T02:05:51.552303+0000","last_peered":"2023-07-29T02:05:51.552303+0000","last_clean":"2023-07-29T02:05:51.552303+0000","last_became_active":"2023-07-29T01:59:57.535762+0000","last_became_peered":"2023-07-29T01:59:57.535762+0000","last_unstale":"2023-07-29T02:05:51.552303+0000","last_undegraded":"2023-07-29T02:05:51.552303+0000","last_fullsized":"2023-07-29T02:05:51.552303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":13,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"36'78","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.927518+0000","last_change":"2023-07-29T02:03:57.049662+0000","last_active":"2023-07-29T02:04:21.927518+0000","last_peered":"2023-07-29T02:04:21.927518+0000","last_clean":"2023-07-29T02:04:21.927518+0000","last_became_active":"2023-07-29T01:59:57.974834+0000","last_became_peered":"2023-07-29T01:59:57.974834+0000","last_unstale":"2023-07-29T02:04:21.927518+0000","last_undegraded":"2023-07-29T02:04:21.927518+0000","last_fullsized":"2023-07-29T02:04:21.927518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53560260199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"39'713","reported_seq":2791,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:08.028422+0000","last_change":"2023-07-29T02:03:57.112720+0000","last_active":"2023-07-29T02:06:08.028422+0000","last_peered":"2023-07-29T02:06:08.028422+0000","last_clean":"2023-07-29T02:06:08.028422+0000","last_became_active":"2023-07-29T02:00:01.990464+0000","last_became_peered":"2023-07-29T02:00:01.990464+0000","last_unstale":"2023-07-29T02:06:08.028422+0000","last_undegraded":"2023-07-29T02:06:08.028422+0000","last_fullsized":"2023-07-29T02:06:08.028422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:16:46.676860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.356278702,"stat_sum":{"num_bytes":25950589,"num_objects":363,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":363,"num_whiteouts":0,"num_read":30,"num_read_kb":4124,"num_write":712,"num_write_kb":29793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"39'162","reported_seq":199,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:54.757116+0000","last_change":"2023-07-29T01:59:57.540561+0000","last_active":"2023-07-29T02:05:54.757116+0000","last_peered":"2023-07-29T02:05:54.757116+0000","last_clean":"2023-07-29T02:05:54.757116+0000","last_became_active":"2023-07-29T01:59:57.540292+0000","last_became_peered":"2023-07-29T01:59:57.540292+0000","last_unstale":"2023-07-29T02:05:54.757116+0000","last_undegraded":"2023-07-29T02:05:54.757116+0000","last_fullsized":"2023-07-29T02:05:54.757116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":162,"num_write_kb":4206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.981740+0000","last_change":"2023-07-29T01:59:52.448098+0000","last_active":"2023-07-29T02:04:21.981740+0000","last_peered":"2023-07-29T02:04:21.981740+0000","last_clean":"2023-07-29T02:04:21.981740+0000","last_became_active":"2023-07-29T01:59:52.447782+0000","last_became_peered":"2023-07-29T01:59:52.447782+0000","last_unstale":"2023-07-29T02:04:21.981740+0000","last_undegraded":"2023-07-29T02:04:21.981740+0000","last_fullsized":"2023-07-29T02:04:21.981740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:31.981804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"35'75","reported_seq":2126,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.442789+0000","last_change":"2023-07-29T02:03:57.173984+0000","last_active":"2023-07-29T02:04:19.442789+0000","last_peered":"2023-07-29T02:04:19.442789+0000","last_clean":"2023-07-29T02:04:19.442789+0000","last_became_active":"2023-07-29T01:59:57.966065+0000","last_became_peered":"2023-07-29T01:59:57.966065+0000","last_unstale":"2023-07-29T02:04:19.442789+0000","last_undegraded":"2023-07-29T02:04:19.442789+0000","last_fullsized":"2023-07-29T02:04:19.442789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37241656400000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"39'677","reported_seq":2773,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:06.908171+0000","last_change":"2023-07-29T02:03:57.174632+0000","last_active":"2023-07-29T02:06:06.908171+0000","last_peered":"2023-07-29T02:06:06.908171+0000","last_clean":"2023-07-29T02:06:06.908171+0000","last_became_active":"2023-07-29T02:00:01.995963+0000","last_became_peered":"2023-07-29T02:00:01.995963+0000","last_unstale":"2023-07-29T02:06:06.908171+0000","last_undegraded":"2023-07-29T02:06:06.908171+0000","last_fullsized":"2023-07-29T02:06:06.908171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:06:19.130853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.373304892,"stat_sum":{"num_bytes":14135733,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":47,"num_read_kb":4140,"num_write":679,"num_write_kb":14069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444185+0000","last_change":"2023-07-29T01:59:52.445649+0000","last_active":"2023-07-29T02:04:19.444185+0000","last_peered":"2023-07-29T02:04:19.444185+0000","last_clean":"2023-07-29T02:04:19.444185+0000","last_became_active":"2023-07-29T01:59:52.445337+0000","last_became_peered":"2023-07-29T01:59:52.445337+0000","last_unstale":"2023-07-29T02:04:19.444185+0000","last_undegraded":"2023-07-29T02:04:19.444185+0000","last_fullsized":"2023-07-29T02:04:19.444185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"39'36","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:04.716354+0000","last_change":"2023-07-29T01:59:57.537863+0000","last_active":"2023-07-29T02:06:04.716354+0000","last_peered":"2023-07-29T02:06:04.716354+0000","last_clean":"2023-07-29T02:06:04.716354+0000","last_became_active":"2023-07-29T01:59:57.537581+0000","last_became_peered":"2023-07-29T01:59:57.537581+0000","last_unstale":"2023-07-29T02:06:04.716354+0000","last_undegraded":"2023-07-29T02:06:04.716354+0000","last_fullsized":"2023-07-29T02:06:04.716354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:02:57.137574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8,"num_write":80,"num_write_kb":1322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"36'77","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.980339+0000","last_change":"2023-07-29T02:03:57.112487+0000","last_active":"2023-07-29T02:04:21.980339+0000","last_peered":"2023-07-29T02:04:21.980339+0000","last_clean":"2023-07-29T02:04:21.980339+0000","last_became_active":"2023-07-29T01:59:57.961298+0000","last_became_peered":"2023-07-29T01:59:57.961298+0000","last_unstale":"2023-07-29T02:04:21.980339+0000","last_undegraded":"2023-07-29T02:04:21.980339+0000","last_fullsized":"2023-07-29T02:04:21.980339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:11:49.956637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35104021600000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"39'622","reported_seq":2707,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.797342+0000","last_change":"2023-07-29T02:03:56.799516+0000","last_active":"2023-07-29T02:06:07.797342+0000","last_peered":"2023-07-29T02:06:07.797342+0000","last_clean":"2023-07-29T02:06:07.797342+0000","last_became_active":"2023-07-29T02:00:01.986915+0000","last_became_peered":"2023-07-29T02:00:01.986915+0000","last_unstale":"2023-07-29T02:06:07.797342+0000","last_undegraded":"2023-07-29T02:06:07.797342+0000","last_fullsized":"2023-07-29T02:06:07.797342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:35:48.256508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30985112500000001,"stat_sum":{"num_bytes":28815426,"num_objects":291,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":291,"num_whiteouts":0,"num_read":37,"num_read_kb":4131,"num_write":621,"num_write_kb":32518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.926459+0000","last_change":"2023-07-29T01:59:52.448423+0000","last_active":"2023-07-29T02:04:21.926459+0000","last_peered":"2023-07-29T02:04:21.926459+0000","last_clean":"2023-07-29T02:04:21.926459+0000","last_became_active":"2023-07-29T01:59:52.448052+0000","last_became_peered":"2023-07-29T01:59:52.448052+0000","last_unstale":"2023-07-29T02:04:21.926459+0000","last_undegraded":"2023-07-29T02:04:21.926459+0000","last_fullsized":"2023-07-29T02:04:21.926459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:31.981804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":185,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444525+0000","last_change":"2023-07-29T01:59:52.450730+0000","last_active":"2023-07-29T02:04:19.444525+0000","last_peered":"2023-07-29T02:04:19.444525+0000","last_clean":"2023-07-29T02:04:19.444525+0000","last_became_active":"2023-07-29T01:59:52.449582+0000","last_became_peered":"2023-07-29T01:59:52.449582+0000","last_unstale":"2023-07-29T02:04:19.444525+0000","last_undegraded":"2023-07-29T02:04:19.444525+0000","last_fullsized":"2023-07-29T02:04:19.444525+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:01:27.099648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"39'65","reported_seq":161,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:38.653219+0000","last_change":"2023-07-29T01:59:57.546474+0000","last_active":"2023-07-29T02:05:38.653219+0000","last_peered":"2023-07-29T02:05:38.653219+0000","last_clean":"2023-07-29T02:05:38.653219+0000","last_became_active":"2023-07-29T01:59:57.546179+0000","last_became_peered":"2023-07-29T01:59:57.546179+0000","last_unstale":"2023-07-29T02:05:38.653219+0000","last_undegraded":"2023-07-29T02:05:38.653219+0000","last_fullsized":"2023-07-29T02:05:38.653219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576046,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":608,"num_write":63,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"36'86","reported_seq":2136,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.434643+0000","last_change":"2023-07-29T02:03:57.038626+0000","last_active":"2023-07-29T02:04:19.434643+0000","last_peered":"2023-07-29T02:04:19.434643+0000","last_clean":"2023-07-29T02:04:19.434643+0000","last_became_active":"2023-07-29T01:59:57.975078+0000","last_became_peered":"2023-07-29T01:59:57.975078+0000","last_unstale":"2023-07-29T02:04:19.434643+0000","last_undegraded":"2023-07-29T02:04:19.434643+0000","last_fullsized":"2023-07-29T02:04:19.434643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55319968200000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"39'709","reported_seq":2807,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.742045+0000","last_change":"2023-07-29T02:03:56.966106+0000","last_active":"2023-07-29T02:06:07.742045+0000","last_peered":"2023-07-29T02:06:07.742045+0000","last_clean":"2023-07-29T02:06:07.742045+0000","last_became_active":"2023-07-29T02:00:01.986937+0000","last_became_peered":"2023-07-29T02:00:01.986937+0000","last_unstale":"2023-07-29T02:06:07.742045+0000","last_undegraded":"2023-07-29T02:06:07.742045+0000","last_fullsized":"2023-07-29T02:06:07.742045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:53.580244+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.47715394799999999,"stat_sum":{"num_bytes":40554601,"num_objects":344,"num_object_clones":0,"num_object_copies":1376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":344,"num_whiteouts":0,"num_read":51,"num_read_kb":15453,"num_write":703,"num_write_kb":39978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444967+0000","last_change":"2023-07-29T01:59:53.171806+0000","last_active":"2023-07-29T02:04:19.444967+0000","last_peered":"2023-07-29T02:04:19.444967+0000","last_clean":"2023-07-29T02:04:19.444967+0000","last_became_active":"2023-07-29T01:59:53.171467+0000","last_became_peered":"2023-07-29T01:59:53.171467+0000","last_unstale":"2023-07-29T02:04:19.444967+0000","last_undegraded":"2023-07-29T02:04:19.444967+0000","last_fullsized":"2023-07-29T02:04:19.444967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"39'249","reported_seq":285,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.552980+0000","last_change":"2023-07-29T01:59:57.549442+0000","last_active":"2023-07-29T02:05:51.552980+0000","last_peered":"2023-07-29T02:05:51.552980+0000","last_clean":"2023-07-29T02:05:51.552980+0000","last_became_active":"2023-07-29T01:59:57.549151+0000","last_became_peered":"2023-07-29T01:59:57.549151+0000","last_unstale":"2023-07-29T02:05:51.552980+0000","last_undegraded":"2023-07-29T02:05:51.552980+0000","last_fullsized":"2023-07-29T02:05:51.552980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":11035,"num_write":246,"num_write_kb":12456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"39'83","reported_seq":2133,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.927123+0000","last_change":"2023-07-29T02:03:57.051306+0000","last_active":"2023-07-29T02:04:21.927123+0000","last_peered":"2023-07-29T02:04:21.927123+0000","last_clean":"2023-07-29T02:04:21.927123+0000","last_became_active":"2023-07-29T01:59:57.969273+0000","last_became_peered":"2023-07-29T01:59:57.969273+0000","last_unstale":"2023-07-29T02:04:21.927123+0000","last_undegraded":"2023-07-29T02:04:21.927123+0000","last_fullsized":"2023-07-29T02:04:21.927123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:56:07.949649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53741308300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"39'638","reported_seq":2718,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.440171+0000","last_change":"2023-07-29T02:03:56.696365+0000","last_active":"2023-07-29T02:06:07.440171+0000","last_peered":"2023-07-29T02:06:07.440171+0000","last_clean":"2023-07-29T02:06:07.440171+0000","last_became_active":"2023-07-29T02:00:01.992406+0000","last_became_peered":"2023-07-29T02:00:01.992406+0000","last_unstale":"2023-07-29T02:06:07.440171+0000","last_undegraded":"2023-07-29T02:06:07.440171+0000","last_fullsized":"2023-07-29T02:06:07.440171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:12.254656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18856821800000001,"stat_sum":{"num_bytes":24793019,"num_objects":324,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":324,"num_whiteouts":0,"num_read":32,"num_read_kb":11492,"num_write":638,"num_write_kb":27823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444207+0000","last_change":"2023-07-29T01:59:53.171746+0000","last_active":"2023-07-29T02:04:19.444207+0000","last_peered":"2023-07-29T02:04:19.444207+0000","last_clean":"2023-07-29T02:04:19.444207+0000","last_became_active":"2023-07-29T01:59:53.171440+0000","last_became_peered":"2023-07-29T01:59:53.171440+0000","last_unstale":"2023-07-29T02:04:19.444207+0000","last_undegraded":"2023-07-29T02:04:19.444207+0000","last_fullsized":"2023-07-29T02:04:19.444207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:17:56.960611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"39'5","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:44.477182+0000","last_change":"2023-07-29T01:59:57.537970+0000","last_active":"2023-07-29T02:05:44.477182+0000","last_peered":"2023-07-29T02:05:44.477182+0000","last_clean":"2023-07-29T02:05:44.477182+0000","last_became_active":"2023-07-29T01:59:57.537665+0000","last_became_peered":"2023-07-29T01:59:57.537665+0000","last_unstale":"2023-07-29T02:05:44.477182+0000","last_undegraded":"2023-07-29T02:05:44.477182+0000","last_fullsized":"2023-07-29T02:05:44.477182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":4,"num_write_kb":8199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"35'79","reported_seq":2130,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.445095+0000","last_change":"2023-07-29T02:03:56.981337+0000","last_active":"2023-07-29T02:04:19.445095+0000","last_peered":"2023-07-29T02:04:19.445095+0000","last_clean":"2023-07-29T02:04:19.445095+0000","last_became_active":"2023-07-29T01:59:57.968373+0000","last_became_peered":"2023-07-29T01:59:57.968373+0000","last_unstale":"2023-07-29T02:04:19.445095+0000","last_undegraded":"2023-07-29T02:04:19.445095+0000","last_fullsized":"2023-07-29T02:04:19.445095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:06.785485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21661398800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"39'634","reported_seq":2720,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.594640+0000","last_change":"2023-07-29T02:03:57.040708+0000","last_active":"2023-07-29T02:06:07.594640+0000","last_peered":"2023-07-29T02:06:07.594640+0000","last_clean":"2023-07-29T02:06:07.594640+0000","last_became_active":"2023-07-29T02:00:01.984476+0000","last_became_peered":"2023-07-29T02:00:01.984476+0000","last_unstale":"2023-07-29T02:06:07.594640+0000","last_undegraded":"2023-07-29T02:06:07.594640+0000","last_fullsized":"2023-07-29T02:06:07.594640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55548792300000005,"stat_sum":{"num_bytes":35592378,"num_objects":339,"num_object_clones":0,"num_object_copies":1356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":339,"num_whiteouts":0,"num_read":38,"num_read_kb":16563,"num_write":635,"num_write_kb":39103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.815399+0000","last_change":"2023-07-29T01:59:53.172039+0000","last_active":"2023-07-29T02:04:21.815399+0000","last_peered":"2023-07-29T02:04:21.815399+0000","last_clean":"2023-07-29T02:04:21.815399+0000","last_became_active":"2023-07-29T01:59:53.171617+0000","last_became_peered":"2023-07-29T01:59:53.171617+0000","last_unstale":"2023-07-29T02:04:21.815399+0000","last_undegraded":"2023-07-29T02:04:21.815399+0000","last_fullsized":"2023-07-29T02:04:21.815399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"39'14","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:54.756200+0000","last_change":"2023-07-29T01:59:57.540888+0000","last_active":"2023-07-29T02:05:54.756200+0000","last_peered":"2023-07-29T02:05:54.756200+0000","last_clean":"2023-07-29T02:05:54.756200+0000","last_became_active":"2023-07-29T01:59:57.540449+0000","last_became_peered":"2023-07-29T01:59:57.540449+0000","last_unstale":"2023-07-29T02:05:54.756200+0000","last_undegraded":"2023-07-29T02:05:54.756200+0000","last_fullsized":"2023-07-29T02:05:54.756200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"35'81","reported_seq":2132,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.926453+0000","last_change":"2023-07-29T02:03:57.049030+0000","last_active":"2023-07-29T02:04:21.926453+0000","last_peered":"2023-07-29T02:04:21.926453+0000","last_clean":"2023-07-29T02:04:21.926453+0000","last_became_active":"2023-07-29T01:59:57.967933+0000","last_became_peered":"2023-07-29T01:59:57.967933+0000","last_unstale":"2023-07-29T02:04:21.926453+0000","last_undegraded":"2023-07-29T02:04:21.926453+0000","last_fullsized":"2023-07-29T02:04:21.926453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54069509900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"39'665","reported_seq":2750,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.868250+0000","last_change":"2023-07-29T02:03:56.982796+0000","last_active":"2023-07-29T02:06:07.868250+0000","last_peered":"2023-07-29T02:06:07.868250+0000","last_clean":"2023-07-29T02:06:07.868250+0000","last_became_active":"2023-07-29T02:00:01.984691+0000","last_became_peered":"2023-07-29T02:00:01.984691+0000","last_unstale":"2023-07-29T02:06:07.868250+0000","last_undegraded":"2023-07-29T02:06:07.868250+0000","last_fullsized":"2023-07-29T02:06:07.868250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:54.400954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.204776021,"stat_sum":{"num_bytes":24859419,"num_objects":316,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":316,"num_whiteouts":0,"num_read":37,"num_read_kb":6702,"num_write":664,"num_write_kb":28713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:14.449534+0000","last_change":"2023-07-29T01:59:53.171808+0000","last_active":"2023-07-29T02:04:14.449534+0000","last_peered":"2023-07-29T02:04:14.449534+0000","last_clean":"2023-07-29T02:04:14.449534+0000","last_became_active":"2023-07-29T01:59:53.171463+0000","last_became_peered":"2023-07-29T01:59:53.171463+0000","last_unstale":"2023-07-29T02:04:14.449534+0000","last_undegraded":"2023-07-29T02:04:14.449534+0000","last_fullsized":"2023-07-29T02:04:14.449534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:07:59.559814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"39'7","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:54.755973+0000","last_change":"2023-07-29T01:59:57.549468+0000","last_active":"2023-07-29T02:05:54.755973+0000","last_peered":"2023-07-29T02:05:54.755973+0000","last_clean":"2023-07-29T02:05:54.755973+0000","last_became_active":"2023-07-29T01:59:57.549181+0000","last_became_peered":"2023-07-29T01:59:57.549181+0000","last_unstale":"2023-07-29T02:05:54.755973+0000","last_undegraded":"2023-07-29T02:05:54.755973+0000","last_fullsized":"2023-07-29T02:05:54.755973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"39'90","reported_seq":2141,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:38.656184+0000","last_change":"2023-07-29T02:03:57.036363+0000","last_active":"2023-07-29T02:05:38.656184+0000","last_peered":"2023-07-29T02:05:38.656184+0000","last_clean":"2023-07-29T02:05:38.656184+0000","last_became_active":"2023-07-29T01:59:57.963659+0000","last_became_peered":"2023-07-29T01:59:57.963659+0000","last_unstale":"2023-07-29T02:05:38.656184+0000","last_undegraded":"2023-07-29T02:05:38.656184+0000","last_fullsized":"2023-07-29T02:05:38.656184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55193447900000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"39'682","reported_seq":2770,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.773690+0000","last_change":"2023-07-29T02:03:57.036172+0000","last_active":"2023-07-29T02:06:07.773690+0000","last_peered":"2023-07-29T02:06:07.773690+0000","last_clean":"2023-07-29T02:06:07.773690+0000","last_became_active":"2023-07-29T02:00:01.983744+0000","last_became_peered":"2023-07-29T02:00:01.983744+0000","last_unstale":"2023-07-29T02:06:07.773690+0000","last_undegraded":"2023-07-29T02:06:07.773690+0000","last_fullsized":"2023-07-29T02:06:07.773690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.552203522,"stat_sum":{"num_bytes":32278530,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":40,"num_read_kb":16416,"num_write":683,"num_write_kb":31830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:14.449587+0000","last_change":"2023-07-29T01:59:52.449102+0000","last_active":"2023-07-29T02:04:14.449587+0000","last_peered":"2023-07-29T02:04:14.449587+0000","last_clean":"2023-07-29T02:04:14.449587+0000","last_became_active":"2023-07-29T01:59:52.448814+0000","last_became_peered":"2023-07-29T01:59:52.448814+0000","last_unstale":"2023-07-29T02:04:14.449587+0000","last_undegraded":"2023-07-29T02:04:14.449587+0000","last_fullsized":"2023-07-29T02:04:14.449587+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"39'425","reported_seq":458,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:47.148677+0000","last_change":"2023-07-29T01:59:57.544590+0000","last_active":"2023-07-29T02:05:47.148677+0000","last_peered":"2023-07-29T02:05:47.148677+0000","last_clean":"2023-07-29T02:05:47.148677+0000","last_became_active":"2023-07-29T01:59:57.544317+0000","last_became_peered":"2023-07-29T01:59:57.544317+0000","last_unstale":"2023-07-29T02:05:47.148677+0000","last_undegraded":"2023-07-29T02:05:47.148677+0000","last_fullsized":"2023-07-29T02:05:47.148677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":424,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"39'82","reported_seq":2133,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.637540+0000","last_change":"2023-07-29T02:03:57.049937+0000","last_active":"2023-07-29T02:04:47.637540+0000","last_peered":"2023-07-29T02:04:47.637540+0000","last_clean":"2023-07-29T02:04:47.637540+0000","last_became_active":"2023-07-29T01:59:57.969642+0000","last_became_peered":"2023-07-29T01:59:57.969642+0000","last_unstale":"2023-07-29T02:04:47.637540+0000","last_undegraded":"2023-07-29T02:04:47.637540+0000","last_fullsized":"2023-07-29T02:04:47.637540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53741660000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"39'637","reported_seq":2730,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.912007+0000","last_change":"2023-07-29T02:03:57.053813+0000","last_active":"2023-07-29T02:06:07.912007+0000","last_peered":"2023-07-29T02:06:07.912007+0000","last_clean":"2023-07-29T02:06:07.912007+0000","last_became_active":"2023-07-29T02:00:01.998715+0000","last_became_peered":"2023-07-29T02:00:01.998715+0000","last_unstale":"2023-07-29T02:06:07.912007+0000","last_undegraded":"2023-07-29T02:06:07.912007+0000","last_fullsized":"2023-07-29T02:06:07.912007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54131381700000003,"stat_sum":{"num_bytes":21401745,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":45,"num_read_kb":12330,"num_write":635,"num_write_kb":33528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"39'136","reported_seq":168,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:44.477484+0000","last_change":"2023-07-29T01:59:57.545933+0000","last_active":"2023-07-29T02:05:44.477484+0000","last_peered":"2023-07-29T02:05:44.477484+0000","last_clean":"2023-07-29T02:05:44.477484+0000","last_became_active":"2023-07-29T01:59:57.545744+0000","last_became_peered":"2023-07-29T01:59:57.545744+0000","last_unstale":"2023-07-29T02:05:44.477484+0000","last_undegraded":"2023-07-29T02:05:44.477484+0000","last_fullsized":"2023-07-29T02:05:44.477484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":139,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"39'83","reported_seq":2133,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:38.656358+0000","last_change":"2023-07-29T02:03:56.956561+0000","last_active":"2023-07-29T02:05:38.656358+0000","last_peered":"2023-07-29T02:05:38.656358+0000","last_clean":"2023-07-29T02:05:38.656358+0000","last_became_active":"2023-07-29T01:59:57.970252+0000","last_became_peered":"2023-07-29T01:59:57.970252+0000","last_unstale":"2023-07-29T02:05:38.656358+0000","last_undegraded":"2023-07-29T02:05:38.656358+0000","last_fullsized":"2023-07-29T02:05:38.656358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:09.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46822948199999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"39'637","reported_seq":2723,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.452647+0000","last_change":"2023-07-29T02:03:56.694563+0000","last_active":"2023-07-29T02:06:07.452647+0000","last_peered":"2023-07-29T02:06:07.452647+0000","last_clean":"2023-07-29T02:06:07.452647+0000","last_became_active":"2023-07-29T02:00:01.989481+0000","last_became_peered":"2023-07-29T02:00:01.989481+0000","last_unstale":"2023-07-29T02:06:07.452647+0000","last_undegraded":"2023-07-29T02:06:07.452647+0000","last_fullsized":"2023-07-29T02:06:07.452647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.187630984,"stat_sum":{"num_bytes":25047033,"num_objects":309,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":38,"num_read_kb":8227,"num_write":637,"num_write_kb":24796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"39'112","reported_seq":149,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.553859+0000","last_change":"2023-07-29T01:59:57.543782+0000","last_active":"2023-07-29T02:05:51.553859+0000","last_peered":"2023-07-29T02:05:51.553859+0000","last_clean":"2023-07-29T02:05:51.553859+0000","last_became_active":"2023-07-29T01:59:57.543445+0000","last_became_peered":"2023-07-29T01:59:57.543445+0000","last_unstale":"2023-07-29T02:05:51.553859+0000","last_undegraded":"2023-07-29T02:05:51.553859+0000","last_fullsized":"2023-07-29T02:05:51.553859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":114,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"39'82","reported_seq":2132,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:45.626039+0000","last_change":"2023-07-29T02:03:57.113153+0000","last_active":"2023-07-29T02:04:45.626039+0000","last_peered":"2023-07-29T02:04:45.626039+0000","last_clean":"2023-07-29T02:04:45.626039+0000","last_became_active":"2023-07-29T01:59:57.964925+0000","last_became_peered":"2023-07-29T01:59:57.964925+0000","last_unstale":"2023-07-29T02:04:45.626039+0000","last_undegraded":"2023-07-29T02:04:45.626039+0000","last_fullsized":"2023-07-29T02:04:45.626039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35003659399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'665","reported_seq":2749,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:08.030901+0000","last_change":"2023-07-29T02:03:56.799552+0000","last_active":"2023-07-29T02:06:08.030901+0000","last_peered":"2023-07-29T02:06:08.030901+0000","last_clean":"2023-07-29T02:06:08.030901+0000","last_became_active":"2023-07-29T02:00:01.985310+0000","last_became_peered":"2023-07-29T02:00:01.985310+0000","last_unstale":"2023-07-29T02:06:08.030901+0000","last_undegraded":"2023-07-29T02:06:08.030901+0000","last_fullsized":"2023-07-29T02:06:08.030901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.31035642899999999,"stat_sum":{"num_bytes":19557603,"num_objects":304,"num_object_clones":0,"num_object_copies":1216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":304,"num_whiteouts":0,"num_read":36,"num_read_kb":35,"num_write":665,"num_write_kb":19402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"39'86","reported_seq":125,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:11.297549+0000","last_change":"2023-07-29T01:59:57.541908+0000","last_active":"2023-07-29T02:06:11.297549+0000","last_peered":"2023-07-29T02:06:11.297549+0000","last_clean":"2023-07-29T02:06:11.297549+0000","last_became_active":"2023-07-29T01:59:57.541633+0000","last_became_peered":"2023-07-29T01:59:57.541633+0000","last_unstale":"2023-07-29T02:06:11.297549+0000","last_undegraded":"2023-07-29T02:06:11.297549+0000","last_fullsized":"2023-07-29T02:06:11.297549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":18,"num_read_kb":12303,"num_write":84,"num_write_kb":16462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'78","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.979692+0000","last_change":"2023-07-29T02:03:57.113037+0000","last_active":"2023-07-29T02:04:21.979692+0000","last_peered":"2023-07-29T02:04:21.979692+0000","last_clean":"2023-07-29T02:04:21.979692+0000","last_became_active":"2023-07-29T01:59:57.965383+0000","last_became_peered":"2023-07-29T01:59:57.965383+0000","last_unstale":"2023-07-29T02:04:21.979692+0000","last_undegraded":"2023-07-29T02:04:21.979692+0000","last_fullsized":"2023-07-29T02:04:21.979692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.352110162,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"39'676","reported_seq":2763,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:08.039437+0000","last_change":"2023-07-29T02:03:57.114115+0000","last_active":"2023-07-29T02:06:08.039437+0000","last_peered":"2023-07-29T02:06:08.039437+0000","last_clean":"2023-07-29T02:06:08.039437+0000","last_became_active":"2023-07-29T02:00:01.993454+0000","last_became_peered":"2023-07-29T02:00:01.993454+0000","last_unstale":"2023-07-29T02:06:08.039437+0000","last_undegraded":"2023-07-29T02:06:08.039437+0000","last_fullsized":"2023-07-29T02:06:08.039437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:46.998657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.33100711700000002,"stat_sum":{"num_bytes":33339861,"num_objects":341,"num_object_clones":0,"num_object_copies":1364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":0,"num_read":39,"num_read_kb":19097,"num_write":677,"num_write_kb":41065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"39'102","reported_seq":135,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.348314+0000","last_change":"2023-07-29T01:59:57.539625+0000","last_active":"2023-07-29T02:06:07.348314+0000","last_peered":"2023-07-29T02:06:07.348314+0000","last_clean":"2023-07-29T02:06:07.348314+0000","last_became_active":"2023-07-29T01:59:57.539181+0000","last_became_peered":"2023-07-29T01:59:57.539181+0000","last_unstale":"2023-07-29T02:06:07.348314+0000","last_undegraded":"2023-07-29T02:06:07.348314+0000","last_fullsized":"2023-07-29T02:06:07.348314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:02:57.137574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":98,"num_write_kb":8257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'81","reported_seq":2131,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.442789+0000","last_change":"2023-07-29T02:03:57.171546+0000","last_active":"2023-07-29T02:04:19.442789+0000","last_peered":"2023-07-29T02:04:19.442789+0000","last_clean":"2023-07-29T02:04:19.442789+0000","last_became_active":"2023-07-29T01:59:57.966580+0000","last_became_peered":"2023-07-29T01:59:57.966580+0000","last_unstale":"2023-07-29T02:04:19.442789+0000","last_undegraded":"2023-07-29T02:04:19.442789+0000","last_fullsized":"2023-07-29T02:04:19.442789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.203628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38010548900000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"39'649","reported_seq":2735,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.663320+0000","last_change":"2023-07-29T02:03:57.046097+0000","last_active":"2023-07-29T02:06:07.663320+0000","last_peered":"2023-07-29T02:06:07.663320+0000","last_clean":"2023-07-29T02:06:07.663320+0000","last_became_active":"2023-07-29T02:00:01.985554+0000","last_became_peered":"2023-07-29T02:00:01.985554+0000","last_unstale":"2023-07-29T02:06:07.663320+0000","last_undegraded":"2023-07-29T02:06:07.663320+0000","last_fullsized":"2023-07-29T02:06:07.663320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:50:50.164635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53877218400000004,"stat_sum":{"num_bytes":39819276,"num_objects":290,"num_object_clones":0,"num_object_copies":1160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":290,"num_whiteouts":0,"num_read":38,"num_read_kb":16418,"num_write":646,"num_write_kb":43313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"39'135","reported_seq":174,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:55.844482+0000","last_change":"2023-07-29T01:59:57.537754+0000","last_active":"2023-07-29T02:05:55.844482+0000","last_peered":"2023-07-29T02:05:55.844482+0000","last_clean":"2023-07-29T02:05:55.844482+0000","last_became_active":"2023-07-29T01:59:57.537457+0000","last_became_peered":"2023-07-29T01:59:57.537457+0000","last_unstale":"2023-07-29T02:05:55.844482+0000","last_undegraded":"2023-07-29T02:05:55.844482+0000","last_fullsized":"2023-07-29T02:05:55.844482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":132,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"35'101","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.978778+0000","last_change":"2023-07-29T02:03:57.113779+0000","last_active":"2023-07-29T02:04:21.978778+0000","last_peered":"2023-07-29T02:04:21.978778+0000","last_clean":"2023-07-29T02:04:21.978778+0000","last_became_active":"2023-07-29T01:59:57.960318+0000","last_became_peered":"2023-07-29T01:59:57.960318+0000","last_unstale":"2023-07-29T02:04:21.978778+0000","last_undegraded":"2023-07-29T02:04:21.978778+0000","last_fullsized":"2023-07-29T02:04:21.978778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:01:11.408184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.32984874600000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"39'98","reported_seq":2149,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:45.626430+0000","last_change":"2023-07-29T02:03:56.970824+0000","last_active":"2023-07-29T02:04:45.626430+0000","last_peered":"2023-07-29T02:04:45.626430+0000","last_clean":"2023-07-29T02:04:45.626430+0000","last_became_active":"2023-07-29T01:59:57.959960+0000","last_became_peered":"2023-07-29T01:59:57.959960+0000","last_unstale":"2023-07-29T02:04:45.626430+0000","last_undegraded":"2023-07-29T02:04:45.626430+0000","last_fullsized":"2023-07-29T02:04:45.626430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22491762700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"35'98","reported_seq":2149,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.443452+0000","last_change":"2023-07-29T02:03:57.173410+0000","last_active":"2023-07-29T02:04:19.443452+0000","last_peered":"2023-07-29T02:04:19.443452+0000","last_clean":"2023-07-29T02:04:19.443452+0000","last_became_active":"2023-07-29T01:59:57.975384+0000","last_became_peered":"2023-07-29T01:59:57.975384+0000","last_unstale":"2023-07-29T02:04:19.443452+0000","last_undegraded":"2023-07-29T02:04:19.443452+0000","last_fullsized":"2023-07-29T02:04:19.443452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38175464599999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"35'93","reported_seq":2144,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.978776+0000","last_change":"2023-07-29T02:03:57.112576+0000","last_active":"2023-07-29T02:04:21.978776+0000","last_peered":"2023-07-29T02:04:21.978776+0000","last_clean":"2023-07-29T02:04:21.978776+0000","last_became_active":"2023-07-29T01:59:57.967603+0000","last_became_peered":"2023-07-29T01:59:57.967603+0000","last_unstale":"2023-07-29T02:04:21.978776+0000","last_undegraded":"2023-07-29T02:04:21.978776+0000","last_fullsized":"2023-07-29T02:04:21.978776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:24:00.439433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.350807488,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"35'92","reported_seq":2143,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.442970+0000","last_change":"2023-07-29T02:03:57.150968+0000","last_active":"2023-07-29T02:04:19.442970+0000","last_peered":"2023-07-29T02:04:19.442970+0000","last_clean":"2023-07-29T02:04:19.442970+0000","last_became_active":"2023-07-29T01:59:57.966672+0000","last_became_peered":"2023-07-29T01:59:57.966672+0000","last_unstale":"2023-07-29T02:04:19.442970+0000","last_undegraded":"2023-07-29T02:04:19.442970+0000","last_fullsized":"2023-07-29T02:04:19.442970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.39433596799999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'75","reported_seq":2125,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.433509+0000","last_change":"2023-07-29T02:03:57.048829+0000","last_active":"2023-07-29T02:04:19.433509+0000","last_peered":"2023-07-29T02:04:19.433509+0000","last_clean":"2023-07-29T02:04:19.433509+0000","last_became_active":"2023-07-29T01:59:57.968449+0000","last_became_peered":"2023-07-29T01:59:57.968449+0000","last_unstale":"2023-07-29T02:04:19.433509+0000","last_undegraded":"2023-07-29T02:04:19.433509+0000","last_fullsized":"2023-07-29T02:04:19.433509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54020755499999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":918109667,"num_objects":10158,"num_object_clones":0,"num_object_copies":40632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10158,"num_whiteouts":0,"num_read":1251,"num_read_kb":366219,"num_write":20739,"num_write_kb":1040888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1801621504,"data_stored":1952874496,"data_compressed":122947712,"data_compressed_allocated":138481664,"data_compressed_original":289734656,"omap_allocated":0,"internal_metadata":0},"log_size":20767,"ondisk_log_size":20767,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5272,"ondisk_log_size":5272,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":214487020,"num_objects":137,"num_object_clones":0,"num_object_copies":274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":137,"num_whiteouts":0,"num_read":307,"num_read_kb":151137,"num_write":3106,"num_write_kb":213424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":85409792,"data_stored":428974040,"data_compressed":54140070,"data_compressed_allocated":68378624,"data_compressed_original":412000256,"omap_allocated":0,"internal_metadata":0},"log_size":3071,"ondisk_log_size":3071,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":287904,"kb_used_data":220760,"kb_used_omap":0,"kb_used_meta":67136,"kb_avail":94083936,"statfs":{"total":96636764160,"available":96341950464,"internally_reserved":0,"allocated":226058240,"data_stored":291929737,"data_compressed":24027719,"data_compressed_allocated":28098560,"data_compressed_original":94220288,"omap_allocated":0,"internal_metadata":68747264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.56000000000000005,"15min":0.51300000000000001},"min":{"1min":0.26400000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.751,"5min":6.0650000000000004,"15min":6.0650000000000004},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.54900000000000004,"15min":0.51700000000000002},"min":{"1min":0.30199999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61599999999999999,"5min":3.988,"15min":3.988},"last":0.28999999999999998}]},{"osd":1,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.66400000000000003,"15min":0.56200000000000006},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.70099999999999996,"5min":10.303000000000001,"15min":10.303000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.79800000000000004,"15min":0.625},"min":{"1min":0.32900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.80100000000000005,"5min":19.527999999999999,"15min":19.527999999999999},"last":0.27500000000000002}]},{"osd":2,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.63400000000000001,"15min":0.59299999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70499999999999996,"5min":6.9720000000000004,"15min":6.9720000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.58399999999999996,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63400000000000001,"5min":3.8260000000000001,"15min":3.8260000000000001},"last":0.40200000000000002}]},{"osd":3,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72999999999999998,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.57799999999999996,"15min":0.60599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.77700000000000002,"5min":1.22,"15min":1.22},"last":0.39100000000000001}]},{"osd":4,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47899999999999998,"15min":0.52700000000000002},"min":{"1min":0.32200000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66100000000000003,"5min":1.454,"15min":1.454},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.51100000000000001,"15min":0.55900000000000005},"min":{"1min":0.30599999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.0249999999999999,"5min":1.244,"15min":1.244},"last":0.31900000000000001}]},{"osd":5,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.50900000000000001,"15min":0.55900000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70799999999999996,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.53400000000000003,"15min":0.57099999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75800000000000001,"5min":3.621,"15min":3.621},"last":0.41399999999999998}]},{"osd":6,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55600000000000005,"15min":0.60299999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.74399999999999999,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.372},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.58099999999999996,"15min":0.627},"min":{"1min":0.37,"5min":0.312,"15min":0.312},"max":{"1min":0.79600000000000004,"5min":3.488,"15min":3.488},"last":0.45800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":239676,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":245428224,"data_stored":280369393,"data_compressed":17301447,"data_compressed_allocated":19628032,"data_compressed_original":54792192,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.57699999999999996,"15min":0.54000000000000004},"min":{"1min":0.33200000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.65300000000000002,"5min":7,"15min":7},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.627,"15min":0.56100000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.59399999999999997,"5min":6.4619999999999997,"15min":6.4619999999999997},"last":0.64900000000000002}]},{"osd":1,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.64700000000000002,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70199999999999996,"5min":12.462,"15min":12.462},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.626,"15min":0.58899999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.63900000000000001,"5min":6.4130000000000003,"15min":6.4130000000000003},"last":0.61099999999999999}]},{"osd":2,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.629,"5min":1.367,"15min":1.367},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.60299999999999998,"15min":0.57499999999999996},"min":{"1min":0.39800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.65600000000000003,"5min":5.5330000000000004,"15min":5.5330000000000004},"last":0.52400000000000002}]},{"osd":3,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.65700000000000003,"15min":0.59899999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70799999999999996,"5min":6.4889999999999999,"15min":6.4889999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.64500000000000002,"15min":0.61499999999999999},"min":{"1min":0.40400000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.69599999999999995,"5min":6.8559999999999999,"15min":6.8559999999999999},"last":0.46400000000000002}]},{"osd":4,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.68600000000000005,"15min":0.58799999999999997},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68000000000000005,"5min":24.123999999999999,"15min":24.123999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.32700000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.70999999999999996,"5min":6.3710000000000004,"15min":6.3710000000000004},"last":0.41799999999999998}]},{"osd":5,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48499999999999999,"15min":0.53900000000000003},"min":{"1min":0.33900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68899999999999995,"5min":0.82999999999999996,"15min":1.1140000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59499999999999997,"15min":0.58299999999999996},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73199999999999998,"5min":6.9669999999999996,"15min":6.9669999999999996},"last":0.33600000000000002}]},{"osd":7,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.34999999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73299999999999998,"5min":5.484,"15min":5.484},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59599999999999997,"15min":0.61699999999999999},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.71299999999999997,"5min":5.2300000000000004,"15min":5.2300000000000004},"last":0.39700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371428,"kb_used_data":268188,"kb_used_omap":0,"kb_used_meta":103232,"kb_avail":94000412,"statfs":{"total":96636764160,"available":96256421888,"internally_reserved":0,"allocated":274624512,"data_stored":329542417,"data_compressed":22309908,"data_compressed_allocated":25948160,"data_compressed_original":81092608,"omap_allocated":0,"internal_metadata":105709568},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.39000000000000001,"15min":0.51400000000000001},"min":{"1min":0.25,"5min":0.20799999999999999,"15min":0.20399999999999999},"max":{"1min":0.441,"5min":3.7989999999999999,"15min":7.1299999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.38600000000000001,"15min":0.51000000000000001},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57099999999999995,"5min":0.94599999999999995,"15min":5.4779999999999998},"last":0.38700000000000001}]},{"osd":2,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.61299999999999999,"15min":0.88900000000000001},"min":{"1min":0.23300000000000001,"5min":0.214,"15min":0.20899999999999999},"max":{"1min":0.47799999999999998,"5min":22.483000000000001,"15min":22.483000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.44,"15min":0.67800000000000005},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56599999999999995,"5min":3.0619999999999998,"15min":11.028},"last":0.434}]},{"osd":3,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46899999999999997,"15min":0.59999999999999998},"min":{"1min":0.33300000000000002,"5min":0.27000000000000002,"15min":0.26800000000000002},"max":{"1min":0.54200000000000004,"5min":2.9900000000000002,"15min":7.1699999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.41999999999999998,"15min":0.39600000000000002},"min":{"1min":0.28399999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.51500000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.63}]},{"osd":4,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.70199999999999996,"15min":1.048},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78500000000000003,"5min":5.7809999999999997,"15min":17.925000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.625,"15min":0.86699999999999999},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79800000000000004,"5min":3.0329999999999999,"15min":10.961},"last":0.59599999999999997}]},{"osd":5,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.60599999999999998,"15min":0.71099999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79700000000000004,"5min":0.878,"15min":5.391},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.70699999999999996,"15min":1.0880000000000001},"min":{"1min":0.45100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86399999999999999,"5min":5.8849999999999998,"15min":17.994},"last":0.50900000000000001}]},{"osd":6,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.629,"15min":0.73999999999999999},"min":{"1min":0.40100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80800000000000005,"5min":0.91300000000000003,"15min":5.452},"last":0.755},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.72499999999999998,"15min":1.077},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82999999999999996,"5min":5.8540000000000001,"15min":17.963999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.67400000000000004,"15min":0.89000000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.755,"5min":3.0880000000000001,"15min":10.994},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67300000000000004,"15min":0.76300000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83499999999999996,"5min":2.9889999999999999,"15min":5.4249999999999998},"last":0.72799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":327772,"kb_used_data":238484,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94044068,"statfs":{"total":96636764160,"available":96301125632,"internally_reserved":0,"allocated":244207616,"data_stored":304944485,"data_compressed":22705554,"data_compressed_allocated":26374144,"data_compressed_original":87339008,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.77600000000000002,"15min":0.47799999999999998},"min":{"1min":0.20999999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.55500000000000005,"5min":39.070999999999998,"15min":39.070999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.435,"15min":0.38900000000000001},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.439,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":0.39900000000000002}]},{"osd":2,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.54600000000000004,"15min":0.45200000000000001},"min":{"1min":0.311,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.58899999999999997,"5min":10.438000000000001,"15min":10.438000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.55900000000000005,"15min":0.45700000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51700000000000002,"5min":10.802,"15min":10.802},"last":0.45900000000000002}]},{"osd":3,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.46500000000000002,"15min":0.39900000000000002},"min":{"1min":0.251,"5min":0.246,"15min":0.246},"max":{"1min":0.48699999999999999,"5min":4.6879999999999997,"15min":4.6879999999999997},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.50900000000000001,"15min":0.45300000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63600000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.48499999999999999}]},{"osd":4,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74099999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.67300000000000004,"15min":0.629},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.84599999999999997,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.52800000000000002}]},{"osd":5,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.374,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76900000000000002,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.63,"15min":0.624},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84999999999999998,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.57599999999999996}]},{"osd":6,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.68000000000000005,"15min":0.64700000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92200000000000004,"5min":1.663,"15min":1.663},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.40500000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.74099999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.67500000000000004,"15min":0.65000000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":1.496,"15min":1.496},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.67800000000000005,"15min":0.66100000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.61899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263968,"kb_used_data":200920,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":94107872,"statfs":{"total":96636764160,"available":96366460928,"internally_reserved":0,"allocated":205742080,"data_stored":235444465,"data_compressed":13107136,"data_compressed_allocated":15015936,"data_compressed_original":44941312,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.46300000000000002,"15min":0.39600000000000002},"min":{"1min":0.22800000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.53600000000000003,"5min":10.795999999999999,"15min":10.795999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.53700000000000003,"15min":0.66100000000000003},"min":{"1min":0.253,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.496,"5min":16.536999999999999,"15min":16.536999999999999},"last":0.30199999999999999}]},{"osd":1,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44900000000000001,"15min":0.55700000000000005},"min":{"1min":0.28499999999999998,"5min":0.223,"15min":0.223},"max":{"1min":0.68400000000000005,"5min":5.2160000000000002,"15min":6.1040000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.47599999999999998,"15min":0.435},"min":{"1min":0.311,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.53900000000000003,"5min":7.4880000000000004,"15min":7.4880000000000004},"last":0.39300000000000002}]},{"osd":3,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42699999999999999,"15min":0.40500000000000003},"min":{"1min":0.28599999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53800000000000003,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.504,"15min":0.61399999999999999},"min":{"1min":0.31,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.60399999999999998,"5min":5.4240000000000004,"15min":6.0620000000000003},"last":0.55400000000000005}]},{"osd":4,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.63700000000000001,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71299999999999997,"5min":5.2919999999999998,"15min":5.2919999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.67100000000000004,"15min":0.65900000000000003},"min":{"1min":0.42199999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77200000000000002,"5min":6.3300000000000001,"15min":6.3300000000000001},"last":0.48099999999999998}]},{"osd":5,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67700000000000005,"15min":0.65800000000000003},"min":{"1min":0.39200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.77300000000000002,"5min":6.149,"15min":6.149},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.89300000000000002,"15min":0.92800000000000005},"min":{"1min":0.38100000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77900000000000003,"5min":28.702000000000002,"15min":28.702000000000002},"last":0.49299999999999999}]},{"osd":6,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65100000000000002,"15min":0.85799999999999998},"min":{"1min":0.40300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.76400000000000001,"5min":4.5179999999999998,"15min":9.1199999999999992},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67800000000000005,"15min":0.65800000000000003},"min":{"1min":0.442,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86899999999999999,"5min":5.2530000000000001,"15min":5.2530000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.69399999999999995,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80100000000000005,"5min":6.2930000000000001,"15min":6.2930000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.67900000000000005,"15min":0.88500000000000001},"min":{"1min":0.433,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79400000000000004,"5min":4.4809999999999999,"15min":9.1620000000000008},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284232,"kb_used_data":199040,"kb_used_omap":0,"kb_used_meta":85184,"kb_avail":94087608,"statfs":{"total":96636764160,"available":96345710592,"internally_reserved":0,"allocated":203816960,"data_stored":281896330,"data_compressed":24201301,"data_compressed_allocated":28655616,"data_compressed_original":106958848,"omap_allocated":0,"internal_metadata":87228416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.36599999999999999,"15min":0.34100000000000003},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.57099999999999995,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35699999999999998,"15min":0.36599999999999999},"min":{"1min":0.24299999999999999,"5min":0.23200000000000001,"15min":0.22900000000000001},"max":{"1min":0.54100000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.38500000000000001}]},{"osd":1,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.44700000000000001,"15min":0.38600000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54000000000000004,"5min":9.7289999999999992,"15min":9.7289999999999992},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.47599999999999998,"15min":0.41399999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.21299999999999999},"max":{"1min":0.58199999999999996,"5min":7.4989999999999997,"15min":7.4989999999999997},"last":0.56599999999999995}]},{"osd":2,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40899999999999997,"15min":0.40699999999999997},"min":{"1min":0.28399999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.59999999999999998,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.45000000000000001,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68600000000000005,"5min":1.603,"15min":1.603},"last":0.48199999999999998}]},{"osd":4,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.34399999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81699999999999995,"5min":0.95899999999999996,"15min":0.96599999999999997},"last":0.505},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.68500000000000005,"15min":0.64000000000000001},"min":{"1min":0.375,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.74399999999999999,"5min":8.6869999999999994,"15min":8.6869999999999994},"last":0.498}]},{"osd":5,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67900000000000005,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.63400000000000001,"15min":0.60799999999999998},"min":{"1min":0.38,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88100000000000001,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.54000000000000004}]},{"osd":6,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67800000000000005,"15min":0.64700000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81200000000000006,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.65100000000000002,"15min":0.65600000000000003},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.61299999999999999}]},{"osd":7,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.70799999999999996,"15min":0.64400000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84899999999999998,"5min":8.7289999999999992,"15min":8.7289999999999992},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86499999999999999,"5min":1.0309999999999999,"15min":1.119},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":355056,"kb_used_data":251816,"kb_used_omap":0,"kb_used_meta":103232,"kb_avail":94016784,"statfs":{"total":96636764160,"available":96273186816,"internally_reserved":0,"allocated":257859584,"data_stored":353359351,"data_compressed":29870574,"data_compressed_allocated":35307520,"data_compressed_original":131047424,"omap_allocated":0,"internal_metadata":105709568},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.61099999999999999,"15min":0.54000000000000004},"min":{"1min":0.31900000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.68200000000000005,"5min":4.4800000000000004,"15min":4.4800000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.57299999999999995,"15min":0.84499999999999997},"min":{"1min":0.28399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.69499999999999995,"5min":7.2679999999999998,"15min":12.231999999999999},"last":0.66000000000000003}]},{"osd":1,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.55700000000000005,"15min":0.51500000000000001},"min":{"1min":0.29399999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.65100000000000002,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.54700000000000004,"15min":0.53100000000000003},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66700000000000004,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.58699999999999997}]},{"osd":2,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.34200000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68400000000000005,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65900000000000003,"5min":0.874,"15min":0.874},"last":0.63400000000000001}]},{"osd":3,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63200000000000001,"5min":3.9969999999999999,"15min":3.9969999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.96199999999999997,"15min":0.69199999999999995},"min":{"1min":0.40899999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67100000000000004,"5min":28.837,"15min":28.837},"last":0.52600000000000002}]},{"osd":5,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.48099999999999998,"15min":0.496},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.69499999999999995,"5min":1.8,"15min":1.8},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48699999999999999,"15min":0.501},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60199999999999998,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.36099999999999999}]},{"osd":6,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51800000000000002,"15min":0.50800000000000001},"min":{"1min":0.314,"5min":0.311,"15min":0.311},"max":{"1min":0.623,"5min":1.006,"15min":1.006},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54100000000000004,"15min":0.54900000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71999999999999997,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.40300000000000002}]},{"osd":7,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64300000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57599999999999996},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67500000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.45600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574929,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":293648,"kb_used_data":226504,"kb_used_omap":0,"kb_used_meta":67136,"kb_avail":94078192,"statfs":{"total":96636764160,"available":96336068608,"internally_reserved":0,"allocated":231940096,"data_stored":303070077,"data_compressed":22818421,"data_compressed_allocated":26935296,"data_compressed_original":98295808,"omap_allocated":0,"internal_metadata":68747264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54400000000000004,"15min":0.51400000000000001},"min":{"1min":0.23000000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.626,"15min":0.54200000000000004},"min":{"1min":0.29699999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":8.2590000000000003,"5min":8.2590000000000003,"15min":8.2590000000000003},"last":0.46600000000000003}]},{"osd":1,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.58099999999999996,"15min":0.51100000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.9179999999999999,"5min":5.9119999999999999,"15min":5.9119999999999999},"last":0.497},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.58199999999999996,"15min":0.54800000000000004},"min":{"1min":0.32200000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":3.996,"5min":3.996,"15min":3.996},"last":0.441}]},{"osd":2,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.51500000000000001},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":2.8929999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.70199999999999996,"15min":0.59999999999999998},"min":{"1min":0.33100000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":9.8360000000000003,"5min":9.8360000000000003,"15min":9.8360000000000003},"last":0.41299999999999998}]},{"osd":3,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.57899999999999996,"15min":0.55500000000000005},"min":{"1min":0.32100000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.83699999999999997,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.70099999999999996,"15min":0.60399999999999998},"min":{"1min":0.34300000000000003,"5min":0.314,"15min":0.314},"max":{"1min":8.1940000000000008,"5min":8.1940000000000008,"15min":8.1940000000000008},"last":0.42699999999999999}]},{"osd":4,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.49299999999999999,"15min":0.51300000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.498,"15min":0.53200000000000003},"min":{"1min":0.318,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.73299999999999998,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.48299999999999998}]},{"osd":6,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.51700000000000002,"15min":0.54100000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.55600000000000005},"min":{"1min":0.35499999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.45200000000000001}]},{"osd":7,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56899999999999995,"15min":0.58999999999999997},"min":{"1min":0.40699999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":0.50900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11333632,"data_stored":50908276,"data_compressed":6612732,"data_compressed_allocated":8208384,"data_compressed_original":47788032,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7892992,"data_stored":41943040,"data_compressed":5179048,"data_compressed_allocated":6578176,"data_compressed_original":40628224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":20971520,"data_compressed":2599703,"data_compressed_allocated":3166208,"data_compressed_original":19935232,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15769600,"data_stored":75497562,"data_compressed":9642572,"data_compressed_allocated":12136448,"data_compressed_original":71868416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16830464,"data_stored":88657158,"data_compressed":10773719,"data_compressed_allocated":13713408,"data_compressed_original":85557248,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12902400,"data_stored":67109516,"data_compressed":8592718,"data_compressed_allocated":10850304,"data_compressed_original":65064960,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5103616,"data_stored":25165824,"data_compressed":3204864,"data_compressed_allocated":4030464,"data_compressed_original":24092672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11374592,"data_stored":58721144,"data_compressed":7534714,"data_compressed_allocated":9695232,"data_compressed_original":57065472,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":232435712,"data_stored":253820928,"data_compressed":16092822,"data_compressed_allocated":18165760,"data_compressed_original":39550976,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":266227712,"data_stored":286793728,"data_compressed":17098430,"data_compressed_allocated":19324928,"data_compressed_original":39890944,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":201101312,"data_stored":214257664,"data_compressed":10507433,"data_compressed_allocated":11849728,"data_compressed_original":25006080,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":187613184,"data_stored":206184448,"data_compressed":14558729,"data_compressed_allocated":16519168,"data_compressed_original":35090432,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":240590848,"data_stored":264486912,"data_compressed":19096855,"data_compressed_allocated":21594112,"data_compressed_original":45490176,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":219586560,"data_stored":239939584,"data_compressed":15036285,"data_compressed_allocated":17072128,"data_compressed_original":37425152,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":239886336,"data_stored":254988288,"data_compressed":14096583,"data_compressed_allocated":15597568,"data_compressed_original":30699520,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":214179840,"data_stored":232402944,"data_compressed":16460575,"data_compressed_allocated":18358272,"data_compressed_original":36581376,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T02:06:19.840 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-29T02:06:19.840 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T02:06:19.996 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.015+0000 7f3b92bc4700 1 Processor -- start 2023-07-29T02:06:19.997 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.015+0000 7f3b92bc4700 1 -- start start 2023-07-29T02:06:19.998 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.016+0000 7f3b92bc4700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3b8c153240 0x7f3b8c071190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.016+0000 7f3b92bc4700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f3b8c071ef0 0x7f3b8c072920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.016+0000 7f3b92bc4700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8c072490 con 0x7f3b8c0c6830 2023-07-29T02:06:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.016+0000 7f3b92bc4700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b8c153610 con 0x7f3b8c153240 2023-07-29T02:06:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.016+0000 7f3b92bc4700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b8c06d280 con 0x7f3b8c071ef0 2023-07-29T02:06:19.999 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.016+0000 7f3b90960700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f3b8c153240 0x7f3b8c071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:20.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.016+0000 7f3b91161700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f3b8c0c6830 0x7f3b8c06dfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52078/0 (socket says 172.21.15.42:52078) 2023-07-29T02:06:20.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.016+0000 7f3b91161700 1 -- 172.21.15.42:0/1217123654 learned_addr learned my addr 172.21.15.42:0/1217123654 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:06:20.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.016+0000 7f3b8bfff700 1 --2- 172.21.15.42:0/1217123654 >> v2:172.21.15.144:3300/0 conn(0x7f3b8c071ef0 0x7f3b8c072920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:20.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.016+0000 7f3b90960700 1 -- 172.21.15.42:0/1217123654 >> v2:172.21.15.144:3300/0 conn(0x7f3b8c071ef0 msgr2=0x7f3b8c072920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:20.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.016+0000 7f3b90960700 1 --2- 172.21.15.42:0/1217123654 >> v2:172.21.15.144:3300/0 conn(0x7f3b8c071ef0 0x7f3b8c072920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:20.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.016+0000 7f3b90960700 1 -- 172.21.15.42:0/1217123654 >> v1:172.21.15.42:6789/0 conn(0x7f3b8c0c6830 legacy=0x7f3b8c06dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:20.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.016+0000 7f3b90960700 1 -- 172.21.15.42:0/1217123654 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8c0c6d70 con 0x7f3b8c153240 2023-07-29T02:06:20.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.016+0000 7f3b8b7fe700 1 -- 172.21.15.42:0/1217123654 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136605846 0 0) 0x7f3b8c072490 con 0x7f3b8c0c6830 2023-07-29T02:06:20.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.016+0000 7f3b8bfff700 1 --2- 172.21.15.42:0/1217123654 >> v2:172.21.15.144:3300/0 conn(0x7f3b8c071ef0 0x7f3b8c072920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:06:20.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.016+0000 7f3b90960700 1 --2- 172.21.15.42:0/1217123654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b8c153240 0x7f3b8c071190 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c070f90 tx=0x7f3b80009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf94939dc8b49de server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:20.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.017+0000 7f3b8b7fe700 1 -- 172.21.15.42:0/1217123654 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b80011830 con 0x7f3b8c153240 2023-07-29T02:06:20.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.017+0000 7f3b8b7fe700 1 -- 172.21.15.42:0/1217123654 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b80011990 con 0x7f3b8c153240 2023-07-29T02:06:20.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.017+0000 7f3b8b7fe700 1 -- 172.21.15.42:0/1217123654 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b80011d20 con 0x7f3b8c153240 2023-07-29T02:06:20.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.017+0000 7f3b92bc4700 1 -- 172.21.15.42:0/1217123654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b8c153240 msgr2=0x7f3b8c071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:20.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.017+0000 7f3b92bc4700 1 --2- 172.21.15.42:0/1217123654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b8c153240 0x7f3b8c071190 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c070f90 tx=0x7f3b80009b20 comp rx=0 tx=0).stop 2023-07-29T02:06:20.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.017+0000 7f3b92bc4700 1 -- 172.21.15.42:0/1217123654 shutdown_connections 2023-07-29T02:06:20.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.017+0000 7f3b92bc4700 1 --2- 172.21.15.42:0/1217123654 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b8c153240 0x7f3b8c071190 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:20.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.017+0000 7f3b92bc4700 1 --2- 172.21.15.42:0/1217123654 >> v2:172.21.15.144:3300/0 conn(0x7f3b8c071ef0 0x7f3b8c072920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:20.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.017+0000 7f3b92bc4700 1 -- 172.21.15.42:0/1217123654 >> 172.21.15.42:0/1217123654 conn(0x7f3b8c0c8930 msgr2=0x7f3b8c0c8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:20.004 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.017+0000 7f3b92bc4700 1 -- 172.21.15.42:0/1217123654 shutdown_connections 2023-07-29T02:06:20.004 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.017+0000 7f3b92bc4700 1 -- 172.21.15.42:0/1217123654 wait complete. 2023-07-29T02:06:20.006 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.018+0000 7f3b92bc4700 1 Processor -- start 2023-07-29T02:06:20.006 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.018+0000 7f3b92bc4700 1 -- start start 2023-07-29T02:06:20.006 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.019+0000 7f3b92bc4700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b8c071ef0 0x7f3b8c14bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:20.006 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.019+0000 7f3b92bc4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b8c0c6830 0x7f3b8c1488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.019+0000 7f3b92bc4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b8c153240 0x7f3b8c148e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.019+0000 7f3b92bc4700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c15c3d0 con 0x7f3b8c071ef0 2023-07-29T02:06:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.019+0000 7f3b92bc4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c159a30 con 0x7f3b8c0c6830 2023-07-29T02:06:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.019+0000 7f3b92bc4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8c1f1cb0 con 0x7f3b8c153240 2023-07-29T02:06:20.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.019+0000 7f3b90960700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b8c071ef0 0x7f3b8c14bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:20.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.019+0000 7f3b90960700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b8c071ef0 0x7f3b8c14bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58276/0 (socket says 172.21.15.42:58276) 2023-07-29T02:06:20.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.019+0000 7f3b90960700 1 -- 172.21.15.42:0/377555377 learned_addr learned my addr 172.21.15.42:0/377555377 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:20.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.020+0000 7f3b91161700 1 --2- 172.21.15.42:0/377555377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b8c153240 0x7f3b8c148e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:20.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.020+0000 7f3b8bfff700 1 --2- 172.21.15.42:0/377555377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b8c0c6830 0x7f3b8c1488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:20.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.020+0000 7f3b90960700 1 -- 172.21.15.42:0/377555377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b8c153240 msgr2=0x7f3b8c148e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:20.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.020+0000 7f3b90960700 1 --2- 172.21.15.42:0/377555377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b8c153240 0x7f3b8c148e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:20.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.020+0000 7f3b90960700 1 -- 172.21.15.42:0/377555377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b8c0c6830 msgr2=0x7f3b8c1488c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:20.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.020+0000 7f3b90960700 1 --2- 172.21.15.42:0/377555377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b8c0c6830 0x7f3b8c1488c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:20.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.020+0000 7f3b90960700 1 -- 172.21.15.42:0/377555377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b800094a0 con 0x7f3b8c071ef0 2023-07-29T02:06:20.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.020+0000 7f3b90960700 1 --2- 172.21.15.42:0/377555377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b8c071ef0 0x7f3b8c14bca0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009fd0 tx=0x7f3b80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:20.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.020+0000 7f3b897fa700 1 -- 172.21.15.42:0/377555377 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b800038b0 con 0x7f3b8c071ef0 2023-07-29T02:06:20.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.020+0000 7f3b897fa700 1 -- 172.21.15.42:0/377555377 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8001e070 con 0x7f3b8c071ef0 2023-07-29T02:06:20.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.020+0000 7f3b92bc4700 1 -- 172.21.15.42:0/377555377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8c1f1f70 con 0x7f3b8c071ef0 2023-07-29T02:06:20.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.020+0000 7f3b897fa700 1 -- 172.21.15.42:0/377555377 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b80003c50 con 0x7f3b8c071ef0 2023-07-29T02:06:20.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.020+0000 7f3b92bc4700 1 -- 172.21.15.42:0/377555377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8c1f2530 con 0x7f3b8c071ef0 2023-07-29T02:06:20.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.021+0000 7f3b92bc4700 1 -- 172.21.15.42:0/377555377 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8c0b2040 con 0x7f3b8c071ef0 2023-07-29T02:06:20.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.021+0000 7f3b897fa700 1 -- 172.21.15.42:0/377555377 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f3b8002d450 con 0x7f3b8c071ef0 2023-07-29T02:06:20.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.022+0000 7f3b897fa700 1 --2- 172.21.15.42:0/377555377 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3b7006a690 0x7f3b7006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:20.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.022+0000 7f3b897fa700 1 -- 172.21.15.42:0/377555377 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f3b8008a2d0 con 0x7f3b8c071ef0 2023-07-29T02:06:20.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.022+0000 7f3b8bfff700 1 --2- 172.21.15.42:0/377555377 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3b7006a690 0x7f3b7006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:20.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.022+0000 7f3b8bfff700 1 --2- 172.21.15.42:0/377555377 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3b7006a690 0x7f3b7006cb40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c150e20 tx=0x7f3b78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:20.012 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.026+0000 7f3b897fa700 1 -- 172.21.15.42:0/377555377 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f3b80055340 con 0x7f3b8c071ef0 2023-07-29T02:06:20.200 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.219+0000 7f3b92bc4700 1 -- 172.21.15.42:0/377555377 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b8c06d820 con 0x7f3b7006a690 2023-07-29T02:06:20.211 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.230+0000 7f3b897fa700 1 -- 172.21.15.42:0/377555377 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+396921 (secure 0 0 0) 0x7f3b7800c050 con 0x7f3b7006a690 2023-07-29T02:06:20.216 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:06:20.218 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.234+0000 7f3b92bc4700 1 -- 172.21.15.42:0/377555377 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3b7006a690 msgr2=0x7f3b7006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:20.219 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.234+0000 7f3b92bc4700 1 --2- 172.21.15.42:0/377555377 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3b7006a690 0x7f3b7006cb40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c150e20 tx=0x7f3b78008040 comp rx=0 tx=0).stop 2023-07-29T02:06:20.219 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.234+0000 7f3b92bc4700 1 -- 172.21.15.42:0/377555377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b8c071ef0 msgr2=0x7f3b8c14bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:20.219 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.234+0000 7f3b92bc4700 1 --2- 172.21.15.42:0/377555377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b8c071ef0 0x7f3b8c14bca0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009fd0 tx=0x7f3b80004750 comp rx=0 tx=0).stop 2023-07-29T02:06:20.219 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.234+0000 7f3b92bc4700 1 -- 172.21.15.42:0/377555377 shutdown_connections 2023-07-29T02:06:20.220 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.234+0000 7f3b92bc4700 1 --2- 172.21.15.42:0/377555377 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f3b7006a690 0x7f3b7006cb40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:20.220 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.234+0000 7f3b92bc4700 1 --2- 172.21.15.42:0/377555377 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f3b8c153240 0x7f3b8c148e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:20.220 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.234+0000 7f3b92bc4700 1 --2- 172.21.15.42:0/377555377 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f3b8c071ef0 0x7f3b8c14bca0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:20.220 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.234+0000 7f3b92bc4700 1 --2- 172.21.15.42:0/377555377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b8c0c6830 0x7f3b8c1488c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:20.221 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.234+0000 7f3b92bc4700 1 -- 172.21.15.42:0/377555377 >> 172.21.15.42:0/377555377 conn(0x7f3b8c0c8930 msgr2=0x7f3b8c150e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:20.221 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.234+0000 7f3b92bc4700 1 -- 172.21.15.42:0/377555377 shutdown_connections 2023-07-29T02:06:20.221 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.234+0000 7f3b92bc4700 1 -- 172.21.15.42:0/377555377 wait complete. 2023-07-29T02:06:20.221 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2023-07-29T02:06:20.228 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":227,"stamp":"2023-07-29T02:06:19.339590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1133187055,"num_objects":10297,"num_object_clones":0,"num_object_copies":40910,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10297,"num_whiteouts":0,"num_read":1674,"num_read_kb":517456,"num_write":24004,"num_write_kb":1256728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29227,"ondisk_log_size":29227,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2486732,"kb_used_data":1845388,"kb_used_omap":0,"kb_used_meta":641280,"kb_avail":752487988,"statfs":{"total":773094113280,"available":770547699712,"internally_reserved":0,"allocated":1889677312,"data_stored":2380556255,"data_compressed":176342060,"data_compressed_allocated":205963264,"data_compressed_original":698687488,"omap_allocated":0,"internal_metadata":656670720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":201304347,"num_objects":9970,"num_object_clones":0,"num_object_copies":39868,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9970,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10105,"num_write_kb":201488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002566"},"pg_stats":[{"pgid":"4.3f","version":"35'78","reported_seq":2129,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.614917+0000","last_change":"2023-07-29T02:03:56.956160+0000","last_active":"2023-07-29T02:04:20.614917+0000","last_peered":"2023-07-29T02:04:20.614917+0000","last_clean":"2023-07-29T02:04:20.614917+0000","last_became_active":"2023-07-29T01:59:57.957742+0000","last_became_peered":"2023-07-29T01:59:57.957742+0000","last_unstale":"2023-07-29T02:04:20.614917+0000","last_undegraded":"2023-07-29T02:04:20.614917+0000","last_fullsized":"2023-07-29T02:04:20.614917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:32.550358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46739399700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"39'71","reported_seq":2122,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.634369+0000","last_change":"2023-07-29T02:03:56.795813+0000","last_active":"2023-07-29T02:04:47.634369+0000","last_peered":"2023-07-29T02:04:47.634369+0000","last_clean":"2023-07-29T02:04:47.634369+0000","last_became_active":"2023-07-29T01:59:57.974338+0000","last_became_peered":"2023-07-29T01:59:57.974338+0000","last_unstale":"2023-07-29T02:04:47.634369+0000","last_undegraded":"2023-07-29T02:04:47.634369+0000","last_fullsized":"2023-07-29T02:04:47.634369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30630966300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"36'83","reported_seq":2134,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.979284+0000","last_change":"2023-07-29T02:03:57.108039+0000","last_active":"2023-07-29T02:04:21.979284+0000","last_peered":"2023-07-29T02:04:21.979284+0000","last_clean":"2023-07-29T02:04:21.979284+0000","last_became_active":"2023-07-29T01:59:57.973406+0000","last_became_peered":"2023-07-29T01:59:57.973406+0000","last_unstale":"2023-07-29T02:04:21.979284+0000","last_undegraded":"2023-07-29T02:04:21.979284+0000","last_fullsized":"2023-07-29T02:04:21.979284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:08:23.687614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37359432399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"37'67","reported_seq":2118,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.446364+0000","last_change":"2023-07-29T02:03:56.955565+0000","last_active":"2023-07-29T02:04:19.446364+0000","last_peered":"2023-07-29T02:04:19.446364+0000","last_clean":"2023-07-29T02:04:19.446364+0000","last_became_active":"2023-07-29T01:59:57.964865+0000","last_became_peered":"2023-07-29T01:59:57.964865+0000","last_unstale":"2023-07-29T02:04:19.446364+0000","last_undegraded":"2023-07-29T02:04:19.446364+0000","last_fullsized":"2023-07-29T02:04:19.446364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:32.905717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22913951599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"35'98","reported_seq":2148,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.413848+0000","last_change":"2023-07-29T02:03:57.038137+0000","last_active":"2023-07-29T02:04:20.413848+0000","last_peered":"2023-07-29T02:04:20.413848+0000","last_clean":"2023-07-29T02:04:20.413848+0000","last_became_active":"2023-07-29T01:59:57.970733+0000","last_became_peered":"2023-07-29T01:59:57.970733+0000","last_unstale":"2023-07-29T02:04:20.413848+0000","last_undegraded":"2023-07-29T02:04:20.413848+0000","last_fullsized":"2023-07-29T02:04:20.413848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55358088100000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"35'86","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.978766+0000","last_change":"2023-07-29T02:03:57.111935+0000","last_active":"2023-07-29T02:04:21.978766+0000","last_peered":"2023-07-29T02:04:21.978766+0000","last_clean":"2023-07-29T02:04:21.978766+0000","last_became_active":"2023-07-29T01:59:57.964993+0000","last_became_peered":"2023-07-29T01:59:57.964993+0000","last_unstale":"2023-07-29T02:04:21.978766+0000","last_undegraded":"2023-07-29T02:04:21.978766+0000","last_fullsized":"2023-07-29T02:04:21.978766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35033357399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"39'100","reported_seq":2150,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.633716+0000","last_change":"2023-07-29T02:03:56.697037+0000","last_active":"2023-07-29T02:04:47.633716+0000","last_peered":"2023-07-29T02:04:47.633716+0000","last_clean":"2023-07-29T02:04:47.633716+0000","last_became_active":"2023-07-29T01:59:57.970232+0000","last_became_peered":"2023-07-29T01:59:57.970232+0000","last_unstale":"2023-07-29T02:04:47.633716+0000","last_undegraded":"2023-07-29T02:04:47.633716+0000","last_fullsized":"2023-07-29T02:04:47.633716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18952802499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"36'65","reported_seq":2115,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.815684+0000","last_change":"2023-07-29T02:03:56.788754+0000","last_active":"2023-07-29T02:04:21.815684+0000","last_peered":"2023-07-29T02:04:21.815684+0000","last_clean":"2023-07-29T02:04:21.815684+0000","last_became_active":"2023-07-29T01:59:57.962884+0000","last_became_peered":"2023-07-29T01:59:57.962884+0000","last_unstale":"2023-07-29T02:04:21.815684+0000","last_undegraded":"2023-07-29T02:04:21.815684+0000","last_fullsized":"2023-07-29T02:04:21.815684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30152641200000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"39'73","reported_seq":2123,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.635152+0000","last_change":"2023-07-29T02:03:57.034522+0000","last_active":"2023-07-29T02:04:47.635152+0000","last_peered":"2023-07-29T02:04:47.635152+0000","last_clean":"2023-07-29T02:04:47.635152+0000","last_became_active":"2023-07-29T01:59:57.971640+0000","last_became_peered":"2023-07-29T01:59:57.971640+0000","last_unstale":"2023-07-29T02:04:47.635152+0000","last_undegraded":"2023-07-29T02:04:47.635152+0000","last_fullsized":"2023-07-29T02:04:47.635152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54966345000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"35'83","reported_seq":2133,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.816709+0000","last_change":"2023-07-29T02:03:56.796189+0000","last_active":"2023-07-29T02:04:21.816709+0000","last_peered":"2023-07-29T02:04:21.816709+0000","last_clean":"2023-07-29T02:04:21.816709+0000","last_became_active":"2023-07-29T01:59:57.962799+0000","last_became_peered":"2023-07-29T01:59:57.962799+0000","last_unstale":"2023-07-29T02:04:21.816709+0000","last_undegraded":"2023-07-29T02:04:21.816709+0000","last_fullsized":"2023-07-29T02:04:21.816709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30635943199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"35'84","reported_seq":2134,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.979809+0000","last_change":"2023-07-29T02:03:57.107266+0000","last_active":"2023-07-29T02:04:21.979809+0000","last_peered":"2023-07-29T02:04:21.979809+0000","last_clean":"2023-07-29T02:04:21.979809+0000","last_became_active":"2023-07-29T01:59:57.969868+0000","last_became_peered":"2023-07-29T01:59:57.969868+0000","last_unstale":"2023-07-29T02:04:21.979809+0000","last_undegraded":"2023-07-29T02:04:21.979809+0000","last_fullsized":"2023-07-29T02:04:21.979809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37294171199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"36'69","reported_seq":2119,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.614635+0000","last_change":"2023-07-29T02:03:56.957883+0000","last_active":"2023-07-29T02:04:20.614635+0000","last_peered":"2023-07-29T02:04:20.614635+0000","last_clean":"2023-07-29T02:04:20.614635+0000","last_became_active":"2023-07-29T01:59:57.963902+0000","last_became_peered":"2023-07-29T01:59:57.963902+0000","last_unstale":"2023-07-29T02:04:20.614635+0000","last_undegraded":"2023-07-29T02:04:20.614635+0000","last_fullsized":"2023-07-29T02:04:20.614635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:51.691001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46909700500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"36'71","reported_seq":2121,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.613803+0000","last_change":"2023-07-29T02:03:56.954586+0000","last_active":"2023-07-29T02:04:20.613803+0000","last_peered":"2023-07-29T02:04:20.613803+0000","last_clean":"2023-07-29T02:04:20.613803+0000","last_became_active":"2023-07-29T01:59:57.963239+0000","last_became_peered":"2023-07-29T01:59:57.963239+0000","last_unstale":"2023-07-29T02:04:20.613803+0000","last_undegraded":"2023-07-29T02:04:20.613803+0000","last_fullsized":"2023-07-29T02:04:20.613803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:08.001986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46603159700000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"39'85","reported_seq":2135,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:39.452612+0000","last_change":"2023-07-29T02:03:56.789592+0000","last_active":"2023-07-29T02:04:39.452612+0000","last_peered":"2023-07-29T02:04:39.452612+0000","last_clean":"2023-07-29T02:04:39.452612+0000","last_became_active":"2023-07-29T01:59:57.960709+0000","last_became_peered":"2023-07-29T01:59:57.960709+0000","last_unstale":"2023-07-29T02:04:39.452612+0000","last_undegraded":"2023-07-29T02:04:39.452612+0000","last_fullsized":"2023-07-29T02:04:39.452612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30181124199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"35'78","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444090+0000","last_change":"2023-07-29T02:03:56.696099+0000","last_active":"2023-07-29T02:04:19.444090+0000","last_peered":"2023-07-29T02:04:19.444090+0000","last_clean":"2023-07-29T02:04:19.444090+0000","last_became_active":"2023-07-29T01:59:57.970263+0000","last_became_peered":"2023-07-29T01:59:57.970263+0000","last_unstale":"2023-07-29T02:04:19.444090+0000","last_undegraded":"2023-07-29T02:04:19.444090+0000","last_fullsized":"2023-07-29T02:04:19.444090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18892089500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"39'88","reported_seq":2138,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:39.442116+0000","last_change":"2023-07-29T02:03:57.113982+0000","last_active":"2023-07-29T02:04:39.442116+0000","last_peered":"2023-07-29T02:04:39.442116+0000","last_clean":"2023-07-29T02:04:39.442116+0000","last_became_active":"2023-07-29T01:59:57.964696+0000","last_became_peered":"2023-07-29T01:59:57.964696+0000","last_unstale":"2023-07-29T02:04:39.442116+0000","last_undegraded":"2023-07-29T02:04:39.442116+0000","last_fullsized":"2023-07-29T02:04:39.442116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:19:14.641252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.32990576199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"39'86","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:39.436873+0000","last_change":"2023-07-29T02:03:57.029741+0000","last_active":"2023-07-29T02:04:39.436873+0000","last_peered":"2023-07-29T02:04:39.436873+0000","last_clean":"2023-07-29T02:04:39.436873+0000","last_became_active":"2023-07-29T01:59:57.968885+0000","last_became_peered":"2023-07-29T01:59:57.968885+0000","last_unstale":"2023-07-29T02:04:39.436873+0000","last_undegraded":"2023-07-29T02:04:39.436873+0000","last_fullsized":"2023-07-29T02:04:39.436873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54488360899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"36'78","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.979073+0000","last_change":"2023-07-29T02:03:57.081083+0000","last_active":"2023-07-29T02:04:21.979073+0000","last_peered":"2023-07-29T02:04:21.979073+0000","last_clean":"2023-07-29T02:04:21.979073+0000","last_became_active":"2023-07-29T01:59:57.962919+0000","last_became_peered":"2023-07-29T01:59:57.962919+0000","last_unstale":"2023-07-29T02:04:21.979073+0000","last_undegraded":"2023-07-29T02:04:21.979073+0000","last_fullsized":"2023-07-29T02:04:21.979073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:16:58.718803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36591080100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"35'78","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.614282+0000","last_change":"2023-07-29T02:03:56.960427+0000","last_active":"2023-07-29T02:04:20.614282+0000","last_peered":"2023-07-29T02:04:20.614282+0000","last_clean":"2023-07-29T02:04:20.614282+0000","last_became_active":"2023-07-29T01:59:57.960111+0000","last_became_peered":"2023-07-29T01:59:57.960111+0000","last_unstale":"2023-07-29T02:04:20.614282+0000","last_undegraded":"2023-07-29T02:04:20.614282+0000","last_fullsized":"2023-07-29T02:04:20.614282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:45.956813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.47199195399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"39'90","reported_seq":2140,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:29.440975+0000","last_change":"2023-07-29T02:03:57.111175+0000","last_active":"2023-07-29T02:04:29.440975+0000","last_peered":"2023-07-29T02:04:29.440975+0000","last_clean":"2023-07-29T02:04:29.440975+0000","last_became_active":"2023-07-29T01:59:57.961655+0000","last_became_peered":"2023-07-29T01:59:57.961655+0000","last_unstale":"2023-07-29T02:04:29.440975+0000","last_undegraded":"2023-07-29T02:04:29.440975+0000","last_fullsized":"2023-07-29T02:04:29.440975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.203628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36267924800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"39'78","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:29.440537+0000","last_change":"2023-07-29T02:03:56.694890+0000","last_active":"2023-07-29T02:04:29.440537+0000","last_peered":"2023-07-29T02:04:29.440537+0000","last_clean":"2023-07-29T02:04:29.440537+0000","last_became_active":"2023-07-29T01:59:57.970757+0000","last_became_peered":"2023-07-29T01:59:57.970757+0000","last_unstale":"2023-07-29T02:04:29.440537+0000","last_undegraded":"2023-07-29T02:04:29.440537+0000","last_fullsized":"2023-07-29T02:04:29.440537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18738185399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"39'85","reported_seq":2135,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.636550+0000","last_change":"2023-07-29T02:03:57.025876+0000","last_active":"2023-07-29T02:04:47.636550+0000","last_peered":"2023-07-29T02:04:47.636550+0000","last_clean":"2023-07-29T02:04:47.636550+0000","last_became_active":"2023-07-29T01:59:57.974436+0000","last_became_peered":"2023-07-29T01:59:57.974436+0000","last_unstale":"2023-07-29T02:04:47.636550+0000","last_undegraded":"2023-07-29T02:04:47.636550+0000","last_fullsized":"2023-07-29T02:04:47.636550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54184882499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"35'84","reported_seq":2134,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.443274+0000","last_change":"2023-07-29T02:03:57.173218+0000","last_active":"2023-07-29T02:04:19.443274+0000","last_peered":"2023-07-29T02:04:19.443274+0000","last_clean":"2023-07-29T02:04:19.443274+0000","last_became_active":"2023-07-29T01:59:57.966987+0000","last_became_peered":"2023-07-29T01:59:57.966987+0000","last_unstale":"2023-07-29T02:04:19.443274+0000","last_undegraded":"2023-07-29T02:04:19.443274+0000","last_fullsized":"2023-07-29T02:04:19.443274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:04.400755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38162062000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"39'86","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.632776+0000","last_change":"2023-07-29T02:03:56.697590+0000","last_active":"2023-07-29T02:04:47.632776+0000","last_peered":"2023-07-29T02:04:47.632776+0000","last_clean":"2023-07-29T02:04:47.632776+0000","last_became_active":"2023-07-29T01:59:57.971733+0000","last_became_peered":"2023-07-29T01:59:57.971733+0000","last_unstale":"2023-07-29T02:04:47.632776+0000","last_undegraded":"2023-07-29T02:04:47.632776+0000","last_fullsized":"2023-07-29T02:04:47.632776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.189164111,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"36'81","reported_seq":2131,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.433572+0000","last_change":"2023-07-29T02:03:57.054022+0000","last_active":"2023-07-29T02:04:19.433572+0000","last_peered":"2023-07-29T02:04:19.433572+0000","last_clean":"2023-07-29T02:04:19.433572+0000","last_became_active":"2023-07-29T01:59:57.969742+0000","last_became_peered":"2023-07-29T01:59:57.969742+0000","last_unstale":"2023-07-29T02:04:19.433572+0000","last_undegraded":"2023-07-29T02:04:19.433572+0000","last_fullsized":"2023-07-29T02:04:19.433572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53981922100000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"35'94","reported_seq":2144,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.433559+0000","last_change":"2023-07-29T02:03:57.052073+0000","last_active":"2023-07-29T02:04:19.433559+0000","last_peered":"2023-07-29T02:04:19.433559+0000","last_clean":"2023-07-29T02:04:19.433559+0000","last_became_active":"2023-07-29T01:59:57.969409+0000","last_became_peered":"2023-07-29T01:59:57.969409+0000","last_unstale":"2023-07-29T02:04:19.433559+0000","last_undegraded":"2023-07-29T02:04:19.433559+0000","last_fullsized":"2023-07-29T02:04:19.433559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53315132300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"39'68","reported_seq":2118,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.816142+0000","last_change":"2023-07-29T02:03:56.792528+0000","last_active":"2023-07-29T02:04:21.816142+0000","last_peered":"2023-07-29T02:04:21.816142+0000","last_clean":"2023-07-29T02:04:21.816142+0000","last_became_active":"2023-07-29T01:59:57.963774+0000","last_became_peered":"2023-07-29T01:59:57.963774+0000","last_unstale":"2023-07-29T02:04:21.816142+0000","last_undegraded":"2023-07-29T02:04:21.816142+0000","last_fullsized":"2023-07-29T02:04:21.816142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30426659299999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"39'632","reported_seq":2711,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.903446+0000","last_change":"2023-07-29T02:03:57.112265+0000","last_active":"2023-07-29T02:06:07.903446+0000","last_peered":"2023-07-29T02:06:07.903446+0000","last_clean":"2023-07-29T02:06:07.903446+0000","last_became_active":"2023-07-29T02:00:01.993731+0000","last_became_peered":"2023-07-29T02:00:01.993731+0000","last_unstale":"2023-07-29T02:06:07.903446+0000","last_undegraded":"2023-07-29T02:06:07.903446+0000","last_fullsized":"2023-07-29T02:06:07.903446+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:14:25.422754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35725884499999999,"stat_sum":{"num_bytes":48336376,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":31,"num_read_kb":16407,"num_write":630,"num_write_kb":51633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"39'156","reported_seq":190,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:08.990208+0000","last_change":"2023-07-29T01:59:57.552913+0000","last_active":"2023-07-29T02:06:08.990208+0000","last_peered":"2023-07-29T02:06:08.990208+0000","last_clean":"2023-07-29T02:06:08.990208+0000","last_became_active":"2023-07-29T01:59:57.552673+0000","last_became_peered":"2023-07-29T01:59:57.552673+0000","last_unstale":"2023-07-29T02:06:08.990208+0000","last_undegraded":"2023-07-29T02:06:08.990208+0000","last_fullsized":"2023-07-29T02:06:08.990208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:49:56.335019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":154,"num_write_kb":16499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"39'75","reported_seq":2125,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:50.633095+0000","last_change":"2023-07-29T02:03:57.172635+0000","last_active":"2023-07-29T02:04:50.633095+0000","last_peered":"2023-07-29T02:04:50.633095+0000","last_clean":"2023-07-29T02:04:50.633095+0000","last_became_active":"2023-07-29T01:59:57.969821+0000","last_became_peered":"2023-07-29T01:59:57.969821+0000","last_unstale":"2023-07-29T02:04:50.633095+0000","last_undegraded":"2023-07-29T02:04:50.633095+0000","last_fullsized":"2023-07-29T02:04:50.633095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.40087768200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'628","reported_seq":2717,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.103880+0000","last_change":"2023-07-29T02:03:56.981521+0000","last_active":"2023-07-29T02:06:07.103880+0000","last_peered":"2023-07-29T02:06:07.103880+0000","last_clean":"2023-07-29T02:06:07.103880+0000","last_became_active":"2023-07-29T02:00:01.992338+0000","last_became_peered":"2023-07-29T02:00:01.992338+0000","last_unstale":"2023-07-29T02:06:07.103880+0000","last_undegraded":"2023-07-29T02:06:07.103880+0000","last_fullsized":"2023-07-29T02:06:07.103880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:37.968145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20956234600000001,"stat_sum":{"num_bytes":44446362,"num_objects":309,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":41,"num_read_kb":16418,"num_write":628,"num_write_kb":43687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"39'20","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:49.437568+0000","last_change":"2023-07-29T01:59:57.547793+0000","last_active":"2023-07-29T02:04:49.437568+0000","last_peered":"2023-07-29T02:04:49.437568+0000","last_clean":"2023-07-29T02:04:49.437568+0000","last_became_active":"2023-07-29T01:59:57.547455+0000","last_became_peered":"2023-07-29T01:59:57.547455+0000","last_unstale":"2023-07-29T02:04:49.437568+0000","last_undegraded":"2023-07-29T02:04:49.437568+0000","last_fullsized":"2023-07-29T02:04:49.437568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":4125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"35'87","reported_seq":2138,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.413318+0000","last_change":"2023-07-29T02:03:57.037080+0000","last_active":"2023-07-29T02:04:20.413318+0000","last_peered":"2023-07-29T02:04:20.413318+0000","last_clean":"2023-07-29T02:04:20.413318+0000","last_became_active":"2023-07-29T01:59:57.964393+0000","last_became_peered":"2023-07-29T01:59:57.964393+0000","last_unstale":"2023-07-29T02:04:20.413318+0000","last_undegraded":"2023-07-29T02:04:20.413318+0000","last_fullsized":"2023-07-29T02:04:20.413318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55267013499999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"39'624","reported_seq":2705,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.294411+0000","last_change":"2023-07-29T02:03:57.037730+0000","last_active":"2023-07-29T02:06:07.294411+0000","last_peered":"2023-07-29T02:06:07.294411+0000","last_clean":"2023-07-29T02:06:07.294411+0000","last_became_active":"2023-07-29T02:00:01.982042+0000","last_became_peered":"2023-07-29T02:00:01.982042+0000","last_unstale":"2023-07-29T02:06:07.294411+0000","last_undegraded":"2023-07-29T02:06:07.294411+0000","last_fullsized":"2023-07-29T02:06:07.294411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55323541600000004,"stat_sum":{"num_bytes":17887936,"num_objects":308,"num_object_clones":0,"num_object_copies":1232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":308,"num_whiteouts":0,"num_read":32,"num_read_kb":5104,"num_write":624,"num_write_kb":17797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"39'130","reported_seq":163,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.544484+0000","last_change":"2023-07-29T01:59:57.535286+0000","last_active":"2023-07-29T02:05:51.544484+0000","last_peered":"2023-07-29T02:05:51.544484+0000","last_clean":"2023-07-29T02:05:51.544484+0000","last_became_active":"2023-07-29T01:59:57.533523+0000","last_became_peered":"2023-07-29T01:59:57.533523+0000","last_unstale":"2023-07-29T02:05:51.544484+0000","last_undegraded":"2023-07-29T02:05:51.544484+0000","last_fullsized":"2023-07-29T02:05:51.544484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":129,"num_write_kb":12373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"36'81","reported_seq":2132,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.445928+0000","last_change":"2023-07-29T02:03:56.982121+0000","last_active":"2023-07-29T02:04:19.445928+0000","last_peered":"2023-07-29T02:04:19.445928+0000","last_clean":"2023-07-29T02:04:19.445928+0000","last_became_active":"2023-07-29T01:59:57.963466+0000","last_became_peered":"2023-07-29T01:59:57.963466+0000","last_unstale":"2023-07-29T02:04:19.445928+0000","last_undegraded":"2023-07-29T02:04:19.445928+0000","last_fullsized":"2023-07-29T02:04:19.445928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:28.048947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.209911193,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"39'697","reported_seq":2784,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.146401+0000","last_change":"2023-07-29T02:03:56.977076+0000","last_active":"2023-07-29T02:06:07.146401+0000","last_peered":"2023-07-29T02:06:07.146401+0000","last_clean":"2023-07-29T02:06:07.146401+0000","last_became_active":"2023-07-29T02:00:01.984000+0000","last_became_peered":"2023-07-29T02:00:01.984000+0000","last_unstale":"2023-07-29T02:06:07.146401+0000","last_undegraded":"2023-07-29T02:06:07.146401+0000","last_fullsized":"2023-07-29T02:06:07.146401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.218444052,"stat_sum":{"num_bytes":33480822,"num_objects":367,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":39,"num_read_kb":11040,"num_write":700,"num_write_kb":41165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"39'3","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:49.438002+0000","last_change":"2023-07-29T01:59:57.537082+0000","last_active":"2023-07-29T02:04:49.438002+0000","last_peered":"2023-07-29T02:04:49.438002+0000","last_clean":"2023-07-29T02:04:49.438002+0000","last_became_active":"2023-07-29T01:59:57.536732+0000","last_became_peered":"2023-07-29T01:59:57.536732+0000","last_unstale":"2023-07-29T02:04:49.438002+0000","last_undegraded":"2023-07-29T02:04:49.438002+0000","last_fullsized":"2023-07-29T02:04:49.438002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"39'82","reported_seq":2132,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:39.451721+0000","last_change":"2023-07-29T02:03:57.174184+0000","last_active":"2023-07-29T02:04:39.451721+0000","last_peered":"2023-07-29T02:04:39.451721+0000","last_clean":"2023-07-29T02:04:39.451721+0000","last_became_active":"2023-07-29T01:59:57.970902+0000","last_became_peered":"2023-07-29T01:59:57.970902+0000","last_unstale":"2023-07-29T02:04:39.451721+0000","last_undegraded":"2023-07-29T02:04:39.451721+0000","last_fullsized":"2023-07-29T02:04:39.451721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.3723399,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'665","reported_seq":2750,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.428896+0000","last_change":"2023-07-29T02:03:56.697947+0000","last_active":"2023-07-29T02:06:07.428896+0000","last_peered":"2023-07-29T02:06:07.428896+0000","last_clean":"2023-07-29T02:06:07.428896+0000","last_became_active":"2023-07-29T02:00:01.989456+0000","last_became_peered":"2023-07-29T02:00:01.989456+0000","last_unstale":"2023-07-29T02:06:07.428896+0000","last_undegraded":"2023-07-29T02:06:07.428896+0000","last_fullsized":"2023-07-29T02:06:07.428896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.189839176,"stat_sum":{"num_bytes":37359948,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":38,"num_read_kb":16417,"num_write":659,"num_write_kb":40721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"39'35","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:10.160718+0000","last_change":"2023-07-29T01:59:57.540572+0000","last_active":"2023-07-29T02:06:10.160718+0000","last_peered":"2023-07-29T02:06:10.160718+0000","last_clean":"2023-07-29T02:06:10.160718+0000","last_became_active":"2023-07-29T01:59:57.540113+0000","last_became_peered":"2023-07-29T01:59:57.540113+0000","last_unstale":"2023-07-29T02:06:10.160718+0000","last_undegraded":"2023-07-29T02:06:10.160718+0000","last_fullsized":"2023-07-29T02:06:10.160718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":31,"num_write_kb":12312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"39'85","reported_seq":2135,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:39.451754+0000","last_change":"2023-07-29T02:03:57.171853+0000","last_active":"2023-07-29T02:04:39.451754+0000","last_peered":"2023-07-29T02:04:39.451754+0000","last_clean":"2023-07-29T02:04:39.451754+0000","last_became_active":"2023-07-29T01:59:57.967083+0000","last_became_peered":"2023-07-29T01:59:57.967083+0000","last_unstale":"2023-07-29T02:04:39.451754+0000","last_undegraded":"2023-07-29T02:04:39.451754+0000","last_fullsized":"2023-07-29T02:04:39.451754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38037237200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"39'632","reported_seq":2724,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:06.764691+0000","last_change":"2023-07-29T02:03:57.161825+0000","last_active":"2023-07-29T02:06:06.764691+0000","last_peered":"2023-07-29T02:06:06.764691+0000","last_clean":"2023-07-29T02:06:06.764691+0000","last_became_active":"2023-07-29T02:00:01.996035+0000","last_became_peered":"2023-07-29T02:00:01.996035+0000","last_unstale":"2023-07-29T02:06:06.764691+0000","last_undegraded":"2023-07-29T02:06:06.764691+0000","last_fullsized":"2023-07-29T02:06:06.764691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.39874443399999998,"stat_sum":{"num_bytes":20875244,"num_objects":313,"num_object_clones":0,"num_object_copies":1252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":44,"num_read_kb":4139,"num_write":632,"num_write_kb":28878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"39'67","reported_seq":107,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:12.525117+0000","last_change":"2023-07-29T01:59:57.548665+0000","last_active":"2023-07-29T02:06:12.525117+0000","last_peered":"2023-07-29T02:06:12.525117+0000","last_clean":"2023-07-29T02:06:12.525117+0000","last_became_active":"2023-07-29T01:59:57.547803+0000","last_became_peered":"2023-07-29T01:59:57.547803+0000","last_unstale":"2023-07-29T02:06:12.525117+0000","last_undegraded":"2023-07-29T02:06:12.525117+0000","last_fullsized":"2023-07-29T02:06:12.525117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":4114,"num_write":65,"num_write_kb":8245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"35'76","reported_seq":2126,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.926154+0000","last_change":"2023-07-29T02:03:57.049617+0000","last_active":"2023-07-29T02:04:21.926154+0000","last_peered":"2023-07-29T02:04:21.926154+0000","last_clean":"2023-07-29T02:04:21.926154+0000","last_became_active":"2023-07-29T01:59:57.969006+0000","last_became_peered":"2023-07-29T01:59:57.969006+0000","last_unstale":"2023-07-29T02:04:21.926154+0000","last_undegraded":"2023-07-29T02:04:21.926154+0000","last_fullsized":"2023-07-29T02:04:21.926154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:30:28.393515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53746501300000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"39'641","reported_seq":2734,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.766377+0000","last_change":"2023-07-29T02:03:57.052276+0000","last_active":"2023-07-29T02:06:07.766377+0000","last_peered":"2023-07-29T02:06:07.766377+0000","last_clean":"2023-07-29T02:06:07.766377+0000","last_became_active":"2023-07-29T02:00:01.995757+0000","last_became_peered":"2023-07-29T02:00:01.995757+0000","last_unstale":"2023-07-29T02:06:07.766377+0000","last_undegraded":"2023-07-29T02:06:07.766377+0000","last_fullsized":"2023-07-29T02:06:07.766377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:24:03.881006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.539926876,"stat_sum":{"num_bytes":20101741,"num_objects":314,"num_object_clones":0,"num_object_copies":1256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":45,"num_read_kb":20517,"num_write":638,"num_write_kb":32247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"39'124","reported_seq":173,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:48.029338+0000","last_change":"2023-07-29T01:59:57.541936+0000","last_active":"2023-07-29T02:05:48.029338+0000","last_peered":"2023-07-29T02:05:48.029338+0000","last_clean":"2023-07-29T02:05:48.029338+0000","last_became_active":"2023-07-29T01:59:57.541434+0000","last_became_peered":"2023-07-29T01:59:57.541434+0000","last_unstale":"2023-07-29T02:05:48.029338+0000","last_undegraded":"2023-07-29T02:05:48.029338+0000","last_fullsized":"2023-07-29T02:05:48.029338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":12324,"num_write":118,"num_write_kb":12357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"35'86","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.979595+0000","last_change":"2023-07-29T02:03:57.112781+0000","last_active":"2023-07-29T02:04:21.979595+0000","last_peered":"2023-07-29T02:04:21.979595+0000","last_clean":"2023-07-29T02:04:21.979595+0000","last_became_active":"2023-07-29T01:59:57.962459+0000","last_became_peered":"2023-07-29T01:59:57.962459+0000","last_unstale":"2023-07-29T02:04:21.979595+0000","last_undegraded":"2023-07-29T02:04:21.979595+0000","last_fullsized":"2023-07-29T02:04:21.979595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.34937986999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'591","reported_seq":2679,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.695555+0000","last_change":"2023-07-29T02:03:56.797439+0000","last_active":"2023-07-29T02:06:07.695555+0000","last_peered":"2023-07-29T02:06:07.695555+0000","last_clean":"2023-07-29T02:06:07.695555+0000","last_became_active":"2023-07-29T02:00:01.995827+0000","last_became_peered":"2023-07-29T02:00:01.995827+0000","last_unstale":"2023-07-29T02:06:07.695555+0000","last_undegraded":"2023-07-29T02:06:07.695555+0000","last_fullsized":"2023-07-29T02:06:07.695555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30893240100000002,"stat_sum":{"num_bytes":24035129,"num_objects":268,"num_object_clones":0,"num_object_copies":1072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":40,"num_read_kb":8228,"num_write":590,"num_write_kb":23787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"39'12","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.543460+0000","last_change":"2023-07-29T01:59:57.545705+0000","last_active":"2023-07-29T02:05:51.543460+0000","last_peered":"2023-07-29T02:05:51.543460+0000","last_clean":"2023-07-29T02:05:51.543460+0000","last_became_active":"2023-07-29T01:59:57.545406+0000","last_became_peered":"2023-07-29T01:59:57.545406+0000","last_unstale":"2023-07-29T02:05:51.543460+0000","last_undegraded":"2023-07-29T02:05:51.543460+0000","last_fullsized":"2023-07-29T02:05:51.543460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:31.903601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":8216,"num_write":11,"num_write_kb":8201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"39'75","reported_seq":2119,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:50.633311+0000","last_change":"2023-07-29T02:03:56.957227+0000","last_active":"2023-07-29T02:04:50.633311+0000","last_peered":"2023-07-29T02:04:50.633311+0000","last_clean":"2023-07-29T02:04:50.633311+0000","last_became_active":"2023-07-29T02:00:46.525331+0000","last_became_peered":"2023-07-29T02:00:46.525331+0000","last_unstale":"2023-07-29T02:04:50.633311+0000","last_undegraded":"2023-07-29T02:04:50.633311+0000","last_fullsized":"2023-07-29T02:04:50.633311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:44:39.930253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46925831499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"39'589","reported_seq":2661,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.254795+0000","last_change":"2023-07-29T02:03:57.172129+0000","last_active":"2023-07-29T02:06:07.254795+0000","last_peered":"2023-07-29T02:06:07.254795+0000","last_clean":"2023-07-29T02:06:07.254795+0000","last_became_active":"2023-07-29T02:00:01.996969+0000","last_became_peered":"2023-07-29T02:00:01.996969+0000","last_unstale":"2023-07-29T02:06:07.254795+0000","last_undegraded":"2023-07-29T02:06:07.254795+0000","last_fullsized":"2023-07-29T02:06:07.254795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:46:37.088979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.40090650999999999,"stat_sum":{"num_bytes":23342582,"num_objects":297,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":297,"num_whiteouts":0,"num_read":24,"num_read_kb":4119,"num_write":587,"num_write_kb":31305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"39'4","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.333735+0000","last_change":"2023-07-29T01:59:57.541115+0000","last_active":"2023-07-29T02:05:51.333735+0000","last_peered":"2023-07-29T02:05:51.333735+0000","last_clean":"2023-07-29T02:05:51.333735+0000","last_became_active":"2023-07-29T01:59:57.540800+0000","last_became_peered":"2023-07-29T01:59:57.540800+0000","last_unstale":"2023-07-29T02:05:51.333735+0000","last_undegraded":"2023-07-29T02:05:51.333735+0000","last_fullsized":"2023-07-29T02:05:51.333735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"39'77","reported_seq":2127,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.634663+0000","last_change":"2023-07-29T02:03:56.792291+0000","last_active":"2023-07-29T02:04:47.634663+0000","last_peered":"2023-07-29T02:04:47.634663+0000","last_clean":"2023-07-29T02:04:47.634663+0000","last_became_active":"2023-07-29T01:59:57.963510+0000","last_became_peered":"2023-07-29T01:59:57.963510+0000","last_unstale":"2023-07-29T02:04:47.634663+0000","last_undegraded":"2023-07-29T02:04:47.634663+0000","last_fullsized":"2023-07-29T02:04:47.634663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30420630999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"39'628","reported_seq":2717,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.247603+0000","last_change":"2023-07-29T02:03:57.173787+0000","last_active":"2023-07-29T02:06:07.247603+0000","last_peered":"2023-07-29T02:06:07.247603+0000","last_clean":"2023-07-29T02:06:07.247603+0000","last_became_active":"2023-07-29T02:00:01.996084+0000","last_became_peered":"2023-07-29T02:00:01.996084+0000","last_unstale":"2023-07-29T02:06:07.247603+0000","last_undegraded":"2023-07-29T02:06:07.247603+0000","last_fullsized":"2023-07-29T02:06:07.247603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:59:57.581952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38362237100000002,"stat_sum":{"num_bytes":15782931,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":41,"num_read_kb":8234,"num_write":627,"num_write_kb":19844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"39'2","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.887924+0000","last_change":"2023-07-29T01:59:57.548464+0000","last_active":"2023-07-29T02:05:51.887924+0000","last_peered":"2023-07-29T02:05:51.887924+0000","last_clean":"2023-07-29T02:05:51.887924+0000","last_became_active":"2023-07-29T01:59:57.548109+0000","last_became_peered":"2023-07-29T01:59:57.548109+0000","last_unstale":"2023-07-29T02:05:51.887924+0000","last_undegraded":"2023-07-29T02:05:51.887924+0000","last_fullsized":"2023-07-29T02:05:51.887924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:13.433053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"35'95","reported_seq":2145,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:20.414033+0000","last_change":"2023-07-29T02:03:57.037255+0000","last_active":"2023-07-29T02:04:20.414033+0000","last_peered":"2023-07-29T02:04:20.414033+0000","last_clean":"2023-07-29T02:04:20.414033+0000","last_became_active":"2023-07-29T01:59:57.961759+0000","last_became_peered":"2023-07-29T01:59:57.961759+0000","last_unstale":"2023-07-29T02:04:20.414033+0000","last_undegraded":"2023-07-29T02:04:20.414033+0000","last_fullsized":"2023-07-29T02:04:20.414033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55180089099999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"39'661","reported_seq":2754,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.775569+0000","last_change":"2023-07-29T02:03:56.798905+0000","last_active":"2023-07-29T02:06:07.775569+0000","last_peered":"2023-07-29T02:06:07.775569+0000","last_clean":"2023-07-29T02:06:07.775569+0000","last_became_active":"2023-07-29T02:00:01.992592+0000","last_became_peered":"2023-07-29T02:00:01.992592+0000","last_unstale":"2023-07-29T02:06:07.775569+0000","last_undegraded":"2023-07-29T02:06:07.775569+0000","last_fullsized":"2023-07-29T02:06:07.775569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:14:06.353802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30939737499999997,"stat_sum":{"num_bytes":46419699,"num_objects":303,"num_object_clones":0,"num_object_copies":1212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":303,"num_whiteouts":0,"num_read":45,"num_read_kb":20516,"num_write":660,"num_write_kb":45624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"39'98","reported_seq":151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:44.468105+0000","last_change":"2023-07-29T01:59:57.543707+0000","last_active":"2023-07-29T02:05:44.468105+0000","last_peered":"2023-07-29T02:05:44.468105+0000","last_clean":"2023-07-29T02:05:44.468105+0000","last_became_active":"2023-07-29T01:59:57.543398+0000","last_became_peered":"2023-07-29T01:59:57.543398+0000","last_unstale":"2023-07-29T02:05:44.468105+0000","last_undegraded":"2023-07-29T02:05:44.468105+0000","last_fullsized":"2023-07-29T02:05:44.468105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":8252,"num_write":102,"num_write_kb":8255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"39'81","reported_seq":2131,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:49.453150+0000","last_change":"2023-07-29T02:03:57.171910+0000","last_active":"2023-07-29T02:04:49.453150+0000","last_peered":"2023-07-29T02:04:49.453150+0000","last_clean":"2023-07-29T02:04:49.453150+0000","last_became_active":"2023-07-29T01:59:57.965962+0000","last_became_peered":"2023-07-29T01:59:57.965962+0000","last_unstale":"2023-07-29T02:04:49.453150+0000","last_undegraded":"2023-07-29T02:04:49.453150+0000","last_fullsized":"2023-07-29T02:04:49.453150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38151887499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"39'670","reported_seq":2767,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.907936+0000","last_change":"2023-07-29T02:03:56.698091+0000","last_active":"2023-07-29T02:06:07.907936+0000","last_peered":"2023-07-29T02:06:07.907936+0000","last_clean":"2023-07-29T02:06:07.907936+0000","last_became_active":"2023-07-29T02:00:01.992384+0000","last_became_peered":"2023-07-29T02:00:01.992384+0000","last_unstale":"2023-07-29T02:06:07.907936+0000","last_undegraded":"2023-07-29T02:06:07.907936+0000","last_fullsized":"2023-07-29T02:06:07.907936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19044205,"stat_sum":{"num_bytes":36575402,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":49,"num_read_kb":16426,"num_write":669,"num_write_kb":40161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"39'26","reported_seq":61,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:46.612297+0000","last_change":"2023-07-29T01:59:57.548392+0000","last_active":"2023-07-29T02:05:46.612297+0000","last_peered":"2023-07-29T02:05:46.612297+0000","last_clean":"2023-07-29T02:05:46.612297+0000","last_became_active":"2023-07-29T01:59:57.548084+0000","last_became_peered":"2023-07-29T01:59:57.548084+0000","last_unstale":"2023-07-29T02:05:46.612297+0000","last_undegraded":"2023-07-29T02:05:46.612297+0000","last_fullsized":"2023-07-29T02:05:46.612297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":27,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"35'83","reported_seq":2133,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.449967+0000","last_change":"2023-07-29T02:03:56.784306+0000","last_active":"2023-07-29T02:04:19.449967+0000","last_peered":"2023-07-29T02:04:19.449967+0000","last_clean":"2023-07-29T02:04:19.449967+0000","last_became_active":"2023-07-29T01:59:57.964626+0000","last_became_peered":"2023-07-29T01:59:57.964626+0000","last_unstale":"2023-07-29T02:04:19.449967+0000","last_undegraded":"2023-07-29T02:04:19.449967+0000","last_fullsized":"2023-07-29T02:04:19.449967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.297089139,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"39'673","reported_seq":2761,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.225534+0000","last_change":"2023-07-29T02:03:56.961858+0000","last_active":"2023-07-29T02:06:07.225534+0000","last_peered":"2023-07-29T02:06:07.225534+0000","last_clean":"2023-07-29T02:06:07.225534+0000","last_became_active":"2023-07-29T02:00:01.990579+0000","last_became_peered":"2023-07-29T02:00:01.990579+0000","last_unstale":"2023-07-29T02:06:07.225534+0000","last_undegraded":"2023-07-29T02:06:07.225534+0000","last_fullsized":"2023-07-29T02:06:07.225534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:11:53.398210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.47400464199999998,"stat_sum":{"num_bytes":32895626,"num_objects":333,"num_object_clones":0,"num_object_copies":1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":333,"num_whiteouts":0,"num_read":40,"num_read_kb":14736,"num_write":673,"num_write_kb":36572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"39'242","reported_seq":279,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.546339+0000","last_change":"2023-07-29T01:59:57.549270+0000","last_active":"2023-07-29T02:05:51.546339+0000","last_peered":"2023-07-29T02:05:51.546339+0000","last_clean":"2023-07-29T02:05:51.546339+0000","last_became_active":"2023-07-29T01:59:57.548981+0000","last_became_peered":"2023-07-29T01:59:57.548981+0000","last_unstale":"2023-07-29T02:05:51.546339+0000","last_undegraded":"2023-07-29T02:05:51.546339+0000","last_fullsized":"2023-07-29T02:05:51.546339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:05.783369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":244,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"39'91","reported_seq":2141,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.978727+0000","last_change":"2023-07-29T02:03:57.111934+0000","last_active":"2023-07-29T02:04:21.978727+0000","last_peered":"2023-07-29T02:04:21.978727+0000","last_clean":"2023-07-29T02:04:21.978727+0000","last_became_active":"2023-07-29T01:59:57.969501+0000","last_became_peered":"2023-07-29T01:59:57.969501+0000","last_unstale":"2023-07-29T02:04:21.978727+0000","last_undegraded":"2023-07-29T02:04:21.978727+0000","last_fullsized":"2023-07-29T02:04:21.978727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:34.526572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35565022000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"39'641","reported_seq":2727,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.163523+0000","last_change":"2023-07-29T02:03:56.959814+0000","last_active":"2023-07-29T02:06:07.163523+0000","last_peered":"2023-07-29T02:06:07.163523+0000","last_clean":"2023-07-29T02:06:07.163523+0000","last_became_active":"2023-07-29T02:00:01.989364+0000","last_became_peered":"2023-07-29T02:00:01.989364+0000","last_unstale":"2023-07-29T02:06:07.163523+0000","last_undegraded":"2023-07-29T02:06:07.163523+0000","last_fullsized":"2023-07-29T02:06:07.163523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:01:14.849757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.47145374600000001,"stat_sum":{"num_bytes":24224399,"num_objects":325,"num_object_clones":0,"num_object_copies":1300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":38,"num_read_kb":8228,"num_write":641,"num_write_kb":23994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"39'6","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:44.468681+0000","last_change":"2023-07-29T01:59:57.541329+0000","last_active":"2023-07-29T02:05:44.468681+0000","last_peered":"2023-07-29T02:05:44.468681+0000","last_clean":"2023-07-29T02:05:44.468681+0000","last_became_active":"2023-07-29T01:59:57.541056+0000","last_became_peered":"2023-07-29T01:59:57.541056+0000","last_unstale":"2023-07-29T02:05:44.468681+0000","last_undegraded":"2023-07-29T02:05:44.468681+0000","last_fullsized":"2023-07-29T02:05:44.468681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":8,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"35'83","reported_seq":2133,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444936+0000","last_change":"2023-07-29T02:03:56.982964+0000","last_active":"2023-07-29T02:04:19.444936+0000","last_peered":"2023-07-29T02:04:19.444936+0000","last_clean":"2023-07-29T02:04:19.444936+0000","last_became_active":"2023-07-29T01:59:57.974998+0000","last_became_peered":"2023-07-29T01:59:57.974998+0000","last_unstale":"2023-07-29T02:04:19.444936+0000","last_undegraded":"2023-07-29T02:04:19.444936+0000","last_fullsized":"2023-07-29T02:04:19.444936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:14.435169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20531364299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"39'660","reported_seq":2739,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.341472+0000","last_change":"2023-07-29T02:03:56.963785+0000","last_active":"2023-07-29T02:06:07.341472+0000","last_peered":"2023-07-29T02:06:07.341472+0000","last_clean":"2023-07-29T02:06:07.341472+0000","last_became_active":"2023-07-29T02:00:01.990276+0000","last_became_peered":"2023-07-29T02:00:01.990276+0000","last_unstale":"2023-07-29T02:06:07.341472+0000","last_undegraded":"2023-07-29T02:06:07.341472+0000","last_fullsized":"2023-07-29T02:06:07.341472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.47581172799999999,"stat_sum":{"num_bytes":20642551,"num_objects":321,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":321,"num_whiteouts":0,"num_read":31,"num_read_kb":1050,"num_write":661,"num_write_kb":24562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"39'8","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.543673+0000","last_change":"2023-07-29T01:59:57.544524+0000","last_active":"2023-07-29T02:05:51.543673+0000","last_peered":"2023-07-29T02:05:51.543673+0000","last_clean":"2023-07-29T02:05:51.543673+0000","last_became_active":"2023-07-29T01:59:57.544231+0000","last_became_peered":"2023-07-29T01:59:57.544231+0000","last_unstale":"2023-07-29T02:05:51.543673+0000","last_undegraded":"2023-07-29T02:05:51.543673+0000","last_fullsized":"2023-07-29T02:05:51.543673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"39'80","reported_seq":2130,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:29.435534+0000","last_change":"2023-07-29T02:03:57.033536+0000","last_active":"2023-07-29T02:04:29.435534+0000","last_peered":"2023-07-29T02:04:29.435534+0000","last_clean":"2023-07-29T02:04:29.435534+0000","last_became_active":"2023-07-29T01:59:57.974525+0000","last_became_peered":"2023-07-29T01:59:57.974525+0000","last_unstale":"2023-07-29T02:04:29.435534+0000","last_undegraded":"2023-07-29T02:04:29.435534+0000","last_fullsized":"2023-07-29T02:04:29.435534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.105781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.549422509,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"39'632","reported_seq":2721,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.136824+0000","last_change":"2023-07-29T02:03:56.961596+0000","last_active":"2023-07-29T02:06:07.136824+0000","last_peered":"2023-07-29T02:06:07.136824+0000","last_clean":"2023-07-29T02:06:07.136824+0000","last_became_active":"2023-07-29T02:00:01.988486+0000","last_became_peered":"2023-07-29T02:00:01.988486+0000","last_unstale":"2023-07-29T02:06:07.136824+0000","last_undegraded":"2023-07-29T02:06:07.136824+0000","last_fullsized":"2023-07-29T02:06:07.136824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:19:07.842328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.473472642,"stat_sum":{"num_bytes":32792736,"num_objects":300,"num_object_clones":0,"num_object_copies":1200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":300,"num_whiteouts":0,"num_read":41,"num_read_kb":18442,"num_write":630,"num_write_kb":40548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"39'375","reported_seq":411,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:55.655087+0000","last_change":"2023-07-29T01:59:57.535498+0000","last_active":"2023-07-29T02:05:55.655087+0000","last_peered":"2023-07-29T02:05:55.655087+0000","last_clean":"2023-07-29T02:05:55.655087+0000","last_became_active":"2023-07-29T01:59:57.534813+0000","last_became_peered":"2023-07-29T01:59:57.534813+0000","last_unstale":"2023-07-29T02:05:55.655087+0000","last_undegraded":"2023-07-29T02:05:55.655087+0000","last_fullsized":"2023-07-29T02:05:55.655087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":8198,"num_write":371,"num_write_kb":12605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"39'90","reported_seq":2140,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:29.440937+0000","last_change":"2023-07-29T02:03:57.110073+0000","last_active":"2023-07-29T02:04:29.440937+0000","last_peered":"2023-07-29T02:04:29.440937+0000","last_clean":"2023-07-29T02:04:29.440937+0000","last_became_active":"2023-07-29T01:59:57.962184+0000","last_became_peered":"2023-07-29T01:59:57.962184+0000","last_unstale":"2023-07-29T02:04:29.440937+0000","last_undegraded":"2023-07-29T02:04:29.440937+0000","last_fullsized":"2023-07-29T02:04:29.440937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36182750899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"39'688","reported_seq":2776,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.851869+0000","last_change":"2023-07-29T02:03:57.053859+0000","last_active":"2023-07-29T02:06:07.851869+0000","last_peered":"2023-07-29T02:06:07.851869+0000","last_clean":"2023-07-29T02:06:07.851869+0000","last_became_active":"2023-07-29T02:00:01.989151+0000","last_became_peered":"2023-07-29T02:00:01.989151+0000","last_unstale":"2023-07-29T02:06:07.851869+0000","last_undegraded":"2023-07-29T02:06:07.851869+0000","last_fullsized":"2023-07-29T02:06:07.851869+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:21:35.031304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54490939800000004,"stat_sum":{"num_bytes":33219663,"num_objects":326,"num_object_clones":0,"num_object_copies":1304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":326,"num_whiteouts":0,"num_read":40,"num_read_kb":16418,"num_write":687,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"39'156","reported_seq":188,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:06.987414+0000","last_change":"2023-07-29T01:59:57.544466+0000","last_active":"2023-07-29T02:06:06.987414+0000","last_peered":"2023-07-29T02:06:06.987414+0000","last_clean":"2023-07-29T02:06:06.987414+0000","last_became_active":"2023-07-29T01:59:57.544120+0000","last_became_peered":"2023-07-29T01:59:57.544120+0000","last_unstale":"2023-07-29T02:06:06.987414+0000","last_undegraded":"2023-07-29T02:06:06.987414+0000","last_fullsized":"2023-07-29T02:06:06.987414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":155,"num_write_kb":8287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"39'86","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:29.441011+0000","last_change":"2023-07-29T02:03:57.107586+0000","last_active":"2023-07-29T02:04:29.441011+0000","last_peered":"2023-07-29T02:04:29.441011+0000","last_clean":"2023-07-29T02:04:29.441011+0000","last_became_active":"2023-07-29T01:59:57.961975+0000","last_became_peered":"2023-07-29T01:59:57.961975+0000","last_unstale":"2023-07-29T02:04:29.441011+0000","last_undegraded":"2023-07-29T02:04:29.441011+0000","last_fullsized":"2023-07-29T02:04:29.441011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:27:01.059953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37361334099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"39'646","reported_seq":2738,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.799960+0000","last_change":"2023-07-29T02:03:56.800119+0000","last_active":"2023-07-29T02:06:07.799960+0000","last_peered":"2023-07-29T02:06:07.799960+0000","last_clean":"2023-07-29T02:06:07.799960+0000","last_became_active":"2023-07-29T02:00:01.988155+0000","last_became_peered":"2023-07-29T02:00:01.988155+0000","last_unstale":"2023-07-29T02:06:07.799960+0000","last_undegraded":"2023-07-29T02:06:07.799960+0000","last_fullsized":"2023-07-29T02:06:07.799960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30982225000000002,"stat_sum":{"num_bytes":22073203,"num_objects":313,"num_object_clones":0,"num_object_copies":1252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":44,"num_read_kb":12328,"num_write":643,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"39'63","reported_seq":95,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:44.477329+0000","last_change":"2023-07-29T01:59:57.549764+0000","last_active":"2023-07-29T02:05:44.477329+0000","last_peered":"2023-07-29T02:05:44.477329+0000","last_clean":"2023-07-29T02:05:44.477329+0000","last_became_active":"2023-07-29T01:59:57.549470+0000","last_became_peered":"2023-07-29T01:59:57.549470+0000","last_unstale":"2023-07-29T02:05:44.477329+0000","last_undegraded":"2023-07-29T02:05:44.477329+0000","last_fullsized":"2023-07-29T02:05:44.477329+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":64,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"35'60","reported_seq":2110,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.980241+0000","last_change":"2023-07-29T02:03:57.081019+0000","last_active":"2023-07-29T02:04:21.980241+0000","last_peered":"2023-07-29T02:04:21.980241+0000","last_clean":"2023-07-29T02:04:21.980241+0000","last_became_active":"2023-07-29T01:59:57.962016+0000","last_became_peered":"2023-07-29T01:59:57.962016+0000","last_unstale":"2023-07-29T02:04:21.980241+0000","last_undegraded":"2023-07-29T02:04:21.980241+0000","last_fullsized":"2023-07-29T02:04:21.980241+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:08.813083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36599154900000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"39'565","reported_seq":2653,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.767129+0000","last_change":"2023-07-29T02:03:57.082127+0000","last_active":"2023-07-29T02:06:07.767129+0000","last_peered":"2023-07-29T02:06:07.767129+0000","last_clean":"2023-07-29T02:06:07.767129+0000","last_became_active":"2023-07-29T02:00:01.992042+0000","last_became_peered":"2023-07-29T02:00:01.992042+0000","last_unstale":"2023-07-29T02:06:07.767129+0000","last_undegraded":"2023-07-29T02:06:07.767129+0000","last_fullsized":"2023-07-29T02:06:07.767129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:24:44.331640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36734029699999998,"stat_sum":{"num_bytes":17472104,"num_objects":288,"num_object_clones":0,"num_object_copies":1152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":40,"num_read_kb":12324,"num_write":565,"num_write_kb":21394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"39'10","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.552303+0000","last_change":"2023-07-29T01:59:57.537045+0000","last_active":"2023-07-29T02:05:51.552303+0000","last_peered":"2023-07-29T02:05:51.552303+0000","last_clean":"2023-07-29T02:05:51.552303+0000","last_became_active":"2023-07-29T01:59:57.535762+0000","last_became_peered":"2023-07-29T01:59:57.535762+0000","last_unstale":"2023-07-29T02:05:51.552303+0000","last_undegraded":"2023-07-29T02:05:51.552303+0000","last_fullsized":"2023-07-29T02:05:51.552303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":13,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"36'78","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.927518+0000","last_change":"2023-07-29T02:03:57.049662+0000","last_active":"2023-07-29T02:04:21.927518+0000","last_peered":"2023-07-29T02:04:21.927518+0000","last_clean":"2023-07-29T02:04:21.927518+0000","last_became_active":"2023-07-29T01:59:57.974834+0000","last_became_peered":"2023-07-29T01:59:57.974834+0000","last_unstale":"2023-07-29T02:04:21.927518+0000","last_undegraded":"2023-07-29T02:04:21.927518+0000","last_fullsized":"2023-07-29T02:04:21.927518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53560260199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"39'713","reported_seq":2791,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:08.028422+0000","last_change":"2023-07-29T02:03:57.112720+0000","last_active":"2023-07-29T02:06:08.028422+0000","last_peered":"2023-07-29T02:06:08.028422+0000","last_clean":"2023-07-29T02:06:08.028422+0000","last_became_active":"2023-07-29T02:00:01.990464+0000","last_became_peered":"2023-07-29T02:00:01.990464+0000","last_unstale":"2023-07-29T02:06:08.028422+0000","last_undegraded":"2023-07-29T02:06:08.028422+0000","last_fullsized":"2023-07-29T02:06:08.028422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:16:46.676860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.356278702,"stat_sum":{"num_bytes":25950589,"num_objects":363,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":363,"num_whiteouts":0,"num_read":30,"num_read_kb":4124,"num_write":712,"num_write_kb":29793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"39'162","reported_seq":199,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:54.757116+0000","last_change":"2023-07-29T01:59:57.540561+0000","last_active":"2023-07-29T02:05:54.757116+0000","last_peered":"2023-07-29T02:05:54.757116+0000","last_clean":"2023-07-29T02:05:54.757116+0000","last_became_active":"2023-07-29T01:59:57.540292+0000","last_became_peered":"2023-07-29T01:59:57.540292+0000","last_unstale":"2023-07-29T02:05:54.757116+0000","last_undegraded":"2023-07-29T02:05:54.757116+0000","last_fullsized":"2023-07-29T02:05:54.757116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":162,"num_write_kb":4206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.981740+0000","last_change":"2023-07-29T01:59:52.448098+0000","last_active":"2023-07-29T02:04:21.981740+0000","last_peered":"2023-07-29T02:04:21.981740+0000","last_clean":"2023-07-29T02:04:21.981740+0000","last_became_active":"2023-07-29T01:59:52.447782+0000","last_became_peered":"2023-07-29T01:59:52.447782+0000","last_unstale":"2023-07-29T02:04:21.981740+0000","last_undegraded":"2023-07-29T02:04:21.981740+0000","last_fullsized":"2023-07-29T02:04:21.981740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:31.981804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"35'75","reported_seq":2126,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.442789+0000","last_change":"2023-07-29T02:03:57.173984+0000","last_active":"2023-07-29T02:04:19.442789+0000","last_peered":"2023-07-29T02:04:19.442789+0000","last_clean":"2023-07-29T02:04:19.442789+0000","last_became_active":"2023-07-29T01:59:57.966065+0000","last_became_peered":"2023-07-29T01:59:57.966065+0000","last_unstale":"2023-07-29T02:04:19.442789+0000","last_undegraded":"2023-07-29T02:04:19.442789+0000","last_fullsized":"2023-07-29T02:04:19.442789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37241656400000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"39'677","reported_seq":2773,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:06.908171+0000","last_change":"2023-07-29T02:03:57.174632+0000","last_active":"2023-07-29T02:06:06.908171+0000","last_peered":"2023-07-29T02:06:06.908171+0000","last_clean":"2023-07-29T02:06:06.908171+0000","last_became_active":"2023-07-29T02:00:01.995963+0000","last_became_peered":"2023-07-29T02:00:01.995963+0000","last_unstale":"2023-07-29T02:06:06.908171+0000","last_undegraded":"2023-07-29T02:06:06.908171+0000","last_fullsized":"2023-07-29T02:06:06.908171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:06:19.130853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.373304892,"stat_sum":{"num_bytes":14135733,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":47,"num_read_kb":4140,"num_write":679,"num_write_kb":14069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444185+0000","last_change":"2023-07-29T01:59:52.445649+0000","last_active":"2023-07-29T02:04:19.444185+0000","last_peered":"2023-07-29T02:04:19.444185+0000","last_clean":"2023-07-29T02:04:19.444185+0000","last_became_active":"2023-07-29T01:59:52.445337+0000","last_became_peered":"2023-07-29T01:59:52.445337+0000","last_unstale":"2023-07-29T02:04:19.444185+0000","last_undegraded":"2023-07-29T02:04:19.444185+0000","last_fullsized":"2023-07-29T02:04:19.444185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"39'36","reported_seq":70,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:04.716354+0000","last_change":"2023-07-29T01:59:57.537863+0000","last_active":"2023-07-29T02:06:04.716354+0000","last_peered":"2023-07-29T02:06:04.716354+0000","last_clean":"2023-07-29T02:06:04.716354+0000","last_became_active":"2023-07-29T01:59:57.537581+0000","last_became_peered":"2023-07-29T01:59:57.537581+0000","last_unstale":"2023-07-29T02:06:04.716354+0000","last_undegraded":"2023-07-29T02:06:04.716354+0000","last_fullsized":"2023-07-29T02:06:04.716354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:02:57.137574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8,"num_write":80,"num_write_kb":1322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"36'77","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.980339+0000","last_change":"2023-07-29T02:03:57.112487+0000","last_active":"2023-07-29T02:04:21.980339+0000","last_peered":"2023-07-29T02:04:21.980339+0000","last_clean":"2023-07-29T02:04:21.980339+0000","last_became_active":"2023-07-29T01:59:57.961298+0000","last_became_peered":"2023-07-29T01:59:57.961298+0000","last_unstale":"2023-07-29T02:04:21.980339+0000","last_undegraded":"2023-07-29T02:04:21.980339+0000","last_fullsized":"2023-07-29T02:04:21.980339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:11:49.956637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35104021600000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"39'622","reported_seq":2707,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.797342+0000","last_change":"2023-07-29T02:03:56.799516+0000","last_active":"2023-07-29T02:06:07.797342+0000","last_peered":"2023-07-29T02:06:07.797342+0000","last_clean":"2023-07-29T02:06:07.797342+0000","last_became_active":"2023-07-29T02:00:01.986915+0000","last_became_peered":"2023-07-29T02:00:01.986915+0000","last_unstale":"2023-07-29T02:06:07.797342+0000","last_undegraded":"2023-07-29T02:06:07.797342+0000","last_fullsized":"2023-07-29T02:06:07.797342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:35:48.256508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30985112500000001,"stat_sum":{"num_bytes":28815426,"num_objects":291,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":291,"num_whiteouts":0,"num_read":37,"num_read_kb":4131,"num_write":621,"num_write_kb":32518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.926459+0000","last_change":"2023-07-29T01:59:52.448423+0000","last_active":"2023-07-29T02:04:21.926459+0000","last_peered":"2023-07-29T02:04:21.926459+0000","last_clean":"2023-07-29T02:04:21.926459+0000","last_became_active":"2023-07-29T01:59:52.448052+0000","last_became_peered":"2023-07-29T01:59:52.448052+0000","last_unstale":"2023-07-29T02:04:21.926459+0000","last_undegraded":"2023-07-29T02:04:21.926459+0000","last_fullsized":"2023-07-29T02:04:21.926459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:31.981804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":185,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444525+0000","last_change":"2023-07-29T01:59:52.450730+0000","last_active":"2023-07-29T02:04:19.444525+0000","last_peered":"2023-07-29T02:04:19.444525+0000","last_clean":"2023-07-29T02:04:19.444525+0000","last_became_active":"2023-07-29T01:59:52.449582+0000","last_became_peered":"2023-07-29T01:59:52.449582+0000","last_unstale":"2023-07-29T02:04:19.444525+0000","last_undegraded":"2023-07-29T02:04:19.444525+0000","last_fullsized":"2023-07-29T02:04:19.444525+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:01:27.099648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"39'65","reported_seq":161,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:38.653219+0000","last_change":"2023-07-29T01:59:57.546474+0000","last_active":"2023-07-29T02:05:38.653219+0000","last_peered":"2023-07-29T02:05:38.653219+0000","last_clean":"2023-07-29T02:05:38.653219+0000","last_became_active":"2023-07-29T01:59:57.546179+0000","last_became_peered":"2023-07-29T01:59:57.546179+0000","last_unstale":"2023-07-29T02:05:38.653219+0000","last_undegraded":"2023-07-29T02:05:38.653219+0000","last_fullsized":"2023-07-29T02:05:38.653219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576046,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":608,"num_write":63,"num_write_kb":608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"36'86","reported_seq":2136,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.434643+0000","last_change":"2023-07-29T02:03:57.038626+0000","last_active":"2023-07-29T02:04:19.434643+0000","last_peered":"2023-07-29T02:04:19.434643+0000","last_clean":"2023-07-29T02:04:19.434643+0000","last_became_active":"2023-07-29T01:59:57.975078+0000","last_became_peered":"2023-07-29T01:59:57.975078+0000","last_unstale":"2023-07-29T02:04:19.434643+0000","last_undegraded":"2023-07-29T02:04:19.434643+0000","last_fullsized":"2023-07-29T02:04:19.434643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55319968200000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"39'709","reported_seq":2807,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.742045+0000","last_change":"2023-07-29T02:03:56.966106+0000","last_active":"2023-07-29T02:06:07.742045+0000","last_peered":"2023-07-29T02:06:07.742045+0000","last_clean":"2023-07-29T02:06:07.742045+0000","last_became_active":"2023-07-29T02:00:01.986937+0000","last_became_peered":"2023-07-29T02:00:01.986937+0000","last_unstale":"2023-07-29T02:06:07.742045+0000","last_undegraded":"2023-07-29T02:06:07.742045+0000","last_fullsized":"2023-07-29T02:06:07.742045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:53.580244+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.47715394799999999,"stat_sum":{"num_bytes":40554601,"num_objects":344,"num_object_clones":0,"num_object_copies":1376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":344,"num_whiteouts":0,"num_read":51,"num_read_kb":15453,"num_write":703,"num_write_kb":39978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444967+0000","last_change":"2023-07-29T01:59:53.171806+0000","last_active":"2023-07-29T02:04:19.444967+0000","last_peered":"2023-07-29T02:04:19.444967+0000","last_clean":"2023-07-29T02:04:19.444967+0000","last_became_active":"2023-07-29T01:59:53.171467+0000","last_became_peered":"2023-07-29T01:59:53.171467+0000","last_unstale":"2023-07-29T02:04:19.444967+0000","last_undegraded":"2023-07-29T02:04:19.444967+0000","last_fullsized":"2023-07-29T02:04:19.444967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"39'249","reported_seq":285,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.552980+0000","last_change":"2023-07-29T01:59:57.549442+0000","last_active":"2023-07-29T02:05:51.552980+0000","last_peered":"2023-07-29T02:05:51.552980+0000","last_clean":"2023-07-29T02:05:51.552980+0000","last_became_active":"2023-07-29T01:59:57.549151+0000","last_became_peered":"2023-07-29T01:59:57.549151+0000","last_unstale":"2023-07-29T02:05:51.552980+0000","last_undegraded":"2023-07-29T02:05:51.552980+0000","last_fullsized":"2023-07-29T02:05:51.552980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":11035,"num_write":246,"num_write_kb":12456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"39'83","reported_seq":2133,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.927123+0000","last_change":"2023-07-29T02:03:57.051306+0000","last_active":"2023-07-29T02:04:21.927123+0000","last_peered":"2023-07-29T02:04:21.927123+0000","last_clean":"2023-07-29T02:04:21.927123+0000","last_became_active":"2023-07-29T01:59:57.969273+0000","last_became_peered":"2023-07-29T01:59:57.969273+0000","last_unstale":"2023-07-29T02:04:21.927123+0000","last_undegraded":"2023-07-29T02:04:21.927123+0000","last_fullsized":"2023-07-29T02:04:21.927123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:56:07.949649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53741308300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"39'638","reported_seq":2718,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.440171+0000","last_change":"2023-07-29T02:03:56.696365+0000","last_active":"2023-07-29T02:06:07.440171+0000","last_peered":"2023-07-29T02:06:07.440171+0000","last_clean":"2023-07-29T02:06:07.440171+0000","last_became_active":"2023-07-29T02:00:01.992406+0000","last_became_peered":"2023-07-29T02:00:01.992406+0000","last_unstale":"2023-07-29T02:06:07.440171+0000","last_undegraded":"2023-07-29T02:06:07.440171+0000","last_fullsized":"2023-07-29T02:06:07.440171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:12.254656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18856821800000001,"stat_sum":{"num_bytes":24793019,"num_objects":324,"num_object_clones":0,"num_object_copies":1296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":324,"num_whiteouts":0,"num_read":32,"num_read_kb":11492,"num_write":638,"num_write_kb":27823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444207+0000","last_change":"2023-07-29T01:59:53.171746+0000","last_active":"2023-07-29T02:04:19.444207+0000","last_peered":"2023-07-29T02:04:19.444207+0000","last_clean":"2023-07-29T02:04:19.444207+0000","last_became_active":"2023-07-29T01:59:53.171440+0000","last_became_peered":"2023-07-29T01:59:53.171440+0000","last_unstale":"2023-07-29T02:04:19.444207+0000","last_undegraded":"2023-07-29T02:04:19.444207+0000","last_fullsized":"2023-07-29T02:04:19.444207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:17:56.960611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"39'5","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:44.477182+0000","last_change":"2023-07-29T01:59:57.537970+0000","last_active":"2023-07-29T02:05:44.477182+0000","last_peered":"2023-07-29T02:05:44.477182+0000","last_clean":"2023-07-29T02:05:44.477182+0000","last_became_active":"2023-07-29T01:59:57.537665+0000","last_became_peered":"2023-07-29T01:59:57.537665+0000","last_unstale":"2023-07-29T02:05:44.477182+0000","last_undegraded":"2023-07-29T02:05:44.477182+0000","last_fullsized":"2023-07-29T02:05:44.477182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":4,"num_write_kb":8199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"35'79","reported_seq":2130,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.445095+0000","last_change":"2023-07-29T02:03:56.981337+0000","last_active":"2023-07-29T02:04:19.445095+0000","last_peered":"2023-07-29T02:04:19.445095+0000","last_clean":"2023-07-29T02:04:19.445095+0000","last_became_active":"2023-07-29T01:59:57.968373+0000","last_became_peered":"2023-07-29T01:59:57.968373+0000","last_unstale":"2023-07-29T02:04:19.445095+0000","last_undegraded":"2023-07-29T02:04:19.445095+0000","last_fullsized":"2023-07-29T02:04:19.445095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:06.785485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21661398800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"39'634","reported_seq":2720,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.594640+0000","last_change":"2023-07-29T02:03:57.040708+0000","last_active":"2023-07-29T02:06:07.594640+0000","last_peered":"2023-07-29T02:06:07.594640+0000","last_clean":"2023-07-29T02:06:07.594640+0000","last_became_active":"2023-07-29T02:00:01.984476+0000","last_became_peered":"2023-07-29T02:00:01.984476+0000","last_unstale":"2023-07-29T02:06:07.594640+0000","last_undegraded":"2023-07-29T02:06:07.594640+0000","last_fullsized":"2023-07-29T02:06:07.594640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55548792300000005,"stat_sum":{"num_bytes":35592378,"num_objects":339,"num_object_clones":0,"num_object_copies":1356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":339,"num_whiteouts":0,"num_read":38,"num_read_kb":16563,"num_write":635,"num_write_kb":39103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.815399+0000","last_change":"2023-07-29T01:59:53.172039+0000","last_active":"2023-07-29T02:04:21.815399+0000","last_peered":"2023-07-29T02:04:21.815399+0000","last_clean":"2023-07-29T02:04:21.815399+0000","last_became_active":"2023-07-29T01:59:53.171617+0000","last_became_peered":"2023-07-29T01:59:53.171617+0000","last_unstale":"2023-07-29T02:04:21.815399+0000","last_undegraded":"2023-07-29T02:04:21.815399+0000","last_fullsized":"2023-07-29T02:04:21.815399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"39'14","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:54.756200+0000","last_change":"2023-07-29T01:59:57.540888+0000","last_active":"2023-07-29T02:05:54.756200+0000","last_peered":"2023-07-29T02:05:54.756200+0000","last_clean":"2023-07-29T02:05:54.756200+0000","last_became_active":"2023-07-29T01:59:57.540449+0000","last_became_peered":"2023-07-29T01:59:57.540449+0000","last_unstale":"2023-07-29T02:05:54.756200+0000","last_undegraded":"2023-07-29T02:05:54.756200+0000","last_fullsized":"2023-07-29T02:05:54.756200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"35'81","reported_seq":2132,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.926453+0000","last_change":"2023-07-29T02:03:57.049030+0000","last_active":"2023-07-29T02:04:21.926453+0000","last_peered":"2023-07-29T02:04:21.926453+0000","last_clean":"2023-07-29T02:04:21.926453+0000","last_became_active":"2023-07-29T01:59:57.967933+0000","last_became_peered":"2023-07-29T01:59:57.967933+0000","last_unstale":"2023-07-29T02:04:21.926453+0000","last_undegraded":"2023-07-29T02:04:21.926453+0000","last_fullsized":"2023-07-29T02:04:21.926453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54069509900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"39'665","reported_seq":2750,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.868250+0000","last_change":"2023-07-29T02:03:56.982796+0000","last_active":"2023-07-29T02:06:07.868250+0000","last_peered":"2023-07-29T02:06:07.868250+0000","last_clean":"2023-07-29T02:06:07.868250+0000","last_became_active":"2023-07-29T02:00:01.984691+0000","last_became_peered":"2023-07-29T02:00:01.984691+0000","last_unstale":"2023-07-29T02:06:07.868250+0000","last_undegraded":"2023-07-29T02:06:07.868250+0000","last_fullsized":"2023-07-29T02:06:07.868250+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:54.400954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.204776021,"stat_sum":{"num_bytes":24859419,"num_objects":316,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":316,"num_whiteouts":0,"num_read":37,"num_read_kb":6702,"num_write":664,"num_write_kb":28713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:14.449534+0000","last_change":"2023-07-29T01:59:53.171808+0000","last_active":"2023-07-29T02:04:14.449534+0000","last_peered":"2023-07-29T02:04:14.449534+0000","last_clean":"2023-07-29T02:04:14.449534+0000","last_became_active":"2023-07-29T01:59:53.171463+0000","last_became_peered":"2023-07-29T01:59:53.171463+0000","last_unstale":"2023-07-29T02:04:14.449534+0000","last_undegraded":"2023-07-29T02:04:14.449534+0000","last_fullsized":"2023-07-29T02:04:14.449534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:07:59.559814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"39'7","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:54.755973+0000","last_change":"2023-07-29T01:59:57.549468+0000","last_active":"2023-07-29T02:05:54.755973+0000","last_peered":"2023-07-29T02:05:54.755973+0000","last_clean":"2023-07-29T02:05:54.755973+0000","last_became_active":"2023-07-29T01:59:57.549181+0000","last_became_peered":"2023-07-29T01:59:57.549181+0000","last_unstale":"2023-07-29T02:05:54.755973+0000","last_undegraded":"2023-07-29T02:05:54.755973+0000","last_fullsized":"2023-07-29T02:05:54.755973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"39'90","reported_seq":2141,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:38.656184+0000","last_change":"2023-07-29T02:03:57.036363+0000","last_active":"2023-07-29T02:05:38.656184+0000","last_peered":"2023-07-29T02:05:38.656184+0000","last_clean":"2023-07-29T02:05:38.656184+0000","last_became_active":"2023-07-29T01:59:57.963659+0000","last_became_peered":"2023-07-29T01:59:57.963659+0000","last_unstale":"2023-07-29T02:05:38.656184+0000","last_undegraded":"2023-07-29T02:05:38.656184+0000","last_fullsized":"2023-07-29T02:05:38.656184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55193447900000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"39'682","reported_seq":2770,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.773690+0000","last_change":"2023-07-29T02:03:57.036172+0000","last_active":"2023-07-29T02:06:07.773690+0000","last_peered":"2023-07-29T02:06:07.773690+0000","last_clean":"2023-07-29T02:06:07.773690+0000","last_became_active":"2023-07-29T02:00:01.983744+0000","last_became_peered":"2023-07-29T02:00:01.983744+0000","last_unstale":"2023-07-29T02:06:07.773690+0000","last_undegraded":"2023-07-29T02:06:07.773690+0000","last_fullsized":"2023-07-29T02:06:07.773690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.552203522,"stat_sum":{"num_bytes":32278530,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":40,"num_read_kb":16416,"num_write":683,"num_write_kb":31830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:14.449587+0000","last_change":"2023-07-29T01:59:52.449102+0000","last_active":"2023-07-29T02:04:14.449587+0000","last_peered":"2023-07-29T02:04:14.449587+0000","last_clean":"2023-07-29T02:04:14.449587+0000","last_became_active":"2023-07-29T01:59:52.448814+0000","last_became_peered":"2023-07-29T01:59:52.448814+0000","last_unstale":"2023-07-29T02:04:14.449587+0000","last_undegraded":"2023-07-29T02:04:14.449587+0000","last_fullsized":"2023-07-29T02:04:14.449587+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"39'425","reported_seq":458,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:47.148677+0000","last_change":"2023-07-29T01:59:57.544590+0000","last_active":"2023-07-29T02:05:47.148677+0000","last_peered":"2023-07-29T02:05:47.148677+0000","last_clean":"2023-07-29T02:05:47.148677+0000","last_became_active":"2023-07-29T01:59:57.544317+0000","last_became_peered":"2023-07-29T01:59:57.544317+0000","last_unstale":"2023-07-29T02:05:47.148677+0000","last_undegraded":"2023-07-29T02:05:47.148677+0000","last_fullsized":"2023-07-29T02:05:47.148677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":424,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"39'82","reported_seq":2133,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:47.637540+0000","last_change":"2023-07-29T02:03:57.049937+0000","last_active":"2023-07-29T02:04:47.637540+0000","last_peered":"2023-07-29T02:04:47.637540+0000","last_clean":"2023-07-29T02:04:47.637540+0000","last_became_active":"2023-07-29T01:59:57.969642+0000","last_became_peered":"2023-07-29T01:59:57.969642+0000","last_unstale":"2023-07-29T02:04:47.637540+0000","last_undegraded":"2023-07-29T02:04:47.637540+0000","last_fullsized":"2023-07-29T02:04:47.637540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53741660000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"39'637","reported_seq":2730,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.912007+0000","last_change":"2023-07-29T02:03:57.053813+0000","last_active":"2023-07-29T02:06:07.912007+0000","last_peered":"2023-07-29T02:06:07.912007+0000","last_clean":"2023-07-29T02:06:07.912007+0000","last_became_active":"2023-07-29T02:00:01.998715+0000","last_became_peered":"2023-07-29T02:00:01.998715+0000","last_unstale":"2023-07-29T02:06:07.912007+0000","last_undegraded":"2023-07-29T02:06:07.912007+0000","last_fullsized":"2023-07-29T02:06:07.912007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54131381700000003,"stat_sum":{"num_bytes":21401745,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":45,"num_read_kb":12330,"num_write":635,"num_write_kb":33528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"39'136","reported_seq":168,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:44.477484+0000","last_change":"2023-07-29T01:59:57.545933+0000","last_active":"2023-07-29T02:05:44.477484+0000","last_peered":"2023-07-29T02:05:44.477484+0000","last_clean":"2023-07-29T02:05:44.477484+0000","last_became_active":"2023-07-29T01:59:57.545744+0000","last_became_peered":"2023-07-29T01:59:57.545744+0000","last_unstale":"2023-07-29T02:05:44.477484+0000","last_undegraded":"2023-07-29T02:05:44.477484+0000","last_fullsized":"2023-07-29T02:05:44.477484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":139,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"39'83","reported_seq":2133,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:38.656358+0000","last_change":"2023-07-29T02:03:56.956561+0000","last_active":"2023-07-29T02:05:38.656358+0000","last_peered":"2023-07-29T02:05:38.656358+0000","last_clean":"2023-07-29T02:05:38.656358+0000","last_became_active":"2023-07-29T01:59:57.970252+0000","last_became_peered":"2023-07-29T01:59:57.970252+0000","last_unstale":"2023-07-29T02:05:38.656358+0000","last_undegraded":"2023-07-29T02:05:38.656358+0000","last_fullsized":"2023-07-29T02:05:38.656358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:09.798579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46822948199999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"39'637","reported_seq":2723,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.452647+0000","last_change":"2023-07-29T02:03:56.694563+0000","last_active":"2023-07-29T02:06:07.452647+0000","last_peered":"2023-07-29T02:06:07.452647+0000","last_clean":"2023-07-29T02:06:07.452647+0000","last_became_active":"2023-07-29T02:00:01.989481+0000","last_became_peered":"2023-07-29T02:00:01.989481+0000","last_unstale":"2023-07-29T02:06:07.452647+0000","last_undegraded":"2023-07-29T02:06:07.452647+0000","last_fullsized":"2023-07-29T02:06:07.452647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.187630984,"stat_sum":{"num_bytes":25047033,"num_objects":309,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":38,"num_read_kb":8227,"num_write":637,"num_write_kb":24796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"39'112","reported_seq":149,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.553859+0000","last_change":"2023-07-29T01:59:57.543782+0000","last_active":"2023-07-29T02:05:51.553859+0000","last_peered":"2023-07-29T02:05:51.553859+0000","last_clean":"2023-07-29T02:05:51.553859+0000","last_became_active":"2023-07-29T01:59:57.543445+0000","last_became_peered":"2023-07-29T01:59:57.543445+0000","last_unstale":"2023-07-29T02:05:51.553859+0000","last_undegraded":"2023-07-29T02:05:51.553859+0000","last_fullsized":"2023-07-29T02:05:51.553859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":114,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"39'82","reported_seq":2132,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:45.626039+0000","last_change":"2023-07-29T02:03:57.113153+0000","last_active":"2023-07-29T02:04:45.626039+0000","last_peered":"2023-07-29T02:04:45.626039+0000","last_clean":"2023-07-29T02:04:45.626039+0000","last_became_active":"2023-07-29T01:59:57.964925+0000","last_became_peered":"2023-07-29T01:59:57.964925+0000","last_unstale":"2023-07-29T02:04:45.626039+0000","last_undegraded":"2023-07-29T02:04:45.626039+0000","last_fullsized":"2023-07-29T02:04:45.626039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:28:03.905606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35003659399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'665","reported_seq":2749,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:08.030901+0000","last_change":"2023-07-29T02:03:56.799552+0000","last_active":"2023-07-29T02:06:08.030901+0000","last_peered":"2023-07-29T02:06:08.030901+0000","last_clean":"2023-07-29T02:06:08.030901+0000","last_became_active":"2023-07-29T02:00:01.985310+0000","last_became_peered":"2023-07-29T02:00:01.985310+0000","last_unstale":"2023-07-29T02:06:08.030901+0000","last_undegraded":"2023-07-29T02:06:08.030901+0000","last_fullsized":"2023-07-29T02:06:08.030901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.31035642899999999,"stat_sum":{"num_bytes":19557603,"num_objects":304,"num_object_clones":0,"num_object_copies":1216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":304,"num_whiteouts":0,"num_read":36,"num_read_kb":35,"num_write":665,"num_write_kb":19402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"39'86","reported_seq":125,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:11.297549+0000","last_change":"2023-07-29T01:59:57.541908+0000","last_active":"2023-07-29T02:06:11.297549+0000","last_peered":"2023-07-29T02:06:11.297549+0000","last_clean":"2023-07-29T02:06:11.297549+0000","last_became_active":"2023-07-29T01:59:57.541633+0000","last_became_peered":"2023-07-29T01:59:57.541633+0000","last_unstale":"2023-07-29T02:06:11.297549+0000","last_undegraded":"2023-07-29T02:06:11.297549+0000","last_fullsized":"2023-07-29T02:06:11.297549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":18,"num_read_kb":12303,"num_write":84,"num_write_kb":16462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"35'78","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.979692+0000","last_change":"2023-07-29T02:03:57.113037+0000","last_active":"2023-07-29T02:04:21.979692+0000","last_peered":"2023-07-29T02:04:21.979692+0000","last_clean":"2023-07-29T02:04:21.979692+0000","last_became_active":"2023-07-29T01:59:57.965383+0000","last_became_peered":"2023-07-29T01:59:57.965383+0000","last_unstale":"2023-07-29T02:04:21.979692+0000","last_undegraded":"2023-07-29T02:04:21.979692+0000","last_fullsized":"2023-07-29T02:04:21.979692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.352110162,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"39'676","reported_seq":2763,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:08.039437+0000","last_change":"2023-07-29T02:03:57.114115+0000","last_active":"2023-07-29T02:06:08.039437+0000","last_peered":"2023-07-29T02:06:08.039437+0000","last_clean":"2023-07-29T02:06:08.039437+0000","last_became_active":"2023-07-29T02:00:01.993454+0000","last_became_peered":"2023-07-29T02:00:01.993454+0000","last_unstale":"2023-07-29T02:06:08.039437+0000","last_undegraded":"2023-07-29T02:06:08.039437+0000","last_fullsized":"2023-07-29T02:06:08.039437+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:46.998657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.33100711700000002,"stat_sum":{"num_bytes":33339861,"num_objects":341,"num_object_clones":0,"num_object_copies":1364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":0,"num_read":39,"num_read_kb":19097,"num_write":677,"num_write_kb":41065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"39'102","reported_seq":135,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.348314+0000","last_change":"2023-07-29T01:59:57.539625+0000","last_active":"2023-07-29T02:06:07.348314+0000","last_peered":"2023-07-29T02:06:07.348314+0000","last_clean":"2023-07-29T02:06:07.348314+0000","last_became_active":"2023-07-29T01:59:57.539181+0000","last_became_peered":"2023-07-29T01:59:57.539181+0000","last_unstale":"2023-07-29T02:06:07.348314+0000","last_undegraded":"2023-07-29T02:06:07.348314+0000","last_fullsized":"2023-07-29T02:06:07.348314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:02:57.137574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":98,"num_write_kb":8257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'81","reported_seq":2131,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.442789+0000","last_change":"2023-07-29T02:03:57.171546+0000","last_active":"2023-07-29T02:04:19.442789+0000","last_peered":"2023-07-29T02:04:19.442789+0000","last_clean":"2023-07-29T02:04:19.442789+0000","last_became_active":"2023-07-29T01:59:57.966580+0000","last_became_peered":"2023-07-29T01:59:57.966580+0000","last_unstale":"2023-07-29T02:04:19.442789+0000","last_undegraded":"2023-07-29T02:04:19.442789+0000","last_fullsized":"2023-07-29T02:04:19.442789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:26.203628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38010548900000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"39'649","reported_seq":2735,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.663320+0000","last_change":"2023-07-29T02:03:57.046097+0000","last_active":"2023-07-29T02:06:07.663320+0000","last_peered":"2023-07-29T02:06:07.663320+0000","last_clean":"2023-07-29T02:06:07.663320+0000","last_became_active":"2023-07-29T02:00:01.985554+0000","last_became_peered":"2023-07-29T02:00:01.985554+0000","last_unstale":"2023-07-29T02:06:07.663320+0000","last_undegraded":"2023-07-29T02:06:07.663320+0000","last_fullsized":"2023-07-29T02:06:07.663320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:50:50.164635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53877218400000004,"stat_sum":{"num_bytes":39819276,"num_objects":290,"num_object_clones":0,"num_object_copies":1160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":290,"num_whiteouts":0,"num_read":38,"num_read_kb":16418,"num_write":646,"num_write_kb":43313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"39'135","reported_seq":174,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:55.844482+0000","last_change":"2023-07-29T01:59:57.537754+0000","last_active":"2023-07-29T02:05:55.844482+0000","last_peered":"2023-07-29T02:05:55.844482+0000","last_clean":"2023-07-29T02:05:55.844482+0000","last_became_active":"2023-07-29T01:59:57.537457+0000","last_became_peered":"2023-07-29T01:59:57.537457+0000","last_unstale":"2023-07-29T02:05:55.844482+0000","last_undegraded":"2023-07-29T02:05:55.844482+0000","last_fullsized":"2023-07-29T02:05:55.844482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":132,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"35'101","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.978778+0000","last_change":"2023-07-29T02:03:57.113779+0000","last_active":"2023-07-29T02:04:21.978778+0000","last_peered":"2023-07-29T02:04:21.978778+0000","last_clean":"2023-07-29T02:04:21.978778+0000","last_became_active":"2023-07-29T01:59:57.960318+0000","last_became_peered":"2023-07-29T01:59:57.960318+0000","last_unstale":"2023-07-29T02:04:21.978778+0000","last_undegraded":"2023-07-29T02:04:21.978778+0000","last_fullsized":"2023-07-29T02:04:21.978778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:01:11.408184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.32984874600000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"39'98","reported_seq":2149,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:45.626430+0000","last_change":"2023-07-29T02:03:56.970824+0000","last_active":"2023-07-29T02:04:45.626430+0000","last_peered":"2023-07-29T02:04:45.626430+0000","last_clean":"2023-07-29T02:04:45.626430+0000","last_became_active":"2023-07-29T01:59:57.959960+0000","last_became_peered":"2023-07-29T01:59:57.959960+0000","last_unstale":"2023-07-29T02:04:45.626430+0000","last_undegraded":"2023-07-29T02:04:45.626430+0000","last_fullsized":"2023-07-29T02:04:45.626430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22491762700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"35'98","reported_seq":2149,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.443452+0000","last_change":"2023-07-29T02:03:57.173410+0000","last_active":"2023-07-29T02:04:19.443452+0000","last_peered":"2023-07-29T02:04:19.443452+0000","last_clean":"2023-07-29T02:04:19.443452+0000","last_became_active":"2023-07-29T01:59:57.975384+0000","last_became_peered":"2023-07-29T01:59:57.975384+0000","last_unstale":"2023-07-29T02:04:19.443452+0000","last_undegraded":"2023-07-29T02:04:19.443452+0000","last_fullsized":"2023-07-29T02:04:19.443452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:50.959382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38175464599999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"35'93","reported_seq":2144,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.978776+0000","last_change":"2023-07-29T02:03:57.112576+0000","last_active":"2023-07-29T02:04:21.978776+0000","last_peered":"2023-07-29T02:04:21.978776+0000","last_clean":"2023-07-29T02:04:21.978776+0000","last_became_active":"2023-07-29T01:59:57.967603+0000","last_became_peered":"2023-07-29T01:59:57.967603+0000","last_unstale":"2023-07-29T02:04:21.978776+0000","last_undegraded":"2023-07-29T02:04:21.978776+0000","last_fullsized":"2023-07-29T02:04:21.978776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:24:00.439433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.350807488,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"35'92","reported_seq":2143,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.442970+0000","last_change":"2023-07-29T02:03:57.150968+0000","last_active":"2023-07-29T02:04:19.442970+0000","last_peered":"2023-07-29T02:04:19.442970+0000","last_clean":"2023-07-29T02:04:19.442970+0000","last_became_active":"2023-07-29T01:59:57.966672+0000","last_became_peered":"2023-07-29T01:59:57.966672+0000","last_unstale":"2023-07-29T02:04:19.442970+0000","last_undegraded":"2023-07-29T02:04:19.442970+0000","last_fullsized":"2023-07-29T02:04:19.442970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:21:50.138672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.39433596799999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"35'75","reported_seq":2125,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.433509+0000","last_change":"2023-07-29T02:03:57.048829+0000","last_active":"2023-07-29T02:04:19.433509+0000","last_peered":"2023-07-29T02:04:19.433509+0000","last_clean":"2023-07-29T02:04:19.433509+0000","last_became_active":"2023-07-29T01:59:57.968449+0000","last_became_peered":"2023-07-29T01:59:57.968449+0000","last_unstale":"2023-07-29T02:04:19.433509+0000","last_undegraded":"2023-07-29T02:04:19.433509+0000","last_fullsized":"2023-07-29T02:04:19.433509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54020755499999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":918109667,"num_objects":10158,"num_object_clones":0,"num_object_copies":40632,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10158,"num_whiteouts":0,"num_read":1251,"num_read_kb":366219,"num_write":20739,"num_write_kb":1040888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1801621504,"data_stored":1952874496,"data_compressed":122947712,"data_compressed_allocated":138481664,"data_compressed_original":289734656,"omap_allocated":0,"internal_metadata":0},"log_size":20767,"ondisk_log_size":20767,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5272,"ondisk_log_size":5272,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":214487020,"num_objects":137,"num_object_clones":0,"num_object_copies":274,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":137,"num_whiteouts":0,"num_read":307,"num_read_kb":151137,"num_write":3106,"num_write_kb":213424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":85409792,"data_stored":428974040,"data_compressed":54140070,"data_compressed_allocated":68378624,"data_compressed_original":412000256,"omap_allocated":0,"internal_metadata":0},"log_size":3071,"ondisk_log_size":3071,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":287904,"kb_used_data":220760,"kb_used_omap":0,"kb_used_meta":67136,"kb_avail":94083936,"statfs":{"total":96636764160,"available":96341950464,"internally_reserved":0,"allocated":226058240,"data_stored":291929737,"data_compressed":24027719,"data_compressed_allocated":28098560,"data_compressed_original":94220288,"omap_allocated":0,"internal_metadata":68747264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.56000000000000005,"15min":0.51300000000000001},"min":{"1min":0.26400000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.751,"5min":6.0650000000000004,"15min":6.0650000000000004},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.54900000000000004,"15min":0.51700000000000002},"min":{"1min":0.30199999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61599999999999999,"5min":3.988,"15min":3.988},"last":0.28999999999999998}]},{"osd":1,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.66400000000000003,"15min":0.56200000000000006},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.70099999999999996,"5min":10.303000000000001,"15min":10.303000000000001},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.79800000000000004,"15min":0.625},"min":{"1min":0.32900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.80100000000000005,"5min":19.527999999999999,"15min":19.527999999999999},"last":0.27500000000000002}]},{"osd":2,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.63400000000000001,"15min":0.59299999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70499999999999996,"5min":6.9720000000000004,"15min":6.9720000000000004},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.58399999999999996,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63400000000000001,"5min":3.8260000000000001,"15min":3.8260000000000001},"last":0.40200000000000002}]},{"osd":3,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72999999999999998,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.57799999999999996,"15min":0.60599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.77700000000000002,"5min":1.22,"15min":1.22},"last":0.39100000000000001}]},{"osd":4,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47899999999999998,"15min":0.52700000000000002},"min":{"1min":0.32200000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66100000000000003,"5min":1.454,"15min":1.454},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.51100000000000001,"15min":0.55900000000000005},"min":{"1min":0.30599999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.0249999999999999,"5min":1.244,"15min":1.244},"last":0.31900000000000001}]},{"osd":5,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.50900000000000001,"15min":0.55900000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70799999999999996,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.53400000000000003,"15min":0.57099999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75800000000000001,"5min":3.621,"15min":3.621},"last":0.41399999999999998}]},{"osd":6,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55600000000000005,"15min":0.60299999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.74399999999999999,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.372},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.58099999999999996,"15min":0.627},"min":{"1min":0.37,"5min":0.312,"15min":0.312},"max":{"1min":0.79600000000000004,"5min":3.488,"15min":3.488},"last":0.45800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302724,"kb_used_data":239676,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":94069116,"statfs":{"total":96636764160,"available":96326774784,"internally_reserved":0,"allocated":245428224,"data_stored":280369393,"data_compressed":17301447,"data_compressed_allocated":19628032,"data_compressed_original":54792192,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.57699999999999996,"15min":0.54000000000000004},"min":{"1min":0.33200000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.65300000000000002,"5min":7,"15min":7},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.627,"15min":0.56100000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.59399999999999997,"5min":6.4619999999999997,"15min":6.4619999999999997},"last":0.64900000000000002}]},{"osd":1,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.64700000000000002,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70199999999999996,"5min":12.462,"15min":12.462},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.626,"15min":0.58899999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.63900000000000001,"5min":6.4130000000000003,"15min":6.4130000000000003},"last":0.61099999999999999}]},{"osd":2,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.629,"5min":1.367,"15min":1.367},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.60299999999999998,"15min":0.57499999999999996},"min":{"1min":0.39800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.65600000000000003,"5min":5.5330000000000004,"15min":5.5330000000000004},"last":0.52400000000000002}]},{"osd":3,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.65700000000000003,"15min":0.59899999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70799999999999996,"5min":6.4889999999999999,"15min":6.4889999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.64500000000000002,"15min":0.61499999999999999},"min":{"1min":0.40400000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.69599999999999995,"5min":6.8559999999999999,"15min":6.8559999999999999},"last":0.46400000000000002}]},{"osd":4,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.68600000000000005,"15min":0.58799999999999997},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68000000000000005,"5min":24.123999999999999,"15min":24.123999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.32700000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.70999999999999996,"5min":6.3710000000000004,"15min":6.3710000000000004},"last":0.41799999999999998}]},{"osd":5,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48499999999999999,"15min":0.53900000000000003},"min":{"1min":0.33900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68899999999999995,"5min":0.82999999999999996,"15min":1.1140000000000001},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59499999999999997,"15min":0.58299999999999996},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73199999999999998,"5min":6.9669999999999996,"15min":6.9669999999999996},"last":0.33600000000000002}]},{"osd":7,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.34999999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73299999999999998,"5min":5.484,"15min":5.484},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59599999999999997,"15min":0.61699999999999999},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.71299999999999997,"5min":5.2300000000000004,"15min":5.2300000000000004},"last":0.39700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371428,"kb_used_data":268188,"kb_used_omap":0,"kb_used_meta":103232,"kb_avail":94000412,"statfs":{"total":96636764160,"available":96256421888,"internally_reserved":0,"allocated":274624512,"data_stored":329542417,"data_compressed":22309908,"data_compressed_allocated":25948160,"data_compressed_original":81092608,"omap_allocated":0,"internal_metadata":105709568},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.39000000000000001,"15min":0.51400000000000001},"min":{"1min":0.25,"5min":0.20799999999999999,"15min":0.20399999999999999},"max":{"1min":0.441,"5min":3.7989999999999999,"15min":7.1299999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.38600000000000001,"15min":0.51000000000000001},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57099999999999995,"5min":0.94599999999999995,"15min":5.4779999999999998},"last":0.38700000000000001}]},{"osd":2,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.61299999999999999,"15min":0.88900000000000001},"min":{"1min":0.23300000000000001,"5min":0.214,"15min":0.20899999999999999},"max":{"1min":0.47799999999999998,"5min":22.483000000000001,"15min":22.483000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.44,"15min":0.67800000000000005},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56599999999999995,"5min":3.0619999999999998,"15min":11.028},"last":0.434}]},{"osd":3,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46899999999999997,"15min":0.59999999999999998},"min":{"1min":0.33300000000000002,"5min":0.27000000000000002,"15min":0.26800000000000002},"max":{"1min":0.54200000000000004,"5min":2.9900000000000002,"15min":7.1699999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.41999999999999998,"15min":0.39600000000000002},"min":{"1min":0.28399999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.51500000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.63}]},{"osd":4,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.70199999999999996,"15min":1.048},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78500000000000003,"5min":5.7809999999999997,"15min":17.925000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.625,"15min":0.86699999999999999},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79800000000000004,"5min":3.0329999999999999,"15min":10.961},"last":0.59599999999999997}]},{"osd":5,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.60599999999999998,"15min":0.71099999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79700000000000004,"5min":0.878,"15min":5.391},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.70699999999999996,"15min":1.0880000000000001},"min":{"1min":0.45100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86399999999999999,"5min":5.8849999999999998,"15min":17.994},"last":0.50900000000000001}]},{"osd":6,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.629,"15min":0.73999999999999999},"min":{"1min":0.40100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80800000000000005,"5min":0.91300000000000003,"15min":5.452},"last":0.755},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.72499999999999998,"15min":1.077},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82999999999999996,"5min":5.8540000000000001,"15min":17.963999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.67400000000000004,"15min":0.89000000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.755,"5min":3.0880000000000001,"15min":10.994},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67300000000000004,"15min":0.76300000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83499999999999996,"5min":2.9889999999999999,"15min":5.4249999999999998},"last":0.72799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":327772,"kb_used_data":238484,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94044068,"statfs":{"total":96636764160,"available":96301125632,"internally_reserved":0,"allocated":244207616,"data_stored":304944485,"data_compressed":22705554,"data_compressed_allocated":26374144,"data_compressed_original":87339008,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.77600000000000002,"15min":0.47799999999999998},"min":{"1min":0.20999999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.55500000000000005,"5min":39.070999999999998,"15min":39.070999999999998},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.435,"15min":0.38900000000000001},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.439,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":0.39900000000000002}]},{"osd":2,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.54600000000000004,"15min":0.45200000000000001},"min":{"1min":0.311,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.58899999999999997,"5min":10.438000000000001,"15min":10.438000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.55900000000000005,"15min":0.45700000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51700000000000002,"5min":10.802,"15min":10.802},"last":0.45900000000000002}]},{"osd":3,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.46500000000000002,"15min":0.39900000000000002},"min":{"1min":0.251,"5min":0.246,"15min":0.246},"max":{"1min":0.48699999999999999,"5min":4.6879999999999997,"15min":4.6879999999999997},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.50900000000000001,"15min":0.45300000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63600000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.48499999999999999}]},{"osd":4,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74099999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.67300000000000004,"15min":0.629},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.84599999999999997,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.52800000000000002}]},{"osd":5,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.374,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76900000000000002,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.63,"15min":0.624},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84999999999999998,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.57599999999999996}]},{"osd":6,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.68000000000000005,"15min":0.64700000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92200000000000004,"5min":1.663,"15min":1.663},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.40500000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.74099999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.67500000000000004,"15min":0.65000000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":1.496,"15min":1.496},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.67800000000000005,"15min":0.66100000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.61899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263968,"kb_used_data":200920,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":94107872,"statfs":{"total":96636764160,"available":96366460928,"internally_reserved":0,"allocated":205742080,"data_stored":235444465,"data_compressed":13107136,"data_compressed_allocated":15015936,"data_compressed_original":44941312,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.46300000000000002,"15min":0.39600000000000002},"min":{"1min":0.22800000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.53600000000000003,"5min":10.795999999999999,"15min":10.795999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.53700000000000003,"15min":0.66100000000000003},"min":{"1min":0.253,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.496,"5min":16.536999999999999,"15min":16.536999999999999},"last":0.30199999999999999}]},{"osd":1,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44900000000000001,"15min":0.55700000000000005},"min":{"1min":0.28499999999999998,"5min":0.223,"15min":0.223},"max":{"1min":0.68400000000000005,"5min":5.2160000000000002,"15min":6.1040000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.47599999999999998,"15min":0.435},"min":{"1min":0.311,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.53900000000000003,"5min":7.4880000000000004,"15min":7.4880000000000004},"last":0.39300000000000002}]},{"osd":3,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42699999999999999,"15min":0.40500000000000003},"min":{"1min":0.28599999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53800000000000003,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.504,"15min":0.61399999999999999},"min":{"1min":0.31,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.60399999999999998,"5min":5.4240000000000004,"15min":6.0620000000000003},"last":0.55400000000000005}]},{"osd":4,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.63700000000000001,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71299999999999997,"5min":5.2919999999999998,"15min":5.2919999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.67100000000000004,"15min":0.65900000000000003},"min":{"1min":0.42199999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77200000000000002,"5min":6.3300000000000001,"15min":6.3300000000000001},"last":0.48099999999999998}]},{"osd":5,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67700000000000005,"15min":0.65800000000000003},"min":{"1min":0.39200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.77300000000000002,"5min":6.149,"15min":6.149},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.89300000000000002,"15min":0.92800000000000005},"min":{"1min":0.38100000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77900000000000003,"5min":28.702000000000002,"15min":28.702000000000002},"last":0.49299999999999999}]},{"osd":6,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65100000000000002,"15min":0.85799999999999998},"min":{"1min":0.40300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.76400000000000001,"5min":4.5179999999999998,"15min":9.1199999999999992},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67800000000000005,"15min":0.65800000000000003},"min":{"1min":0.442,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86899999999999999,"5min":5.2530000000000001,"15min":5.2530000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.69399999999999995,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80100000000000005,"5min":6.2930000000000001,"15min":6.2930000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.67900000000000005,"15min":0.88500000000000001},"min":{"1min":0.433,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79400000000000004,"5min":4.4809999999999999,"15min":9.1620000000000008},"last":0.63600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574928,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":284232,"kb_used_data":199040,"kb_used_omap":0,"kb_used_meta":85184,"kb_avail":94087608,"statfs":{"total":96636764160,"available":96345710592,"internally_reserved":0,"allocated":203816960,"data_stored":281896330,"data_compressed":24201301,"data_compressed_allocated":28655616,"data_compressed_original":106958848,"omap_allocated":0,"internal_metadata":87228416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.36599999999999999,"15min":0.34100000000000003},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.57099999999999995,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35699999999999998,"15min":0.36599999999999999},"min":{"1min":0.24299999999999999,"5min":0.23200000000000001,"15min":0.22900000000000001},"max":{"1min":0.54100000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.38500000000000001}]},{"osd":1,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.44700000000000001,"15min":0.38600000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54000000000000004,"5min":9.7289999999999992,"15min":9.7289999999999992},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.47599999999999998,"15min":0.41399999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.21299999999999999},"max":{"1min":0.58199999999999996,"5min":7.4989999999999997,"15min":7.4989999999999997},"last":0.56599999999999995}]},{"osd":2,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40899999999999997,"15min":0.40699999999999997},"min":{"1min":0.28399999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.59999999999999998,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.45000000000000001,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68600000000000005,"5min":1.603,"15min":1.603},"last":0.48199999999999998}]},{"osd":4,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.34399999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81699999999999995,"5min":0.95899999999999996,"15min":0.96599999999999997},"last":0.505},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.68500000000000005,"15min":0.64000000000000001},"min":{"1min":0.375,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.74399999999999999,"5min":8.6869999999999994,"15min":8.6869999999999994},"last":0.498}]},{"osd":5,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67900000000000005,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.63400000000000001,"15min":0.60799999999999998},"min":{"1min":0.38,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88100000000000001,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.54000000000000004}]},{"osd":6,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67800000000000005,"15min":0.64700000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81200000000000006,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.65100000000000002,"15min":0.65600000000000003},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.61299999999999999}]},{"osd":7,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.70799999999999996,"15min":0.64400000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84899999999999998,"5min":8.7289999999999992,"15min":8.7289999999999992},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86499999999999999,"5min":1.0309999999999999,"15min":1.119},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":355056,"kb_used_data":251816,"kb_used_omap":0,"kb_used_meta":103232,"kb_avail":94016784,"statfs":{"total":96636764160,"available":96273186816,"internally_reserved":0,"allocated":257859584,"data_stored":353359351,"data_compressed":29870574,"data_compressed_allocated":35307520,"data_compressed_original":131047424,"omap_allocated":0,"internal_metadata":105709568},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.61099999999999999,"15min":0.54000000000000004},"min":{"1min":0.31900000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.68200000000000005,"5min":4.4800000000000004,"15min":4.4800000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.57299999999999995,"15min":0.84499999999999997},"min":{"1min":0.28399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.69499999999999995,"5min":7.2679999999999998,"15min":12.231999999999999},"last":0.66000000000000003}]},{"osd":1,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.55700000000000005,"15min":0.51500000000000001},"min":{"1min":0.29399999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.65100000000000002,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.54700000000000004,"15min":0.53100000000000003},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66700000000000004,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.58699999999999997}]},{"osd":2,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.34200000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68400000000000005,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65900000000000003,"5min":0.874,"15min":0.874},"last":0.63400000000000001}]},{"osd":3,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63200000000000001,"5min":3.9969999999999999,"15min":3.9969999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.96199999999999997,"15min":0.69199999999999995},"min":{"1min":0.40899999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67100000000000004,"5min":28.837,"15min":28.837},"last":0.52600000000000002}]},{"osd":5,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.48099999999999998,"15min":0.496},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.69499999999999995,"5min":1.8,"15min":1.8},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48699999999999999,"15min":0.501},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60199999999999998,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.36099999999999999}]},{"osd":6,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51800000000000002,"15min":0.50800000000000001},"min":{"1min":0.314,"5min":0.311,"15min":0.311},"max":{"1min":0.623,"5min":1.006,"15min":1.006},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54100000000000004,"15min":0.54900000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71999999999999997,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.40300000000000002}]},{"osd":7,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64300000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57599999999999996},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67500000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.45600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574929,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":293648,"kb_used_data":226504,"kb_used_omap":0,"kb_used_meta":67136,"kb_avail":94078192,"statfs":{"total":96636764160,"available":96336068608,"internally_reserved":0,"allocated":231940096,"data_stored":303070077,"data_compressed":22818421,"data_compressed_allocated":26935296,"data_compressed_original":98295808,"omap_allocated":0,"internal_metadata":68747264},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54400000000000004,"15min":0.51400000000000001},"min":{"1min":0.23000000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.626,"15min":0.54200000000000004},"min":{"1min":0.29699999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":8.2590000000000003,"5min":8.2590000000000003,"15min":8.2590000000000003},"last":0.46600000000000003}]},{"osd":1,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.58099999999999996,"15min":0.51100000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.9179999999999999,"5min":5.9119999999999999,"15min":5.9119999999999999},"last":0.497},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.58199999999999996,"15min":0.54800000000000004},"min":{"1min":0.32200000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":3.996,"5min":3.996,"15min":3.996},"last":0.441}]},{"osd":2,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.51500000000000001},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":2.8929999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.70199999999999996,"15min":0.59999999999999998},"min":{"1min":0.33100000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":9.8360000000000003,"5min":9.8360000000000003,"15min":9.8360000000000003},"last":0.41299999999999998}]},{"osd":3,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.57899999999999996,"15min":0.55500000000000005},"min":{"1min":0.32100000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.83699999999999997,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.70099999999999996,"15min":0.60399999999999998},"min":{"1min":0.34300000000000003,"5min":0.314,"15min":0.314},"max":{"1min":8.1940000000000008,"5min":8.1940000000000008,"15min":8.1940000000000008},"last":0.42699999999999999}]},{"osd":4,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.49299999999999999,"15min":0.51300000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.498,"15min":0.53200000000000003},"min":{"1min":0.318,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.73299999999999998,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.48299999999999998}]},{"osd":6,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.51700000000000002,"15min":0.54100000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.55600000000000005},"min":{"1min":0.35499999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.45200000000000001}]},{"osd":7,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56899999999999995,"15min":0.58999999999999997},"min":{"1min":0.40699999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":0.50900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11333632,"data_stored":50908276,"data_compressed":6612732,"data_compressed_allocated":8208384,"data_compressed_original":47788032,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7892992,"data_stored":41943040,"data_compressed":5179048,"data_compressed_allocated":6578176,"data_compressed_original":40628224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":20971520,"data_compressed":2599703,"data_compressed_allocated":3166208,"data_compressed_original":19935232,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15769600,"data_stored":75497562,"data_compressed":9642572,"data_compressed_allocated":12136448,"data_compressed_original":71868416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16830464,"data_stored":88657158,"data_compressed":10773719,"data_compressed_allocated":13713408,"data_compressed_original":85557248,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12902400,"data_stored":67109516,"data_compressed":8592718,"data_compressed_allocated":10850304,"data_compressed_original":65064960,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5103616,"data_stored":25165824,"data_compressed":3204864,"data_compressed_allocated":4030464,"data_compressed_original":24092672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11374592,"data_stored":58721144,"data_compressed":7534714,"data_compressed_allocated":9695232,"data_compressed_original":57065472,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":232435712,"data_stored":253820928,"data_compressed":16092822,"data_compressed_allocated":18165760,"data_compressed_original":39550976,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":266227712,"data_stored":286793728,"data_compressed":17098430,"data_compressed_allocated":19324928,"data_compressed_original":39890944,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":201101312,"data_stored":214257664,"data_compressed":10507433,"data_compressed_allocated":11849728,"data_compressed_original":25006080,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":187613184,"data_stored":206184448,"data_compressed":14558729,"data_compressed_allocated":16519168,"data_compressed_original":35090432,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":240590848,"data_stored":264486912,"data_compressed":19096855,"data_compressed_allocated":21594112,"data_compressed_original":45490176,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":219586560,"data_stored":239939584,"data_compressed":15036285,"data_compressed_allocated":17072128,"data_compressed_original":37425152,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":239886336,"data_stored":254988288,"data_compressed":14096583,"data_compressed_allocated":15597568,"data_compressed_original":30699520,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":214179840,"data_stored":232402944,"data_compressed":16460575,"data_compressed_allocated":18358272,"data_compressed_original":36581376,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T02:06:20.237 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T02:06:20.393 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.411+0000 7f6af73e6700 1 Processor -- start 2023-07-29T02:06:20.393 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.412+0000 7f6af73e6700 1 -- start start 2023-07-29T02:06:20.395 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.412+0000 7f6af73e6700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6af0151500 0x7f6af006dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:20.395 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.412+0000 7f6af73e6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6af0157ba0 0x7f6af006e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:20.395 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.412+0000 7f6af73e6700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af00cd140 con 0x7f6af00c7f40 2023-07-29T02:06:20.396 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.412+0000 7f6af73e6700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af00c2370 con 0x7f6af0151500 2023-07-29T02:06:20.396 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.412+0000 7f6af73e6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af0156f90 con 0x7f6af0157ba0 2023-07-29T02:06:20.396 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.413+0000 7f6af5182700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6af0151500 0x7f6af006dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:20.396 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.413+0000 7f6af4981700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f6af00c7f40 0x7f6af0157490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52088/0 (socket says 172.21.15.42:52088) 2023-07-29T02:06:20.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.413+0000 7f6af5182700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f6af0151500 0x7f6af006dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58284/0 (socket says 172.21.15.42:58284) 2023-07-29T02:06:20.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.413+0000 7f6af4981700 1 -- 172.21.15.42:0/113518112 learned_addr learned my addr 172.21.15.42:0/113518112 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:06:20.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.413+0000 7f6af5983700 1 --2- 172.21.15.42:0/113518112 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6af0157ba0 0x7f6af006e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:20.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.413+0000 7f6af5182700 1 -- 172.21.15.42:0/113518112 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6af0157ba0 msgr2=0x7f6af006e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:20.397 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.413+0000 7f6af5182700 1 --2- 172.21.15.42:0/113518112 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6af0157ba0 0x7f6af006e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:20.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.413+0000 7f6af5182700 1 -- 172.21.15.42:0/113518112 >> v1:172.21.15.42:6789/0 conn(0x7f6af00c7f40 legacy=0x7f6af0157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:20.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.413+0000 7f6af5182700 1 -- 172.21.15.42:0/113518112 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af00cd390 con 0x7f6af0151500 2023-07-29T02:06:20.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.413+0000 7f6ae7fff700 1 -- 172.21.15.42:0/113518112 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232113828 0 0) 0x7f6af00cd140 con 0x7f6af00c7f40 2023-07-29T02:06:20.398 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.413+0000 7f6af5182700 1 --2- 172.21.15.42:0/113518112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6af0151500 0x7f6af006dc60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6aec009840 tx=0x7f6aec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0de5d4a4a1d18b server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:20.399 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.413+0000 7f6ae7fff700 1 -- 172.21.15.42:0/113518112 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec011830 con 0x7f6af0151500 2023-07-29T02:06:20.399 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.413+0000 7f6ae7fff700 1 -- 172.21.15.42:0/113518112 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aec011990 con 0x7f6af0151500 2023-07-29T02:06:20.399 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.413+0000 7f6ae7fff700 1 -- 172.21.15.42:0/113518112 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec011d20 con 0x7f6af0151500 2023-07-29T02:06:20.399 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.414+0000 7f6af73e6700 1 -- 172.21.15.42:0/113518112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6af0151500 msgr2=0x7f6af006dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:20.399 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.414+0000 7f6af73e6700 1 --2- 172.21.15.42:0/113518112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6af0151500 0x7f6af006dc60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6aec009840 tx=0x7f6aec009b50 comp rx=0 tx=0).stop 2023-07-29T02:06:20.400 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.414+0000 7f6af73e6700 1 -- 172.21.15.42:0/113518112 shutdown_connections 2023-07-29T02:06:20.400 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.414+0000 7f6af73e6700 1 --2- 172.21.15.42:0/113518112 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6af0157ba0 0x7f6af006e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:20.400 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.414+0000 7f6af73e6700 1 --2- 172.21.15.42:0/113518112 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6af0151500 0x7f6af006dc60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:20.401 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.414+0000 7f6af73e6700 1 -- 172.21.15.42:0/113518112 >> 172.21.15.42:0/113518112 conn(0x7f6af0061190 msgr2=0x7f6af0061590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:20.401 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.414+0000 7f6af73e6700 1 -- 172.21.15.42:0/113518112 shutdown_connections 2023-07-29T02:06:20.401 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.414+0000 7f6af73e6700 1 -- 172.21.15.42:0/113518112 wait complete. 2023-07-29T02:06:20.403 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.415+0000 7f6af73e6700 1 Processor -- start 2023-07-29T02:06:20.403 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.415+0000 7f6af73e6700 1 -- start start 2023-07-29T02:06:20.404 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.416+0000 7f6af73e6700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6af00c7f40 0x7f6af0156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:20.404 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.416+0000 7f6af73e6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6af0151500 0x7f6af006b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:20.404 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.416+0000 7f6af73e6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6af0157ba0 0x7f6af014ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:20.404 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.416+0000 7f6af73e6700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af01e2c20 con 0x7f6af00c7f40 2023-07-29T02:06:20.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.416+0000 7f6af73e6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af01ef9a0 con 0x7f6af0151500 2023-07-29T02:06:20.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.416+0000 7f6af73e6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af006d6d0 con 0x7f6af0157ba0 2023-07-29T02:06:20.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.416+0000 7f6af5182700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6af00c7f40 0x7f6af0156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:20.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.416+0000 7f6af5182700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6af00c7f40 0x7f6af0156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58290/0 (socket says 172.21.15.42:58290) 2023-07-29T02:06:20.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.416+0000 7f6af5182700 1 -- 172.21.15.42:0/2322549148 learned_addr learned my addr 172.21.15.42:0/2322549148 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:20.405 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.416+0000 7f6af4981700 1 --2- 172.21.15.42:0/2322549148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6af0151500 0x7f6af006b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:20.406 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.416+0000 7f6af5983700 1 --2- 172.21.15.42:0/2322549148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6af0157ba0 0x7f6af014ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:20.406 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.416+0000 7f6af5182700 1 -- 172.21.15.42:0/2322549148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6af0157ba0 msgr2=0x7f6af014ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:20.406 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.416+0000 7f6af5182700 1 --2- 172.21.15.42:0/2322549148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6af0157ba0 0x7f6af014ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:20.406 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.416+0000 7f6af5182700 1 -- 172.21.15.42:0/2322549148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6af0151500 msgr2=0x7f6af006b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:20.406 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.416+0000 7f6af5182700 1 --2- 172.21.15.42:0/2322549148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6af0151500 0x7f6af006b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:20.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.416+0000 7f6af5182700 1 -- 172.21.15.42:0/2322549148 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec0094a0 con 0x7f6af00c7f40 2023-07-29T02:06:20.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.416+0000 7f6af5182700 1 --2- 172.21.15.42:0/2322549148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6af00c7f40 0x7f6af0156460 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6aec000c00 tx=0x7f6aec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:20.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.417+0000 7f6ae5ffb700 1 -- 172.21.15.42:0/2322549148 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec0036a0 con 0x7f6af00c7f40 2023-07-29T02:06:20.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.417+0000 7f6ae5ffb700 1 -- 172.21.15.42:0/2322549148 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aec01f070 con 0x7f6af00c7f40 2023-07-29T02:06:20.407 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.417+0000 7f6ae5ffb700 1 -- 172.21.15.42:0/2322549148 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec003a20 con 0x7f6af00c7f40 2023-07-29T02:06:20.408 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.417+0000 7f6af73e6700 1 -- 172.21.15.42:0/2322549148 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af01e2e50 con 0x7f6af00c7f40 2023-07-29T02:06:20.408 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.417+0000 7f6af73e6700 1 -- 172.21.15.42:0/2322549148 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af01ef350 con 0x7f6af00c7f40 2023-07-29T02:06:20.408 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.418+0000 7f6af73e6700 1 -- 172.21.15.42:0/2322549148 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af004ea50 con 0x7f6af00c7f40 2023-07-29T02:06:20.409 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.418+0000 7f6ae5ffb700 1 -- 172.21.15.42:0/2322549148 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f6aec003b80 con 0x7f6af00c7f40 2023-07-29T02:06:20.409 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.419+0000 7f6ae5ffb700 1 --2- 172.21.15.42:0/2322549148 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6ad406a660 0x7f6ad406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:20.409 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.419+0000 7f6ae5ffb700 1 -- 172.21.15.42:0/2322549148 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f6aec021070 con 0x7f6af00c7f40 2023-07-29T02:06:20.409 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.419+0000 7f6af4981700 1 --2- 172.21.15.42:0/2322549148 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6ad406a660 0x7f6ad406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:20.409 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.419+0000 7f6af4981700 1 --2- 172.21.15.42:0/2322549148 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6ad406a660 0x7f6ad406cb10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6af006da40 tx=0x7f6ae0007e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:20.410 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.423+0000 7f6ae5ffb700 1 -- 172.21.15.42:0/2322549148 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f6aec055810 con 0x7f6af00c7f40 2023-07-29T02:06:20.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.622+0000 7f6af73e6700 1 -- 172.21.15.42:0/2322549148 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6af014b580 con 0x7f6af00c7f40 2023-07-29T02:06:20.604 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.623+0000 7f6ae5ffb700 1 -- 172.21.15.42:0/2322549148 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+20196 (secure 0 0 0) 0x7f6aec058e30 con 0x7f6af00c7f40 2023-07-29T02:06:20.605 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:06:20.606 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":39,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T02:04:19.439695+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T01:59:55.827461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T01:59:56.924040+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-29T01:59:59.996470+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2},{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6836/2695599859":"2023-07-30T02:04:19.439641+0000","172.21.15.42:6837/2695599859":"2023-07-30T02:04:19.439641+0000","172.21.15.144:6837/3824722756":"2023-07-30T02:02:24.415811+0000","172.21.15.42:6836/1851767861":"2023-07-30T02:01:34.406178+0000","172.21.15.144:6839/3824722756":"2023-07-30T02:02:24.415811+0000","172.21.15.42:6837/1851767861":"2023-07-30T02:01:34.406178+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T02:06:20.607 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.626+0000 7f6af73e6700 1 -- 172.21.15.42:0/2322549148 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6ad406a660 msgr2=0x7f6ad406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:20.607 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.626+0000 7f6af73e6700 1 --2- 172.21.15.42:0/2322549148 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6ad406a660 0x7f6ad406cb10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6af006da40 tx=0x7f6ae0007e70 comp rx=0 tx=0).stop 2023-07-29T02:06:20.607 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.626+0000 7f6af73e6700 1 -- 172.21.15.42:0/2322549148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6af00c7f40 msgr2=0x7f6af0156460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:20.608 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.626+0000 7f6af73e6700 1 --2- 172.21.15.42:0/2322549148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6af00c7f40 0x7f6af0156460 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6aec000c00 tx=0x7f6aec004750 comp rx=0 tx=0).stop 2023-07-29T02:06:20.608 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.626+0000 7f6af73e6700 1 -- 172.21.15.42:0/2322549148 shutdown_connections 2023-07-29T02:06:20.608 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.626+0000 7f6af73e6700 1 --2- 172.21.15.42:0/2322549148 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f6ad406a660 0x7f6ad406cb10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:20.608 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.626+0000 7f6af73e6700 1 --2- 172.21.15.42:0/2322549148 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f6af0157ba0 0x7f6af014ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:20.609 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.626+0000 7f6af73e6700 1 --2- 172.21.15.42:0/2322549148 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f6af00c7f40 0x7f6af0156460 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:20.609 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.626+0000 7f6af73e6700 1 --2- 172.21.15.42:0/2322549148 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6af0151500 0x7f6af006b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:20.609 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.626+0000 7f6af73e6700 1 -- 172.21.15.42:0/2322549148 >> 172.21.15.42:0/2322549148 conn(0x7f6af0061190 msgr2=0x7f6af01501a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:20.609 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.626+0000 7f6af73e6700 1 -- 172.21.15.42:0/2322549148 shutdown_connections 2023-07-29T02:06:20.610 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:20.626+0000 7f6af73e6700 1 -- 172.21.15.42:0/2322549148 wait complete. 2023-07-29T02:06:21.621 INFO:tasks.ceph:Scrubbing osd.0 2023-07-29T02:06:21.622 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-07-29T02:06:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.785+0000 7f718ea1d700 1 Processor -- start 2023-07-29T02:06:21.766 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.785+0000 7f718ea1d700 1 -- start start 2023-07-29T02:06:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.785+0000 7f718ea1d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f71880c1d50 0x7f71880c6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:21.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.785+0000 7f718ea1d700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71880c18c0 con 0x7f7188159810 2023-07-29T02:06:21.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.785+0000 7f718ea1d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71880c0fd0 con 0x7f7188159440 2023-07-29T02:06:21.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.785+0000 7f718ea1d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7188071e90 con 0x7f71880c1d50 2023-07-29T02:06:21.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.786+0000 7f718cfba700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f7188159810 0x7f7188152eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52106/0 (socket says 172.21.15.42:52106) 2023-07-29T02:06:21.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.786+0000 7f718cfba700 1 -- 172.21.15.42:0/326080142 learned_addr learned my addr 172.21.15.42:0/326080142 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:06:21.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.786+0000 7f71877fe700 1 --2- 172.21.15.42:0/326080142 >> v2:172.21.15.144:3300/0 conn(0x7f71880c1d50 0x7f71880c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:21.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.786+0000 7f7186ffd700 1 -- 172.21.15.42:0/326080142 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890213712 0 0) 0x7f71880c18c0 con 0x7f7188159810 2023-07-29T02:06:21.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.786+0000 7f7186ffd700 1 -- 172.21.15.42:0/326080142 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71700035b0 con 0x7f7188159810 2023-07-29T02:06:21.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.786+0000 7f7186ffd700 1 -- 172.21.15.42:0/326080142 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 53453552 0 0) 0x7f71700035b0 con 0x7f7188159810 2023-07-29T02:06:21.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.786+0000 7f7186ffd700 1 -- 172.21.15.42:0/326080142 >> v2:172.21.15.144:3300/0 conn(0x7f71880c1d50 msgr2=0x7f71880c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:21.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.786+0000 7f7186ffd700 1 --2- 172.21.15.42:0/326080142 >> v2:172.21.15.144:3300/0 conn(0x7f71880c1d50 0x7f71880c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:21.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.786+0000 7f7186ffd700 1 -- 172.21.15.42:0/326080142 >> v1:172.21.15.144:6789/0 conn(0x7f7188159440 legacy=0x7f71880c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:21.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.786+0000 7f7186ffd700 1 -- 172.21.15.42:0/326080142 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71880c1270 con 0x7f7188159810 2023-07-29T02:06:21.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.786+0000 7f7186ffd700 1 -- 172.21.15.42:0/326080142 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7f71800019f0 con 0x7f7188159810 2023-07-29T02:06:21.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.786+0000 7f7186ffd700 1 -- 172.21.15.42:0/326080142 >> v1:172.21.15.42:6789/0 conn(0x7f7188159810 legacy=0x7f7188152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:21.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.786+0000 7f7186ffd700 1 --2- 172.21.15.42:0/326080142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7170003a00 0x7f7170003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:21.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.786+0000 7f7186ffd700 1 --2- 172.21.15.42:0/326080142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7170004850 0x7f7170004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:21.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.786+0000 7f7186ffd700 1 --2- 172.21.15.42:0/326080142 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7170005200 0x7f717000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:21.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.786+0000 7f7186ffd700 1 -- 172.21.15.42:0/326080142 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7188071e90 con 0x7f7170004850 2023-07-29T02:06:21.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.786+0000 7f7186ffd700 1 -- 172.21.15.42:0/326080142 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717000c060 con 0x7f7170003a00 2023-07-29T02:06:21.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.786+0000 7f7186ffd700 1 -- 172.21.15.42:0/326080142 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717000c220 con 0x7f7170005200 2023-07-29T02:06:21.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.786+0000 7f71877fe700 1 --2- 172.21.15.42:0/326080142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7170004850 0x7f7170004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:21.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.786+0000 7f7187fff700 1 --2- 172.21.15.42:0/326080142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7170003a00 0x7f7170003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.787+0000 7f718cfba700 1 --2- 172.21.15.42:0/326080142 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7170005200 0x7f717000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.787+0000 7f71877fe700 1 -- 172.21.15.42:0/326080142 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7170005200 msgr2=0x7f717000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.787+0000 7f71877fe700 1 --2- 172.21.15.42:0/326080142 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f7170005200 0x7f717000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.787+0000 7f71877fe700 1 -- 172.21.15.42:0/326080142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7170003a00 msgr2=0x7f7170003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:21.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.787+0000 7f71877fe700 1 --2- 172.21.15.42:0/326080142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7170003a00 0x7f7170003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.787+0000 7f71877fe700 1 -- 172.21.15.42:0/326080142 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71700035b0 con 0x7f7170004850 2023-07-29T02:06:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.787+0000 7f718cfba700 1 -- 172.21.15.42:0/326080142 reap_dead start 2023-07-29T02:06:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.787+0000 7f7187fff700 1 --2- 172.21.15.42:0/326080142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7170003a00 0x7f7170003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:06:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.787+0000 7f71877fe700 1 --2- 172.21.15.42:0/326080142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7170004850 0x7f7170004cc0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f717c009b60 tx=0x7f7170005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6db0a0a31ae529 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:21.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.787+0000 7f7186ffd700 1 -- 172.21.15.42:0/326080142 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c00e6c0 con 0x7f7170004850 2023-07-29T02:06:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.787+0000 7f7186ffd700 1 -- 172.21.15.42:0/326080142 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717c00e820 con 0x7f7170004850 2023-07-29T02:06:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.787+0000 7f7186ffd700 1 -- 172.21.15.42:0/326080142 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c00eb90 con 0x7f7170004850 2023-07-29T02:06:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.787+0000 7f718ea1d700 1 -- 172.21.15.42:0/326080142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7170004850 msgr2=0x7f7170004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.787+0000 7f718ea1d700 1 --2- 172.21.15.42:0/326080142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7170004850 0x7f7170004cc0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f717c009b60 tx=0x7f7170005880 comp rx=0 tx=0).stop 2023-07-29T02:06:21.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.788+0000 7f718ea1d700 1 -- 172.21.15.42:0/326080142 shutdown_connections 2023-07-29T02:06:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.788+0000 7f718ea1d700 1 --2- 172.21.15.42:0/326080142 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7170004850 0x7f7170004cc0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.788+0000 7f718ea1d700 1 -- 172.21.15.42:0/326080142 >> 172.21.15.42:0/326080142 conn(0x7f71880c8980 msgr2=0x7f71880c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.788+0000 7f718ea1d700 1 -- 172.21.15.42:0/326080142 shutdown_connections 2023-07-29T02:06:21.778 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.788+0000 7f718ea1d700 1 -- 172.21.15.42:0/326080142 wait complete. 2023-07-29T02:06:21.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.789+0000 7f718ea1d700 1 Processor -- start 2023-07-29T02:06:21.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.789+0000 7f718ea1d700 1 -- start start 2023-07-29T02:06:21.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.790+0000 7f718ea1d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7170004850 0x7f7188156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:21.781 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.790+0000 7f718ea1d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f718814cea0 0x7f7188145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.790+0000 7f718ea1d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71881553f0 0x7f71881e5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.790+0000 7f718ea1d700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7188153b70 con 0x7f7170004850 2023-07-29T02:06:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.790+0000 7f718ea1d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71881f1d30 con 0x7f718814cea0 2023-07-29T02:06:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.790+0000 7f718ea1d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7188153e30 con 0x7f71881553f0 2023-07-29T02:06:21.782 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.790+0000 7f7187fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7170004850 0x7f7188156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.790+0000 7f7187fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7170004850 0x7f7188156800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58310/0 (socket says 172.21.15.42:58310) 2023-07-29T02:06:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.790+0000 7f7187fff700 1 -- 172.21.15.42:0/2579683992 learned_addr learned my addr 172.21.15.42:0/2579683992 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.791+0000 7f718cfba700 1 --2- 172.21.15.42:0/2579683992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71881553f0 0x7f71881e5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.791+0000 7f71877fe700 1 --2- 172.21.15.42:0/2579683992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f718814cea0 0x7f7188145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.791+0000 7f7187fff700 1 -- 172.21.15.42:0/2579683992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71881553f0 msgr2=0x7f71881e5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:21.783 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.791+0000 7f7187fff700 1 --2- 172.21.15.42:0/2579683992 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f71881553f0 0x7f71881e5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.791+0000 7f7187fff700 1 -- 172.21.15.42:0/2579683992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f718814cea0 msgr2=0x7f7188145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.791+0000 7f7187fff700 1 --2- 172.21.15.42:0/2579683992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f718814cea0 0x7f7188145720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.791+0000 7f7187fff700 1 -- 172.21.15.42:0/2579683992 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7188154110 con 0x7f7170004850 2023-07-29T02:06:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.791+0000 7f71877fe700 1 --2- 172.21.15.42:0/2579683992 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f718814cea0 0x7f7188145720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:06:21.784 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.791+0000 7f7187fff700 1 --2- 172.21.15.42:0/2579683992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7170004850 0x7f7188156800 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f717800e550 tx=0x7f717800e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:21.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.791+0000 7f7184ff9700 1 -- 172.21.15.42:0/2579683992 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71780052e0 con 0x7f7170004850 2023-07-29T02:06:21.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.791+0000 7f7184ff9700 1 -- 172.21.15.42:0/2579683992 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7178005460 con 0x7f7170004850 2023-07-29T02:06:21.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.791+0000 7f7184ff9700 1 -- 172.21.15.42:0/2579683992 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71780038c0 con 0x7f7170004850 2023-07-29T02:06:21.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.791+0000 7f718ea1d700 1 -- 172.21.15.42:0/2579683992 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71881543f0 con 0x7f7170004850 2023-07-29T02:06:21.785 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.791+0000 7f718ea1d700 1 -- 172.21.15.42:0/2579683992 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7188145c60 con 0x7f7170004850 2023-07-29T02:06:21.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.792+0000 7f718ea1d700 1 -- 172.21.15.42:0/2579683992 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7188072170 con 0x7f7170004850 2023-07-29T02:06:21.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.793+0000 7f7184ff9700 1 -- 172.21.15.42:0/2579683992 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f7178003a20 con 0x7f7170004850 2023-07-29T02:06:21.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.793+0000 7f7184ff9700 1 --2- 172.21.15.42:0/2579683992 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f717406a660 0x7f717406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:21.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.793+0000 7f7184ff9700 1 -- 172.21.15.42:0/2579683992 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f7178088610 con 0x7f7170004850 2023-07-29T02:06:21.786 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.793+0000 7f7184ff9700 1 --2- 172.21.15.42:0/2579683992 >> [v2:172.21.15.42:6816/131312,v1:172.21.15.42:6817/131312] conn(0x7f71740744f0 0x7f7174076940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:21.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.793+0000 7f71877fe700 1 --2- 172.21.15.42:0/2579683992 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f717406a660 0x7f717406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:21.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.793+0000 7f7184ff9700 1 -- 172.21.15.42:0/2579683992 --> [v2:172.21.15.42:6816/131312,v1:172.21.15.42:6817/131312] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7174077010 con 0x7f71740744f0 2023-07-29T02:06:21.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.793+0000 7f7184ff9700 1 -- 172.21.15.42:0/2579683992 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f717808acd0 con 0x7f7170004850 2023-07-29T02:06:21.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.794+0000 7f718cfba700 1 --2- 172.21.15.42:0/2579683992 >> [v2:172.21.15.42:6816/131312,v1:172.21.15.42:6817/131312] conn(0x7f71740744f0 0x7f7174076940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:21.787 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.794+0000 7f718cfba700 1 --2- 172.21.15.42:0/2579683992 >> [v2:172.21.15.42:6816/131312,v1:172.21.15.42:6817/131312] conn(0x7f71740744f0 0x7f7174076940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:21.788 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.794+0000 7f71877fe700 1 --2- 172.21.15.42:0/2579683992 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f717406a660 0x7f717406cb10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f717c0090b0 tx=0x7f717c01e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:21.788 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.794+0000 7f7184ff9700 1 -- 172.21.15.42:0/2579683992 <== osd.0 v2:172.21.15.42:6816/131312 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7174077010 con 0x7f71740744f0 2023-07-29T02:06:21.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.809+0000 7f718ea1d700 1 -- 172.21.15.42:0/2579683992 --> [v2:172.21.15.42:6816/131312,v1:172.21.15.42:6817/131312] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f71880c1550 con 0x7f71740744f0 2023-07-29T02:06:21.790 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.809+0000 7f7184ff9700 1 -- 172.21.15.42:0/2579683992 <== osd.0 v2:172.21.15.42:6816/131312 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7180007210 con 0x7f71740744f0 2023-07-29T02:06:21.791 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2023-07-29T02:06:21.791 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-29T02:06:21.791 INFO:teuthology.orchestra.run.smithi042.stdout:} 2023-07-29T02:06:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.809+0000 7f718ea1d700 1 -- 172.21.15.42:0/2579683992 >> [v2:172.21.15.42:6816/131312,v1:172.21.15.42:6817/131312] conn(0x7f71740744f0 msgr2=0x7f7174076940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:21.792 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.809+0000 7f718ea1d700 1 --2- 172.21.15.42:0/2579683992 >> [v2:172.21.15.42:6816/131312,v1:172.21.15.42:6817/131312] conn(0x7f71740744f0 0x7f7174076940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.809+0000 7f718ea1d700 1 -- 172.21.15.42:0/2579683992 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f717406a660 msgr2=0x7f717406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.809+0000 7f718ea1d700 1 --2- 172.21.15.42:0/2579683992 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f717406a660 0x7f717406cb10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f717c0090b0 tx=0x7f717c01e040 comp rx=0 tx=0).stop 2023-07-29T02:06:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.810+0000 7f718ea1d700 1 -- 172.21.15.42:0/2579683992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7170004850 msgr2=0x7f7188156800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.810+0000 7f718ea1d700 1 --2- 172.21.15.42:0/2579683992 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f7170004850 0x7f7188156800 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f717800e550 tx=0x7f717800e860 comp rx=0 tx=0).stop 2023-07-29T02:06:21.793 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.810+0000 7f718cfba700 1 -- 172.21.15.42:0/2579683992 reap_dead start 2023-07-29T02:06:21.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.810+0000 7f718ea1d700 1 -- 172.21.15.42:0/2579683992 shutdown_connections 2023-07-29T02:06:21.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.810+0000 7f718ea1d700 1 -- 172.21.15.42:0/2579683992 >> 172.21.15.42:0/2579683992 conn(0x7f71880c8980 msgr2=0x7f7188150730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:21.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.810+0000 7f718ea1d700 1 -- 172.21.15.42:0/2579683992 shutdown_connections 2023-07-29T02:06:21.794 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.810+0000 7f718ea1d700 1 -- 172.21.15.42:0/2579683992 wait complete. 2023-07-29T02:06:21.803 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-07-29T02:06:21.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.948+0000 7f235572e700 1 Processor -- start 2023-07-29T02:06:21.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.948+0000 7f235572e700 1 -- start start 2023-07-29T02:06:21.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.948+0000 7f235572e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23500b4250 0x7f235006b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:21.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.948+0000 7f235572e700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f23500c6190 0x7f235015c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:21.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.948+0000 7f235572e700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23501598a0 con 0x7f2350159d30 2023-07-29T02:06:21.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.948+0000 7f235572e700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235006c680 con 0x7f23500c6190 2023-07-29T02:06:21.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.948+0000 7f235572e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2350153850 con 0x7f23500b4250 2023-07-29T02:06:21.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.949+0000 7f234f7fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f2350159d30 0x7f23500c4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52128/0 (socket says 172.21.15.42:52128) 2023-07-29T02:06:21.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.949+0000 7f234f7fe700 1 -- 172.21.15.42:0/823924507 learned_addr learned my addr 172.21.15.42:0/823924507 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:06:21.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.949+0000 7f234effd700 1 --2- 172.21.15.42:0/823924507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23500b4250 0x7f235006b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:21.932 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.949+0000 7f234e7fc700 1 --2- 172.21.15.42:0/823924507 >> v2:172.21.15.144:3300/0 conn(0x7f23500c6190 0x7f235015c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:21.933 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.949+0000 7f234dffb700 1 -- 172.21.15.42:0/823924507 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988051479 0 0) 0x7f23501598a0 con 0x7f2350159d30 2023-07-29T02:06:21.933 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.949+0000 7f234dffb700 1 -- 172.21.15.42:0/823924507 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23380035b0 con 0x7f2350159d30 2023-07-29T02:06:21.933 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.949+0000 7f234effd700 1 -- 172.21.15.42:0/823924507 >> v2:172.21.15.144:3300/0 conn(0x7f23500c6190 msgr2=0x7f235015c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:21.933 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.949+0000 7f234effd700 1 --2- 172.21.15.42:0/823924507 >> v2:172.21.15.144:3300/0 conn(0x7f23500c6190 0x7f235015c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:21.933 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.949+0000 7f234effd700 1 -- 172.21.15.42:0/823924507 >> v1:172.21.15.42:6789/0 conn(0x7f2350159d30 legacy=0x7f23500c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.949+0000 7f234effd700 1 -- 172.21.15.42:0/823924507 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235015cb50 con 0x7f23500b4250 2023-07-29T02:06:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.949+0000 7f234effd700 1 --2- 172.21.15.42:0/823924507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23500b4250 0x7f235006b980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2340009840 tx=0x7f2340009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a93629fea12819d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.949+0000 7f234dffb700 1 -- 172.21.15.42:0/823924507 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340011830 con 0x7f23500b4250 2023-07-29T02:06:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.949+0000 7f234dffb700 1 -- 172.21.15.42:0/823924507 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2340011990 con 0x7f23500b4250 2023-07-29T02:06:21.934 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.950+0000 7f234dffb700 1 -- 172.21.15.42:0/823924507 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340011d20 con 0x7f23500b4250 2023-07-29T02:06:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.950+0000 7f235572e700 1 -- 172.21.15.42:0/823924507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23500b4250 msgr2=0x7f235006b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.950+0000 7f235572e700 1 --2- 172.21.15.42:0/823924507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23500b4250 0x7f235006b980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2340009840 tx=0x7f2340009b50 comp rx=0 tx=0).stop 2023-07-29T02:06:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.950+0000 7f235572e700 1 -- 172.21.15.42:0/823924507 shutdown_connections 2023-07-29T02:06:21.937 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.950+0000 7f235572e700 1 --2- 172.21.15.42:0/823924507 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23500b4250 0x7f235006b980 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.950+0000 7f235572e700 1 --2- 172.21.15.42:0/823924507 >> v2:172.21.15.144:3300/0 conn(0x7f23500c6190 0x7f235015c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.950+0000 7f235572e700 1 -- 172.21.15.42:0/823924507 >> 172.21.15.42:0/823924507 conn(0x7f235006ca30 msgr2=0x7f235006ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.950+0000 7f235572e700 1 -- 172.21.15.42:0/823924507 shutdown_connections 2023-07-29T02:06:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.950+0000 7f235572e700 1 -- 172.21.15.42:0/823924507 wait complete. 2023-07-29T02:06:21.938 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.951+0000 7f235572e700 1 Processor -- start 2023-07-29T02:06:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.951+0000 7f235572e700 1 -- start start 2023-07-29T02:06:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.952+0000 7f235572e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23500b4250 0x7f23500c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.952+0000 7f235572e700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23500c6190 0x7f2350153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.952+0000 7f235572e700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2350159d30 0x7f23501f1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:21.939 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.952+0000 7f235572e700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23500cff10 con 0x7f23500b4250 2023-07-29T02:06:21.940 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.952+0000 7f235572e700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23501569b0 con 0x7f2350159d30 2023-07-29T02:06:21.941 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.952+0000 7f235572e700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2350154840 con 0x7f23500c6190 2023-07-29T02:06:21.941 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.952+0000 7f234effd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23500b4250 0x7f23500c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.952+0000 7f234effd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23500b4250 0x7f23500c4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58326/0 (socket says 172.21.15.42:58326) 2023-07-29T02:06:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.952+0000 7f234effd700 1 -- 172.21.15.42:0/4289908686 learned_addr learned my addr 172.21.15.42:0/4289908686 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.952+0000 7f234e7fc700 1 --2- 172.21.15.42:0/4289908686 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23500c6190 0x7f2350153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.952+0000 7f234effd700 1 -- 172.21.15.42:0/4289908686 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23500c6190 msgr2=0x7f2350153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:21.942 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.952+0000 7f234f7fe700 1 --2- 172.21.15.42:0/4289908686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2350159d30 0x7f23501f1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.953+0000 7f234effd700 1 --2- 172.21.15.42:0/4289908686 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23500c6190 0x7f2350153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.953+0000 7f234effd700 1 -- 172.21.15.42:0/4289908686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2350159d30 msgr2=0x7f23501f1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.953+0000 7f234effd700 1 --2- 172.21.15.42:0/4289908686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2350159d30 0x7f23501f1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.953+0000 7f234effd700 1 -- 172.21.15.42:0/4289908686 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23400094a0 con 0x7f23500b4250 2023-07-29T02:06:21.943 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.953+0000 7f234e7fc700 1 --2- 172.21.15.42:0/4289908686 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23500c6190 0x7f2350153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:06:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.953+0000 7f234effd700 1 --2- 172.21.15.42:0/4289908686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23500b4250 0x7f23500c4480 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f23400090b0 tx=0x7f2340004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.953+0000 7f23377fe700 1 -- 172.21.15.42:0/4289908686 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23400036a0 con 0x7f23500b4250 2023-07-29T02:06:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.953+0000 7f23377fe700 1 -- 172.21.15.42:0/4289908686 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234001f070 con 0x7f23500b4250 2023-07-29T02:06:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.953+0000 7f235572e700 1 -- 172.21.15.42:0/4289908686 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23500cf5e0 con 0x7f23500b4250 2023-07-29T02:06:21.944 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.953+0000 7f23377fe700 1 -- 172.21.15.42:0/4289908686 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2340003a40 con 0x7f23500b4250 2023-07-29T02:06:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.953+0000 7f235572e700 1 -- 172.21.15.42:0/4289908686 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23500cfba0 con 0x7f23500b4250 2023-07-29T02:06:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.954+0000 7f235572e700 1 -- 172.21.15.42:0/4289908686 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23501f1db0 con 0x7f23500b4250 2023-07-29T02:06:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.954+0000 7f23377fe700 1 -- 172.21.15.42:0/4289908686 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f2340003ba0 con 0x7f23500b4250 2023-07-29T02:06:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.955+0000 7f23377fe700 1 --2- 172.21.15.42:0/4289908686 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f233c06a660 0x7f233c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.955+0000 7f23377fe700 1 -- 172.21.15.42:0/4289908686 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f2340021070 con 0x7f23500b4250 2023-07-29T02:06:21.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.955+0000 7f234e7fc700 1 --2- 172.21.15.42:0/4289908686 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f233c06a660 0x7f233c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.955+0000 7f234e7fc700 1 --2- 172.21.15.42:0/4289908686 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f233c06a660 0x7f233c06cb10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f23500cc060 tx=0x7f2344008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:21.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:21.959+0000 7f23377fe700 1 -- 172.21.15.42:0/4289908686 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f2340055510 con 0x7f23500b4250 2023-07-29T02:06:22.142 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.161+0000 7f235572e700 1 -- 172.21.15.42:0/4289908686 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f235006c3a0 con 0x7f233c06a660 2023-07-29T02:06:22.143 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.161+0000 7f23377fe700 1 -- 172.21.15.42:0/4289908686 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2344010710 con 0x7f233c06a660 2023-07-29T02:06:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.163+0000 7f235572e700 1 -- 172.21.15.42:0/4289908686 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f233c06a660 msgr2=0x7f233c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.163+0000 7f235572e700 1 --2- 172.21.15.42:0/4289908686 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f233c06a660 0x7f233c06cb10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f23500cc060 tx=0x7f2344008040 comp rx=0 tx=0).stop 2023-07-29T02:06:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.163+0000 7f235572e700 1 -- 172.21.15.42:0/4289908686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23500b4250 msgr2=0x7f23500c4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.163+0000 7f235572e700 1 --2- 172.21.15.42:0/4289908686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23500b4250 0x7f23500c4480 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f23400090b0 tx=0x7f2340004750 comp rx=0 tx=0).stop 2023-07-29T02:06:22.145 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.163+0000 7f235572e700 1 -- 172.21.15.42:0/4289908686 shutdown_connections 2023-07-29T02:06:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.163+0000 7f235572e700 1 --2- 172.21.15.42:0/4289908686 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f233c06a660 0x7f233c06cb10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.163+0000 7f235572e700 1 --2- 172.21.15.42:0/4289908686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2350159d30 0x7f23501f1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.163+0000 7f235572e700 1 --2- 172.21.15.42:0/4289908686 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f23500b4250 0x7f23500c4480 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.163+0000 7f235572e700 1 --2- 172.21.15.42:0/4289908686 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f23500c6190 0x7f2350153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.146 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.163+0000 7f235572e700 1 -- 172.21.15.42:0/4289908686 >> 172.21.15.42:0/4289908686 conn(0x7f235006ca30 msgr2=0x7f23500b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:22.147 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.163+0000 7f235572e700 1 -- 172.21.15.42:0/4289908686 shutdown_connections 2023-07-29T02:06:22.147 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.163+0000 7f235572e700 1 -- 172.21.15.42:0/4289908686 wait complete. 2023-07-29T02:06:22.147 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 0 to deep-scrub 2023-07-29T02:06:22.157 INFO:tasks.ceph:Scrubbing osd.1 2023-07-29T02:06:22.157 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-07-29T02:06:22.286 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.305+0000 7f22b47c5700 1 Processor -- start 2023-07-29T02:06:22.287 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.305+0000 7f22b47c5700 1 -- start start 2023-07-29T02:06:22.288 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.306+0000 7f22b47c5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22ac153440 0x7f22ac0c6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.288 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.306+0000 7f22b47c5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f22ac06ece0 0x7f22ac06f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.288 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.306+0000 7f22b47c5700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f22ac0cbed0 0x7f22ac0cc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.306+0000 7f22b47c5700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ac0c7bb0 con 0x7f22ac0cbed0 2023-07-29T02:06:22.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.306+0000 7f22b47c5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ac15d5f0 con 0x7f22ac06ece0 2023-07-29T02:06:22.293 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.306+0000 7f22b47c5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac15d090 con 0x7f22ac153440 2023-07-29T02:06:22.293 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.306+0000 7f22b2d62700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f22ac0cbed0 0x7f22ac0cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.293 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.306+0000 7f22b2d62700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f22ac0cbed0 0x7f22ac0cc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58338/0 (socket says 172.21.15.42:58338) 2023-07-29T02:06:22.294 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.306+0000 7f22b2d62700 1 -- 172.21.15.42:0/980322248 learned_addr learned my addr 172.21.15.42:0/980322248 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:22.294 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.306+0000 7f22b2561700 1 --2- 172.21.15.42:0/980322248 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22ac153440 0x7f22ac0c6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.294 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.306+0000 7f22b1d60700 1 --2- 172.21.15.42:0/980322248 >> v2:172.21.15.144:3300/0 conn(0x7f22ac06ece0 0x7f22ac06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.294 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.306+0000 7f22b2d62700 1 -- 172.21.15.42:0/980322248 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22ac153440 msgr2=0x7f22ac0c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:22.294 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.306+0000 7f22b2d62700 1 --2- 172.21.15.42:0/980322248 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22ac153440 0x7f22ac0c6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.306+0000 7f22b2d62700 1 -- 172.21.15.42:0/980322248 >> v2:172.21.15.144:3300/0 conn(0x7f22ac06ece0 msgr2=0x7f22ac06f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:22.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.306+0000 7f22b2d62700 1 --2- 172.21.15.42:0/980322248 >> v2:172.21.15.144:3300/0 conn(0x7f22ac06ece0 0x7f22ac06f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.306+0000 7f22b2d62700 1 -- 172.21.15.42:0/980322248 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac0711c0 con 0x7f22ac0cbed0 2023-07-29T02:06:22.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.307+0000 7f22b2d62700 1 --2- 172.21.15.42:0/980322248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22ac0cbed0 0x7f22ac0cc330 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0c9b40 tx=0x7f22a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b62fae89101de73 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:22.295 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.307+0000 7f22b155f700 1 -- 172.21.15.42:0/980322248 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a400e070 con 0x7f22ac0cbed0 2023-07-29T02:06:22.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.307+0000 7f22b155f700 1 -- 172.21.15.42:0/980322248 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a400b910 con 0x7f22ac0cbed0 2023-07-29T02:06:22.296 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.307+0000 7f22b155f700 1 -- 172.21.15.42:0/980322248 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a400bcc0 con 0x7f22ac0cbed0 2023-07-29T02:06:22.299 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.307+0000 7f22b47c5700 1 -- 172.21.15.42:0/980322248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22ac0cbed0 msgr2=0x7f22ac0cc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.299 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.307+0000 7f22b47c5700 1 --2- 172.21.15.42:0/980322248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22ac0cbed0 0x7f22ac0cc330 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0c9b40 tx=0x7f22a400b330 comp rx=0 tx=0).stop 2023-07-29T02:06:22.299 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.307+0000 7f22b47c5700 1 -- 172.21.15.42:0/980322248 shutdown_connections 2023-07-29T02:06:22.299 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.307+0000 7f22b47c5700 1 --2- 172.21.15.42:0/980322248 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22ac153440 0x7f22ac0c6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.300 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.307+0000 7f22b47c5700 1 --2- 172.21.15.42:0/980322248 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22ac0cbed0 0x7f22ac0cc330 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.300 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.307+0000 7f22b47c5700 1 --2- 172.21.15.42:0/980322248 >> v2:172.21.15.144:3300/0 conn(0x7f22ac06ece0 0x7f22ac06f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.300 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.307+0000 7f22b47c5700 1 -- 172.21.15.42:0/980322248 >> 172.21.15.42:0/980322248 conn(0x7f22ac06d040 msgr2=0x7f22ac06d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:22.300 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.307+0000 7f22b47c5700 1 -- 172.21.15.42:0/980322248 shutdown_connections 2023-07-29T02:06:22.301 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.307+0000 7f22b47c5700 1 -- 172.21.15.42:0/980322248 wait complete. 2023-07-29T02:06:22.301 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.309+0000 7f22b47c5700 1 Processor -- start 2023-07-29T02:06:22.301 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.309+0000 7f22b47c5700 1 -- start start 2023-07-29T02:06:22.301 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.309+0000 7f22b47c5700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22ac06ece0 0x7f22ac1ee990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.301 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.309+0000 7f22b47c5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22ac0cbed0 0x7f22ac0c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.302 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.309+0000 7f22b47c5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22ac153440 0x7f22ac1e2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.302 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.309+0000 7f22b47c5700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac1e5f40 con 0x7f22ac06ece0 2023-07-29T02:06:22.302 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.309+0000 7f22b47c5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0ae290 con 0x7f22ac0cbed0 2023-07-29T02:06:22.302 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.309+0000 7f22b47c5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0c43c0 con 0x7f22ac153440 2023-07-29T02:06:22.302 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.309+0000 7f22b2561700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22ac06ece0 0x7f22ac1ee990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.302 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.309+0000 7f22b2561700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22ac06ece0 0x7f22ac1ee990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58340/0 (socket says 172.21.15.42:58340) 2023-07-29T02:06:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.309+0000 7f22b2561700 1 -- 172.21.15.42:0/498495559 learned_addr learned my addr 172.21.15.42:0/498495559 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.309+0000 7f22b2d62700 1 --2- 172.21.15.42:0/498495559 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22ac153440 0x7f22ac1e2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.310+0000 7f22b1d60700 1 --2- 172.21.15.42:0/498495559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22ac0cbed0 0x7f22ac0c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.310+0000 7f22b2561700 1 -- 172.21.15.42:0/498495559 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22ac153440 msgr2=0x7f22ac1e2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.303 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.310+0000 7f22b2561700 1 --2- 172.21.15.42:0/498495559 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f22ac153440 0x7f22ac1e2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.304 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.310+0000 7f22b2561700 1 -- 172.21.15.42:0/498495559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22ac0cbed0 msgr2=0x7f22ac0c5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.304 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.310+0000 7f22b2561700 1 --2- 172.21.15.42:0/498495559 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22ac0cbed0 0x7f22ac0c5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.304 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.310+0000 7f22b2561700 1 -- 172.21.15.42:0/498495559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a4009b30 con 0x7f22ac06ece0 2023-07-29T02:06:22.304 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.310+0000 7f22b2561700 1 --2- 172.21.15.42:0/498495559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22ac06ece0 0x7f22ac1ee990 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f229c00e9b0 tx=0x7f229c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:22.305 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.310+0000 7f22a2ffd700 1 -- 172.21.15.42:0/498495559 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c009710 con 0x7f22ac06ece0 2023-07-29T02:06:22.305 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.310+0000 7f22a2ffd700 1 -- 172.21.15.42:0/498495559 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229c00ee50 con 0x7f22ac06ece0 2023-07-29T02:06:22.305 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.310+0000 7f22b47c5700 1 -- 172.21.15.42:0/498495559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ac0c46a0 con 0x7f22ac06ece0 2023-07-29T02:06:22.305 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.310+0000 7f22a2ffd700 1 -- 172.21.15.42:0/498495559 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c00ca50 con 0x7f22ac06ece0 2023-07-29T02:06:22.305 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.310+0000 7f22b47c5700 1 -- 172.21.15.42:0/498495559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ac0c4c60 con 0x7f22ac06ece0 2023-07-29T02:06:22.306 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.311+0000 7f22b47c5700 1 -- 172.21.15.42:0/498495559 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22ac0c2bf0 con 0x7f22ac06ece0 2023-07-29T02:06:22.306 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.312+0000 7f22a2ffd700 1 -- 172.21.15.42:0/498495559 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f229c00cbb0 con 0x7f22ac06ece0 2023-07-29T02:06:22.306 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.312+0000 7f22a2ffd700 1 --2- 172.21.15.42:0/498495559 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f229006a690 0x7f229006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.306 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.312+0000 7f22a2ffd700 1 -- 172.21.15.42:0/498495559 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f229c088eb0 con 0x7f22ac06ece0 2023-07-29T02:06:22.306 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.312+0000 7f22b1d60700 1 --2- 172.21.15.42:0/498495559 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f229006a690 0x7f229006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.312+0000 7f22a2ffd700 1 --2- 172.21.15.42:0/498495559 >> [v2:172.21.15.42:6800/131311,v1:172.21.15.42:6801/131311] conn(0x7f2290074520 0x7f2290076970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.312+0000 7f22a2ffd700 1 -- 172.21.15.42:0/498495559 --> [v2:172.21.15.42:6800/131311,v1:172.21.15.42:6801/131311] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2290077040 con 0x7f2290074520 2023-07-29T02:06:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.312+0000 7f22a2ffd700 1 -- 172.21.15.42:0/498495559 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f229c08b570 con 0x7f22ac06ece0 2023-07-29T02:06:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.312+0000 7f22b2d62700 1 --2- 172.21.15.42:0/498495559 >> [v2:172.21.15.42:6800/131311,v1:172.21.15.42:6801/131311] conn(0x7f2290074520 0x7f2290076970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.307 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.313+0000 7f22b1d60700 1 --2- 172.21.15.42:0/498495559 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f229006a690 0x7f229006cb40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f22ac1e3340 tx=0x7f22a8009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.313+0000 7f22b2d62700 1 --2- 172.21.15.42:0/498495559 >> [v2:172.21.15.42:6800/131311,v1:172.21.15.42:6801/131311] conn(0x7f2290074520 0x7f2290076970 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:22.308 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.313+0000 7f22a2ffd700 1 -- 172.21.15.42:0/498495559 <== osd.1 v2:172.21.15.42:6800/131311 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2290077040 con 0x7f2290074520 2023-07-29T02:06:22.309 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.328+0000 7f22b47c5700 1 -- 172.21.15.42:0/498495559 --> [v2:172.21.15.42:6800/131311,v1:172.21.15.42:6801/131311] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f22ac15d310 con 0x7f2290074520 2023-07-29T02:06:22.309 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.328+0000 7f22a2ffd700 1 -- 172.21.15.42:0/498495559 <== osd.1 v2:172.21.15.42:6800/131311 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f22a40099b0 con 0x7f2290074520 2023-07-29T02:06:22.310 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2023-07-29T02:06:22.310 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-29T02:06:22.311 INFO:teuthology.orchestra.run.smithi042.stdout:} 2023-07-29T02:06:22.312 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.328+0000 7f22b47c5700 1 -- 172.21.15.42:0/498495559 >> [v2:172.21.15.42:6800/131311,v1:172.21.15.42:6801/131311] conn(0x7f2290074520 msgr2=0x7f2290076970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.313 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.328+0000 7f22b47c5700 1 --2- 172.21.15.42:0/498495559 >> [v2:172.21.15.42:6800/131311,v1:172.21.15.42:6801/131311] conn(0x7f2290074520 0x7f2290076970 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.313 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.328+0000 7f22b47c5700 1 -- 172.21.15.42:0/498495559 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f229006a690 msgr2=0x7f229006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.314 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.328+0000 7f22b47c5700 1 --2- 172.21.15.42:0/498495559 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f229006a690 0x7f229006cb40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f22ac1e3340 tx=0x7f22a8009210 comp rx=0 tx=0).stop 2023-07-29T02:06:22.314 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.328+0000 7f22b47c5700 1 -- 172.21.15.42:0/498495559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22ac06ece0 msgr2=0x7f22ac1ee990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.315 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.328+0000 7f22b47c5700 1 --2- 172.21.15.42:0/498495559 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f22ac06ece0 0x7f22ac1ee990 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f229c00e9b0 tx=0x7f229c00ecc0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.315 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.328+0000 7f22b2d62700 1 -- 172.21.15.42:0/498495559 reap_dead start 2023-07-29T02:06:22.315 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.328+0000 7f22b47c5700 1 -- 172.21.15.42:0/498495559 shutdown_connections 2023-07-29T02:06:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.328+0000 7f22b47c5700 1 -- 172.21.15.42:0/498495559 >> 172.21.15.42:0/498495559 conn(0x7f22ac06d040 msgr2=0x7f22ac15c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.328+0000 7f22b47c5700 1 -- 172.21.15.42:0/498495559 shutdown_connections 2023-07-29T02:06:22.316 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.328+0000 7f22b47c5700 1 -- 172.21.15.42:0/498495559 wait complete. 2023-07-29T02:06:22.321 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-07-29T02:06:22.448 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.466+0000 7f30474b6700 1 Processor -- start 2023-07-29T02:06:22.448 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.467+0000 7f30474b6700 1 -- start start 2023-07-29T02:06:22.450 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.467+0000 7f30474b6700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f304014f360 0x7f304006a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.450 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.468+0000 7f30474b6700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f30400c7d00 0x7f3040071940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.468+0000 7f30474b6700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30401557d0 con 0x7f30400c6110 2023-07-29T02:06:22.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.468+0000 7f30474b6700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30400c6c60 con 0x7f304014f360 2023-07-29T02:06:22.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.468+0000 7f30474b6700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30400c6f40 con 0x7f30400c7d00 2023-07-29T02:06:22.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.468+0000 7f3045252700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f304014f360 0x7f304006a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.468+0000 7f3044a51700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f30400c6110 0x7f3040071230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52154/0 (socket says 172.21.15.42:52154) 2023-07-29T02:06:22.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.468+0000 7f3045252700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f304014f360 0x7f304006a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58350/0 (socket says 172.21.15.42:58350) 2023-07-29T02:06:22.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.468+0000 7f3044a51700 1 -- 172.21.15.42:0/770496297 learned_addr learned my addr 172.21.15.42:0/770496297 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:06:22.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.468+0000 7f3045a53700 1 --2- 172.21.15.42:0/770496297 >> v2:172.21.15.144:3300/0 conn(0x7f30400c7d00 0x7f3040071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.468+0000 7f3045252700 1 -- 172.21.15.42:0/770496297 >> v2:172.21.15.144:3300/0 conn(0x7f30400c7d00 msgr2=0x7f3040071940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:22.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.468+0000 7f3045252700 1 --2- 172.21.15.42:0/770496297 >> v2:172.21.15.144:3300/0 conn(0x7f30400c7d00 0x7f3040071940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.468+0000 7f3045252700 1 -- 172.21.15.42:0/770496297 >> v1:172.21.15.42:6789/0 conn(0x7f30400c6110 legacy=0x7f3040071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.468+0000 7f3045252700 1 -- 172.21.15.42:0/770496297 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30400c7220 con 0x7f304014f360 2023-07-29T02:06:22.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.468+0000 7f3033fff700 1 -- 172.21.15.42:0/770496297 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518677138 0 0) 0x7f30401557d0 con 0x7f30400c6110 2023-07-29T02:06:22.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.468+0000 7f3045252700 1 --2- 172.21.15.42:0/770496297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f304014f360 0x7f304006a750 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f30400681d0 tx=0x7f303c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04f07eb87e92253 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:22.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.468+0000 7f3033fff700 1 -- 172.21.15.42:0/770496297 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c011830 con 0x7f304014f360 2023-07-29T02:06:22.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.468+0000 7f3033fff700 1 -- 172.21.15.42:0/770496297 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c011990 con 0x7f304014f360 2023-07-29T02:06:22.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.468+0000 7f3033fff700 1 -- 172.21.15.42:0/770496297 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c011d20 con 0x7f304014f360 2023-07-29T02:06:22.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.469+0000 7f30474b6700 1 -- 172.21.15.42:0/770496297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f304014f360 msgr2=0x7f304006a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.469+0000 7f30474b6700 1 --2- 172.21.15.42:0/770496297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f304014f360 0x7f304006a750 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f30400681d0 tx=0x7f303c009b20 comp rx=0 tx=0).stop 2023-07-29T02:06:22.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.469+0000 7f30474b6700 1 -- 172.21.15.42:0/770496297 shutdown_connections 2023-07-29T02:06:22.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.469+0000 7f30474b6700 1 --2- 172.21.15.42:0/770496297 >> v2:172.21.15.144:3300/0 conn(0x7f30400c7d00 0x7f3040071940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.469+0000 7f30474b6700 1 --2- 172.21.15.42:0/770496297 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f304014f360 0x7f304006a750 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.469+0000 7f30474b6700 1 -- 172.21.15.42:0/770496297 >> 172.21.15.42:0/770496297 conn(0x7f30400cc420 msgr2=0x7f30400c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:22.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.469+0000 7f30474b6700 1 -- 172.21.15.42:0/770496297 shutdown_connections 2023-07-29T02:06:22.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.469+0000 7f30474b6700 1 -- 172.21.15.42:0/770496297 wait complete. 2023-07-29T02:06:22.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.471+0000 7f30474b6700 1 Processor -- start 2023-07-29T02:06:22.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.471+0000 7f30474b6700 1 -- start start 2023-07-29T02:06:22.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.471+0000 7f30474b6700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30400c6110 0x7f30400c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f30474b6700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30400c7d00 0x7f3040148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f30474b6700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f304014f360 0x7f30401efcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f30474b6700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30401ef4f0 con 0x7f30400c7d00 2023-07-29T02:06:22.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f30474b6700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3040149980 con 0x7f30400c6110 2023-07-29T02:06:22.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f30474b6700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3040149c40 con 0x7f304014f360 2023-07-29T02:06:22.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f3044a51700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30400c7d00 0x7f3040148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f3044a51700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30400c7d00 0x7f3040148100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58358/0 (socket says 172.21.15.42:58358) 2023-07-29T02:06:22.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f3044a51700 1 -- 172.21.15.42:0/2076054912 learned_addr learned my addr 172.21.15.42:0/2076054912 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:22.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f3045252700 1 --2- 172.21.15.42:0/2076054912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30400c6110 0x7f30400c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f3045a53700 1 --2- 172.21.15.42:0/2076054912 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f304014f360 0x7f30401efcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f3044a51700 1 -- 172.21.15.42:0/2076054912 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f304014f360 msgr2=0x7f30401efcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f3044a51700 1 --2- 172.21.15.42:0/2076054912 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f304014f360 0x7f30401efcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f3044a51700 1 -- 172.21.15.42:0/2076054912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30400c6110 msgr2=0x7f30400c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f3044a51700 1 --2- 172.21.15.42:0/2076054912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30400c6110 0x7f30400c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f3044a51700 1 -- 172.21.15.42:0/2076054912 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c0094a0 con 0x7f30400c7d00 2023-07-29T02:06:22.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f3045252700 1 --2- 172.21.15.42:0/2076054912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30400c6110 0x7f30400c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:06:22.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f3044a51700 1 --2- 172.21.15.42:0/2076054912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30400c7d00 0x7f3040148100 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f303400c520 tx=0x7f303400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:22.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f3031ffb700 1 -- 172.21.15.42:0/2076054912 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3034004c80 con 0x7f30400c7d00 2023-07-29T02:06:22.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f3031ffb700 1 -- 172.21.15.42:0/2076054912 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3034004de0 con 0x7f30400c7d00 2023-07-29T02:06:22.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f3031ffb700 1 -- 172.21.15.42:0/2076054912 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30340072d0 con 0x7f30400c7d00 2023-07-29T02:06:22.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.472+0000 7f30474b6700 1 -- 172.21.15.42:0/2076054912 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3040149f20 con 0x7f30400c7d00 2023-07-29T02:06:22.463 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.473+0000 7f30474b6700 1 -- 172.21.15.42:0/2076054912 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30401ef790 con 0x7f30400c7d00 2023-07-29T02:06:22.463 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.473+0000 7f30474b6700 1 -- 172.21.15.42:0/2076054912 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304004ea50 con 0x7f30400c7d00 2023-07-29T02:06:22.463 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.474+0000 7f3031ffb700 1 -- 172.21.15.42:0/2076054912 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f3034007430 con 0x7f30400c7d00 2023-07-29T02:06:22.463 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.474+0000 7f3031ffb700 1 --2- 172.21.15.42:0/2076054912 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f302406a660 0x7f302406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.463 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.474+0000 7f3031ffb700 1 -- 172.21.15.42:0/2076054912 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f3034088d20 con 0x7f30400c7d00 2023-07-29T02:06:22.464 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.474+0000 7f3045252700 1 --2- 172.21.15.42:0/2076054912 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f302406a660 0x7f302406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.464 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.475+0000 7f3045252700 1 --2- 172.21.15.42:0/2076054912 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f302406a660 0x7f302406cb10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f303c0090b0 tx=0x7f303c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:22.464 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.479+0000 7f3031ffb700 1 -- 172.21.15.42:0/2076054912 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f3034053bd0 con 0x7f30400c7d00 2023-07-29T02:06:22.656 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.675+0000 7f30474b6700 1 -- 172.21.15.42:0/2076054912 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f30400c77e0 con 0x7f302406a660 2023-07-29T02:06:22.657 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.676+0000 7f3031ffb700 1 -- 172.21.15.42:0/2076054912 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f303c011800 con 0x7f302406a660 2023-07-29T02:06:22.660 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.678+0000 7f30474b6700 1 -- 172.21.15.42:0/2076054912 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f302406a660 msgr2=0x7f302406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.660 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.678+0000 7f30474b6700 1 --2- 172.21.15.42:0/2076054912 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f302406a660 0x7f302406cb10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f303c0090b0 tx=0x7f303c008030 comp rx=0 tx=0).stop 2023-07-29T02:06:22.660 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.678+0000 7f30474b6700 1 -- 172.21.15.42:0/2076054912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30400c7d00 msgr2=0x7f3040148100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.678+0000 7f30474b6700 1 --2- 172.21.15.42:0/2076054912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30400c7d00 0x7f3040148100 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f303400c520 tx=0x7f303400c8e0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.678+0000 7f30474b6700 1 -- 172.21.15.42:0/2076054912 shutdown_connections 2023-07-29T02:06:22.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.678+0000 7f30474b6700 1 --2- 172.21.15.42:0/2076054912 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f302406a660 0x7f302406cb10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.678+0000 7f30474b6700 1 --2- 172.21.15.42:0/2076054912 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f304014f360 0x7f30401efcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.661 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.678+0000 7f30474b6700 1 --2- 172.21.15.42:0/2076054912 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30400c6110 0x7f30400c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.678+0000 7f30474b6700 1 --2- 172.21.15.42:0/2076054912 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f30400c7d00 0x7f3040148100 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.678+0000 7f30474b6700 1 -- 172.21.15.42:0/2076054912 >> 172.21.15.42:0/2076054912 conn(0x7f30400cc420 msgr2=0x7f304014e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:22.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.678+0000 7f30474b6700 1 -- 172.21.15.42:0/2076054912 shutdown_connections 2023-07-29T02:06:22.662 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.679+0000 7f30474b6700 1 -- 172.21.15.42:0/2076054912 wait complete. 2023-07-29T02:06:22.663 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 1 to deep-scrub 2023-07-29T02:06:22.672 INFO:tasks.ceph:Scrubbing osd.2 2023-07-29T02:06:22.672 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-07-29T02:06:22.801 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.820+0000 7fb96dddb700 1 Processor -- start 2023-07-29T02:06:22.802 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.820+0000 7fb96dddb700 1 -- start start 2023-07-29T02:06:22.804 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.821+0000 7fb96dddb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb968071e80 0x7fb96815cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.804 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.821+0000 7fb96dddb700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9680728f0 con 0x7fb968153560 2023-07-29T02:06:22.805 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.821+0000 7fb96dddb700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96815d600 con 0x7fb9680c80a0 2023-07-29T02:06:22.805 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.821+0000 7fb96dddb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb968072b40 con 0x7fb968071e80 2023-07-29T02:06:22.805 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.821+0000 7fb9677fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fb968153560 0x7fb96815c8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52168/0 (socket says 172.21.15.42:52168) 2023-07-29T02:06:22.805 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.821+0000 7fb9677fe700 1 -- 172.21.15.42:0/2761806834 learned_addr learned my addr 172.21.15.42:0/2761806834 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:06:22.806 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.821+0000 7fb966ffd700 1 --2- 172.21.15.42:0/2761806834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb968071e80 0x7fb96815cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.806 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.821+0000 7fb9667fc700 1 -- 172.21.15.42:0/2761806834 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1876876053 0 0) 0x7fb9680728f0 con 0x7fb968153560 2023-07-29T02:06:22.806 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.821+0000 7fb9667fc700 1 -- 172.21.15.42:0/2761806834 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9500035b0 con 0x7fb968153560 2023-07-29T02:06:22.806 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb9667fc700 1 -- 172.21.15.42:0/2761806834 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3440632995 0 0) 0x7fb9500035b0 con 0x7fb968153560 2023-07-29T02:06:22.806 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb9667fc700 1 -- 172.21.15.42:0/2761806834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb968071e80 msgr2=0x7fb96815cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:22.807 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb9667fc700 1 --2- 172.21.15.42:0/2761806834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb968071e80 0x7fb96815cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.807 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb9667fc700 1 -- 172.21.15.42:0/2761806834 >> v1:172.21.15.144:6789/0 conn(0x7fb9680c80a0 legacy=0x7fb968163be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.807 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb9667fc700 1 -- 172.21.15.42:0/2761806834 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9680c7590 con 0x7fb968153560 2023-07-29T02:06:22.807 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb9667fc700 1 -- 172.21.15.42:0/2761806834 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7fb958001670 con 0x7fb968153560 2023-07-29T02:06:22.807 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb9667fc700 1 -- 172.21.15.42:0/2761806834 >> v1:172.21.15.42:6789/0 conn(0x7fb968153560 legacy=0x7fb96815c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.807 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb9667fc700 1 --2- 172.21.15.42:0/2761806834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb950003a30 0x7fb950003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.808 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb9667fc700 1 --2- 172.21.15.42:0/2761806834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb968071e80 0x7fb950004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.808 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb9667fc700 1 --2- 172.21.15.42:0/2761806834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb950004d90 0x7fb950005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.808 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb9667fc700 1 -- 172.21.15.42:0/2761806834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb968072b40 con 0x7fb950004d90 2023-07-29T02:06:22.808 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb9667fc700 1 -- 172.21.15.42:0/2761806834 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95000bb20 con 0x7fb950003a30 2023-07-29T02:06:22.808 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb9667fc700 1 -- 172.21.15.42:0/2761806834 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95000bce0 con 0x7fb968071e80 2023-07-29T02:06:22.809 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb9677fe700 1 --2- 172.21.15.42:0/2761806834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb950003a30 0x7fb950003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.809 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb967fff700 1 --2- 172.21.15.42:0/2761806834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb950004d90 0x7fb950005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.809 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb966ffd700 1 --2- 172.21.15.42:0/2761806834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb968071e80 0x7fb950004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.809 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb967fff700 1 -- 172.21.15.42:0/2761806834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb968071e80 msgr2=0x7fb950004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:22.809 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb967fff700 1 --2- 172.21.15.42:0/2761806834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb968071e80 0x7fb950004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.810 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb967fff700 1 -- 172.21.15.42:0/2761806834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb950003a30 msgr2=0x7fb950003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:22.810 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb967fff700 1 --2- 172.21.15.42:0/2761806834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb950003a30 0x7fb950003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.810 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb967fff700 1 -- 172.21.15.42:0/2761806834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9500035b0 con 0x7fb950004d90 2023-07-29T02:06:22.810 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb967fff700 1 --2- 172.21.15.42:0/2761806834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb950004d90 0x7fb950005200 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb96000c240 tx=0x7fb950005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f05727de12a45f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:22.810 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.822+0000 7fb9667fc700 1 -- 172.21.15.42:0/2761806834 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb960001df0 con 0x7fb950004d90 2023-07-29T02:06:22.811 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.823+0000 7fb9667fc700 1 -- 172.21.15.42:0/2761806834 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96000cda0 con 0x7fb950004d90 2023-07-29T02:06:22.811 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.823+0000 7fb9667fc700 1 -- 172.21.15.42:0/2761806834 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb960003c40 con 0x7fb950004d90 2023-07-29T02:06:22.811 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.823+0000 7fb96dddb700 1 -- 172.21.15.42:0/2761806834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb950004d90 msgr2=0x7fb950005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.811 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.823+0000 7fb96dddb700 1 --2- 172.21.15.42:0/2761806834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb950004d90 0x7fb950005200 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb96000c240 tx=0x7fb950005880 comp rx=0 tx=0).stop 2023-07-29T02:06:22.811 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.823+0000 7fb967fff700 1 -- 172.21.15.42:0/2761806834 reap_dead start 2023-07-29T02:06:22.812 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.823+0000 7fb96dddb700 1 -- 172.21.15.42:0/2761806834 shutdown_connections 2023-07-29T02:06:22.812 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.823+0000 7fb96dddb700 1 -- 172.21.15.42:0/2761806834 >> 172.21.15.42:0/2761806834 conn(0x7fb9680c8980 msgr2=0x7fb9680c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:22.812 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.823+0000 7fb96dddb700 1 -- 172.21.15.42:0/2761806834 shutdown_connections 2023-07-29T02:06:22.812 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.823+0000 7fb96dddb700 1 -- 172.21.15.42:0/2761806834 wait complete. 2023-07-29T02:06:22.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.824+0000 7fb96dddb700 1 Processor -- start 2023-07-29T02:06:22.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.825+0000 7fb96dddb700 1 -- start start 2023-07-29T02:06:22.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.825+0000 7fb96dddb700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9680cb270 0x7fb968158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.815 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.825+0000 7fb96dddb700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9680cb640 0x7fb9681f1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.816 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.825+0000 7fb96dddb700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb96806c8b0 0x7fb9681f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.816 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.825+0000 7fb96dddb700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9681595f0 con 0x7fb9680cb640 2023-07-29T02:06:22.816 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.825+0000 7fb96dddb700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb968158740 con 0x7fb9680cb270 2023-07-29T02:06:22.816 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.825+0000 7fb96dddb700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb968159800 con 0x7fb96806c8b0 2023-07-29T02:06:22.816 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.825+0000 7fb966ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9680cb640 0x7fb9681f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.817 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.825+0000 7fb966ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9680cb640 0x7fb9681f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58378/0 (socket says 172.21.15.42:58378) 2023-07-29T02:06:22.817 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.825+0000 7fb966ffd700 1 -- 172.21.15.42:0/764052826 learned_addr learned my addr 172.21.15.42:0/764052826 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:22.817 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.825+0000 7fb967fff700 1 --2- 172.21.15.42:0/764052826 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb96806c8b0 0x7fb9681f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.817 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.825+0000 7fb9677fe700 1 --2- 172.21.15.42:0/764052826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9680cb270 0x7fb968158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.817 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.826+0000 7fb966ffd700 1 -- 172.21.15.42:0/764052826 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb96806c8b0 msgr2=0x7fb9681f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.817 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.826+0000 7fb966ffd700 1 --2- 172.21.15.42:0/764052826 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb96806c8b0 0x7fb9681f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.818 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.826+0000 7fb966ffd700 1 -- 172.21.15.42:0/764052826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9680cb270 msgr2=0x7fb968158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.818 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.826+0000 7fb966ffd700 1 --2- 172.21.15.42:0/764052826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9680cb270 0x7fb968158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.818 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.826+0000 7fb966ffd700 1 -- 172.21.15.42:0/764052826 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb968159ae0 con 0x7fb9680cb640 2023-07-29T02:06:22.818 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.826+0000 7fb9677fe700 1 --2- 172.21.15.42:0/764052826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9680cb270 0x7fb968158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:06:22.818 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.826+0000 7fb966ffd700 1 --2- 172.21.15.42:0/764052826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9680cb640 0x7fb9681f1810 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb95c011aa0 tx=0x7fb95c011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:22.819 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.826+0000 7fb94ffff700 1 -- 172.21.15.42:0/764052826 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c00f940 con 0x7fb9680cb640 2023-07-29T02:06:22.819 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.826+0000 7fb94ffff700 1 -- 172.21.15.42:0/764052826 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c00faa0 con 0x7fb9680cb640 2023-07-29T02:06:22.819 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.826+0000 7fb94ffff700 1 -- 172.21.15.42:0/764052826 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c00fe50 con 0x7fb9680cb640 2023-07-29T02:06:22.819 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.826+0000 7fb96dddb700 1 -- 172.21.15.42:0/764052826 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb968159dc0 con 0x7fb9680cb640 2023-07-29T02:06:22.819 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.826+0000 7fb96dddb700 1 -- 172.21.15.42:0/764052826 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb968159060 con 0x7fb9680cb640 2023-07-29T02:06:22.820 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.827+0000 7fb96dddb700 1 -- 172.21.15.42:0/764052826 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb9680c7870 con 0x7fb9680cb640 2023-07-29T02:06:22.820 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.828+0000 7fb94ffff700 1 -- 172.21.15.42:0/764052826 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fb95c014440 con 0x7fb9680cb640 2023-07-29T02:06:22.820 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.828+0000 7fb94ffff700 1 --2- 172.21.15.42:0/764052826 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb95406a660 0x7fb95406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.820 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.828+0000 7fb94ffff700 1 -- 172.21.15.42:0/764052826 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7fb95c089670 con 0x7fb9680cb640 2023-07-29T02:06:22.820 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.828+0000 7fb9677fe700 1 --2- 172.21.15.42:0/764052826 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb95406a660 0x7fb95406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.821 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.828+0000 7fb94ffff700 1 --2- 172.21.15.42:0/764052826 >> [v2:172.21.15.42:6808/131313,v1:172.21.15.42:6809/131313] conn(0x7fb9540744f0 0x7fb954076940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.821 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.828+0000 7fb94ffff700 1 -- 172.21.15.42:0/764052826 --> [v2:172.21.15.42:6808/131313,v1:172.21.15.42:6809/131313] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb954077010 con 0x7fb9540744f0 2023-07-29T02:06:22.821 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.828+0000 7fb94ffff700 1 -- 172.21.15.42:0/764052826 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb95c08bd30 con 0x7fb9680cb640 2023-07-29T02:06:22.821 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.828+0000 7fb967fff700 1 --2- 172.21.15.42:0/764052826 >> [v2:172.21.15.42:6808/131313,v1:172.21.15.42:6809/131313] conn(0x7fb9540744f0 0x7fb954076940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.821 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.829+0000 7fb9677fe700 1 --2- 172.21.15.42:0/764052826 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb95406a660 0x7fb95406cb10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb958000c00 tx=0x7fb958009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:22.822 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.829+0000 7fb967fff700 1 --2- 172.21.15.42:0/764052826 >> [v2:172.21.15.42:6808/131313,v1:172.21.15.42:6809/131313] conn(0x7fb9540744f0 0x7fb954076940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:22.822 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.829+0000 7fb94ffff700 1 -- 172.21.15.42:0/764052826 <== osd.2 v2:172.21.15.42:6808/131313 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb954077010 con 0x7fb9540744f0 2023-07-29T02:06:22.824 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.844+0000 7fb96dddb700 1 -- 172.21.15.42:0/764052826 --> [v2:172.21.15.42:6808/131313,v1:172.21.15.42:6809/131313] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb968159250 con 0x7fb9540744f0 2023-07-29T02:06:22.825 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.844+0000 7fb94ffff700 1 -- 172.21.15.42:0/764052826 <== osd.2 v2:172.21.15.42:6808/131313 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb968159250 con 0x7fb9540744f0 2023-07-29T02:06:22.825 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2023-07-29T02:06:22.826 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-29T02:06:22.826 INFO:teuthology.orchestra.run.smithi042.stdout:} 2023-07-29T02:06:22.827 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.844+0000 7fb96dddb700 1 -- 172.21.15.42:0/764052826 >> [v2:172.21.15.42:6808/131313,v1:172.21.15.42:6809/131313] conn(0x7fb9540744f0 msgr2=0x7fb954076940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.827 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.844+0000 7fb96dddb700 1 --2- 172.21.15.42:0/764052826 >> [v2:172.21.15.42:6808/131313,v1:172.21.15.42:6809/131313] conn(0x7fb9540744f0 0x7fb954076940 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.827 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.844+0000 7fb96dddb700 1 -- 172.21.15.42:0/764052826 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb95406a660 msgr2=0x7fb95406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.827 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.844+0000 7fb96dddb700 1 --2- 172.21.15.42:0/764052826 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb95406a660 0x7fb95406cb10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb958000c00 tx=0x7fb958009040 comp rx=0 tx=0).stop 2023-07-29T02:06:22.828 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.844+0000 7fb96dddb700 1 -- 172.21.15.42:0/764052826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9680cb640 msgr2=0x7fb9681f1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.828 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.844+0000 7fb96dddb700 1 --2- 172.21.15.42:0/764052826 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb9680cb640 0x7fb9681f1810 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb95c011aa0 tx=0x7fb95c011db0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.828 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.844+0000 7fb967fff700 1 -- 172.21.15.42:0/764052826 reap_dead start 2023-07-29T02:06:22.828 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.844+0000 7fb96dddb700 1 -- 172.21.15.42:0/764052826 shutdown_connections 2023-07-29T02:06:22.828 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.844+0000 7fb96dddb700 1 -- 172.21.15.42:0/764052826 >> 172.21.15.42:0/764052826 conn(0x7fb9680c8980 msgr2=0x7fb968071090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:22.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.844+0000 7fb96dddb700 1 -- 172.21.15.42:0/764052826 shutdown_connections 2023-07-29T02:06:22.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.844+0000 7fb96dddb700 1 -- 172.21.15.42:0/764052826 wait complete. 2023-07-29T02:06:22.837 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-07-29T02:06:22.962 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.981+0000 7f90a113f700 1 Processor -- start 2023-07-29T02:06:22.963 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.981+0000 7f90a113f700 1 -- start start 2023-07-29T02:06:22.964 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.982+0000 7f90a113f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f909c0c5510 0x7f909c1626b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.965 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.982+0000 7f90a113f700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909c157710 con 0x7f909c1512f0 2023-07-29T02:06:22.965 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.982+0000 7f90a113f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909c0c8e20 con 0x7f909c061520 2023-07-29T02:06:22.965 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.982+0000 7f90a113f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909c0c5950 con 0x7f909c0c5510 2023-07-29T02:06:22.965 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.982+0000 7f909ad9d700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f909c1512f0 0x7f909c0c67e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52190/0 (socket says 172.21.15.42:52190) 2023-07-29T02:06:22.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.982+0000 7f909ad9d700 1 -- 172.21.15.42:0/3555361438 learned_addr learned my addr 172.21.15.42:0/3555361438 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:06:22.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.982+0000 7f909b59e700 1 --2- 172.21.15.42:0/3555361438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f909c0c5510 0x7f909c1626b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.982+0000 7f9099d9b700 1 -- 172.21.15.42:0/3555361438 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207720670 0 0) 0x7f909c157710 con 0x7f909c1512f0 2023-07-29T02:06:22.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.982+0000 7f9099d9b700 1 -- 172.21.15.42:0/3555361438 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90840035b0 con 0x7f909c1512f0 2023-07-29T02:06:22.966 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.982+0000 7f9099d9b700 1 -- 172.21.15.42:0/3555361438 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522202299 0 0) 0x7f909c0c8e20 con 0x7f909c061520 2023-07-29T02:06:22.967 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.982+0000 7f9099d9b700 1 -- 172.21.15.42:0/3555361438 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f909c157710 con 0x7f909c061520 2023-07-29T02:06:22.967 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.982+0000 7f909b59e700 1 -- 172.21.15.42:0/3555361438 >> v1:172.21.15.144:6789/0 conn(0x7f909c061520 legacy=0x7f909c0c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.967 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.982+0000 7f909b59e700 1 -- 172.21.15.42:0/3555361438 >> v1:172.21.15.42:6789/0 conn(0x7f909c1512f0 legacy=0x7f909c0c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.967 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.982+0000 7f909b59e700 1 -- 172.21.15.42:0/3555361438 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c156e00 con 0x7f909c0c5510 2023-07-29T02:06:22.967 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.983+0000 7f909b59e700 1 --2- 172.21.15.42:0/3555361438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f909c0c5510 0x7f909c1626b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9094009dc0 tx=0x7f909400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5856ff1e0de4b67 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:22.968 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.983+0000 7f9099d9b700 1 -- 172.21.15.42:0/3555361438 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400e070 con 0x7f909c0c5510 2023-07-29T02:06:22.968 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.983+0000 7f9099d9b700 1 -- 172.21.15.42:0/3555361438 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909400bb20 con 0x7f909c0c5510 2023-07-29T02:06:22.968 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.983+0000 7f9099d9b700 1 -- 172.21.15.42:0/3555361438 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909400be90 con 0x7f909c0c5510 2023-07-29T02:06:22.968 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.983+0000 7f90a113f700 1 -- 172.21.15.42:0/3555361438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f909c0c5510 msgr2=0x7f909c1626b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.968 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.983+0000 7f90a113f700 1 --2- 172.21.15.42:0/3555361438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f909c0c5510 0x7f909c1626b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9094009dc0 tx=0x7f909400b330 comp rx=0 tx=0).stop 2023-07-29T02:06:22.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.983+0000 7f90a113f700 1 -- 172.21.15.42:0/3555361438 shutdown_connections 2023-07-29T02:06:22.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.983+0000 7f90a113f700 1 --2- 172.21.15.42:0/3555361438 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f909c0c5510 0x7f909c1626b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.983+0000 7f90a113f700 1 -- 172.21.15.42:0/3555361438 >> 172.21.15.42:0/3555361438 conn(0x7f909c0cc420 msgr2=0x7f909c0c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:22.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.984+0000 7f90a113f700 1 -- 172.21.15.42:0/3555361438 shutdown_connections 2023-07-29T02:06:22.969 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.984+0000 7f90a113f700 1 -- 172.21.15.42:0/3555361438 wait complete. 2023-07-29T02:06:22.971 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.985+0000 7f90a113f700 1 Processor -- start 2023-07-29T02:06:22.972 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.985+0000 7f90a113f700 1 -- start start 2023-07-29T02:06:22.972 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.986+0000 7f90a113f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f909c061520 0x7f909c0ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.972 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.986+0000 7f90a113f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f909c0c5510 0x7f909c1ed540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.986+0000 7f90a113f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f909c1512f0 0x7f909c0c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.986+0000 7f90a113f700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c1f0240 con 0x7f909c0c5510 2023-07-29T02:06:22.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.986+0000 7f90a113f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c1f04e0 con 0x7f909c1512f0 2023-07-29T02:06:22.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.986+0000 7f90a113f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909c1f07a0 con 0x7f909c061520 2023-07-29T02:06:22.973 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.986+0000 7f909a59c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f909c0c5510 0x7f909c1ed540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.986+0000 7f909a59c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f909c0c5510 0x7f909c1ed540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58394/0 (socket says 172.21.15.42:58394) 2023-07-29T02:06:22.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.986+0000 7f909a59c700 1 -- 172.21.15.42:0/2890845250 learned_addr learned my addr 172.21.15.42:0/2890845250 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:22.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.986+0000 7f909ad9d700 1 --2- 172.21.15.42:0/2890845250 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f909c061520 0x7f909c0ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.986+0000 7f909b59e700 1 --2- 172.21.15.42:0/2890845250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f909c1512f0 0x7f909c0c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.974 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.986+0000 7f909a59c700 1 -- 172.21.15.42:0/2890845250 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f909c061520 msgr2=0x7f909c0ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.986+0000 7f909a59c700 1 --2- 172.21.15.42:0/2890845250 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f909c061520 0x7f909c0ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.986+0000 7f909a59c700 1 -- 172.21.15.42:0/2890845250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f909c1512f0 msgr2=0x7f909c0c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:22.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.986+0000 7f909a59c700 1 --2- 172.21.15.42:0/2890845250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f909c1512f0 0x7f909c0c65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:22.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.986+0000 7f909a59c700 1 -- 172.21.15.42:0/2890845250 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9094009a70 con 0x7f909c0c5510 2023-07-29T02:06:22.975 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.986+0000 7f909a59c700 1 --2- 172.21.15.42:0/2890845250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f909c0c5510 0x7f909c1ed540 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f908c00c500 tx=0x7f908c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:22.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.986+0000 7f90837fe700 1 -- 172.21.15.42:0/2890845250 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c0052d0 con 0x7f909c0c5510 2023-07-29T02:06:22.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.987+0000 7f90837fe700 1 -- 172.21.15.42:0/2890845250 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c005450 con 0x7f909c0c5510 2023-07-29T02:06:22.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.987+0000 7f90a113f700 1 -- 172.21.15.42:0/2890845250 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909c1f0a80 con 0x7f909c0c5510 2023-07-29T02:06:22.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.987+0000 7f90837fe700 1 -- 172.21.15.42:0/2890845250 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c0038c0 con 0x7f909c0c5510 2023-07-29T02:06:22.976 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.987+0000 7f90a113f700 1 -- 172.21.15.42:0/2890845250 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909c1f1040 con 0x7f909c0c5510 2023-07-29T02:06:22.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.988+0000 7f90a113f700 1 -- 172.21.15.42:0/2890845250 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909c0698b0 con 0x7f909c0c5510 2023-07-29T02:06:22.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.988+0000 7f90837fe700 1 -- 172.21.15.42:0/2890845250 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f908c003a20 con 0x7f909c0c5510 2023-07-29T02:06:22.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.988+0000 7f90837fe700 1 --2- 172.21.15.42:0/2890845250 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f908806a660 0x7f908806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:22.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.989+0000 7f90837fe700 1 -- 172.21.15.42:0/2890845250 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f908c0883f0 con 0x7f909c0c5510 2023-07-29T02:06:22.977 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.989+0000 7f909ad9d700 1 --2- 172.21.15.42:0/2890845250 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f908806a660 0x7f908806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:22.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.989+0000 7f909ad9d700 1 --2- 172.21.15.42:0/2890845250 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f908806a660 0x7f908806cb10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9090007fd0 tx=0x7f9090007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:22.978 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:22.993+0000 7f90837fe700 1 -- 172.21.15.42:0/2890845250 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f908c0532c0 con 0x7f909c0c5510 2023-07-29T02:06:23.173 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.192+0000 7f90a113f700 1 -- 172.21.15.42:0/2890845250 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f909c0c7e90 con 0x7f908806a660 2023-07-29T02:06:23.174 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.193+0000 7f90837fe700 1 -- 172.21.15.42:0/2890845250 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f90900058e0 con 0x7f908806a660 2023-07-29T02:06:23.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.195+0000 7f90a113f700 1 -- 172.21.15.42:0/2890845250 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f908806a660 msgr2=0x7f908806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.195+0000 7f90a113f700 1 --2- 172.21.15.42:0/2890845250 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f908806a660 0x7f908806cb10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9090007fd0 tx=0x7f9090007de0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.195+0000 7f90a113f700 1 -- 172.21.15.42:0/2890845250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f909c0c5510 msgr2=0x7f909c1ed540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.195+0000 7f90a113f700 1 --2- 172.21.15.42:0/2890845250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f909c0c5510 0x7f909c1ed540 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f908c00c500 tx=0x7f908c00c810 comp rx=0 tx=0).stop 2023-07-29T02:06:23.177 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.195+0000 7f90a113f700 1 -- 172.21.15.42:0/2890845250 shutdown_connections 2023-07-29T02:06:23.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.195+0000 7f90a113f700 1 --2- 172.21.15.42:0/2890845250 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f908806a660 0x7f908806cb10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.195+0000 7f90a113f700 1 --2- 172.21.15.42:0/2890845250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f909c1512f0 0x7f909c0c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.195+0000 7f90a113f700 1 --2- 172.21.15.42:0/2890845250 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f909c061520 0x7f909c0ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.195+0000 7f90a113f700 1 --2- 172.21.15.42:0/2890845250 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f909c0c5510 0x7f909c1ed540 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.178 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.195+0000 7f90a113f700 1 -- 172.21.15.42:0/2890845250 >> 172.21.15.42:0/2890845250 conn(0x7f909c0cc420 msgr2=0x7f909c155a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:23.179 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.195+0000 7f90a113f700 1 -- 172.21.15.42:0/2890845250 shutdown_connections 2023-07-29T02:06:23.179 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.196+0000 7f90a113f700 1 -- 172.21.15.42:0/2890845250 wait complete. 2023-07-29T02:06:23.179 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 2 to deep-scrub 2023-07-29T02:06:23.189 INFO:tasks.ceph:Scrubbing osd.3 2023-07-29T02:06:23.189 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-07-29T02:06:23.318 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.336+0000 7f6628068700 1 Processor -- start 2023-07-29T02:06:23.318 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.337+0000 7f6628068700 1 -- start start 2023-07-29T02:06:23.319 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.337+0000 7f6628068700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f662015c070 0x7f6620159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.321 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.338+0000 7f6628068700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66200c7cf0 con 0x7f662006e520 2023-07-29T02:06:23.321 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.338+0000 7f6628068700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66200c7fd0 con 0x7f6620061190 2023-07-29T02:06:23.322 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.338+0000 7f6628068700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66200c7b00 con 0x7f662015c070 2023-07-29T02:06:23.322 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.338+0000 7f6625e04700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f662015c070 0x7f6620159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.322 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.338+0000 7f6625603700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f662006e520 0x7f662006f270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52204/0 (socket says 172.21.15.42:52204) 2023-07-29T02:06:23.322 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.338+0000 7f6625603700 1 -- 172.21.15.42:0/2066399252 learned_addr learned my addr 172.21.15.42:0/2066399252 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:06:23.322 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.338+0000 7f6625e04700 1 -- 172.21.15.42:0/2066399252 >> v1:172.21.15.144:6789/0 conn(0x7f6620061190 legacy=0x7f6620163ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.323 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.338+0000 7f6625e04700 1 -- 172.21.15.42:0/2066399252 >> v1:172.21.15.42:6789/0 conn(0x7f662006e520 legacy=0x7f662006f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.323 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.338+0000 7f6624e02700 1 -- 172.21.15.42:0/2066399252 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333491585 0 0) 0x7f66200c7cf0 con 0x7f662006e520 2023-07-29T02:06:23.323 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.338+0000 7f6625e04700 1 -- 172.21.15.42:0/2066399252 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66200c82b0 con 0x7f662015c070 2023-07-29T02:06:23.323 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.338+0000 7f6625e04700 1 --2- 172.21.15.42:0/2066399252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f662015c070 0x7f6620159c10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6610009840 tx=0x7f6610009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac70ca019023234 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:23.323 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.338+0000 7f6624e02700 1 -- 172.21.15.42:0/2066399252 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6610011830 con 0x7f662015c070 2023-07-29T02:06:23.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.338+0000 7f6624e02700 1 -- 172.21.15.42:0/2066399252 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6610011990 con 0x7f662015c070 2023-07-29T02:06:23.324 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.338+0000 7f6624e02700 1 -- 172.21.15.42:0/2066399252 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6610011d20 con 0x7f662015c070 2023-07-29T02:06:23.327 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.339+0000 7f6628068700 1 -- 172.21.15.42:0/2066399252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f662015c070 msgr2=0x7f6620159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.327 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.339+0000 7f6628068700 1 --2- 172.21.15.42:0/2066399252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f662015c070 0x7f6620159c10 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6610009840 tx=0x7f6610009b50 comp rx=0 tx=0).stop 2023-07-29T02:06:23.327 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.339+0000 7f6628068700 1 -- 172.21.15.42:0/2066399252 shutdown_connections 2023-07-29T02:06:23.327 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.339+0000 7f6628068700 1 --2- 172.21.15.42:0/2066399252 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f662015c070 0x7f6620159c10 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.328 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.339+0000 7f6628068700 1 -- 172.21.15.42:0/2066399252 >> 172.21.15.42:0/2066399252 conn(0x7f662006ab40 msgr2=0x7f6620072390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:23.328 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.339+0000 7f6628068700 1 -- 172.21.15.42:0/2066399252 shutdown_connections 2023-07-29T02:06:23.328 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.339+0000 7f6628068700 1 -- 172.21.15.42:0/2066399252 wait complete. 2023-07-29T02:06:23.328 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.341+0000 7f6628068700 1 Processor -- start 2023-07-29T02:06:23.329 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.341+0000 7f6628068700 1 -- start start 2023-07-29T02:06:23.329 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.341+0000 7f6628068700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6620061190 0x7f66200c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.329 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.341+0000 7f6628068700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f662006e520 0x7f66200c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.329 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.341+0000 7f6628068700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f662015c070 0x7f6620151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.329 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.341+0000 7f6628068700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66200c91e0 con 0x7f662015c070 2023-07-29T02:06:23.329 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.341+0000 7f6628068700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66200c6a80 con 0x7f6620061190 2023-07-29T02:06:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.341+0000 7f6628068700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662015aab0 con 0x7f662006e520 2023-07-29T02:06:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.342+0000 7f6626605700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f662015c070 0x7f6620151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.342+0000 7f6626605700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f662015c070 0x7f6620151d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58410/0 (socket says 172.21.15.42:58410) 2023-07-29T02:06:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.342+0000 7f6626605700 1 -- 172.21.15.42:0/2270757211 learned_addr learned my addr 172.21.15.42:0/2270757211 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:23.330 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.342+0000 7f6625603700 1 --2- 172.21.15.42:0/2270757211 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f662006e520 0x7f66200c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.342+0000 7f6625e04700 1 --2- 172.21.15.42:0/2270757211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6620061190 0x7f66200c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.342+0000 7f6626605700 1 -- 172.21.15.42:0/2270757211 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f662006e520 msgr2=0x7f66200c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.342+0000 7f6626605700 1 --2- 172.21.15.42:0/2270757211 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f662006e520 0x7f66200c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.342+0000 7f6626605700 1 -- 172.21.15.42:0/2270757211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6620061190 msgr2=0x7f66200c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.331 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.342+0000 7f6626605700 1 --2- 172.21.15.42:0/2270757211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6620061190 0x7f66200c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.332 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.342+0000 7f6626605700 1 -- 172.21.15.42:0/2270757211 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66100094a0 con 0x7f662015c070 2023-07-29T02:06:23.332 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.342+0000 7f6625e04700 1 --2- 172.21.15.42:0/2270757211 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6620061190 0x7f66200c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:06:23.332 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.342+0000 7f6626605700 1 --2- 172.21.15.42:0/2270757211 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f662015c070 0x7f6620151d20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f661800cc50 tx=0x7f661800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:23.332 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.342+0000 7f66167fc700 1 -- 172.21.15.42:0/2270757211 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661800ad80 con 0x7f662015c070 2023-07-29T02:06:23.332 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.342+0000 7f66167fc700 1 -- 172.21.15.42:0/2270757211 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661800ce50 con 0x7f662015c070 2023-07-29T02:06:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.342+0000 7f6628068700 1 -- 172.21.15.42:0/2270757211 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66201f2020 con 0x7f662015c070 2023-07-29T02:06:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.342+0000 7f66167fc700 1 -- 172.21.15.42:0/2270757211 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6618003c40 con 0x7f662015c070 2023-07-29T02:06:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.342+0000 7f6628068700 1 -- 172.21.15.42:0/2270757211 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66201f2300 con 0x7f662015c070 2023-07-29T02:06:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.343+0000 7f6628068700 1 -- 172.21.15.42:0/2270757211 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f66201596f0 con 0x7f662015c070 2023-07-29T02:06:23.333 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.344+0000 7f66167fc700 1 -- 172.21.15.42:0/2270757211 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f66180050d0 con 0x7f662015c070 2023-07-29T02:06:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.344+0000 7f66167fc700 1 --2- 172.21.15.42:0/2270757211 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f660406a660 0x7f660406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.344+0000 7f66167fc700 1 -- 172.21.15.42:0/2270757211 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f6618089950 con 0x7f662015c070 2023-07-29T02:06:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.344+0000 7f66167fc700 1 --2- 172.21.15.42:0/2270757211 >> [v2:172.21.15.42:6824/131326,v1:172.21.15.42:6825/131326] conn(0x7f66040744f0 0x7f6604076940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.344+0000 7f6625e04700 1 --2- 172.21.15.42:0/2270757211 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f660406a660 0x7f660406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.334 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.344+0000 7f66167fc700 1 -- 172.21.15.42:0/2270757211 --> [v2:172.21.15.42:6824/131326,v1:172.21.15.42:6825/131326] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6604077010 con 0x7f66040744f0 2023-07-29T02:06:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.344+0000 7f66167fc700 1 -- 172.21.15.42:0/2270757211 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6618089da0 con 0x7f662015c070 2023-07-29T02:06:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.345+0000 7f6625603700 1 --2- 172.21.15.42:0/2270757211 >> [v2:172.21.15.42:6824/131326,v1:172.21.15.42:6825/131326] conn(0x7f66040744f0 0x7f6604076940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.345+0000 7f6625603700 1 --2- 172.21.15.42:0/2270757211 >> [v2:172.21.15.42:6824/131326,v1:172.21.15.42:6825/131326] conn(0x7f66040744f0 0x7f6604076940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.345+0000 7f6625e04700 1 --2- 172.21.15.42:0/2270757211 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f660406a660 0x7f660406cb10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6610000c00 tx=0x7f661001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:23.335 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.346+0000 7f66167fc700 1 -- 172.21.15.42:0/2270757211 <== osd.3 v2:172.21.15.42:6824/131326 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6604077010 con 0x7f66040744f0 2023-07-29T02:06:23.341 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.360+0000 7f6628068700 1 -- 172.21.15.42:0/2270757211 --> [v2:172.21.15.42:6824/131326,v1:172.21.15.42:6825/131326] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6620159410 con 0x7f66040744f0 2023-07-29T02:06:23.341 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.360+0000 7f66167fc700 1 -- 172.21.15.42:0/2270757211 <== osd.3 v2:172.21.15.42:6824/131326 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f661c005aa0 con 0x7f66040744f0 2023-07-29T02:06:23.342 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2023-07-29T02:06:23.342 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-29T02:06:23.342 INFO:teuthology.orchestra.run.smithi042.stdout:} 2023-07-29T02:06:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.360+0000 7f6628068700 1 -- 172.21.15.42:0/2270757211 >> [v2:172.21.15.42:6824/131326,v1:172.21.15.42:6825/131326] conn(0x7f66040744f0 msgr2=0x7f6604076940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.343 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.360+0000 7f6628068700 1 --2- 172.21.15.42:0/2270757211 >> [v2:172.21.15.42:6824/131326,v1:172.21.15.42:6825/131326] conn(0x7f66040744f0 0x7f6604076940 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.361+0000 7f6628068700 1 -- 172.21.15.42:0/2270757211 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f660406a660 msgr2=0x7f660406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.361+0000 7f6628068700 1 --2- 172.21.15.42:0/2270757211 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f660406a660 0x7f660406cb10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6610000c00 tx=0x7f661001c040 comp rx=0 tx=0).stop 2023-07-29T02:06:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.361+0000 7f6628068700 1 -- 172.21.15.42:0/2270757211 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f662015c070 msgr2=0x7f6620151d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.361+0000 7f6628068700 1 --2- 172.21.15.42:0/2270757211 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f662015c070 0x7f6620151d20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f661800cc50 tx=0x7f661800a340 comp rx=0 tx=0).stop 2023-07-29T02:06:23.344 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.361+0000 7f6626605700 1 -- 172.21.15.42:0/2270757211 reap_dead start 2023-07-29T02:06:23.345 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.361+0000 7f6628068700 1 -- 172.21.15.42:0/2270757211 shutdown_connections 2023-07-29T02:06:23.345 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.361+0000 7f6628068700 1 -- 172.21.15.42:0/2270757211 >> 172.21.15.42:0/2270757211 conn(0x7f662006ab40 msgr2=0x7f66200cb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:23.345 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.361+0000 7f6628068700 1 -- 172.21.15.42:0/2270757211 shutdown_connections 2023-07-29T02:06:23.345 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.361+0000 7f6628068700 1 -- 172.21.15.42:0/2270757211 wait complete. 2023-07-29T02:06:23.354 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-07-29T02:06:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.498+0000 7f2efc146700 1 Processor -- start 2023-07-29T02:06:23.480 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.499+0000 7f2efc146700 1 -- start start 2023-07-29T02:06:23.481 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.499+0000 7f2efc146700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2ef413ed20 0x7f2ef4156650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.499+0000 7f2efc146700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ef4071120 0x7f2ef40c6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.499+0000 7f2efc146700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef4071d10 con 0x7f2ef40c6ec0 2023-07-29T02:06:23.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.499+0000 7f2efc146700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef4072dc0 con 0x7f2ef413ed20 2023-07-29T02:06:23.482 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.499+0000 7f2efc146700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef40c83c0 con 0x7f2ef4071120 2023-07-29T02:06:23.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.500+0000 7f2ef96e1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ef4071120 0x7f2ef40c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.500+0000 7f2ef96e1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ef4071120 0x7f2ef40c6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:58930/0 (socket says 172.21.15.42:58930) 2023-07-29T02:06:23.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.500+0000 7f2ef9ee2700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2ef413ed20 0x7f2ef4156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.500+0000 7f2ef96e1700 1 -- 172.21.15.42:0/905132218 learned_addr learned my addr 172.21.15.42:0/905132218 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:23.483 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.500+0000 7f2ef96e1700 1 -- 172.21.15.42:0/905132218 >> v2:172.21.15.144:3300/0 conn(0x7f2ef413ed20 msgr2=0x7f2ef4156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.500+0000 7f2ef96e1700 1 --2- 172.21.15.42:0/905132218 >> v2:172.21.15.144:3300/0 conn(0x7f2ef413ed20 0x7f2ef4156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.500+0000 7f2ef96e1700 1 -- 172.21.15.42:0/905132218 >> v1:172.21.15.144:6789/0 conn(0x7f2ef40c6ec0 legacy=0x7f2ef41574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.500+0000 7f2ef96e1700 1 -- 172.21.15.42:0/905132218 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef4156b90 con 0x7f2ef4071120 2023-07-29T02:06:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.500+0000 7f2ef96e1700 1 --2- 172.21.15.42:0/905132218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ef4071120 0x7f2ef40c6980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000bb90 tx=0x7f2ef000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20e1f807a33e2db2 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:23.484 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.500+0000 7f2ef8ee0700 1 -- 172.21.15.42:0/905132218 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef000dd30 con 0x7f2ef4071120 2023-07-29T02:06:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.500+0000 7f2ef8ee0700 1 -- 172.21.15.42:0/905132218 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef000de90 con 0x7f2ef4071120 2023-07-29T02:06:23.485 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.500+0000 7f2ef8ee0700 1 -- 172.21.15.42:0/905132218 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0010690 con 0x7f2ef4071120 2023-07-29T02:06:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.501+0000 7f2efc146700 1 -- 172.21.15.42:0/905132218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ef4071120 msgr2=0x7f2ef40c6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.501+0000 7f2efc146700 1 --2- 172.21.15.42:0/905132218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ef4071120 0x7f2ef40c6980 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000bb90 tx=0x7f2ef000bea0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.487 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.501+0000 7f2efc146700 1 -- 172.21.15.42:0/905132218 shutdown_connections 2023-07-29T02:06:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.501+0000 7f2efc146700 1 --2- 172.21.15.42:0/905132218 >> v2:172.21.15.144:3300/0 conn(0x7f2ef413ed20 0x7f2ef4156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.501+0000 7f2efc146700 1 --2- 172.21.15.42:0/905132218 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ef4071120 0x7f2ef40c6980 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.501+0000 7f2efc146700 1 -- 172.21.15.42:0/905132218 >> 172.21.15.42:0/905132218 conn(0x7f2ef40ccc50 msgr2=0x7f2ef406ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.501+0000 7f2efc146700 1 -- 172.21.15.42:0/905132218 shutdown_connections 2023-07-29T02:06:23.488 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.501+0000 7f2efc146700 1 -- 172.21.15.42:0/905132218 wait complete. 2023-07-29T02:06:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.502+0000 7f2efc146700 1 Processor -- start 2023-07-29T02:06:23.489 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.502+0000 7f2efc146700 1 -- start start 2023-07-29T02:06:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.503+0000 7f2efc146700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ef4071120 0x7f2ef41ee610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.503+0000 7f2efc146700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ef40c6ec0 0x7f2ef413d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.490 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.503+0000 7f2efc146700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ef413ed20 0x7f2ef4150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.503+0000 7f2efc146700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef41eeb50 con 0x7f2ef40c6ec0 2023-07-29T02:06:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.503+0000 7f2efc146700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef4150a00 con 0x7f2ef4071120 2023-07-29T02:06:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.503+0000 7f2efc146700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef41e1a60 con 0x7f2ef413ed20 2023-07-29T02:06:23.491 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.503+0000 7f2ef96e1700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ef40c6ec0 0x7f2ef413d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.492 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.503+0000 7f2ef96e1700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ef40c6ec0 0x7f2ef413d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58424/0 (socket says 172.21.15.42:58424) 2023-07-29T02:06:23.492 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.503+0000 7f2ef96e1700 1 -- 172.21.15.42:0/1358327524 learned_addr learned my addr 172.21.15.42:0/1358327524 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:23.493 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.503+0000 7f2efa6e3700 1 --2- 172.21.15.42:0/1358327524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ef413ed20 0x7f2ef4150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.493 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.503+0000 7f2ef9ee2700 1 --2- 172.21.15.42:0/1358327524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ef4071120 0x7f2ef41ee610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.493 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.503+0000 7f2ef96e1700 1 -- 172.21.15.42:0/1358327524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ef413ed20 msgr2=0x7f2ef4150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.493 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.503+0000 7f2ef96e1700 1 --2- 172.21.15.42:0/1358327524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ef413ed20 0x7f2ef4150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.493 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.503+0000 7f2ef96e1700 1 -- 172.21.15.42:0/1358327524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ef4071120 msgr2=0x7f2ef41ee610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.494 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.503+0000 7f2ef96e1700 1 --2- 172.21.15.42:0/1358327524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ef4071120 0x7f2ef41ee610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.494 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.503+0000 7f2ef96e1700 1 -- 172.21.15.42:0/1358327524 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef000b7f0 con 0x7f2ef40c6ec0 2023-07-29T02:06:23.494 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.504+0000 7f2ef96e1700 1 --2- 172.21.15.42:0/1358327524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ef40c6ec0 0x7f2ef413d800 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000d5d0 tx=0x7f2ef0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:23.494 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.504+0000 7f2eea7fc700 1 -- 172.21.15.42:0/1358327524 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef001f070 con 0x7f2ef40c6ec0 2023-07-29T02:06:23.494 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.504+0000 7f2eea7fc700 1 -- 172.21.15.42:0/1358327524 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef0003970 con 0x7f2ef40c6ec0 2023-07-29T02:06:23.495 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.504+0000 7f2eea7fc700 1 -- 172.21.15.42:0/1358327524 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0003d20 con 0x7f2ef40c6ec0 2023-07-29T02:06:23.495 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.504+0000 7f2efc146700 1 -- 172.21.15.42:0/1358327524 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef41e1d40 con 0x7f2ef40c6ec0 2023-07-29T02:06:23.495 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.504+0000 7f2efc146700 1 -- 172.21.15.42:0/1358327524 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef41533a0 con 0x7f2ef40c6ec0 2023-07-29T02:06:23.495 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.505+0000 7f2efc146700 1 -- 172.21.15.42:0/1358327524 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef404ea50 con 0x7f2ef40c6ec0 2023-07-29T02:06:23.495 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.505+0000 7f2eea7fc700 1 -- 172.21.15.42:0/1358327524 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f2ef0019400 con 0x7f2ef40c6ec0 2023-07-29T02:06:23.496 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.506+0000 7f2eea7fc700 1 --2- 172.21.15.42:0/1358327524 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2ed806a690 0x7f2ed806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.496 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.506+0000 7f2eea7fc700 1 -- 172.21.15.42:0/1358327524 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f2ef008c140 con 0x7f2ef40c6ec0 2023-07-29T02:06:23.496 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.506+0000 7f2ef9ee2700 1 --2- 172.21.15.42:0/1358327524 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2ed806a690 0x7f2ed806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.496 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.506+0000 7f2ef9ee2700 1 --2- 172.21.15.42:0/1358327524 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2ed806a690 0x7f2ed806cb40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009b40 tx=0x7f2ee4009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:23.497 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.510+0000 7f2eea7fc700 1 -- 172.21.15.42:0/1358327524 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f2ef00571b0 con 0x7f2ef40c6ec0 2023-07-29T02:06:23.689 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.708+0000 7f2efc146700 1 -- 172.21.15.42:0/1358327524 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ef4072240 con 0x7f2ed806a690 2023-07-29T02:06:23.690 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.709+0000 7f2eea7fc700 1 -- 172.21.15.42:0/1358327524 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2ee4004020 con 0x7f2ed806a690 2023-07-29T02:06:23.693 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.711+0000 7f2efc146700 1 -- 172.21.15.42:0/1358327524 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2ed806a690 msgr2=0x7f2ed806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.694 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.711+0000 7f2efc146700 1 --2- 172.21.15.42:0/1358327524 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2ed806a690 0x7f2ed806cb40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009b40 tx=0x7f2ee4009210 comp rx=0 tx=0).stop 2023-07-29T02:06:23.694 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.711+0000 7f2efc146700 1 -- 172.21.15.42:0/1358327524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ef40c6ec0 msgr2=0x7f2ef413d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.694 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.711+0000 7f2efc146700 1 --2- 172.21.15.42:0/1358327524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ef40c6ec0 0x7f2ef413d800 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000d5d0 tx=0x7f2ef0004750 comp rx=0 tx=0).stop 2023-07-29T02:06:23.695 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.711+0000 7f2efc146700 1 -- 172.21.15.42:0/1358327524 shutdown_connections 2023-07-29T02:06:23.695 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.711+0000 7f2efc146700 1 --2- 172.21.15.42:0/1358327524 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2ed806a690 0x7f2ed806cb40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.696 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.711+0000 7f2efc146700 1 --2- 172.21.15.42:0/1358327524 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2ef413ed20 0x7f2ef4150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.696 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.711+0000 7f2efc146700 1 --2- 172.21.15.42:0/1358327524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2ef4071120 0x7f2ef41ee610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.696 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.711+0000 7f2efc146700 1 --2- 172.21.15.42:0/1358327524 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2ef40c6ec0 0x7f2ef413d800 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.697 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.711+0000 7f2efc146700 1 -- 172.21.15.42:0/1358327524 >> 172.21.15.42:0/1358327524 conn(0x7f2ef40ccc50 msgr2=0x7f2ef40c73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:23.697 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.711+0000 7f2efc146700 1 -- 172.21.15.42:0/1358327524 shutdown_connections 2023-07-29T02:06:23.698 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.711+0000 7f2efc146700 1 -- 172.21.15.42:0/1358327524 wait complete. 2023-07-29T02:06:23.698 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 3 to deep-scrub 2023-07-29T02:06:23.705 INFO:tasks.ceph:Scrubbing osd.4 2023-07-29T02:06:23.705 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-07-29T02:06:23.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.854+0000 7f535227b700 1 Processor -- start 2023-07-29T02:06:23.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.854+0000 7f535227b700 1 -- start start 2023-07-29T02:06:23.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.855+0000 7f535227b700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f534c1534d0 0x7f534c072930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.855+0000 7f535227b700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534c15d190 con 0x7f534c0c8390 2023-07-29T02:06:23.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.855+0000 7f535227b700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534c1538a0 con 0x7f534c06ce60 2023-07-29T02:06:23.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.855+0000 7f535227b700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534c15d6c0 con 0x7f534c1534d0 2023-07-29T02:06:23.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.855+0000 7f534b7fe700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f534c0c8390 0x7f534c0c71c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52236/0 (socket says 172.21.15.42:52236) 2023-07-29T02:06:23.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.855+0000 7f534b7fe700 1 -- 172.21.15.42:0/3988606692 learned_addr learned my addr 172.21.15.42:0/3988606692 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:06:23.839 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.855+0000 7f534bfff700 1 --2- 172.21.15.42:0/3988606692 >> v2:172.21.15.144:3300/0 conn(0x7f534c1534d0 0x7f534c072930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.855+0000 7f534affd700 1 -- 172.21.15.42:0/3988606692 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815484053 0 0) 0x7f534c15d190 con 0x7f534c0c8390 2023-07-29T02:06:23.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.855+0000 7f534affd700 1 -- 172.21.15.42:0/3988606692 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53340035b0 con 0x7f534c0c8390 2023-07-29T02:06:23.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.855+0000 7f534affd700 1 -- 172.21.15.42:0/3988606692 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3695327765 0 0) 0x7f53340035b0 con 0x7f534c0c8390 2023-07-29T02:06:23.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534affd700 1 -- 172.21.15.42:0/3988606692 >> v2:172.21.15.144:3300/0 conn(0x7f534c1534d0 msgr2=0x7f534c072930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:23.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534affd700 1 --2- 172.21.15.42:0/3988606692 >> v2:172.21.15.144:3300/0 conn(0x7f534c1534d0 0x7f534c072930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534affd700 1 -- 172.21.15.42:0/3988606692 >> v1:172.21.15.144:6789/0 conn(0x7f534c06ce60 legacy=0x7f534c06d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534affd700 1 -- 172.21.15.42:0/3988606692 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c15a0f0 con 0x7f534c0c8390 2023-07-29T02:06:23.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534affd700 1 -- 172.21.15.42:0/3988606692 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7f533c001670 con 0x7f534c0c8390 2023-07-29T02:06:23.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534affd700 1 -- 172.21.15.42:0/3988606692 >> v1:172.21.15.42:6789/0 conn(0x7f534c0c8390 legacy=0x7f534c0c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534affd700 1 --2- 172.21.15.42:0/3988606692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5334003a00 0x7f5334003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534affd700 1 --2- 172.21.15.42:0/3988606692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5334004850 0x7f5334004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534affd700 1 --2- 172.21.15.42:0/3988606692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5334005200 0x7f533400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534affd700 1 -- 172.21.15.42:0/3988606692 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c15d6c0 con 0x7f5334004850 2023-07-29T02:06:23.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534affd700 1 -- 172.21.15.42:0/3988606692 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533400c060 con 0x7f5334005200 2023-07-29T02:06:23.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534affd700 1 -- 172.21.15.42:0/3988606692 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533400c220 con 0x7f5334003a00 2023-07-29T02:06:23.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534b7fe700 1 --2- 172.21.15.42:0/3988606692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5334004850 0x7f5334004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534bfff700 1 --2- 172.21.15.42:0/3988606692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5334003a00 0x7f5334003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f5350818700 1 --2- 172.21.15.42:0/3988606692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5334005200 0x7f533400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534b7fe700 1 -- 172.21.15.42:0/3988606692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5334003a00 msgr2=0x7f5334003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:23.843 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534b7fe700 1 --2- 172.21.15.42:0/3988606692 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5334003a00 0x7f5334003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534b7fe700 1 -- 172.21.15.42:0/3988606692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5334005200 msgr2=0x7f533400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:23.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534b7fe700 1 --2- 172.21.15.42:0/3988606692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5334005200 0x7f533400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f5350818700 1 -- 172.21.15.42:0/3988606692 reap_dead start 2023-07-29T02:06:23.844 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534b7fe700 1 -- 172.21.15.42:0/3988606692 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53340035b0 con 0x7f5334004850 2023-07-29T02:06:23.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534b7fe700 1 --2- 172.21.15.42:0/3988606692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5334004850 0x7f5334004cc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f533c00c240 tx=0x7f5334005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e39b537046a4a06 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:23.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534affd700 1 -- 172.21.15.42:0/3988606692 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c007c10 con 0x7f5334004850 2023-07-29T02:06:23.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534affd700 1 -- 172.21.15.42:0/3988606692 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c00cde0 con 0x7f5334004850 2023-07-29T02:06:23.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.856+0000 7f534affd700 1 -- 172.21.15.42:0/3988606692 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c005ba0 con 0x7f5334004850 2023-07-29T02:06:23.845 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.857+0000 7f535227b700 1 -- 172.21.15.42:0/3988606692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5334004850 msgr2=0x7f5334004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.857+0000 7f535227b700 1 --2- 172.21.15.42:0/3988606692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5334004850 0x7f5334004cc0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f533c00c240 tx=0x7f5334005880 comp rx=0 tx=0).stop 2023-07-29T02:06:23.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.857+0000 7f535227b700 1 -- 172.21.15.42:0/3988606692 shutdown_connections 2023-07-29T02:06:23.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.857+0000 7f535227b700 1 --2- 172.21.15.42:0/3988606692 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5334004850 0x7f5334004cc0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.857+0000 7f535227b700 1 -- 172.21.15.42:0/3988606692 >> 172.21.15.42:0/3988606692 conn(0x7f534c0c8980 msgr2=0x7f534c0c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:23.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.857+0000 7f535227b700 1 -- 172.21.15.42:0/3988606692 shutdown_connections 2023-07-29T02:06:23.846 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.857+0000 7f535227b700 1 -- 172.21.15.42:0/3988606692 wait complete. 2023-07-29T02:06:23.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.859+0000 7f535227b700 1 Processor -- start 2023-07-29T02:06:23.849 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.859+0000 7f535227b700 1 -- start start 2023-07-29T02:06:23.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f535227b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5334004850 0x7f534c1ef780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f535227b700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f534c1576d0 0x7f534c0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f535227b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f534c158db0 0x7f534c148620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f535227b700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c1ef360 con 0x7f5334004850 2023-07-29T02:06:23.850 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f535227b700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c1584f0 con 0x7f534c1576d0 2023-07-29T02:06:23.851 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f535227b700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c1eefc0 con 0x7f534c158db0 2023-07-29T02:06:23.851 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f534bfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5334004850 0x7f534c1ef780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.851 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f534bfff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5334004850 0x7f534c1ef780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58442/0 (socket says 172.21.15.42:58442) 2023-07-29T02:06:23.851 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f534bfff700 1 -- 172.21.15.42:0/3330020853 learned_addr learned my addr 172.21.15.42:0/3330020853 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:23.851 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f534b7fe700 1 --2- 172.21.15.42:0/3330020853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f534c1576d0 0x7f534c0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.852 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f5350818700 1 --2- 172.21.15.42:0/3330020853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f534c158db0 0x7f534c148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.852 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f534bfff700 1 -- 172.21.15.42:0/3330020853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f534c158db0 msgr2=0x7f534c148620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.852 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f534bfff700 1 --2- 172.21.15.42:0/3330020853 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f534c158db0 0x7f534c148620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.852 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f534bfff700 1 -- 172.21.15.42:0/3330020853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f534c1576d0 msgr2=0x7f534c0cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.852 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f534bfff700 1 --2- 172.21.15.42:0/3330020853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f534c1576d0 0x7f534c0cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f534bfff700 1 -- 172.21.15.42:0/3330020853 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c157f30 con 0x7f5334004850 2023-07-29T02:06:23.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f534bfff700 1 --2- 172.21.15.42:0/3330020853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5334004850 0x7f534c1ef780 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5340011aa0 tx=0x7f5340011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:23.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f5348ff9700 1 -- 172.21.15.42:0/3330020853 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534000f940 con 0x7f5334004850 2023-07-29T02:06:23.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f5348ff9700 1 -- 172.21.15.42:0/3330020853 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534000faa0 con 0x7f5334004850 2023-07-29T02:06:23.853 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f535227b700 1 -- 172.21.15.42:0/3330020853 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534c158210 con 0x7f5334004850 2023-07-29T02:06:23.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f5348ff9700 1 -- 172.21.15.42:0/3330020853 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534000fe50 con 0x7f5334004850 2023-07-29T02:06:23.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.860+0000 7f535227b700 1 -- 172.21.15.42:0/3330020853 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534c158ab0 con 0x7f5334004850 2023-07-29T02:06:23.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.861+0000 7f535227b700 1 -- 172.21.15.42:0/3330020853 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f534c159330 con 0x7f5334004850 2023-07-29T02:06:23.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.862+0000 7f5348ff9700 1 -- 172.21.15.42:0/3330020853 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f5340014440 con 0x7f5334004850 2023-07-29T02:06:23.854 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.862+0000 7f5348ff9700 1 --2- 172.21.15.42:0/3330020853 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f533806a690 0x7f533806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.862+0000 7f5348ff9700 1 -- 172.21.15.42:0/3330020853 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f5340089540 con 0x7f5334004850 2023-07-29T02:06:23.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.862+0000 7f5348ff9700 1 --2- 172.21.15.42:0/3330020853 >> [v2:172.21.15.144:6800/131482,v1:172.21.15.144:6801/131482] conn(0x7f5338074520 0x7f5338076970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:23.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.862+0000 7f5348ff9700 1 -- 172.21.15.42:0/3330020853 --> [v2:172.21.15.144:6800/131482,v1:172.21.15.144:6801/131482] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5338077040 con 0x7f5338074520 2023-07-29T02:06:23.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.863+0000 7f5348ff9700 1 -- 172.21.15.42:0/3330020853 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f534008bc00 con 0x7f5334004850 2023-07-29T02:06:23.855 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.863+0000 7f534b7fe700 1 --2- 172.21.15.42:0/3330020853 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f533806a690 0x7f533806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.863+0000 7f5350818700 1 --2- 172.21.15.42:0/3330020853 >> [v2:172.21.15.144:6800/131482,v1:172.21.15.144:6801/131482] conn(0x7f5338074520 0x7f5338076970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:23.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.863+0000 7f534b7fe700 1 --2- 172.21.15.42:0/3330020853 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f533806a690 0x7f533806cb40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f533c001930 tx=0x7f533c007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:23.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.863+0000 7f5350818700 1 --2- 172.21.15.42:0/3330020853 >> [v2:172.21.15.144:6800/131482,v1:172.21.15.144:6801/131482] conn(0x7f5338074520 0x7f5338076970 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:23.856 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.864+0000 7f5348ff9700 1 -- 172.21.15.42:0/3330020853 <== osd.4 v2:172.21.15.144:6800/131482 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5338077040 con 0x7f5338074520 2023-07-29T02:06:23.859 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.878+0000 7f535227b700 1 -- 172.21.15.42:0/3330020853 --> [v2:172.21.15.144:6800/131482,v1:172.21.15.144:6801/131482] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f534c15d3e0 con 0x7f5338074520 2023-07-29T02:06:23.860 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.879+0000 7f5348ff9700 1 -- 172.21.15.42:0/3330020853 <== osd.4 v2:172.21.15.144:6800/131482 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5344002070 con 0x7f5338074520 2023-07-29T02:06:23.860 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2023-07-29T02:06:23.861 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-29T02:06:23.861 INFO:teuthology.orchestra.run.smithi042.stdout:} 2023-07-29T02:06:23.862 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.879+0000 7f535227b700 1 -- 172.21.15.42:0/3330020853 >> [v2:172.21.15.144:6800/131482,v1:172.21.15.144:6801/131482] conn(0x7f5338074520 msgr2=0x7f5338076970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.862 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.879+0000 7f535227b700 1 --2- 172.21.15.42:0/3330020853 >> [v2:172.21.15.144:6800/131482,v1:172.21.15.144:6801/131482] conn(0x7f5338074520 0x7f5338076970 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.862 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.879+0000 7f535227b700 1 -- 172.21.15.42:0/3330020853 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f533806a690 msgr2=0x7f533806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.862 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.879+0000 7f535227b700 1 --2- 172.21.15.42:0/3330020853 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f533806a690 0x7f533806cb40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f533c001930 tx=0x7f533c007000 comp rx=0 tx=0).stop 2023-07-29T02:06:23.863 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.879+0000 7f535227b700 1 -- 172.21.15.42:0/3330020853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5334004850 msgr2=0x7f534c1ef780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:23.863 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.879+0000 7f535227b700 1 --2- 172.21.15.42:0/3330020853 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5334004850 0x7f534c1ef780 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5340011aa0 tx=0x7f5340011db0 comp rx=0 tx=0).stop 2023-07-29T02:06:23.863 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.879+0000 7f5350818700 1 -- 172.21.15.42:0/3330020853 reap_dead start 2023-07-29T02:06:23.863 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.879+0000 7f535227b700 1 -- 172.21.15.42:0/3330020853 shutdown_connections 2023-07-29T02:06:23.863 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.879+0000 7f535227b700 1 -- 172.21.15.42:0/3330020853 >> 172.21.15.42:0/3330020853 conn(0x7f534c0c8980 msgr2=0x7f534c071090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:23.864 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.879+0000 7f535227b700 1 -- 172.21.15.42:0/3330020853 shutdown_connections 2023-07-29T02:06:23.864 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:23.879+0000 7f535227b700 1 -- 172.21.15.42:0/3330020853 wait complete. 2023-07-29T02:06:23.872 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-07-29T02:06:23.998 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.017+0000 7efc0140f700 1 Processor -- start 2023-07-29T02:06:23.998 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.017+0000 7efc0140f700 1 -- start start 2023-07-29T02:06:24.000 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.018+0000 7efc0140f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7efbfc0b4250 0x7efbfc06b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.018+0000 7efc0140f700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efbfc159d30 0x7efbfc15c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.018+0000 7efc0140f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbfc1598a0 con 0x7efbfc0c6190 2023-07-29T02:06:24.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.018+0000 7efc0140f700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbfc06c680 con 0x7efbfc159d30 2023-07-29T02:06:24.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.018+0000 7efc0140f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbfc153850 con 0x7efbfc0b4250 2023-07-29T02:06:24.001 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.018+0000 7efbfb7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efbfc159d30 0x7efbfc15c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.018+0000 7efbfb7fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7efbfc159d30 0x7efbfc15c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58456/0 (socket says 172.21.15.42:58456) 2023-07-29T02:06:24.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.018+0000 7efbfb7fe700 1 -- 172.21.15.42:0/2889540827 learned_addr learned my addr 172.21.15.42:0/2889540827 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:24.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.018+0000 7efbfaffd700 1 --2- 172.21.15.42:0/2889540827 >> v2:172.21.15.144:3300/0 conn(0x7efbfc0b4250 0x7efbfc06b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.002 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.018+0000 7efbfb7fe700 1 -- 172.21.15.42:0/2889540827 >> v2:172.21.15.144:3300/0 conn(0x7efbfc0b4250 msgr2=0x7efbfc06b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:24.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.018+0000 7efbfb7fe700 1 --2- 172.21.15.42:0/2889540827 >> v2:172.21.15.144:3300/0 conn(0x7efbfc0b4250 0x7efbfc06b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.018+0000 7efbfb7fe700 1 -- 172.21.15.42:0/2889540827 >> v1:172.21.15.144:6789/0 conn(0x7efbfc0c6190 legacy=0x7efbfc0c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.018+0000 7efbfb7fe700 1 -- 172.21.15.42:0/2889540827 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbfc15cb50 con 0x7efbfc159d30 2023-07-29T02:06:24.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.018+0000 7efbfb7fe700 1 --2- 172.21.15.42:0/2889540827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efbfc159d30 0x7efbfc15c610 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7efbfc072f50 tx=0x7efbf400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ee2d3dfa0388d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:24.003 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.018+0000 7efbf9ffb700 1 -- 172.21.15.42:0/2889540827 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf400e070 con 0x7efbfc159d30 2023-07-29T02:06:24.004 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.018+0000 7efbf9ffb700 1 -- 172.21.15.42:0/2889540827 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf400b8d0 con 0x7efbfc159d30 2023-07-29T02:06:24.004 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.018+0000 7efbf9ffb700 1 -- 172.21.15.42:0/2889540827 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf400bc80 con 0x7efbfc159d30 2023-07-29T02:06:24.004 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.019+0000 7efc0140f700 1 -- 172.21.15.42:0/2889540827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efbfc159d30 msgr2=0x7efbfc15c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.004 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.019+0000 7efc0140f700 1 --2- 172.21.15.42:0/2889540827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efbfc159d30 0x7efbfc15c610 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7efbfc072f50 tx=0x7efbf400b330 comp rx=0 tx=0).stop 2023-07-29T02:06:24.004 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.019+0000 7efc0140f700 1 -- 172.21.15.42:0/2889540827 shutdown_connections 2023-07-29T02:06:24.005 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.019+0000 7efc0140f700 1 --2- 172.21.15.42:0/2889540827 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efbfc159d30 0x7efbfc15c610 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.005 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.019+0000 7efc0140f700 1 --2- 172.21.15.42:0/2889540827 >> v2:172.21.15.144:3300/0 conn(0x7efbfc0b4250 0x7efbfc06b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.005 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.019+0000 7efc0140f700 1 -- 172.21.15.42:0/2889540827 >> 172.21.15.42:0/2889540827 conn(0x7efbfc06ca30 msgr2=0x7efbfc06ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:24.005 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.019+0000 7efc0140f700 1 -- 172.21.15.42:0/2889540827 shutdown_connections 2023-07-29T02:06:24.005 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.019+0000 7efc0140f700 1 -- 172.21.15.42:0/2889540827 wait complete. 2023-07-29T02:06:24.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.020+0000 7efc0140f700 1 Processor -- start 2023-07-29T02:06:24.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.020+0000 7efc0140f700 1 -- start start 2023-07-29T02:06:24.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.021+0000 7efc0140f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbfc0b4250 0x7efbfc150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.021+0000 7efc0140f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efbfc0c6190 0x7efbfc0c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.021+0000 7efc0140f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efbfc159d30 0x7efbfc150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.021+0000 7efc0140f700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc0c85e0 con 0x7efbfc0c6190 2023-07-29T02:06:24.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.021+0000 7efc0140f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc1f1f30 con 0x7efbfc0b4250 2023-07-29T02:06:24.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.021+0000 7efc0140f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc1562b0 con 0x7efbfc159d30 2023-07-29T02:06:24.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.021+0000 7efbfa7fc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efbfc0c6190 0x7efbfc0c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.021+0000 7efbfa7fc700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efbfc0c6190 0x7efbfc0c80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58460/0 (socket says 172.21.15.42:58460) 2023-07-29T02:06:24.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.021+0000 7efbfa7fc700 1 -- 172.21.15.42:0/2822269838 learned_addr learned my addr 172.21.15.42:0/2822269838 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:24.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.021+0000 7efbfaffd700 1 --2- 172.21.15.42:0/2822269838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbfc0b4250 0x7efbfc150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.021+0000 7efbfb7fe700 1 --2- 172.21.15.42:0/2822269838 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efbfc159d30 0x7efbfc150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.022+0000 7efbfa7fc700 1 -- 172.21.15.42:0/2822269838 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efbfc159d30 msgr2=0x7efbfc150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.022+0000 7efbfa7fc700 1 --2- 172.21.15.42:0/2822269838 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efbfc159d30 0x7efbfc150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.022+0000 7efbfa7fc700 1 -- 172.21.15.42:0/2822269838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbfc0b4250 msgr2=0x7efbfc150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.022+0000 7efbfa7fc700 1 --2- 172.21.15.42:0/2822269838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbfc0b4250 0x7efbfc150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.022+0000 7efbfa7fc700 1 -- 172.21.15.42:0/2822269838 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf4009b30 con 0x7efbfc0c6190 2023-07-29T02:06:24.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.022+0000 7efbfa7fc700 1 --2- 172.21.15.42:0/2822269838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efbfc0c6190 0x7efbfc0c80a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7efbf000c500 tx=0x7efbf000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:24.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.022+0000 7efbe37fe700 1 -- 172.21.15.42:0/2822269838 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf00052d0 con 0x7efbfc0c6190 2023-07-29T02:06:24.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.022+0000 7efbe37fe700 1 -- 172.21.15.42:0/2822269838 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf0005430 con 0x7efbfc0c6190 2023-07-29T02:06:24.012 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.022+0000 7efc0140f700 1 -- 172.21.15.42:0/2822269838 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbfc156590 con 0x7efbfc0c6190 2023-07-29T02:06:24.012 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.022+0000 7efbe37fe700 1 -- 172.21.15.42:0/2822269838 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0006aa0 con 0x7efbfc0c6190 2023-07-29T02:06:24.012 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.022+0000 7efc0140f700 1 -- 172.21.15.42:0/2822269838 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbfc1f21f0 con 0x7efbfc0c6190 2023-07-29T02:06:24.012 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.023+0000 7efc0140f700 1 -- 172.21.15.42:0/2822269838 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbfc0ccc20 con 0x7efbfc0c6190 2023-07-29T02:06:24.012 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.023+0000 7efbe37fe700 1 -- 172.21.15.42:0/2822269838 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7efbf0003680 con 0x7efbfc0c6190 2023-07-29T02:06:24.013 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.024+0000 7efbe37fe700 1 --2- 172.21.15.42:0/2822269838 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efbe806a690 0x7efbe806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.013 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.024+0000 7efbe37fe700 1 -- 172.21.15.42:0/2822269838 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7efbf0087fd0 con 0x7efbfc0c6190 2023-07-29T02:06:24.013 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.024+0000 7efbfaffd700 1 --2- 172.21.15.42:0/2822269838 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efbe806a690 0x7efbe806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.013 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.024+0000 7efbfaffd700 1 --2- 172.21.15.42:0/2822269838 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efbe806a690 0x7efbe806cb40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efbec009be0 tx=0x7efbec009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:24.014 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.028+0000 7efbe37fe700 1 -- 172.21.15.42:0/2822269838 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7efbf004b2c0 con 0x7efbfc0c6190 2023-07-29T02:06:24.208 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.227+0000 7efc0140f700 1 -- 172.21.15.42:0/2822269838 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7efbfc06c3a0 con 0x7efbe806a690 2023-07-29T02:06:24.209 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.228+0000 7efbe37fe700 1 -- 172.21.15.42:0/2822269838 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efbec004020 con 0x7efbe806a690 2023-07-29T02:06:24.211 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.230+0000 7efc0140f700 1 -- 172.21.15.42:0/2822269838 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efbe806a690 msgr2=0x7efbe806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.212 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.230+0000 7efc0140f700 1 --2- 172.21.15.42:0/2822269838 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efbe806a690 0x7efbe806cb40 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efbec009be0 tx=0x7efbec009210 comp rx=0 tx=0).stop 2023-07-29T02:06:24.212 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.230+0000 7efc0140f700 1 -- 172.21.15.42:0/2822269838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efbfc0c6190 msgr2=0x7efbfc0c80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.212 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.230+0000 7efc0140f700 1 --2- 172.21.15.42:0/2822269838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efbfc0c6190 0x7efbfc0c80a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7efbf000c500 tx=0x7efbf000c810 comp rx=0 tx=0).stop 2023-07-29T02:06:24.212 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.230+0000 7efc0140f700 1 -- 172.21.15.42:0/2822269838 shutdown_connections 2023-07-29T02:06:24.213 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.230+0000 7efc0140f700 1 --2- 172.21.15.42:0/2822269838 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7efbe806a690 0x7efbe806cb40 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.213 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.230+0000 7efc0140f700 1 --2- 172.21.15.42:0/2822269838 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7efbfc159d30 0x7efbfc150200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.213 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.230+0000 7efc0140f700 1 --2- 172.21.15.42:0/2822269838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efbfc0b4250 0x7efbfc150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.213 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.230+0000 7efc0140f700 1 --2- 172.21.15.42:0/2822269838 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7efbfc0c6190 0x7efbfc0c80a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.213 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.230+0000 7efc0140f700 1 -- 172.21.15.42:0/2822269838 >> 172.21.15.42:0/2822269838 conn(0x7efbfc06ca30 msgr2=0x7efbfc15c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.230+0000 7efc0140f700 1 -- 172.21.15.42:0/2822269838 shutdown_connections 2023-07-29T02:06:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.230+0000 7efc0140f700 1 -- 172.21.15.42:0/2822269838 wait complete. 2023-07-29T02:06:24.214 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 4 to deep-scrub 2023-07-29T02:06:24.224 INFO:tasks.ceph:Scrubbing osd.5 2023-07-29T02:06:24.224 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-07-29T02:06:24.353 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.372+0000 7fbe70a5d700 1 Processor -- start 2023-07-29T02:06:24.353 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.372+0000 7fbe70a5d700 1 -- start start 2023-07-29T02:06:24.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.373+0000 7fbe70a5d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbe6c159440 0x7fbe6c0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.356 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.373+0000 7fbe70a5d700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c0c18c0 con 0x7fbe6c0c1d50 2023-07-29T02:06:24.357 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.373+0000 7fbe70a5d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6c0c7790 con 0x7fbe6c159810 2023-07-29T02:06:24.357 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.373+0000 7fbe70a5d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6c0c0fd0 con 0x7fbe6c159440 2023-07-29T02:06:24.357 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.373+0000 7fbe69d9b700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fbe6c0c1d50 0x7fbe6c0c6880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52270/0 (socket says 172.21.15.42:52270) 2023-07-29T02:06:24.357 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.373+0000 7fbe69d9b700 1 -- 172.21.15.42:0/1580455030 learned_addr learned my addr 172.21.15.42:0/1580455030 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:06:24.357 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.373+0000 7fbe6a59c700 1 --2- 172.21.15.42:0/1580455030 >> v2:172.21.15.144:3300/0 conn(0x7fbe6c159440 0x7fbe6c0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.373+0000 7fbe6959a700 1 -- 172.21.15.42:0/1580455030 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167735288 0 0) 0x7fbe6c0c18c0 con 0x7fbe6c0c1d50 2023-07-29T02:06:24.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.373+0000 7fbe6959a700 1 -- 172.21.15.42:0/1580455030 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe540035b0 con 0x7fbe6c0c1d50 2023-07-29T02:06:24.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.373+0000 7fbe6959a700 1 -- 172.21.15.42:0/1580455030 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1332745808 0 0) 0x7fbe540035b0 con 0x7fbe6c0c1d50 2023-07-29T02:06:24.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.373+0000 7fbe6959a700 1 -- 172.21.15.42:0/1580455030 >> v2:172.21.15.144:3300/0 conn(0x7fbe6c159440 msgr2=0x7fbe6c0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:24.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.373+0000 7fbe6959a700 1 --2- 172.21.15.42:0/1580455030 >> v2:172.21.15.144:3300/0 conn(0x7fbe6c159440 0x7fbe6c0c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.373+0000 7fbe6959a700 1 -- 172.21.15.42:0/1580455030 >> v1:172.21.15.144:6789/0 conn(0x7fbe6c159810 legacy=0x7fbe6c152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.373+0000 7fbe6959a700 1 -- 172.21.15.42:0/1580455030 --> v1:172.21.15.42:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c071e90 con 0x7fbe6c0c1d50 2023-07-29T02:06:24.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.373+0000 7fbe6959a700 1 -- 172.21.15.42:0/1580455030 <== mon.0 v1:172.21.15.42:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 469027473 0 0) 0x7fbe60001670 con 0x7fbe6c0c1d50 2023-07-29T02:06:24.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.373+0000 7fbe6959a700 1 -- 172.21.15.42:0/1580455030 >> v1:172.21.15.42:6789/0 conn(0x7fbe6c0c1d50 legacy=0x7fbe6c0c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.360 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.373+0000 7fbe6959a700 1 --2- 172.21.15.42:0/1580455030 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe54003a00 0x7fbe54003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.360 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.373+0000 7fbe6959a700 1 --2- 172.21.15.42:0/1580455030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe54004850 0x7fbe54004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.360 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.374+0000 7fbe6959a700 1 --2- 172.21.15.42:0/1580455030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe54005200 0x7fbe5400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.360 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.374+0000 7fbe6959a700 1 -- 172.21.15.42:0/1580455030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c0c0fd0 con 0x7fbe54005200 2023-07-29T02:06:24.360 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.374+0000 7fbe6959a700 1 -- 172.21.15.42:0/1580455030 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5400c060 con 0x7fbe54004850 2023-07-29T02:06:24.361 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.374+0000 7fbe6959a700 1 -- 172.21.15.42:0/1580455030 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5400c220 con 0x7fbe54003a00 2023-07-29T02:06:24.361 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.374+0000 7fbe6ad9d700 1 --2- 172.21.15.42:0/1580455030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe54005200 0x7fbe5400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.361 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.374+0000 7fbe69d9b700 1 --2- 172.21.15.42:0/1580455030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe54004850 0x7fbe54004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.361 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.374+0000 7fbe6a59c700 1 --2- 172.21.15.42:0/1580455030 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe54003a00 0x7fbe54003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.361 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.374+0000 7fbe6ad9d700 1 -- 172.21.15.42:0/1580455030 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe54003a00 msgr2=0x7fbe54003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:24.362 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.374+0000 7fbe6ad9d700 1 --2- 172.21.15.42:0/1580455030 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe54003a00 0x7fbe54003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.362 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.374+0000 7fbe6ad9d700 1 -- 172.21.15.42:0/1580455030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe54004850 msgr2=0x7fbe54004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:24.362 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.374+0000 7fbe6ad9d700 1 --2- 172.21.15.42:0/1580455030 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe54004850 0x7fbe54004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.362 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.374+0000 7fbe6ad9d700 1 -- 172.21.15.42:0/1580455030 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe540035b0 con 0x7fbe54005200 2023-07-29T02:06:24.362 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.374+0000 7fbe6ad9d700 1 -- 172.21.15.42:0/1580455030 reap_dead start 2023-07-29T02:06:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.374+0000 7fbe6ad9d700 1 --2- 172.21.15.42:0/1580455030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe54005200 0x7fbe5400ba10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400c190 tx=0x7fbe54005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f03a51694894196 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.374+0000 7fbe6959a700 1 -- 172.21.15.42:0/1580455030 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64001db0 con 0x7fbe54005200 2023-07-29T02:06:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.374+0000 7fbe6959a700 1 -- 172.21.15.42:0/1580455030 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6400ccd0 con 0x7fbe54005200 2023-07-29T02:06:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.374+0000 7fbe6959a700 1 -- 172.21.15.42:0/1580455030 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64003c40 con 0x7fbe54005200 2023-07-29T02:06:24.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.375+0000 7fbe70a5d700 1 -- 172.21.15.42:0/1580455030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe54005200 msgr2=0x7fbe5400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.375+0000 7fbe70a5d700 1 --2- 172.21.15.42:0/1580455030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe54005200 0x7fbe5400ba10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400c190 tx=0x7fbe54005880 comp rx=0 tx=0).stop 2023-07-29T02:06:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.375+0000 7fbe70a5d700 1 -- 172.21.15.42:0/1580455030 shutdown_connections 2023-07-29T02:06:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.375+0000 7fbe70a5d700 1 --2- 172.21.15.42:0/1580455030 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe54005200 0x7fbe5400ba10 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.375+0000 7fbe70a5d700 1 -- 172.21.15.42:0/1580455030 >> 172.21.15.42:0/1580455030 conn(0x7fbe6c0c8980 msgr2=0x7fbe6c0c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:24.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.375+0000 7fbe70a5d700 1 -- 172.21.15.42:0/1580455030 shutdown_connections 2023-07-29T02:06:24.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.375+0000 7fbe70a5d700 1 -- 172.21.15.42:0/1580455030 wait complete. 2023-07-29T02:06:24.367 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.377+0000 7fbe70a5d700 1 Processor -- start 2023-07-29T02:06:24.367 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.377+0000 7fbe70a5d700 1 -- start start 2023-07-29T02:06:24.367 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe70a5d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe54005200 0x7fbe6c1ee9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe70a5d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe6c148520 0x7fbe6c145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe70a5d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe6c145dd0 0x7fbe6c0c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe70a5d700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c0c49b0 con 0x7fbe6c145dd0 2023-07-29T02:06:24.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe70a5d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c146270 con 0x7fbe54005200 2023-07-29T02:06:24.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe70a5d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6c147750 con 0x7fbe6c148520 2023-07-29T02:06:24.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe6ad9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe6c145dd0 0x7fbe6c0c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe6ad9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe6c145dd0 0x7fbe6c0c36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58482/0 (socket says 172.21.15.42:58482) 2023-07-29T02:06:24.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe6ad9d700 1 -- 172.21.15.42:0/1913611815 learned_addr learned my addr 172.21.15.42:0/1913611815 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:24.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe69d9b700 1 --2- 172.21.15.42:0/1913611815 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe6c148520 0x7fbe6c145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe6a59c700 1 --2- 172.21.15.42:0/1913611815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe54005200 0x7fbe6c1ee9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe6ad9d700 1 -- 172.21.15.42:0/1913611815 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe6c148520 msgr2=0x7fbe6c145890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe6ad9d700 1 --2- 172.21.15.42:0/1913611815 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbe6c148520 0x7fbe6c145890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe6ad9d700 1 -- 172.21.15.42:0/1913611815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe54005200 msgr2=0x7fbe6c1ee9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe6ad9d700 1 --2- 172.21.15.42:0/1913611815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbe54005200 0x7fbe6c1ee9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe6ad9d700 1 -- 172.21.15.42:0/1913611815 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c0c3260 con 0x7fbe6c145dd0 2023-07-29T02:06:24.371 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe6ad9d700 1 --2- 172.21.15.42:0/1913611815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe6c145dd0 0x7fbe6c0c36f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0c9a10 tx=0x7fbe640014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:24.371 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe5affd700 1 -- 172.21.15.42:0/1913611815 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64005070 con 0x7fbe6c145dd0 2023-07-29T02:06:24.371 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe5affd700 1 -- 172.21.15.42:0/1913611815 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe640051f0 con 0x7fbe6c145dd0 2023-07-29T02:06:24.371 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe70a5d700 1 -- 172.21.15.42:0/1913611815 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6c1479a0 con 0x7fbe6c145dd0 2023-07-29T02:06:24.371 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.378+0000 7fbe5affd700 1 -- 172.21.15.42:0/1913611815 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe640053a0 con 0x7fbe6c145dd0 2023-07-29T02:06:24.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.379+0000 7fbe70a5d700 1 -- 172.21.15.42:0/1913611815 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6c147f60 con 0x7fbe6c145dd0 2023-07-29T02:06:24.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.379+0000 7fbe70a5d700 1 -- 172.21.15.42:0/1913611815 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe6c0c1550 con 0x7fbe6c145dd0 2023-07-29T02:06:24.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.380+0000 7fbe5affd700 1 -- 172.21.15.42:0/1913611815 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fbe64005500 con 0x7fbe6c145dd0 2023-07-29T02:06:24.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.380+0000 7fbe5affd700 1 --2- 172.21.15.42:0/1913611815 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbe4c06a660 0x7fbe4c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.380+0000 7fbe5affd700 1 -- 172.21.15.42:0/1913611815 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7fbe6408a210 con 0x7fbe6c145dd0 2023-07-29T02:06:24.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.380+0000 7fbe5affd700 1 --2- 172.21.15.42:0/1913611815 >> [v2:172.21.15.144:6808/131483,v1:172.21.15.144:6809/131483] conn(0x7fbe4c0744f0 0x7fbe4c076940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.380+0000 7fbe5affd700 1 -- 172.21.15.42:0/1913611815 --> [v2:172.21.15.144:6808/131483,v1:172.21.15.144:6809/131483] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe4c077010 con 0x7fbe4c0744f0 2023-07-29T02:06:24.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.381+0000 7fbe5affd700 1 -- 172.21.15.42:0/1913611815 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe6408a660 con 0x7fbe6c145dd0 2023-07-29T02:06:24.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.381+0000 7fbe6a59c700 1 --2- 172.21.15.42:0/1913611815 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbe4c06a660 0x7fbe4c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.381+0000 7fbe69d9b700 1 --2- 172.21.15.42:0/1913611815 >> [v2:172.21.15.144:6808/131483,v1:172.21.15.144:6809/131483] conn(0x7fbe4c0744f0 0x7fbe4c076940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.381+0000 7fbe6a59c700 1 --2- 172.21.15.42:0/1913611815 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbe4c06a660 0x7fbe4c06cb10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009be0 tx=0x7fbe5c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:24.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.381+0000 7fbe69d9b700 1 --2- 172.21.15.42:0/1913611815 >> [v2:172.21.15.144:6808/131483,v1:172.21.15.144:6809/131483] conn(0x7fbe4c0744f0 0x7fbe4c076940 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:24.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.382+0000 7fbe5affd700 1 -- 172.21.15.42:0/1913611815 <== osd.5 v2:172.21.15.144:6808/131483 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbe4c077010 con 0x7fbe4c0744f0 2023-07-29T02:06:24.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.396+0000 7fbe70a5d700 1 -- 172.21.15.42:0/1913611815 --> [v2:172.21.15.144:6808/131483,v1:172.21.15.144:6809/131483] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbe6c0c1270 con 0x7fbe4c0744f0 2023-07-29T02:06:24.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.397+0000 7fbe5affd700 1 -- 172.21.15.42:0/1913611815 <== osd.5 v2:172.21.15.144:6808/131483 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbe60007e70 con 0x7fbe4c0744f0 2023-07-29T02:06:24.378 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2023-07-29T02:06:24.378 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-29T02:06:24.379 INFO:teuthology.orchestra.run.smithi042.stdout:} 2023-07-29T02:06:24.380 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.397+0000 7fbe70a5d700 1 -- 172.21.15.42:0/1913611815 >> [v2:172.21.15.144:6808/131483,v1:172.21.15.144:6809/131483] conn(0x7fbe4c0744f0 msgr2=0x7fbe4c076940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.380 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.397+0000 7fbe70a5d700 1 --2- 172.21.15.42:0/1913611815 >> [v2:172.21.15.144:6808/131483,v1:172.21.15.144:6809/131483] conn(0x7fbe4c0744f0 0x7fbe4c076940 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.380 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.397+0000 7fbe70a5d700 1 -- 172.21.15.42:0/1913611815 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbe4c06a660 msgr2=0x7fbe4c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.380 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.397+0000 7fbe70a5d700 1 --2- 172.21.15.42:0/1913611815 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbe4c06a660 0x7fbe4c06cb10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009be0 tx=0x7fbe5c009210 comp rx=0 tx=0).stop 2023-07-29T02:06:24.381 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.397+0000 7fbe70a5d700 1 -- 172.21.15.42:0/1913611815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe6c145dd0 msgr2=0x7fbe6c0c36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.381 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.397+0000 7fbe70a5d700 1 --2- 172.21.15.42:0/1913611815 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbe6c145dd0 0x7fbe6c0c36f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0c9a10 tx=0x7fbe640014a0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.381 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.397+0000 7fbe6ad9d700 1 -- 172.21.15.42:0/1913611815 reap_dead start 2023-07-29T02:06:24.381 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.397+0000 7fbe70a5d700 1 -- 172.21.15.42:0/1913611815 shutdown_connections 2023-07-29T02:06:24.381 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.397+0000 7fbe70a5d700 1 -- 172.21.15.42:0/1913611815 >> 172.21.15.42:0/1913611815 conn(0x7fbe6c0c8980 msgr2=0x7fbe6c1512c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.397+0000 7fbe70a5d700 1 -- 172.21.15.42:0/1913611815 shutdown_connections 2023-07-29T02:06:24.382 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.397+0000 7fbe70a5d700 1 -- 172.21.15.42:0/1913611815 wait complete. 2023-07-29T02:06:24.390 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-07-29T02:06:24.517 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.536+0000 7ff6d31a9700 1 Processor -- start 2023-07-29T02:06:24.518 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.536+0000 7ff6d31a9700 1 -- start start 2023-07-29T02:06:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.537+0000 7ff6d31a9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff6cc0c8580 0x7ff6cc06f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.537+0000 7ff6d31a9700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6cc06c870 con 0x7ff6cc071840 2023-07-29T02:06:24.521 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.537+0000 7ff6d31a9700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6cc06fa50 con 0x7ff6cc1531a0 2023-07-29T02:06:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.537+0000 7ff6d31a9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc0c74a0 con 0x7ff6cc0c8580 2023-07-29T02:06:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.537+0000 7ff6d1746700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7ff6cc071840 0x7ff6cc06a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52296/0 (socket says 172.21.15.42:52296) 2023-07-29T02:06:24.522 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.537+0000 7ff6d1746700 1 -- 172.21.15.42:0/345020284 learned_addr learned my addr 172.21.15.42:0/345020284 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:06:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.537+0000 7ff6cbfff700 1 --2- 172.21.15.42:0/345020284 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff6cc0c8580 0x7ff6cc06f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.537+0000 7ff6cb7fe700 1 -- 172.21.15.42:0/345020284 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564578166 0 0) 0x7ff6cc06c870 con 0x7ff6cc071840 2023-07-29T02:06:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.537+0000 7ff6cb7fe700 1 -- 172.21.15.42:0/345020284 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6bc0035b0 con 0x7ff6cc071840 2023-07-29T02:06:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.537+0000 7ff6cb7fe700 1 -- 172.21.15.42:0/345020284 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137484578 0 0) 0x7ff6cc06fa50 con 0x7ff6cc1531a0 2023-07-29T02:06:24.523 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.537+0000 7ff6cb7fe700 1 -- 172.21.15.42:0/345020284 --> v1:172.21.15.144:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6cc06c870 con 0x7ff6cc1531a0 2023-07-29T02:06:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.537+0000 7ff6cbfff700 1 -- 172.21.15.42:0/345020284 >> v1:172.21.15.144:6789/0 conn(0x7ff6cc1531a0 legacy=0x7ff6cc15c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.537+0000 7ff6cbfff700 1 -- 172.21.15.42:0/345020284 >> v1:172.21.15.42:6789/0 conn(0x7ff6cc071840 legacy=0x7ff6cc06a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.537+0000 7ff6cb7fe700 1 -- 172.21.15.42:0/345020284 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2227675492 0 0) 0x7ff6bc0035b0 con 0x7ff6cc071840 2023-07-29T02:06:24.524 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.537+0000 7ff6cbfff700 1 -- 172.21.15.42:0/345020284 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc06d450 con 0x7ff6cc0c8580 2023-07-29T02:06:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.538+0000 7ff6cbfff700 1 --2- 172.21.15.42:0/345020284 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff6cc0c8580 0x7ff6cc06f510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8009870 tx=0x7ff6b8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=168bdc4796269bf2 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.538+0000 7ff6cb7fe700 1 -- 172.21.15.42:0/345020284 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c40019f0 con 0x7ff6cc0c8580 2023-07-29T02:06:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.538+0000 7ff6cb7fe700 1 -- 172.21.15.42:0/345020284 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b8004030 con 0x7ff6cc0c8580 2023-07-29T02:06:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.538+0000 7ff6cb7fe700 1 -- 172.21.15.42:0/345020284 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80043c0 con 0x7ff6cc0c8580 2023-07-29T02:06:24.525 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.538+0000 7ff6d31a9700 1 -- 172.21.15.42:0/345020284 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff6cc0c8580 msgr2=0x7ff6cc06f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.538+0000 7ff6d31a9700 1 --2- 172.21.15.42:0/345020284 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff6cc0c8580 0x7ff6cc06f510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8009870 tx=0x7ff6b8009b80 comp rx=0 tx=0).stop 2023-07-29T02:06:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.538+0000 7ff6d31a9700 1 -- 172.21.15.42:0/345020284 shutdown_connections 2023-07-29T02:06:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.538+0000 7ff6d31a9700 1 --2- 172.21.15.42:0/345020284 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff6cc0c8580 0x7ff6cc06f510 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.538+0000 7ff6d31a9700 1 -- 172.21.15.42:0/345020284 >> 172.21.15.42:0/345020284 conn(0x7ff6cc0cbf10 msgr2=0x7ff6cc0cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.538+0000 7ff6d31a9700 1 -- 172.21.15.42:0/345020284 shutdown_connections 2023-07-29T02:06:24.526 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.538+0000 7ff6d31a9700 1 -- 172.21.15.42:0/345020284 wait complete. 2023-07-29T02:06:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.539+0000 7ff6d31a9700 1 Processor -- start 2023-07-29T02:06:24.527 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.539+0000 7ff6d31a9700 1 -- start start 2023-07-29T02:06:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.540+0000 7ff6d31a9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6cc071840 0x7ff6cc1587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.540+0000 7ff6d31a9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff6cc0c8580 0x7ff6cc1efd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.529 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.540+0000 7ff6d31a9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6cc1531a0 0x7ff6cc1ef330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.540+0000 7ff6d31a9700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc1ef870 con 0x7ff6cc1531a0 2023-07-29T02:06:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.540+0000 7ff6d31a9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc1596b0 con 0x7ff6cc071840 2023-07-29T02:06:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.540+0000 7ff6d31a9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc159950 con 0x7ff6cc0c8580 2023-07-29T02:06:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.540+0000 7ff6d1746700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6cc1531a0 0x7ff6cc1ef330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.540+0000 7ff6d1746700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6cc1531a0 0x7ff6cc1ef330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58498/0 (socket says 172.21.15.42:58498) 2023-07-29T02:06:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.540+0000 7ff6d1746700 1 -- 172.21.15.42:0/2314161144 learned_addr learned my addr 172.21.15.42:0/2314161144 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.541+0000 7ff6cbfff700 1 --2- 172.21.15.42:0/2314161144 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff6cc0c8580 0x7ff6cc1efd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.541+0000 7ff6d0f45700 1 --2- 172.21.15.42:0/2314161144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6cc071840 0x7ff6cc1587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.541+0000 7ff6d1746700 1 -- 172.21.15.42:0/2314161144 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff6cc0c8580 msgr2=0x7ff6cc1efd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.541+0000 7ff6d1746700 1 --2- 172.21.15.42:0/2314161144 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff6cc0c8580 0x7ff6cc1efd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.541+0000 7ff6d1746700 1 -- 172.21.15.42:0/2314161144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6cc071840 msgr2=0x7ff6cc1587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.541+0000 7ff6d1746700 1 --2- 172.21.15.42:0/2314161144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6cc071840 0x7ff6cc1587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.541+0000 7ff6d1746700 1 -- 172.21.15.42:0/2314161144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b80094a0 con 0x7ff6cc1531a0 2023-07-29T02:06:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.541+0000 7ff6d1746700 1 --2- 172.21.15.42:0/2314161144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6cc1531a0 0x7ff6cc1ef330 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40017f0 tx=0x7ff6c400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.541+0000 7ff6c97fa700 1 -- 172.21.15.42:0/2314161144 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c40019f0 con 0x7ff6cc1531a0 2023-07-29T02:06:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.541+0000 7ff6c97fa700 1 -- 172.21.15.42:0/2314161144 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c400ade0 con 0x7ff6cc1531a0 2023-07-29T02:06:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.541+0000 7ff6d31a9700 1 -- 172.21.15.42:0/2314161144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6cc157ce0 con 0x7ff6cc1531a0 2023-07-29T02:06:24.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.541+0000 7ff6c97fa700 1 -- 172.21.15.42:0/2314161144 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4007310 con 0x7ff6cc1531a0 2023-07-29T02:06:24.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.541+0000 7ff6d31a9700 1 -- 172.21.15.42:0/2314161144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6cc1582a0 con 0x7ff6cc1531a0 2023-07-29T02:06:24.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.542+0000 7ff6d31a9700 1 -- 172.21.15.42:0/2314161144 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6cc04ea50 con 0x7ff6cc1531a0 2023-07-29T02:06:24.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.543+0000 7ff6c97fa700 1 -- 172.21.15.42:0/2314161144 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7ff6c4007470 con 0x7ff6cc1531a0 2023-07-29T02:06:24.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.543+0000 7ff6c97fa700 1 --2- 172.21.15.42:0/2314161144 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff6b006a690 0x7ff6b006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.543+0000 7ff6c97fa700 1 -- 172.21.15.42:0/2314161144 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7ff6c4088b80 con 0x7ff6cc1531a0 2023-07-29T02:06:24.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.543+0000 7ff6d0f45700 1 --2- 172.21.15.42:0/2314161144 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff6b006a690 0x7ff6b006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.544+0000 7ff6d0f45700 1 --2- 172.21.15.42:0/2314161144 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff6b006a690 0x7ff6b006cb40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0007fd0 tx=0x7ff6c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:24.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.547+0000 7ff6c97fa700 1 -- 172.21.15.42:0/2314161144 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7ff6c4053ad0 con 0x7ff6cc1531a0 2023-07-29T02:06:24.758 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.777+0000 7ff6d31a9700 1 -- 172.21.15.42:0/2314161144 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6cc1593a0 con 0x7ff6b006a690 2023-07-29T02:06:24.758 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.777+0000 7ff6c97fa700 1 -- 172.21.15.42:0/2314161144 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff6cc1593a0 con 0x7ff6b006a690 2023-07-29T02:06:24.761 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.779+0000 7ff6d31a9700 1 -- 172.21.15.42:0/2314161144 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff6b006a690 msgr2=0x7ff6b006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.761 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.779+0000 7ff6d31a9700 1 --2- 172.21.15.42:0/2314161144 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff6b006a690 0x7ff6b006cb40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0007fd0 tx=0x7ff6c0009040 comp rx=0 tx=0).stop 2023-07-29T02:06:24.761 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.779+0000 7ff6d31a9700 1 -- 172.21.15.42:0/2314161144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6cc1531a0 msgr2=0x7ff6cc1ef330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.761 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.779+0000 7ff6d31a9700 1 --2- 172.21.15.42:0/2314161144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6cc1531a0 0x7ff6cc1ef330 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40017f0 tx=0x7ff6c400a340 comp rx=0 tx=0).stop 2023-07-29T02:06:24.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.780+0000 7ff6d31a9700 1 -- 172.21.15.42:0/2314161144 shutdown_connections 2023-07-29T02:06:24.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.780+0000 7ff6d31a9700 1 --2- 172.21.15.42:0/2314161144 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff6b006a690 0x7ff6b006cb40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.780+0000 7ff6d31a9700 1 --2- 172.21.15.42:0/2314161144 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff6cc1531a0 0x7ff6cc1ef330 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.780+0000 7ff6d31a9700 1 --2- 172.21.15.42:0/2314161144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6cc071840 0x7ff6cc1587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.780+0000 7ff6d31a9700 1 --2- 172.21.15.42:0/2314161144 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff6cc0c8580 0x7ff6cc1efd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.780+0000 7ff6d31a9700 1 -- 172.21.15.42:0/2314161144 >> 172.21.15.42:0/2314161144 conn(0x7ff6cc0cbf10 msgr2=0x7ff6cc0738a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:24.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.780+0000 7ff6d31a9700 1 -- 172.21.15.42:0/2314161144 shutdown_connections 2023-07-29T02:06:24.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.780+0000 7ff6d31a9700 1 -- 172.21.15.42:0/2314161144 wait complete. 2023-07-29T02:06:24.763 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 5 to deep-scrub 2023-07-29T02:06:24.773 INFO:tasks.ceph:Scrubbing osd.6 2023-07-29T02:06:24.774 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-07-29T02:06:24.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.923+0000 7fe43d798700 1 Processor -- start 2023-07-29T02:06:24.905 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.923+0000 7fe43d798700 1 -- start start 2023-07-29T02:06:24.908 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.924+0000 7fe43d798700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fe4380c9320 0x7fe4381597e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.908 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.924+0000 7fe43d798700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe438159d20 0x7fe4380cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.908 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.924+0000 7fe43d798700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe43815ca50 con 0x7fe438153600 2023-07-29T02:06:24.909 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.924+0000 7fe43d798700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4381593d0 con 0x7fe438159d20 2023-07-29T02:06:24.909 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.924+0000 7fe43d798700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe43815d8b0 con 0x7fe4380c9320 2023-07-29T02:06:24.909 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.924+0000 7fe4377fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe438159d20 0x7fe4380cf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.910 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.924+0000 7fe436ffd700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fe438153600 0x7fe4380caa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52306/0 (socket says 172.21.15.42:52306) 2023-07-29T02:06:24.910 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.924+0000 7fe4377fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fe438159d20 0x7fe4380cf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58506/0 (socket says 172.21.15.42:58506) 2023-07-29T02:06:24.910 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.924+0000 7fe436ffd700 1 -- 172.21.15.42:0/783296723 learned_addr learned my addr 172.21.15.42:0/783296723 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:06:24.910 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.924+0000 7fe4367fc700 1 --2- 172.21.15.42:0/783296723 >> v2:172.21.15.144:3300/0 conn(0x7fe4380c9320 0x7fe4381597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.924+0000 7fe4377fe700 1 -- 172.21.15.42:0/783296723 >> v2:172.21.15.144:3300/0 conn(0x7fe4380c9320 msgr2=0x7fe4381597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:24.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.924+0000 7fe4377fe700 1 --2- 172.21.15.42:0/783296723 >> v2:172.21.15.144:3300/0 conn(0x7fe4380c9320 0x7fe4381597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.924+0000 7fe4377fe700 1 -- 172.21.15.42:0/783296723 >> v1:172.21.15.42:6789/0 conn(0x7fe438153600 legacy=0x7fe4380caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.911 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.924+0000 7fe4377fe700 1 -- 172.21.15.42:0/783296723 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43815cd30 con 0x7fe438159d20 2023-07-29T02:06:24.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.924+0000 7fe435ffb700 1 -- 172.21.15.42:0/783296723 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 514522591 0 0) 0x7fe43815ca50 con 0x7fe438153600 2023-07-29T02:06:24.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.924+0000 7fe4367fc700 1 --2- 172.21.15.42:0/783296723 >> v2:172.21.15.144:3300/0 conn(0x7fe4380c9320 0x7fe4381597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:06:24.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.924+0000 7fe4377fe700 1 --2- 172.21.15.42:0/783296723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe438159d20 0x7fe4380cf220 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe4380b5520 tx=0x7fe43000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5d02bb554a8589 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:24.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.925+0000 7fe435ffb700 1 -- 172.21.15.42:0/783296723 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43000e070 con 0x7fe438159d20 2023-07-29T02:06:24.912 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.925+0000 7fe435ffb700 1 -- 172.21.15.42:0/783296723 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43000bbd0 con 0x7fe438159d20 2023-07-29T02:06:24.913 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.925+0000 7fe435ffb700 1 -- 172.21.15.42:0/783296723 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe430012430 con 0x7fe438159d20 2023-07-29T02:06:24.913 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.925+0000 7fe43d798700 1 -- 172.21.15.42:0/783296723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe438159d20 msgr2=0x7fe4380cf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.913 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.925+0000 7fe43d798700 1 --2- 172.21.15.42:0/783296723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe438159d20 0x7fe4380cf220 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe4380b5520 tx=0x7fe43000b330 comp rx=0 tx=0).stop 2023-07-29T02:06:24.913 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.925+0000 7fe43d798700 1 -- 172.21.15.42:0/783296723 shutdown_connections 2023-07-29T02:06:24.913 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.925+0000 7fe43d798700 1 --2- 172.21.15.42:0/783296723 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe438159d20 0x7fe4380cf220 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.914 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.925+0000 7fe43d798700 1 --2- 172.21.15.42:0/783296723 >> v2:172.21.15.144:3300/0 conn(0x7fe4380c9320 0x7fe4381597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.914 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.925+0000 7fe43d798700 1 -- 172.21.15.42:0/783296723 >> 172.21.15.42:0/783296723 conn(0x7fe43806ca50 msgr2=0x7fe43806ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:24.914 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.925+0000 7fe43d798700 1 -- 172.21.15.42:0/783296723 shutdown_connections 2023-07-29T02:06:24.914 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.925+0000 7fe43d798700 1 -- 172.21.15.42:0/783296723 wait complete. 2023-07-29T02:06:24.914 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.926+0000 7fe43d798700 1 Processor -- start 2023-07-29T02:06:24.915 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.927+0000 7fe43d798700 1 -- start start 2023-07-29T02:06:24.917 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.927+0000 7fe43d798700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe438153600 0x7fe438158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.917 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.927+0000 7fe43d798700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe438159d20 0x7fe438158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.917 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.927+0000 7fe43d798700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4380b2f90 0x7fe438152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.918 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.927+0000 7fe43d798700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43814cd20 con 0x7fe4380b2f90 2023-07-29T02:06:24.918 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.927+0000 7fe43d798700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4380b1eb0 con 0x7fe438153600 2023-07-29T02:06:24.918 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.927+0000 7fe43d798700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4380c69e0 con 0x7fe438159d20 2023-07-29T02:06:24.918 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.927+0000 7fe4377fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4380b2f90 0x7fe438152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.918 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.927+0000 7fe4377fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4380b2f90 0x7fe438152510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58512/0 (socket says 172.21.15.42:58512) 2023-07-29T02:06:24.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.927+0000 7fe4377fe700 1 -- 172.21.15.42:0/3103264522 learned_addr learned my addr 172.21.15.42:0/3103264522 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:24.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.927+0000 7fe4367fc700 1 --2- 172.21.15.42:0/3103264522 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe438159d20 0x7fe438158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.927+0000 7fe436ffd700 1 --2- 172.21.15.42:0/3103264522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe438153600 0x7fe438158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.928+0000 7fe4377fe700 1 -- 172.21.15.42:0/3103264522 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe438159d20 msgr2=0x7fe438158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.919 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.928+0000 7fe4377fe700 1 --2- 172.21.15.42:0/3103264522 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fe438159d20 0x7fe438158bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.920 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.928+0000 7fe4377fe700 1 -- 172.21.15.42:0/3103264522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe438153600 msgr2=0x7fe438158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.920 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.928+0000 7fe4377fe700 1 --2- 172.21.15.42:0/3103264522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe438153600 0x7fe438158690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.920 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.928+0000 7fe4377fe700 1 -- 172.21.15.42:0/3103264522 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe430009a70 con 0x7fe4380b2f90 2023-07-29T02:06:24.920 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.928+0000 7fe436ffd700 1 --2- 172.21.15.42:0/3103264522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe438153600 0x7fe438158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:06:24.920 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.928+0000 7fe4377fe700 1 --2- 172.21.15.42:0/3103264522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4380b2f90 0x7fe438152510 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe438068400 tx=0x7fe430004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:24.921 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.928+0000 7fe41f7fe700 1 -- 172.21.15.42:0/3103264522 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe430012430 con 0x7fe4380b2f90 2023-07-29T02:06:24.921 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.928+0000 7fe41f7fe700 1 -- 172.21.15.42:0/3103264522 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe430020070 con 0x7fe4380b2f90 2023-07-29T02:06:24.921 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.928+0000 7fe43d798700 1 -- 172.21.15.42:0/3103264522 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4381ef6c0 con 0x7fe4380b2f90 2023-07-29T02:06:24.921 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.928+0000 7fe41f7fe700 1 -- 172.21.15.42:0/3103264522 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe430003ea0 con 0x7fe4380b2f90 2023-07-29T02:06:24.921 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.928+0000 7fe43d798700 1 -- 172.21.15.42:0/3103264522 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4380b39f0 con 0x7fe4380b2f90 2023-07-29T02:06:24.922 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.929+0000 7fe43d798700 1 -- 172.21.15.42:0/3103264522 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe43815d2f0 con 0x7fe4380b2f90 2023-07-29T02:06:24.922 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.929+0000 7fe41f7fe700 1 -- 172.21.15.42:0/3103264522 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fe430004280 con 0x7fe4380b2f90 2023-07-29T02:06:24.922 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.930+0000 7fe41f7fe700 1 --2- 172.21.15.42:0/3103264522 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe42406a690 0x7fe42406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.922 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.930+0000 7fe41f7fe700 1 -- 172.21.15.42:0/3103264522 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7fe430022070 con 0x7fe4380b2f90 2023-07-29T02:06:24.922 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.930+0000 7fe41f7fe700 1 --2- 172.21.15.42:0/3103264522 >> [v2:172.21.15.144:6824/131504,v1:172.21.15.144:6825/131504] conn(0x7fe424074520 0x7fe424076970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:24.922 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.930+0000 7fe436ffd700 1 --2- 172.21.15.42:0/3103264522 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe42406a690 0x7fe42406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.923 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.930+0000 7fe41f7fe700 1 -- 172.21.15.42:0/3103264522 --> [v2:172.21.15.144:6824/131504,v1:172.21.15.144:6825/131504] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe424077040 con 0x7fe424074520 2023-07-29T02:06:24.923 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.930+0000 7fe41f7fe700 1 -- 172.21.15.42:0/3103264522 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe43008f2c0 con 0x7fe4380b2f90 2023-07-29T02:06:24.923 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.930+0000 7fe4367fc700 1 --2- 172.21.15.42:0/3103264522 >> [v2:172.21.15.144:6824/131504,v1:172.21.15.144:6825/131504] conn(0x7fe424074520 0x7fe424076970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:24.923 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.930+0000 7fe436ffd700 1 --2- 172.21.15.42:0/3103264522 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe42406a690 0x7fe42406cb40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe42c000f60 tx=0x7fe42c007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:24.923 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.931+0000 7fe4367fc700 1 --2- 172.21.15.42:0/3103264522 >> [v2:172.21.15.144:6824/131504,v1:172.21.15.144:6825/131504] conn(0x7fe424074520 0x7fe424076970 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:24.924 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.931+0000 7fe41f7fe700 1 -- 172.21.15.42:0/3103264522 <== osd.6 v2:172.21.15.144:6824/131504 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe424077040 con 0x7fe424074520 2023-07-29T02:06:24.926 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.946+0000 7fe43d798700 1 -- 172.21.15.42:0/3103264522 --> [v2:172.21.15.144:6824/131504,v1:172.21.15.144:6825/131504] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe43815d010 con 0x7fe424074520 2023-07-29T02:06:24.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.946+0000 7fe41f7fe700 1 -- 172.21.15.42:0/3103264522 <== osd.6 v2:172.21.15.144:6824/131504 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe42800c040 con 0x7fe424074520 2023-07-29T02:06:24.927 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2023-07-29T02:06:24.928 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-29T02:06:24.928 INFO:teuthology.orchestra.run.smithi042.stdout:} 2023-07-29T02:06:24.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.946+0000 7fe43d798700 1 -- 172.21.15.42:0/3103264522 >> [v2:172.21.15.144:6824/131504,v1:172.21.15.144:6825/131504] conn(0x7fe424074520 msgr2=0x7fe424076970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.946+0000 7fe43d798700 1 --2- 172.21.15.42:0/3103264522 >> [v2:172.21.15.144:6824/131504,v1:172.21.15.144:6825/131504] conn(0x7fe424074520 0x7fe424076970 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.929 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.946+0000 7fe43d798700 1 -- 172.21.15.42:0/3103264522 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe42406a690 msgr2=0x7fe42406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.946+0000 7fe43d798700 1 --2- 172.21.15.42:0/3103264522 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fe42406a690 0x7fe42406cb40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe42c000f60 tx=0x7fe42c007ca0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.946+0000 7fe43d798700 1 -- 172.21.15.42:0/3103264522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4380b2f90 msgr2=0x7fe438152510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:24.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.946+0000 7fe43d798700 1 --2- 172.21.15.42:0/3103264522 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fe4380b2f90 0x7fe438152510 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe438068400 tx=0x7fe430004ad0 comp rx=0 tx=0).stop 2023-07-29T02:06:24.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.946+0000 7fe4377fe700 1 -- 172.21.15.42:0/3103264522 reap_dead start 2023-07-29T02:06:24.930 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.946+0000 7fe43d798700 1 -- 172.21.15.42:0/3103264522 shutdown_connections 2023-07-29T02:06:24.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.946+0000 7fe43d798700 1 -- 172.21.15.42:0/3103264522 >> 172.21.15.42:0/3103264522 conn(0x7fe43806ca50 msgr2=0x7fe4380ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:24.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.946+0000 7fe43d798700 1 -- 172.21.15.42:0/3103264522 shutdown_connections 2023-07-29T02:06:24.931 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:24.946+0000 7fe43d798700 1 -- 172.21.15.42:0/3103264522 wait complete. 2023-07-29T02:06:24.940 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-07-29T02:06:25.068 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.087+0000 7f9bc0f06700 1 Processor -- start 2023-07-29T02:06:25.069 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.087+0000 7f9bc0f06700 1 -- start start 2023-07-29T02:06:25.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.088+0000 7f9bc0f06700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9bbc1531a0 0x7f9bbc06f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.070 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.088+0000 7f9bc0f06700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bbc0c8580 0x7f9bbc15c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.088+0000 7f9bc0f06700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bbc06c870 con 0x7f9bbc071840 2023-07-29T02:06:25.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.088+0000 7f9bc0f06700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc0c74a0 con 0x7f9bbc1531a0 2023-07-29T02:06:25.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.088+0000 7f9bc0f06700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc06fa50 con 0x7f9bbc0c8580 2023-07-29T02:06:25.071 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.088+0000 7f9bb9d9b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bbc0c8580 0x7f9bbc15c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.088+0000 7f9bba59c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9bbc1531a0 0x7f9bbc06f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.089+0000 7f9bb9d9b700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bbc0c8580 0x7f9bbc15c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3301/0 says I am v2:172.21.15.42:59034/0 (socket says 172.21.15.42:59034) 2023-07-29T02:06:25.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.088+0000 7f9bbad9d700 1 --1- >> v1:172.21.15.144:6789/0 conn(0x7f9bbc071840 0x7f9bbc06a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.144:6789/0 says I am v1:172.21.15.42:54818/0 (socket says 172.21.15.42:54818) 2023-07-29T02:06:25.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.089+0000 7f9bb9d9b700 1 -- 172.21.15.42:0/3968280635 learned_addr learned my addr 172.21.15.42:0/3968280635 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:25.072 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.089+0000 7f9bba59c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f9bbc1531a0 0x7f9bbc06f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.42:41896/0 (socket says 172.21.15.42:41896) 2023-07-29T02:06:25.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.089+0000 7f9bb9d9b700 1 -- 172.21.15.42:0/3968280635 >> v2:172.21.15.144:3300/0 conn(0x7f9bbc1531a0 msgr2=0x7f9bbc06f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:25.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.089+0000 7f9bb9d9b700 1 --2- 172.21.15.42:0/3968280635 >> v2:172.21.15.144:3300/0 conn(0x7f9bbc1531a0 0x7f9bbc06f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.089+0000 7f9bb9d9b700 1 -- 172.21.15.42:0/3968280635 >> v1:172.21.15.144:6789/0 conn(0x7f9bbc071840 legacy=0x7f9bbc06a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.089+0000 7f9bb9d9b700 1 -- 172.21.15.42:0/3968280635 --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc15ca00 con 0x7f9bbc0c8580 2023-07-29T02:06:25.073 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.089+0000 7f9bb9d9b700 1 --2- 172.21.15.42:0/3968280635 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bbc0c8580 0x7f9bbc15c4c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0098f0 tx=0x7f9bac009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb6331806d04e4a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:25.074 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.089+0000 7f9bb959a700 1 -- 172.21.15.42:0/3968280635 <== mon.2 v2:172.21.15.144:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac011830 con 0x7f9bbc0c8580 2023-07-29T02:06:25.074 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.089+0000 7f9bb959a700 1 -- 172.21.15.42:0/3968280635 <== mon.2 v2:172.21.15.144:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac011990 con 0x7f9bbc0c8580 2023-07-29T02:06:25.074 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.089+0000 7f9bb959a700 1 -- 172.21.15.42:0/3968280635 <== mon.2 v2:172.21.15.144:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac011d20 con 0x7f9bbc0c8580 2023-07-29T02:06:25.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.090+0000 7f9bc0f06700 1 -- 172.21.15.42:0/3968280635 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bbc0c8580 msgr2=0x7f9bbc15c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.090+0000 7f9bc0f06700 1 --2- 172.21.15.42:0/3968280635 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bbc0c8580 0x7f9bbc15c4c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9bac0098f0 tx=0x7f9bac009c00 comp rx=0 tx=0).stop 2023-07-29T02:06:25.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.090+0000 7f9bc0f06700 1 -- 172.21.15.42:0/3968280635 shutdown_connections 2023-07-29T02:06:25.077 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.090+0000 7f9bc0f06700 1 --2- 172.21.15.42:0/3968280635 >> v2:172.21.15.144:3300/0 conn(0x7f9bbc1531a0 0x7f9bbc06f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.090+0000 7f9bc0f06700 1 --2- 172.21.15.42:0/3968280635 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bbc0c8580 0x7f9bbc15c4c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.090+0000 7f9bc0f06700 1 -- 172.21.15.42:0/3968280635 >> 172.21.15.42:0/3968280635 conn(0x7f9bbc0cbf10 msgr2=0x7f9bbc0cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:25.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.090+0000 7f9bc0f06700 1 -- 172.21.15.42:0/3968280635 shutdown_connections 2023-07-29T02:06:25.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.090+0000 7f9bc0f06700 1 -- 172.21.15.42:0/3968280635 wait complete. 2023-07-29T02:06:25.078 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.091+0000 7f9bc0f06700 1 Processor -- start 2023-07-29T02:06:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.091+0000 7f9bc0f06700 1 -- start start 2023-07-29T02:06:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.092+0000 7f9bc0f06700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bbc071840 0x7f9bbc1538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.092+0000 7f9bc0f06700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bbc0c8580 0x7f9bbc153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.092+0000 7f9bc0f06700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bbc1531a0 0x7f9bbc15a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.079 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.092+0000 7f9bc0f06700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc15a3c0 con 0x7f9bbc071840 2023-07-29T02:06:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.092+0000 7f9bc0f06700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc154f80 con 0x7f9bbc1531a0 2023-07-29T02:06:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.092+0000 7f9bc0f06700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc1e2840 con 0x7f9bbc0c8580 2023-07-29T02:06:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.092+0000 7f9bba59c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bbc071840 0x7f9bbc1538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.092+0000 7f9bba59c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bbc071840 0x7f9bbc1538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58524/0 (socket says 172.21.15.42:58524) 2023-07-29T02:06:25.080 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.092+0000 7f9bba59c700 1 -- 172.21.15.42:0/1556160018 learned_addr learned my addr 172.21.15.42:0/1556160018 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:25.081 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.092+0000 7f9bb9d9b700 1 --2- 172.21.15.42:0/1556160018 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bbc0c8580 0x7f9bbc153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.081 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.092+0000 7f9bbad9d700 1 --2- 172.21.15.42:0/1556160018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bbc1531a0 0x7f9bbc15a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.081 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.092+0000 7f9bba59c700 1 -- 172.21.15.42:0/1556160018 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bbc0c8580 msgr2=0x7f9bbc153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.081 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.092+0000 7f9bba59c700 1 --2- 172.21.15.42:0/1556160018 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bbc0c8580 0x7f9bbc153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.081 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.092+0000 7f9bba59c700 1 -- 172.21.15.42:0/1556160018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bbc1531a0 msgr2=0x7f9bbc15a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.082 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.092+0000 7f9bba59c700 1 --2- 172.21.15.42:0/1556160018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bbc1531a0 0x7f9bbc15a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.082 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.092+0000 7f9bba59c700 1 -- 172.21.15.42:0/1556160018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac009550 con 0x7f9bbc071840 2023-07-29T02:06:25.082 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.092+0000 7f9bba59c700 1 --2- 172.21.15.42:0/1556160018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bbc071840 0x7f9bbc1538e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000e9b0 tx=0x7f9bb000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:25.082 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.093+0000 7f9baaffd700 1 -- 172.21.15.42:0/1556160018 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0009710 con 0x7f9bbc071840 2023-07-29T02:06:25.082 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.093+0000 7f9baaffd700 1 -- 172.21.15.42:0/1556160018 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb000ee50 con 0x7f9bbc071840 2023-07-29T02:06:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.093+0000 7f9bc0f06700 1 -- 172.21.15.42:0/1556160018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bbc155190 con 0x7f9bbc071840 2023-07-29T02:06:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.093+0000 7f9baaffd700 1 -- 172.21.15.42:0/1556160018 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb000ca50 con 0x7f9bbc071840 2023-07-29T02:06:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.093+0000 7f9bc0f06700 1 -- 172.21.15.42:0/1556160018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bbc155750 con 0x7f9bbc071840 2023-07-29T02:06:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.094+0000 7f9bc0f06700 1 -- 172.21.15.42:0/1556160018 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bbc04ea50 con 0x7f9bbc071840 2023-07-29T02:06:25.083 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.094+0000 7f9baaffd700 1 -- 172.21.15.42:0/1556160018 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f9bb000cbb0 con 0x7f9bbc071840 2023-07-29T02:06:25.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.094+0000 7f9baaffd700 1 --2- 172.21.15.42:0/1556160018 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9b9c06a660 0x7f9b9c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.095+0000 7f9baaffd700 1 -- 172.21.15.42:0/1556160018 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f9bb0088ef0 con 0x7f9bbc071840 2023-07-29T02:06:25.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.095+0000 7f9bb9d9b700 1 --2- 172.21.15.42:0/1556160018 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9b9c06a660 0x7f9b9c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.084 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.095+0000 7f9bb9d9b700 1 --2- 172.21.15.42:0/1556160018 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9b9c06a660 0x7f9b9c06cb10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009c40 tx=0x7f9bac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:25.085 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.099+0000 7f9baaffd700 1 -- 172.21.15.42:0/1556160018 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f9bb0057960 con 0x7f9bbc071840 2023-07-29T02:06:25.282 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.301+0000 7f9bc0f06700 1 -- 172.21.15.42:0/1556160018 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f9bbc06d730 con 0x7f9b9c06a660 2023-07-29T02:06:25.283 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.301+0000 7f9baaffd700 1 -- 172.21.15.42:0/1556160018 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9bac011c00 con 0x7f9b9c06a660 2023-07-29T02:06:25.285 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.303+0000 7f9bc0f06700 1 -- 172.21.15.42:0/1556160018 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9b9c06a660 msgr2=0x7f9b9c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.286 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.303+0000 7f9bc0f06700 1 --2- 172.21.15.42:0/1556160018 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9b9c06a660 0x7f9b9c06cb10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009c40 tx=0x7f9bac008030 comp rx=0 tx=0).stop 2023-07-29T02:06:25.286 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.303+0000 7f9bc0f06700 1 -- 172.21.15.42:0/1556160018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bbc071840 msgr2=0x7f9bbc1538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.286 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.303+0000 7f9bc0f06700 1 --2- 172.21.15.42:0/1556160018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bbc071840 0x7f9bbc1538e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000e9b0 tx=0x7f9bb000ecc0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.287 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.303+0000 7f9bc0f06700 1 -- 172.21.15.42:0/1556160018 shutdown_connections 2023-07-29T02:06:25.287 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.303+0000 7f9bc0f06700 1 --2- 172.21.15.42:0/1556160018 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f9b9c06a660 0x7f9b9c06cb10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.288 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.303+0000 7f9bc0f06700 1 --2- 172.21.15.42:0/1556160018 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9bbc1531a0 0x7f9bbc15a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.288 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.303+0000 7f9bc0f06700 1 --2- 172.21.15.42:0/1556160018 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f9bbc071840 0x7f9bbc1538e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.288 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.303+0000 7f9bc0f06700 1 --2- 172.21.15.42:0/1556160018 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f9bbc0c8580 0x7f9bbc153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.303+0000 7f9bc0f06700 1 -- 172.21.15.42:0/1556160018 >> 172.21.15.42:0/1556160018 conn(0x7f9bbc0cbf10 msgr2=0x7f9bbc14d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:25.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.304+0000 7f9bc0f06700 1 -- 172.21.15.42:0/1556160018 shutdown_connections 2023-07-29T02:06:25.289 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.304+0000 7f9bc0f06700 1 -- 172.21.15.42:0/1556160018 wait complete. 2023-07-29T02:06:25.290 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 6 to deep-scrub 2023-07-29T02:06:25.297 INFO:tasks.ceph:Scrubbing osd.7 2023-07-29T02:06:25.297 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-07-29T02:06:25.426 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.445+0000 7f2e5af1d700 1 Processor -- start 2023-07-29T02:06:25.427 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.445+0000 7f2e5af1d700 1 -- start start 2023-07-29T02:06:25.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.446+0000 7f2e5af1d700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f2e540c1d50 0x7f2e540c6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.435 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.446+0000 7f2e5af1d700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e540c18c0 con 0x7f2e54159810 2023-07-29T02:06:25.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.446+0000 7f2e5af1d700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e540c0fd0 con 0x7f2e54159440 2023-07-29T02:06:25.436 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.446+0000 7f2e5af1d700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e54071e90 con 0x7f2e540c1d50 2023-07-29T02:06:25.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.446+0000 7f2e594ba700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f2e54159810 0x7f2e54152eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52340/0 (socket says 172.21.15.42:52340) 2023-07-29T02:06:25.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.446+0000 7f2e594ba700 1 -- 172.21.15.42:0/3990944620 learned_addr learned my addr 172.21.15.42:0/3990944620 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:06:25.437 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.446+0000 7f2e53fff700 1 --2- 172.21.15.42:0/3990944620 >> v2:172.21.15.144:3300/0 conn(0x7f2e540c1d50 0x7f2e540c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.446+0000 7f2e537fe700 1 -- 172.21.15.42:0/3990944620 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115867280 0 0) 0x7f2e540c18c0 con 0x7f2e54159810 2023-07-29T02:06:25.438 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.446+0000 7f2e537fe700 1 -- 172.21.15.42:0/3990944620 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e440035b0 con 0x7f2e54159810 2023-07-29T02:06:25.439 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.446+0000 7f2e53fff700 1 -- 172.21.15.42:0/3990944620 >> v1:172.21.15.144:6789/0 conn(0x7f2e54159440 legacy=0x7f2e540c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.439 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.446+0000 7f2e537fe700 1 -- 172.21.15.42:0/3990944620 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3669288103 0 0) 0x7f2e440035b0 con 0x7f2e54159810 2023-07-29T02:06:25.439 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.446+0000 7f2e53fff700 1 -- 172.21.15.42:0/3990944620 >> v1:172.21.15.42:6789/0 conn(0x7f2e54159810 legacy=0x7f2e54152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.440 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.446+0000 7f2e53fff700 1 -- 172.21.15.42:0/3990944620 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e540c1270 con 0x7f2e540c1d50 2023-07-29T02:06:25.440 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.447+0000 7f2e53fff700 1 --2- 172.21.15.42:0/3990944620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e540c1d50 0x7f2e540c6880 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009840 tx=0x7f2e40009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79088b0bdba119dd server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:25.441 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.447+0000 7f2e537fe700 1 -- 172.21.15.42:0/3990944620 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4c0019f0 con 0x7f2e540c1d50 2023-07-29T02:06:25.441 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.447+0000 7f2e537fe700 1 -- 172.21.15.42:0/3990944620 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e40004030 con 0x7f2e540c1d50 2023-07-29T02:06:25.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.447+0000 7f2e537fe700 1 -- 172.21.15.42:0/3990944620 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e400043c0 con 0x7f2e540c1d50 2023-07-29T02:06:25.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.447+0000 7f2e5af1d700 1 -- 172.21.15.42:0/3990944620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e540c1d50 msgr2=0x7f2e540c6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.447+0000 7f2e5af1d700 1 --2- 172.21.15.42:0/3990944620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e540c1d50 0x7f2e540c6880 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009840 tx=0x7f2e40009b50 comp rx=0 tx=0).stop 2023-07-29T02:06:25.443 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.447+0000 7f2e5af1d700 1 -- 172.21.15.42:0/3990944620 shutdown_connections 2023-07-29T02:06:25.443 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.447+0000 7f2e5af1d700 1 --2- 172.21.15.42:0/3990944620 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e540c1d50 0x7f2e540c6880 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.444 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.447+0000 7f2e5af1d700 1 -- 172.21.15.42:0/3990944620 >> 172.21.15.42:0/3990944620 conn(0x7f2e540c8980 msgr2=0x7f2e540c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:25.444 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.447+0000 7f2e5af1d700 1 -- 172.21.15.42:0/3990944620 shutdown_connections 2023-07-29T02:06:25.445 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.447+0000 7f2e5af1d700 1 -- 172.21.15.42:0/3990944620 wait complete. 2023-07-29T02:06:25.445 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.449+0000 7f2e5af1d700 1 Processor -- start 2023-07-29T02:06:25.445 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.449+0000 7f2e5af1d700 1 -- start start 2023-07-29T02:06:25.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.450+0000 7f2e5af1d700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e540c1d50 0x7f2e541ee570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.446 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.450+0000 7f2e5af1d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e54159440 0x7f2e540c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.447 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.450+0000 7f2e5af1d700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e54159810 0x7f2e5406cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.447 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.450+0000 7f2e5af1d700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540af670 con 0x7f2e54159440 2023-07-29T02:06:25.447 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.450+0000 7f2e5af1d700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e540c3700 con 0x7f2e54159810 2023-07-29T02:06:25.448 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.450+0000 7f2e5af1d700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e541ef510 con 0x7f2e540c1d50 2023-07-29T02:06:25.448 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.450+0000 7f2e53fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e54159440 0x7f2e540c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.448 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.450+0000 7f2e53fff700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e54159440 0x7f2e540c3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58540/0 (socket says 172.21.15.42:58540) 2023-07-29T02:06:25.449 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.450+0000 7f2e53fff700 1 -- 172.21.15.42:0/3033947454 learned_addr learned my addr 172.21.15.42:0/3033947454 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:25.449 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.450+0000 7f2e58cb9700 1 --2- 172.21.15.42:0/3033947454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e540c1d50 0x7f2e541ee570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.449 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.450+0000 7f2e594ba700 1 --2- 172.21.15.42:0/3033947454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e54159810 0x7f2e5406cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.449 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.451+0000 7f2e53fff700 1 -- 172.21.15.42:0/3033947454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e540c1d50 msgr2=0x7f2e541ee570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.449 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.451+0000 7f2e53fff700 1 --2- 172.21.15.42:0/3033947454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e540c1d50 0x7f2e541ee570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.450 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.451+0000 7f2e53fff700 1 -- 172.21.15.42:0/3033947454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e54159810 msgr2=0x7f2e5406cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.450 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.451+0000 7f2e53fff700 1 --2- 172.21.15.42:0/3033947454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2e54159810 0x7f2e5406cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.450 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.451+0000 7f2e53fff700 1 -- 172.21.15.42:0/3033947454 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e400094a0 con 0x7f2e54159440 2023-07-29T02:06:25.450 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.451+0000 7f2e58cb9700 1 --2- 172.21.15.42:0/3033947454 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f2e540c1d50 0x7f2e541ee570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:06:25.450 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.451+0000 7f2e53fff700 1 --2- 172.21.15.42:0/3033947454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e54159440 0x7f2e540c3b90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009b90 tx=0x7f2e40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:25.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.451+0000 7f2e517fa700 1 -- 172.21.15.42:0/3033947454 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40011630 con 0x7f2e54159440 2023-07-29T02:06:25.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.451+0000 7f2e517fa700 1 -- 172.21.15.42:0/3033947454 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4001f070 con 0x7f2e54159440 2023-07-29T02:06:25.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.451+0000 7f2e5af1d700 1 -- 172.21.15.42:0/3033947454 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e541eec70 con 0x7f2e54159440 2023-07-29T02:06:25.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.451+0000 7f2e517fa700 1 -- 172.21.15.42:0/3033947454 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e400119f0 con 0x7f2e54159440 2023-07-29T02:06:25.451 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.451+0000 7f2e5af1d700 1 -- 172.21.15.42:0/3033947454 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e541ef230 con 0x7f2e54159440 2023-07-29T02:06:25.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.452+0000 7f2e5af1d700 1 -- 172.21.15.42:0/3033947454 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2e54072170 con 0x7f2e54159440 2023-07-29T02:06:25.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.452+0000 7f2e517fa700 1 -- 172.21.15.42:0/3033947454 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f2e40011b50 con 0x7f2e54159440 2023-07-29T02:06:25.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.453+0000 7f2e517fa700 1 --2- 172.21.15.42:0/3033947454 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2e3806a660 0x7f2e3806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.453+0000 7f2e517fa700 1 -- 172.21.15.42:0/3033947454 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f2e40021070 con 0x7f2e54159440 2023-07-29T02:06:25.452 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.453+0000 7f2e58cb9700 1 --2- 172.21.15.42:0/3033947454 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2e3806a660 0x7f2e3806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.453+0000 7f2e517fa700 1 --2- 172.21.15.42:0/3033947454 >> [v2:172.21.15.144:6816/131507,v1:172.21.15.144:6817/131507] conn(0x7f2e38074470 0x7f2e380768c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.453+0000 7f2e517fa700 1 -- 172.21.15.42:0/3033947454 --> [v2:172.21.15.144:6816/131507,v1:172.21.15.144:6817/131507] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2e38076f90 con 0x7f2e38074470 2023-07-29T02:06:25.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.453+0000 7f2e517fa700 1 -- 172.21.15.42:0/3033947454 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e4008ce40 con 0x7f2e54159440 2023-07-29T02:06:25.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.453+0000 7f2e594ba700 1 --2- 172.21.15.42:0/3033947454 >> [v2:172.21.15.144:6816/131507,v1:172.21.15.144:6817/131507] conn(0x7f2e38074470 0x7f2e380768c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.453 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.453+0000 7f2e58cb9700 1 --2- 172.21.15.42:0/3033947454 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2e3806a660 0x7f2e3806cb10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2e48007fd0 tx=0x7f2e48009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:25.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.454+0000 7f2e594ba700 1 --2- 172.21.15.42:0/3033947454 >> [v2:172.21.15.144:6816/131507,v1:172.21.15.144:6817/131507] conn(0x7f2e38074470 0x7f2e380768c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:25.454 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.454+0000 7f2e517fa700 1 -- 172.21.15.42:0/3033947454 <== osd.7 v2:172.21.15.144:6816/131507 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2e38076f90 con 0x7f2e38074470 2023-07-29T02:06:25.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.469+0000 7f2e5af1d700 1 -- 172.21.15.42:0/3033947454 --> [v2:172.21.15.144:6816/131507,v1:172.21.15.144:6817/131507] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2e54071b70 con 0x7f2e38074470 2023-07-29T02:06:25.455 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.469+0000 7f2e517fa700 1 -- 172.21.15.42:0/3033947454 <== osd.7 v2:172.21.15.144:6816/131507 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2e4c0071c0 con 0x7f2e38074470 2023-07-29T02:06:25.456 INFO:teuthology.orchestra.run.smithi042.stdout:{ 2023-07-29T02:06:25.456 INFO:teuthology.orchestra.run.smithi042.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-29T02:06:25.456 INFO:teuthology.orchestra.run.smithi042.stdout:} 2023-07-29T02:06:25.458 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.469+0000 7f2e5af1d700 1 -- 172.21.15.42:0/3033947454 >> [v2:172.21.15.144:6816/131507,v1:172.21.15.144:6817/131507] conn(0x7f2e38074470 msgr2=0x7f2e380768c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.469+0000 7f2e5af1d700 1 --2- 172.21.15.42:0/3033947454 >> [v2:172.21.15.144:6816/131507,v1:172.21.15.144:6817/131507] conn(0x7f2e38074470 0x7f2e380768c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.469+0000 7f2e5af1d700 1 -- 172.21.15.42:0/3033947454 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2e3806a660 msgr2=0x7f2e3806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.459 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.469+0000 7f2e5af1d700 1 --2- 172.21.15.42:0/3033947454 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f2e3806a660 0x7f2e3806cb10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2e48007fd0 tx=0x7f2e48009040 comp rx=0 tx=0).stop 2023-07-29T02:06:25.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.469+0000 7f2e5af1d700 1 -- 172.21.15.42:0/3033947454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e54159440 msgr2=0x7f2e540c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.460 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.469+0000 7f2e5af1d700 1 --2- 172.21.15.42:0/3033947454 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f2e54159440 0x7f2e540c3b90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009b90 tx=0x7f2e40004750 comp rx=0 tx=0).stop 2023-07-29T02:06:25.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.469+0000 7f2e594ba700 1 -- 172.21.15.42:0/3033947454 reap_dead start 2023-07-29T02:06:25.461 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.470+0000 7f2e5af1d700 1 -- 172.21.15.42:0/3033947454 shutdown_connections 2023-07-29T02:06:25.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.470+0000 7f2e5af1d700 1 -- 172.21.15.42:0/3033947454 >> 172.21.15.42:0/3033947454 conn(0x7f2e540c8980 msgr2=0x7f2e54150ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:25.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.470+0000 7f2e5af1d700 1 -- 172.21.15.42:0/3033947454 shutdown_connections 2023-07-29T02:06:25.462 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.470+0000 7f2e5af1d700 1 -- 172.21.15.42:0/3033947454 wait complete. 2023-07-29T02:06:25.464 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-07-29T02:06:25.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.609+0000 7f5e410c9700 1 Processor -- start 2023-07-29T02:06:25.590 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.609+0000 7f5e410c9700 1 -- start start 2023-07-29T02:06:25.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.610+0000 7f5e410c9700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5e3c070bb0 0x7f5e3c159950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.610+0000 7f5e410c9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e3c070f80 0x7f5e3c0c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.610+0000 7f5e410c9700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3c0c6c80 con 0x7f5e3c152c50 2023-07-29T02:06:25.592 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.610+0000 7f5e410c9700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e3c0c7520 con 0x7f5e3c070bb0 2023-07-29T02:06:25.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.610+0000 7f5e410c9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c159e90 con 0x7f5e3c070f80 2023-07-29T02:06:25.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.610+0000 7f5e3ad9d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5e3c070bb0 0x7f5e3c159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.610+0000 7f5e3ad9d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5e3c070bb0 0x7f5e3c159950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58548/0 (socket says 172.21.15.42:58548) 2023-07-29T02:06:25.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.610+0000 7f5e3ad9d700 1 -- 172.21.15.42:0/1922996973 learned_addr learned my addr 172.21.15.42:0/1922996973 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:25.593 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.610+0000 7f5e3a59c700 1 --2- 172.21.15.42:0/1922996973 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e3c070f80 0x7f5e3c0c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.610+0000 7f5e3ad9d700 1 -- 172.21.15.42:0/1922996973 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e3c070f80 msgr2=0x7f5e3c0c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:25.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.610+0000 7f5e3ad9d700 1 --2- 172.21.15.42:0/1922996973 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e3c070f80 0x7f5e3c0c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.610+0000 7f5e3ad9d700 1 -- 172.21.15.42:0/1922996973 >> v1:172.21.15.144:6789/0 conn(0x7f5e3c152c50 legacy=0x7f5e3c1530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.610+0000 7f5e3ad9d700 1 -- 172.21.15.42:0/1922996973 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c0723f0 con 0x7f5e3c070bb0 2023-07-29T02:06:25.594 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.611+0000 7f5e3ad9d700 1 --2- 172.21.15.42:0/1922996973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c070bb0 0x7f5e3c159950 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c0098f0 tx=0x7f5e2c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bbc7e7079307c1f server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:25.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.612+0000 7f5e39d9b700 1 -- 172.21.15.42:0/1922996973 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c011830 con 0x7f5e3c070bb0 2023-07-29T02:06:25.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.612+0000 7f5e39d9b700 1 -- 172.21.15.42:0/1922996973 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c011990 con 0x7f5e3c070bb0 2023-07-29T02:06:25.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.612+0000 7f5e39d9b700 1 -- 172.21.15.42:0/1922996973 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c011d20 con 0x7f5e3c070bb0 2023-07-29T02:06:25.597 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.612+0000 7f5e410c9700 1 -- 172.21.15.42:0/1922996973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c070bb0 msgr2=0x7f5e3c159950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.598 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.612+0000 7f5e410c9700 1 --2- 172.21.15.42:0/1922996973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c070bb0 0x7f5e3c159950 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c0098f0 tx=0x7f5e2c009c00 comp rx=0 tx=0).stop 2023-07-29T02:06:25.598 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.613+0000 7f5e410c9700 1 -- 172.21.15.42:0/1922996973 shutdown_connections 2023-07-29T02:06:25.598 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.613+0000 7f5e410c9700 1 --2- 172.21.15.42:0/1922996973 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c070bb0 0x7f5e3c159950 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.599 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.613+0000 7f5e410c9700 1 --2- 172.21.15.42:0/1922996973 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e3c070f80 0x7f5e3c0c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.600 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.613+0000 7f5e410c9700 1 -- 172.21.15.42:0/1922996973 >> 172.21.15.42:0/1922996973 conn(0x7f5e3c0cc420 msgr2=0x7f5e3c0c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:25.601 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.613+0000 7f5e410c9700 1 -- 172.21.15.42:0/1922996973 shutdown_connections 2023-07-29T02:06:25.601 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.613+0000 7f5e410c9700 1 -- 172.21.15.42:0/1922996973 wait complete. 2023-07-29T02:06:25.601 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.614+0000 7f5e410c9700 1 Processor -- start 2023-07-29T02:06:25.602 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.614+0000 7f5e410c9700 1 -- start start 2023-07-29T02:06:25.602 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.615+0000 7f5e410c9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c070bb0 0x7f5e3c0c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.602 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.615+0000 7f5e410c9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e3c070f80 0x7f5e3c14a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.615+0000 7f5e410c9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e3c152c50 0x7f5e3c14ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.615+0000 7f5e410c9700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c159850 con 0x7f5e3c070bb0 2023-07-29T02:06:25.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.615+0000 7f5e410c9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c0bf610 con 0x7f5e3c152c50 2023-07-29T02:06:25.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.615+0000 7f5e410c9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3c0ca5e0 con 0x7f5e3c070f80 2023-07-29T02:06:25.604 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.615+0000 7f5e3ad9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c070bb0 0x7f5e3c0c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.604 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.615+0000 7f5e3ad9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c070bb0 0x7f5e3c0c1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58554/0 (socket says 172.21.15.42:58554) 2023-07-29T02:06:25.604 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.615+0000 7f5e3ad9d700 1 -- 172.21.15.42:0/1734491168 learned_addr learned my addr 172.21.15.42:0/1734491168 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:25.605 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.615+0000 7f5e3a59c700 1 --2- 172.21.15.42:0/1734491168 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e3c070f80 0x7f5e3c14a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.605 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.615+0000 7f5e3b59e700 1 --2- 172.21.15.42:0/1734491168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e3c152c50 0x7f5e3c14ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.605 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.615+0000 7f5e3ad9d700 1 -- 172.21.15.42:0/1734491168 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e3c070f80 msgr2=0x7f5e3c14a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.605 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.615+0000 7f5e3ad9d700 1 --2- 172.21.15.42:0/1734491168 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e3c070f80 0x7f5e3c14a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.605 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.615+0000 7f5e3ad9d700 1 -- 172.21.15.42:0/1734491168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e3c152c50 msgr2=0x7f5e3c14ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.606 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.615+0000 7f5e3ad9d700 1 --2- 172.21.15.42:0/1734491168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e3c152c50 0x7f5e3c14ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.606 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.615+0000 7f5e3ad9d700 1 -- 172.21.15.42:0/1734491168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2c009550 con 0x7f5e3c070bb0 2023-07-29T02:06:25.606 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.616+0000 7f5e3ad9d700 1 --2- 172.21.15.42:0/1734491168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c070bb0 0x7f5e3c0c1da0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009c40 tx=0x7f5e2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:25.606 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.616+0000 7f5e237fe700 1 -- 172.21.15.42:0/1734491168 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c004510 con 0x7f5e3c070bb0 2023-07-29T02:06:25.606 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.616+0000 7f5e237fe700 1 -- 172.21.15.42:0/1734491168 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c01e070 con 0x7f5e3c070bb0 2023-07-29T02:06:25.607 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.616+0000 7f5e410c9700 1 -- 172.21.15.42:0/1734491168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3c14a440 con 0x7f5e3c070bb0 2023-07-29T02:06:25.607 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.616+0000 7f5e237fe700 1 -- 172.21.15.42:0/1734491168 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c0038e0 con 0x7f5e3c070bb0 2023-07-29T02:06:25.608 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.616+0000 7f5e410c9700 1 -- 172.21.15.42:0/1734491168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3c0c22e0 con 0x7f5e3c070bb0 2023-07-29T02:06:25.608 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.617+0000 7f5e410c9700 1 -- 172.21.15.42:0/1734491168 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3c14a720 con 0x7f5e3c070bb0 2023-07-29T02:06:25.608 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.617+0000 7f5e237fe700 1 -- 172.21.15.42:0/1734491168 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f5e2c003a40 con 0x7f5e3c070bb0 2023-07-29T02:06:25.608 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.617+0000 7f5e237fe700 1 --2- 172.21.15.42:0/1734491168 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f5e2806a660 0x7f5e2806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.609 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.618+0000 7f5e237fe700 1 -- 172.21.15.42:0/1734491168 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f5e2c089e70 con 0x7f5e3c070bb0 2023-07-29T02:06:25.609 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.618+0000 7f5e3a59c700 1 --2- 172.21.15.42:0/1734491168 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f5e2806a660 0x7f5e2806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.609 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.618+0000 7f5e3a59c700 1 --2- 172.21.15.42:0/1734491168 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f5e2806a660 0x7f5e2806cb10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0cab70 tx=0x7f5e30009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:25.609 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.622+0000 7f5e237fe700 1 -- 172.21.15.42:0/1734491168 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f5e2c054e60 con 0x7f5e3c070bb0 2023-07-29T02:06:25.800 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.819+0000 7f5e410c9700 1 -- 172.21.15.42:0/1734491168 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e3c0c8da0 con 0x7f5e2806a660 2023-07-29T02:06:25.801 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.820+0000 7f5e237fe700 1 -- 172.21.15.42:0/1734491168 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5e300118e0 con 0x7f5e2806a660 2023-07-29T02:06:25.803 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.822+0000 7f5e410c9700 1 -- 172.21.15.42:0/1734491168 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f5e2806a660 msgr2=0x7f5e2806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.803 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.822+0000 7f5e410c9700 1 --2- 172.21.15.42:0/1734491168 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f5e2806a660 0x7f5e2806cb10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0cab70 tx=0x7f5e30009210 comp rx=0 tx=0).stop 2023-07-29T02:06:25.803 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.822+0000 7f5e410c9700 1 -- 172.21.15.42:0/1734491168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c070bb0 msgr2=0x7f5e3c0c1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.804 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.822+0000 7f5e410c9700 1 --2- 172.21.15.42:0/1734491168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c070bb0 0x7f5e3c0c1da0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009c40 tx=0x7f5e2c004750 comp rx=0 tx=0).stop 2023-07-29T02:06:25.804 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.822+0000 7f5e410c9700 1 -- 172.21.15.42:0/1734491168 shutdown_connections 2023-07-29T02:06:25.804 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.822+0000 7f5e410c9700 1 --2- 172.21.15.42:0/1734491168 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f5e2806a660 0x7f5e2806cb10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.804 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.822+0000 7f5e410c9700 1 --2- 172.21.15.42:0/1734491168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5e3c152c50 0x7f5e3c14ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.804 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.822+0000 7f5e410c9700 1 --2- 172.21.15.42:0/1734491168 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5e3c070bb0 0x7f5e3c0c1da0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.822+0000 7f5e410c9700 1 --2- 172.21.15.42:0/1734491168 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5e3c070f80 0x7f5e3c14a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.822+0000 7f5e410c9700 1 -- 172.21.15.42:0/1734491168 >> 172.21.15.42:0/1734491168 conn(0x7f5e3c0cc420 msgr2=0x7f5e3c0c8300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.822+0000 7f5e410c9700 1 -- 172.21.15.42:0/1734491168 shutdown_connections 2023-07-29T02:06:25.805 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.822+0000 7f5e410c9700 1 -- 172.21.15.42:0/1734491168 wait complete. 2023-07-29T02:06:25.806 INFO:teuthology.orchestra.run.smithi042.stderr:instructed osd(s) 7 to deep-scrub 2023-07-29T02:06:25.815 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T02:06:25.944 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.960+0000 7fc17c79c700 1 Processor -- start 2023-07-29T02:06:25.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.960+0000 7fc17c79c700 1 -- start start 2023-07-29T02:06:25.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.961+0000 7fc17c79c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fc174153210 0x7fc1740c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.961+0000 7fc17c79c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1740cc820 0x7fc17415c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.945 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.961+0000 7fc17c79c700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1740c7b00 con 0x7fc1740c6980 2023-07-29T02:06:25.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.961+0000 7fc17c79c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc174159be0 con 0x7fc174153210 2023-07-29T02:06:25.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.961+0000 7fc17c79c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc174159ec0 con 0x7fc1740cc820 2023-07-29T02:06:25.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.961+0000 7fc17ad39700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fc1740c6980 0x7fc17415cb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52370/0 (socket says 172.21.15.42:52370) 2023-07-29T02:06:25.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.961+0000 7fc17ad39700 1 -- 172.21.15.42:0/1616389693 learned_addr learned my addr 172.21.15.42:0/1616389693 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:06:25.946 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.961+0000 7fc179d37700 1 --2- 172.21.15.42:0/1616389693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1740cc820 0x7fc17415c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.961+0000 7fc17a538700 1 --2- 172.21.15.42:0/1616389693 >> v2:172.21.15.144:3300/0 conn(0x7fc174153210 0x7fc1740c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.961+0000 7fc179536700 1 -- 172.21.15.42:0/1616389693 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1991494846 0 0) 0x7fc1740c7b00 con 0x7fc1740c6980 2023-07-29T02:06:25.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.961+0000 7fc179536700 1 -- 172.21.15.42:0/1616389693 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1600035b0 con 0x7fc1740c6980 2023-07-29T02:06:25.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.962+0000 7fc17a538700 1 -- 172.21.15.42:0/1616389693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1740cc820 msgr2=0x7fc17415c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:25.947 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.962+0000 7fc17a538700 1 --2- 172.21.15.42:0/1616389693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1740cc820 0x7fc17415c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.962+0000 7fc17a538700 1 -- 172.21.15.42:0/1616389693 >> v1:172.21.15.42:6789/0 conn(0x7fc1740c6980 legacy=0x7fc17415cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.962+0000 7fc17a538700 1 -- 172.21.15.42:0/1616389693 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1740c71d0 con 0x7fc174153210 2023-07-29T02:06:25.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.962+0000 7fc179d37700 1 --2- 172.21.15.42:0/1616389693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1740cc820 0x7fc17415c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:06:25.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.962+0000 7fc17a538700 1 --2- 172.21.15.42:0/1616389693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc174153210 0x7fc1740c7f90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc168009840 tx=0x7fc168009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79b0c0ff1fdc4d6d server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:25.948 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.962+0000 7fc179536700 1 -- 172.21.15.42:0/1616389693 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc168011830 con 0x7fc174153210 2023-07-29T02:06:25.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.962+0000 7fc179536700 1 -- 172.21.15.42:0/1616389693 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc168011990 con 0x7fc174153210 2023-07-29T02:06:25.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.962+0000 7fc179536700 1 -- 172.21.15.42:0/1616389693 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc168011d20 con 0x7fc174153210 2023-07-29T02:06:25.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.962+0000 7fc17c79c700 1 -- 172.21.15.42:0/1616389693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc174153210 msgr2=0x7fc1740c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.962+0000 7fc17c79c700 1 --2- 172.21.15.42:0/1616389693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc174153210 0x7fc1740c7f90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc168009840 tx=0x7fc168009b50 comp rx=0 tx=0).stop 2023-07-29T02:06:25.949 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.963+0000 7fc17c79c700 1 -- 172.21.15.42:0/1616389693 shutdown_connections 2023-07-29T02:06:25.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.963+0000 7fc17c79c700 1 --2- 172.21.15.42:0/1616389693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc174153210 0x7fc1740c7f90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.963+0000 7fc17c79c700 1 --2- 172.21.15.42:0/1616389693 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1740cc820 0x7fc17415c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.963+0000 7fc17c79c700 1 -- 172.21.15.42:0/1616389693 >> 172.21.15.42:0/1616389693 conn(0x7fc17406f850 msgr2=0x7fc1740cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:25.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.963+0000 7fc17c79c700 1 -- 172.21.15.42:0/1616389693 shutdown_connections 2023-07-29T02:06:25.950 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.963+0000 7fc17c79c700 1 -- 172.21.15.42:0/1616389693 wait complete. 2023-07-29T02:06:25.952 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.964+0000 7fc17c79c700 1 Processor -- start 2023-07-29T02:06:25.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.964+0000 7fc17c79c700 1 -- start start 2023-07-29T02:06:25.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.965+0000 7fc17c79c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1740c6980 0x7fc17406bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.965+0000 7fc17c79c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc174153210 0x7fc1740c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.953 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.965+0000 7fc17c79c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1740c5e30 0x7fc1740c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.954 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.965+0000 7fc17c79c700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740c3c70 con 0x7fc1740c5e30 2023-07-29T02:06:25.954 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.965+0000 7fc17c79c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17414bca0 con 0x7fc174153210 2023-07-29T02:06:25.954 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.965+0000 7fc17c79c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17414bf60 con 0x7fc1740c6980 2023-07-29T02:06:25.954 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.965+0000 7fc17ad39700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1740c5e30 0x7fc1740c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.954 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.965+0000 7fc17ad39700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1740c5e30 0x7fc1740c4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58572/0 (socket says 172.21.15.42:58572) 2023-07-29T02:06:25.954 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.965+0000 7fc17ad39700 1 -- 172.21.15.42:0/988566834 learned_addr learned my addr 172.21.15.42:0/988566834 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:25.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.966+0000 7fc17a538700 1 --2- 172.21.15.42:0/988566834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1740c6980 0x7fc17406bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.966+0000 7fc179d37700 1 --2- 172.21.15.42:0/988566834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc174153210 0x7fc1740c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.966+0000 7fc17ad39700 1 -- 172.21.15.42:0/988566834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1740c6980 msgr2=0x7fc17406bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.966+0000 7fc17ad39700 1 --2- 172.21.15.42:0/988566834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1740c6980 0x7fc17406bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.955 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.966+0000 7fc17ad39700 1 -- 172.21.15.42:0/988566834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc174153210 msgr2=0x7fc1740c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:25.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.966+0000 7fc17ad39700 1 --2- 172.21.15.42:0/988566834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc174153210 0x7fc1740c5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:25.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.966+0000 7fc17ad39700 1 -- 172.21.15.42:0/988566834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1700094a0 con 0x7fc1740c5e30 2023-07-29T02:06:25.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.966+0000 7fc17ad39700 1 --2- 172.21.15.42:0/988566834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1740c5e30 0x7fc1740c4100 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00cb40 tx=0x7fc16c00cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:25.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.966+0000 7fc166ffd700 1 -- 172.21.15.42:0/988566834 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c00ab50 con 0x7fc1740c5e30 2023-07-29T02:06:25.956 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.966+0000 7fc166ffd700 1 -- 172.21.15.42:0/988566834 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c00acb0 con 0x7fc1740c5e30 2023-07-29T02:06:25.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.966+0000 7fc17c79c700 1 -- 172.21.15.42:0/988566834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1680094a0 con 0x7fc1740c5e30 2023-07-29T02:06:25.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.966+0000 7fc166ffd700 1 -- 172.21.15.42:0/988566834 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c012620 con 0x7fc1740c5e30 2023-07-29T02:06:25.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.966+0000 7fc17c79c700 1 -- 172.21.15.42:0/988566834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1740c3340 con 0x7fc1740c5e30 2023-07-29T02:06:25.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.967+0000 7fc17c79c700 1 -- 172.21.15.42:0/988566834 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1740c2f30 con 0x7fc1740c5e30 2023-07-29T02:06:25.957 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.967+0000 7fc166ffd700 1 -- 172.21.15.42:0/988566834 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fc16c01b3b0 con 0x7fc1740c5e30 2023-07-29T02:06:25.958 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.968+0000 7fc166ffd700 1 --2- 172.21.15.42:0/988566834 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc15806a660 0x7fc15806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:25.958 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.968+0000 7fc166ffd700 1 -- 172.21.15.42:0/988566834 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7fc16c088dc0 con 0x7fc1740c5e30 2023-07-29T02:06:25.958 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.968+0000 7fc17a538700 1 --2- 172.21.15.42:0/988566834 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc15806a660 0x7fc15806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:25.958 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.969+0000 7fc17a538700 1 --2- 172.21.15.42:0/988566834 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc15806a660 0x7fc15806cb10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc168009fd0 tx=0x7fc16801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:25.959 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:25.972+0000 7fc166ffd700 1 -- 172.21.15.42:0/988566834 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fc16c053d00 con 0x7fc1740c5e30 2023-07-29T02:06:26.151 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:26.170+0000 7fc17c79c700 1 -- 172.21.15.42:0/988566834 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1740c7790 con 0x7fc15806a660 2023-07-29T02:06:26.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:26.181+0000 7fc166ffd700 1 -- 172.21.15.42:0/988566834 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+393617 (secure 0 0 0) 0x7fc168011b00 con 0x7fc15806a660 2023-07-29T02:06:26.166 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:06:26.169 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:26.185+0000 7fc17c79c700 1 -- 172.21.15.42:0/988566834 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc15806a660 msgr2=0x7fc15806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:26.169 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:26.185+0000 7fc17c79c700 1 --2- 172.21.15.42:0/988566834 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc15806a660 0x7fc15806cb10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc168009fd0 tx=0x7fc16801c040 comp rx=0 tx=0).stop 2023-07-29T02:06:26.169 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:26.185+0000 7fc17c79c700 1 -- 172.21.15.42:0/988566834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1740c5e30 msgr2=0x7fc1740c4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:26.169 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:26.185+0000 7fc17c79c700 1 --2- 172.21.15.42:0/988566834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1740c5e30 0x7fc1740c4100 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00cb40 tx=0x7fc16c00cf00 comp rx=0 tx=0).stop 2023-07-29T02:06:26.170 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:26.185+0000 7fc17c79c700 1 -- 172.21.15.42:0/988566834 shutdown_connections 2023-07-29T02:06:26.170 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:26.185+0000 7fc17c79c700 1 --2- 172.21.15.42:0/988566834 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fc15806a660 0x7fc15806cb10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:26.170 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:26.185+0000 7fc17c79c700 1 --2- 172.21.15.42:0/988566834 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fc1740c5e30 0x7fc1740c4100 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:26.170 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:26.185+0000 7fc17c79c700 1 --2- 172.21.15.42:0/988566834 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fc1740c6980 0x7fc17406bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:26.170 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:26.185+0000 7fc17c79c700 1 --2- 172.21.15.42:0/988566834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc174153210 0x7fc1740c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:26.171 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:26.185+0000 7fc17c79c700 1 -- 172.21.15.42:0/988566834 >> 172.21.15.42:0/988566834 conn(0x7fc17406f850 msgr2=0x7fc174152440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:26.171 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:26.185+0000 7fc17c79c700 1 -- 172.21.15.42:0/988566834 shutdown_connections 2023-07-29T02:06:26.171 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:26.185+0000 7fc17c79c700 1 -- 172.21.15.42:0/988566834 wait complete. 2023-07-29T02:06:26.171 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2023-07-29T02:06:26.178 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":230,"stamp":"2023-07-29T02:06:25.341360+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1153107610,"num_objects":10300,"num_object_clones":0,"num_object_copies":40912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10300,"num_whiteouts":0,"num_read":1676,"num_read_kb":517458,"num_write":24607,"num_write_kb":1276486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30334,"ondisk_log_size":30334,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2521416,"kb_used_data":1857928,"kb_used_omap":0,"kb_used_meta":663424,"kb_avail":752453304,"statfs":{"total":773094113280,"available":770512183296,"internally_reserved":0,"allocated":1902518272,"data_stored":2424559413,"data_compressed":184105332,"data_compressed_allocated":215486464,"data_compressed_original":739377152,"omap_allocated":0,"internal_metadata":679346176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":36697771,"num_objects":7,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":627,"num_write_kb":36151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003070"},"pg_stats":[{"pgid":"4.3f","version":"39'86","reported_seq":2138,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.448677+0000","last_change":"2023-07-29T02:03:56.956160+0000","last_active":"2023-07-29T02:06:18.448677+0000","last_peered":"2023-07-29T02:06:18.448677+0000","last_clean":"2023-07-29T02:06:18.448677+0000","last_became_active":"2023-07-29T01:59:57.957742+0000","last_became_peered":"2023-07-29T01:59:57.957742+0000","last_unstale":"2023-07-29T02:06:18.448677+0000","last_undegraded":"2023-07-29T02:06:18.448677+0000","last_fullsized":"2023-07-29T02:06:18.448677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46739399700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"39'75","reported_seq":2126,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.442151+0000","last_change":"2023-07-29T02:03:56.795813+0000","last_active":"2023-07-29T02:06:18.442151+0000","last_peered":"2023-07-29T02:06:18.442151+0000","last_clean":"2023-07-29T02:06:18.442151+0000","last_became_active":"2023-07-29T01:59:57.974338+0000","last_became_peered":"2023-07-29T01:59:57.974338+0000","last_unstale":"2023-07-29T02:06:18.442151+0000","last_undegraded":"2023-07-29T02:06:18.442151+0000","last_fullsized":"2023-07-29T02:06:18.442151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30630966300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"39'90","reported_seq":2142,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.447905+0000","last_change":"2023-07-29T02:03:57.108039+0000","last_active":"2023-07-29T02:06:18.447905+0000","last_peered":"2023-07-29T02:06:18.447905+0000","last_clean":"2023-07-29T02:06:18.447905+0000","last_became_active":"2023-07-29T01:59:57.973406+0000","last_became_peered":"2023-07-29T01:59:57.973406+0000","last_unstale":"2023-07-29T02:06:18.447905+0000","last_undegraded":"2023-07-29T02:06:18.447905+0000","last_fullsized":"2023-07-29T02:06:18.447905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37359432399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"39'75","reported_seq":2126,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.444286+0000","last_change":"2023-07-29T02:03:56.955565+0000","last_active":"2023-07-29T02:06:18.444286+0000","last_peered":"2023-07-29T02:06:18.444286+0000","last_clean":"2023-07-29T02:06:18.444286+0000","last_became_active":"2023-07-29T01:59:57.964865+0000","last_became_peered":"2023-07-29T01:59:57.964865+0000","last_unstale":"2023-07-29T02:06:18.444286+0000","last_undegraded":"2023-07-29T02:06:18.444286+0000","last_fullsized":"2023-07-29T02:06:18.444286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:32.905717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22913951599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"39'102","reported_seq":2153,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.450814+0000","last_change":"2023-07-29T02:03:57.038137+0000","last_active":"2023-07-29T02:06:18.450814+0000","last_peered":"2023-07-29T02:06:18.450814+0000","last_clean":"2023-07-29T02:06:18.450814+0000","last_became_active":"2023-07-29T01:59:57.970733+0000","last_became_peered":"2023-07-29T01:59:57.970733+0000","last_unstale":"2023-07-29T02:06:18.450814+0000","last_undegraded":"2023-07-29T02:06:18.450814+0000","last_fullsized":"2023-07-29T02:06:18.450814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55358088100000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"39'92","reported_seq":2143,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.444391+0000","last_change":"2023-07-29T02:03:57.111935+0000","last_active":"2023-07-29T02:06:18.444391+0000","last_peered":"2023-07-29T02:06:18.444391+0000","last_clean":"2023-07-29T02:06:18.444391+0000","last_became_active":"2023-07-29T01:59:57.964993+0000","last_became_peered":"2023-07-29T01:59:57.964993+0000","last_unstale":"2023-07-29T02:06:18.444391+0000","last_undegraded":"2023-07-29T02:06:18.444391+0000","last_fullsized":"2023-07-29T02:06:18.444391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35033357399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"39'105","reported_seq":2155,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.439893+0000","last_change":"2023-07-29T02:03:56.697037+0000","last_active":"2023-07-29T02:06:18.439893+0000","last_peered":"2023-07-29T02:06:18.439893+0000","last_clean":"2023-07-29T02:06:18.439893+0000","last_became_active":"2023-07-29T01:59:57.970232+0000","last_became_peered":"2023-07-29T01:59:57.970232+0000","last_unstale":"2023-07-29T02:06:18.439893+0000","last_undegraded":"2023-07-29T02:06:18.439893+0000","last_fullsized":"2023-07-29T02:06:18.439893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18952802499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"39'74","reported_seq":2124,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.438373+0000","last_change":"2023-07-29T02:03:56.788754+0000","last_active":"2023-07-29T02:06:18.438373+0000","last_peered":"2023-07-29T02:06:18.438373+0000","last_clean":"2023-07-29T02:06:18.438373+0000","last_became_active":"2023-07-29T01:59:57.962884+0000","last_became_peered":"2023-07-29T01:59:57.962884+0000","last_unstale":"2023-07-29T02:06:18.438373+0000","last_undegraded":"2023-07-29T02:06:18.438373+0000","last_fullsized":"2023-07-29T02:06:18.438373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30152641200000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"39'84","reported_seq":2135,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.450858+0000","last_change":"2023-07-29T02:03:57.034522+0000","last_active":"2023-07-29T02:06:18.450858+0000","last_peered":"2023-07-29T02:06:18.450858+0000","last_clean":"2023-07-29T02:06:18.450858+0000","last_became_active":"2023-07-29T01:59:57.971640+0000","last_became_peered":"2023-07-29T01:59:57.971640+0000","last_unstale":"2023-07-29T02:06:18.450858+0000","last_undegraded":"2023-07-29T02:06:18.450858+0000","last_fullsized":"2023-07-29T02:06:18.450858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54966345000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"39'98","reported_seq":2148,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.436545+0000","last_change":"2023-07-29T02:03:56.796189+0000","last_active":"2023-07-29T02:06:18.436545+0000","last_peered":"2023-07-29T02:06:18.436545+0000","last_clean":"2023-07-29T02:06:18.436545+0000","last_became_active":"2023-07-29T01:59:57.962799+0000","last_became_peered":"2023-07-29T01:59:57.962799+0000","last_unstale":"2023-07-29T02:06:18.436545+0000","last_undegraded":"2023-07-29T02:06:18.436545+0000","last_fullsized":"2023-07-29T02:06:18.436545+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:30.005730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30635943199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"39'90","reported_seq":2141,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.447958+0000","last_change":"2023-07-29T02:03:57.107266+0000","last_active":"2023-07-29T02:06:18.447958+0000","last_peered":"2023-07-29T02:06:18.447958+0000","last_clean":"2023-07-29T02:06:18.447958+0000","last_became_active":"2023-07-29T01:59:57.969868+0000","last_became_peered":"2023-07-29T01:59:57.969868+0000","last_unstale":"2023-07-29T02:06:18.447958+0000","last_undegraded":"2023-07-29T02:06:18.447958+0000","last_fullsized":"2023-07-29T02:06:18.447958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37294171199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"39'76","reported_seq":2127,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.439676+0000","last_change":"2023-07-29T02:03:56.957883+0000","last_active":"2023-07-29T02:06:18.439676+0000","last_peered":"2023-07-29T02:06:18.439676+0000","last_clean":"2023-07-29T02:06:18.439676+0000","last_became_active":"2023-07-29T01:59:57.963902+0000","last_became_peered":"2023-07-29T01:59:57.963902+0000","last_unstale":"2023-07-29T02:06:18.439676+0000","last_undegraded":"2023-07-29T02:06:18.439676+0000","last_fullsized":"2023-07-29T02:06:18.439676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46909700500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"39'81","reported_seq":2132,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.448857+0000","last_change":"2023-07-29T02:03:56.954586+0000","last_active":"2023-07-29T02:06:18.448857+0000","last_peered":"2023-07-29T02:06:18.448857+0000","last_clean":"2023-07-29T02:06:18.448857+0000","last_became_active":"2023-07-29T01:59:57.963239+0000","last_became_peered":"2023-07-29T01:59:57.963239+0000","last_unstale":"2023-07-29T02:06:18.448857+0000","last_undegraded":"2023-07-29T02:06:18.448857+0000","last_fullsized":"2023-07-29T02:06:18.448857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46603159700000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"39'92","reported_seq":2142,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.433369+0000","last_change":"2023-07-29T02:03:56.789592+0000","last_active":"2023-07-29T02:06:18.433369+0000","last_peered":"2023-07-29T02:06:18.433369+0000","last_clean":"2023-07-29T02:06:18.433369+0000","last_became_active":"2023-07-29T01:59:57.960709+0000","last_became_peered":"2023-07-29T01:59:57.960709+0000","last_unstale":"2023-07-29T02:06:18.433369+0000","last_undegraded":"2023-07-29T02:06:18.433369+0000","last_fullsized":"2023-07-29T02:06:18.433369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:24:50.436552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30181124199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"39'85","reported_seq":2135,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.443204+0000","last_change":"2023-07-29T02:03:56.696099+0000","last_active":"2023-07-29T02:06:18.443204+0000","last_peered":"2023-07-29T02:06:18.443204+0000","last_clean":"2023-07-29T02:06:18.443204+0000","last_became_active":"2023-07-29T01:59:57.970263+0000","last_became_peered":"2023-07-29T01:59:57.970263+0000","last_unstale":"2023-07-29T02:06:18.443204+0000","last_undegraded":"2023-07-29T02:06:18.443204+0000","last_fullsized":"2023-07-29T02:06:18.443204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:17.824009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18892089500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"39'97","reported_seq":2148,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.447954+0000","last_change":"2023-07-29T02:03:57.113982+0000","last_active":"2023-07-29T02:06:18.447954+0000","last_peered":"2023-07-29T02:06:18.447954+0000","last_clean":"2023-07-29T02:06:18.447954+0000","last_became_active":"2023-07-29T01:59:57.964696+0000","last_became_peered":"2023-07-29T01:59:57.964696+0000","last_unstale":"2023-07-29T02:06:18.447954+0000","last_undegraded":"2023-07-29T02:06:18.447954+0000","last_fullsized":"2023-07-29T02:06:18.447954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.32990576199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"39'94","reported_seq":2145,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.450594+0000","last_change":"2023-07-29T02:03:57.029741+0000","last_active":"2023-07-29T02:06:18.450594+0000","last_peered":"2023-07-29T02:06:18.450594+0000","last_clean":"2023-07-29T02:06:18.450594+0000","last_became_active":"2023-07-29T01:59:57.968885+0000","last_became_peered":"2023-07-29T01:59:57.968885+0000","last_unstale":"2023-07-29T02:06:18.450594+0000","last_undegraded":"2023-07-29T02:06:18.450594+0000","last_fullsized":"2023-07-29T02:06:18.450594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54488360899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"39'88","reported_seq":2139,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.445713+0000","last_change":"2023-07-29T02:03:57.081083+0000","last_active":"2023-07-29T02:06:18.445713+0000","last_peered":"2023-07-29T02:06:18.445713+0000","last_clean":"2023-07-29T02:06:18.445713+0000","last_became_active":"2023-07-29T01:59:57.962919+0000","last_became_peered":"2023-07-29T01:59:57.962919+0000","last_unstale":"2023-07-29T02:06:18.445713+0000","last_undegraded":"2023-07-29T02:06:18.445713+0000","last_fullsized":"2023-07-29T02:06:18.445713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36591080100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"39'85","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.437893+0000","last_change":"2023-07-29T02:03:56.960427+0000","last_active":"2023-07-29T02:06:18.437893+0000","last_peered":"2023-07-29T02:06:18.437893+0000","last_clean":"2023-07-29T02:06:18.437893+0000","last_became_active":"2023-07-29T01:59:57.960111+0000","last_became_peered":"2023-07-29T01:59:57.960111+0000","last_unstale":"2023-07-29T02:06:18.437893+0000","last_undegraded":"2023-07-29T02:06:18.437893+0000","last_fullsized":"2023-07-29T02:06:18.437893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.47199195399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"39'98","reported_seq":2149,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.438597+0000","last_change":"2023-07-29T02:03:57.111175+0000","last_active":"2023-07-29T02:06:18.438597+0000","last_peered":"2023-07-29T02:06:18.438597+0000","last_clean":"2023-07-29T02:06:18.438597+0000","last_became_active":"2023-07-29T01:59:57.961655+0000","last_became_peered":"2023-07-29T01:59:57.961655+0000","last_unstale":"2023-07-29T02:06:18.438597+0000","last_undegraded":"2023-07-29T02:06:18.438597+0000","last_fullsized":"2023-07-29T02:06:18.438597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36267924800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"39'89","reported_seq":2139,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.450289+0000","last_change":"2023-07-29T02:03:56.694890+0000","last_active":"2023-07-29T02:06:18.450289+0000","last_peered":"2023-07-29T02:06:18.450289+0000","last_clean":"2023-07-29T02:06:18.450289+0000","last_became_active":"2023-07-29T01:59:57.970757+0000","last_became_peered":"2023-07-29T01:59:57.970757+0000","last_unstale":"2023-07-29T02:06:18.450289+0000","last_undegraded":"2023-07-29T02:06:18.450289+0000","last_fullsized":"2023-07-29T02:06:18.450289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18738185399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"39'95","reported_seq":2146,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.447500+0000","last_change":"2023-07-29T02:03:57.025876+0000","last_active":"2023-07-29T02:06:18.447500+0000","last_peered":"2023-07-29T02:06:18.447500+0000","last_clean":"2023-07-29T02:06:18.447500+0000","last_became_active":"2023-07-29T01:59:57.974436+0000","last_became_peered":"2023-07-29T01:59:57.974436+0000","last_unstale":"2023-07-29T02:06:18.447500+0000","last_undegraded":"2023-07-29T02:06:18.447500+0000","last_fullsized":"2023-07-29T02:06:18.447500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54184882499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"39'92","reported_seq":2143,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.450448+0000","last_change":"2023-07-29T02:03:57.173218+0000","last_active":"2023-07-29T02:06:18.450448+0000","last_peered":"2023-07-29T02:06:18.450448+0000","last_clean":"2023-07-29T02:06:18.450448+0000","last_became_active":"2023-07-29T01:59:57.966987+0000","last_became_peered":"2023-07-29T01:59:57.966987+0000","last_unstale":"2023-07-29T02:06:18.450448+0000","last_undegraded":"2023-07-29T02:06:18.450448+0000","last_fullsized":"2023-07-29T02:06:18.450448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38162062000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"39'92","reported_seq":2142,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.449078+0000","last_change":"2023-07-29T02:03:56.697590+0000","last_active":"2023-07-29T02:06:18.449078+0000","last_peered":"2023-07-29T02:06:18.449078+0000","last_clean":"2023-07-29T02:06:18.449078+0000","last_became_active":"2023-07-29T01:59:57.971733+0000","last_became_peered":"2023-07-29T01:59:57.971733+0000","last_unstale":"2023-07-29T02:06:18.449078+0000","last_undegraded":"2023-07-29T02:06:18.449078+0000","last_fullsized":"2023-07-29T02:06:18.449078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:09:58.375394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.189164111,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"39'83","reported_seq":2134,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.436107+0000","last_change":"2023-07-29T02:03:57.054022+0000","last_active":"2023-07-29T02:06:18.436107+0000","last_peered":"2023-07-29T02:06:18.436107+0000","last_clean":"2023-07-29T02:06:18.436107+0000","last_became_active":"2023-07-29T01:59:57.969742+0000","last_became_peered":"2023-07-29T01:59:57.969742+0000","last_unstale":"2023-07-29T02:06:18.436107+0000","last_undegraded":"2023-07-29T02:06:18.436107+0000","last_fullsized":"2023-07-29T02:06:18.436107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53981922100000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"39'109","reported_seq":2160,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.449310+0000","last_change":"2023-07-29T02:03:57.052073+0000","last_active":"2023-07-29T02:06:18.449310+0000","last_peered":"2023-07-29T02:06:18.449310+0000","last_clean":"2023-07-29T02:06:18.449310+0000","last_became_active":"2023-07-29T01:59:57.969409+0000","last_became_peered":"2023-07-29T01:59:57.969409+0000","last_unstale":"2023-07-29T02:06:18.449310+0000","last_undegraded":"2023-07-29T02:06:18.449310+0000","last_fullsized":"2023-07-29T02:06:18.449310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53315132300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"39'74","reported_seq":2124,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.438815+0000","last_change":"2023-07-29T02:03:56.792528+0000","last_active":"2023-07-29T02:06:18.438815+0000","last_peered":"2023-07-29T02:06:18.438815+0000","last_clean":"2023-07-29T02:06:18.438815+0000","last_became_active":"2023-07-29T01:59:57.963774+0000","last_became_peered":"2023-07-29T01:59:57.963774+0000","last_unstale":"2023-07-29T02:06:18.438815+0000","last_undegraded":"2023-07-29T02:06:18.438815+0000","last_fullsized":"2023-07-29T02:06:18.438815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:16:46.614077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30426659299999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"39'632","reported_seq":2712,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.903567+0000","last_change":"2023-07-29T02:03:57.112265+0000","last_active":"2023-07-29T02:06:07.903567+0000","last_peered":"2023-07-29T02:06:07.903567+0000","last_clean":"2023-07-29T02:06:07.903567+0000","last_became_active":"2023-07-29T02:00:01.993731+0000","last_became_peered":"2023-07-29T02:00:01.993731+0000","last_unstale":"2023-07-29T02:06:07.903567+0000","last_undegraded":"2023-07-29T02:06:07.903567+0000","last_fullsized":"2023-07-29T02:06:07.903567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35725884499999999,"stat_sum":{"num_bytes":48336376,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":31,"num_read_kb":16407,"num_write":630,"num_write_kb":51633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"39'156","reported_seq":191,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:13.641957+0000","last_change":"2023-07-29T01:59:57.552913+0000","last_active":"2023-07-29T02:06:13.641957+0000","last_peered":"2023-07-29T02:06:13.641957+0000","last_clean":"2023-07-29T02:06:13.641957+0000","last_became_active":"2023-07-29T01:59:57.552673+0000","last_became_peered":"2023-07-29T01:59:57.552673+0000","last_unstale":"2023-07-29T02:06:13.641957+0000","last_undegraded":"2023-07-29T02:06:13.641957+0000","last_fullsized":"2023-07-29T02:06:13.641957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":154,"num_write_kb":16499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"39'90","reported_seq":2141,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.450810+0000","last_change":"2023-07-29T02:03:57.172635+0000","last_active":"2023-07-29T02:06:18.450810+0000","last_peered":"2023-07-29T02:06:18.450810+0000","last_clean":"2023-07-29T02:06:18.450810+0000","last_became_active":"2023-07-29T01:59:57.969821+0000","last_became_peered":"2023-07-29T01:59:57.969821+0000","last_unstale":"2023-07-29T02:06:18.450810+0000","last_undegraded":"2023-07-29T02:06:18.450810+0000","last_fullsized":"2023-07-29T02:06:18.450810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.40087768200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'629","reported_seq":2719,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.010347+0000","last_change":"2023-07-29T02:03:56.981521+0000","last_active":"2023-07-29T02:06:19.010347+0000","last_peered":"2023-07-29T02:06:19.010347+0000","last_clean":"2023-07-29T02:06:19.010347+0000","last_became_active":"2023-07-29T02:00:01.992338+0000","last_became_peered":"2023-07-29T02:00:01.992338+0000","last_unstale":"2023-07-29T02:06:19.010347+0000","last_undegraded":"2023-07-29T02:06:19.010347+0000","last_fullsized":"2023-07-29T02:06:19.010347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:37.968145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20956234600000001,"stat_sum":{"num_bytes":44446331,"num_objects":308,"num_object_clones":0,"num_object_copies":1232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":308,"num_whiteouts":0,"num_read":41,"num_read_kb":16418,"num_write":629,"num_write_kb":43687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"39'20","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:44.477376+0000","last_change":"2023-07-29T01:59:57.547793+0000","last_active":"2023-07-29T02:05:44.477376+0000","last_peered":"2023-07-29T02:05:44.477376+0000","last_clean":"2023-07-29T02:05:44.477376+0000","last_became_active":"2023-07-29T01:59:57.547455+0000","last_became_peered":"2023-07-29T01:59:57.547455+0000","last_unstale":"2023-07-29T02:05:44.477376+0000","last_undegraded":"2023-07-29T02:05:44.477376+0000","last_fullsized":"2023-07-29T02:05:44.477376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":4125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"39'92","reported_seq":2144,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.443930+0000","last_change":"2023-07-29T02:03:57.037080+0000","last_active":"2023-07-29T02:06:18.443930+0000","last_peered":"2023-07-29T02:06:18.443930+0000","last_clean":"2023-07-29T02:06:18.443930+0000","last_became_active":"2023-07-29T01:59:57.964393+0000","last_became_peered":"2023-07-29T01:59:57.964393+0000","last_unstale":"2023-07-29T02:06:18.443930+0000","last_undegraded":"2023-07-29T02:06:18.443930+0000","last_fullsized":"2023-07-29T02:06:18.443930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55267013499999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"39'624","reported_seq":2706,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.294650+0000","last_change":"2023-07-29T02:03:57.037730+0000","last_active":"2023-07-29T02:06:07.294650+0000","last_peered":"2023-07-29T02:06:07.294650+0000","last_clean":"2023-07-29T02:06:07.294650+0000","last_became_active":"2023-07-29T02:00:01.982042+0000","last_became_peered":"2023-07-29T02:00:01.982042+0000","last_unstale":"2023-07-29T02:06:07.294650+0000","last_undegraded":"2023-07-29T02:06:07.294650+0000","last_fullsized":"2023-07-29T02:06:07.294650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55323541600000004,"stat_sum":{"num_bytes":17887936,"num_objects":308,"num_object_clones":0,"num_object_copies":1232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":308,"num_whiteouts":0,"num_read":32,"num_read_kb":5104,"num_write":624,"num_write_kb":17797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"39'211","reported_seq":245,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:16.830519+0000","last_change":"2023-07-29T01:59:57.535286+0000","last_active":"2023-07-29T02:06:16.830519+0000","last_peered":"2023-07-29T02:06:16.830519+0000","last_clean":"2023-07-29T02:06:16.830519+0000","last_became_active":"2023-07-29T01:59:57.533523+0000","last_became_peered":"2023-07-29T01:59:57.533523+0000","last_unstale":"2023-07-29T02:06:16.830519+0000","last_undegraded":"2023-07-29T02:06:16.830519+0000","last_fullsized":"2023-07-29T02:06:16.830519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":211,"log_dups_size":0,"ondisk_log_size":211,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":210,"num_write_kb":16504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"39'88","reported_seq":2139,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.430148+0000","last_change":"2023-07-29T02:03:56.982121+0000","last_active":"2023-07-29T02:06:18.430148+0000","last_peered":"2023-07-29T02:06:18.430148+0000","last_clean":"2023-07-29T02:06:18.430148+0000","last_became_active":"2023-07-29T01:59:57.963466+0000","last_became_peered":"2023-07-29T01:59:57.963466+0000","last_unstale":"2023-07-29T02:06:18.430148+0000","last_undegraded":"2023-07-29T02:06:18.430148+0000","last_fullsized":"2023-07-29T02:06:18.430148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:28.048947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.209911193,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"39'697","reported_seq":2784,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.146401+0000","last_change":"2023-07-29T02:03:56.977076+0000","last_active":"2023-07-29T02:06:07.146401+0000","last_peered":"2023-07-29T02:06:07.146401+0000","last_clean":"2023-07-29T02:06:07.146401+0000","last_became_active":"2023-07-29T02:00:01.984000+0000","last_became_peered":"2023-07-29T02:00:01.984000+0000","last_unstale":"2023-07-29T02:06:07.146401+0000","last_undegraded":"2023-07-29T02:06:07.146401+0000","last_fullsized":"2023-07-29T02:06:07.146401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:26:29.645201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.218444052,"stat_sum":{"num_bytes":33480822,"num_objects":367,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":39,"num_read_kb":11040,"num_write":700,"num_write_kb":41165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"39'3","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:46.612214+0000","last_change":"2023-07-29T01:59:57.537082+0000","last_active":"2023-07-29T02:05:46.612214+0000","last_peered":"2023-07-29T02:05:46.612214+0000","last_clean":"2023-07-29T02:05:46.612214+0000","last_became_active":"2023-07-29T01:59:57.536732+0000","last_became_peered":"2023-07-29T01:59:57.536732+0000","last_unstale":"2023-07-29T02:05:46.612214+0000","last_undegraded":"2023-07-29T02:05:46.612214+0000","last_fullsized":"2023-07-29T02:05:46.612214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"39'88","reported_seq":2139,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.445607+0000","last_change":"2023-07-29T02:03:57.174184+0000","last_active":"2023-07-29T02:06:18.445607+0000","last_peered":"2023-07-29T02:06:18.445607+0000","last_clean":"2023-07-29T02:06:18.445607+0000","last_became_active":"2023-07-29T01:59:57.970902+0000","last_became_peered":"2023-07-29T01:59:57.970902+0000","last_unstale":"2023-07-29T02:06:18.445607+0000","last_undegraded":"2023-07-29T02:06:18.445607+0000","last_fullsized":"2023-07-29T02:06:18.445607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.3723399,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'665","reported_seq":2750,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.428896+0000","last_change":"2023-07-29T02:03:56.697947+0000","last_active":"2023-07-29T02:06:07.428896+0000","last_peered":"2023-07-29T02:06:07.428896+0000","last_clean":"2023-07-29T02:06:07.428896+0000","last_became_active":"2023-07-29T02:00:01.989456+0000","last_became_peered":"2023-07-29T02:00:01.989456+0000","last_unstale":"2023-07-29T02:06:07.428896+0000","last_undegraded":"2023-07-29T02:06:07.428896+0000","last_fullsized":"2023-07-29T02:06:07.428896+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:39.007323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.189839176,"stat_sum":{"num_bytes":37359948,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":38,"num_read_kb":16417,"num_write":659,"num_write_kb":40721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"39'104","reported_seq":136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:14.678391+0000","last_change":"2023-07-29T01:59:57.540572+0000","last_active":"2023-07-29T02:06:14.678391+0000","last_peered":"2023-07-29T02:06:14.678391+0000","last_clean":"2023-07-29T02:06:14.678391+0000","last_became_active":"2023-07-29T01:59:57.540113+0000","last_became_peered":"2023-07-29T01:59:57.540113+0000","last_unstale":"2023-07-29T02:06:14.678391+0000","last_undegraded":"2023-07-29T02:06:14.678391+0000","last_fullsized":"2023-07-29T02:06:14.678391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:08:31.548242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":100,"num_write_kb":16445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"39'91","reported_seq":2142,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.450563+0000","last_change":"2023-07-29T02:03:57.171853+0000","last_active":"2023-07-29T02:06:18.450563+0000","last_peered":"2023-07-29T02:06:18.450563+0000","last_clean":"2023-07-29T02:06:18.450563+0000","last_became_active":"2023-07-29T01:59:57.967083+0000","last_became_peered":"2023-07-29T01:59:57.967083+0000","last_unstale":"2023-07-29T02:06:18.450563+0000","last_undegraded":"2023-07-29T02:06:18.450563+0000","last_fullsized":"2023-07-29T02:06:18.450563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38037237200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"39'632","reported_seq":2725,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:06.764831+0000","last_change":"2023-07-29T02:03:57.161825+0000","last_active":"2023-07-29T02:06:06.764831+0000","last_peered":"2023-07-29T02:06:06.764831+0000","last_clean":"2023-07-29T02:06:06.764831+0000","last_became_active":"2023-07-29T02:00:01.996035+0000","last_became_peered":"2023-07-29T02:00:01.996035+0000","last_unstale":"2023-07-29T02:06:06.764831+0000","last_undegraded":"2023-07-29T02:06:06.764831+0000","last_fullsized":"2023-07-29T02:06:06.764831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.39874443399999998,"stat_sum":{"num_bytes":20875244,"num_objects":313,"num_object_clones":0,"num_object_copies":1252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":44,"num_read_kb":4139,"num_write":632,"num_write_kb":28878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"39'452","reported_seq":492,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.857350+0000","last_change":"2023-07-29T01:59:57.548665+0000","last_active":"2023-07-29T02:06:19.857350+0000","last_peered":"2023-07-29T02:06:19.857350+0000","last_clean":"2023-07-29T02:06:19.857350+0000","last_became_active":"2023-07-29T01:59:57.547803+0000","last_became_peered":"2023-07-29T01:59:57.547803+0000","last_unstale":"2023-07-29T02:06:19.857350+0000","last_undegraded":"2023-07-29T02:06:19.857350+0000","last_fullsized":"2023-07-29T02:06:19.857350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:21:33.364001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11532075,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":4114,"num_write":450,"num_write_kb":11515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"39'85","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.444029+0000","last_change":"2023-07-29T02:03:57.049617+0000","last_active":"2023-07-29T02:06:18.444029+0000","last_peered":"2023-07-29T02:06:18.444029+0000","last_clean":"2023-07-29T02:06:18.444029+0000","last_became_active":"2023-07-29T01:59:57.969006+0000","last_became_peered":"2023-07-29T01:59:57.969006+0000","last_unstale":"2023-07-29T02:06:18.444029+0000","last_undegraded":"2023-07-29T02:06:18.444029+0000","last_fullsized":"2023-07-29T02:06:18.444029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53746501300000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"39'641","reported_seq":2735,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.766530+0000","last_change":"2023-07-29T02:03:57.052276+0000","last_active":"2023-07-29T02:06:07.766530+0000","last_peered":"2023-07-29T02:06:07.766530+0000","last_clean":"2023-07-29T02:06:07.766530+0000","last_became_active":"2023-07-29T02:00:01.995757+0000","last_became_peered":"2023-07-29T02:00:01.995757+0000","last_unstale":"2023-07-29T02:06:07.766530+0000","last_undegraded":"2023-07-29T02:06:07.766530+0000","last_fullsized":"2023-07-29T02:06:07.766530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.539926876,"stat_sum":{"num_bytes":20101741,"num_objects":314,"num_object_clones":0,"num_object_copies":1256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":45,"num_read_kb":20517,"num_write":638,"num_write_kb":32247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"39'126","reported_seq":176,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.616137+0000","last_change":"2023-07-29T01:59:57.541936+0000","last_active":"2023-07-29T02:06:19.616137+0000","last_peered":"2023-07-29T02:06:19.616137+0000","last_clean":"2023-07-29T02:06:19.616137+0000","last_became_active":"2023-07-29T01:59:57.541434+0000","last_became_peered":"2023-07-29T01:59:57.541434+0000","last_unstale":"2023-07-29T02:06:19.616137+0000","last_undegraded":"2023-07-29T02:06:19.616137+0000","last_fullsized":"2023-07-29T02:06:19.616137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":12324,"num_write":119,"num_write_kb":12358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"39'101","reported_seq":2152,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.439118+0000","last_change":"2023-07-29T02:03:57.112781+0000","last_active":"2023-07-29T02:06:18.439118+0000","last_peered":"2023-07-29T02:06:18.439118+0000","last_clean":"2023-07-29T02:06:18.439118+0000","last_became_active":"2023-07-29T01:59:57.962459+0000","last_became_peered":"2023-07-29T01:59:57.962459+0000","last_unstale":"2023-07-29T02:06:18.439118+0000","last_undegraded":"2023-07-29T02:06:18.439118+0000","last_fullsized":"2023-07-29T02:06:18.439118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.34937986999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'591","reported_seq":2679,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.695555+0000","last_change":"2023-07-29T02:03:56.797439+0000","last_active":"2023-07-29T02:06:07.695555+0000","last_peered":"2023-07-29T02:06:07.695555+0000","last_clean":"2023-07-29T02:06:07.695555+0000","last_became_active":"2023-07-29T02:00:01.995827+0000","last_became_peered":"2023-07-29T02:00:01.995827+0000","last_unstale":"2023-07-29T02:06:07.695555+0000","last_undegraded":"2023-07-29T02:06:07.695555+0000","last_fullsized":"2023-07-29T02:06:07.695555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:51:16.784160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30893240100000002,"stat_sum":{"num_bytes":24035129,"num_objects":268,"num_object_clones":0,"num_object_copies":1072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":40,"num_read_kb":8228,"num_write":590,"num_write_kb":23787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"39'12","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.543460+0000","last_change":"2023-07-29T01:59:57.545705+0000","last_active":"2023-07-29T02:05:51.543460+0000","last_peered":"2023-07-29T02:05:51.543460+0000","last_clean":"2023-07-29T02:05:51.543460+0000","last_became_active":"2023-07-29T01:59:57.545406+0000","last_became_peered":"2023-07-29T01:59:57.545406+0000","last_unstale":"2023-07-29T02:05:51.543460+0000","last_undegraded":"2023-07-29T02:05:51.543460+0000","last_fullsized":"2023-07-29T02:05:51.543460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:37:31.903601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":8216,"num_write":11,"num_write_kb":8201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"39'86","reported_seq":2131,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.444998+0000","last_change":"2023-07-29T02:03:56.957227+0000","last_active":"2023-07-29T02:06:18.444998+0000","last_peered":"2023-07-29T02:06:18.444998+0000","last_clean":"2023-07-29T02:06:18.444998+0000","last_became_active":"2023-07-29T02:00:46.525331+0000","last_became_peered":"2023-07-29T02:00:46.525331+0000","last_unstale":"2023-07-29T02:06:18.444998+0000","last_undegraded":"2023-07-29T02:06:18.444998+0000","last_fullsized":"2023-07-29T02:06:18.444998+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46925831499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"39'589","reported_seq":2662,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.254958+0000","last_change":"2023-07-29T02:03:57.172129+0000","last_active":"2023-07-29T02:06:07.254958+0000","last_peered":"2023-07-29T02:06:07.254958+0000","last_clean":"2023-07-29T02:06:07.254958+0000","last_became_active":"2023-07-29T02:00:01.996969+0000","last_became_peered":"2023-07-29T02:00:01.996969+0000","last_unstale":"2023-07-29T02:06:07.254958+0000","last_undegraded":"2023-07-29T02:06:07.254958+0000","last_fullsized":"2023-07-29T02:06:07.254958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.40090650999999999,"stat_sum":{"num_bytes":23342582,"num_objects":297,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":297,"num_whiteouts":0,"num_read":24,"num_read_kb":4119,"num_write":587,"num_write_kb":31305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"39'4","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.901290+0000","last_change":"2023-07-29T01:59:57.541115+0000","last_active":"2023-07-29T02:05:51.901290+0000","last_peered":"2023-07-29T02:05:51.901290+0000","last_clean":"2023-07-29T02:05:51.901290+0000","last_became_active":"2023-07-29T01:59:57.540800+0000","last_became_peered":"2023-07-29T01:59:57.540800+0000","last_unstale":"2023-07-29T02:05:51.901290+0000","last_undegraded":"2023-07-29T02:05:51.901290+0000","last_fullsized":"2023-07-29T02:05:51.901290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"39'83","reported_seq":2133,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.438711+0000","last_change":"2023-07-29T02:03:56.792291+0000","last_active":"2023-07-29T02:06:18.438711+0000","last_peered":"2023-07-29T02:06:18.438711+0000","last_clean":"2023-07-29T02:06:18.438711+0000","last_became_active":"2023-07-29T01:59:57.963510+0000","last_became_peered":"2023-07-29T01:59:57.963510+0000","last_unstale":"2023-07-29T02:06:18.438711+0000","last_undegraded":"2023-07-29T02:06:18.438711+0000","last_fullsized":"2023-07-29T02:06:18.438711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:45:48.747340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30420630999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"39'628","reported_seq":2718,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.247727+0000","last_change":"2023-07-29T02:03:57.173787+0000","last_active":"2023-07-29T02:06:07.247727+0000","last_peered":"2023-07-29T02:06:07.247727+0000","last_clean":"2023-07-29T02:06:07.247727+0000","last_became_active":"2023-07-29T02:00:01.996084+0000","last_became_peered":"2023-07-29T02:00:01.996084+0000","last_unstale":"2023-07-29T02:06:07.247727+0000","last_undegraded":"2023-07-29T02:06:07.247727+0000","last_fullsized":"2023-07-29T02:06:07.247727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38362237100000002,"stat_sum":{"num_bytes":15782931,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":41,"num_read_kb":8234,"num_write":627,"num_write_kb":19844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"39'2","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.887924+0000","last_change":"2023-07-29T01:59:57.548464+0000","last_active":"2023-07-29T02:05:51.887924+0000","last_peered":"2023-07-29T02:05:51.887924+0000","last_clean":"2023-07-29T02:05:51.887924+0000","last_became_active":"2023-07-29T01:59:57.548109+0000","last_became_peered":"2023-07-29T01:59:57.548109+0000","last_unstale":"2023-07-29T02:05:51.887924+0000","last_undegraded":"2023-07-29T02:05:51.887924+0000","last_fullsized":"2023-07-29T02:05:51.887924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:13.433053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"39'105","reported_seq":2156,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.450812+0000","last_change":"2023-07-29T02:03:57.037255+0000","last_active":"2023-07-29T02:06:18.450812+0000","last_peered":"2023-07-29T02:06:18.450812+0000","last_clean":"2023-07-29T02:06:18.450812+0000","last_became_active":"2023-07-29T01:59:57.961759+0000","last_became_peered":"2023-07-29T01:59:57.961759+0000","last_unstale":"2023-07-29T02:06:18.450812+0000","last_undegraded":"2023-07-29T02:06:18.450812+0000","last_fullsized":"2023-07-29T02:06:18.450812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55180089099999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"39'661","reported_seq":2754,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.775569+0000","last_change":"2023-07-29T02:03:56.798905+0000","last_active":"2023-07-29T02:06:07.775569+0000","last_peered":"2023-07-29T02:06:07.775569+0000","last_clean":"2023-07-29T02:06:07.775569+0000","last_became_active":"2023-07-29T02:00:01.992592+0000","last_became_peered":"2023-07-29T02:00:01.992592+0000","last_unstale":"2023-07-29T02:06:07.775569+0000","last_undegraded":"2023-07-29T02:06:07.775569+0000","last_fullsized":"2023-07-29T02:06:07.775569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:14:06.353802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30939737499999997,"stat_sum":{"num_bytes":46419699,"num_objects":303,"num_object_clones":0,"num_object_copies":1212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":303,"num_whiteouts":0,"num_read":45,"num_read_kb":20516,"num_write":660,"num_write_kb":45624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"39'98","reported_seq":151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:44.468105+0000","last_change":"2023-07-29T01:59:57.543707+0000","last_active":"2023-07-29T02:05:44.468105+0000","last_peered":"2023-07-29T02:05:44.468105+0000","last_clean":"2023-07-29T02:05:44.468105+0000","last_became_active":"2023-07-29T01:59:57.543398+0000","last_became_peered":"2023-07-29T01:59:57.543398+0000","last_unstale":"2023-07-29T02:05:44.468105+0000","last_undegraded":"2023-07-29T02:05:44.468105+0000","last_fullsized":"2023-07-29T02:05:44.468105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":8252,"num_write":102,"num_write_kb":8255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"39'90","reported_seq":2141,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.447682+0000","last_change":"2023-07-29T02:03:57.171910+0000","last_active":"2023-07-29T02:06:18.447682+0000","last_peered":"2023-07-29T02:06:18.447682+0000","last_clean":"2023-07-29T02:06:18.447682+0000","last_became_active":"2023-07-29T01:59:57.965962+0000","last_became_peered":"2023-07-29T01:59:57.965962+0000","last_unstale":"2023-07-29T02:06:18.447682+0000","last_undegraded":"2023-07-29T02:06:18.447682+0000","last_fullsized":"2023-07-29T02:06:18.447682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38151887499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"39'670","reported_seq":2767,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.907936+0000","last_change":"2023-07-29T02:03:56.698091+0000","last_active":"2023-07-29T02:06:07.907936+0000","last_peered":"2023-07-29T02:06:07.907936+0000","last_clean":"2023-07-29T02:06:07.907936+0000","last_became_active":"2023-07-29T02:00:01.992384+0000","last_became_peered":"2023-07-29T02:00:01.992384+0000","last_unstale":"2023-07-29T02:06:07.907936+0000","last_undegraded":"2023-07-29T02:06:07.907936+0000","last_fullsized":"2023-07-29T02:06:07.907936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19044205,"stat_sum":{"num_bytes":36575402,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":49,"num_read_kb":16426,"num_write":669,"num_write_kb":40161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"39'26","reported_seq":61,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:46.612297+0000","last_change":"2023-07-29T01:59:57.548392+0000","last_active":"2023-07-29T02:05:46.612297+0000","last_peered":"2023-07-29T02:05:46.612297+0000","last_clean":"2023-07-29T02:05:46.612297+0000","last_became_active":"2023-07-29T01:59:57.548084+0000","last_became_peered":"2023-07-29T01:59:57.548084+0000","last_unstale":"2023-07-29T02:05:46.612297+0000","last_undegraded":"2023-07-29T02:05:46.612297+0000","last_fullsized":"2023-07-29T02:05:46.612297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:54:27.046831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":27,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"39'93","reported_seq":2143,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.438379+0000","last_change":"2023-07-29T02:03:56.784306+0000","last_active":"2023-07-29T02:06:18.438379+0000","last_peered":"2023-07-29T02:06:18.438379+0000","last_clean":"2023-07-29T02:06:18.438379+0000","last_became_active":"2023-07-29T01:59:57.964626+0000","last_became_peered":"2023-07-29T01:59:57.964626+0000","last_unstale":"2023-07-29T02:06:18.438379+0000","last_undegraded":"2023-07-29T02:06:18.438379+0000","last_fullsized":"2023-07-29T02:06:18.438379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:16:42.307137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.297089139,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"39'673","reported_seq":2762,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.243933+0000","last_change":"2023-07-29T02:03:56.961858+0000","last_active":"2023-07-29T02:06:07.243933+0000","last_peered":"2023-07-29T02:06:07.243933+0000","last_clean":"2023-07-29T02:06:07.243933+0000","last_became_active":"2023-07-29T02:00:01.990579+0000","last_became_peered":"2023-07-29T02:00:01.990579+0000","last_unstale":"2023-07-29T02:06:07.243933+0000","last_undegraded":"2023-07-29T02:06:07.243933+0000","last_fullsized":"2023-07-29T02:06:07.243933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.47400464199999998,"stat_sum":{"num_bytes":32895626,"num_objects":333,"num_object_clones":0,"num_object_copies":1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":333,"num_whiteouts":0,"num_read":40,"num_read_kb":14736,"num_write":673,"num_write_kb":36572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"39'243","reported_seq":280,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.546415+0000","last_change":"2023-07-29T01:59:57.549270+0000","last_active":"2023-07-29T02:05:51.546415+0000","last_peered":"2023-07-29T02:05:51.546415+0000","last_clean":"2023-07-29T02:05:51.546415+0000","last_became_active":"2023-07-29T01:59:57.548981+0000","last_became_peered":"2023-07-29T01:59:57.548981+0000","last_unstale":"2023-07-29T02:05:51.546415+0000","last_undegraded":"2023-07-29T02:05:51.546415+0000","last_fullsized":"2023-07-29T02:05:51.546415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:05.783369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":244,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"39'93","reported_seq":2144,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.445649+0000","last_change":"2023-07-29T02:03:57.111934+0000","last_active":"2023-07-29T02:06:18.445649+0000","last_peered":"2023-07-29T02:06:18.445649+0000","last_clean":"2023-07-29T02:06:18.445649+0000","last_became_active":"2023-07-29T01:59:57.969501+0000","last_became_peered":"2023-07-29T01:59:57.969501+0000","last_unstale":"2023-07-29T02:06:18.445649+0000","last_undegraded":"2023-07-29T02:06:18.445649+0000","last_fullsized":"2023-07-29T02:06:18.445649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35565022000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"39'641","reported_seq":2728,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.184235+0000","last_change":"2023-07-29T02:03:56.959814+0000","last_active":"2023-07-29T02:06:07.184235+0000","last_peered":"2023-07-29T02:06:07.184235+0000","last_clean":"2023-07-29T02:06:07.184235+0000","last_became_active":"2023-07-29T02:00:01.989364+0000","last_became_peered":"2023-07-29T02:00:01.989364+0000","last_unstale":"2023-07-29T02:06:07.184235+0000","last_undegraded":"2023-07-29T02:06:07.184235+0000","last_fullsized":"2023-07-29T02:06:07.184235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.47145374600000001,"stat_sum":{"num_bytes":24224399,"num_objects":325,"num_object_clones":0,"num_object_copies":1300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":38,"num_read_kb":8228,"num_write":641,"num_write_kb":23994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"39'7","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.556753+0000","last_change":"2023-07-29T01:59:57.541329+0000","last_active":"2023-07-29T02:05:51.556753+0000","last_peered":"2023-07-29T02:05:51.556753+0000","last_clean":"2023-07-29T02:05:51.556753+0000","last_became_active":"2023-07-29T01:59:57.541056+0000","last_became_peered":"2023-07-29T01:59:57.541056+0000","last_unstale":"2023-07-29T02:05:51.556753+0000","last_undegraded":"2023-07-29T02:05:51.556753+0000","last_fullsized":"2023-07-29T02:05:51.556753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:49:34.427033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":8,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"39'88","reported_seq":2138,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.439827+0000","last_change":"2023-07-29T02:03:56.982964+0000","last_active":"2023-07-29T02:06:18.439827+0000","last_peered":"2023-07-29T02:06:18.439827+0000","last_clean":"2023-07-29T02:06:18.439827+0000","last_became_active":"2023-07-29T01:59:57.974998+0000","last_became_peered":"2023-07-29T01:59:57.974998+0000","last_unstale":"2023-07-29T02:06:18.439827+0000","last_undegraded":"2023-07-29T02:06:18.439827+0000","last_fullsized":"2023-07-29T02:06:18.439827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:39:14.435169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20531364299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"39'660","reported_seq":2740,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.341616+0000","last_change":"2023-07-29T02:03:56.963785+0000","last_active":"2023-07-29T02:06:07.341616+0000","last_peered":"2023-07-29T02:06:07.341616+0000","last_clean":"2023-07-29T02:06:07.341616+0000","last_became_active":"2023-07-29T02:00:01.990276+0000","last_became_peered":"2023-07-29T02:00:01.990276+0000","last_unstale":"2023-07-29T02:06:07.341616+0000","last_undegraded":"2023-07-29T02:06:07.341616+0000","last_fullsized":"2023-07-29T02:06:07.341616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.47581172799999999,"stat_sum":{"num_bytes":20642551,"num_objects":321,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":321,"num_whiteouts":0,"num_read":31,"num_read_kb":1050,"num_write":661,"num_write_kb":24562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"39'8","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.543673+0000","last_change":"2023-07-29T01:59:57.544524+0000","last_active":"2023-07-29T02:05:51.543673+0000","last_peered":"2023-07-29T02:05:51.543673+0000","last_clean":"2023-07-29T02:05:51.543673+0000","last_became_active":"2023-07-29T01:59:57.544231+0000","last_became_peered":"2023-07-29T01:59:57.544231+0000","last_unstale":"2023-07-29T02:05:51.543673+0000","last_undegraded":"2023-07-29T02:05:51.543673+0000","last_fullsized":"2023-07-29T02:05:51.543673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:41:50.688885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"39'88","reported_seq":2139,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.447139+0000","last_change":"2023-07-29T02:03:57.033536+0000","last_active":"2023-07-29T02:06:18.447139+0000","last_peered":"2023-07-29T02:06:18.447139+0000","last_clean":"2023-07-29T02:06:18.447139+0000","last_became_active":"2023-07-29T01:59:57.974525+0000","last_became_peered":"2023-07-29T01:59:57.974525+0000","last_unstale":"2023-07-29T02:06:18.447139+0000","last_undegraded":"2023-07-29T02:06:18.447139+0000","last_fullsized":"2023-07-29T02:06:18.447139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.549422509,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"39'632","reported_seq":2722,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.137000+0000","last_change":"2023-07-29T02:03:56.961596+0000","last_active":"2023-07-29T02:06:07.137000+0000","last_peered":"2023-07-29T02:06:07.137000+0000","last_clean":"2023-07-29T02:06:07.137000+0000","last_became_active":"2023-07-29T02:00:01.988486+0000","last_became_peered":"2023-07-29T02:00:01.988486+0000","last_unstale":"2023-07-29T02:06:07.137000+0000","last_undegraded":"2023-07-29T02:06:07.137000+0000","last_fullsized":"2023-07-29T02:06:07.137000+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.473472642,"stat_sum":{"num_bytes":32792736,"num_objects":300,"num_object_clones":0,"num_object_copies":1200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":300,"num_whiteouts":0,"num_read":41,"num_read_kb":18442,"num_write":630,"num_write_kb":40548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"39'376","reported_seq":413,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:17.868750+0000","last_change":"2023-07-29T01:59:57.535498+0000","last_active":"2023-07-29T02:06:17.868750+0000","last_peered":"2023-07-29T02:06:17.868750+0000","last_clean":"2023-07-29T02:06:17.868750+0000","last_became_active":"2023-07-29T01:59:57.534813+0000","last_became_peered":"2023-07-29T01:59:57.534813+0000","last_unstale":"2023-07-29T02:06:17.868750+0000","last_undegraded":"2023-07-29T02:06:17.868750+0000","last_fullsized":"2023-07-29T02:06:17.868750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":8198,"num_write":371,"num_write_kb":12605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"39'96","reported_seq":2147,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.448003+0000","last_change":"2023-07-29T02:03:57.110073+0000","last_active":"2023-07-29T02:06:18.448003+0000","last_peered":"2023-07-29T02:06:18.448003+0000","last_clean":"2023-07-29T02:06:18.448003+0000","last_became_active":"2023-07-29T01:59:57.962184+0000","last_became_peered":"2023-07-29T01:59:57.962184+0000","last_unstale":"2023-07-29T02:06:18.448003+0000","last_undegraded":"2023-07-29T02:06:18.448003+0000","last_fullsized":"2023-07-29T02:06:18.448003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36182750899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"39'688","reported_seq":2777,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.852391+0000","last_change":"2023-07-29T02:03:57.053859+0000","last_active":"2023-07-29T02:06:07.852391+0000","last_peered":"2023-07-29T02:06:07.852391+0000","last_clean":"2023-07-29T02:06:07.852391+0000","last_became_active":"2023-07-29T02:00:01.989151+0000","last_became_peered":"2023-07-29T02:00:01.989151+0000","last_unstale":"2023-07-29T02:06:07.852391+0000","last_undegraded":"2023-07-29T02:06:07.852391+0000","last_fullsized":"2023-07-29T02:06:07.852391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54490939800000004,"stat_sum":{"num_bytes":33219663,"num_objects":326,"num_object_clones":0,"num_object_copies":1304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":326,"num_whiteouts":0,"num_read":40,"num_read_kb":16418,"num_write":687,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"39'193","reported_seq":225,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:17.209207+0000","last_change":"2023-07-29T01:59:57.544466+0000","last_active":"2023-07-29T02:06:17.209207+0000","last_peered":"2023-07-29T02:06:17.209207+0000","last_clean":"2023-07-29T02:06:17.209207+0000","last_became_active":"2023-07-29T01:59:57.544120+0000","last_became_peered":"2023-07-29T01:59:57.544120+0000","last_unstale":"2023-07-29T02:06:17.209207+0000","last_undegraded":"2023-07-29T02:06:17.209207+0000","last_fullsized":"2023-07-29T02:06:17.209207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":192,"num_write_kb":12401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"39'93","reported_seq":2144,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.445728+0000","last_change":"2023-07-29T02:03:57.107586+0000","last_active":"2023-07-29T02:06:18.445728+0000","last_peered":"2023-07-29T02:06:18.445728+0000","last_clean":"2023-07-29T02:06:18.445728+0000","last_became_active":"2023-07-29T01:59:57.961975+0000","last_became_peered":"2023-07-29T01:59:57.961975+0000","last_unstale":"2023-07-29T02:06:18.445728+0000","last_undegraded":"2023-07-29T02:06:18.445728+0000","last_fullsized":"2023-07-29T02:06:18.445728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37361334099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"39'646","reported_seq":2738,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.799960+0000","last_change":"2023-07-29T02:03:56.800119+0000","last_active":"2023-07-29T02:06:07.799960+0000","last_peered":"2023-07-29T02:06:07.799960+0000","last_clean":"2023-07-29T02:06:07.799960+0000","last_became_active":"2023-07-29T02:00:01.988155+0000","last_became_peered":"2023-07-29T02:00:01.988155+0000","last_unstale":"2023-07-29T02:06:07.799960+0000","last_undegraded":"2023-07-29T02:06:07.799960+0000","last_fullsized":"2023-07-29T02:06:07.799960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:33:44.297599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30982225000000002,"stat_sum":{"num_bytes":22073203,"num_objects":313,"num_object_clones":0,"num_object_copies":1252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":44,"num_read_kb":12328,"num_write":643,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"39'63","reported_seq":96,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:55.841535+0000","last_change":"2023-07-29T01:59:57.549764+0000","last_active":"2023-07-29T02:05:55.841535+0000","last_peered":"2023-07-29T02:05:55.841535+0000","last_clean":"2023-07-29T02:05:55.841535+0000","last_became_active":"2023-07-29T01:59:57.549470+0000","last_became_peered":"2023-07-29T01:59:57.549470+0000","last_unstale":"2023-07-29T02:05:55.841535+0000","last_undegraded":"2023-07-29T02:05:55.841535+0000","last_fullsized":"2023-07-29T02:05:55.841535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":64,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"39'65","reported_seq":2116,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.438119+0000","last_change":"2023-07-29T02:03:57.081019+0000","last_active":"2023-07-29T02:06:18.438119+0000","last_peered":"2023-07-29T02:06:18.438119+0000","last_clean":"2023-07-29T02:06:18.438119+0000","last_became_active":"2023-07-29T01:59:57.962016+0000","last_became_peered":"2023-07-29T01:59:57.962016+0000","last_unstale":"2023-07-29T02:06:18.438119+0000","last_undegraded":"2023-07-29T02:06:18.438119+0000","last_fullsized":"2023-07-29T02:06:18.438119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36599154900000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"39'565","reported_seq":2654,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.783232+0000","last_change":"2023-07-29T02:03:57.082127+0000","last_active":"2023-07-29T02:06:07.783232+0000","last_peered":"2023-07-29T02:06:07.783232+0000","last_clean":"2023-07-29T02:06:07.783232+0000","last_became_active":"2023-07-29T02:00:01.992042+0000","last_became_peered":"2023-07-29T02:00:01.992042+0000","last_unstale":"2023-07-29T02:06:07.783232+0000","last_undegraded":"2023-07-29T02:06:07.783232+0000","last_fullsized":"2023-07-29T02:06:07.783232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36734029699999998,"stat_sum":{"num_bytes":17472104,"num_objects":288,"num_object_clones":0,"num_object_copies":1152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":40,"num_read_kb":12324,"num_write":565,"num_write_kb":21394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"39'10","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:54.755229+0000","last_change":"2023-07-29T01:59:57.537045+0000","last_active":"2023-07-29T02:05:54.755229+0000","last_peered":"2023-07-29T02:05:54.755229+0000","last_clean":"2023-07-29T02:05:54.755229+0000","last_became_active":"2023-07-29T01:59:57.535762+0000","last_became_peered":"2023-07-29T01:59:57.535762+0000","last_unstale":"2023-07-29T02:05:54.755229+0000","last_undegraded":"2023-07-29T02:05:54.755229+0000","last_fullsized":"2023-07-29T02:05:54.755229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":13,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"39'87","reported_seq":2138,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.450063+0000","last_change":"2023-07-29T02:03:57.049662+0000","last_active":"2023-07-29T02:06:18.450063+0000","last_peered":"2023-07-29T02:06:18.450063+0000","last_clean":"2023-07-29T02:06:18.450063+0000","last_became_active":"2023-07-29T01:59:57.974834+0000","last_became_peered":"2023-07-29T01:59:57.974834+0000","last_unstale":"2023-07-29T02:06:18.450063+0000","last_undegraded":"2023-07-29T02:06:18.450063+0000","last_fullsized":"2023-07-29T02:06:18.450063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53560260199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"39'713","reported_seq":2793,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.454413+0000","last_change":"2023-07-29T02:03:57.112720+0000","last_active":"2023-07-29T02:06:19.454413+0000","last_peered":"2023-07-29T02:06:19.454413+0000","last_clean":"2023-07-29T02:06:19.454413+0000","last_became_active":"2023-07-29T02:00:01.990464+0000","last_became_peered":"2023-07-29T02:00:01.990464+0000","last_unstale":"2023-07-29T02:06:19.454413+0000","last_undegraded":"2023-07-29T02:06:19.454413+0000","last_fullsized":"2023-07-29T02:06:19.454413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.356278702,"stat_sum":{"num_bytes":25950589,"num_objects":363,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":363,"num_whiteouts":0,"num_read":30,"num_read_kb":4124,"num_write":712,"num_write_kb":29793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"39'162","reported_seq":200,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:55.844400+0000","last_change":"2023-07-29T01:59:57.540561+0000","last_active":"2023-07-29T02:05:55.844400+0000","last_peered":"2023-07-29T02:05:55.844400+0000","last_clean":"2023-07-29T02:05:55.844400+0000","last_became_active":"2023-07-29T01:59:57.540292+0000","last_became_peered":"2023-07-29T01:59:57.540292+0000","last_unstale":"2023-07-29T02:05:55.844400+0000","last_undegraded":"2023-07-29T02:05:55.844400+0000","last_fullsized":"2023-07-29T02:05:55.844400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":162,"num_write_kb":4206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:09.453448+0000","last_change":"2023-07-29T01:59:52.448098+0000","last_active":"2023-07-29T02:06:09.453448+0000","last_peered":"2023-07-29T02:06:09.453448+0000","last_clean":"2023-07-29T02:06:09.453448+0000","last_became_active":"2023-07-29T01:59:52.447782+0000","last_became_peered":"2023-07-29T01:59:52.447782+0000","last_unstale":"2023-07-29T02:06:09.453448+0000","last_undegraded":"2023-07-29T02:06:09.453448+0000","last_fullsized":"2023-07-29T02:06:09.453448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"39'83","reported_seq":2135,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.449278+0000","last_change":"2023-07-29T02:03:57.173984+0000","last_active":"2023-07-29T02:06:18.449278+0000","last_peered":"2023-07-29T02:06:18.449278+0000","last_clean":"2023-07-29T02:06:18.449278+0000","last_became_active":"2023-07-29T01:59:57.966065+0000","last_became_peered":"2023-07-29T01:59:57.966065+0000","last_unstale":"2023-07-29T02:06:18.449278+0000","last_undegraded":"2023-07-29T02:06:18.449278+0000","last_fullsized":"2023-07-29T02:06:18.449278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37241656400000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"39'677","reported_seq":2774,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:06.908747+0000","last_change":"2023-07-29T02:03:57.174632+0000","last_active":"2023-07-29T02:06:06.908747+0000","last_peered":"2023-07-29T02:06:06.908747+0000","last_clean":"2023-07-29T02:06:06.908747+0000","last_became_active":"2023-07-29T02:00:01.995963+0000","last_became_peered":"2023-07-29T02:00:01.995963+0000","last_unstale":"2023-07-29T02:06:06.908747+0000","last_undegraded":"2023-07-29T02:06:06.908747+0000","last_fullsized":"2023-07-29T02:06:06.908747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.373304892,"stat_sum":{"num_bytes":14135733,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":47,"num_read_kb":4140,"num_write":679,"num_write_kb":14069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:09.462398+0000","last_change":"2023-07-29T01:59:52.445649+0000","last_active":"2023-07-29T02:06:09.462398+0000","last_peered":"2023-07-29T02:06:09.462398+0000","last_clean":"2023-07-29T02:06:09.462398+0000","last_became_active":"2023-07-29T01:59:52.445337+0000","last_became_peered":"2023-07-29T01:59:52.445337+0000","last_unstale":"2023-07-29T02:06:09.462398+0000","last_undegraded":"2023-07-29T02:06:09.462398+0000","last_fullsized":"2023-07-29T02:06:09.462398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"39'38","reported_seq":73,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.640701+0000","last_change":"2023-07-29T01:59:57.537863+0000","last_active":"2023-07-29T02:06:19.640701+0000","last_peered":"2023-07-29T02:06:19.640701+0000","last_clean":"2023-07-29T02:06:19.640701+0000","last_became_active":"2023-07-29T01:59:57.537581+0000","last_became_peered":"2023-07-29T01:59:57.537581+0000","last_unstale":"2023-07-29T02:06:19.640701+0000","last_undegraded":"2023-07-29T02:06:19.640701+0000","last_fullsized":"2023-07-29T02:06:19.640701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8,"num_write":84,"num_write_kb":1322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"39'82","reported_seq":2134,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.440352+0000","last_change":"2023-07-29T02:03:57.112487+0000","last_active":"2023-07-29T02:06:18.440352+0000","last_peered":"2023-07-29T02:06:18.440352+0000","last_clean":"2023-07-29T02:06:18.440352+0000","last_became_active":"2023-07-29T01:59:57.961298+0000","last_became_peered":"2023-07-29T01:59:57.961298+0000","last_unstale":"2023-07-29T02:06:18.440352+0000","last_undegraded":"2023-07-29T02:06:18.440352+0000","last_fullsized":"2023-07-29T02:06:18.440352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35104021600000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"39'622","reported_seq":2707,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.797342+0000","last_change":"2023-07-29T02:03:56.799516+0000","last_active":"2023-07-29T02:06:07.797342+0000","last_peered":"2023-07-29T02:06:07.797342+0000","last_clean":"2023-07-29T02:06:07.797342+0000","last_became_active":"2023-07-29T02:00:01.986915+0000","last_became_peered":"2023-07-29T02:00:01.986915+0000","last_unstale":"2023-07-29T02:06:07.797342+0000","last_undegraded":"2023-07-29T02:06:07.797342+0000","last_fullsized":"2023-07-29T02:06:07.797342+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:35:48.256508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30985112500000001,"stat_sum":{"num_bytes":28815426,"num_objects":291,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":291,"num_whiteouts":0,"num_read":37,"num_read_kb":4131,"num_write":621,"num_write_kb":32518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:23.105634+0000","last_change":"2023-07-29T02:06:23.105717+0000","last_active":"2023-07-29T02:06:23.105634+0000","last_peered":"2023-07-29T02:06:23.105634+0000","last_clean":"2023-07-29T02:06:23.105634+0000","last_became_active":"2023-07-29T01:59:52.448052+0000","last_became_peered":"2023-07-29T01:59:52.448052+0000","last_unstale":"2023-07-29T02:06:23.105634+0000","last_undegraded":"2023-07-29T02:06:23.105634+0000","last_fullsized":"2023-07-29T02:06:23.105634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:23.105612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:23.105612+0000","last_clean_scrub_stamp":"2023-07-29T02:06:23.105612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:01:13.810307+0000","scrub_duration":0.0019361350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":185,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444525+0000","last_change":"2023-07-29T01:59:52.450730+0000","last_active":"2023-07-29T02:04:19.444525+0000","last_peered":"2023-07-29T02:04:19.444525+0000","last_clean":"2023-07-29T02:04:19.444525+0000","last_became_active":"2023-07-29T01:59:52.449582+0000","last_became_peered":"2023-07-29T01:59:52.449582+0000","last_unstale":"2023-07-29T02:04:19.444525+0000","last_undegraded":"2023-07-29T02:04:19.444525+0000","last_fullsized":"2023-07-29T02:04:19.444525+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:01:27.099648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"39'67","reported_seq":166,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.008320+0000","last_change":"2023-07-29T01:59:57.546474+0000","last_active":"2023-07-29T02:06:19.008320+0000","last_peered":"2023-07-29T02:06:19.008320+0000","last_clean":"2023-07-29T02:06:19.008320+0000","last_became_active":"2023-07-29T01:59:57.546179+0000","last_became_peered":"2023-07-29T01:59:57.546179+0000","last_unstale":"2023-07-29T02:06:19.008320+0000","last_undegraded":"2023-07-29T02:06:19.008320+0000","last_fullsized":"2023-07-29T02:06:19.008320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576264,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":610,"num_write":65,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"39'93","reported_seq":2144,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.447017+0000","last_change":"2023-07-29T02:03:57.038626+0000","last_active":"2023-07-29T02:06:18.447017+0000","last_peered":"2023-07-29T02:06:18.447017+0000","last_clean":"2023-07-29T02:06:18.447017+0000","last_became_active":"2023-07-29T01:59:57.975078+0000","last_became_peered":"2023-07-29T01:59:57.975078+0000","last_unstale":"2023-07-29T02:06:18.447017+0000","last_undegraded":"2023-07-29T02:06:18.447017+0000","last_fullsized":"2023-07-29T02:06:18.447017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55319968200000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"39'709","reported_seq":2808,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.743155+0000","last_change":"2023-07-29T02:03:56.966106+0000","last_active":"2023-07-29T02:06:07.743155+0000","last_peered":"2023-07-29T02:06:07.743155+0000","last_clean":"2023-07-29T02:06:07.743155+0000","last_became_active":"2023-07-29T02:00:01.986937+0000","last_became_peered":"2023-07-29T02:00:01.986937+0000","last_unstale":"2023-07-29T02:06:07.743155+0000","last_undegraded":"2023-07-29T02:06:07.743155+0000","last_fullsized":"2023-07-29T02:06:07.743155+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.47715394799999999,"stat_sum":{"num_bytes":40554601,"num_objects":344,"num_object_clones":0,"num_object_copies":1376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":344,"num_whiteouts":0,"num_read":51,"num_read_kb":15453,"num_write":703,"num_write_kb":39978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444967+0000","last_change":"2023-07-29T01:59:53.171806+0000","last_active":"2023-07-29T02:04:19.444967+0000","last_peered":"2023-07-29T02:04:19.444967+0000","last_clean":"2023-07-29T02:04:19.444967+0000","last_became_active":"2023-07-29T01:59:53.171467+0000","last_became_peered":"2023-07-29T01:59:53.171467+0000","last_unstale":"2023-07-29T02:04:19.444967+0000","last_undegraded":"2023-07-29T02:04:19.444967+0000","last_fullsized":"2023-07-29T02:04:19.444967+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"39'249","reported_seq":286,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:59.445668+0000","last_change":"2023-07-29T01:59:57.549442+0000","last_active":"2023-07-29T02:05:59.445668+0000","last_peered":"2023-07-29T02:05:59.445668+0000","last_clean":"2023-07-29T02:05:59.445668+0000","last_became_active":"2023-07-29T01:59:57.549151+0000","last_became_peered":"2023-07-29T01:59:57.549151+0000","last_unstale":"2023-07-29T02:05:59.445668+0000","last_undegraded":"2023-07-29T02:05:59.445668+0000","last_fullsized":"2023-07-29T02:05:59.445668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":11035,"num_write":246,"num_write_kb":12456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"39'88","reported_seq":2139,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.441620+0000","last_change":"2023-07-29T02:03:57.051306+0000","last_active":"2023-07-29T02:06:18.441620+0000","last_peered":"2023-07-29T02:06:18.441620+0000","last_clean":"2023-07-29T02:06:18.441620+0000","last_became_active":"2023-07-29T01:59:57.969273+0000","last_became_peered":"2023-07-29T01:59:57.969273+0000","last_unstale":"2023-07-29T02:06:18.441620+0000","last_undegraded":"2023-07-29T02:06:18.441620+0000","last_fullsized":"2023-07-29T02:06:18.441620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53741308300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"39'639","reported_seq":2720,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.012650+0000","last_change":"2023-07-29T02:03:56.696365+0000","last_active":"2023-07-29T02:06:19.012650+0000","last_peered":"2023-07-29T02:06:19.012650+0000","last_clean":"2023-07-29T02:06:19.012650+0000","last_became_active":"2023-07-29T02:00:01.992406+0000","last_became_peered":"2023-07-29T02:00:01.992406+0000","last_unstale":"2023-07-29T02:06:19.012650+0000","last_undegraded":"2023-07-29T02:06:19.012650+0000","last_fullsized":"2023-07-29T02:06:19.012650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:01:12.254656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18856821800000001,"stat_sum":{"num_bytes":24792794,"num_objects":323,"num_object_clones":0,"num_object_copies":1292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":323,"num_whiteouts":0,"num_read":32,"num_read_kb":11492,"num_write":639,"num_write_kb":27823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.444207+0000","last_change":"2023-07-29T01:59:53.171746+0000","last_active":"2023-07-29T02:04:19.444207+0000","last_peered":"2023-07-29T02:04:19.444207+0000","last_clean":"2023-07-29T02:04:19.444207+0000","last_became_active":"2023-07-29T01:59:53.171440+0000","last_became_peered":"2023-07-29T01:59:53.171440+0000","last_unstale":"2023-07-29T02:04:19.444207+0000","last_undegraded":"2023-07-29T02:04:19.444207+0000","last_fullsized":"2023-07-29T02:04:19.444207+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:17:56.960611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"39'5","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:14.463035+0000","last_change":"2023-07-29T01:59:57.537970+0000","last_active":"2023-07-29T02:06:14.463035+0000","last_peered":"2023-07-29T02:06:14.463035+0000","last_clean":"2023-07-29T02:06:14.463035+0000","last_became_active":"2023-07-29T01:59:57.537665+0000","last_became_peered":"2023-07-29T01:59:57.537665+0000","last_unstale":"2023-07-29T02:06:14.463035+0000","last_undegraded":"2023-07-29T02:06:14.463035+0000","last_fullsized":"2023-07-29T02:06:14.463035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":4,"num_write_kb":8199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"39'84","reported_seq":2135,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.421260+0000","last_change":"2023-07-29T02:03:56.981337+0000","last_active":"2023-07-29T02:06:18.421260+0000","last_peered":"2023-07-29T02:06:18.421260+0000","last_clean":"2023-07-29T02:06:18.421260+0000","last_became_active":"2023-07-29T01:59:57.968373+0000","last_became_peered":"2023-07-29T01:59:57.968373+0000","last_unstale":"2023-07-29T02:06:18.421260+0000","last_undegraded":"2023-07-29T02:06:18.421260+0000","last_fullsized":"2023-07-29T02:06:18.421260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:12:06.785485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21661398800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"39'634","reported_seq":2722,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.448266+0000","last_change":"2023-07-29T02:03:57.040708+0000","last_active":"2023-07-29T02:06:19.448266+0000","last_peered":"2023-07-29T02:06:19.448266+0000","last_clean":"2023-07-29T02:06:19.448266+0000","last_became_active":"2023-07-29T02:00:01.984476+0000","last_became_peered":"2023-07-29T02:00:01.984476+0000","last_unstale":"2023-07-29T02:06:19.448266+0000","last_undegraded":"2023-07-29T02:06:19.448266+0000","last_fullsized":"2023-07-29T02:06:19.448266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55548792300000005,"stat_sum":{"num_bytes":35592378,"num_objects":339,"num_object_clones":0,"num_object_copies":1356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":339,"num_whiteouts":0,"num_read":38,"num_read_kb":16563,"num_write":635,"num_write_kb":39103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:21.815399+0000","last_change":"2023-07-29T01:59:53.172039+0000","last_active":"2023-07-29T02:04:21.815399+0000","last_peered":"2023-07-29T02:04:21.815399+0000","last_clean":"2023-07-29T02:04:21.815399+0000","last_became_active":"2023-07-29T01:59:53.171617+0000","last_became_peered":"2023-07-29T01:59:53.171617+0000","last_unstale":"2023-07-29T02:04:21.815399+0000","last_undegraded":"2023-07-29T02:04:21.815399+0000","last_fullsized":"2023-07-29T02:04:21.815399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:46:05.344021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"39'14","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:14.453979+0000","last_change":"2023-07-29T01:59:57.540888+0000","last_active":"2023-07-29T02:06:14.453979+0000","last_peered":"2023-07-29T02:06:14.453979+0000","last_clean":"2023-07-29T02:06:14.453979+0000","last_became_active":"2023-07-29T01:59:57.540449+0000","last_became_peered":"2023-07-29T01:59:57.540449+0000","last_unstale":"2023-07-29T02:06:14.453979+0000","last_undegraded":"2023-07-29T02:06:14.453979+0000","last_fullsized":"2023-07-29T02:06:14.453979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"39'91","reported_seq":2143,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.010867+0000","last_change":"2023-07-29T02:03:57.049030+0000","last_active":"2023-07-29T02:06:19.010867+0000","last_peered":"2023-07-29T02:06:19.010867+0000","last_clean":"2023-07-29T02:06:19.010867+0000","last_became_active":"2023-07-29T01:59:57.967933+0000","last_became_peered":"2023-07-29T01:59:57.967933+0000","last_unstale":"2023-07-29T02:06:19.010867+0000","last_undegraded":"2023-07-29T02:06:19.010867+0000","last_fullsized":"2023-07-29T02:06:19.010867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54069509900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"39'665","reported_seq":2751,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.868401+0000","last_change":"2023-07-29T02:03:56.982796+0000","last_active":"2023-07-29T02:06:07.868401+0000","last_peered":"2023-07-29T02:06:07.868401+0000","last_clean":"2023-07-29T02:06:07.868401+0000","last_became_active":"2023-07-29T02:00:01.984691+0000","last_became_peered":"2023-07-29T02:00:01.984691+0000","last_unstale":"2023-07-29T02:06:07.868401+0000","last_undegraded":"2023-07-29T02:06:07.868401+0000","last_fullsized":"2023-07-29T02:06:07.868401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:50:54.400954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.204776021,"stat_sum":{"num_bytes":24859419,"num_objects":316,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":316,"num_whiteouts":0,"num_read":37,"num_read_kb":6702,"num_write":664,"num_write_kb":28713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.445343+0000","last_change":"2023-07-29T01:59:53.171808+0000","last_active":"2023-07-29T02:04:19.445343+0000","last_peered":"2023-07-29T02:04:19.445343+0000","last_clean":"2023-07-29T02:04:19.445343+0000","last_became_active":"2023-07-29T01:59:53.171463+0000","last_became_peered":"2023-07-29T01:59:53.171463+0000","last_unstale":"2023-07-29T02:04:19.445343+0000","last_undegraded":"2023-07-29T02:04:19.445343+0000","last_fullsized":"2023-07-29T02:04:19.445343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:07:59.559814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"39'7","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:14.447459+0000","last_change":"2023-07-29T01:59:57.549468+0000","last_active":"2023-07-29T02:06:14.447459+0000","last_peered":"2023-07-29T02:06:14.447459+0000","last_clean":"2023-07-29T02:06:14.447459+0000","last_became_active":"2023-07-29T01:59:57.549181+0000","last_became_peered":"2023-07-29T01:59:57.549181+0000","last_unstale":"2023-07-29T02:06:14.447459+0000","last_undegraded":"2023-07-29T02:06:14.447459+0000","last_fullsized":"2023-07-29T02:06:14.447459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"39'97","reported_seq":2149,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.443329+0000","last_change":"2023-07-29T02:03:57.036363+0000","last_active":"2023-07-29T02:06:18.443329+0000","last_peered":"2023-07-29T02:06:18.443329+0000","last_clean":"2023-07-29T02:06:18.443329+0000","last_became_active":"2023-07-29T01:59:57.963659+0000","last_became_peered":"2023-07-29T01:59:57.963659+0000","last_unstale":"2023-07-29T02:06:18.443329+0000","last_undegraded":"2023-07-29T02:06:18.443329+0000","last_fullsized":"2023-07-29T02:06:18.443329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55193447900000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"39'682","reported_seq":2772,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.448222+0000","last_change":"2023-07-29T02:03:57.036172+0000","last_active":"2023-07-29T02:06:19.448222+0000","last_peered":"2023-07-29T02:06:19.448222+0000","last_clean":"2023-07-29T02:06:19.448222+0000","last_became_active":"2023-07-29T02:00:01.983744+0000","last_became_peered":"2023-07-29T02:00:01.983744+0000","last_unstale":"2023-07-29T02:06:19.448222+0000","last_undegraded":"2023-07-29T02:06:19.448222+0000","last_fullsized":"2023-07-29T02:06:19.448222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.552203522,"stat_sum":{"num_bytes":32278530,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":40,"num_read_kb":16416,"num_write":683,"num_write_kb":31830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:04:19.445838+0000","last_change":"2023-07-29T01:59:52.449102+0000","last_active":"2023-07-29T02:04:19.445838+0000","last_peered":"2023-07-29T02:04:19.445838+0000","last_clean":"2023-07-29T02:04:19.445838+0000","last_became_active":"2023-07-29T01:59:52.448814+0000","last_became_peered":"2023-07-29T01:59:52.448814+0000","last_unstale":"2023-07-29T02:04:19.445838+0000","last_undegraded":"2023-07-29T02:04:19.445838+0000","last_fullsized":"2023-07-29T02:04:19.445838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:51.430399+0000","last_clean_scrub_stamp":"2023-07-29T01:59:51.430399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:33:55.775703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"39'425","reported_seq":458,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:47.148677+0000","last_change":"2023-07-29T01:59:57.544590+0000","last_active":"2023-07-29T02:05:47.148677+0000","last_peered":"2023-07-29T02:05:47.148677+0000","last_clean":"2023-07-29T02:05:47.148677+0000","last_became_active":"2023-07-29T01:59:57.544317+0000","last_became_peered":"2023-07-29T01:59:57.544317+0000","last_unstale":"2023-07-29T02:05:47.148677+0000","last_undegraded":"2023-07-29T02:05:47.148677+0000","last_fullsized":"2023-07-29T02:05:47.148677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:07:08.796463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":424,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"39'90","reported_seq":2142,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.440587+0000","last_change":"2023-07-29T02:03:57.049937+0000","last_active":"2023-07-29T02:06:18.440587+0000","last_peered":"2023-07-29T02:06:18.440587+0000","last_clean":"2023-07-29T02:06:18.440587+0000","last_became_active":"2023-07-29T01:59:57.969642+0000","last_became_peered":"2023-07-29T01:59:57.969642+0000","last_unstale":"2023-07-29T02:06:18.440587+0000","last_undegraded":"2023-07-29T02:06:18.440587+0000","last_fullsized":"2023-07-29T02:06:18.440587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53741660000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"39'637","reported_seq":2731,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.912163+0000","last_change":"2023-07-29T02:03:57.053813+0000","last_active":"2023-07-29T02:06:07.912163+0000","last_peered":"2023-07-29T02:06:07.912163+0000","last_clean":"2023-07-29T02:06:07.912163+0000","last_became_active":"2023-07-29T02:00:01.998715+0000","last_became_peered":"2023-07-29T02:00:01.998715+0000","last_unstale":"2023-07-29T02:06:07.912163+0000","last_undegraded":"2023-07-29T02:06:07.912163+0000","last_fullsized":"2023-07-29T02:06:07.912163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54131381700000003,"stat_sum":{"num_bytes":21401745,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":45,"num_read_kb":12330,"num_write":635,"num_write_kb":33528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"39'136","reported_seq":169,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:55.844336+0000","last_change":"2023-07-29T01:59:57.545933+0000","last_active":"2023-07-29T02:05:55.844336+0000","last_peered":"2023-07-29T02:05:55.844336+0000","last_clean":"2023-07-29T02:05:55.844336+0000","last_became_active":"2023-07-29T01:59:57.545744+0000","last_became_peered":"2023-07-29T01:59:57.545744+0000","last_unstale":"2023-07-29T02:05:55.844336+0000","last_undegraded":"2023-07-29T02:05:55.844336+0000","last_fullsized":"2023-07-29T02:05:55.844336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":139,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"39'92","reported_seq":2143,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.448537+0000","last_change":"2023-07-29T02:03:56.956561+0000","last_active":"2023-07-29T02:06:18.448537+0000","last_peered":"2023-07-29T02:06:18.448537+0000","last_clean":"2023-07-29T02:06:18.448537+0000","last_became_active":"2023-07-29T01:59:57.970252+0000","last_became_peered":"2023-07-29T01:59:57.970252+0000","last_unstale":"2023-07-29T02:06:18.448537+0000","last_undegraded":"2023-07-29T02:06:18.448537+0000","last_fullsized":"2023-07-29T02:06:18.448537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46822948199999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"39'637","reported_seq":2723,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.452647+0000","last_change":"2023-07-29T02:03:56.694563+0000","last_active":"2023-07-29T02:06:07.452647+0000","last_peered":"2023-07-29T02:06:07.452647+0000","last_clean":"2023-07-29T02:06:07.452647+0000","last_became_active":"2023-07-29T02:00:01.989481+0000","last_became_peered":"2023-07-29T02:00:01.989481+0000","last_unstale":"2023-07-29T02:06:07.452647+0000","last_undegraded":"2023-07-29T02:06:07.452647+0000","last_fullsized":"2023-07-29T02:06:07.452647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:17:55.923302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.187630984,"stat_sum":{"num_bytes":25047033,"num_objects":309,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":38,"num_read_kb":8227,"num_write":637,"num_write_kb":24796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"39'112","reported_seq":149,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.553859+0000","last_change":"2023-07-29T01:59:57.543782+0000","last_active":"2023-07-29T02:05:51.553859+0000","last_peered":"2023-07-29T02:05:51.553859+0000","last_clean":"2023-07-29T02:05:51.553859+0000","last_became_active":"2023-07-29T01:59:57.543445+0000","last_became_peered":"2023-07-29T01:59:57.543445+0000","last_unstale":"2023-07-29T02:05:51.553859+0000","last_undegraded":"2023-07-29T02:05:51.553859+0000","last_fullsized":"2023-07-29T02:05:51.553859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:12:06.999870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":114,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"39'90","reported_seq":2141,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.449830+0000","last_change":"2023-07-29T02:03:57.113153+0000","last_active":"2023-07-29T02:06:18.449830+0000","last_peered":"2023-07-29T02:06:18.449830+0000","last_clean":"2023-07-29T02:06:18.449830+0000","last_became_active":"2023-07-29T01:59:57.964925+0000","last_became_peered":"2023-07-29T01:59:57.964925+0000","last_unstale":"2023-07-29T02:06:18.449830+0000","last_undegraded":"2023-07-29T02:06:18.449830+0000","last_fullsized":"2023-07-29T02:06:18.449830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35003659399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'665","reported_seq":2749,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:08.030901+0000","last_change":"2023-07-29T02:03:56.799552+0000","last_active":"2023-07-29T02:06:08.030901+0000","last_peered":"2023-07-29T02:06:08.030901+0000","last_clean":"2023-07-29T02:06:08.030901+0000","last_became_active":"2023-07-29T02:00:01.985310+0000","last_became_peered":"2023-07-29T02:00:01.985310+0000","last_unstale":"2023-07-29T02:06:08.030901+0000","last_undegraded":"2023-07-29T02:06:08.030901+0000","last_fullsized":"2023-07-29T02:06:08.030901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:28:25.551162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.31035642899999999,"stat_sum":{"num_bytes":19557603,"num_objects":304,"num_object_clones":0,"num_object_copies":1216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":304,"num_whiteouts":0,"num_read":36,"num_read_kb":35,"num_write":665,"num_write_kb":19402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"39'86","reported_seq":125,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:11.297549+0000","last_change":"2023-07-29T01:59:57.541908+0000","last_active":"2023-07-29T02:06:11.297549+0000","last_peered":"2023-07-29T02:06:11.297549+0000","last_clean":"2023-07-29T02:06:11.297549+0000","last_became_active":"2023-07-29T01:59:57.541633+0000","last_became_peered":"2023-07-29T01:59:57.541633+0000","last_unstale":"2023-07-29T02:06:11.297549+0000","last_undegraded":"2023-07-29T02:06:11.297549+0000","last_fullsized":"2023-07-29T02:06:11.297549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:52:44.954697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":18,"num_read_kb":12303,"num_write":84,"num_write_kb":16462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"39'85","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.448416+0000","last_change":"2023-07-29T02:03:57.113037+0000","last_active":"2023-07-29T02:06:18.448416+0000","last_peered":"2023-07-29T02:06:18.448416+0000","last_clean":"2023-07-29T02:06:18.448416+0000","last_became_active":"2023-07-29T01:59:57.965383+0000","last_became_peered":"2023-07-29T01:59:57.965383+0000","last_unstale":"2023-07-29T02:06:18.448416+0000","last_undegraded":"2023-07-29T02:06:18.448416+0000","last_fullsized":"2023-07-29T02:06:18.448416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.352110162,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"39'676","reported_seq":2764,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:08.041523+0000","last_change":"2023-07-29T02:03:57.114115+0000","last_active":"2023-07-29T02:06:08.041523+0000","last_peered":"2023-07-29T02:06:08.041523+0000","last_clean":"2023-07-29T02:06:08.041523+0000","last_became_active":"2023-07-29T02:00:01.993454+0000","last_became_peered":"2023-07-29T02:00:01.993454+0000","last_unstale":"2023-07-29T02:06:08.041523+0000","last_undegraded":"2023-07-29T02:06:08.041523+0000","last_fullsized":"2023-07-29T02:06:08.041523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.33100711700000002,"stat_sum":{"num_bytes":33339861,"num_objects":341,"num_object_clones":0,"num_object_copies":1364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":0,"num_read":39,"num_read_kb":19097,"num_write":677,"num_write_kb":41065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"39'124","reported_seq":158,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:15.793671+0000","last_change":"2023-07-29T01:59:57.539625+0000","last_active":"2023-07-29T02:06:15.793671+0000","last_peered":"2023-07-29T02:06:15.793671+0000","last_clean":"2023-07-29T02:06:15.793671+0000","last_became_active":"2023-07-29T01:59:57.539181+0000","last_became_peered":"2023-07-29T01:59:57.539181+0000","last_unstale":"2023-07-29T02:06:15.793671+0000","last_undegraded":"2023-07-29T02:06:15.793671+0000","last_fullsized":"2023-07-29T02:06:15.793671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":120,"num_write_kb":12364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"39'91","reported_seq":2142,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.450445+0000","last_change":"2023-07-29T02:03:57.171546+0000","last_active":"2023-07-29T02:06:18.450445+0000","last_peered":"2023-07-29T02:06:18.450445+0000","last_clean":"2023-07-29T02:06:18.450445+0000","last_became_active":"2023-07-29T01:59:57.966580+0000","last_became_peered":"2023-07-29T01:59:57.966580+0000","last_unstale":"2023-07-29T02:06:18.450445+0000","last_undegraded":"2023-07-29T02:06:18.450445+0000","last_fullsized":"2023-07-29T02:06:18.450445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38010548900000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"39'649","reported_seq":2736,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.671722+0000","last_change":"2023-07-29T02:03:57.046097+0000","last_active":"2023-07-29T02:06:07.671722+0000","last_peered":"2023-07-29T02:06:07.671722+0000","last_clean":"2023-07-29T02:06:07.671722+0000","last_became_active":"2023-07-29T02:00:01.985554+0000","last_became_peered":"2023-07-29T02:00:01.985554+0000","last_unstale":"2023-07-29T02:06:07.671722+0000","last_undegraded":"2023-07-29T02:06:07.671722+0000","last_fullsized":"2023-07-29T02:06:07.671722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53877218400000004,"stat_sum":{"num_bytes":39819276,"num_objects":290,"num_object_clones":0,"num_object_copies":1160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":290,"num_whiteouts":0,"num_read":38,"num_read_kb":16418,"num_write":646,"num_write_kb":43313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"39'135","reported_seq":175,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:14.447799+0000","last_change":"2023-07-29T01:59:57.537754+0000","last_active":"2023-07-29T02:06:14.447799+0000","last_peered":"2023-07-29T02:06:14.447799+0000","last_clean":"2023-07-29T02:06:14.447799+0000","last_became_active":"2023-07-29T01:59:57.537457+0000","last_became_peered":"2023-07-29T01:59:57.537457+0000","last_unstale":"2023-07-29T02:06:14.447799+0000","last_undegraded":"2023-07-29T02:06:14.447799+0000","last_fullsized":"2023-07-29T02:06:14.447799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":132,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"39'109","reported_seq":2160,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.438026+0000","last_change":"2023-07-29T02:03:57.113779+0000","last_active":"2023-07-29T02:06:18.438026+0000","last_peered":"2023-07-29T02:06:18.438026+0000","last_clean":"2023-07-29T02:06:18.438026+0000","last_became_active":"2023-07-29T01:59:57.960318+0000","last_became_peered":"2023-07-29T01:59:57.960318+0000","last_unstale":"2023-07-29T02:06:18.438026+0000","last_undegraded":"2023-07-29T02:06:18.438026+0000","last_fullsized":"2023-07-29T02:06:18.438026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.32984874600000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"39'107","reported_seq":2158,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.430260+0000","last_change":"2023-07-29T02:03:56.970824+0000","last_active":"2023-07-29T02:06:18.430260+0000","last_peered":"2023-07-29T02:06:18.430260+0000","last_clean":"2023-07-29T02:06:18.430260+0000","last_became_active":"2023-07-29T01:59:57.959960+0000","last_became_peered":"2023-07-29T01:59:57.959960+0000","last_unstale":"2023-07-29T02:06:18.430260+0000","last_undegraded":"2023-07-29T02:06:18.430260+0000","last_fullsized":"2023-07-29T02:06:18.430260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:07:20.224535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22491762700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"39'110","reported_seq":2162,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.448522+0000","last_change":"2023-07-29T02:03:57.173410+0000","last_active":"2023-07-29T02:06:18.448522+0000","last_peered":"2023-07-29T02:06:18.448522+0000","last_clean":"2023-07-29T02:06:18.448522+0000","last_became_active":"2023-07-29T01:59:57.975384+0000","last_became_peered":"2023-07-29T01:59:57.975384+0000","last_unstale":"2023-07-29T02:06:18.448522+0000","last_undegraded":"2023-07-29T02:06:18.448522+0000","last_fullsized":"2023-07-29T02:06:18.448522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38175464599999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"39'101","reported_seq":2153,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.438562+0000","last_change":"2023-07-29T02:03:57.112576+0000","last_active":"2023-07-29T02:06:18.438562+0000","last_peered":"2023-07-29T02:06:18.438562+0000","last_clean":"2023-07-29T02:06:18.438562+0000","last_became_active":"2023-07-29T01:59:57.967603+0000","last_became_peered":"2023-07-29T01:59:57.967603+0000","last_unstale":"2023-07-29T02:06:18.438562+0000","last_undegraded":"2023-07-29T02:06:18.438562+0000","last_fullsized":"2023-07-29T02:06:18.438562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.350807488,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"39'99","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.448035+0000","last_change":"2023-07-29T02:03:57.150968+0000","last_active":"2023-07-29T02:06:18.448035+0000","last_peered":"2023-07-29T02:06:18.448035+0000","last_clean":"2023-07-29T02:06:18.448035+0000","last_became_active":"2023-07-29T01:59:57.966672+0000","last_became_peered":"2023-07-29T01:59:57.966672+0000","last_unstale":"2023-07-29T02:06:18.448035+0000","last_undegraded":"2023-07-29T02:06:18.448035+0000","last_fullsized":"2023-07-29T02:06:18.448035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.39433596799999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"39'79","reported_seq":2130,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.437523+0000","last_change":"2023-07-29T02:03:57.048829+0000","last_active":"2023-07-29T02:06:18.437523+0000","last_peered":"2023-07-29T02:06:18.437523+0000","last_clean":"2023-07-29T02:06:18.437523+0000","last_became_active":"2023-07-29T01:59:57.968449+0000","last_became_peered":"2023-07-29T01:59:57.968449+0000","last_unstale":"2023-07-29T02:06:18.437523+0000","last_undegraded":"2023-07-29T02:06:18.437523+0000","last_fullsized":"2023-07-29T02:06:18.437523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54020755499999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":918109411,"num_objects":10156,"num_object_clones":0,"num_object_copies":40624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10156,"num_whiteouts":0,"num_read":1251,"num_read_kb":366219,"num_write":20741,"num_write_kb":1040888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1801588736,"data_stored":1952841728,"data_compressed":122947712,"data_compressed_allocated":138481664,"data_compressed_original":289734656,"omap_allocated":0,"internal_metadata":0},"log_size":20769,"ondisk_log_size":20769,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5774,"ondisk_log_size":5774,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":234407831,"num_objects":142,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":142,"num_whiteouts":0,"num_read":309,"num_read_kb":151139,"num_write":3707,"num_write_kb":233182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97296384,"data_stored":468815662,"data_compressed":61092760,"data_compressed_allocated":76914688,"data_compressed_original":448495616,"omap_allocated":0,"internal_metadata":0},"log_size":3674,"ondisk_log_size":3674,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574930,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":290212,"kb_used_data":223068,"kb_used_omap":0,"kb_used_meta":67136,"kb_avail":94081628,"statfs":{"total":96636764160,"available":96339587072,"internally_reserved":0,"allocated":228421632,"data_stored":299259226,"data_compressed":25181964,"data_compressed_allocated":29503488,"data_compressed_original":100593664,"omap_allocated":0,"internal_metadata":68747264},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.56000000000000005,"15min":0.51300000000000001},"min":{"1min":0.26400000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.751,"5min":6.0650000000000004,"15min":6.0650000000000004},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.54900000000000004,"15min":0.51700000000000002},"min":{"1min":0.30199999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61599999999999999,"5min":3.988,"15min":3.988},"last":0.56299999999999994}]},{"osd":1,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.66400000000000003,"15min":0.56200000000000006},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.70099999999999996,"5min":10.303000000000001,"15min":10.303000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.79800000000000004,"15min":0.625},"min":{"1min":0.32900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.80100000000000005,"5min":19.527999999999999,"15min":19.527999999999999},"last":0.48399999999999999}]},{"osd":2,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.63400000000000001,"15min":0.59299999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70499999999999996,"5min":6.9720000000000004,"15min":6.9720000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.58399999999999996,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63400000000000001,"5min":3.8260000000000001,"15min":3.8260000000000001},"last":0.52600000000000002}]},{"osd":3,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72999999999999998,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.57799999999999996,"15min":0.60599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.77700000000000002,"5min":1.22,"15min":1.22},"last":0.63600000000000001}]},{"osd":4,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47899999999999998,"15min":0.52700000000000002},"min":{"1min":0.32200000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66100000000000003,"5min":1.454,"15min":1.454},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.51100000000000001,"15min":0.55900000000000005},"min":{"1min":0.30599999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.0249999999999999,"5min":1.244,"15min":1.244},"last":0.41499999999999998}]},{"osd":5,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.50900000000000001,"15min":0.55900000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70799999999999996,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.437},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.53400000000000003,"15min":0.57099999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75800000000000001,"5min":3.621,"15min":3.621},"last":0.38100000000000001}]},{"osd":6,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55600000000000005,"15min":0.60299999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.74399999999999999,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.58099999999999996,"15min":0.627},"min":{"1min":0.37,"5min":0.312,"15min":0.312},"max":{"1min":0.79600000000000004,"5min":3.488,"15min":3.488},"last":0.504}]}]},{"osd":6,"up_from":13,"seq":55834574930,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304904,"kb_used_data":241856,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":94066936,"statfs":{"total":96636764160,"available":96324542464,"internally_reserved":0,"allocated":247660544,"data_stored":288753905,"data_compressed":18888304,"data_compressed_allocated":21577728,"data_compressed_original":62894080,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.57699999999999996,"15min":0.54000000000000004},"min":{"1min":0.33200000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.65300000000000002,"5min":7,"15min":7},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.627,"15min":0.56100000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.59399999999999997,"5min":6.4619999999999997,"15min":6.4619999999999997},"last":0.39300000000000002}]},{"osd":1,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.64700000000000002,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70199999999999996,"5min":12.462,"15min":12.462},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.626,"15min":0.58899999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.63900000000000001,"5min":6.4130000000000003,"15min":6.4130000000000003},"last":0.48499999999999999}]},{"osd":2,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.629,"5min":1.367,"15min":1.367},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.60299999999999998,"15min":0.57499999999999996},"min":{"1min":0.39800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.65600000000000003,"5min":5.5330000000000004,"15min":5.5330000000000004},"last":0.59499999999999997}]},{"osd":3,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.65700000000000003,"15min":0.59899999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70799999999999996,"5min":6.4889999999999999,"15min":6.4889999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.64500000000000002,"15min":0.61499999999999999},"min":{"1min":0.40400000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.69599999999999995,"5min":6.8559999999999999,"15min":6.8559999999999999},"last":0.51300000000000001}]},{"osd":4,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.68600000000000005,"15min":0.58799999999999997},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68000000000000005,"5min":24.123999999999999,"15min":24.123999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.32700000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.70999999999999996,"5min":6.3710000000000004,"15min":6.3710000000000004},"last":0.56699999999999995}]},{"osd":5,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48499999999999999,"15min":0.53900000000000003},"min":{"1min":0.33900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68899999999999995,"5min":0.82999999999999996,"15min":1.1140000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59499999999999997,"15min":0.58299999999999996},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73199999999999998,"5min":6.9669999999999996,"15min":6.9669999999999996},"last":0.67600000000000005}]},{"osd":7,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.34999999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73299999999999998,"5min":5.484,"15min":5.484},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59599999999999997,"15min":0.61699999999999999},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.71299999999999997,"5min":5.2300000000000004,"15min":5.2300000000000004},"last":0.65800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371428,"kb_used_data":268188,"kb_used_omap":0,"kb_used_meta":103232,"kb_avail":94000412,"statfs":{"total":96636764160,"available":96256421888,"internally_reserved":0,"allocated":274624512,"data_stored":329542417,"data_compressed":22309908,"data_compressed_allocated":25948160,"data_compressed_original":81092608,"omap_allocated":0,"internal_metadata":105709568},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.39000000000000001,"15min":0.51400000000000001},"min":{"1min":0.25,"5min":0.20799999999999999,"15min":0.20399999999999999},"max":{"1min":0.441,"5min":3.7989999999999999,"15min":7.1299999999999999},"last":0.311},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.38600000000000001,"15min":0.51000000000000001},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57099999999999995,"5min":0.94599999999999995,"15min":5.4779999999999998},"last":0.42899999999999999}]},{"osd":2,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.61299999999999999,"15min":0.88900000000000001},"min":{"1min":0.23300000000000001,"5min":0.214,"15min":0.20899999999999999},"max":{"1min":0.47799999999999998,"5min":22.483000000000001,"15min":22.483000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.44,"15min":0.67800000000000005},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56599999999999995,"5min":3.0619999999999998,"15min":11.028},"last":0.35799999999999998}]},{"osd":3,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46899999999999997,"15min":0.59999999999999998},"min":{"1min":0.33300000000000002,"5min":0.27000000000000002,"15min":0.26800000000000002},"max":{"1min":0.54200000000000004,"5min":2.9900000000000002,"15min":7.1699999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.41999999999999998,"15min":0.39600000000000002},"min":{"1min":0.28399999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.51500000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.48899999999999999}]},{"osd":4,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.70199999999999996,"15min":1.048},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78500000000000003,"5min":5.7809999999999997,"15min":17.925000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.625,"15min":0.86699999999999999},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79800000000000004,"5min":3.0329999999999999,"15min":10.961},"last":0.57799999999999996}]},{"osd":5,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.60599999999999998,"15min":0.71099999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79700000000000004,"5min":0.878,"15min":5.391},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.70699999999999996,"15min":1.0880000000000001},"min":{"1min":0.45100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86399999999999999,"5min":5.8849999999999998,"15min":17.994},"last":0.5}]},{"osd":6,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.629,"15min":0.73999999999999999},"min":{"1min":0.40100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80800000000000005,"5min":0.91300000000000003,"15min":5.452},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.72499999999999998,"15min":1.077},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82999999999999996,"5min":5.8540000000000001,"15min":17.963999999999999},"last":0.52000000000000002}]},{"osd":7,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.67400000000000004,"15min":0.89000000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.755,"5min":3.0880000000000001,"15min":10.994},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67300000000000004,"15min":0.76300000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83499999999999996,"5min":2.9889999999999999,"15min":5.4249999999999998},"last":0.56100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574930,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329076,"kb_used_data":239788,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94042764,"statfs":{"total":96636764160,"available":96299790336,"internally_reserved":0,"allocated":245542912,"data_stored":309139007,"data_compressed":23440797,"data_compressed_allocated":27287552,"data_compressed_original":91111424,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.77600000000000002,"15min":0.47799999999999998},"min":{"1min":0.20999999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.55500000000000005,"5min":39.070999999999998,"15min":39.070999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.435,"15min":0.38900000000000001},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.439,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":0.23300000000000001}]},{"osd":2,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.54600000000000004,"15min":0.45200000000000001},"min":{"1min":0.311,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.58899999999999997,"5min":10.438000000000001,"15min":10.438000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.55900000000000005,"15min":0.45700000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51700000000000002,"5min":10.802,"15min":10.802},"last":0.35799999999999998}]},{"osd":3,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.46500000000000002,"15min":0.39900000000000002},"min":{"1min":0.251,"5min":0.246,"15min":0.246},"max":{"1min":0.48699999999999999,"5min":4.6879999999999997,"15min":4.6879999999999997},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.50900000000000001,"15min":0.45300000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63600000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.377}]},{"osd":4,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74099999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":0.626},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.67300000000000004,"15min":0.629},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.84599999999999997,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.53600000000000003}]},{"osd":5,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.374,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76900000000000002,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.63,"15min":0.624},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84999999999999998,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.47399999999999998}]},{"osd":6,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.68000000000000005,"15min":0.64700000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92200000000000004,"5min":1.663,"15min":1.663},"last":0.499},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.40500000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.74099999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.56799999999999995}]},{"osd":7,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.67500000000000004,"15min":0.65000000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":1.496,"15min":1.496},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.67800000000000005,"15min":0.66100000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.59299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574930,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263964,"kb_used_data":200916,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":94107876,"statfs":{"total":96636764160,"available":96366465024,"internally_reserved":0,"allocated":205737984,"data_stored":235440369,"data_compressed":13107136,"data_compressed_allocated":15015936,"data_compressed_original":44941312,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.46300000000000002,"15min":0.39600000000000002},"min":{"1min":0.22800000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.53600000000000003,"5min":10.795999999999999,"15min":10.795999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.53700000000000003,"15min":0.66100000000000003},"min":{"1min":0.253,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.496,"5min":16.536999999999999,"15min":16.536999999999999},"last":0.31}]},{"osd":1,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44900000000000001,"15min":0.55700000000000005},"min":{"1min":0.28499999999999998,"5min":0.223,"15min":0.223},"max":{"1min":0.68400000000000005,"5min":5.2160000000000002,"15min":6.1040000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.47599999999999998,"15min":0.435},"min":{"1min":0.311,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.53900000000000003,"5min":7.4880000000000004,"15min":7.4880000000000004},"last":0.34000000000000002}]},{"osd":3,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42699999999999999,"15min":0.40500000000000003},"min":{"1min":0.28599999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53800000000000003,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.504,"15min":0.61399999999999999},"min":{"1min":0.31,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.60399999999999998,"5min":5.4240000000000004,"15min":6.0620000000000003},"last":0.36099999999999999}]},{"osd":4,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.63700000000000001,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71299999999999997,"5min":5.2919999999999998,"15min":5.2919999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.67100000000000004,"15min":0.65900000000000003},"min":{"1min":0.42199999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77200000000000002,"5min":6.3300000000000001,"15min":6.3300000000000001},"last":0.53500000000000003}]},{"osd":5,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67700000000000005,"15min":0.65800000000000003},"min":{"1min":0.39200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.77300000000000002,"5min":6.149,"15min":6.149},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.89300000000000002,"15min":0.92800000000000005},"min":{"1min":0.38100000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77900000000000003,"5min":28.702000000000002,"15min":28.702000000000002},"last":0.34899999999999998}]},{"osd":6,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65100000000000002,"15min":0.85799999999999998},"min":{"1min":0.40300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.76400000000000001,"5min":4.5179999999999998,"15min":9.1199999999999992},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67800000000000005,"15min":0.65800000000000003},"min":{"1min":0.442,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86899999999999999,"5min":5.2530000000000001,"15min":5.2530000000000001},"last":0.57199999999999995}]},{"osd":7,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.69399999999999995,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80100000000000005,"5min":6.2930000000000001,"15min":6.2930000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.67900000000000005,"15min":0.88500000000000001},"min":{"1min":0.433,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79400000000000004,"5min":4.4809999999999999,"15min":9.1620000000000008},"last":0.42899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574930,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":291968,"kb_used_data":202680,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94079872,"statfs":{"total":96636764160,"available":96337788928,"internally_reserved":0,"allocated":207544320,"data_stored":293420123,"data_compressed":26117434,"data_compressed_allocated":31023104,"data_compressed_original":117125120,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.36599999999999999,"15min":0.34100000000000003},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.57099999999999995,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35699999999999998,"15min":0.36599999999999999},"min":{"1min":0.24299999999999999,"5min":0.23200000000000001,"15min":0.22900000000000001},"max":{"1min":0.54100000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.41399999999999998}]},{"osd":1,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.44700000000000001,"15min":0.38600000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54000000000000004,"5min":9.7289999999999992,"15min":9.7289999999999992},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.47599999999999998,"15min":0.41399999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.21299999999999999},"max":{"1min":0.58199999999999996,"5min":7.4989999999999997,"15min":7.4989999999999997},"last":0.38100000000000001}]},{"osd":2,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40899999999999997,"15min":0.40699999999999997},"min":{"1min":0.28399999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.59999999999999998,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.45000000000000001,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68600000000000005,"5min":1.603,"15min":1.603},"last":0.42699999999999999}]},{"osd":4,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.34399999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81699999999999995,"5min":0.95899999999999996,"15min":0.96599999999999997},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.68500000000000005,"15min":0.64000000000000001},"min":{"1min":0.375,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.74399999999999999,"5min":8.6869999999999994,"15min":8.6869999999999994},"last":0.54000000000000004}]},{"osd":5,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67900000000000005,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.438},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.63400000000000001,"15min":0.60799999999999998},"min":{"1min":0.38,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88100000000000001,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.52700000000000002}]},{"osd":6,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67800000000000005,"15min":0.64700000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81200000000000006,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.65100000000000002,"15min":0.65600000000000003},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.45200000000000001}]},{"osd":7,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.70799999999999996,"15min":0.64400000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84899999999999998,"5min":8.7289999999999992,"15min":8.7289999999999992},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86499999999999999,"5min":1.0309999999999999,"15min":1.119},"last":0.50700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574929,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356164,"kb_used_data":252924,"kb_used_omap":0,"kb_used_meta":103232,"kb_avail":94015676,"statfs":{"total":96636764160,"available":96272052224,"internally_reserved":0,"allocated":258994176,"data_stored":357549777,"data_compressed":30651040,"data_compressed_allocated":36261888,"data_compressed_original":135057408,"omap_allocated":0,"internal_metadata":105709568},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.61099999999999999,"15min":0.54000000000000004},"min":{"1min":0.31900000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.68200000000000005,"5min":4.4800000000000004,"15min":4.4800000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.57299999999999995,"15min":0.84499999999999997},"min":{"1min":0.28399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.69499999999999995,"5min":7.2679999999999998,"15min":12.231999999999999},"last":0.53200000000000003}]},{"osd":1,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.55700000000000005,"15min":0.51500000000000001},"min":{"1min":0.29399999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.65100000000000002,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.622},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.54700000000000004,"15min":0.53100000000000003},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66700000000000004,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.34200000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68400000000000005,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65900000000000003,"5min":0.874,"15min":0.874},"last":0.64000000000000001}]},{"osd":3,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63200000000000001,"5min":3.9969999999999999,"15min":3.9969999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.96199999999999997,"15min":0.69199999999999995},"min":{"1min":0.40899999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67100000000000004,"5min":28.837,"15min":28.837},"last":0.72599999999999998}]},{"osd":5,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.48099999999999998,"15min":0.496},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.69499999999999995,"5min":1.8,"15min":1.8},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48699999999999999,"15min":0.501},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60199999999999998,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.81599999999999995}]},{"osd":6,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51800000000000002,"15min":0.50800000000000001},"min":{"1min":0.314,"5min":0.311,"15min":0.311},"max":{"1min":0.623,"5min":1.006,"15min":1.006},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54100000000000004,"15min":0.54900000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71999999999999997,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.74299999999999999}]},{"osd":7,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64300000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.873},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57599999999999996},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67500000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.91900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574931,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313700,"kb_used_data":228508,"kb_used_omap":0,"kb_used_meta":85184,"kb_avail":94058140,"statfs":{"total":96636764160,"available":96315535360,"internally_reserved":0,"allocated":233992192,"data_stored":311454589,"data_compressed":24408749,"data_compressed_allocated":28868608,"data_compressed_original":106561536,"omap_allocated":0,"internal_metadata":87228416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54400000000000004,"15min":0.51400000000000001},"min":{"1min":0.23000000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.626,"15min":0.54200000000000004},"min":{"1min":0.29699999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":8.2590000000000003,"5min":8.2590000000000003,"15min":8.2590000000000003},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.58099999999999996,"15min":0.51100000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.9179999999999999,"5min":5.9119999999999999,"15min":5.9119999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.58199999999999996,"15min":0.54800000000000004},"min":{"1min":0.32200000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":3.996,"5min":3.996,"15min":3.996},"last":0.45300000000000001}]},{"osd":2,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.51500000000000001},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":2.8929999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.70199999999999996,"15min":0.59999999999999998},"min":{"1min":0.33100000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":9.8360000000000003,"5min":9.8360000000000003,"15min":9.8360000000000003},"last":0.38900000000000001}]},{"osd":3,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.57899999999999996,"15min":0.55500000000000005},"min":{"1min":0.32100000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.83699999999999997,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.70099999999999996,"15min":0.60399999999999998},"min":{"1min":0.34300000000000003,"5min":0.314,"15min":0.314},"max":{"1min":8.1940000000000008,"5min":8.1940000000000008,"15min":8.1940000000000008},"last":0.51600000000000001}]},{"osd":4,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.49299999999999999,"15min":0.51300000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.441},{"interface":"front","average":{"1min":0.497,"5min":0.498,"15min":0.53200000000000003},"min":{"1min":0.318,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.73299999999999998,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.58699999999999997}]},{"osd":6,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.51700000000000002,"15min":0.54100000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.55600000000000005},"min":{"1min":0.35499999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.56299999999999994}]},{"osd":7,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56899999999999995,"15min":0.58999999999999997},"min":{"1min":0.40699999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":0.57699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12668928,"data_stored":55102798,"data_compressed":7347975,"data_compressed_allocated":9121792,"data_compressed_original":51560448,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7892992,"data_stored":41943040,"data_compressed":5179048,"data_compressed_allocated":6578176,"data_compressed_original":40628224,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":20971520,"data_compressed":2599703,"data_compressed_allocated":3166208,"data_compressed_original":19935232,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19505152,"data_stored":87029547,"data_compressed":11558705,"data_compressed_allocated":14503936,"data_compressed_original":82034688,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":17969152,"data_stored":92851680,"data_compressed":11554185,"data_compressed_allocated":14667776,"data_compressed_original":89567232,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13971456,"data_stored":71303820,"data_compressed":9372464,"data_compressed_allocated":11796480,"data_compressed_original":69136384,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":33554432,"data_compressed":4791721,"data_compressed_allocated":5980160,"data_compressed_original":32194560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":13746176,"data_stored":66058825,"data_compressed":8688959,"data_compressed_allocated":11100160,"data_compressed_original":63438848,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":232435712,"data_stored":253820928,"data_compressed":16092822,"data_compressed_allocated":18165760,"data_compressed_original":39550976,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":266227712,"data_stored":286793728,"data_compressed":17098430,"data_compressed_allocated":19324928,"data_compressed_original":39890944,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":201097216,"data_stored":214253568,"data_compressed":10507433,"data_compressed_allocated":11849728,"data_compressed_original":25006080,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":187604992,"data_stored":206176256,"data_compressed":14558729,"data_compressed_allocated":16519168,"data_compressed_original":35090432,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":240586752,"data_stored":264482816,"data_compressed":19096855,"data_compressed_allocated":21594112,"data_compressed_original":45490176,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":219582464,"data_stored":239935488,"data_compressed":15036285,"data_compressed_allocated":17072128,"data_compressed_original":37425152,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":239882240,"data_stored":254984192,"data_compressed":14096583,"data_compressed_allocated":15597568,"data_compressed_original":30699520,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":214171648,"data_stored":232394752,"data_compressed":16460575,"data_compressed_allocated":18358272,"data_compressed_original":36581376,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T02:06:26.190 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.190 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.190 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.191 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.191 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.191 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.191 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.192 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.192 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.192 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.193 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.193 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.193 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.194 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.194 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.194 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.194 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.195 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.195 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.195 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.196 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.196 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.196 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.196 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.197 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.197 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.197 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.198 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.198 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.198 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.198 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.199 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.199 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.199 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.200 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.200 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.200 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.201 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.201 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.201 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.201 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.202 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.202 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.202 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.203 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.203 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.203 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.203 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.204 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.204 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.204 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.205 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.205 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.205 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.205 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.206 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.206 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.206 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.207 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.207 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.207 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.207 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.208 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.208 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.208 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.209 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.209 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.209 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.209 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.210 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.210 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.210 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.211 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.211 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.211 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.211 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.212 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.212 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.212 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.213 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.213 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.213 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.214 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.214 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.214 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.214 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.215 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-07-29T01:59:51.430399+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=51, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.215 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.216 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.216 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-07-29T01:59:51.430399+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=51, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.216 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.216 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.217 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.217 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-07-29T01:59:51.430399+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=51, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.217 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.218 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.218 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.218 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-07-29T01:59:51.430399+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=51, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.218 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.219 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.219 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.219 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-07-29T01:59:51.430399+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=51, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.220 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.220 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.220 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.221 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-07-29T01:59:51.430399+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=51, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.221 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.221 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.221 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.222 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-07-29T01:59:51.430399+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=51, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.222 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.222 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.223 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.223 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-07-29T01:59:51.430399+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=51, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.223 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.223 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.224 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.224 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.224 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.225 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.225 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.225 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.225 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.226 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.226 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.226 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.227 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.227 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.227 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.227 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.228 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.228 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.228 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.229 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.229 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.229 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:26.229 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-29T02:06:37.693 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:06:37.696 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:06:46.231 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T02:06:46.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.377+0000 7f37a41d4700 1 Processor -- start 2023-07-29T02:06:46.358 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.377+0000 7f37a41d4700 1 -- start start 2023-07-29T02:06:46.360 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.378+0000 7f37a41d4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f379c1545b0 0x7f379c06a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:46.361 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.378+0000 7f37a41d4700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f379c0bf750 0x7f379c06ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:46.361 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.378+0000 7f37a41d4700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f379c0c6770 con 0x7f379c0c84c0 2023-07-29T02:06:46.361 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.378+0000 7f37a41d4700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379c06e420 con 0x7f379c0bf750 2023-07-29T02:06:46.361 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.378+0000 7f37a41d4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379c06dea0 con 0x7f379c1545b0 2023-07-29T02:06:46.362 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.378+0000 7f37a176f700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f379c0bf750 0x7f379c06ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:46.362 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.378+0000 7f37a176f700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f379c0bf750 0x7f379c06ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58578/0 (socket says 172.21.15.42:58578) 2023-07-29T02:06:46.362 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.378+0000 7f37a176f700 1 -- 172.21.15.42:0/518748776 learned_addr learned my addr 172.21.15.42:0/518748776 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:46.362 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.378+0000 7f37a1f70700 1 --2- 172.21.15.42:0/518748776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f379c1545b0 0x7f379c06a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:46.362 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.378+0000 7f37a176f700 1 -- 172.21.15.42:0/518748776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f379c1545b0 msgr2=0x7f379c06a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:06:46.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.378+0000 7f37a176f700 1 --2- 172.21.15.42:0/518748776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f379c1545b0 0x7f379c06a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:46.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.378+0000 7f37a176f700 1 -- 172.21.15.42:0/518748776 >> v1:172.21.15.144:6789/0 conn(0x7f379c0c84c0 legacy=0x7f379c1573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:46.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.378+0000 7f37a176f700 1 -- 172.21.15.42:0/518748776 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379c0c69c0 con 0x7f379c0bf750 2023-07-29T02:06:46.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.378+0000 7f37a1f70700 1 --2- 172.21.15.42:0/518748776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f379c1545b0 0x7f379c06a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:06:46.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.379+0000 7f37a176f700 1 --2- 172.21.15.42:0/518748776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f379c0bf750 0x7f379c06ac90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f37980098f0 tx=0x7f3798009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a46eafe82d182f server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:46.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.379+0000 7f37a0f6e700 1 -- 172.21.15.42:0/518748776 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379800b8a0 con 0x7f379c0bf750 2023-07-29T02:06:46.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.379+0000 7f37a0f6e700 1 -- 172.21.15.42:0/518748776 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379800ba00 con 0x7f379c0bf750 2023-07-29T02:06:46.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.379+0000 7f37a0f6e700 1 -- 172.21.15.42:0/518748776 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379800bd90 con 0x7f379c0bf750 2023-07-29T02:06:46.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.379+0000 7f37a41d4700 1 -- 172.21.15.42:0/518748776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f379c0bf750 msgr2=0x7f379c06ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:46.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.379+0000 7f37a41d4700 1 --2- 172.21.15.42:0/518748776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f379c0bf750 0x7f379c06ac90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f37980098f0 tx=0x7f3798009c00 comp rx=0 tx=0).stop 2023-07-29T02:06:46.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.379+0000 7f37a41d4700 1 -- 172.21.15.42:0/518748776 shutdown_connections 2023-07-29T02:06:46.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.379+0000 7f37a41d4700 1 --2- 172.21.15.42:0/518748776 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f379c1545b0 0x7f379c06a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:46.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.379+0000 7f37a41d4700 1 --2- 172.21.15.42:0/518748776 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f379c0bf750 0x7f379c06ac90 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:46.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.379+0000 7f37a41d4700 1 -- 172.21.15.42:0/518748776 >> 172.21.15.42:0/518748776 conn(0x7f379c0c8970 msgr2=0x7f379c0c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:46.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.379+0000 7f37a41d4700 1 -- 172.21.15.42:0/518748776 shutdown_connections 2023-07-29T02:06:46.366 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.379+0000 7f37a41d4700 1 -- 172.21.15.42:0/518748776 wait complete. 2023-07-29T02:06:46.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.381+0000 7f37a41d4700 1 Processor -- start 2023-07-29T02:06:46.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.381+0000 7f37a41d4700 1 -- start start 2023-07-29T02:06:46.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.381+0000 7f37a41d4700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f379c0bf750 0x7f379c15a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:46.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.381+0000 7f37a41d4700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f379c0c84c0 0x7f379c15ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:46.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.381+0000 7f37a41d4700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f379c1545b0 0x7f379c1ed8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:46.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.381+0000 7f37a41d4700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c14efa0 con 0x7f379c1545b0 2023-07-29T02:06:46.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.381+0000 7f37a41d4700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c06f610 con 0x7f379c0c84c0 2023-07-29T02:06:46.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.381+0000 7f37a41d4700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379c15abd0 con 0x7f379c0bf750 2023-07-29T02:06:46.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.382+0000 7f37a2771700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f379c1545b0 0x7f379c1ed8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:46.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.382+0000 7f37a2771700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f379c1545b0 0x7f379c1ed8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58586/0 (socket says 172.21.15.42:58586) 2023-07-29T02:06:46.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.382+0000 7f37a2771700 1 -- 172.21.15.42:0/584445837 learned_addr learned my addr 172.21.15.42:0/584445837 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:06:46.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.382+0000 7f37a176f700 1 --2- 172.21.15.42:0/584445837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f379c0c84c0 0x7f379c15ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:46.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.382+0000 7f37a1f70700 1 --2- 172.21.15.42:0/584445837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f379c0bf750 0x7f379c15a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:46.371 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.382+0000 7f37a2771700 1 -- 172.21.15.42:0/584445837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f379c0bf750 msgr2=0x7f379c15a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:46.371 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.382+0000 7f37a2771700 1 --2- 172.21.15.42:0/584445837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f379c0bf750 0x7f379c15a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:46.371 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.382+0000 7f37a2771700 1 -- 172.21.15.42:0/584445837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f379c0c84c0 msgr2=0x7f379c15ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:46.371 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.382+0000 7f37a2771700 1 --2- 172.21.15.42:0/584445837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f379c0c84c0 0x7f379c15ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:46.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.382+0000 7f37a2771700 1 -- 172.21.15.42:0/584445837 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3798009550 con 0x7f379c1545b0 2023-07-29T02:06:46.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.382+0000 7f37a2771700 1 --2- 172.21.15.42:0/584445837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f379c1545b0 0x7f379c1ed8f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f379400cc50 tx=0x7f379400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:46.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.382+0000 7f37927fc700 1 -- 172.21.15.42:0/584445837 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3794003c00 con 0x7f379c1545b0 2023-07-29T02:06:46.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.382+0000 7f37927fc700 1 -- 172.21.15.42:0/584445837 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3794003d60 con 0x7f379c1545b0 2023-07-29T02:06:46.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.382+0000 7f37a41d4700 1 -- 172.21.15.42:0/584445837 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379c15b320 con 0x7f379c1545b0 2023-07-29T02:06:46.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.382+0000 7f37927fc700 1 -- 172.21.15.42:0/584445837 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379400aab0 con 0x7f379c1545b0 2023-07-29T02:06:46.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.382+0000 7f37a41d4700 1 -- 172.21.15.42:0/584445837 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379c14dc10 con 0x7f379c1545b0 2023-07-29T02:06:46.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.383+0000 7f37a41d4700 1 -- 172.21.15.42:0/584445837 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379c06f800 con 0x7f379c1545b0 2023-07-29T02:06:46.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.384+0000 7f37927fc700 1 -- 172.21.15.42:0/584445837 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f379400ac10 con 0x7f379c1545b0 2023-07-29T02:06:46.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.384+0000 7f37927fc700 1 --2- 172.21.15.42:0/584445837 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f378006a660 0x7f378006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:06:46.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.384+0000 7f37927fc700 1 -- 172.21.15.42:0/584445837 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f3794088e60 con 0x7f379c1545b0 2023-07-29T02:06:46.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.384+0000 7f37a1f70700 1 --2- 172.21.15.42:0/584445837 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f378006a660 0x7f378006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:06:46.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.385+0000 7f37a1f70700 1 --2- 172.21.15.42:0/584445837 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f378006a660 0x7f378006cb10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f378c00c960 tx=0x7f378c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:06:46.375 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.388+0000 7f37927fc700 1 -- 172.21.15.42:0/584445837 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f3794053e40 con 0x7f379c1545b0 2023-07-29T02:06:46.563 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.583+0000 7f37a41d4700 1 -- 172.21.15.42:0/584445837 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f379c0c6ca0 con 0x7f378006a660 2023-07-29T02:06:46.574 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.594+0000 7f37927fc700 1 -- 172.21.15.42:0/584445837 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+395870 (secure 0 0 0) 0x7f378c00cdd0 con 0x7f378006a660 2023-07-29T02:06:46.579 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:06:46.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.598+0000 7f37a41d4700 1 -- 172.21.15.42:0/584445837 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f378006a660 msgr2=0x7f378006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:46.581 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.598+0000 7f37a41d4700 1 --2- 172.21.15.42:0/584445837 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f378006a660 0x7f378006cb10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f378c00c960 tx=0x7f378c008040 comp rx=0 tx=0).stop 2023-07-29T02:06:46.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.598+0000 7f37a41d4700 1 -- 172.21.15.42:0/584445837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f379c1545b0 msgr2=0x7f379c1ed8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:06:46.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.598+0000 7f37a41d4700 1 --2- 172.21.15.42:0/584445837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f379c1545b0 0x7f379c1ed8f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f379400cc50 tx=0x7f379400cf60 comp rx=0 tx=0).stop 2023-07-29T02:06:46.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.598+0000 7f37a41d4700 1 -- 172.21.15.42:0/584445837 shutdown_connections 2023-07-29T02:06:46.582 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.598+0000 7f37a41d4700 1 --2- 172.21.15.42:0/584445837 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f378006a660 0x7f378006cb10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:46.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.598+0000 7f37a41d4700 1 --2- 172.21.15.42:0/584445837 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f379c1545b0 0x7f379c1ed8f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:46.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.598+0000 7f37a41d4700 1 --2- 172.21.15.42:0/584445837 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f379c0bf750 0x7f379c15a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:46.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.598+0000 7f37a41d4700 1 --2- 172.21.15.42:0/584445837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f379c0c84c0 0x7f379c15ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:06:46.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.598+0000 7f37a41d4700 1 -- 172.21.15.42:0/584445837 >> 172.21.15.42:0/584445837 conn(0x7f379c0c8970 msgr2=0x7f379c0c54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:06:46.583 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.598+0000 7f37a41d4700 1 -- 172.21.15.42:0/584445837 shutdown_connections 2023-07-29T02:06:46.584 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:06:46.598+0000 7f37a41d4700 1 -- 172.21.15.42:0/584445837 wait complete. 2023-07-29T02:06:46.584 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2023-07-29T02:06:46.590 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2023-07-29T02:06:45.347326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1154254648,"num_objects":10301,"num_object_clones":0,"num_object_copies":40914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10301,"num_whiteouts":0,"num_read":1676,"num_read_kb":517458,"num_write":24859,"num_write_kb":1277702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":462801,"num_omap_keys":776,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30690,"ondisk_log_size":30690,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2545224,"kb_used_data":1859592,"kb_used_omap":0,"kb_used_meta":685568,"kb_avail":752429496,"statfs":{"total":773094113280,"available":770487803904,"internally_reserved":0,"allocated":1904222208,"data_stored":2426853489,"data_compressed":184230562,"data_compressed_allocated":215666688,"data_compressed_original":740147200,"omap_allocated":0,"internal_metadata":702021632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":457196,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":420567,"num_omap_keys":706,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003480"},"pg_stats":[{"pgid":"4.3f","version":"39'86","reported_seq":2149,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:36.889969+0000","last_change":"2023-07-29T02:06:36.890083+0000","last_active":"2023-07-29T02:06:36.889969+0000","last_peered":"2023-07-29T02:06:36.889969+0000","last_clean":"2023-07-29T02:06:36.889969+0000","last_became_active":"2023-07-29T01:59:57.957742+0000","last_became_peered":"2023-07-29T01:59:57.957742+0000","last_unstale":"2023-07-29T02:06:36.889969+0000","last_undegraded":"2023-07-29T02:06:36.889969+0000","last_fullsized":"2023-07-29T02:06:36.889969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'86","last_scrub_stamp":"2023-07-29T02:06:36.889932+0000","last_deep_scrub":"39'86","last_deep_scrub_stamp":"2023-07-29T02:06:36.889932+0000","last_clean_scrub_stamp":"2023-07-29T02:06:36.889932+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:56.860301+0000","scrub_duration":0.0015445599999999999,"objects_trimmed":0,"snaptrim_duration":0.46739399700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"39'75","reported_seq":2127,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.442679+0000","last_change":"2023-07-29T02:03:56.795813+0000","last_active":"2023-07-29T02:06:18.442679+0000","last_peered":"2023-07-29T02:06:18.442679+0000","last_clean":"2023-07-29T02:06:18.442679+0000","last_became_active":"2023-07-29T01:59:57.974338+0000","last_became_peered":"2023-07-29T01:59:57.974338+0000","last_unstale":"2023-07-29T02:06:18.442679+0000","last_undegraded":"2023-07-29T02:06:18.442679+0000","last_fullsized":"2023-07-29T02:06:18.442679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30630966300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"39'90","reported_seq":2142,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.447905+0000","last_change":"2023-07-29T02:03:57.108039+0000","last_active":"2023-07-29T02:06:18.447905+0000","last_peered":"2023-07-29T02:06:18.447905+0000","last_clean":"2023-07-29T02:06:18.447905+0000","last_became_active":"2023-07-29T01:59:57.973406+0000","last_became_peered":"2023-07-29T01:59:57.973406+0000","last_unstale":"2023-07-29T02:06:18.447905+0000","last_undegraded":"2023-07-29T02:06:18.447905+0000","last_fullsized":"2023-07-29T02:06:18.447905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37359432399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"39'75","reported_seq":2138,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:43.061322+0000","last_change":"2023-07-29T02:06:43.061439+0000","last_active":"2023-07-29T02:06:43.061322+0000","last_peered":"2023-07-29T02:06:43.061322+0000","last_clean":"2023-07-29T02:06:43.061322+0000","last_became_active":"2023-07-29T01:59:57.964865+0000","last_became_peered":"2023-07-29T01:59:57.964865+0000","last_unstale":"2023-07-29T02:06:43.061322+0000","last_undegraded":"2023-07-29T02:06:43.061322+0000","last_fullsized":"2023-07-29T02:06:43.061322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'75","last_scrub_stamp":"2023-07-29T02:06:43.061294+0000","last_deep_scrub":"39'75","last_deep_scrub_stamp":"2023-07-29T02:06:43.061294+0000","last_clean_scrub_stamp":"2023-07-29T02:06:43.061294+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:05:34.515449+0000","scrub_duration":0.0020787169999999999,"objects_trimmed":0,"snaptrim_duration":0.22913951599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"39'102","reported_seq":2153,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.450814+0000","last_change":"2023-07-29T02:03:57.038137+0000","last_active":"2023-07-29T02:06:18.450814+0000","last_peered":"2023-07-29T02:06:18.450814+0000","last_clean":"2023-07-29T02:06:18.450814+0000","last_became_active":"2023-07-29T01:59:57.970733+0000","last_became_peered":"2023-07-29T01:59:57.970733+0000","last_unstale":"2023-07-29T02:06:18.450814+0000","last_undegraded":"2023-07-29T02:06:18.450814+0000","last_fullsized":"2023-07-29T02:06:18.450814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55358088100000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"39'92","reported_seq":2143,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.444391+0000","last_change":"2023-07-29T02:03:57.111935+0000","last_active":"2023-07-29T02:06:18.444391+0000","last_peered":"2023-07-29T02:06:18.444391+0000","last_clean":"2023-07-29T02:06:18.444391+0000","last_became_active":"2023-07-29T01:59:57.964993+0000","last_became_peered":"2023-07-29T01:59:57.964993+0000","last_unstale":"2023-07-29T02:06:18.444391+0000","last_undegraded":"2023-07-29T02:06:18.444391+0000","last_fullsized":"2023-07-29T02:06:18.444391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35033357399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"39'105","reported_seq":2156,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.443178+0000","last_change":"2023-07-29T02:03:56.697037+0000","last_active":"2023-07-29T02:06:18.443178+0000","last_peered":"2023-07-29T02:06:18.443178+0000","last_clean":"2023-07-29T02:06:18.443178+0000","last_became_active":"2023-07-29T01:59:57.970232+0000","last_became_peered":"2023-07-29T01:59:57.970232+0000","last_unstale":"2023-07-29T02:06:18.443178+0000","last_undegraded":"2023-07-29T02:06:18.443178+0000","last_fullsized":"2023-07-29T02:06:18.443178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18952802499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"39'74","reported_seq":2125,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.438478+0000","last_change":"2023-07-29T02:03:56.788754+0000","last_active":"2023-07-29T02:06:18.438478+0000","last_peered":"2023-07-29T02:06:18.438478+0000","last_clean":"2023-07-29T02:06:18.438478+0000","last_became_active":"2023-07-29T01:59:57.962884+0000","last_became_peered":"2023-07-29T01:59:57.962884+0000","last_unstale":"2023-07-29T02:06:18.438478+0000","last_undegraded":"2023-07-29T02:06:18.438478+0000","last_fullsized":"2023-07-29T02:06:18.438478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30152641200000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"39'84","reported_seq":2135,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.450858+0000","last_change":"2023-07-29T02:03:57.034522+0000","last_active":"2023-07-29T02:06:18.450858+0000","last_peered":"2023-07-29T02:06:18.450858+0000","last_clean":"2023-07-29T02:06:18.450858+0000","last_became_active":"2023-07-29T01:59:57.971640+0000","last_became_peered":"2023-07-29T01:59:57.971640+0000","last_unstale":"2023-07-29T02:06:18.450858+0000","last_undegraded":"2023-07-29T02:06:18.450858+0000","last_fullsized":"2023-07-29T02:06:18.450858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54966345000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"39'98","reported_seq":2149,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.440312+0000","last_change":"2023-07-29T02:03:56.796189+0000","last_active":"2023-07-29T02:06:18.440312+0000","last_peered":"2023-07-29T02:06:18.440312+0000","last_clean":"2023-07-29T02:06:18.440312+0000","last_became_active":"2023-07-29T01:59:57.962799+0000","last_became_peered":"2023-07-29T01:59:57.962799+0000","last_unstale":"2023-07-29T02:06:18.440312+0000","last_undegraded":"2023-07-29T02:06:18.440312+0000","last_fullsized":"2023-07-29T02:06:18.440312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30635943199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"39'90","reported_seq":2152,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:37.449626+0000","last_change":"2023-07-29T02:06:37.449786+0000","last_active":"2023-07-29T02:06:37.449626+0000","last_peered":"2023-07-29T02:06:37.449626+0000","last_clean":"2023-07-29T02:06:37.449626+0000","last_became_active":"2023-07-29T01:59:57.969868+0000","last_became_peered":"2023-07-29T01:59:57.969868+0000","last_unstale":"2023-07-29T02:06:37.449626+0000","last_undegraded":"2023-07-29T02:06:37.449626+0000","last_fullsized":"2023-07-29T02:06:37.449626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'90","last_scrub_stamp":"2023-07-29T02:06:37.449587+0000","last_deep_scrub":"39'90","last_deep_scrub_stamp":"2023-07-29T02:06:37.449587+0000","last_clean_scrub_stamp":"2023-07-29T02:06:37.449587+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:11:20.181943+0000","scrub_duration":0.0020192080000000002,"objects_trimmed":0,"snaptrim_duration":0.37294171199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"39'76","reported_seq":2138,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.908831+0000","last_change":"2023-07-29T02:06:39.908940+0000","last_active":"2023-07-29T02:06:39.908831+0000","last_peered":"2023-07-29T02:06:39.908831+0000","last_clean":"2023-07-29T02:06:39.908831+0000","last_became_active":"2023-07-29T01:59:57.963902+0000","last_became_peered":"2023-07-29T01:59:57.963902+0000","last_unstale":"2023-07-29T02:06:39.908831+0000","last_undegraded":"2023-07-29T02:06:39.908831+0000","last_fullsized":"2023-07-29T02:06:39.908831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'76","last_scrub_stamp":"2023-07-29T02:06:39.908800+0000","last_deep_scrub":"39'76","last_deep_scrub_stamp":"2023-07-29T02:06:39.908800+0000","last_clean_scrub_stamp":"2023-07-29T02:06:39.908800+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:43.162709+0000","scrub_duration":0.0020822839999999998,"objects_trimmed":0,"snaptrim_duration":0.46909700500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"39'81","reported_seq":2143,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:25.869494+0000","last_change":"2023-07-29T02:06:25.869573+0000","last_active":"2023-07-29T02:06:25.869494+0000","last_peered":"2023-07-29T02:06:25.869494+0000","last_clean":"2023-07-29T02:06:25.869494+0000","last_became_active":"2023-07-29T01:59:57.963239+0000","last_became_peered":"2023-07-29T01:59:57.963239+0000","last_unstale":"2023-07-29T02:06:25.869494+0000","last_undegraded":"2023-07-29T02:06:25.869494+0000","last_fullsized":"2023-07-29T02:06:25.869494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'81","last_scrub_stamp":"2023-07-29T02:06:25.869472+0000","last_deep_scrub":"39'81","last_deep_scrub_stamp":"2023-07-29T02:06:25.869472+0000","last_clean_scrub_stamp":"2023-07-29T02:06:25.869472+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:01:16.574167+0000","scrub_duration":0.0015035739999999999,"objects_trimmed":0,"snaptrim_duration":0.46603159700000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"39'92","reported_seq":2143,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.442322+0000","last_change":"2023-07-29T02:03:56.789592+0000","last_active":"2023-07-29T02:06:18.442322+0000","last_peered":"2023-07-29T02:06:18.442322+0000","last_clean":"2023-07-29T02:06:18.442322+0000","last_became_active":"2023-07-29T01:59:57.960709+0000","last_became_peered":"2023-07-29T01:59:57.960709+0000","last_unstale":"2023-07-29T02:06:18.442322+0000","last_undegraded":"2023-07-29T02:06:18.442322+0000","last_fullsized":"2023-07-29T02:06:18.442322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30181124199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"39'85","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.445152+0000","last_change":"2023-07-29T02:03:56.696099+0000","last_active":"2023-07-29T02:06:18.445152+0000","last_peered":"2023-07-29T02:06:18.445152+0000","last_clean":"2023-07-29T02:06:18.445152+0000","last_became_active":"2023-07-29T01:59:57.970263+0000","last_became_peered":"2023-07-29T01:59:57.970263+0000","last_unstale":"2023-07-29T02:06:18.445152+0000","last_undegraded":"2023-07-29T02:06:18.445152+0000","last_fullsized":"2023-07-29T02:06:18.445152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18892089500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"39'97","reported_seq":2159,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:25.491214+0000","last_change":"2023-07-29T02:06:25.491331+0000","last_active":"2023-07-29T02:06:25.491214+0000","last_peered":"2023-07-29T02:06:25.491214+0000","last_clean":"2023-07-29T02:06:25.491214+0000","last_became_active":"2023-07-29T01:59:57.964696+0000","last_became_peered":"2023-07-29T01:59:57.964696+0000","last_unstale":"2023-07-29T02:06:25.491214+0000","last_undegraded":"2023-07-29T02:06:25.491214+0000","last_fullsized":"2023-07-29T02:06:25.491214+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'97","last_scrub_stamp":"2023-07-29T02:06:25.491173+0000","last_deep_scrub":"39'97","last_deep_scrub_stamp":"2023-07-29T02:06:25.491173+0000","last_clean_scrub_stamp":"2023-07-29T02:06:25.491173+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:48:25.389074+0000","scrub_duration":0.001642227,"objects_trimmed":0,"snaptrim_duration":0.32990576199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"39'94","reported_seq":2145,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.450594+0000","last_change":"2023-07-29T02:03:57.029741+0000","last_active":"2023-07-29T02:06:18.450594+0000","last_peered":"2023-07-29T02:06:18.450594+0000","last_clean":"2023-07-29T02:06:18.450594+0000","last_became_active":"2023-07-29T01:59:57.968885+0000","last_became_peered":"2023-07-29T01:59:57.968885+0000","last_unstale":"2023-07-29T02:06:18.450594+0000","last_undegraded":"2023-07-29T02:06:18.450594+0000","last_fullsized":"2023-07-29T02:06:18.450594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54488360899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"39'88","reported_seq":2139,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.445713+0000","last_change":"2023-07-29T02:03:57.081083+0000","last_active":"2023-07-29T02:06:18.445713+0000","last_peered":"2023-07-29T02:06:18.445713+0000","last_clean":"2023-07-29T02:06:18.445713+0000","last_became_active":"2023-07-29T01:59:57.962919+0000","last_became_peered":"2023-07-29T01:59:57.962919+0000","last_unstale":"2023-07-29T02:06:18.445713+0000","last_undegraded":"2023-07-29T02:06:18.445713+0000","last_fullsized":"2023-07-29T02:06:18.445713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36591080100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"39'85","reported_seq":2148,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:35.858539+0000","last_change":"2023-07-29T02:06:35.858539+0000","last_active":"2023-07-29T02:06:35.858539+0000","last_peered":"2023-07-29T02:06:35.858539+0000","last_clean":"2023-07-29T02:06:35.858539+0000","last_became_active":"2023-07-29T01:59:57.960111+0000","last_became_peered":"2023-07-29T01:59:57.960111+0000","last_unstale":"2023-07-29T02:06:35.858539+0000","last_undegraded":"2023-07-29T02:06:35.858539+0000","last_fullsized":"2023-07-29T02:06:35.858539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'85","last_scrub_stamp":"2023-07-29T02:06:35.858385+0000","last_deep_scrub":"39'85","last_deep_scrub_stamp":"2023-07-29T02:06:35.858385+0000","last_clean_scrub_stamp":"2023-07-29T02:06:35.858385+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:30.976536+0000","scrub_duration":0.0025554530000000001,"objects_trimmed":0,"snaptrim_duration":0.47199195399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"39'98","reported_seq":2161,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:27.503464+0000","last_change":"2023-07-29T02:06:27.503464+0000","last_active":"2023-07-29T02:06:27.503464+0000","last_peered":"2023-07-29T02:06:27.503464+0000","last_clean":"2023-07-29T02:06:27.503464+0000","last_became_active":"2023-07-29T01:59:57.961655+0000","last_became_peered":"2023-07-29T01:59:57.961655+0000","last_unstale":"2023-07-29T02:06:27.503464+0000","last_undegraded":"2023-07-29T02:06:27.503464+0000","last_fullsized":"2023-07-29T02:06:27.503464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'98","last_scrub_stamp":"2023-07-29T02:06:27.503321+0000","last_deep_scrub":"39'98","last_deep_scrub_stamp":"2023-07-29T02:06:27.503321+0000","last_clean_scrub_stamp":"2023-07-29T02:06:27.503321+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:20.644410+0000","scrub_duration":0.001657045,"objects_trimmed":0,"snaptrim_duration":0.36267924800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"39'89","reported_seq":2141,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:25.821487+0000","last_change":"2023-07-29T02:03:56.694890+0000","last_active":"2023-07-29T02:06:25.821487+0000","last_peered":"2023-07-29T02:06:25.821487+0000","last_clean":"2023-07-29T02:06:25.821487+0000","last_became_active":"2023-07-29T01:59:57.970757+0000","last_became_peered":"2023-07-29T01:59:57.970757+0000","last_unstale":"2023-07-29T02:06:25.821487+0000","last_undegraded":"2023-07-29T02:06:25.821487+0000","last_fullsized":"2023-07-29T02:06:25.821487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18738185399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"39'95","reported_seq":2158,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.272264+0000","last_change":"2023-07-29T02:06:41.272264+0000","last_active":"2023-07-29T02:06:41.272264+0000","last_peered":"2023-07-29T02:06:41.272264+0000","last_clean":"2023-07-29T02:06:41.272264+0000","last_became_active":"2023-07-29T01:59:57.974436+0000","last_became_peered":"2023-07-29T01:59:57.974436+0000","last_unstale":"2023-07-29T02:06:41.272264+0000","last_undegraded":"2023-07-29T02:06:41.272264+0000","last_fullsized":"2023-07-29T02:06:41.272264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'95","last_scrub_stamp":"2023-07-29T02:06:41.272136+0000","last_deep_scrub":"39'95","last_deep_scrub_stamp":"2023-07-29T02:06:41.272136+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.272136+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:31.305058+0000","scrub_duration":0.00149913,"objects_trimmed":0,"snaptrim_duration":0.54184882499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"39'92","reported_seq":2144,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:23.710621+0000","last_change":"2023-07-29T02:03:57.173218+0000","last_active":"2023-07-29T02:06:23.710621+0000","last_peered":"2023-07-29T02:06:23.710621+0000","last_clean":"2023-07-29T02:06:23.710621+0000","last_became_active":"2023-07-29T01:59:57.966987+0000","last_became_peered":"2023-07-29T01:59:57.966987+0000","last_unstale":"2023-07-29T02:06:23.710621+0000","last_undegraded":"2023-07-29T02:06:23.710621+0000","last_fullsized":"2023-07-29T02:06:23.710621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38162062000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"39'92","reported_seq":2144,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:25.821488+0000","last_change":"2023-07-29T02:03:56.697590+0000","last_active":"2023-07-29T02:06:25.821488+0000","last_peered":"2023-07-29T02:06:25.821488+0000","last_clean":"2023-07-29T02:06:25.821488+0000","last_became_active":"2023-07-29T01:59:57.971733+0000","last_became_peered":"2023-07-29T01:59:57.971733+0000","last_unstale":"2023-07-29T02:06:25.821488+0000","last_undegraded":"2023-07-29T02:06:25.821488+0000","last_fullsized":"2023-07-29T02:06:25.821488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.189164111,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"39'83","reported_seq":2135,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:22.677857+0000","last_change":"2023-07-29T02:03:57.054022+0000","last_active":"2023-07-29T02:06:22.677857+0000","last_peered":"2023-07-29T02:06:22.677857+0000","last_clean":"2023-07-29T02:06:22.677857+0000","last_became_active":"2023-07-29T01:59:57.969742+0000","last_became_peered":"2023-07-29T01:59:57.969742+0000","last_unstale":"2023-07-29T02:06:22.677857+0000","last_undegraded":"2023-07-29T02:06:22.677857+0000","last_fullsized":"2023-07-29T02:06:22.677857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53981922100000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"39'109","reported_seq":2161,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:22.677824+0000","last_change":"2023-07-29T02:03:57.052073+0000","last_active":"2023-07-29T02:06:22.677824+0000","last_peered":"2023-07-29T02:06:22.677824+0000","last_clean":"2023-07-29T02:06:22.677824+0000","last_became_active":"2023-07-29T01:59:57.969409+0000","last_became_peered":"2023-07-29T01:59:57.969409+0000","last_unstale":"2023-07-29T02:06:22.677824+0000","last_undegraded":"2023-07-29T02:06:22.677824+0000","last_fullsized":"2023-07-29T02:06:22.677824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53315132300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"39'74","reported_seq":2137,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:30.637361+0000","last_change":"2023-07-29T02:06:30.637467+0000","last_active":"2023-07-29T02:06:30.637361+0000","last_peered":"2023-07-29T02:06:30.637361+0000","last_clean":"2023-07-29T02:06:30.637361+0000","last_became_active":"2023-07-29T01:59:57.963774+0000","last_became_peered":"2023-07-29T01:59:57.963774+0000","last_unstale":"2023-07-29T02:06:30.637361+0000","last_undegraded":"2023-07-29T02:06:30.637361+0000","last_fullsized":"2023-07-29T02:06:30.637361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'74","last_scrub_stamp":"2023-07-29T02:06:30.637332+0000","last_deep_scrub":"39'74","last_deep_scrub_stamp":"2023-07-29T02:06:30.637332+0000","last_clean_scrub_stamp":"2023-07-29T02:06:30.637332+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:25.755483+0000","scrub_duration":0.0015544249999999999,"objects_trimmed":0,"snaptrim_duration":0.30426659299999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"39'632","reported_seq":2712,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.903567+0000","last_change":"2023-07-29T02:03:57.112265+0000","last_active":"2023-07-29T02:06:07.903567+0000","last_peered":"2023-07-29T02:06:07.903567+0000","last_clean":"2023-07-29T02:06:07.903567+0000","last_became_active":"2023-07-29T02:00:01.993731+0000","last_became_peered":"2023-07-29T02:00:01.993731+0000","last_unstale":"2023-07-29T02:06:07.903567+0000","last_undegraded":"2023-07-29T02:06:07.903567+0000","last_fullsized":"2023-07-29T02:06:07.903567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35725884499999999,"stat_sum":{"num_bytes":48336376,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":31,"num_read_kb":16407,"num_write":630,"num_write_kb":51633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"39'163","reported_seq":198,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.627821+0000","last_change":"2023-07-29T01:59:57.552913+0000","last_active":"2023-07-29T02:06:39.627821+0000","last_peered":"2023-07-29T02:06:39.627821+0000","last_clean":"2023-07-29T02:06:39.627821+0000","last_became_active":"2023-07-29T01:59:57.552673+0000","last_became_peered":"2023-07-29T01:59:57.552673+0000","last_unstale":"2023-07-29T02:06:39.627821+0000","last_undegraded":"2023-07-29T02:06:39.627821+0000","last_fullsized":"2023-07-29T02:06:39.627821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16873327,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":161,"num_write_kb":16595,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"39'90","reported_seq":2141,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.450810+0000","last_change":"2023-07-29T02:03:57.172635+0000","last_active":"2023-07-29T02:06:18.450810+0000","last_peered":"2023-07-29T02:06:18.450810+0000","last_clean":"2023-07-29T02:06:18.450810+0000","last_became_active":"2023-07-29T01:59:57.969821+0000","last_became_peered":"2023-07-29T01:59:57.969821+0000","last_unstale":"2023-07-29T02:06:18.450810+0000","last_undegraded":"2023-07-29T02:06:18.450810+0000","last_fullsized":"2023-07-29T02:06:18.450810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.40087768200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'629","reported_seq":2720,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.462431+0000","last_change":"2023-07-29T02:03:56.981521+0000","last_active":"2023-07-29T02:06:19.462431+0000","last_peered":"2023-07-29T02:06:19.462431+0000","last_clean":"2023-07-29T02:06:19.462431+0000","last_became_active":"2023-07-29T02:00:01.992338+0000","last_became_peered":"2023-07-29T02:00:01.992338+0000","last_unstale":"2023-07-29T02:06:19.462431+0000","last_undegraded":"2023-07-29T02:06:19.462431+0000","last_fullsized":"2023-07-29T02:06:19.462431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.20956234600000001,"stat_sum":{"num_bytes":44446331,"num_objects":308,"num_object_clones":0,"num_object_copies":1232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":308,"num_whiteouts":0,"num_read":41,"num_read_kb":16418,"num_write":629,"num_write_kb":43687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"39'22","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:27.140131+0000","last_change":"2023-07-29T02:06:27.140252+0000","last_active":"2023-07-29T02:06:27.140131+0000","last_peered":"2023-07-29T02:06:27.140131+0000","last_clean":"2023-07-29T02:06:27.140131+0000","last_became_active":"2023-07-29T01:59:57.547455+0000","last_became_peered":"2023-07-29T01:59:57.547455+0000","last_unstale":"2023-07-29T02:06:27.140131+0000","last_undegraded":"2023-07-29T02:06:27.140131+0000","last_fullsized":"2023-07-29T02:06:27.140131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'22","last_scrub_stamp":"2023-07-29T02:06:27.140101+0000","last_deep_scrub":"39'22","last_deep_scrub_stamp":"2023-07-29T02:06:27.140101+0000","last_clean_scrub_stamp":"2023-07-29T02:06:27.140101+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:40.716498+0000","scrub_duration":0.0090765410000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":4125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16912,"num_omap_keys":28,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"39'92","reported_seq":2144,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.443930+0000","last_change":"2023-07-29T02:03:57.037080+0000","last_active":"2023-07-29T02:06:18.443930+0000","last_peered":"2023-07-29T02:06:18.443930+0000","last_clean":"2023-07-29T02:06:18.443930+0000","last_became_active":"2023-07-29T01:59:57.964393+0000","last_became_peered":"2023-07-29T01:59:57.964393+0000","last_unstale":"2023-07-29T02:06:18.443930+0000","last_undegraded":"2023-07-29T02:06:18.443930+0000","last_fullsized":"2023-07-29T02:06:18.443930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55267013499999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"39'624","reported_seq":2706,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.294650+0000","last_change":"2023-07-29T02:03:57.037730+0000","last_active":"2023-07-29T02:06:07.294650+0000","last_peered":"2023-07-29T02:06:07.294650+0000","last_clean":"2023-07-29T02:06:07.294650+0000","last_became_active":"2023-07-29T02:00:01.982042+0000","last_became_peered":"2023-07-29T02:00:01.982042+0000","last_unstale":"2023-07-29T02:06:07.294650+0000","last_undegraded":"2023-07-29T02:06:07.294650+0000","last_fullsized":"2023-07-29T02:06:07.294650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55323541600000004,"stat_sum":{"num_bytes":17887936,"num_objects":308,"num_object_clones":0,"num_object_copies":1232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":308,"num_whiteouts":0,"num_read":32,"num_read_kb":5104,"num_write":624,"num_write_kb":17797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"39'219","reported_seq":264,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:40.995519+0000","last_change":"2023-07-29T02:06:40.995666+0000","last_active":"2023-07-29T02:06:40.995519+0000","last_peered":"2023-07-29T02:06:40.995519+0000","last_clean":"2023-07-29T02:06:40.995519+0000","last_became_active":"2023-07-29T01:59:57.533523+0000","last_became_peered":"2023-07-29T01:59:57.533523+0000","last_unstale":"2023-07-29T02:06:40.995519+0000","last_undegraded":"2023-07-29T02:06:40.995519+0000","last_fullsized":"2023-07-29T02:06:40.995519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'219","last_scrub_stamp":"2023-07-29T02:06:40.995491+0000","last_deep_scrub":"39'219","last_deep_scrub_stamp":"2023-07-29T02:06:40.995491+0000","last_clean_scrub_stamp":"2023-07-29T02:06:40.995491+0000","objects_scrubbed":8,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:16:19.962753+0000","scrub_duration":0.031869078000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":210,"num_write_kb":16504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31952,"num_omap_keys":53,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"39'88","reported_seq":2140,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.010033+0000","last_change":"2023-07-29T02:03:56.982121+0000","last_active":"2023-07-29T02:06:19.010033+0000","last_peered":"2023-07-29T02:06:19.010033+0000","last_clean":"2023-07-29T02:06:19.010033+0000","last_became_active":"2023-07-29T01:59:57.963466+0000","last_became_peered":"2023-07-29T01:59:57.963466+0000","last_unstale":"2023-07-29T02:06:19.010033+0000","last_undegraded":"2023-07-29T02:06:19.010033+0000","last_fullsized":"2023-07-29T02:06:19.010033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.209911193,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"39'697","reported_seq":2785,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.146543+0000","last_change":"2023-07-29T02:03:56.977076+0000","last_active":"2023-07-29T02:06:07.146543+0000","last_peered":"2023-07-29T02:06:07.146543+0000","last_clean":"2023-07-29T02:06:07.146543+0000","last_became_active":"2023-07-29T02:00:01.984000+0000","last_became_peered":"2023-07-29T02:00:01.984000+0000","last_unstale":"2023-07-29T02:06:07.146543+0000","last_undegraded":"2023-07-29T02:06:07.146543+0000","last_fullsized":"2023-07-29T02:06:07.146543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.218444052,"stat_sum":{"num_bytes":33480822,"num_objects":367,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":39,"num_read_kb":11040,"num_write":700,"num_write_kb":41165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"39'4","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:35.267068+0000","last_change":"2023-07-29T02:06:35.267179+0000","last_active":"2023-07-29T02:06:35.267068+0000","last_peered":"2023-07-29T02:06:35.267068+0000","last_clean":"2023-07-29T02:06:35.267068+0000","last_became_active":"2023-07-29T01:59:57.536732+0000","last_became_peered":"2023-07-29T01:59:57.536732+0000","last_unstale":"2023-07-29T02:06:35.267068+0000","last_undegraded":"2023-07-29T02:06:35.267068+0000","last_fullsized":"2023-07-29T02:06:35.267068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2023-07-29T02:06:35.267044+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2023-07-29T02:06:35.267044+0000","last_clean_scrub_stamp":"2023-07-29T02:06:35.267044+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:32.781960+0000","scrub_duration":0.0035102390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11476,"num_omap_keys":19,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"39'88","reported_seq":2150,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:25.880664+0000","last_change":"2023-07-29T02:06:25.880739+0000","last_active":"2023-07-29T02:06:25.880664+0000","last_peered":"2023-07-29T02:06:25.880664+0000","last_clean":"2023-07-29T02:06:25.880664+0000","last_became_active":"2023-07-29T01:59:57.970902+0000","last_became_peered":"2023-07-29T01:59:57.970902+0000","last_unstale":"2023-07-29T02:06:25.880664+0000","last_undegraded":"2023-07-29T02:06:25.880664+0000","last_fullsized":"2023-07-29T02:06:25.880664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'88","last_scrub_stamp":"2023-07-29T02:06:25.880641+0000","last_deep_scrub":"39'88","last_deep_scrub_stamp":"2023-07-29T02:06:25.880641+0000","last_clean_scrub_stamp":"2023-07-29T02:06:25.880641+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:45.851009+0000","scrub_duration":0.0013327549999999999,"objects_trimmed":0,"snaptrim_duration":0.3723399,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'665","reported_seq":2751,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.429049+0000","last_change":"2023-07-29T02:03:56.697947+0000","last_active":"2023-07-29T02:06:07.429049+0000","last_peered":"2023-07-29T02:06:07.429049+0000","last_clean":"2023-07-29T02:06:07.429049+0000","last_became_active":"2023-07-29T02:00:01.989456+0000","last_became_peered":"2023-07-29T02:00:01.989456+0000","last_unstale":"2023-07-29T02:06:07.429049+0000","last_undegraded":"2023-07-29T02:06:07.429049+0000","last_fullsized":"2023-07-29T02:06:07.429049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.189839176,"stat_sum":{"num_bytes":37359948,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":38,"num_read_kb":16417,"num_write":659,"num_write_kb":40721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"39'108","reported_seq":152,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:40.695129+0000","last_change":"2023-07-29T02:06:40.695251+0000","last_active":"2023-07-29T02:06:40.695129+0000","last_peered":"2023-07-29T02:06:40.695129+0000","last_clean":"2023-07-29T02:06:40.695129+0000","last_became_active":"2023-07-29T01:59:57.540113+0000","last_became_peered":"2023-07-29T01:59:57.540113+0000","last_unstale":"2023-07-29T02:06:40.695129+0000","last_undegraded":"2023-07-29T02:06:40.695129+0000","last_fullsized":"2023-07-29T02:06:40.695129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'108","last_scrub_stamp":"2023-07-29T02:06:40.695102+0000","last_deep_scrub":"39'108","last_deep_scrub_stamp":"2023-07-29T02:06:40.695102+0000","last_clean_scrub_stamp":"2023-07-29T02:06:40.695102+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:33.836191+0000","scrub_duration":0.036052965999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":100,"num_write_kb":16445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17522,"num_omap_keys":30,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"39'91","reported_seq":2143,"reported_epoch":39,"state":"active+clean+scrubbing+deep","last_fresh":"2023-07-29T02:06:23.710493+0000","last_change":"2023-07-29T02:06:44.009570+0000","last_active":"2023-07-29T02:06:23.710493+0000","last_peered":"2023-07-29T02:06:23.710493+0000","last_clean":"2023-07-29T02:06:23.710493+0000","last_became_active":"2023-07-29T01:59:57.967083+0000","last_became_peered":"2023-07-29T01:59:57.967083+0000","last_unstale":"2023-07-29T02:06:23.710493+0000","last_undegraded":"2023-07-29T02:06:23.710493+0000","last_fullsized":"2023-07-29T02:06:23.710493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38037237200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"39'632","reported_seq":2725,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:06.764831+0000","last_change":"2023-07-29T02:03:57.161825+0000","last_active":"2023-07-29T02:06:06.764831+0000","last_peered":"2023-07-29T02:06:06.764831+0000","last_clean":"2023-07-29T02:06:06.764831+0000","last_became_active":"2023-07-29T02:00:01.996035+0000","last_became_peered":"2023-07-29T02:00:01.996035+0000","last_unstale":"2023-07-29T02:06:06.764831+0000","last_undegraded":"2023-07-29T02:06:06.764831+0000","last_fullsized":"2023-07-29T02:06:06.764831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.39874443399999998,"stat_sum":{"num_bytes":20875244,"num_objects":313,"num_object_clones":0,"num_object_copies":1252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":44,"num_read_kb":4139,"num_write":632,"num_write_kb":28878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"39'697","reported_seq":749,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:34.641374+0000","last_change":"2023-07-29T02:06:27.569347+0000","last_active":"2023-07-29T02:06:34.641374+0000","last_peered":"2023-07-29T02:06:34.641374+0000","last_clean":"2023-07-29T02:06:34.641374+0000","last_became_active":"2023-07-29T01:59:57.547803+0000","last_became_peered":"2023-07-29T01:59:57.547803+0000","last_unstale":"2023-07-29T02:06:34.641374+0000","last_undegraded":"2023-07-29T02:06:34.641374+0000","last_fullsized":"2023-07-29T02:06:34.641374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'621","last_scrub_stamp":"2023-07-29T02:06:27.569221+0000","last_deep_scrub":"39'621","last_deep_scrub_stamp":"2023-07-29T02:06:27.569221+0000","last_clean_scrub_stamp":"2023-07-29T02:06:27.569221+0000","objects_scrubbed":5,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:59:25.186236+0000","scrub_duration":0.02490562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583002,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":4114,"num_write":693,"num_write_kb":12634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"39'85","reported_seq":2147,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:43.393210+0000","last_change":"2023-07-29T02:06:43.393307+0000","last_active":"2023-07-29T02:06:43.393210+0000","last_peered":"2023-07-29T02:06:43.393210+0000","last_clean":"2023-07-29T02:06:43.393210+0000","last_became_active":"2023-07-29T01:59:57.969006+0000","last_became_peered":"2023-07-29T01:59:57.969006+0000","last_unstale":"2023-07-29T02:06:43.393210+0000","last_undegraded":"2023-07-29T02:06:43.393210+0000","last_fullsized":"2023-07-29T02:06:43.393210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'85","last_scrub_stamp":"2023-07-29T02:06:43.393180+0000","last_deep_scrub":"39'85","last_deep_scrub_stamp":"2023-07-29T02:06:43.393180+0000","last_clean_scrub_stamp":"2023-07-29T02:06:43.393180+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:36.534269+0000","scrub_duration":0.0019770159999999998,"objects_trimmed":0,"snaptrim_duration":0.53746501300000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"39'641","reported_seq":2735,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.766530+0000","last_change":"2023-07-29T02:03:57.052276+0000","last_active":"2023-07-29T02:06:07.766530+0000","last_peered":"2023-07-29T02:06:07.766530+0000","last_clean":"2023-07-29T02:06:07.766530+0000","last_became_active":"2023-07-29T02:00:01.995757+0000","last_became_peered":"2023-07-29T02:00:01.995757+0000","last_unstale":"2023-07-29T02:06:07.766530+0000","last_undegraded":"2023-07-29T02:06:07.766530+0000","last_fullsized":"2023-07-29T02:06:07.766530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.539926876,"stat_sum":{"num_bytes":20101741,"num_objects":314,"num_object_clones":0,"num_object_copies":1256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":45,"num_read_kb":20517,"num_write":638,"num_write_kb":32247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"39'127","reported_seq":177,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.229650+0000","last_change":"2023-07-29T01:59:57.541936+0000","last_active":"2023-07-29T02:06:24.229650+0000","last_peered":"2023-07-29T02:06:24.229650+0000","last_clean":"2023-07-29T02:06:24.229650+0000","last_became_active":"2023-07-29T01:59:57.541434+0000","last_became_peered":"2023-07-29T01:59:57.541434+0000","last_unstale":"2023-07-29T02:06:24.229650+0000","last_undegraded":"2023-07-29T02:06:24.229650+0000","last_fullsized":"2023-07-29T02:06:24.229650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":12324,"num_write":120,"num_write_kb":12359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"39'101","reported_seq":2163,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:38.483368+0000","last_change":"2023-07-29T02:06:38.483478+0000","last_active":"2023-07-29T02:06:38.483368+0000","last_peered":"2023-07-29T02:06:38.483368+0000","last_clean":"2023-07-29T02:06:38.483368+0000","last_became_active":"2023-07-29T01:59:57.962459+0000","last_became_peered":"2023-07-29T01:59:57.962459+0000","last_unstale":"2023-07-29T02:06:38.483368+0000","last_undegraded":"2023-07-29T02:06:38.483368+0000","last_fullsized":"2023-07-29T02:06:38.483368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'101","last_scrub_stamp":"2023-07-29T02:06:38.483341+0000","last_deep_scrub":"39'101","last_deep_scrub_stamp":"2023-07-29T02:06:38.483341+0000","last_clean_scrub_stamp":"2023-07-29T02:06:38.483341+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:53:21.113599+0000","scrub_duration":0.0015478099999999999,"objects_trimmed":0,"snaptrim_duration":0.34937986999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'591","reported_seq":2680,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.695716+0000","last_change":"2023-07-29T02:03:56.797439+0000","last_active":"2023-07-29T02:06:07.695716+0000","last_peered":"2023-07-29T02:06:07.695716+0000","last_clean":"2023-07-29T02:06:07.695716+0000","last_became_active":"2023-07-29T02:00:01.995827+0000","last_became_peered":"2023-07-29T02:00:01.995827+0000","last_unstale":"2023-07-29T02:06:07.695716+0000","last_undegraded":"2023-07-29T02:06:07.695716+0000","last_fullsized":"2023-07-29T02:06:07.695716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30893240100000002,"stat_sum":{"num_bytes":24035129,"num_objects":268,"num_object_clones":0,"num_object_copies":1072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":40,"num_read_kb":8228,"num_write":590,"num_write_kb":23787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"39'12","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:05:51.901143+0000","last_change":"2023-07-29T01:59:57.545705+0000","last_active":"2023-07-29T02:05:51.901143+0000","last_peered":"2023-07-29T02:05:51.901143+0000","last_clean":"2023-07-29T02:05:51.901143+0000","last_became_active":"2023-07-29T01:59:57.545406+0000","last_became_peered":"2023-07-29T01:59:57.545406+0000","last_unstale":"2023-07-29T02:05:51.901143+0000","last_undegraded":"2023-07-29T02:05:51.901143+0000","last_fullsized":"2023-07-29T02:05:51.901143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":8216,"num_write":11,"num_write_kb":8201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"39'86","reported_seq":2131,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.444998+0000","last_change":"2023-07-29T02:03:56.957227+0000","last_active":"2023-07-29T02:06:18.444998+0000","last_peered":"2023-07-29T02:06:18.444998+0000","last_clean":"2023-07-29T02:06:18.444998+0000","last_became_active":"2023-07-29T02:00:46.525331+0000","last_became_peered":"2023-07-29T02:00:46.525331+0000","last_unstale":"2023-07-29T02:06:18.444998+0000","last_undegraded":"2023-07-29T02:06:18.444998+0000","last_fullsized":"2023-07-29T02:06:18.444998+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.46925831499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"39'589","reported_seq":2662,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.254958+0000","last_change":"2023-07-29T02:03:57.172129+0000","last_active":"2023-07-29T02:06:07.254958+0000","last_peered":"2023-07-29T02:06:07.254958+0000","last_clean":"2023-07-29T02:06:07.254958+0000","last_became_active":"2023-07-29T02:00:01.996969+0000","last_became_peered":"2023-07-29T02:00:01.996969+0000","last_unstale":"2023-07-29T02:06:07.254958+0000","last_undegraded":"2023-07-29T02:06:07.254958+0000","last_fullsized":"2023-07-29T02:06:07.254958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.40090650999999999,"stat_sum":{"num_bytes":23342582,"num_objects":297,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":297,"num_whiteouts":0,"num_read":24,"num_read_kb":4119,"num_write":587,"num_write_kb":31305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"39'7","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:33.304556+0000","last_change":"2023-07-29T02:06:33.304685+0000","last_active":"2023-07-29T02:06:33.304556+0000","last_peered":"2023-07-29T02:06:33.304556+0000","last_clean":"2023-07-29T02:06:33.304556+0000","last_became_active":"2023-07-29T01:59:57.540800+0000","last_became_peered":"2023-07-29T01:59:57.540800+0000","last_unstale":"2023-07-29T02:06:33.304556+0000","last_undegraded":"2023-07-29T02:06:33.304556+0000","last_fullsized":"2023-07-29T02:06:33.304556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'7","last_scrub_stamp":"2023-07-29T02:06:33.304529+0000","last_deep_scrub":"39'7","last_deep_scrub_stamp":"2023-07-29T02:06:33.304529+0000","last_clean_scrub_stamp":"2023-07-29T02:06:33.304529+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:48.348979+0000","scrub_duration":0.0044829869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22906,"num_omap_keys":38,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"39'83","reported_seq":2145,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:31.683331+0000","last_change":"2023-07-29T02:06:31.683441+0000","last_active":"2023-07-29T02:06:31.683331+0000","last_peered":"2023-07-29T02:06:31.683331+0000","last_clean":"2023-07-29T02:06:31.683331+0000","last_became_active":"2023-07-29T01:59:57.963510+0000","last_became_peered":"2023-07-29T01:59:57.963510+0000","last_unstale":"2023-07-29T02:06:31.683331+0000","last_undegraded":"2023-07-29T02:06:31.683331+0000","last_fullsized":"2023-07-29T02:06:31.683331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'83","last_scrub_stamp":"2023-07-29T02:06:31.683303+0000","last_deep_scrub":"39'83","last_deep_scrub_stamp":"2023-07-29T02:06:31.683303+0000","last_clean_scrub_stamp":"2023-07-29T02:06:31.683303+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:51.653672+0000","scrub_duration":0.001434568,"objects_trimmed":0,"snaptrim_duration":0.30420630999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"39'628","reported_seq":2718,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.247727+0000","last_change":"2023-07-29T02:03:57.173787+0000","last_active":"2023-07-29T02:06:07.247727+0000","last_peered":"2023-07-29T02:06:07.247727+0000","last_clean":"2023-07-29T02:06:07.247727+0000","last_became_active":"2023-07-29T02:00:01.996084+0000","last_became_peered":"2023-07-29T02:00:01.996084+0000","last_unstale":"2023-07-29T02:06:07.247727+0000","last_undegraded":"2023-07-29T02:06:07.247727+0000","last_fullsized":"2023-07-29T02:06:07.247727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38362237100000002,"stat_sum":{"num_bytes":15782931,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":41,"num_read_kb":8234,"num_write":627,"num_write_kb":19844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"39'3","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:37.575794+0000","last_change":"2023-07-29T02:06:37.575902+0000","last_active":"2023-07-29T02:06:37.575794+0000","last_peered":"2023-07-29T02:06:37.575794+0000","last_clean":"2023-07-29T02:06:37.575794+0000","last_became_active":"2023-07-29T01:59:57.548109+0000","last_became_peered":"2023-07-29T01:59:57.548109+0000","last_unstale":"2023-07-29T02:06:37.575794+0000","last_undegraded":"2023-07-29T02:06:37.575794+0000","last_fullsized":"2023-07-29T02:06:37.575794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2023-07-29T02:06:37.575767+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2023-07-29T02:06:37.575767+0000","last_clean_scrub_stamp":"2023-07-29T02:06:37.575767+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:40.829676+0000","scrub_duration":0.0030220429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"39'105","reported_seq":2156,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.450812+0000","last_change":"2023-07-29T02:03:57.037255+0000","last_active":"2023-07-29T02:06:18.450812+0000","last_peered":"2023-07-29T02:06:18.450812+0000","last_clean":"2023-07-29T02:06:18.450812+0000","last_became_active":"2023-07-29T01:59:57.961759+0000","last_became_peered":"2023-07-29T01:59:57.961759+0000","last_unstale":"2023-07-29T02:06:18.450812+0000","last_undegraded":"2023-07-29T02:06:18.450812+0000","last_fullsized":"2023-07-29T02:06:18.450812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55180089099999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"39'661","reported_seq":2755,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.775707+0000","last_change":"2023-07-29T02:03:56.798905+0000","last_active":"2023-07-29T02:06:07.775707+0000","last_peered":"2023-07-29T02:06:07.775707+0000","last_clean":"2023-07-29T02:06:07.775707+0000","last_became_active":"2023-07-29T02:00:01.992592+0000","last_became_peered":"2023-07-29T02:00:01.992592+0000","last_unstale":"2023-07-29T02:06:07.775707+0000","last_undegraded":"2023-07-29T02:06:07.775707+0000","last_fullsized":"2023-07-29T02:06:07.775707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30939737499999997,"stat_sum":{"num_bytes":46419699,"num_objects":303,"num_object_clones":0,"num_object_copies":1212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":303,"num_whiteouts":0,"num_read":45,"num_read_kb":20516,"num_write":660,"num_write_kb":45624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"39'106","reported_seq":171,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:38.170657+0000","last_change":"2023-07-29T02:06:38.170787+0000","last_active":"2023-07-29T02:06:38.170657+0000","last_peered":"2023-07-29T02:06:38.170657+0000","last_clean":"2023-07-29T02:06:38.170657+0000","last_became_active":"2023-07-29T01:59:57.543398+0000","last_became_peered":"2023-07-29T01:59:57.543398+0000","last_unstale":"2023-07-29T02:06:38.170657+0000","last_undegraded":"2023-07-29T02:06:38.170657+0000","last_fullsized":"2023-07-29T02:06:38.170657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'106","last_scrub_stamp":"2023-07-29T02:06:38.170630+0000","last_deep_scrub":"39'106","last_deep_scrub_stamp":"2023-07-29T02:06:38.170630+0000","last_clean_scrub_stamp":"2023-07-29T02:06:38.170630+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:33.288781+0000","scrub_duration":0.020523897999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":8252,"num_write":102,"num_write_kb":8255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24160,"num_omap_keys":40,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"39'90","reported_seq":2152,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.890980+0000","last_change":"2023-07-29T02:06:24.891064+0000","last_active":"2023-07-29T02:06:24.890980+0000","last_peered":"2023-07-29T02:06:24.890980+0000","last_clean":"2023-07-29T02:06:24.890980+0000","last_became_active":"2023-07-29T01:59:57.965962+0000","last_became_peered":"2023-07-29T01:59:57.965962+0000","last_unstale":"2023-07-29T02:06:24.890980+0000","last_undegraded":"2023-07-29T02:06:24.890980+0000","last_fullsized":"2023-07-29T02:06:24.890980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'90","last_scrub_stamp":"2023-07-29T02:06:24.890955+0000","last_deep_scrub":"39'90","last_deep_scrub_stamp":"2023-07-29T02:06:24.890955+0000","last_clean_scrub_stamp":"2023-07-29T02:06:24.890955+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:20.009107+0000","scrub_duration":0.0016125829999999999,"objects_trimmed":0,"snaptrim_duration":0.38151887499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"39'670","reported_seq":2769,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:25.821570+0000","last_change":"2023-07-29T02:03:56.698091+0000","last_active":"2023-07-29T02:06:25.821570+0000","last_peered":"2023-07-29T02:06:25.821570+0000","last_clean":"2023-07-29T02:06:25.821570+0000","last_became_active":"2023-07-29T02:00:01.992384+0000","last_became_peered":"2023-07-29T02:00:01.992384+0000","last_unstale":"2023-07-29T02:06:25.821570+0000","last_undegraded":"2023-07-29T02:06:25.821570+0000","last_fullsized":"2023-07-29T02:06:25.821570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19044205,"stat_sum":{"num_bytes":36575402,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":49,"num_read_kb":16426,"num_write":669,"num_write_kb":40161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"39'30","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:43.592473+0000","last_change":"2023-07-29T02:06:43.592473+0000","last_active":"2023-07-29T02:06:43.592473+0000","last_peered":"2023-07-29T02:06:43.592473+0000","last_clean":"2023-07-29T02:06:43.592473+0000","last_became_active":"2023-07-29T01:59:57.548084+0000","last_became_peered":"2023-07-29T01:59:57.548084+0000","last_unstale":"2023-07-29T02:06:43.592473+0000","last_undegraded":"2023-07-29T02:06:43.592473+0000","last_fullsized":"2023-07-29T02:06:43.592473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'30","last_scrub_stamp":"2023-07-29T02:06:43.592305+0000","last_deep_scrub":"39'30","last_deep_scrub_stamp":"2023-07-29T02:06:43.592305+0000","last_clean_scrub_stamp":"2023-07-29T02:06:43.592305+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:36.733394+0000","scrub_duration":0.012205482,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":27,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17798,"num_omap_keys":30,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"39'93","reported_seq":2145,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.778962+0000","last_change":"2023-07-29T02:03:56.784306+0000","last_active":"2023-07-29T02:06:24.778962+0000","last_peered":"2023-07-29T02:06:24.778962+0000","last_clean":"2023-07-29T02:06:24.778962+0000","last_became_active":"2023-07-29T01:59:57.964626+0000","last_became_peered":"2023-07-29T01:59:57.964626+0000","last_unstale":"2023-07-29T02:06:24.778962+0000","last_undegraded":"2023-07-29T02:06:24.778962+0000","last_fullsized":"2023-07-29T02:06:24.778962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.297089139,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"39'673","reported_seq":2800,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:42.077307+0000","last_change":"2023-07-29T02:06:42.077438+0000","last_active":"2023-07-29T02:06:42.077307+0000","last_peered":"2023-07-29T02:06:42.077307+0000","last_clean":"2023-07-29T02:06:42.077307+0000","last_became_active":"2023-07-29T02:00:01.990579+0000","last_became_peered":"2023-07-29T02:00:01.990579+0000","last_unstale":"2023-07-29T02:06:42.077307+0000","last_undegraded":"2023-07-29T02:06:42.077307+0000","last_fullsized":"2023-07-29T02:06:42.077307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'673","last_scrub_stamp":"2023-07-29T02:06:42.077282+0000","last_deep_scrub":"39'673","last_deep_scrub_stamp":"2023-07-29T02:06:42.077282+0000","last_clean_scrub_stamp":"2023-07-29T02:06:42.077282+0000","objects_scrubbed":333,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:57.121733+0000","scrub_duration":0.13274117899999999,"objects_trimmed":0,"snaptrim_duration":0.47400464199999998,"stat_sum":{"num_bytes":32895626,"num_objects":333,"num_object_clones":0,"num_object_copies":1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":333,"num_whiteouts":0,"num_read":40,"num_read_kb":14736,"num_write":673,"num_write_kb":36572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"39'247","reported_seq":297,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.564540+0000","last_change":"2023-07-29T02:06:41.564540+0000","last_active":"2023-07-29T02:06:41.564540+0000","last_peered":"2023-07-29T02:06:41.564540+0000","last_clean":"2023-07-29T02:06:41.564540+0000","last_became_active":"2023-07-29T01:59:57.548981+0000","last_became_peered":"2023-07-29T01:59:57.548981+0000","last_unstale":"2023-07-29T02:06:41.564540+0000","last_undegraded":"2023-07-29T02:06:41.564540+0000","last_fullsized":"2023-07-29T02:06:41.564540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'247","last_scrub_stamp":"2023-07-29T02:06:41.564325+0000","last_deep_scrub":"39'247","last_deep_scrub_stamp":"2023-07-29T02:06:41.564325+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.564325+0000","objects_scrubbed":4,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:39.079241+0000","scrub_duration":0.018895436000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":244,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14496,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"39'93","reported_seq":2145,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.229703+0000","last_change":"2023-07-29T02:03:57.111934+0000","last_active":"2023-07-29T02:06:24.229703+0000","last_peered":"2023-07-29T02:06:24.229703+0000","last_clean":"2023-07-29T02:06:24.229703+0000","last_became_active":"2023-07-29T01:59:57.969501+0000","last_became_peered":"2023-07-29T01:59:57.969501+0000","last_unstale":"2023-07-29T02:06:24.229703+0000","last_undegraded":"2023-07-29T02:06:24.229703+0000","last_fullsized":"2023-07-29T02:06:24.229703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35565022000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"39'641","reported_seq":2728,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.184235+0000","last_change":"2023-07-29T02:03:56.959814+0000","last_active":"2023-07-29T02:06:07.184235+0000","last_peered":"2023-07-29T02:06:07.184235+0000","last_clean":"2023-07-29T02:06:07.184235+0000","last_became_active":"2023-07-29T02:00:01.989364+0000","last_became_peered":"2023-07-29T02:00:01.989364+0000","last_unstale":"2023-07-29T02:06:07.184235+0000","last_undegraded":"2023-07-29T02:06:07.184235+0000","last_fullsized":"2023-07-29T02:06:07.184235+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.47145374600000001,"stat_sum":{"num_bytes":24224399,"num_objects":325,"num_object_clones":0,"num_object_copies":1300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":38,"num_read_kb":8228,"num_write":641,"num_write_kb":23994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"39'12","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.570729+0000","last_change":"2023-07-29T02:06:39.570729+0000","last_active":"2023-07-29T02:06:39.570729+0000","last_peered":"2023-07-29T02:06:39.570729+0000","last_clean":"2023-07-29T02:06:39.570729+0000","last_became_active":"2023-07-29T01:59:57.541056+0000","last_became_peered":"2023-07-29T01:59:57.541056+0000","last_unstale":"2023-07-29T02:06:39.570729+0000","last_undegraded":"2023-07-29T02:06:39.570729+0000","last_fullsized":"2023-07-29T02:06:39.570729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2023-07-29T02:06:39.570584+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2023-07-29T02:06:39.570584+0000","last_clean_scrub_stamp":"2023-07-29T02:06:39.570584+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:54.615034+0000","scrub_duration":0.016833287999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":8,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31920,"num_omap_keys":53,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"39'88","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.129971+0000","last_change":"2023-07-29T02:06:39.130059+0000","last_active":"2023-07-29T02:06:39.129971+0000","last_peered":"2023-07-29T02:06:39.129971+0000","last_clean":"2023-07-29T02:06:39.129971+0000","last_became_active":"2023-07-29T01:59:57.974998+0000","last_became_peered":"2023-07-29T01:59:57.974998+0000","last_unstale":"2023-07-29T02:06:39.129971+0000","last_undegraded":"2023-07-29T02:06:39.129971+0000","last_fullsized":"2023-07-29T02:06:39.129971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'88","last_scrub_stamp":"2023-07-29T02:06:39.129946+0000","last_deep_scrub":"39'88","last_deep_scrub_stamp":"2023-07-29T02:06:39.129946+0000","last_clean_scrub_stamp":"2023-07-29T02:06:39.129946+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:59.100315+0000","scrub_duration":0.0019768939999999999,"objects_trimmed":0,"snaptrim_duration":0.20531364299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"39'660","reported_seq":2741,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:23.194672+0000","last_change":"2023-07-29T02:03:56.963785+0000","last_active":"2023-07-29T02:06:23.194672+0000","last_peered":"2023-07-29T02:06:23.194672+0000","last_clean":"2023-07-29T02:06:23.194672+0000","last_became_active":"2023-07-29T02:00:01.990276+0000","last_became_peered":"2023-07-29T02:00:01.990276+0000","last_unstale":"2023-07-29T02:06:23.194672+0000","last_undegraded":"2023-07-29T02:06:23.194672+0000","last_fullsized":"2023-07-29T02:06:23.194672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.47581172799999999,"stat_sum":{"num_bytes":20642551,"num_objects":321,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":321,"num_whiteouts":0,"num_read":31,"num_read_kb":1050,"num_write":661,"num_write_kb":24562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"39'11","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:36.751062+0000","last_change":"2023-07-29T02:06:36.751062+0000","last_active":"2023-07-29T02:06:36.751062+0000","last_peered":"2023-07-29T02:06:36.751062+0000","last_clean":"2023-07-29T02:06:36.751062+0000","last_became_active":"2023-07-29T01:59:57.544231+0000","last_became_peered":"2023-07-29T01:59:57.544231+0000","last_unstale":"2023-07-29T02:06:36.751062+0000","last_undegraded":"2023-07-29T02:06:36.751062+0000","last_fullsized":"2023-07-29T02:06:36.751062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'11","last_scrub_stamp":"2023-07-29T02:06:36.750893+0000","last_deep_scrub":"39'11","last_deep_scrub_stamp":"2023-07-29T02:06:36.750893+0000","last_clean_scrub_stamp":"2023-07-29T02:06:36.750893+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:51.795344+0000","scrub_duration":0.011813673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20726,"num_omap_keys":35,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"39'88","reported_seq":2140,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:22.163121+0000","last_change":"2023-07-29T02:03:57.033536+0000","last_active":"2023-07-29T02:06:22.163121+0000","last_peered":"2023-07-29T02:06:22.163121+0000","last_clean":"2023-07-29T02:06:22.163121+0000","last_became_active":"2023-07-29T01:59:57.974525+0000","last_became_peered":"2023-07-29T01:59:57.974525+0000","last_unstale":"2023-07-29T02:06:22.163121+0000","last_undegraded":"2023-07-29T02:06:22.163121+0000","last_fullsized":"2023-07-29T02:06:22.163121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.549422509,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"39'632","reported_seq":2757,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:44.103153+0000","last_change":"2023-07-29T02:06:44.103323+0000","last_active":"2023-07-29T02:06:44.103153+0000","last_peered":"2023-07-29T02:06:44.103153+0000","last_clean":"2023-07-29T02:06:44.103153+0000","last_became_active":"2023-07-29T02:00:01.988486+0000","last_became_peered":"2023-07-29T02:00:01.988486+0000","last_unstale":"2023-07-29T02:06:44.103153+0000","last_undegraded":"2023-07-29T02:06:44.103153+0000","last_fullsized":"2023-07-29T02:06:44.103153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'632","last_scrub_stamp":"2023-07-29T02:06:44.103126+0000","last_deep_scrub":"39'632","last_deep_scrub_stamp":"2023-07-29T02:06:44.103126+0000","last_clean_scrub_stamp":"2023-07-29T02:06:44.103126+0000","objects_scrubbed":300,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:41.618043+0000","scrub_duration":0.13271588600000001,"objects_trimmed":0,"snaptrim_duration":0.473472642,"stat_sum":{"num_bytes":32792736,"num_objects":300,"num_object_clones":0,"num_object_copies":1200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":300,"num_whiteouts":0,"num_read":41,"num_read_kb":18442,"num_write":630,"num_write_kb":40548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"39'382","reported_seq":431,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.975797+0000","last_change":"2023-07-29T02:06:39.975797+0000","last_active":"2023-07-29T02:06:39.975797+0000","last_peered":"2023-07-29T02:06:39.975797+0000","last_clean":"2023-07-29T02:06:39.975797+0000","last_became_active":"2023-07-29T01:59:57.534813+0000","last_became_peered":"2023-07-29T01:59:57.534813+0000","last_unstale":"2023-07-29T02:06:39.975797+0000","last_undegraded":"2023-07-29T02:06:39.975797+0000","last_fullsized":"2023-07-29T02:06:39.975797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'382","last_scrub_stamp":"2023-07-29T02:06:39.975672+0000","last_deep_scrub":"39'382","last_deep_scrub_stamp":"2023-07-29T02:06:39.975672+0000","last_clean_scrub_stamp":"2023-07-29T02:06:39.975672+0000","objects_scrubbed":6,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:30.008594+0000","scrub_duration":0.024545006000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":8198,"num_write":371,"num_write_kb":12605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"39'96","reported_seq":2159,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.494296+0000","last_change":"2023-07-29T02:06:24.494296+0000","last_active":"2023-07-29T02:06:24.494296+0000","last_peered":"2023-07-29T02:06:24.494296+0000","last_clean":"2023-07-29T02:06:24.494296+0000","last_became_active":"2023-07-29T01:59:57.962184+0000","last_became_peered":"2023-07-29T01:59:57.962184+0000","last_unstale":"2023-07-29T02:06:24.494296+0000","last_undegraded":"2023-07-29T02:06:24.494296+0000","last_fullsized":"2023-07-29T02:06:24.494296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'96","last_scrub_stamp":"2023-07-29T02:06:24.494142+0000","last_deep_scrub":"39'96","last_deep_scrub_stamp":"2023-07-29T02:06:24.494142+0000","last_clean_scrub_stamp":"2023-07-29T02:06:24.494142+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:05:15.948297+0000","scrub_duration":0.001611838,"objects_trimmed":0,"snaptrim_duration":0.36182750899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"39'688","reported_seq":2777,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.852391+0000","last_change":"2023-07-29T02:03:57.053859+0000","last_active":"2023-07-29T02:06:07.852391+0000","last_peered":"2023-07-29T02:06:07.852391+0000","last_clean":"2023-07-29T02:06:07.852391+0000","last_became_active":"2023-07-29T02:00:01.989151+0000","last_became_peered":"2023-07-29T02:00:01.989151+0000","last_unstale":"2023-07-29T02:06:07.852391+0000","last_undegraded":"2023-07-29T02:06:07.852391+0000","last_fullsized":"2023-07-29T02:06:07.852391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54490939800000004,"stat_sum":{"num_bytes":33219663,"num_objects":326,"num_object_clones":0,"num_object_copies":1304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":326,"num_whiteouts":0,"num_read":40,"num_read_kb":16418,"num_write":687,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"39'196","reported_seq":241,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:34.174273+0000","last_change":"2023-07-29T02:06:34.174383+0000","last_active":"2023-07-29T02:06:34.174273+0000","last_peered":"2023-07-29T02:06:34.174273+0000","last_clean":"2023-07-29T02:06:34.174273+0000","last_became_active":"2023-07-29T01:59:57.544120+0000","last_became_peered":"2023-07-29T01:59:57.544120+0000","last_unstale":"2023-07-29T02:06:34.174273+0000","last_undegraded":"2023-07-29T02:06:34.174273+0000","last_fullsized":"2023-07-29T02:06:34.174273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'196","last_scrub_stamp":"2023-07-29T02:06:34.174245+0000","last_deep_scrub":"39'196","last_deep_scrub_stamp":"2023-07-29T02:06:34.174245+0000","last_clean_scrub_stamp":"2023-07-29T02:06:34.174245+0000","objects_scrubbed":5,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:18:24.878615+0000","scrub_duration":0.032465687999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":192,"num_write_kb":12401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24074,"num_omap_keys":41,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"39'93","reported_seq":2145,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.229675+0000","last_change":"2023-07-29T02:03:57.107586+0000","last_active":"2023-07-29T02:06:24.229675+0000","last_peered":"2023-07-29T02:06:24.229675+0000","last_clean":"2023-07-29T02:06:24.229675+0000","last_became_active":"2023-07-29T01:59:57.961975+0000","last_became_peered":"2023-07-29T01:59:57.961975+0000","last_unstale":"2023-07-29T02:06:24.229675+0000","last_undegraded":"2023-07-29T02:06:24.229675+0000","last_fullsized":"2023-07-29T02:06:24.229675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37361334099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"39'646","reported_seq":2739,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.800114+0000","last_change":"2023-07-29T02:03:56.800119+0000","last_active":"2023-07-29T02:06:07.800114+0000","last_peered":"2023-07-29T02:06:07.800114+0000","last_clean":"2023-07-29T02:06:07.800114+0000","last_became_active":"2023-07-29T02:00:01.988155+0000","last_became_peered":"2023-07-29T02:00:01.988155+0000","last_unstale":"2023-07-29T02:06:07.800114+0000","last_undegraded":"2023-07-29T02:06:07.800114+0000","last_fullsized":"2023-07-29T02:06:07.800114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30982225000000002,"stat_sum":{"num_bytes":22073203,"num_objects":313,"num_object_clones":0,"num_object_copies":1252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":44,"num_read_kb":12328,"num_write":643,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"39'63","reported_seq":97,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.229607+0000","last_change":"2023-07-29T01:59:57.549764+0000","last_active":"2023-07-29T02:06:24.229607+0000","last_peered":"2023-07-29T02:06:24.229607+0000","last_clean":"2023-07-29T02:06:24.229607+0000","last_became_active":"2023-07-29T01:59:57.549470+0000","last_became_peered":"2023-07-29T01:59:57.549470+0000","last_unstale":"2023-07-29T02:06:24.229607+0000","last_undegraded":"2023-07-29T02:06:24.229607+0000","last_fullsized":"2023-07-29T02:06:24.229607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":64,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"39'65","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:32.423044+0000","last_change":"2023-07-29T02:06:32.423044+0000","last_active":"2023-07-29T02:06:32.423044+0000","last_peered":"2023-07-29T02:06:32.423044+0000","last_clean":"2023-07-29T02:06:32.423044+0000","last_became_active":"2023-07-29T01:59:57.962016+0000","last_became_peered":"2023-07-29T01:59:57.962016+0000","last_unstale":"2023-07-29T02:06:32.423044+0000","last_undegraded":"2023-07-29T02:06:32.423044+0000","last_fullsized":"2023-07-29T02:06:32.423044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'65","last_scrub_stamp":"2023-07-29T02:06:32.422911+0000","last_deep_scrub":"39'65","last_deep_scrub_stamp":"2023-07-29T02:06:32.422911+0000","last_clean_scrub_stamp":"2023-07-29T02:06:32.422911+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:22.455833+0000","scrub_duration":0.0014239599999999999,"objects_trimmed":0,"snaptrim_duration":0.36599154900000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"39'565","reported_seq":2654,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.783232+0000","last_change":"2023-07-29T02:03:57.082127+0000","last_active":"2023-07-29T02:06:07.783232+0000","last_peered":"2023-07-29T02:06:07.783232+0000","last_clean":"2023-07-29T02:06:07.783232+0000","last_became_active":"2023-07-29T02:00:01.992042+0000","last_became_peered":"2023-07-29T02:00:01.992042+0000","last_unstale":"2023-07-29T02:06:07.783232+0000","last_undegraded":"2023-07-29T02:06:07.783232+0000","last_fullsized":"2023-07-29T02:06:07.783232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36734029699999998,"stat_sum":{"num_bytes":17472104,"num_objects":288,"num_object_clones":0,"num_object_copies":1152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":40,"num_read_kb":12324,"num_write":565,"num_write_kb":21394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"39'15","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:35.000137+0000","last_change":"2023-07-29T02:06:35.000254+0000","last_active":"2023-07-29T02:06:35.000137+0000","last_peered":"2023-07-29T02:06:35.000137+0000","last_clean":"2023-07-29T02:06:35.000137+0000","last_became_active":"2023-07-29T01:59:57.535762+0000","last_became_peered":"2023-07-29T01:59:57.535762+0000","last_unstale":"2023-07-29T02:06:35.000137+0000","last_undegraded":"2023-07-29T02:06:35.000137+0000","last_fullsized":"2023-07-29T02:06:35.000137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'15","last_scrub_stamp":"2023-07-29T02:06:35.000106+0000","last_deep_scrub":"39'15","last_deep_scrub_stamp":"2023-07-29T02:06:35.000106+0000","last_clean_scrub_stamp":"2023-07-29T02:06:35.000106+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:28.141195+0000","scrub_duration":0.010307169,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":13,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30910,"num_omap_keys":52,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"39'87","reported_seq":2150,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.329087+0000","last_change":"2023-07-29T02:06:39.329087+0000","last_active":"2023-07-29T02:06:39.329087+0000","last_peered":"2023-07-29T02:06:39.329087+0000","last_clean":"2023-07-29T02:06:39.329087+0000","last_became_active":"2023-07-29T01:59:57.974834+0000","last_became_peered":"2023-07-29T01:59:57.974834+0000","last_unstale":"2023-07-29T02:06:39.329087+0000","last_undegraded":"2023-07-29T02:06:39.329087+0000","last_fullsized":"2023-07-29T02:06:39.329087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'87","last_scrub_stamp":"2023-07-29T02:06:39.328959+0000","last_deep_scrub":"39'87","last_deep_scrub_stamp":"2023-07-29T02:06:39.328959+0000","last_clean_scrub_stamp":"2023-07-29T02:06:39.328959+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:54.373409+0000","scrub_duration":0.0016042369999999999,"objects_trimmed":0,"snaptrim_duration":0.53560260199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"39'713","reported_seq":2793,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.454413+0000","last_change":"2023-07-29T02:03:57.112720+0000","last_active":"2023-07-29T02:06:19.454413+0000","last_peered":"2023-07-29T02:06:19.454413+0000","last_clean":"2023-07-29T02:06:19.454413+0000","last_became_active":"2023-07-29T02:00:01.990464+0000","last_became_peered":"2023-07-29T02:00:01.990464+0000","last_unstale":"2023-07-29T02:06:19.454413+0000","last_undegraded":"2023-07-29T02:06:19.454413+0000","last_fullsized":"2023-07-29T02:06:19.454413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.356278702,"stat_sum":{"num_bytes":25950589,"num_objects":363,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":363,"num_whiteouts":0,"num_read":30,"num_read_kb":4124,"num_write":712,"num_write_kb":29793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"39'166","reported_seq":216,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.989281+0000","last_change":"2023-07-29T02:06:41.989432+0000","last_active":"2023-07-29T02:06:41.989281+0000","last_peered":"2023-07-29T02:06:41.989281+0000","last_clean":"2023-07-29T02:06:41.989281+0000","last_became_active":"2023-07-29T01:59:57.540292+0000","last_became_peered":"2023-07-29T01:59:57.540292+0000","last_unstale":"2023-07-29T02:06:41.989281+0000","last_undegraded":"2023-07-29T02:06:41.989281+0000","last_fullsized":"2023-07-29T02:06:41.989281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'166","last_scrub_stamp":"2023-07-29T02:06:41.989234+0000","last_deep_scrub":"39'166","last_deep_scrub_stamp":"2023-07-29T02:06:41.989234+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.989234+0000","objects_scrubbed":4,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:33:15.850245+0000","scrub_duration":0.014136332,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":162,"num_write_kb":4206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20550,"num_omap_keys":35,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.534625+0000","last_change":"2023-07-29T02:06:41.534733+0000","last_active":"2023-07-29T02:06:41.534625+0000","last_peered":"2023-07-29T02:06:41.534625+0000","last_clean":"2023-07-29T02:06:41.534625+0000","last_became_active":"2023-07-29T01:59:52.447782+0000","last_became_peered":"2023-07-29T01:59:52.447782+0000","last_unstale":"2023-07-29T02:06:41.534625+0000","last_undegraded":"2023-07-29T02:06:41.534625+0000","last_fullsized":"2023-07-29T02:06:41.534625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:41.534599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:41.534599+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.534599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:58:31.380201+0000","scrub_duration":0.0019006699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"39'83","reported_seq":2146,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:30.896156+0000","last_change":"2023-07-29T02:06:30.896265+0000","last_active":"2023-07-29T02:06:30.896156+0000","last_peered":"2023-07-29T02:06:30.896156+0000","last_clean":"2023-07-29T02:06:30.896156+0000","last_became_active":"2023-07-29T01:59:57.966065+0000","last_became_peered":"2023-07-29T01:59:57.966065+0000","last_unstale":"2023-07-29T02:06:30.896156+0000","last_undegraded":"2023-07-29T02:06:30.896156+0000","last_fullsized":"2023-07-29T02:06:30.896156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'83","last_scrub_stamp":"2023-07-29T02:06:30.896126+0000","last_deep_scrub":"39'83","last_deep_scrub_stamp":"2023-07-29T02:06:30.896126+0000","last_clean_scrub_stamp":"2023-07-29T02:06:30.896126+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:45.940577+0000","scrub_duration":0.002183015,"objects_trimmed":0,"snaptrim_duration":0.37241656400000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"39'677","reported_seq":2774,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:06.908747+0000","last_change":"2023-07-29T02:03:57.174632+0000","last_active":"2023-07-29T02:06:06.908747+0000","last_peered":"2023-07-29T02:06:06.908747+0000","last_clean":"2023-07-29T02:06:06.908747+0000","last_became_active":"2023-07-29T02:00:01.995963+0000","last_became_peered":"2023-07-29T02:00:01.995963+0000","last_unstale":"2023-07-29T02:06:06.908747+0000","last_undegraded":"2023-07-29T02:06:06.908747+0000","last_fullsized":"2023-07-29T02:06:06.908747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.373304892,"stat_sum":{"num_bytes":14135733,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":47,"num_read_kb":4140,"num_write":679,"num_write_kb":14069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:32.905149+0000","last_change":"2023-07-29T02:06:32.905293+0000","last_active":"2023-07-29T02:06:32.905149+0000","last_peered":"2023-07-29T02:06:32.905149+0000","last_clean":"2023-07-29T02:06:32.905149+0000","last_became_active":"2023-07-29T01:59:52.445337+0000","last_became_peered":"2023-07-29T01:59:52.445337+0000","last_unstale":"2023-07-29T02:06:32.905149+0000","last_undegraded":"2023-07-29T02:06:32.905149+0000","last_fullsized":"2023-07-29T02:06:32.905149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:32.905103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:32.905103+0000","last_clean_scrub_stamp":"2023-07-29T02:06:32.905103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:30.420020+0000","scrub_duration":0.0019302989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"39'40","reported_seq":87,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:37.295043+0000","last_change":"2023-07-29T02:06:37.295159+0000","last_active":"2023-07-29T02:06:37.295043+0000","last_peered":"2023-07-29T02:06:37.295043+0000","last_clean":"2023-07-29T02:06:37.295043+0000","last_became_active":"2023-07-29T01:59:57.537581+0000","last_became_peered":"2023-07-29T01:59:57.537581+0000","last_unstale":"2023-07-29T02:06:37.295043+0000","last_undegraded":"2023-07-29T02:06:37.295043+0000","last_fullsized":"2023-07-29T02:06:37.295043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'40","last_scrub_stamp":"2023-07-29T02:06:37.294992+0000","last_deep_scrub":"39'40","last_deep_scrub_stamp":"2023-07-29T02:06:37.294992+0000","last_clean_scrub_stamp":"2023-07-29T02:06:37.294992+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:30.436081+0000","scrub_duration":0.0068420169999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8,"num_write":85,"num_write_kb":1322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12080,"num_omap_keys":20,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"39'82","reported_seq":2134,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.440352+0000","last_change":"2023-07-29T02:03:57.112487+0000","last_active":"2023-07-29T02:06:18.440352+0000","last_peered":"2023-07-29T02:06:18.440352+0000","last_clean":"2023-07-29T02:06:18.440352+0000","last_became_active":"2023-07-29T01:59:57.961298+0000","last_became_peered":"2023-07-29T01:59:57.961298+0000","last_unstale":"2023-07-29T02:06:18.440352+0000","last_undegraded":"2023-07-29T02:06:18.440352+0000","last_fullsized":"2023-07-29T02:06:18.440352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35104021600000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"39'622","reported_seq":2709,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.778872+0000","last_change":"2023-07-29T02:03:56.799516+0000","last_active":"2023-07-29T02:06:24.778872+0000","last_peered":"2023-07-29T02:06:24.778872+0000","last_clean":"2023-07-29T02:06:24.778872+0000","last_became_active":"2023-07-29T02:00:01.986915+0000","last_became_peered":"2023-07-29T02:00:01.986915+0000","last_unstale":"2023-07-29T02:06:24.778872+0000","last_undegraded":"2023-07-29T02:06:24.778872+0000","last_fullsized":"2023-07-29T02:06:24.778872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30985112500000001,"stat_sum":{"num_bytes":28815426,"num_objects":291,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":291,"num_whiteouts":0,"num_read":37,"num_read_kb":4131,"num_write":621,"num_write_kb":32518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:23.105634+0000","last_change":"2023-07-29T02:06:23.105717+0000","last_active":"2023-07-29T02:06:23.105634+0000","last_peered":"2023-07-29T02:06:23.105634+0000","last_clean":"2023-07-29T02:06:23.105634+0000","last_became_active":"2023-07-29T01:59:52.448052+0000","last_became_peered":"2023-07-29T01:59:52.448052+0000","last_unstale":"2023-07-29T02:06:23.105634+0000","last_undegraded":"2023-07-29T02:06:23.105634+0000","last_fullsized":"2023-07-29T02:06:23.105634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:23.105612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:23.105612+0000","last_clean_scrub_stamp":"2023-07-29T02:06:23.105612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:01:13.810307+0000","scrub_duration":0.0019361350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"39'119","reported_seq":199,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:34.526309+0000","last_change":"2023-07-29T02:06:34.526427+0000","last_active":"2023-07-29T02:06:34.526309+0000","last_peered":"2023-07-29T02:06:34.526309+0000","last_clean":"2023-07-29T02:06:34.526309+0000","last_became_active":"2023-07-29T01:59:52.449582+0000","last_became_peered":"2023-07-29T01:59:52.449582+0000","last_unstale":"2023-07-29T02:06:34.526309+0000","last_undegraded":"2023-07-29T02:06:34.526309+0000","last_fullsized":"2023-07-29T02:06:34.526309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2023-07-29T02:06:34.526281+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2023-07-29T02:06:34.526281+0000","last_clean_scrub_stamp":"2023-07-29T02:06:34.526281+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:54.496650+0000","scrub_duration":0.0069852009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"39'67","reported_seq":177,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:31.365346+0000","last_change":"2023-07-29T02:06:31.365465+0000","last_active":"2023-07-29T02:06:31.365346+0000","last_peered":"2023-07-29T02:06:31.365346+0000","last_clean":"2023-07-29T02:06:31.365346+0000","last_became_active":"2023-07-29T01:59:57.546179+0000","last_became_peered":"2023-07-29T01:59:57.546179+0000","last_unstale":"2023-07-29T02:06:31.365346+0000","last_undegraded":"2023-07-29T02:06:31.365346+0000","last_fullsized":"2023-07-29T02:06:31.365346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'67","last_scrub_stamp":"2023-07-29T02:06:31.365318+0000","last_deep_scrub":"39'67","last_deep_scrub_stamp":"2023-07-29T02:06:31.365318+0000","last_clean_scrub_stamp":"2023-07-29T02:06:31.365318+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:34.619227+0000","scrub_duration":0.0034459820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576264,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":610,"num_write":65,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"39'93","reported_seq":2156,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:27.316704+0000","last_change":"2023-07-29T02:06:27.316704+0000","last_active":"2023-07-29T02:06:27.316704+0000","last_peered":"2023-07-29T02:06:27.316704+0000","last_clean":"2023-07-29T02:06:27.316704+0000","last_became_active":"2023-07-29T01:59:57.975078+0000","last_became_peered":"2023-07-29T01:59:57.975078+0000","last_unstale":"2023-07-29T02:06:27.316704+0000","last_undegraded":"2023-07-29T02:06:27.316704+0000","last_fullsized":"2023-07-29T02:06:27.316704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'93","last_scrub_stamp":"2023-07-29T02:06:27.316579+0000","last_deep_scrub":"39'93","last_deep_scrub_stamp":"2023-07-29T02:06:27.316579+0000","last_clean_scrub_stamp":"2023-07-29T02:06:27.316579+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:22.434730+0000","scrub_duration":0.0015657690000000001,"objects_trimmed":0,"snaptrim_duration":0.55319968200000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"39'709","reported_seq":2809,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:23.194692+0000","last_change":"2023-07-29T02:03:56.966106+0000","last_active":"2023-07-29T02:06:23.194692+0000","last_peered":"2023-07-29T02:06:23.194692+0000","last_clean":"2023-07-29T02:06:23.194692+0000","last_became_active":"2023-07-29T02:00:01.986937+0000","last_became_peered":"2023-07-29T02:00:01.986937+0000","last_unstale":"2023-07-29T02:06:23.194692+0000","last_undegraded":"2023-07-29T02:06:23.194692+0000","last_fullsized":"2023-07-29T02:06:23.194692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.47715394799999999,"stat_sum":{"num_bytes":40554601,"num_objects":344,"num_object_clones":0,"num_object_copies":1376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":344,"num_whiteouts":0,"num_read":51,"num_read_kb":15453,"num_write":703,"num_write_kb":39978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:28.531585+0000","last_change":"2023-07-29T02:06:28.531707+0000","last_active":"2023-07-29T02:06:28.531585+0000","last_peered":"2023-07-29T02:06:28.531585+0000","last_clean":"2023-07-29T02:06:28.531585+0000","last_became_active":"2023-07-29T01:59:53.171467+0000","last_became_peered":"2023-07-29T01:59:53.171467+0000","last_unstale":"2023-07-29T02:06:28.531585+0000","last_undegraded":"2023-07-29T02:06:28.531585+0000","last_fullsized":"2023-07-29T02:06:28.531585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:28.531559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:28.531559+0000","last_clean_scrub_stamp":"2023-07-29T02:06:28.531559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:01:40.717070+0000","scrub_duration":0.0018899190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"39'254","reported_seq":302,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:29.161357+0000","last_change":"2023-07-29T02:06:29.161511+0000","last_active":"2023-07-29T02:06:29.161357+0000","last_peered":"2023-07-29T02:06:29.161357+0000","last_clean":"2023-07-29T02:06:29.161357+0000","last_became_active":"2023-07-29T01:59:57.549151+0000","last_became_peered":"2023-07-29T01:59:57.549151+0000","last_unstale":"2023-07-29T02:06:29.161357+0000","last_undegraded":"2023-07-29T02:06:29.161357+0000","last_fullsized":"2023-07-29T02:06:29.161357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'254","last_scrub_stamp":"2023-07-29T02:06:29.161311+0000","last_deep_scrub":"39'254","last_deep_scrub_stamp":"2023-07-29T02:06:29.161311+0000","last_clean_scrub_stamp":"2023-07-29T02:06:29.161311+0000","objects_scrubbed":5,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:18:19.865681+0000","scrub_duration":0.023803841999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":11035,"num_write":246,"num_write_kb":12456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25322,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"39'88","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:37.239617+0000","last_change":"2023-07-29T02:06:37.239734+0000","last_active":"2023-07-29T02:06:37.239617+0000","last_peered":"2023-07-29T02:06:37.239617+0000","last_clean":"2023-07-29T02:06:37.239617+0000","last_became_active":"2023-07-29T01:59:57.969273+0000","last_became_peered":"2023-07-29T01:59:57.969273+0000","last_unstale":"2023-07-29T02:06:37.239617+0000","last_undegraded":"2023-07-29T02:06:37.239617+0000","last_fullsized":"2023-07-29T02:06:37.239617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'88","last_scrub_stamp":"2023-07-29T02:06:37.239591+0000","last_deep_scrub":"39'88","last_deep_scrub_stamp":"2023-07-29T02:06:37.239591+0000","last_clean_scrub_stamp":"2023-07-29T02:06:37.239591+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:40.493500+0000","scrub_duration":0.0016482389999999999,"objects_trimmed":0,"snaptrim_duration":0.53741308300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"39'639","reported_seq":2721,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.453969+0000","last_change":"2023-07-29T02:03:56.696365+0000","last_active":"2023-07-29T02:06:19.453969+0000","last_peered":"2023-07-29T02:06:19.453969+0000","last_clean":"2023-07-29T02:06:19.453969+0000","last_became_active":"2023-07-29T02:00:01.992406+0000","last_became_peered":"2023-07-29T02:00:01.992406+0000","last_unstale":"2023-07-29T02:06:19.453969+0000","last_undegraded":"2023-07-29T02:06:19.453969+0000","last_fullsized":"2023-07-29T02:06:19.453969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.18856821800000001,"stat_sum":{"num_bytes":24792794,"num_objects":323,"num_object_clones":0,"num_object_copies":1292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":323,"num_whiteouts":0,"num_read":32,"num_read_kb":11492,"num_write":639,"num_write_kb":27823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:33.505179+0000","last_change":"2023-07-29T02:06:33.505289+0000","last_active":"2023-07-29T02:06:33.505179+0000","last_peered":"2023-07-29T02:06:33.505179+0000","last_clean":"2023-07-29T02:06:33.505179+0000","last_became_active":"2023-07-29T01:59:53.171440+0000","last_became_peered":"2023-07-29T01:59:53.171440+0000","last_unstale":"2023-07-29T02:06:33.505179+0000","last_undegraded":"2023-07-29T02:06:33.505179+0000","last_fullsized":"2023-07-29T02:06:33.505179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:33.505144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:33.505144+0000","last_clean_scrub_stamp":"2023-07-29T02:06:33.505144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:28.623295+0000","scrub_duration":0.0017891820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"39'8","reported_seq":54,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:37.053724+0000","last_change":"2023-07-29T02:06:37.053856+0000","last_active":"2023-07-29T02:06:37.053724+0000","last_peered":"2023-07-29T02:06:37.053724+0000","last_clean":"2023-07-29T02:06:37.053724+0000","last_became_active":"2023-07-29T01:59:57.537665+0000","last_became_peered":"2023-07-29T01:59:57.537665+0000","last_unstale":"2023-07-29T02:06:37.053724+0000","last_undegraded":"2023-07-29T02:06:37.053724+0000","last_fullsized":"2023-07-29T02:06:37.053724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2023-07-29T02:06:37.053696+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2023-07-29T02:06:37.053696+0000","last_clean_scrub_stamp":"2023-07-29T02:06:37.053696+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:12:59.646704+0000","scrub_duration":0.016447590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":4,"num_write_kb":8199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6040,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"39'84","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.430257+0000","last_change":"2023-07-29T02:03:56.981337+0000","last_active":"2023-07-29T02:06:18.430257+0000","last_peered":"2023-07-29T02:06:18.430257+0000","last_clean":"2023-07-29T02:06:18.430257+0000","last_became_active":"2023-07-29T01:59:57.968373+0000","last_became_peered":"2023-07-29T01:59:57.968373+0000","last_unstale":"2023-07-29T02:06:18.430257+0000","last_undegraded":"2023-07-29T02:06:18.430257+0000","last_fullsized":"2023-07-29T02:06:18.430257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.21661398800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"39'634","reported_seq":2722,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.448266+0000","last_change":"2023-07-29T02:03:57.040708+0000","last_active":"2023-07-29T02:06:19.448266+0000","last_peered":"2023-07-29T02:06:19.448266+0000","last_clean":"2023-07-29T02:06:19.448266+0000","last_became_active":"2023-07-29T02:00:01.984476+0000","last_became_peered":"2023-07-29T02:00:01.984476+0000","last_unstale":"2023-07-29T02:06:19.448266+0000","last_undegraded":"2023-07-29T02:06:19.448266+0000","last_fullsized":"2023-07-29T02:06:19.448266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55548792300000005,"stat_sum":{"num_bytes":35592378,"num_objects":339,"num_object_clones":0,"num_object_copies":1356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":339,"num_whiteouts":0,"num_read":38,"num_read_kb":16563,"num_write":635,"num_write_kb":39103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:34.723044+0000","last_change":"2023-07-29T02:06:34.723187+0000","last_active":"2023-07-29T02:06:34.723044+0000","last_peered":"2023-07-29T02:06:34.723044+0000","last_clean":"2023-07-29T02:06:34.723044+0000","last_became_active":"2023-07-29T01:59:53.171617+0000","last_became_peered":"2023-07-29T01:59:53.171617+0000","last_unstale":"2023-07-29T02:06:34.723044+0000","last_undegraded":"2023-07-29T02:06:34.723044+0000","last_fullsized":"2023-07-29T02:06:34.723044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:34.723018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:34.723018+0000","last_clean_scrub_stamp":"2023-07-29T02:06:34.723018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:37.976927+0000","scrub_duration":0.0020343689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"39'14","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:14.453979+0000","last_change":"2023-07-29T01:59:57.540888+0000","last_active":"2023-07-29T02:06:14.453979+0000","last_peered":"2023-07-29T02:06:14.453979+0000","last_clean":"2023-07-29T02:06:14.453979+0000","last_became_active":"2023-07-29T01:59:57.540449+0000","last_became_peered":"2023-07-29T01:59:57.540449+0000","last_unstale":"2023-07-29T02:06:14.453979+0000","last_undegraded":"2023-07-29T02:06:14.453979+0000","last_fullsized":"2023-07-29T02:06:14.453979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:56.517054+0000","last_clean_scrub_stamp":"2023-07-29T01:59:56.517054+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"39'91","reported_seq":2154,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.383474+0000","last_change":"2023-07-29T02:06:41.383581+0000","last_active":"2023-07-29T02:06:41.383474+0000","last_peered":"2023-07-29T02:06:41.383474+0000","last_clean":"2023-07-29T02:06:41.383474+0000","last_became_active":"2023-07-29T01:59:57.967933+0000","last_became_peered":"2023-07-29T01:59:57.967933+0000","last_unstale":"2023-07-29T02:06:41.383474+0000","last_undegraded":"2023-07-29T02:06:41.383474+0000","last_fullsized":"2023-07-29T02:06:41.383474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'91","last_scrub_stamp":"2023-07-29T02:06:41.383445+0000","last_deep_scrub":"39'91","last_deep_scrub_stamp":"2023-07-29T02:06:41.383445+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.383445+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:38.898362+0000","scrub_duration":0.001572709,"objects_trimmed":0,"snaptrim_duration":0.54069509900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"39'665","reported_seq":2752,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.462371+0000","last_change":"2023-07-29T02:03:56.982796+0000","last_active":"2023-07-29T02:06:19.462371+0000","last_peered":"2023-07-29T02:06:19.462371+0000","last_clean":"2023-07-29T02:06:19.462371+0000","last_became_active":"2023-07-29T02:00:01.984691+0000","last_became_peered":"2023-07-29T02:00:01.984691+0000","last_unstale":"2023-07-29T02:06:19.462371+0000","last_undegraded":"2023-07-29T02:06:19.462371+0000","last_fullsized":"2023-07-29T02:06:19.462371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.204776021,"stat_sum":{"num_bytes":24859419,"num_objects":316,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":316,"num_whiteouts":0,"num_read":37,"num_read_kb":6702,"num_write":664,"num_write_kb":28713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:32.106823+0000","last_change":"2023-07-29T02:06:32.106957+0000","last_active":"2023-07-29T02:06:32.106823+0000","last_peered":"2023-07-29T02:06:32.106823+0000","last_clean":"2023-07-29T02:06:32.106823+0000","last_became_active":"2023-07-29T01:59:53.171463+0000","last_became_peered":"2023-07-29T01:59:53.171463+0000","last_unstale":"2023-07-29T02:06:32.106823+0000","last_undegraded":"2023-07-29T02:06:32.106823+0000","last_fullsized":"2023-07-29T02:06:32.106823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:32.106799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:32.106799+0000","last_clean_scrub_stamp":"2023-07-29T02:06:32.106799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:45.683196+0000","scrub_duration":0.0021981660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"39'9","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:33.194543+0000","last_change":"2023-07-29T02:06:33.194659+0000","last_active":"2023-07-29T02:06:33.194543+0000","last_peered":"2023-07-29T02:06:33.194543+0000","last_clean":"2023-07-29T02:06:33.194543+0000","last_became_active":"2023-07-29T01:59:57.549181+0000","last_became_peered":"2023-07-29T01:59:57.549181+0000","last_unstale":"2023-07-29T02:06:33.194543+0000","last_undegraded":"2023-07-29T02:06:33.194543+0000","last_fullsized":"2023-07-29T02:06:33.194543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'9","last_scrub_stamp":"2023-07-29T02:06:33.194518+0000","last_deep_scrub":"39'9","last_deep_scrub_stamp":"2023-07-29T02:06:33.194518+0000","last_clean_scrub_stamp":"2023-07-29T02:06:33.194518+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:28.312669+0000","scrub_duration":0.0098727299999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11674,"num_omap_keys":20,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"39'97","reported_seq":2160,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:28.363951+0000","last_change":"2023-07-29T02:06:28.364094+0000","last_active":"2023-07-29T02:06:28.363951+0000","last_peered":"2023-07-29T02:06:28.363951+0000","last_clean":"2023-07-29T02:06:28.363951+0000","last_became_active":"2023-07-29T01:59:57.963659+0000","last_became_peered":"2023-07-29T01:59:57.963659+0000","last_unstale":"2023-07-29T02:06:28.363951+0000","last_undegraded":"2023-07-29T02:06:28.363951+0000","last_fullsized":"2023-07-29T02:06:28.363951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'97","last_scrub_stamp":"2023-07-29T02:06:28.363914+0000","last_deep_scrub":"39'97","last_deep_scrub_stamp":"2023-07-29T02:06:28.363914+0000","last_clean_scrub_stamp":"2023-07-29T02:06:28.363914+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:48.334283+0000","scrub_duration":0.001843236,"objects_trimmed":0,"snaptrim_duration":0.55193447900000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"39'682","reported_seq":2772,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.448222+0000","last_change":"2023-07-29T02:03:57.036172+0000","last_active":"2023-07-29T02:06:19.448222+0000","last_peered":"2023-07-29T02:06:19.448222+0000","last_clean":"2023-07-29T02:06:19.448222+0000","last_became_active":"2023-07-29T02:00:01.983744+0000","last_became_peered":"2023-07-29T02:00:01.983744+0000","last_unstale":"2023-07-29T02:06:19.448222+0000","last_undegraded":"2023-07-29T02:06:19.448222+0000","last_fullsized":"2023-07-29T02:06:19.448222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.552203522,"stat_sum":{"num_bytes":32278530,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":40,"num_read_kb":16416,"num_write":683,"num_write_kb":31830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:28.151338+0000","last_change":"2023-07-29T02:06:28.151465+0000","last_active":"2023-07-29T02:06:28.151338+0000","last_peered":"2023-07-29T02:06:28.151338+0000","last_clean":"2023-07-29T02:06:28.151338+0000","last_became_active":"2023-07-29T01:59:52.448814+0000","last_became_peered":"2023-07-29T01:59:52.448814+0000","last_unstale":"2023-07-29T02:06:28.151338+0000","last_undegraded":"2023-07-29T02:06:28.151338+0000","last_fullsized":"2023-07-29T02:06:28.151338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:28.151312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:28.151312+0000","last_clean_scrub_stamp":"2023-07-29T02:06:28.151312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:01:18.856007+0000","scrub_duration":0.0019737660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"39'428","reported_seq":473,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:38.773403+0000","last_change":"2023-07-29T02:06:38.773525+0000","last_active":"2023-07-29T02:06:38.773403+0000","last_peered":"2023-07-29T02:06:38.773403+0000","last_clean":"2023-07-29T02:06:38.773403+0000","last_became_active":"2023-07-29T01:59:57.544317+0000","last_became_peered":"2023-07-29T01:59:57.544317+0000","last_unstale":"2023-07-29T02:06:38.773403+0000","last_undegraded":"2023-07-29T02:06:38.773403+0000","last_fullsized":"2023-07-29T02:06:38.773403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'428","last_scrub_stamp":"2023-07-29T02:06:38.773375+0000","last_deep_scrub":"39'428","last_deep_scrub_stamp":"2023-07-29T02:06:38.773375+0000","last_clean_scrub_stamp":"2023-07-29T02:06:38.773375+0000","objects_scrubbed":3,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:36.288292+0000","scrub_duration":0.023010361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":424,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"39'90","reported_seq":2153,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:34.198334+0000","last_change":"2023-07-29T02:06:34.198474+0000","last_active":"2023-07-29T02:06:34.198334+0000","last_peered":"2023-07-29T02:06:34.198334+0000","last_clean":"2023-07-29T02:06:34.198334+0000","last_became_active":"2023-07-29T01:59:57.969642+0000","last_became_peered":"2023-07-29T01:59:57.969642+0000","last_unstale":"2023-07-29T02:06:34.198334+0000","last_undegraded":"2023-07-29T02:06:34.198334+0000","last_fullsized":"2023-07-29T02:06:34.198334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'90","last_scrub_stamp":"2023-07-29T02:06:34.198306+0000","last_deep_scrub":"39'90","last_deep_scrub_stamp":"2023-07-29T02:06:34.198306+0000","last_clean_scrub_stamp":"2023-07-29T02:06:34.198306+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:54.168675+0000","scrub_duration":0.0019970069999999999,"objects_trimmed":0,"snaptrim_duration":0.53741660000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"39'637","reported_seq":2731,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.912163+0000","last_change":"2023-07-29T02:03:57.053813+0000","last_active":"2023-07-29T02:06:07.912163+0000","last_peered":"2023-07-29T02:06:07.912163+0000","last_clean":"2023-07-29T02:06:07.912163+0000","last_became_active":"2023-07-29T02:00:01.998715+0000","last_became_peered":"2023-07-29T02:00:01.998715+0000","last_unstale":"2023-07-29T02:06:07.912163+0000","last_undegraded":"2023-07-29T02:06:07.912163+0000","last_fullsized":"2023-07-29T02:06:07.912163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54131381700000003,"stat_sum":{"num_bytes":21401745,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":45,"num_read_kb":12330,"num_write":635,"num_write_kb":33528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"39'140","reported_seq":184,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:38.331660+0000","last_change":"2023-07-29T02:06:38.331785+0000","last_active":"2023-07-29T02:06:38.331660+0000","last_peered":"2023-07-29T02:06:38.331660+0000","last_clean":"2023-07-29T02:06:38.331660+0000","last_became_active":"2023-07-29T01:59:57.545744+0000","last_became_peered":"2023-07-29T01:59:57.545744+0000","last_unstale":"2023-07-29T02:06:38.331660+0000","last_undegraded":"2023-07-29T02:06:38.331660+0000","last_fullsized":"2023-07-29T02:06:38.331660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'140","last_scrub_stamp":"2023-07-29T02:06:38.331635+0000","last_deep_scrub":"39'140","last_deep_scrub_stamp":"2023-07-29T02:06:38.331635+0000","last_clean_scrub_stamp":"2023-07-29T02:06:38.331635+0000","objects_scrubbed":4,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:16.541693+0000","scrub_duration":0.014197192000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":139,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22538,"num_omap_keys":38,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"39'92","reported_seq":2154,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:29.765400+0000","last_change":"2023-07-29T02:06:29.765521+0000","last_active":"2023-07-29T02:06:29.765400+0000","last_peered":"2023-07-29T02:06:29.765400+0000","last_clean":"2023-07-29T02:06:29.765400+0000","last_became_active":"2023-07-29T01:59:57.970252+0000","last_became_peered":"2023-07-29T01:59:57.970252+0000","last_unstale":"2023-07-29T02:06:29.765400+0000","last_undegraded":"2023-07-29T02:06:29.765400+0000","last_fullsized":"2023-07-29T02:06:29.765400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'92","last_scrub_stamp":"2023-07-29T02:06:29.765372+0000","last_deep_scrub":"39'92","last_deep_scrub_stamp":"2023-07-29T02:06:29.765372+0000","last_clean_scrub_stamp":"2023-07-29T02:06:29.765372+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:59:27.382387+0000","scrub_duration":0.0016174830000000001,"objects_trimmed":0,"snaptrim_duration":0.46822948199999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"39'637","reported_seq":2724,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.452797+0000","last_change":"2023-07-29T02:03:56.694563+0000","last_active":"2023-07-29T02:06:07.452797+0000","last_peered":"2023-07-29T02:06:07.452797+0000","last_clean":"2023-07-29T02:06:07.452797+0000","last_became_active":"2023-07-29T02:00:01.989481+0000","last_became_peered":"2023-07-29T02:00:01.989481+0000","last_unstale":"2023-07-29T02:06:07.452797+0000","last_undegraded":"2023-07-29T02:06:07.452797+0000","last_fullsized":"2023-07-29T02:06:07.452797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.187630984,"stat_sum":{"num_bytes":25047033,"num_objects":309,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":38,"num_read_kb":8227,"num_write":637,"num_write_kb":24796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"39'117","reported_seq":166,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.700467+0000","last_change":"2023-07-29T02:06:41.700574+0000","last_active":"2023-07-29T02:06:41.700467+0000","last_peered":"2023-07-29T02:06:41.700467+0000","last_clean":"2023-07-29T02:06:41.700467+0000","last_became_active":"2023-07-29T01:59:57.543445+0000","last_became_peered":"2023-07-29T01:59:57.543445+0000","last_unstale":"2023-07-29T02:06:41.700467+0000","last_undegraded":"2023-07-29T02:06:41.700467+0000","last_fullsized":"2023-07-29T02:06:41.700467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'117","last_scrub_stamp":"2023-07-29T02:06:41.700441+0000","last_deep_scrub":"39'117","last_deep_scrub_stamp":"2023-07-29T02:06:41.700441+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.700441+0000","objects_scrubbed":5,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:19.910499+0000","scrub_duration":0.011827798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":114,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":38984,"num_omap_keys":65,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"39'90","reported_seq":2152,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:28.472206+0000","last_change":"2023-07-29T02:06:28.472340+0000","last_active":"2023-07-29T02:06:28.472206+0000","last_peered":"2023-07-29T02:06:28.472206+0000","last_clean":"2023-07-29T02:06:28.472206+0000","last_became_active":"2023-07-29T01:59:57.964925+0000","last_became_peered":"2023-07-29T01:59:57.964925+0000","last_unstale":"2023-07-29T02:06:28.472206+0000","last_undegraded":"2023-07-29T02:06:28.472206+0000","last_fullsized":"2023-07-29T02:06:28.472206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'90","last_scrub_stamp":"2023-07-29T02:06:28.472178+0000","last_deep_scrub":"39'90","last_deep_scrub_stamp":"2023-07-29T02:06:28.472178+0000","last_clean_scrub_stamp":"2023-07-29T02:06:28.472178+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:06.682236+0000","scrub_duration":0.0018172119999999999,"objects_trimmed":0,"snaptrim_duration":0.35003659399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'665","reported_seq":2750,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:08.036034+0000","last_change":"2023-07-29T02:03:56.799552+0000","last_active":"2023-07-29T02:06:08.036034+0000","last_peered":"2023-07-29T02:06:08.036034+0000","last_clean":"2023-07-29T02:06:08.036034+0000","last_became_active":"2023-07-29T02:00:01.985310+0000","last_became_peered":"2023-07-29T02:00:01.985310+0000","last_unstale":"2023-07-29T02:06:08.036034+0000","last_undegraded":"2023-07-29T02:06:08.036034+0000","last_fullsized":"2023-07-29T02:06:08.036034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.31035642899999999,"stat_sum":{"num_bytes":19557603,"num_objects":304,"num_object_clones":0,"num_object_copies":1216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":304,"num_whiteouts":0,"num_read":36,"num_read_kb":35,"num_write":665,"num_write_kb":19402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"39'94","reported_seq":145,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:42.709299+0000","last_change":"2023-07-29T02:06:42.709432+0000","last_active":"2023-07-29T02:06:42.709299+0000","last_peered":"2023-07-29T02:06:42.709299+0000","last_clean":"2023-07-29T02:06:42.709299+0000","last_became_active":"2023-07-29T01:59:57.541633+0000","last_became_peered":"2023-07-29T01:59:57.541633+0000","last_unstale":"2023-07-29T02:06:42.709299+0000","last_undegraded":"2023-07-29T02:06:42.709299+0000","last_fullsized":"2023-07-29T02:06:42.709299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'94","last_scrub_stamp":"2023-07-29T02:06:42.709271+0000","last_deep_scrub":"39'94","last_deep_scrub_stamp":"2023-07-29T02:06:42.709271+0000","last_clean_scrub_stamp":"2023-07-29T02:06:42.709271+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:13:05.302279+0000","scrub_duration":0.032654646000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":18,"num_read_kb":12303,"num_write":84,"num_write_kb":16462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":29892,"num_omap_keys":51,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"39'85","reported_seq":2147,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:26.458452+0000","last_change":"2023-07-29T02:06:26.458592+0000","last_active":"2023-07-29T02:06:26.458452+0000","last_peered":"2023-07-29T02:06:26.458452+0000","last_clean":"2023-07-29T02:06:26.458452+0000","last_became_active":"2023-07-29T01:59:57.965383+0000","last_became_peered":"2023-07-29T01:59:57.965383+0000","last_unstale":"2023-07-29T02:06:26.458452+0000","last_undegraded":"2023-07-29T02:06:26.458452+0000","last_fullsized":"2023-07-29T02:06:26.458452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'85","last_scrub_stamp":"2023-07-29T02:06:26.458409+0000","last_deep_scrub":"39'85","last_deep_scrub_stamp":"2023-07-29T02:06:26.458409+0000","last_clean_scrub_stamp":"2023-07-29T02:06:26.458409+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:23.973325+0000","scrub_duration":0.0020203869999999998,"objects_trimmed":0,"snaptrim_duration":0.352110162,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"39'676","reported_seq":2764,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:08.041523+0000","last_change":"2023-07-29T02:03:57.114115+0000","last_active":"2023-07-29T02:06:08.041523+0000","last_peered":"2023-07-29T02:06:08.041523+0000","last_clean":"2023-07-29T02:06:08.041523+0000","last_became_active":"2023-07-29T02:00:01.993454+0000","last_became_peered":"2023-07-29T02:00:01.993454+0000","last_unstale":"2023-07-29T02:06:08.041523+0000","last_undegraded":"2023-07-29T02:06:08.041523+0000","last_fullsized":"2023-07-29T02:06:08.041523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.33100711700000002,"stat_sum":{"num_bytes":33339861,"num_objects":341,"num_object_clones":0,"num_object_copies":1364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":0,"num_read":39,"num_read_kb":19097,"num_write":677,"num_write_kb":41065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"39'127","reported_seq":172,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:36.017890+0000","last_change":"2023-07-29T02:06:36.018010+0000","last_active":"2023-07-29T02:06:36.017890+0000","last_peered":"2023-07-29T02:06:36.017890+0000","last_clean":"2023-07-29T02:06:36.017890+0000","last_became_active":"2023-07-29T01:59:57.539181+0000","last_became_peered":"2023-07-29T01:59:57.539181+0000","last_unstale":"2023-07-29T02:06:36.017890+0000","last_undegraded":"2023-07-29T02:06:36.017890+0000","last_fullsized":"2023-07-29T02:06:36.017890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'127","last_scrub_stamp":"2023-07-29T02:06:36.017861+0000","last_deep_scrub":"39'127","last_deep_scrub_stamp":"2023-07-29T02:06:36.017861+0000","last_clean_scrub_stamp":"2023-07-29T02:06:36.017861+0000","objects_scrubbed":5,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:14.227919+0000","scrub_duration":0.025569596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":120,"num_write_kb":12364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18028,"num_omap_keys":30,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"39'91","reported_seq":2153,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:28.854141+0000","last_change":"2023-07-29T02:06:28.854311+0000","last_active":"2023-07-29T02:06:28.854141+0000","last_peered":"2023-07-29T02:06:28.854141+0000","last_clean":"2023-07-29T02:06:28.854141+0000","last_became_active":"2023-07-29T01:59:57.966580+0000","last_became_peered":"2023-07-29T01:59:57.966580+0000","last_unstale":"2023-07-29T02:06:28.854141+0000","last_undegraded":"2023-07-29T02:06:28.854141+0000","last_fullsized":"2023-07-29T02:06:28.854141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'91","last_scrub_stamp":"2023-07-29T02:06:28.854093+0000","last_deep_scrub":"39'91","last_deep_scrub_stamp":"2023-07-29T02:06:28.854093+0000","last_clean_scrub_stamp":"2023-07-29T02:06:28.854093+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:32.108002+0000","scrub_duration":0.001683281,"objects_trimmed":0,"snaptrim_duration":0.38010548900000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"39'649","reported_seq":2736,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.671722+0000","last_change":"2023-07-29T02:03:57.046097+0000","last_active":"2023-07-29T02:06:07.671722+0000","last_peered":"2023-07-29T02:06:07.671722+0000","last_clean":"2023-07-29T02:06:07.671722+0000","last_became_active":"2023-07-29T02:00:01.985554+0000","last_became_peered":"2023-07-29T02:00:01.985554+0000","last_unstale":"2023-07-29T02:06:07.671722+0000","last_undegraded":"2023-07-29T02:06:07.671722+0000","last_fullsized":"2023-07-29T02:06:07.671722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.53877218400000004,"stat_sum":{"num_bytes":39819276,"num_objects":290,"num_object_clones":0,"num_object_copies":1160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":290,"num_whiteouts":0,"num_read":38,"num_read_kb":16418,"num_write":646,"num_write_kb":43313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"39'140","reported_seq":191,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:40.302084+0000","last_change":"2023-07-29T02:06:40.302188+0000","last_active":"2023-07-29T02:06:40.302084+0000","last_peered":"2023-07-29T02:06:40.302084+0000","last_clean":"2023-07-29T02:06:40.302084+0000","last_became_active":"2023-07-29T01:59:57.537457+0000","last_became_peered":"2023-07-29T01:59:57.537457+0000","last_unstale":"2023-07-29T02:06:40.302084+0000","last_undegraded":"2023-07-29T02:06:40.302084+0000","last_fullsized":"2023-07-29T02:06:40.302084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'140","last_scrub_stamp":"2023-07-29T02:06:40.302059+0000","last_deep_scrub":"39'140","last_deep_scrub_stamp":"2023-07-29T02:06:40.302059+0000","last_clean_scrub_stamp":"2023-07-29T02:06:40.302059+0000","objects_scrubbed":5,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:45:14.737193+0000","scrub_duration":0.022800549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":132,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12841,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"39'109","reported_seq":2160,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.438026+0000","last_change":"2023-07-29T02:03:57.113779+0000","last_active":"2023-07-29T02:06:18.438026+0000","last_peered":"2023-07-29T02:06:18.438026+0000","last_clean":"2023-07-29T02:06:18.438026+0000","last_became_active":"2023-07-29T01:59:57.960318+0000","last_became_peered":"2023-07-29T01:59:57.960318+0000","last_unstale":"2023-07-29T02:06:18.438026+0000","last_undegraded":"2023-07-29T02:06:18.438026+0000","last_fullsized":"2023-07-29T02:06:18.438026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.32984874600000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"39'107","reported_seq":2160,"reported_epoch":39,"state":"active+clean+scrubbing+deep","last_fresh":"2023-07-29T02:06:25.302907+0000","last_change":"2023-07-29T02:06:42.068925+0000","last_active":"2023-07-29T02:06:25.302907+0000","last_peered":"2023-07-29T02:06:25.302907+0000","last_clean":"2023-07-29T02:06:25.302907+0000","last_became_active":"2023-07-29T01:59:57.959960+0000","last_became_peered":"2023-07-29T01:59:57.959960+0000","last_unstale":"2023-07-29T02:06:25.302907+0000","last_undegraded":"2023-07-29T02:06:25.302907+0000","last_fullsized":"2023-07-29T02:06:25.302907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.22491762700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"39'110","reported_seq":2162,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.448522+0000","last_change":"2023-07-29T02:03:57.173410+0000","last_active":"2023-07-29T02:06:18.448522+0000","last_peered":"2023-07-29T02:06:18.448522+0000","last_clean":"2023-07-29T02:06:18.448522+0000","last_became_active":"2023-07-29T01:59:57.975384+0000","last_became_peered":"2023-07-29T01:59:57.975384+0000","last_unstale":"2023-07-29T02:06:18.448522+0000","last_undegraded":"2023-07-29T02:06:18.448522+0000","last_fullsized":"2023-07-29T02:06:18.448522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38175464599999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"39'101","reported_seq":2164,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:30.442599+0000","last_change":"2023-07-29T02:06:30.442707+0000","last_active":"2023-07-29T02:06:30.442599+0000","last_peered":"2023-07-29T02:06:30.442599+0000","last_clean":"2023-07-29T02:06:30.442599+0000","last_became_active":"2023-07-29T01:59:57.967603+0000","last_became_peered":"2023-07-29T01:59:57.967603+0000","last_unstale":"2023-07-29T02:06:30.442599+0000","last_undegraded":"2023-07-29T02:06:30.442599+0000","last_fullsized":"2023-07-29T02:06:30.442599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'101","last_scrub_stamp":"2023-07-29T02:06:30.442572+0000","last_deep_scrub":"39'101","last_deep_scrub_stamp":"2023-07-29T02:06:30.442572+0000","last_clean_scrub_stamp":"2023-07-29T02:06:30.442572+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:12:53.035580+0000","scrub_duration":0.001551853,"objects_trimmed":0,"snaptrim_duration":0.350807488,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"39'99","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.448035+0000","last_change":"2023-07-29T02:03:57.150968+0000","last_active":"2023-07-29T02:06:18.448035+0000","last_peered":"2023-07-29T02:06:18.448035+0000","last_clean":"2023-07-29T02:06:18.448035+0000","last_became_active":"2023-07-29T01:59:57.966672+0000","last_became_peered":"2023-07-29T01:59:57.966672+0000","last_unstale":"2023-07-29T02:06:18.448035+0000","last_undegraded":"2023-07-29T02:06:18.448035+0000","last_fullsized":"2023-07-29T02:06:18.448035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.39433596799999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"39'79","reported_seq":2131,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:22.677812+0000","last_change":"2023-07-29T02:03:57.048829+0000","last_active":"2023-07-29T02:06:22.677812+0000","last_peered":"2023-07-29T02:06:22.677812+0000","last_clean":"2023-07-29T02:06:22.677812+0000","last_became_active":"2023-07-29T01:59:57.968449+0000","last_became_peered":"2023-07-29T01:59:57.968449+0000","last_unstale":"2023-07-29T02:06:22.677812+0000","last_undegraded":"2023-07-29T02:06:22.677812+0000","last_fullsized":"2023-07-29T02:06:22.677812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.54020755499999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":918109411,"num_objects":10156,"num_object_clones":0,"num_object_copies":40624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10156,"num_whiteouts":0,"num_read":1251,"num_read_kb":366219,"num_write":20741,"num_write_kb":1040888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1801588736,"data_stored":1952841728,"data_compressed":122947712,"data_compressed_allocated":138481664,"data_compressed_original":289734656,"omap_allocated":0,"internal_metadata":0},"log_size":20769,"ondisk_log_size":20769,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5774,"ondisk_log_size":5774,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":235554869,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":309,"num_read_kb":151139,"num_write":3959,"num_write_kb":234398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":462801,"num_omap_keys":776,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99000320,"data_stored":471109738,"data_compressed":61217990,"data_compressed_allocated":77094912,"data_compressed_original":449265664,"omap_allocated":0,"internal_metadata":0},"log_size":4028,"ondisk_log_size":4028,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574934,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313140,"kb_used_data":223852,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94058700,"statfs":{"total":96636764160,"available":96316108800,"internally_reserved":0,"allocated":229224448,"data_stored":300310153,"data_compressed":25236479,"data_compressed_allocated":29581312,"data_compressed_original":100917248,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.56000000000000005,"15min":0.51300000000000001},"min":{"1min":0.26400000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.751,"5min":6.0650000000000004,"15min":6.0650000000000004},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.54900000000000004,"15min":0.51700000000000002},"min":{"1min":0.30199999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61599999999999999,"5min":3.988,"15min":3.988},"last":0.629}]},{"osd":1,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.66400000000000003,"15min":0.56200000000000006},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.70099999999999996,"5min":10.303000000000001,"15min":10.303000000000001},"last":0.375},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.79800000000000004,"15min":0.625},"min":{"1min":0.32900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.80100000000000005,"5min":19.527999999999999,"15min":19.527999999999999},"last":0.46500000000000002}]},{"osd":2,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.63400000000000001,"15min":0.59299999999999997},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70499999999999996,"5min":6.9720000000000004,"15min":6.9720000000000004},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.58399999999999996,"15min":0.56599999999999995},"min":{"1min":0.36299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63400000000000001,"5min":3.8260000000000001,"15min":3.8260000000000001},"last":0.55100000000000005}]},{"osd":3,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.56899999999999995,"15min":0.56299999999999994},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.72999999999999998,"5min":3.4319999999999999,"15min":3.4319999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.57799999999999996,"15min":0.60599999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.77700000000000002,"5min":1.22,"15min":1.22},"last":0.52900000000000003}]},{"osd":4,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47899999999999998,"15min":0.52700000000000002},"min":{"1min":0.32200000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.66100000000000003,"5min":1.454,"15min":1.454},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.51100000000000001,"15min":0.55900000000000005},"min":{"1min":0.30599999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.0249999999999999,"5min":1.244,"15min":1.244},"last":0.50800000000000001}]},{"osd":5,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.50900000000000001,"15min":0.55900000000000005},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70799999999999996,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.53400000000000003,"15min":0.57099999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.75800000000000001,"5min":3.621,"15min":3.621},"last":0.54100000000000004}]},{"osd":6,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.55600000000000005,"15min":0.60299999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.74399999999999999,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.58099999999999996,"15min":0.627},"min":{"1min":0.37,"5min":0.312,"15min":0.312},"max":{"1min":0.79600000000000004,"5min":3.488,"15min":3.488},"last":0.60599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574934,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304904,"kb_used_data":241856,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":94066936,"statfs":{"total":96636764160,"available":96324542464,"internally_reserved":0,"allocated":247660544,"data_stored":288753905,"data_compressed":18888304,"data_compressed_allocated":21577728,"data_compressed_original":62894080,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.57699999999999996,"15min":0.54000000000000004},"min":{"1min":0.33200000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.65300000000000002,"5min":7,"15min":7},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.627,"15min":0.56100000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.59399999999999997,"5min":6.4619999999999997,"15min":6.4619999999999997},"last":0.54000000000000004}]},{"osd":1,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.64700000000000002,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70199999999999996,"5min":12.462,"15min":12.462},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.626,"15min":0.58899999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.63900000000000001,"5min":6.4130000000000003,"15min":6.4130000000000003},"last":0.625}]},{"osd":2,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.629,"5min":1.367,"15min":1.367},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.60299999999999998,"15min":0.57499999999999996},"min":{"1min":0.39800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.65600000000000003,"5min":5.5330000000000004,"15min":5.5330000000000004},"last":0.56899999999999995}]},{"osd":3,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.65700000000000003,"15min":0.59899999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70799999999999996,"5min":6.4889999999999999,"15min":6.4889999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.64500000000000002,"15min":0.61499999999999999},"min":{"1min":0.40400000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.69599999999999995,"5min":6.8559999999999999,"15min":6.8559999999999999},"last":0.60299999999999998}]},{"osd":4,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.68600000000000005,"15min":0.58799999999999997},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68000000000000005,"5min":24.123999999999999,"15min":24.123999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.32700000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.70999999999999996,"5min":6.3710000000000004,"15min":6.3710000000000004},"last":0.39800000000000002}]},{"osd":5,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48499999999999999,"15min":0.53900000000000003},"min":{"1min":0.33900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68899999999999995,"5min":0.82999999999999996,"15min":1.1140000000000001},"last":0.376},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59499999999999997,"15min":0.58299999999999996},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73199999999999998,"5min":6.9669999999999996,"15min":6.9669999999999996},"last":0.42299999999999999}]},{"osd":7,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.34999999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73299999999999998,"5min":5.484,"15min":5.484},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59599999999999997,"15min":0.61699999999999999},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.71299999999999997,"5min":5.2300000000000004,"15min":5.2300000000000004},"last":0.55100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371476,"kb_used_data":268236,"kb_used_omap":0,"kb_used_meta":103232,"kb_avail":94000364,"statfs":{"total":96636764160,"available":96256372736,"internally_reserved":0,"allocated":274673664,"data_stored":329638528,"data_compressed":22318008,"data_compressed_allocated":25960448,"data_compressed_original":81154048,"omap_allocated":0,"internal_metadata":105709568},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.39000000000000001,"15min":0.51400000000000001},"min":{"1min":0.25,"5min":0.20799999999999999,"15min":0.20399999999999999},"max":{"1min":0.441,"5min":3.7989999999999999,"15min":7.1299999999999999},"last":0.248},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.38600000000000001,"15min":0.51000000000000001},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57099999999999995,"5min":0.94599999999999995,"15min":5.4779999999999998},"last":0.29999999999999999}]},{"osd":2,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.61299999999999999,"15min":0.88900000000000001},"min":{"1min":0.23300000000000001,"5min":0.214,"15min":0.20899999999999999},"max":{"1min":0.47799999999999998,"5min":22.483000000000001,"15min":22.483000000000001},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.44,"15min":0.67800000000000005},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56599999999999995,"5min":3.0619999999999998,"15min":11.028},"last":0.38800000000000001}]},{"osd":3,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46899999999999997,"15min":0.59999999999999998},"min":{"1min":0.33300000000000002,"5min":0.27000000000000002,"15min":0.26800000000000002},"max":{"1min":0.54200000000000004,"5min":2.9900000000000002,"15min":7.1699999999999999},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.41999999999999998,"15min":0.39600000000000002},"min":{"1min":0.28399999999999997,"5min":0.245,"15min":0.245},"max":{"1min":0.51500000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.41899999999999998}]},{"osd":4,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.70199999999999996,"15min":1.048},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.78500000000000003,"5min":5.7809999999999997,"15min":17.925000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.625,"15min":0.86699999999999999},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79800000000000004,"5min":3.0329999999999999,"15min":10.961},"last":0.435}]},{"osd":5,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.60599999999999998,"15min":0.71099999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79700000000000004,"5min":0.878,"15min":5.391},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.70699999999999996,"15min":1.0880000000000001},"min":{"1min":0.45100000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86399999999999999,"5min":5.8849999999999998,"15min":17.994},"last":0.50900000000000001}]},{"osd":6,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.629,"15min":0.73999999999999999},"min":{"1min":0.40100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80800000000000005,"5min":0.91300000000000003,"15min":5.452},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.72499999999999998,"15min":1.077},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82999999999999996,"5min":5.8540000000000001,"15min":17.963999999999999},"last":0.58099999999999996}]},{"osd":7,"last update":"Sat Jul 29 02:05:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.67400000000000004,"15min":0.89000000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.755,"5min":3.0880000000000001,"15min":10.994},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.67300000000000004,"15min":0.76300000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83499999999999996,"5min":2.9889999999999999,"15min":5.4249999999999998},"last":0.63100000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329076,"kb_used_data":239788,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94042764,"statfs":{"total":96636764160,"available":96299790336,"internally_reserved":0,"allocated":245542912,"data_stored":309139007,"data_compressed":23440797,"data_compressed_allocated":27287552,"data_compressed_original":91111424,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.77600000000000002,"15min":0.47799999999999998},"min":{"1min":0.20999999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.55500000000000005,"5min":39.070999999999998,"15min":39.070999999999998},"last":0.496},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.435,"15min":0.38900000000000001},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.439,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":0.52900000000000003}]},{"osd":2,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.54600000000000004,"15min":0.45200000000000001},"min":{"1min":0.311,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.58899999999999997,"5min":10.438000000000001,"15min":10.438000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.55900000000000005,"15min":0.45700000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51700000000000002,"5min":10.802,"15min":10.802},"last":0.63}]},{"osd":3,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.46500000000000002,"15min":0.39900000000000002},"min":{"1min":0.251,"5min":0.246,"15min":0.246},"max":{"1min":0.48699999999999999,"5min":4.6879999999999997,"15min":4.6879999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.50900000000000001,"15min":0.45300000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63600000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.67700000000000005}]},{"osd":4,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74099999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.67300000000000004,"15min":0.629},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.84599999999999997,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.71799999999999997}]},{"osd":5,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.374,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76900000000000002,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.63,"15min":0.624},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84999999999999998,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.69199999999999995}]},{"osd":6,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.68000000000000005,"15min":0.64700000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92200000000000004,"5min":1.663,"15min":1.663},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.40500000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.74099999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.81000000000000005}]},{"osd":7,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.67500000000000004,"15min":0.65000000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":1.496,"15min":1.496},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.67800000000000005,"15min":0.66100000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.874}]}]},{"osd":2,"up_from":13,"seq":55834574934,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":263964,"kb_used_data":200916,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":94107876,"statfs":{"total":96636764160,"available":96366465024,"internally_reserved":0,"allocated":205737984,"data_stored":235440369,"data_compressed":13107136,"data_compressed_allocated":15015936,"data_compressed_original":44941312,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.46300000000000002,"15min":0.39600000000000002},"min":{"1min":0.22800000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.53600000000000003,"5min":10.795999999999999,"15min":10.795999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.53700000000000003,"15min":0.66100000000000003},"min":{"1min":0.253,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.496,"5min":16.536999999999999,"15min":16.536999999999999},"last":0.38}]},{"osd":1,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44900000000000001,"15min":0.55700000000000005},"min":{"1min":0.28499999999999998,"5min":0.223,"15min":0.223},"max":{"1min":0.68400000000000005,"5min":5.2160000000000002,"15min":6.1040000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.47599999999999998,"15min":0.435},"min":{"1min":0.311,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.53900000000000003,"5min":7.4880000000000004,"15min":7.4880000000000004},"last":0.44900000000000001}]},{"osd":3,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.42699999999999999,"15min":0.40500000000000003},"min":{"1min":0.28599999999999998,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.53800000000000003,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.504,"15min":0.61399999999999999},"min":{"1min":0.31,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.60399999999999998,"5min":5.4240000000000004,"15min":6.0620000000000003},"last":0.42999999999999999}]},{"osd":4,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.63700000000000001,"15min":0.621},"min":{"1min":0.40999999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.71299999999999997,"5min":5.2919999999999998,"15min":5.2919999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.67100000000000004,"15min":0.65900000000000003},"min":{"1min":0.42199999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77200000000000002,"5min":6.3300000000000001,"15min":6.3300000000000001},"last":0.68400000000000005}]},{"osd":5,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.67700000000000005,"15min":0.65800000000000003},"min":{"1min":0.39200000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.77300000000000002,"5min":6.149,"15min":6.149},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.89300000000000002,"15min":0.92800000000000005},"min":{"1min":0.38100000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.77900000000000003,"5min":28.702000000000002,"15min":28.702000000000002},"last":0.66500000000000004}]},{"osd":6,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.65100000000000002,"15min":0.85799999999999998},"min":{"1min":0.40300000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.76400000000000001,"5min":4.5179999999999998,"15min":9.1199999999999992},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.67800000000000005,"15min":0.65800000000000003},"min":{"1min":0.442,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86899999999999999,"5min":5.2530000000000001,"15min":5.2530000000000001},"last":0.69899999999999995}]},{"osd":7,"last update":"Sat Jul 29 02:05:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.69399999999999995,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80100000000000005,"5min":6.2930000000000001,"15min":6.2930000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.67900000000000005,"15min":0.88500000000000001},"min":{"1min":0.433,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79400000000000004,"5min":4.4809999999999999,"15min":9.1620000000000008},"last":0.73999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574934,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":292752,"kb_used_data":203464,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94079088,"statfs":{"total":96636764160,"available":96336986112,"internally_reserved":0,"allocated":208347136,"data_stored":294471050,"data_compressed":26171949,"data_compressed_allocated":31100928,"data_compressed_original":117448704,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.36599999999999999,"15min":0.34100000000000003},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.57099999999999995,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35699999999999998,"15min":0.36599999999999999},"min":{"1min":0.24299999999999999,"5min":0.23200000000000001,"15min":0.22900000000000001},"max":{"1min":0.54100000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.41999999999999998}]},{"osd":1,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.44700000000000001,"15min":0.38600000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54000000000000004,"5min":9.7289999999999992,"15min":9.7289999999999992},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.47599999999999998,"15min":0.41399999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.21299999999999999},"max":{"1min":0.58199999999999996,"5min":7.4989999999999997,"15min":7.4989999999999997},"last":0.56799999999999995}]},{"osd":2,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40899999999999997,"15min":0.40699999999999997},"min":{"1min":0.28399999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.59999999999999998,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.45000000000000001,"15min":0.42599999999999999},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.68600000000000005,"5min":1.603,"15min":1.603},"last":0.621}]},{"osd":4,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.60999999999999999,"15min":0.61499999999999999},"min":{"1min":0.34399999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81699999999999995,"5min":0.95899999999999996,"15min":0.96599999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.68500000000000005,"15min":0.64000000000000001},"min":{"1min":0.375,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.74399999999999999,"5min":8.6869999999999994,"15min":8.6869999999999994},"last":0.53000000000000003}]},{"osd":5,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.58799999999999997,"15min":0.59299999999999997},"min":{"1min":0.34899999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67900000000000005,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.63400000000000001,"15min":0.60799999999999998},"min":{"1min":0.38,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88100000000000001,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.68100000000000005}]},{"osd":6,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.67800000000000005,"15min":0.64700000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81200000000000006,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.65100000000000002,"15min":0.65600000000000003},"min":{"1min":0.42399999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84799999999999998,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":0.55200000000000005}]},{"osd":7,"last update":"Sat Jul 29 02:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.70799999999999996,"15min":0.64400000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84899999999999998,"5min":8.7289999999999992,"15min":8.7289999999999992},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86499999999999999,"5min":1.0309999999999999,"15min":1.119},"last":0.58499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574933,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356212,"kb_used_data":252972,"kb_used_omap":0,"kb_used_meta":103232,"kb_avail":94015628,"statfs":{"total":96636764160,"available":96272003072,"internally_reserved":0,"allocated":259043328,"data_stored":357645888,"data_compressed":30659140,"data_compressed_allocated":36274176,"data_compressed_original":135118848,"omap_allocated":0,"internal_metadata":105709568},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.61099999999999999,"15min":0.54000000000000004},"min":{"1min":0.31900000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.68200000000000005,"5min":4.4800000000000004,"15min":4.4800000000000004},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.57299999999999995,"15min":0.84499999999999997},"min":{"1min":0.28399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.69499999999999995,"5min":7.2679999999999998,"15min":12.231999999999999},"last":0.60599999999999998}]},{"osd":1,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.55700000000000005,"15min":0.51500000000000001},"min":{"1min":0.29399999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.65100000000000002,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.54700000000000004,"15min":0.53100000000000003},"min":{"1min":0.27700000000000002,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66700000000000004,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.82699999999999996}]},{"osd":2,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.34200000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68400000000000005,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.35499999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.65900000000000003,"5min":0.874,"15min":0.874},"last":0.75}]},{"osd":3,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63200000000000001,"5min":3.9969999999999999,"15min":3.9969999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.96199999999999997,"15min":0.69199999999999995},"min":{"1min":0.40899999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67100000000000004,"5min":28.837,"15min":28.837},"last":0.55600000000000005}]},{"osd":5,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.48099999999999998,"15min":0.496},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.69499999999999995,"5min":1.8,"15min":1.8},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48699999999999999,"15min":0.501},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60199999999999998,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.69099999999999995}]},{"osd":6,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51800000000000002,"15min":0.50800000000000001},"min":{"1min":0.314,"5min":0.311,"15min":0.311},"max":{"1min":0.623,"5min":1.006,"15min":1.006},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54100000000000004,"15min":0.54900000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71999999999999997,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":1.018}]},{"osd":7,"last update":"Sat Jul 29 02:05:59 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.52600000000000002,"15min":0.53200000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64300000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57599999999999996},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67500000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.80600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574935,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313700,"kb_used_data":228508,"kb_used_omap":0,"kb_used_meta":85184,"kb_avail":94058140,"statfs":{"total":96636764160,"available":96315535360,"internally_reserved":0,"allocated":233992192,"data_stored":311454589,"data_compressed":24408749,"data_compressed_allocated":28868608,"data_compressed_original":106561536,"omap_allocated":0,"internal_metadata":87228416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54400000000000004,"15min":0.51400000000000001},"min":{"1min":0.23000000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.626,"15min":0.54200000000000004},"min":{"1min":0.29699999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":8.2590000000000003,"5min":8.2590000000000003,"15min":8.2590000000000003},"last":0.59599999999999997}]},{"osd":1,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.58099999999999996,"15min":0.51100000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.9179999999999999,"5min":5.9119999999999999,"15min":5.9119999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.58199999999999996,"15min":0.54800000000000004},"min":{"1min":0.32200000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":3.996,"5min":3.996,"15min":3.996},"last":0.749}]},{"osd":2,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.51500000000000001},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":2.8929999999999998},"last":0.625},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.70199999999999996,"15min":0.59999999999999998},"min":{"1min":0.33100000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":9.8360000000000003,"5min":9.8360000000000003,"15min":9.8360000000000003},"last":0.72199999999999998}]},{"osd":3,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.57899999999999996,"15min":0.55500000000000005},"min":{"1min":0.32100000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.83699999999999997,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.70099999999999996,"15min":0.60399999999999998},"min":{"1min":0.34300000000000003,"5min":0.314,"15min":0.314},"max":{"1min":8.1940000000000008,"5min":8.1940000000000008,"15min":8.1940000000000008},"last":0.73599999999999999}]},{"osd":4,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.49299999999999999,"15min":0.51300000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.498,"15min":0.53200000000000003},"min":{"1min":0.318,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.73299999999999998,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.49299999999999999}]},{"osd":6,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.51700000000000002,"15min":0.54100000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.55600000000000005},"min":{"1min":0.35499999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.45100000000000001}]},{"osd":7,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56899999999999995,"15min":0.58999999999999997},"min":{"1min":0.40699999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.437},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":0.55600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12668928,"data_stored":55102798,"data_compressed":7347975,"data_compressed_allocated":9121792,"data_compressed_original":51560448,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":7942144,"data_stored":42039151,"data_compressed":5187148,"data_compressed_allocated":6590464,"data_compressed_original":40689664,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":20971520,"data_compressed":2599703,"data_compressed_allocated":3166208,"data_compressed_original":19935232,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20307968,"data_stored":88080474,"data_compressed":11613220,"data_compressed_allocated":14581760,"data_compressed_original":82358272,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18018304,"data_stored":92947791,"data_compressed":11562285,"data_compressed_allocated":14680064,"data_compressed_original":89628672,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13971456,"data_stored":71303820,"data_compressed":9372464,"data_compressed_allocated":11796480,"data_compressed_original":69136384,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":33554432,"data_compressed":4791721,"data_compressed_allocated":5980160,"data_compressed_original":32194560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14548992,"data_stored":67109752,"data_compressed":8743474,"data_compressed_allocated":11177984,"data_compressed_original":63762432,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":232435712,"data_stored":253820928,"data_compressed":16092822,"data_compressed_allocated":18165760,"data_compressed_original":39550976,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":266227712,"data_stored":286793728,"data_compressed":17098430,"data_compressed_allocated":19324928,"data_compressed_original":39890944,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":201097216,"data_stored":214253568,"data_compressed":10507433,"data_compressed_allocated":11849728,"data_compressed_original":25006080,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":187604992,"data_stored":206176256,"data_compressed":14558729,"data_compressed_allocated":16519168,"data_compressed_original":35090432,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":240586752,"data_stored":264482816,"data_compressed":19096855,"data_compressed_allocated":21594112,"data_compressed_original":45490176,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":219582464,"data_stored":239935488,"data_compressed":15036285,"data_compressed_allocated":17072128,"data_compressed_original":37425152,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":239882240,"data_stored":254984192,"data_compressed":14096583,"data_compressed_allocated":15597568,"data_compressed_original":30699520,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":214171648,"data_stored":232394752,"data_compressed":16460575,"data_compressed_allocated":18358272,"data_compressed_original":36581376,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T02:06:46.654 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.655 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.655 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.656 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.656 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.657 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.658 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.658 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.659 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.659 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.660 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.660 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.661 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.662 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.662 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.663 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.663 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.664 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.664 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.665 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.666 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.666 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.667 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.668 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.668 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.669 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.669 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.669 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.670 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.670 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.670 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.671 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.671 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.671 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.672 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.672 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.673 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.673 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.674 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.675 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.675 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.676 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.677 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.678 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.678 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.679 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.679 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.680 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.681 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.681 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.682 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.682 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.683 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.683 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.684 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.684 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.684 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-07-29T01:59:56.517054+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=56, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.685 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.685 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.685 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.686 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.686 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.686 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.687 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.687 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.687 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.688 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.688 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.688 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:06:46.689 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-29T02:07:06.690 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T02:07:06.822 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.842+0000 7f14fa0ce700 1 Processor -- start 2023-07-29T02:07:06.823 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.842+0000 7f14fa0ce700 1 -- start start 2023-07-29T02:07:06.827 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.842+0000 7f14fa0ce700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f14f4153610 0x7f14f406b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:06.827 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.842+0000 7f14fa0ce700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f14f40c8040 0x7f14f4159be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:06.828 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.842+0000 7f14fa0ce700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f40722b0 con 0x7f14f4072740 2023-07-29T02:07:06.828 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.842+0000 7f14fa0ce700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f40c74d0 con 0x7f14f40c8040 2023-07-29T02:07:06.828 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.842+0000 7f14fa0ce700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f40c6f10 con 0x7f14f4153610 2023-07-29T02:07:06.828 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.843+0000 7f14f3fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f14f40c8040 0x7f14f4159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:06.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.843+0000 7f14f3fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f14f40c8040 0x7f14f4159be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58594/0 (socket says 172.21.15.42:58594) 2023-07-29T02:07:06.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.843+0000 7f14f3fff700 1 -- 172.21.15.42:0/2873605763 learned_addr learned my addr 172.21.15.42:0/2873605763 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:07:06.829 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.843+0000 7f14f37fe700 1 --2- 172.21.15.42:0/2873605763 >> v2:172.21.15.144:3300/0 conn(0x7f14f4153610 0x7f14f406b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:06.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.843+0000 7f14f3fff700 1 -- 172.21.15.42:0/2873605763 >> v2:172.21.15.144:3300/0 conn(0x7f14f4153610 msgr2=0x7f14f406b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:07:06.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.843+0000 7f14f3fff700 1 --2- 172.21.15.42:0/2873605763 >> v2:172.21.15.144:3300/0 conn(0x7f14f4153610 0x7f14f406b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:06.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.843+0000 7f14f3fff700 1 -- 172.21.15.42:0/2873605763 >> v1:172.21.15.144:6789/0 conn(0x7f14f4072740 legacy=0x7f14f41594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:07:06.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.843+0000 7f14f3fff700 1 -- 172.21.15.42:0/2873605763 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f40c71f0 con 0x7f14f40c8040 2023-07-29T02:07:06.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.843+0000 7f14f3fff700 1 --2- 172.21.15.42:0/2873605763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14f40c8040 0x7f14f4159be0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f14f4074700 tx=0x7f14ec00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21dec651c9e1ae19 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:06.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.843+0000 7f14f27fc700 1 -- 172.21.15.42:0/2873605763 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec010070 con 0x7f14f40c8040 2023-07-29T02:07:06.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.843+0000 7f14f27fc700 1 -- 172.21.15.42:0/2873605763 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ec00dd50 con 0x7f14f40c8040 2023-07-29T02:07:06.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.843+0000 7f14f27fc700 1 -- 172.21.15.42:0/2873605763 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec00b310 con 0x7f14f40c8040 2023-07-29T02:07:06.832 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.844+0000 7f14fa0ce700 1 -- 172.21.15.42:0/2873605763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14f40c8040 msgr2=0x7f14f4159be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:06.832 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.844+0000 7f14fa0ce700 1 --2- 172.21.15.42:0/2873605763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14f40c8040 0x7f14f4159be0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f14f4074700 tx=0x7f14ec00d430 comp rx=0 tx=0).stop 2023-07-29T02:07:06.832 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.844+0000 7f14fa0ce700 1 -- 172.21.15.42:0/2873605763 shutdown_connections 2023-07-29T02:07:06.833 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.844+0000 7f14fa0ce700 1 --2- 172.21.15.42:0/2873605763 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14f40c8040 0x7f14f4159be0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:06.833 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.844+0000 7f14fa0ce700 1 --2- 172.21.15.42:0/2873605763 >> v2:172.21.15.144:3300/0 conn(0x7f14f4153610 0x7f14f406b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:06.833 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.844+0000 7f14fa0ce700 1 -- 172.21.15.42:0/2873605763 >> 172.21.15.42:0/2873605763 conn(0x7f14f40c8970 msgr2=0x7f14f40c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:06.833 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.844+0000 7f14fa0ce700 1 -- 172.21.15.42:0/2873605763 shutdown_connections 2023-07-29T02:07:06.833 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.844+0000 7f14fa0ce700 1 -- 172.21.15.42:0/2873605763 wait complete. 2023-07-29T02:07:06.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.845+0000 7f14fa0ce700 1 Processor -- start 2023-07-29T02:07:06.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.845+0000 7f14fa0ce700 1 -- start start 2023-07-29T02:07:06.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.846+0000 7f14fa0ce700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14f4072740 0x7f14f414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:06.834 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.846+0000 7f14fa0ce700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14f40c8040 0x7f14f41dd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:06.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.846+0000 7f14fa0ce700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14f4153610 0x7f14f41ddcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:06.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.846+0000 7f14fa0ce700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f4152380 con 0x7f14f40c8040 2023-07-29T02:07:06.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.846+0000 7f14fa0ce700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f40c4b80 con 0x7f14f4153610 2023-07-29T02:07:06.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.846+0000 7f14fa0ce700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f4151e00 con 0x7f14f4072740 2023-07-29T02:07:06.835 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.846+0000 7f14f2ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14f40c8040 0x7f14f41dd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:06.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.846+0000 7f14f2ffd700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14f40c8040 0x7f14f41dd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58598/0 (socket says 172.21.15.42:58598) 2023-07-29T02:07:06.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.846+0000 7f14f2ffd700 1 -- 172.21.15.42:0/1840535379 learned_addr learned my addr 172.21.15.42:0/1840535379 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:07:06.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.846+0000 7f14f3fff700 1 --2- 172.21.15.42:0/1840535379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14f4153610 0x7f14f41ddcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:06.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.846+0000 7f14f37fe700 1 --2- 172.21.15.42:0/1840535379 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14f4072740 0x7f14f414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:06.836 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.846+0000 7f14f2ffd700 1 -- 172.21.15.42:0/1840535379 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14f4072740 msgr2=0x7f14f414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:06.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.846+0000 7f14f2ffd700 1 --2- 172.21.15.42:0/1840535379 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14f4072740 0x7f14f414ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:06.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.846+0000 7f14f2ffd700 1 -- 172.21.15.42:0/1840535379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14f4153610 msgr2=0x7f14f41ddcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:06.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.846+0000 7f14f2ffd700 1 --2- 172.21.15.42:0/1840535379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14f4153610 0x7f14f41ddcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:06.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.846+0000 7f14f2ffd700 1 -- 172.21.15.42:0/1840535379 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec00bd40 con 0x7f14f40c8040 2023-07-29T02:07:06.837 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.846+0000 7f14f2ffd700 1 --2- 172.21.15.42:0/1840535379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14f40c8040 0x7f14f41dd7b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f14e800b4a0 tx=0x7f14e800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:06.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.847+0000 7f14dbfff700 1 -- 172.21.15.42:0/1840535379 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e8011830 con 0x7f14f40c8040 2023-07-29T02:07:06.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.847+0000 7f14dbfff700 1 -- 172.21.15.42:0/1840535379 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e8011990 con 0x7f14f40c8040 2023-07-29T02:07:06.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.847+0000 7f14dbfff700 1 -- 172.21.15.42:0/1840535379 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e8011d40 con 0x7f14f40c8040 2023-07-29T02:07:06.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.847+0000 7f14fa0ce700 1 -- 172.21.15.42:0/1840535379 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f40c48a0 con 0x7f14f40c8040 2023-07-29T02:07:06.838 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.847+0000 7f14fa0ce700 1 -- 172.21.15.42:0/1840535379 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f41dd290 con 0x7f14f40c8040 2023-07-29T02:07:06.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.848+0000 7f14fa0ce700 1 -- 172.21.15.42:0/1840535379 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f40c79d0 con 0x7f14f40c8040 2023-07-29T02:07:06.840 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.848+0000 7f14dbfff700 1 -- 172.21.15.42:0/1840535379 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f14e801a400 con 0x7f14f40c8040 2023-07-29T02:07:06.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.849+0000 7f14dbfff700 1 --2- 172.21.15.42:0/1840535379 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f14e006a660 0x7f14e006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:06.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.849+0000 7f14dbfff700 1 -- 172.21.15.42:0/1840535379 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f14e8088a70 con 0x7f14f40c8040 2023-07-29T02:07:06.841 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.849+0000 7f14f37fe700 1 --2- 172.21.15.42:0/1840535379 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f14e006a660 0x7f14e006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:06.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.849+0000 7f14f37fe700 1 --2- 172.21.15.42:0/1840535379 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f14e006a660 0x7f14e006cb10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f14e4006fd0 tx=0x7f14e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:06.842 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:06.853+0000 7f14dbfff700 1 -- 172.21.15.42:0/1840535379 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f14e8053ae0 con 0x7f14f40c8040 2023-07-29T02:07:07.026 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:07.045+0000 7f14fa0ce700 1 -- 172.21.15.42:0/1840535379 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f14f4071f40 con 0x7f14e006a660 2023-07-29T02:07:07.037 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:07.057+0000 7f14dbfff700 1 -- 172.21.15.42:0/1840535379 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+398182 (secure 0 0 0) 0x7f14e4011750 con 0x7f14e006a660 2023-07-29T02:07:07.042 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:07:07.044 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:07.060+0000 7f14fa0ce700 1 -- 172.21.15.42:0/1840535379 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f14e006a660 msgr2=0x7f14e006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:07.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:07.060+0000 7f14fa0ce700 1 --2- 172.21.15.42:0/1840535379 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f14e006a660 0x7f14e006cb10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f14e4006fd0 tx=0x7f14e4008040 comp rx=0 tx=0).stop 2023-07-29T02:07:07.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:07.060+0000 7f14fa0ce700 1 -- 172.21.15.42:0/1840535379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14f40c8040 msgr2=0x7f14f41dd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:07.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:07.060+0000 7f14fa0ce700 1 --2- 172.21.15.42:0/1840535379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14f40c8040 0x7f14f41dd7b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f14e800b4a0 tx=0x7f14e800b7b0 comp rx=0 tx=0).stop 2023-07-29T02:07:07.045 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:07.060+0000 7f14fa0ce700 1 -- 172.21.15.42:0/1840535379 shutdown_connections 2023-07-29T02:07:07.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:07.060+0000 7f14fa0ce700 1 --2- 172.21.15.42:0/1840535379 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f14e006a660 0x7f14e006cb10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:07.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:07.060+0000 7f14fa0ce700 1 --2- 172.21.15.42:0/1840535379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f14f4153610 0x7f14f41ddcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:07.046 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:07.060+0000 7f14fa0ce700 1 --2- 172.21.15.42:0/1840535379 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f14f4072740 0x7f14f414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:07.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:07.060+0000 7f14fa0ce700 1 --2- 172.21.15.42:0/1840535379 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f14f40c8040 0x7f14f41dd7b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:07.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:07.060+0000 7f14fa0ce700 1 -- 172.21.15.42:0/1840535379 >> 172.21.15.42:0/1840535379 conn(0x7f14f40c8970 msgr2=0x7f14f406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:07.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:07.060+0000 7f14fa0ce700 1 -- 172.21.15.42:0/1840535379 shutdown_connections 2023-07-29T02:07:07.047 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:07.060+0000 7f14fa0ce700 1 -- 172.21.15.42:0/1840535379 wait complete. 2023-07-29T02:07:07.047 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2023-07-29T02:07:07.056 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":250,"stamp":"2023-07-29T02:07:05.353029+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1154429116,"num_objects":10301,"num_object_clones":0,"num_object_copies":40914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10301,"num_whiteouts":0,"num_read":1676,"num_read_kb":517458,"num_write":24879,"num_write_kb":1277880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":586841,"num_omap_keys":984,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30738,"ondisk_log_size":30738,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2549496,"kb_used_data":1859768,"kb_used_omap":0,"kb_used_meta":689664,"kb_avail":752425224,"statfs":{"total":773094113280,"available":770483429376,"internally_reserved":0,"allocated":1904402432,"data_stored":2427202425,"data_compressed":184258406,"data_compressed_allocated":215715840,"data_compressed_original":740368384,"omap_allocated":0,"internal_metadata":706215936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":75598,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":119040,"num_omap_keys":198,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003279"},"pg_stats":[{"pgid":"4.3f","version":"39'86","reported_seq":2149,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:36.889969+0000","last_change":"2023-07-29T02:06:36.890083+0000","last_active":"2023-07-29T02:06:36.889969+0000","last_peered":"2023-07-29T02:06:36.889969+0000","last_clean":"2023-07-29T02:06:36.889969+0000","last_became_active":"2023-07-29T01:59:57.957742+0000","last_became_peered":"2023-07-29T01:59:57.957742+0000","last_unstale":"2023-07-29T02:06:36.889969+0000","last_undegraded":"2023-07-29T02:06:36.889969+0000","last_fullsized":"2023-07-29T02:06:36.889969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'86","last_scrub_stamp":"2023-07-29T02:06:36.889932+0000","last_deep_scrub":"39'86","last_deep_scrub_stamp":"2023-07-29T02:06:36.889932+0000","last_clean_scrub_stamp":"2023-07-29T02:06:36.889932+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:56.860301+0000","scrub_duration":0.0015445599999999999,"objects_trimmed":0,"snaptrim_duration":0.46739399700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"39'75","reported_seq":2138,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:47.633090+0000","last_change":"2023-07-29T02:06:47.633222+0000","last_active":"2023-07-29T02:06:47.633090+0000","last_peered":"2023-07-29T02:06:47.633090+0000","last_clean":"2023-07-29T02:06:47.633090+0000","last_became_active":"2023-07-29T01:59:57.974338+0000","last_became_peered":"2023-07-29T01:59:57.974338+0000","last_unstale":"2023-07-29T02:06:47.633090+0000","last_undegraded":"2023-07-29T02:06:47.633090+0000","last_fullsized":"2023-07-29T02:06:47.633090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'75","last_scrub_stamp":"2023-07-29T02:06:47.633064+0000","last_deep_scrub":"39'75","last_deep_scrub_stamp":"2023-07-29T02:06:47.633064+0000","last_clean_scrub_stamp":"2023-07-29T02:06:47.633064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:33:21.494075+0000","scrub_duration":0.001874503,"objects_trimmed":0,"snaptrim_duration":0.30630966300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"39'90","reported_seq":2142,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.447905+0000","last_change":"2023-07-29T02:03:57.108039+0000","last_active":"2023-07-29T02:06:18.447905+0000","last_peered":"2023-07-29T02:06:18.447905+0000","last_clean":"2023-07-29T02:06:18.447905+0000","last_became_active":"2023-07-29T01:59:57.973406+0000","last_became_peered":"2023-07-29T01:59:57.973406+0000","last_unstale":"2023-07-29T02:06:18.447905+0000","last_undegraded":"2023-07-29T02:06:18.447905+0000","last_fullsized":"2023-07-29T02:06:18.447905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37359432399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"39'75","reported_seq":2138,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:43.061322+0000","last_change":"2023-07-29T02:06:43.061439+0000","last_active":"2023-07-29T02:06:43.061322+0000","last_peered":"2023-07-29T02:06:43.061322+0000","last_clean":"2023-07-29T02:06:43.061322+0000","last_became_active":"2023-07-29T01:59:57.964865+0000","last_became_peered":"2023-07-29T01:59:57.964865+0000","last_unstale":"2023-07-29T02:06:43.061322+0000","last_undegraded":"2023-07-29T02:06:43.061322+0000","last_fullsized":"2023-07-29T02:06:43.061322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'75","last_scrub_stamp":"2023-07-29T02:06:43.061294+0000","last_deep_scrub":"39'75","last_deep_scrub_stamp":"2023-07-29T02:06:43.061294+0000","last_clean_scrub_stamp":"2023-07-29T02:06:43.061294+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:05:34.515449+0000","scrub_duration":0.0020787169999999999,"objects_trimmed":0,"snaptrim_duration":0.22913951599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"39'102","reported_seq":2153,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.450814+0000","last_change":"2023-07-29T02:03:57.038137+0000","last_active":"2023-07-29T02:06:18.450814+0000","last_peered":"2023-07-29T02:06:18.450814+0000","last_clean":"2023-07-29T02:06:18.450814+0000","last_became_active":"2023-07-29T01:59:57.970733+0000","last_became_peered":"2023-07-29T01:59:57.970733+0000","last_unstale":"2023-07-29T02:06:18.450814+0000","last_undegraded":"2023-07-29T02:06:18.450814+0000","last_fullsized":"2023-07-29T02:06:18.450814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55358088100000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"39'92","reported_seq":2143,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.444391+0000","last_change":"2023-07-29T02:03:57.111935+0000","last_active":"2023-07-29T02:06:18.444391+0000","last_peered":"2023-07-29T02:06:18.444391+0000","last_clean":"2023-07-29T02:06:18.444391+0000","last_became_active":"2023-07-29T01:59:57.964993+0000","last_became_peered":"2023-07-29T01:59:57.964993+0000","last_unstale":"2023-07-29T02:06:18.444391+0000","last_undegraded":"2023-07-29T02:06:18.444391+0000","last_fullsized":"2023-07-29T02:06:18.444391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35033357399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"39'105","reported_seq":2167,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:51.524392+0000","last_change":"2023-07-29T02:06:51.524562+0000","last_active":"2023-07-29T02:06:51.524392+0000","last_peered":"2023-07-29T02:06:51.524392+0000","last_clean":"2023-07-29T02:06:51.524392+0000","last_became_active":"2023-07-29T01:59:57.970232+0000","last_became_peered":"2023-07-29T01:59:57.970232+0000","last_unstale":"2023-07-29T02:06:51.524392+0000","last_undegraded":"2023-07-29T02:06:51.524392+0000","last_fullsized":"2023-07-29T02:06:51.524392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'105","last_scrub_stamp":"2023-07-29T02:06:51.524349+0000","last_deep_scrub":"39'105","last_deep_scrub_stamp":"2023-07-29T02:06:51.524349+0000","last_clean_scrub_stamp":"2023-07-29T02:06:51.524349+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:11:34.256705+0000","scrub_duration":0.001901168,"objects_trimmed":0,"snaptrim_duration":0.18952802499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"39'74","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:49.596322+0000","last_change":"2023-07-29T02:06:49.596442+0000","last_active":"2023-07-29T02:06:49.596322+0000","last_peered":"2023-07-29T02:06:49.596322+0000","last_clean":"2023-07-29T02:06:49.596322+0000","last_became_active":"2023-07-29T01:59:57.962884+0000","last_became_peered":"2023-07-29T01:59:57.962884+0000","last_unstale":"2023-07-29T02:06:49.596322+0000","last_undegraded":"2023-07-29T02:06:49.596322+0000","last_fullsized":"2023-07-29T02:06:49.596322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'74","last_scrub_stamp":"2023-07-29T02:06:49.596297+0000","last_deep_scrub":"39'74","last_deep_scrub_stamp":"2023-07-29T02:06:49.596297+0000","last_clean_scrub_stamp":"2023-07-29T02:06:49.596297+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:53:32.226555+0000","scrub_duration":0.0014879120000000001,"objects_trimmed":0,"snaptrim_duration":0.30152641200000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"39'84","reported_seq":2146,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:47.264979+0000","last_change":"2023-07-29T02:06:47.265092+0000","last_active":"2023-07-29T02:06:47.264979+0000","last_peered":"2023-07-29T02:06:47.264979+0000","last_clean":"2023-07-29T02:06:47.264979+0000","last_became_active":"2023-07-29T01:59:57.971640+0000","last_became_peered":"2023-07-29T01:59:57.971640+0000","last_unstale":"2023-07-29T02:06:47.264979+0000","last_undegraded":"2023-07-29T02:06:47.264979+0000","last_fullsized":"2023-07-29T02:06:47.264979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'84","last_scrub_stamp":"2023-07-29T02:06:47.264932+0000","last_deep_scrub":"39'84","last_deep_scrub_stamp":"2023-07-29T02:06:47.264932+0000","last_clean_scrub_stamp":"2023-07-29T02:06:47.264932+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:53:29.895190+0000","scrub_duration":0.001323896,"objects_trimmed":0,"snaptrim_duration":0.54966345000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"39'98","reported_seq":2160,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:46.628255+0000","last_change":"2023-07-29T02:06:46.628373+0000","last_active":"2023-07-29T02:06:46.628255+0000","last_peered":"2023-07-29T02:06:46.628255+0000","last_clean":"2023-07-29T02:06:46.628255+0000","last_became_active":"2023-07-29T01:59:57.962799+0000","last_became_peered":"2023-07-29T01:59:57.962799+0000","last_unstale":"2023-07-29T02:06:46.628255+0000","last_undegraded":"2023-07-29T02:06:46.628255+0000","last_fullsized":"2023-07-29T02:06:46.628255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'98","last_scrub_stamp":"2023-07-29T02:06:46.628226+0000","last_deep_scrub":"39'98","last_deep_scrub_stamp":"2023-07-29T02:06:46.628226+0000","last_clean_scrub_stamp":"2023-07-29T02:06:46.628226+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:16:25.595487+0000","scrub_duration":0.001832855,"objects_trimmed":0,"snaptrim_duration":0.30635943199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"39'90","reported_seq":2152,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:37.449626+0000","last_change":"2023-07-29T02:06:37.449786+0000","last_active":"2023-07-29T02:06:37.449626+0000","last_peered":"2023-07-29T02:06:37.449626+0000","last_clean":"2023-07-29T02:06:37.449626+0000","last_became_active":"2023-07-29T01:59:57.969868+0000","last_became_peered":"2023-07-29T01:59:57.969868+0000","last_unstale":"2023-07-29T02:06:37.449626+0000","last_undegraded":"2023-07-29T02:06:37.449626+0000","last_fullsized":"2023-07-29T02:06:37.449626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'90","last_scrub_stamp":"2023-07-29T02:06:37.449587+0000","last_deep_scrub":"39'90","last_deep_scrub_stamp":"2023-07-29T02:06:37.449587+0000","last_clean_scrub_stamp":"2023-07-29T02:06:37.449587+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:11:20.181943+0000","scrub_duration":0.0020192080000000002,"objects_trimmed":0,"snaptrim_duration":0.37294171199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"39'76","reported_seq":2138,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.908831+0000","last_change":"2023-07-29T02:06:39.908940+0000","last_active":"2023-07-29T02:06:39.908831+0000","last_peered":"2023-07-29T02:06:39.908831+0000","last_clean":"2023-07-29T02:06:39.908831+0000","last_became_active":"2023-07-29T01:59:57.963902+0000","last_became_peered":"2023-07-29T01:59:57.963902+0000","last_unstale":"2023-07-29T02:06:39.908831+0000","last_undegraded":"2023-07-29T02:06:39.908831+0000","last_fullsized":"2023-07-29T02:06:39.908831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'76","last_scrub_stamp":"2023-07-29T02:06:39.908800+0000","last_deep_scrub":"39'76","last_deep_scrub_stamp":"2023-07-29T02:06:39.908800+0000","last_clean_scrub_stamp":"2023-07-29T02:06:39.908800+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:43.162709+0000","scrub_duration":0.0020822839999999998,"objects_trimmed":0,"snaptrim_duration":0.46909700500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"39'81","reported_seq":2143,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:25.869494+0000","last_change":"2023-07-29T02:06:25.869573+0000","last_active":"2023-07-29T02:06:25.869494+0000","last_peered":"2023-07-29T02:06:25.869494+0000","last_clean":"2023-07-29T02:06:25.869494+0000","last_became_active":"2023-07-29T01:59:57.963239+0000","last_became_peered":"2023-07-29T01:59:57.963239+0000","last_unstale":"2023-07-29T02:06:25.869494+0000","last_undegraded":"2023-07-29T02:06:25.869494+0000","last_fullsized":"2023-07-29T02:06:25.869494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'81","last_scrub_stamp":"2023-07-29T02:06:25.869472+0000","last_deep_scrub":"39'81","last_deep_scrub_stamp":"2023-07-29T02:06:25.869472+0000","last_clean_scrub_stamp":"2023-07-29T02:06:25.869472+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:01:16.574167+0000","scrub_duration":0.0015035739999999999,"objects_trimmed":0,"snaptrim_duration":0.46603159700000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"39'92","reported_seq":2155,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:51.568747+0000","last_change":"2023-07-29T02:06:51.568747+0000","last_active":"2023-07-29T02:06:51.568747+0000","last_peered":"2023-07-29T02:06:51.568747+0000","last_clean":"2023-07-29T02:06:51.568747+0000","last_became_active":"2023-07-29T01:59:57.960709+0000","last_became_peered":"2023-07-29T01:59:57.960709+0000","last_unstale":"2023-07-29T02:06:51.568747+0000","last_undegraded":"2023-07-29T02:06:51.568747+0000","last_fullsized":"2023-07-29T02:06:51.568747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'92","last_scrub_stamp":"2023-07-29T02:06:51.568595+0000","last_deep_scrub":"39'92","last_deep_scrub_stamp":"2023-07-29T02:06:51.568595+0000","last_clean_scrub_stamp":"2023-07-29T02:06:51.568595+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:29:56.648023+0000","scrub_duration":0.0019764689999999998,"objects_trimmed":0,"snaptrim_duration":0.30181124199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"39'85","reported_seq":2148,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:45.538248+0000","last_change":"2023-07-29T02:06:45.538248+0000","last_active":"2023-07-29T02:06:45.538248+0000","last_peered":"2023-07-29T02:06:45.538248+0000","last_clean":"2023-07-29T02:06:45.538248+0000","last_became_active":"2023-07-29T01:59:57.970263+0000","last_became_peered":"2023-07-29T01:59:57.970263+0000","last_unstale":"2023-07-29T02:06:45.538248+0000","last_undegraded":"2023-07-29T02:06:45.538248+0000","last_fullsized":"2023-07-29T02:06:45.538248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'85","last_scrub_stamp":"2023-07-29T02:06:45.538096+0000","last_deep_scrub":"39'85","last_deep_scrub_stamp":"2023-07-29T02:06:45.538096+0000","last_clean_scrub_stamp":"2023-07-29T02:06:45.538096+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:13:08.131105+0000","scrub_duration":0.0019771799999999998,"objects_trimmed":0,"snaptrim_duration":0.18892089500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"39'97","reported_seq":2160,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:25.491331+0000","last_change":"2023-07-29T02:06:25.491331+0000","last_active":"2023-07-29T02:06:25.491331+0000","last_peered":"2023-07-29T02:06:25.491331+0000","last_clean":"2023-07-29T02:06:25.491331+0000","last_became_active":"2023-07-29T01:59:57.964696+0000","last_became_peered":"2023-07-29T01:59:57.964696+0000","last_unstale":"2023-07-29T02:06:25.491331+0000","last_undegraded":"2023-07-29T02:06:25.491331+0000","last_fullsized":"2023-07-29T02:06:25.491331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'97","last_scrub_stamp":"2023-07-29T02:06:25.491173+0000","last_deep_scrub":"39'97","last_deep_scrub_stamp":"2023-07-29T02:06:25.491173+0000","last_clean_scrub_stamp":"2023-07-29T02:06:25.491173+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:48:25.389074+0000","scrub_duration":0.001642227,"objects_trimmed":0,"snaptrim_duration":0.32990576199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"39'94","reported_seq":2157,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:46.252234+0000","last_change":"2023-07-29T02:06:46.252234+0000","last_active":"2023-07-29T02:06:46.252234+0000","last_peered":"2023-07-29T02:06:46.252234+0000","last_clean":"2023-07-29T02:06:46.252234+0000","last_became_active":"2023-07-29T01:59:57.968885+0000","last_became_peered":"2023-07-29T01:59:57.968885+0000","last_unstale":"2023-07-29T02:06:46.252234+0000","last_undegraded":"2023-07-29T02:06:46.252234+0000","last_fullsized":"2023-07-29T02:06:46.252234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'94","last_scrub_stamp":"2023-07-29T02:06:46.252116+0000","last_deep_scrub":"39'94","last_deep_scrub_stamp":"2023-07-29T02:06:46.252116+0000","last_clean_scrub_stamp":"2023-07-29T02:06:46.252116+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:11:28.984472+0000","scrub_duration":0.0014621020000000001,"objects_trimmed":0,"snaptrim_duration":0.54488360899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"39'88","reported_seq":2140,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.229896+0000","last_change":"2023-07-29T02:03:57.081083+0000","last_active":"2023-07-29T02:06:24.229896+0000","last_peered":"2023-07-29T02:06:24.229896+0000","last_clean":"2023-07-29T02:06:24.229896+0000","last_became_active":"2023-07-29T01:59:57.962919+0000","last_became_peered":"2023-07-29T01:59:57.962919+0000","last_unstale":"2023-07-29T02:06:24.229896+0000","last_undegraded":"2023-07-29T02:06:24.229896+0000","last_fullsized":"2023-07-29T02:06:24.229896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36591080100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"39'85","reported_seq":2148,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:35.858539+0000","last_change":"2023-07-29T02:06:35.858539+0000","last_active":"2023-07-29T02:06:35.858539+0000","last_peered":"2023-07-29T02:06:35.858539+0000","last_clean":"2023-07-29T02:06:35.858539+0000","last_became_active":"2023-07-29T01:59:57.960111+0000","last_became_peered":"2023-07-29T01:59:57.960111+0000","last_unstale":"2023-07-29T02:06:35.858539+0000","last_undegraded":"2023-07-29T02:06:35.858539+0000","last_fullsized":"2023-07-29T02:06:35.858539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'85","last_scrub_stamp":"2023-07-29T02:06:35.858385+0000","last_deep_scrub":"39'85","last_deep_scrub_stamp":"2023-07-29T02:06:35.858385+0000","last_clean_scrub_stamp":"2023-07-29T02:06:35.858385+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:30.976536+0000","scrub_duration":0.0025554530000000001,"objects_trimmed":0,"snaptrim_duration":0.47199195399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"39'98","reported_seq":2161,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:27.503464+0000","last_change":"2023-07-29T02:06:27.503464+0000","last_active":"2023-07-29T02:06:27.503464+0000","last_peered":"2023-07-29T02:06:27.503464+0000","last_clean":"2023-07-29T02:06:27.503464+0000","last_became_active":"2023-07-29T01:59:57.961655+0000","last_became_peered":"2023-07-29T01:59:57.961655+0000","last_unstale":"2023-07-29T02:06:27.503464+0000","last_undegraded":"2023-07-29T02:06:27.503464+0000","last_fullsized":"2023-07-29T02:06:27.503464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'98","last_scrub_stamp":"2023-07-29T02:06:27.503321+0000","last_deep_scrub":"39'98","last_deep_scrub_stamp":"2023-07-29T02:06:27.503321+0000","last_clean_scrub_stamp":"2023-07-29T02:06:27.503321+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:20.644410+0000","scrub_duration":0.001657045,"objects_trimmed":0,"snaptrim_duration":0.36267924800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"39'89","reported_seq":2152,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:48.581789+0000","last_change":"2023-07-29T02:06:48.581910+0000","last_active":"2023-07-29T02:06:48.581789+0000","last_peered":"2023-07-29T02:06:48.581789+0000","last_clean":"2023-07-29T02:06:48.581789+0000","last_became_active":"2023-07-29T01:59:57.970757+0000","last_became_peered":"2023-07-29T01:59:57.970757+0000","last_unstale":"2023-07-29T02:06:48.581789+0000","last_undegraded":"2023-07-29T02:06:48.581789+0000","last_fullsized":"2023-07-29T02:06:48.581789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'89","last_scrub_stamp":"2023-07-29T02:06:48.581763+0000","last_deep_scrub":"39'89","last_deep_scrub_stamp":"2023-07-29T02:06:48.581763+0000","last_clean_scrub_stamp":"2023-07-29T02:06:48.581763+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:38.614685+0000","scrub_duration":0.0022151100000000002,"objects_trimmed":0,"snaptrim_duration":0.18738185399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"39'95","reported_seq":2158,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.272264+0000","last_change":"2023-07-29T02:06:41.272264+0000","last_active":"2023-07-29T02:06:41.272264+0000","last_peered":"2023-07-29T02:06:41.272264+0000","last_clean":"2023-07-29T02:06:41.272264+0000","last_became_active":"2023-07-29T01:59:57.974436+0000","last_became_peered":"2023-07-29T01:59:57.974436+0000","last_unstale":"2023-07-29T02:06:41.272264+0000","last_undegraded":"2023-07-29T02:06:41.272264+0000","last_fullsized":"2023-07-29T02:06:41.272264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'95","last_scrub_stamp":"2023-07-29T02:06:41.272136+0000","last_deep_scrub":"39'95","last_deep_scrub_stamp":"2023-07-29T02:06:41.272136+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.272136+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:31.305058+0000","scrub_duration":0.00149913,"objects_trimmed":0,"snaptrim_duration":0.54184882499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"39'92","reported_seq":2155,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:02.090750+0000","last_change":"2023-07-29T02:07:02.090865+0000","last_active":"2023-07-29T02:07:02.090750+0000","last_peered":"2023-07-29T02:07:02.090750+0000","last_clean":"2023-07-29T02:07:02.090750+0000","last_became_active":"2023-07-29T01:59:57.966987+0000","last_became_peered":"2023-07-29T01:59:57.966987+0000","last_unstale":"2023-07-29T02:07:02.090750+0000","last_undegraded":"2023-07-29T02:07:02.090750+0000","last_fullsized":"2023-07-29T02:07:02.090750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'92","last_scrub_stamp":"2023-07-29T02:07:02.090716+0000","last_deep_scrub":"39'92","last_deep_scrub_stamp":"2023-07-29T02:07:02.090716+0000","last_clean_scrub_stamp":"2023-07-29T02:07:02.090716+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:42:14.967178+0000","scrub_duration":0.001745199,"objects_trimmed":0,"snaptrim_duration":0.38162062000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"39'92","reported_seq":2155,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:49.594095+0000","last_change":"2023-07-29T02:06:49.594218+0000","last_active":"2023-07-29T02:06:49.594095+0000","last_peered":"2023-07-29T02:06:49.594095+0000","last_clean":"2023-07-29T02:06:49.594095+0000","last_became_active":"2023-07-29T01:59:57.971733+0000","last_became_peered":"2023-07-29T01:59:57.971733+0000","last_unstale":"2023-07-29T02:06:49.594095+0000","last_undegraded":"2023-07-29T02:06:49.594095+0000","last_fullsized":"2023-07-29T02:06:49.594095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'92","last_scrub_stamp":"2023-07-29T02:06:49.594065+0000","last_deep_scrub":"39'92","last_deep_scrub_stamp":"2023-07-29T02:06:49.594065+0000","last_clean_scrub_stamp":"2023-07-29T02:06:49.594065+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:16:28.561327+0000","scrub_duration":0.0021722790000000001,"objects_trimmed":0,"snaptrim_duration":0.189164111,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"39'83","reported_seq":2146,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:48.389699+0000","last_change":"2023-07-29T02:06:48.389813+0000","last_active":"2023-07-29T02:06:48.389699+0000","last_peered":"2023-07-29T02:06:48.389699+0000","last_clean":"2023-07-29T02:06:48.389699+0000","last_became_active":"2023-07-29T01:59:57.969742+0000","last_became_peered":"2023-07-29T01:59:57.969742+0000","last_unstale":"2023-07-29T02:06:48.389699+0000","last_undegraded":"2023-07-29T02:06:48.389699+0000","last_fullsized":"2023-07-29T02:06:48.389699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'83","last_scrub_stamp":"2023-07-29T02:06:48.389675+0000","last_deep_scrub":"39'83","last_deep_scrub_stamp":"2023-07-29T02:06:48.389675+0000","last_clean_scrub_stamp":"2023-07-29T02:06:48.389675+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:38.422597+0000","scrub_duration":0.0019922020000000002,"objects_trimmed":0,"snaptrim_duration":0.53981922100000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"39'109","reported_seq":2172,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:49.410502+0000","last_change":"2023-07-29T02:06:49.410631+0000","last_active":"2023-07-29T02:06:49.410502+0000","last_peered":"2023-07-29T02:06:49.410502+0000","last_clean":"2023-07-29T02:06:49.410502+0000","last_became_active":"2023-07-29T01:59:57.969409+0000","last_became_peered":"2023-07-29T01:59:57.969409+0000","last_unstale":"2023-07-29T02:06:49.410502+0000","last_undegraded":"2023-07-29T02:06:49.410502+0000","last_fullsized":"2023-07-29T02:06:49.410502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'109","last_scrub_stamp":"2023-07-29T02:06:49.410474+0000","last_deep_scrub":"39'109","last_deep_scrub_stamp":"2023-07-29T02:06:49.410474+0000","last_clean_scrub_stamp":"2023-07-29T02:06:49.410474+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:16:28.377736+0000","scrub_duration":0.0015257249999999999,"objects_trimmed":0,"snaptrim_duration":0.53315132300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"39'74","reported_seq":2137,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:30.637361+0000","last_change":"2023-07-29T02:06:30.637467+0000","last_active":"2023-07-29T02:06:30.637361+0000","last_peered":"2023-07-29T02:06:30.637361+0000","last_clean":"2023-07-29T02:06:30.637361+0000","last_became_active":"2023-07-29T01:59:57.963774+0000","last_became_peered":"2023-07-29T01:59:57.963774+0000","last_unstale":"2023-07-29T02:06:30.637361+0000","last_undegraded":"2023-07-29T02:06:30.637361+0000","last_fullsized":"2023-07-29T02:06:30.637361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'74","last_scrub_stamp":"2023-07-29T02:06:30.637332+0000","last_deep_scrub":"39'74","last_deep_scrub_stamp":"2023-07-29T02:06:30.637332+0000","last_clean_scrub_stamp":"2023-07-29T02:06:30.637332+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:25.755483+0000","scrub_duration":0.0015544249999999999,"objects_trimmed":0,"snaptrim_duration":0.30426659299999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"39'632","reported_seq":2712,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.903567+0000","last_change":"2023-07-29T02:03:57.112265+0000","last_active":"2023-07-29T02:06:07.903567+0000","last_peered":"2023-07-29T02:06:07.903567+0000","last_clean":"2023-07-29T02:06:07.903567+0000","last_became_active":"2023-07-29T02:00:01.993731+0000","last_became_peered":"2023-07-29T02:00:01.993731+0000","last_unstale":"2023-07-29T02:06:07.903567+0000","last_undegraded":"2023-07-29T02:06:07.903567+0000","last_fullsized":"2023-07-29T02:06:07.903567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35725884499999999,"stat_sum":{"num_bytes":48336376,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":31,"num_read_kb":16407,"num_write":630,"num_write_kb":51633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"39'188","reported_seq":234,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:58.531596+0000","last_change":"2023-07-29T02:06:58.531745+0000","last_active":"2023-07-29T02:06:58.531596+0000","last_peered":"2023-07-29T02:06:58.531596+0000","last_clean":"2023-07-29T02:06:58.531596+0000","last_became_active":"2023-07-29T01:59:57.552673+0000","last_became_peered":"2023-07-29T01:59:57.552673+0000","last_unstale":"2023-07-29T02:06:58.531596+0000","last_undegraded":"2023-07-29T02:06:58.531596+0000","last_fullsized":"2023-07-29T02:06:58.531596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'188","last_scrub_stamp":"2023-07-29T02:06:58.531553+0000","last_deep_scrub":"39'188","last_deep_scrub_stamp":"2023-07-29T02:06:58.531553+0000","last_clean_scrub_stamp":"2023-07-29T02:06:58.531553+0000","objects_scrubbed":8,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:42:11.408015+0000","scrub_duration":0.031327384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17047795,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":179,"num_write_kb":16772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30712,"num_omap_keys":51,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"39'90","reported_seq":2152,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:45.022174+0000","last_change":"2023-07-29T02:06:45.022292+0000","last_active":"2023-07-29T02:06:45.022174+0000","last_peered":"2023-07-29T02:06:45.022174+0000","last_clean":"2023-07-29T02:06:45.022174+0000","last_became_active":"2023-07-29T01:59:57.969821+0000","last_became_peered":"2023-07-29T01:59:57.969821+0000","last_unstale":"2023-07-29T02:06:45.022174+0000","last_undegraded":"2023-07-29T02:06:45.022174+0000","last_fullsized":"2023-07-29T02:06:45.022174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'90","last_scrub_stamp":"2023-07-29T02:06:45.022147+0000","last_deep_scrub":"39'90","last_deep_scrub_stamp":"2023-07-29T02:06:45.022147+0000","last_clean_scrub_stamp":"2023-07-29T02:06:45.022147+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:06:42.106944+0000","scrub_duration":0.0015979880000000001,"objects_trimmed":0,"snaptrim_duration":0.40087768200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'629","reported_seq":2755,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:57.244950+0000","last_change":"2023-07-29T02:06:57.245067+0000","last_active":"2023-07-29T02:06:57.244950+0000","last_peered":"2023-07-29T02:06:57.244950+0000","last_clean":"2023-07-29T02:06:57.244950+0000","last_became_active":"2023-07-29T02:00:01.992338+0000","last_became_peered":"2023-07-29T02:00:01.992338+0000","last_unstale":"2023-07-29T02:06:57.244950+0000","last_undegraded":"2023-07-29T02:06:57.244950+0000","last_fullsized":"2023-07-29T02:06:57.244950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'629","last_scrub_stamp":"2023-07-29T02:06:57.244926+0000","last_deep_scrub":"39'629","last_deep_scrub_stamp":"2023-07-29T02:06:57.244926+0000","last_clean_scrub_stamp":"2023-07-29T02:06:57.244926+0000","objects_scrubbed":308,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:33:31.105937+0000","scrub_duration":0.13632612799999999,"objects_trimmed":0,"snaptrim_duration":0.20956234600000001,"stat_sum":{"num_bytes":44446331,"num_objects":308,"num_object_clones":0,"num_object_copies":1232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":308,"num_whiteouts":0,"num_read":41,"num_read_kb":16418,"num_write":629,"num_write_kb":43687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"39'22","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:27.140131+0000","last_change":"2023-07-29T02:06:27.140252+0000","last_active":"2023-07-29T02:06:27.140131+0000","last_peered":"2023-07-29T02:06:27.140131+0000","last_clean":"2023-07-29T02:06:27.140131+0000","last_became_active":"2023-07-29T01:59:57.547455+0000","last_became_peered":"2023-07-29T01:59:57.547455+0000","last_unstale":"2023-07-29T02:06:27.140131+0000","last_undegraded":"2023-07-29T02:06:27.140131+0000","last_fullsized":"2023-07-29T02:06:27.140131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'22","last_scrub_stamp":"2023-07-29T02:06:27.140101+0000","last_deep_scrub":"39'22","last_deep_scrub_stamp":"2023-07-29T02:06:27.140101+0000","last_clean_scrub_stamp":"2023-07-29T02:06:27.140101+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:40.716498+0000","scrub_duration":0.0090765410000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":4125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16912,"num_omap_keys":28,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"39'92","reported_seq":2155,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:02.188486+0000","last_change":"2023-07-29T02:07:02.188588+0000","last_active":"2023-07-29T02:07:02.188486+0000","last_peered":"2023-07-29T02:07:02.188486+0000","last_clean":"2023-07-29T02:07:02.188486+0000","last_became_active":"2023-07-29T01:59:57.964393+0000","last_became_peered":"2023-07-29T01:59:57.964393+0000","last_unstale":"2023-07-29T02:07:02.188486+0000","last_undegraded":"2023-07-29T02:07:02.188486+0000","last_fullsized":"2023-07-29T02:07:02.188486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'92","last_scrub_stamp":"2023-07-29T02:07:02.188459+0000","last_deep_scrub":"39'92","last_deep_scrub_stamp":"2023-07-29T02:07:02.188459+0000","last_clean_scrub_stamp":"2023-07-29T02:07:02.188459+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:37:00.928554+0000","scrub_duration":0.0018349029999999999,"objects_trimmed":0,"snaptrim_duration":0.55267013499999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"39'624","reported_seq":2706,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.294650+0000","last_change":"2023-07-29T02:03:57.037730+0000","last_active":"2023-07-29T02:06:07.294650+0000","last_peered":"2023-07-29T02:06:07.294650+0000","last_clean":"2023-07-29T02:06:07.294650+0000","last_became_active":"2023-07-29T02:00:01.982042+0000","last_became_peered":"2023-07-29T02:00:01.982042+0000","last_unstale":"2023-07-29T02:06:07.294650+0000","last_undegraded":"2023-07-29T02:06:07.294650+0000","last_fullsized":"2023-07-29T02:06:07.294650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55323541600000004,"stat_sum":{"num_bytes":17887936,"num_objects":308,"num_object_clones":0,"num_object_copies":1232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":308,"num_whiteouts":0,"num_read":32,"num_read_kb":5104,"num_write":624,"num_write_kb":17797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"39'219","reported_seq":264,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:40.995519+0000","last_change":"2023-07-29T02:06:40.995666+0000","last_active":"2023-07-29T02:06:40.995519+0000","last_peered":"2023-07-29T02:06:40.995519+0000","last_clean":"2023-07-29T02:06:40.995519+0000","last_became_active":"2023-07-29T01:59:57.533523+0000","last_became_peered":"2023-07-29T01:59:57.533523+0000","last_unstale":"2023-07-29T02:06:40.995519+0000","last_undegraded":"2023-07-29T02:06:40.995519+0000","last_fullsized":"2023-07-29T02:06:40.995519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'219","last_scrub_stamp":"2023-07-29T02:06:40.995491+0000","last_deep_scrub":"39'219","last_deep_scrub_stamp":"2023-07-29T02:06:40.995491+0000","last_clean_scrub_stamp":"2023-07-29T02:06:40.995491+0000","objects_scrubbed":8,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:16:19.962753+0000","scrub_duration":0.031869078000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":210,"num_write_kb":16504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31952,"num_omap_keys":53,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"39'88","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:53.076715+0000","last_change":"2023-07-29T02:06:53.076831+0000","last_active":"2023-07-29T02:06:53.076715+0000","last_peered":"2023-07-29T02:06:53.076715+0000","last_clean":"2023-07-29T02:06:53.076715+0000","last_became_active":"2023-07-29T01:59:57.963466+0000","last_became_peered":"2023-07-29T01:59:57.963466+0000","last_unstale":"2023-07-29T02:06:53.076715+0000","last_undegraded":"2023-07-29T02:06:53.076715+0000","last_fullsized":"2023-07-29T02:06:53.076715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'88","last_scrub_stamp":"2023-07-29T02:06:53.076686+0000","last_deep_scrub":"39'88","last_deep_scrub_stamp":"2023-07-29T02:06:53.076686+0000","last_clean_scrub_stamp":"2023-07-29T02:06:53.076686+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:13:15.669694+0000","scrub_duration":0.0015148620000000001,"objects_trimmed":0,"snaptrim_duration":0.209911193,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"39'697","reported_seq":2825,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:56.220583+0000","last_change":"2023-07-29T02:06:56.220583+0000","last_active":"2023-07-29T02:06:56.220583+0000","last_peered":"2023-07-29T02:06:56.220583+0000","last_clean":"2023-07-29T02:06:56.220583+0000","last_became_active":"2023-07-29T02:00:01.984000+0000","last_became_peered":"2023-07-29T02:00:01.984000+0000","last_unstale":"2023-07-29T02:06:56.220583+0000","last_undegraded":"2023-07-29T02:06:56.220583+0000","last_fullsized":"2023-07-29T02:06:56.220583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'697","last_scrub_stamp":"2023-07-29T02:06:56.220417+0000","last_deep_scrub":"39'697","last_deep_scrub_stamp":"2023-07-29T02:06:56.220417+0000","last_clean_scrub_stamp":"2023-07-29T02:06:56.220417+0000","objects_scrubbed":367,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:16:35.187678+0000","scrub_duration":0.14049162900000001,"objects_trimmed":0,"snaptrim_duration":0.218444052,"stat_sum":{"num_bytes":33480822,"num_objects":367,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":39,"num_read_kb":11040,"num_write":700,"num_write_kb":41165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"39'4","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:35.267068+0000","last_change":"2023-07-29T02:06:35.267179+0000","last_active":"2023-07-29T02:06:35.267068+0000","last_peered":"2023-07-29T02:06:35.267068+0000","last_clean":"2023-07-29T02:06:35.267068+0000","last_became_active":"2023-07-29T01:59:57.536732+0000","last_became_peered":"2023-07-29T01:59:57.536732+0000","last_unstale":"2023-07-29T02:06:35.267068+0000","last_undegraded":"2023-07-29T02:06:35.267068+0000","last_fullsized":"2023-07-29T02:06:35.267068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2023-07-29T02:06:35.267044+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2023-07-29T02:06:35.267044+0000","last_clean_scrub_stamp":"2023-07-29T02:06:35.267044+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:32.781960+0000","scrub_duration":0.0035102390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11476,"num_omap_keys":19,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"39'88","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:25.880739+0000","last_change":"2023-07-29T02:06:25.880739+0000","last_active":"2023-07-29T02:06:25.880739+0000","last_peered":"2023-07-29T02:06:25.880739+0000","last_clean":"2023-07-29T02:06:25.880739+0000","last_became_active":"2023-07-29T01:59:57.970902+0000","last_became_peered":"2023-07-29T01:59:57.970902+0000","last_unstale":"2023-07-29T02:06:25.880739+0000","last_undegraded":"2023-07-29T02:06:25.880739+0000","last_fullsized":"2023-07-29T02:06:25.880739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'88","last_scrub_stamp":"2023-07-29T02:06:25.880641+0000","last_deep_scrub":"39'88","last_deep_scrub_stamp":"2023-07-29T02:06:25.880641+0000","last_clean_scrub_stamp":"2023-07-29T02:06:25.880641+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:45.851009+0000","scrub_duration":0.0013327549999999999,"objects_trimmed":0,"snaptrim_duration":0.3723399,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'665","reported_seq":2787,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:54.736294+0000","last_change":"2023-07-29T02:06:54.736294+0000","last_active":"2023-07-29T02:06:54.736294+0000","last_peered":"2023-07-29T02:06:54.736294+0000","last_clean":"2023-07-29T02:06:54.736294+0000","last_became_active":"2023-07-29T02:00:01.989456+0000","last_became_peered":"2023-07-29T02:00:01.989456+0000","last_unstale":"2023-07-29T02:06:54.736294+0000","last_undegraded":"2023-07-29T02:06:54.736294+0000","last_fullsized":"2023-07-29T02:06:54.736294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'665","last_scrub_stamp":"2023-07-29T02:06:54.736108+0000","last_deep_scrub":"39'665","last_deep_scrub_stamp":"2023-07-29T02:06:54.736108+0000","last_clean_scrub_stamp":"2023-07-29T02:06:54.736108+0000","objects_scrubbed":318,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:29:59.815537+0000","scrub_duration":0.14528770899999999,"objects_trimmed":0,"snaptrim_duration":0.189839176,"stat_sum":{"num_bytes":37359948,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":38,"num_read_kb":16417,"num_write":659,"num_write_kb":40721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"39'108","reported_seq":152,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:40.695129+0000","last_change":"2023-07-29T02:06:40.695251+0000","last_active":"2023-07-29T02:06:40.695129+0000","last_peered":"2023-07-29T02:06:40.695129+0000","last_clean":"2023-07-29T02:06:40.695129+0000","last_became_active":"2023-07-29T01:59:57.540113+0000","last_became_peered":"2023-07-29T01:59:57.540113+0000","last_unstale":"2023-07-29T02:06:40.695129+0000","last_undegraded":"2023-07-29T02:06:40.695129+0000","last_fullsized":"2023-07-29T02:06:40.695129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'108","last_scrub_stamp":"2023-07-29T02:06:40.695102+0000","last_deep_scrub":"39'108","last_deep_scrub_stamp":"2023-07-29T02:06:40.695102+0000","last_clean_scrub_stamp":"2023-07-29T02:06:40.695102+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:33.836191+0000","scrub_duration":0.036052965999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":100,"num_write_kb":16445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17522,"num_omap_keys":30,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"39'91","reported_seq":2144,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:44.009570+0000","last_change":"2023-07-29T02:06:59.469842+0000","last_active":"2023-07-29T02:06:44.009570+0000","last_peered":"2023-07-29T02:06:44.009570+0000","last_clean":"2023-07-29T02:06:44.009570+0000","last_became_active":"2023-07-29T01:59:57.967083+0000","last_became_peered":"2023-07-29T01:59:57.967083+0000","last_unstale":"2023-07-29T02:06:44.009570+0000","last_undegraded":"2023-07-29T02:06:44.009570+0000","last_fullsized":"2023-07-29T02:06:44.009570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38037237200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"39'632","reported_seq":2726,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:23.710619+0000","last_change":"2023-07-29T02:03:57.161825+0000","last_active":"2023-07-29T02:06:23.710619+0000","last_peered":"2023-07-29T02:06:23.710619+0000","last_clean":"2023-07-29T02:06:23.710619+0000","last_became_active":"2023-07-29T02:00:01.996035+0000","last_became_peered":"2023-07-29T02:00:01.996035+0000","last_unstale":"2023-07-29T02:06:23.710619+0000","last_undegraded":"2023-07-29T02:06:23.710619+0000","last_fullsized":"2023-07-29T02:06:23.710619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.39874443399999998,"stat_sum":{"num_bytes":20875244,"num_objects":313,"num_object_clones":0,"num_object_copies":1252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":44,"num_read_kb":4139,"num_write":632,"num_write_kb":28878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"39'697","reported_seq":749,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:34.641374+0000","last_change":"2023-07-29T02:06:27.569347+0000","last_active":"2023-07-29T02:06:34.641374+0000","last_peered":"2023-07-29T02:06:34.641374+0000","last_clean":"2023-07-29T02:06:34.641374+0000","last_became_active":"2023-07-29T01:59:57.547803+0000","last_became_peered":"2023-07-29T01:59:57.547803+0000","last_unstale":"2023-07-29T02:06:34.641374+0000","last_undegraded":"2023-07-29T02:06:34.641374+0000","last_fullsized":"2023-07-29T02:06:34.641374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'621","last_scrub_stamp":"2023-07-29T02:06:27.569221+0000","last_deep_scrub":"39'621","last_deep_scrub_stamp":"2023-07-29T02:06:27.569221+0000","last_clean_scrub_stamp":"2023-07-29T02:06:27.569221+0000","objects_scrubbed":5,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:59:25.186236+0000","scrub_duration":0.02490562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583002,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":4114,"num_write":693,"num_write_kb":12634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"39'85","reported_seq":2148,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:43.393307+0000","last_change":"2023-07-29T02:06:43.393307+0000","last_active":"2023-07-29T02:06:43.393307+0000","last_peered":"2023-07-29T02:06:43.393307+0000","last_clean":"2023-07-29T02:06:43.393307+0000","last_became_active":"2023-07-29T01:59:57.969006+0000","last_became_peered":"2023-07-29T01:59:57.969006+0000","last_unstale":"2023-07-29T02:06:43.393307+0000","last_undegraded":"2023-07-29T02:06:43.393307+0000","last_fullsized":"2023-07-29T02:06:43.393307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'85","last_scrub_stamp":"2023-07-29T02:06:43.393180+0000","last_deep_scrub":"39'85","last_deep_scrub_stamp":"2023-07-29T02:06:43.393180+0000","last_clean_scrub_stamp":"2023-07-29T02:06:43.393180+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:36.534269+0000","scrub_duration":0.0019770159999999998,"objects_trimmed":0,"snaptrim_duration":0.53746501300000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"39'641","reported_seq":2771,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:54.571591+0000","last_change":"2023-07-29T02:06:54.571591+0000","last_active":"2023-07-29T02:06:54.571591+0000","last_peered":"2023-07-29T02:06:54.571591+0000","last_clean":"2023-07-29T02:06:54.571591+0000","last_became_active":"2023-07-29T02:00:01.995757+0000","last_became_peered":"2023-07-29T02:00:01.995757+0000","last_unstale":"2023-07-29T02:06:54.571591+0000","last_undegraded":"2023-07-29T02:06:54.571591+0000","last_fullsized":"2023-07-29T02:06:54.571591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'641","last_scrub_stamp":"2023-07-29T02:06:54.571428+0000","last_deep_scrub":"39'641","last_deep_scrub_stamp":"2023-07-29T02:06:54.571428+0000","last_clean_scrub_stamp":"2023-07-29T02:06:54.571428+0000","objects_scrubbed":314,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:29:59.650857+0000","scrub_duration":0.117718709,"objects_trimmed":0,"snaptrim_duration":0.539926876,"stat_sum":{"num_bytes":20101741,"num_objects":314,"num_object_clones":0,"num_object_copies":1256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":45,"num_read_kb":20517,"num_write":638,"num_write_kb":32247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"39'133","reported_seq":195,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:59.507595+0000","last_change":"2023-07-29T02:06:59.507702+0000","last_active":"2023-07-29T02:06:59.507595+0000","last_peered":"2023-07-29T02:06:59.507595+0000","last_clean":"2023-07-29T02:06:59.507595+0000","last_became_active":"2023-07-29T01:59:57.541434+0000","last_became_peered":"2023-07-29T01:59:57.541434+0000","last_unstale":"2023-07-29T02:06:59.507595+0000","last_undegraded":"2023-07-29T02:06:59.507595+0000","last_fullsized":"2023-07-29T02:06:59.507595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'133","last_scrub_stamp":"2023-07-29T02:06:59.507567+0000","last_deep_scrub":"39'133","last_deep_scrub_stamp":"2023-07-29T02:06:59.507567+0000","last_clean_scrub_stamp":"2023-07-29T02:06:59.507567+0000","objects_scrubbed":6,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:06:17.216400+0000","scrub_duration":0.025791858000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":12324,"num_write":121,"num_write_kb":12360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"39'101","reported_seq":2164,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:38.483478+0000","last_change":"2023-07-29T02:06:38.483478+0000","last_active":"2023-07-29T02:06:38.483478+0000","last_peered":"2023-07-29T02:06:38.483478+0000","last_clean":"2023-07-29T02:06:38.483478+0000","last_became_active":"2023-07-29T01:59:57.962459+0000","last_became_peered":"2023-07-29T01:59:57.962459+0000","last_unstale":"2023-07-29T02:06:38.483478+0000","last_undegraded":"2023-07-29T02:06:38.483478+0000","last_fullsized":"2023-07-29T02:06:38.483478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'101","last_scrub_stamp":"2023-07-29T02:06:38.483341+0000","last_deep_scrub":"39'101","last_deep_scrub_stamp":"2023-07-29T02:06:38.483341+0000","last_clean_scrub_stamp":"2023-07-29T02:06:38.483341+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:53:21.113599+0000","scrub_duration":0.0015478099999999999,"objects_trimmed":0,"snaptrim_duration":0.34937986999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'591","reported_seq":2680,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.695716+0000","last_change":"2023-07-29T02:03:56.797439+0000","last_active":"2023-07-29T02:06:07.695716+0000","last_peered":"2023-07-29T02:06:07.695716+0000","last_clean":"2023-07-29T02:06:07.695716+0000","last_became_active":"2023-07-29T02:00:01.995827+0000","last_became_peered":"2023-07-29T02:00:01.995827+0000","last_unstale":"2023-07-29T02:06:07.695716+0000","last_undegraded":"2023-07-29T02:06:07.695716+0000","last_fullsized":"2023-07-29T02:06:07.695716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30893240100000002,"stat_sum":{"num_bytes":24035129,"num_objects":268,"num_object_clones":0,"num_object_copies":1072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":40,"num_read_kb":8228,"num_write":590,"num_write_kb":23787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"39'17","reported_seq":69,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:44.571061+0000","last_change":"2023-07-29T02:06:44.571061+0000","last_active":"2023-07-29T02:06:44.571061+0000","last_peered":"2023-07-29T02:06:44.571061+0000","last_clean":"2023-07-29T02:06:44.571061+0000","last_became_active":"2023-07-29T01:59:57.545406+0000","last_became_peered":"2023-07-29T01:59:57.545406+0000","last_unstale":"2023-07-29T02:06:44.571061+0000","last_undegraded":"2023-07-29T02:06:44.571061+0000","last_fullsized":"2023-07-29T02:06:44.571061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'17","last_scrub_stamp":"2023-07-29T02:06:44.570888+0000","last_deep_scrub":"39'17","last_deep_scrub_stamp":"2023-07-29T02:06:44.570888+0000","last_clean_scrub_stamp":"2023-07-29T02:06:44.570888+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:22.780946+0000","scrub_duration":0.018911788999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":8216,"num_write":11,"num_write_kb":8201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"39'86","reported_seq":2142,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:51.084893+0000","last_change":"2023-07-29T02:06:51.085043+0000","last_active":"2023-07-29T02:06:51.084893+0000","last_peered":"2023-07-29T02:06:51.084893+0000","last_clean":"2023-07-29T02:06:51.084893+0000","last_became_active":"2023-07-29T02:00:46.525331+0000","last_became_peered":"2023-07-29T02:00:46.525331+0000","last_unstale":"2023-07-29T02:06:51.084893+0000","last_undegraded":"2023-07-29T02:06:51.084893+0000","last_fullsized":"2023-07-29T02:06:51.084893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'86","last_scrub_stamp":"2023-07-29T02:06:51.084864+0000","last_deep_scrub":"39'86","last_deep_scrub_stamp":"2023-07-29T02:06:51.084864+0000","last_clean_scrub_stamp":"2023-07-29T02:06:51.084864+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:41.117785+0000","scrub_duration":0.0019762199999999999,"objects_trimmed":0,"snaptrim_duration":0.46925831499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"39'589","reported_seq":2663,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:23.710634+0000","last_change":"2023-07-29T02:03:57.172129+0000","last_active":"2023-07-29T02:06:23.710634+0000","last_peered":"2023-07-29T02:06:23.710634+0000","last_clean":"2023-07-29T02:06:23.710634+0000","last_became_active":"2023-07-29T02:00:01.996969+0000","last_became_peered":"2023-07-29T02:00:01.996969+0000","last_unstale":"2023-07-29T02:06:23.710634+0000","last_undegraded":"2023-07-29T02:06:23.710634+0000","last_fullsized":"2023-07-29T02:06:23.710634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.40090650999999999,"stat_sum":{"num_bytes":23342582,"num_objects":297,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":297,"num_whiteouts":0,"num_read":24,"num_read_kb":4119,"num_write":587,"num_write_kb":31305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"39'7","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:33.304685+0000","last_change":"2023-07-29T02:06:33.304685+0000","last_active":"2023-07-29T02:06:33.304685+0000","last_peered":"2023-07-29T02:06:33.304685+0000","last_clean":"2023-07-29T02:06:33.304685+0000","last_became_active":"2023-07-29T01:59:57.540800+0000","last_became_peered":"2023-07-29T01:59:57.540800+0000","last_unstale":"2023-07-29T02:06:33.304685+0000","last_undegraded":"2023-07-29T02:06:33.304685+0000","last_fullsized":"2023-07-29T02:06:33.304685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'7","last_scrub_stamp":"2023-07-29T02:06:33.304529+0000","last_deep_scrub":"39'7","last_deep_scrub_stamp":"2023-07-29T02:06:33.304529+0000","last_clean_scrub_stamp":"2023-07-29T02:06:33.304529+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:48.348979+0000","scrub_duration":0.0044829869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22906,"num_omap_keys":38,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"39'83","reported_seq":2145,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:31.683331+0000","last_change":"2023-07-29T02:06:31.683441+0000","last_active":"2023-07-29T02:06:31.683331+0000","last_peered":"2023-07-29T02:06:31.683331+0000","last_clean":"2023-07-29T02:06:31.683331+0000","last_became_active":"2023-07-29T01:59:57.963510+0000","last_became_peered":"2023-07-29T01:59:57.963510+0000","last_unstale":"2023-07-29T02:06:31.683331+0000","last_undegraded":"2023-07-29T02:06:31.683331+0000","last_fullsized":"2023-07-29T02:06:31.683331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'83","last_scrub_stamp":"2023-07-29T02:06:31.683303+0000","last_deep_scrub":"39'83","last_deep_scrub_stamp":"2023-07-29T02:06:31.683303+0000","last_clean_scrub_stamp":"2023-07-29T02:06:31.683303+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:51.653672+0000","scrub_duration":0.001434568,"objects_trimmed":0,"snaptrim_duration":0.30420630999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"39'628","reported_seq":2718,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.247727+0000","last_change":"2023-07-29T02:03:57.173787+0000","last_active":"2023-07-29T02:06:07.247727+0000","last_peered":"2023-07-29T02:06:07.247727+0000","last_clean":"2023-07-29T02:06:07.247727+0000","last_became_active":"2023-07-29T02:00:01.996084+0000","last_became_peered":"2023-07-29T02:00:01.996084+0000","last_unstale":"2023-07-29T02:06:07.247727+0000","last_undegraded":"2023-07-29T02:06:07.247727+0000","last_fullsized":"2023-07-29T02:06:07.247727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38362237100000002,"stat_sum":{"num_bytes":15782931,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":41,"num_read_kb":8234,"num_write":627,"num_write_kb":19844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"39'3","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:37.575902+0000","last_change":"2023-07-29T02:06:37.575902+0000","last_active":"2023-07-29T02:06:37.575902+0000","last_peered":"2023-07-29T02:06:37.575902+0000","last_clean":"2023-07-29T02:06:37.575902+0000","last_became_active":"2023-07-29T01:59:57.548109+0000","last_became_peered":"2023-07-29T01:59:57.548109+0000","last_unstale":"2023-07-29T02:06:37.575902+0000","last_undegraded":"2023-07-29T02:06:37.575902+0000","last_fullsized":"2023-07-29T02:06:37.575902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2023-07-29T02:06:37.575767+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2023-07-29T02:06:37.575767+0000","last_clean_scrub_stamp":"2023-07-29T02:06:37.575767+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:40.829676+0000","scrub_duration":0.0030220429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"39'105","reported_seq":2167,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:50.193295+0000","last_change":"2023-07-29T02:06:50.193450+0000","last_active":"2023-07-29T02:06:50.193295+0000","last_peered":"2023-07-29T02:06:50.193295+0000","last_clean":"2023-07-29T02:06:50.193295+0000","last_became_active":"2023-07-29T01:59:57.961759+0000","last_became_peered":"2023-07-29T01:59:57.961759+0000","last_unstale":"2023-07-29T02:06:50.193295+0000","last_undegraded":"2023-07-29T02:06:50.193295+0000","last_fullsized":"2023-07-29T02:06:50.193295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'105","last_scrub_stamp":"2023-07-29T02:06:50.193242+0000","last_deep_scrub":"39'105","last_deep_scrub_stamp":"2023-07-29T02:06:50.193242+0000","last_clean_scrub_stamp":"2023-07-29T02:06:50.193242+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:29:55.272671+0000","scrub_duration":0.00185907,"objects_trimmed":0,"snaptrim_duration":0.55180089099999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"39'661","reported_seq":2790,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:02.729127+0000","last_change":"2023-07-29T02:07:02.729286+0000","last_active":"2023-07-29T02:07:02.729127+0000","last_peered":"2023-07-29T02:07:02.729127+0000","last_clean":"2023-07-29T02:07:02.729127+0000","last_became_active":"2023-07-29T02:00:01.992592+0000","last_became_peered":"2023-07-29T02:00:01.992592+0000","last_unstale":"2023-07-29T02:07:02.729127+0000","last_undegraded":"2023-07-29T02:07:02.729127+0000","last_fullsized":"2023-07-29T02:07:02.729127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'661","last_scrub_stamp":"2023-07-29T02:07:02.729101+0000","last_deep_scrub":"39'661","last_deep_scrub_stamp":"2023-07-29T02:07:02.729101+0000","last_clean_scrub_stamp":"2023-07-29T02:07:02.729101+0000","objects_scrubbed":303,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:37:01.469196+0000","scrub_duration":0.13390676700000001,"objects_trimmed":0,"snaptrim_duration":0.30939737499999997,"stat_sum":{"num_bytes":46419699,"num_objects":303,"num_object_clones":0,"num_object_copies":1212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":303,"num_whiteouts":0,"num_read":45,"num_read_kb":20516,"num_write":660,"num_write_kb":45624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"39'106","reported_seq":172,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:38.170787+0000","last_change":"2023-07-29T02:06:38.170787+0000","last_active":"2023-07-29T02:06:38.170787+0000","last_peered":"2023-07-29T02:06:38.170787+0000","last_clean":"2023-07-29T02:06:38.170787+0000","last_became_active":"2023-07-29T01:59:57.543398+0000","last_became_peered":"2023-07-29T01:59:57.543398+0000","last_unstale":"2023-07-29T02:06:38.170787+0000","last_undegraded":"2023-07-29T02:06:38.170787+0000","last_fullsized":"2023-07-29T02:06:38.170787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'106","last_scrub_stamp":"2023-07-29T02:06:38.170630+0000","last_deep_scrub":"39'106","last_deep_scrub_stamp":"2023-07-29T02:06:38.170630+0000","last_clean_scrub_stamp":"2023-07-29T02:06:38.170630+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:33.288781+0000","scrub_duration":0.020523897999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":8252,"num_write":102,"num_write_kb":8255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24160,"num_omap_keys":40,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"39'90","reported_seq":2152,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.890980+0000","last_change":"2023-07-29T02:06:24.891064+0000","last_active":"2023-07-29T02:06:24.890980+0000","last_peered":"2023-07-29T02:06:24.890980+0000","last_clean":"2023-07-29T02:06:24.890980+0000","last_became_active":"2023-07-29T01:59:57.965962+0000","last_became_peered":"2023-07-29T01:59:57.965962+0000","last_unstale":"2023-07-29T02:06:24.890980+0000","last_undegraded":"2023-07-29T02:06:24.890980+0000","last_fullsized":"2023-07-29T02:06:24.890980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'90","last_scrub_stamp":"2023-07-29T02:06:24.890955+0000","last_deep_scrub":"39'90","last_deep_scrub_stamp":"2023-07-29T02:06:24.890955+0000","last_clean_scrub_stamp":"2023-07-29T02:06:24.890955+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:20.009107+0000","scrub_duration":0.0016125829999999999,"objects_trimmed":0,"snaptrim_duration":0.38151887499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"39'670","reported_seq":2769,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:25.821570+0000","last_change":"2023-07-29T02:03:56.698091+0000","last_active":"2023-07-29T02:06:25.821570+0000","last_peered":"2023-07-29T02:06:25.821570+0000","last_clean":"2023-07-29T02:06:25.821570+0000","last_became_active":"2023-07-29T02:00:01.992384+0000","last_became_peered":"2023-07-29T02:00:01.992384+0000","last_unstale":"2023-07-29T02:06:25.821570+0000","last_undegraded":"2023-07-29T02:06:25.821570+0000","last_fullsized":"2023-07-29T02:06:25.821570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.19044205,"stat_sum":{"num_bytes":36575402,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":49,"num_read_kb":16426,"num_write":669,"num_write_kb":40161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"39'30","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:43.592473+0000","last_change":"2023-07-29T02:06:43.592473+0000","last_active":"2023-07-29T02:06:43.592473+0000","last_peered":"2023-07-29T02:06:43.592473+0000","last_clean":"2023-07-29T02:06:43.592473+0000","last_became_active":"2023-07-29T01:59:57.548084+0000","last_became_peered":"2023-07-29T01:59:57.548084+0000","last_unstale":"2023-07-29T02:06:43.592473+0000","last_undegraded":"2023-07-29T02:06:43.592473+0000","last_fullsized":"2023-07-29T02:06:43.592473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'30","last_scrub_stamp":"2023-07-29T02:06:43.592305+0000","last_deep_scrub":"39'30","last_deep_scrub_stamp":"2023-07-29T02:06:43.592305+0000","last_clean_scrub_stamp":"2023-07-29T02:06:43.592305+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:36.733394+0000","scrub_duration":0.012205482,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":27,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17798,"num_omap_keys":30,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"39'93","reported_seq":2156,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:45.593991+0000","last_change":"2023-07-29T02:06:45.594104+0000","last_active":"2023-07-29T02:06:45.593991+0000","last_peered":"2023-07-29T02:06:45.593991+0000","last_clean":"2023-07-29T02:06:45.593991+0000","last_became_active":"2023-07-29T01:59:57.964626+0000","last_became_peered":"2023-07-29T01:59:57.964626+0000","last_unstale":"2023-07-29T02:06:45.593991+0000","last_undegraded":"2023-07-29T02:06:45.593991+0000","last_fullsized":"2023-07-29T02:06:45.593991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'93","last_scrub_stamp":"2023-07-29T02:06:45.593955+0000","last_deep_scrub":"39'93","last_deep_scrub_stamp":"2023-07-29T02:06:45.593955+0000","last_clean_scrub_stamp":"2023-07-29T02:06:45.593955+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:35.626877+0000","scrub_duration":0.0014249449999999999,"objects_trimmed":0,"snaptrim_duration":0.297089139,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"39'673","reported_seq":2800,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:42.077307+0000","last_change":"2023-07-29T02:06:42.077438+0000","last_active":"2023-07-29T02:06:42.077307+0000","last_peered":"2023-07-29T02:06:42.077307+0000","last_clean":"2023-07-29T02:06:42.077307+0000","last_became_active":"2023-07-29T02:00:01.990579+0000","last_became_peered":"2023-07-29T02:00:01.990579+0000","last_unstale":"2023-07-29T02:06:42.077307+0000","last_undegraded":"2023-07-29T02:06:42.077307+0000","last_fullsized":"2023-07-29T02:06:42.077307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'673","last_scrub_stamp":"2023-07-29T02:06:42.077282+0000","last_deep_scrub":"39'673","last_deep_scrub_stamp":"2023-07-29T02:06:42.077282+0000","last_clean_scrub_stamp":"2023-07-29T02:06:42.077282+0000","objects_scrubbed":333,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:57.121733+0000","scrub_duration":0.13274117899999999,"objects_trimmed":0,"snaptrim_duration":0.47400464199999998,"stat_sum":{"num_bytes":32895626,"num_objects":333,"num_object_clones":0,"num_object_copies":1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":333,"num_whiteouts":0,"num_read":40,"num_read_kb":14736,"num_write":673,"num_write_kb":36572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"39'247","reported_seq":297,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.564540+0000","last_change":"2023-07-29T02:06:41.564540+0000","last_active":"2023-07-29T02:06:41.564540+0000","last_peered":"2023-07-29T02:06:41.564540+0000","last_clean":"2023-07-29T02:06:41.564540+0000","last_became_active":"2023-07-29T01:59:57.548981+0000","last_became_peered":"2023-07-29T01:59:57.548981+0000","last_unstale":"2023-07-29T02:06:41.564540+0000","last_undegraded":"2023-07-29T02:06:41.564540+0000","last_fullsized":"2023-07-29T02:06:41.564540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'247","last_scrub_stamp":"2023-07-29T02:06:41.564325+0000","last_deep_scrub":"39'247","last_deep_scrub_stamp":"2023-07-29T02:06:41.564325+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.564325+0000","objects_scrubbed":4,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:39.079241+0000","scrub_duration":0.018895436000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":244,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14496,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"39'93","reported_seq":2145,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.229703+0000","last_change":"2023-07-29T02:03:57.111934+0000","last_active":"2023-07-29T02:06:24.229703+0000","last_peered":"2023-07-29T02:06:24.229703+0000","last_clean":"2023-07-29T02:06:24.229703+0000","last_became_active":"2023-07-29T01:59:57.969501+0000","last_became_peered":"2023-07-29T01:59:57.969501+0000","last_unstale":"2023-07-29T02:06:24.229703+0000","last_undegraded":"2023-07-29T02:06:24.229703+0000","last_fullsized":"2023-07-29T02:06:24.229703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35565022000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"39'641","reported_seq":2766,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:48.159456+0000","last_change":"2023-07-29T02:06:48.159456+0000","last_active":"2023-07-29T02:06:48.159456+0000","last_peered":"2023-07-29T02:06:48.159456+0000","last_clean":"2023-07-29T02:06:48.159456+0000","last_became_active":"2023-07-29T02:00:01.989364+0000","last_became_peered":"2023-07-29T02:00:01.989364+0000","last_unstale":"2023-07-29T02:06:48.159456+0000","last_undegraded":"2023-07-29T02:06:48.159456+0000","last_fullsized":"2023-07-29T02:06:48.159456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'641","last_scrub_stamp":"2023-07-29T02:06:48.159299+0000","last_deep_scrub":"39'641","last_deep_scrub_stamp":"2023-07-29T02:06:48.159299+0000","last_clean_scrub_stamp":"2023-07-29T02:06:48.159299+0000","objects_scrubbed":325,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:13:10.752308+0000","scrub_duration":0.124059473,"objects_trimmed":0,"snaptrim_duration":0.47145374600000001,"stat_sum":{"num_bytes":24224399,"num_objects":325,"num_object_clones":0,"num_object_copies":1300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":38,"num_read_kb":8228,"num_write":641,"num_write_kb":23994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"39'12","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.570729+0000","last_change":"2023-07-29T02:06:39.570729+0000","last_active":"2023-07-29T02:06:39.570729+0000","last_peered":"2023-07-29T02:06:39.570729+0000","last_clean":"2023-07-29T02:06:39.570729+0000","last_became_active":"2023-07-29T01:59:57.541056+0000","last_became_peered":"2023-07-29T01:59:57.541056+0000","last_unstale":"2023-07-29T02:06:39.570729+0000","last_undegraded":"2023-07-29T02:06:39.570729+0000","last_fullsized":"2023-07-29T02:06:39.570729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2023-07-29T02:06:39.570584+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2023-07-29T02:06:39.570584+0000","last_clean_scrub_stamp":"2023-07-29T02:06:39.570584+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:54.615034+0000","scrub_duration":0.016833287999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":8,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31920,"num_omap_keys":53,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"39'88","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.129971+0000","last_change":"2023-07-29T02:06:39.130059+0000","last_active":"2023-07-29T02:06:39.129971+0000","last_peered":"2023-07-29T02:06:39.129971+0000","last_clean":"2023-07-29T02:06:39.129971+0000","last_became_active":"2023-07-29T01:59:57.974998+0000","last_became_peered":"2023-07-29T01:59:57.974998+0000","last_unstale":"2023-07-29T02:06:39.129971+0000","last_undegraded":"2023-07-29T02:06:39.129971+0000","last_fullsized":"2023-07-29T02:06:39.129971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'88","last_scrub_stamp":"2023-07-29T02:06:39.129946+0000","last_deep_scrub":"39'88","last_deep_scrub_stamp":"2023-07-29T02:06:39.129946+0000","last_clean_scrub_stamp":"2023-07-29T02:06:39.129946+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:59.100315+0000","scrub_duration":0.0019768939999999999,"objects_trimmed":0,"snaptrim_duration":0.20531364299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"39'660","reported_seq":2776,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:47.144287+0000","last_change":"2023-07-29T02:06:47.144475+0000","last_active":"2023-07-29T02:06:47.144287+0000","last_peered":"2023-07-29T02:06:47.144287+0000","last_clean":"2023-07-29T02:06:47.144287+0000","last_became_active":"2023-07-29T02:00:01.990276+0000","last_became_peered":"2023-07-29T02:00:01.990276+0000","last_unstale":"2023-07-29T02:06:47.144287+0000","last_undegraded":"2023-07-29T02:06:47.144287+0000","last_fullsized":"2023-07-29T02:06:47.144287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'660","last_scrub_stamp":"2023-07-29T02:06:47.144238+0000","last_deep_scrub":"39'660","last_deep_scrub_stamp":"2023-07-29T02:06:47.144238+0000","last_clean_scrub_stamp":"2023-07-29T02:06:47.144238+0000","objects_scrubbed":321,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:25.354296+0000","scrub_duration":0.12368135500000001,"objects_trimmed":0,"snaptrim_duration":0.47581172799999999,"stat_sum":{"num_bytes":20642551,"num_objects":321,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":321,"num_whiteouts":0,"num_read":31,"num_read_kb":1050,"num_write":661,"num_write_kb":24562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"39'11","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:36.751062+0000","last_change":"2023-07-29T02:06:36.751062+0000","last_active":"2023-07-29T02:06:36.751062+0000","last_peered":"2023-07-29T02:06:36.751062+0000","last_clean":"2023-07-29T02:06:36.751062+0000","last_became_active":"2023-07-29T01:59:57.544231+0000","last_became_peered":"2023-07-29T01:59:57.544231+0000","last_unstale":"2023-07-29T02:06:36.751062+0000","last_undegraded":"2023-07-29T02:06:36.751062+0000","last_fullsized":"2023-07-29T02:06:36.751062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'11","last_scrub_stamp":"2023-07-29T02:06:36.750893+0000","last_deep_scrub":"39'11","last_deep_scrub_stamp":"2023-07-29T02:06:36.750893+0000","last_clean_scrub_stamp":"2023-07-29T02:06:36.750893+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:51.795344+0000","scrub_duration":0.011813673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20726,"num_omap_keys":35,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"39'88","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:04.226546+0000","last_change":"2023-07-29T02:07:04.226649+0000","last_active":"2023-07-29T02:07:04.226546+0000","last_peered":"2023-07-29T02:07:04.226546+0000","last_clean":"2023-07-29T02:07:04.226546+0000","last_became_active":"2023-07-29T01:59:57.974525+0000","last_became_peered":"2023-07-29T01:59:57.974525+0000","last_unstale":"2023-07-29T02:07:04.226546+0000","last_undegraded":"2023-07-29T02:07:04.226546+0000","last_fullsized":"2023-07-29T02:07:04.226546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'88","last_scrub_stamp":"2023-07-29T02:07:04.226523+0000","last_deep_scrub":"39'88","last_deep_scrub_stamp":"2023-07-29T02:07:04.226523+0000","last_clean_scrub_stamp":"2023-07-29T02:07:04.226523+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:48:31.036883+0000","scrub_duration":0.0011936620000000001,"objects_trimmed":0,"snaptrim_duration":0.549422509,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"39'632","reported_seq":2758,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:44.103323+0000","last_change":"2023-07-29T02:06:44.103323+0000","last_active":"2023-07-29T02:06:44.103323+0000","last_peered":"2023-07-29T02:06:44.103323+0000","last_clean":"2023-07-29T02:06:44.103323+0000","last_became_active":"2023-07-29T02:00:01.988486+0000","last_became_peered":"2023-07-29T02:00:01.988486+0000","last_unstale":"2023-07-29T02:06:44.103323+0000","last_undegraded":"2023-07-29T02:06:44.103323+0000","last_fullsized":"2023-07-29T02:06:44.103323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'632","last_scrub_stamp":"2023-07-29T02:06:44.103126+0000","last_deep_scrub":"39'632","last_deep_scrub_stamp":"2023-07-29T02:06:44.103126+0000","last_clean_scrub_stamp":"2023-07-29T02:06:44.103126+0000","objects_scrubbed":300,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:41.618043+0000","scrub_duration":0.13271588600000001,"objects_trimmed":0,"snaptrim_duration":0.473472642,"stat_sum":{"num_bytes":32792736,"num_objects":300,"num_object_clones":0,"num_object_copies":1200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":300,"num_whiteouts":0,"num_read":41,"num_read_kb":18442,"num_write":630,"num_write_kb":40548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"39'382","reported_seq":431,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.975797+0000","last_change":"2023-07-29T02:06:39.975797+0000","last_active":"2023-07-29T02:06:39.975797+0000","last_peered":"2023-07-29T02:06:39.975797+0000","last_clean":"2023-07-29T02:06:39.975797+0000","last_became_active":"2023-07-29T01:59:57.534813+0000","last_became_peered":"2023-07-29T01:59:57.534813+0000","last_unstale":"2023-07-29T02:06:39.975797+0000","last_undegraded":"2023-07-29T02:06:39.975797+0000","last_fullsized":"2023-07-29T02:06:39.975797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'382","last_scrub_stamp":"2023-07-29T02:06:39.975672+0000","last_deep_scrub":"39'382","last_deep_scrub_stamp":"2023-07-29T02:06:39.975672+0000","last_clean_scrub_stamp":"2023-07-29T02:06:39.975672+0000","objects_scrubbed":6,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:30.008594+0000","scrub_duration":0.024545006000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":8198,"num_write":371,"num_write_kb":12605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"39'96","reported_seq":2159,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.494296+0000","last_change":"2023-07-29T02:06:24.494296+0000","last_active":"2023-07-29T02:06:24.494296+0000","last_peered":"2023-07-29T02:06:24.494296+0000","last_clean":"2023-07-29T02:06:24.494296+0000","last_became_active":"2023-07-29T01:59:57.962184+0000","last_became_peered":"2023-07-29T01:59:57.962184+0000","last_unstale":"2023-07-29T02:06:24.494296+0000","last_undegraded":"2023-07-29T02:06:24.494296+0000","last_fullsized":"2023-07-29T02:06:24.494296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'96","last_scrub_stamp":"2023-07-29T02:06:24.494142+0000","last_deep_scrub":"39'96","last_deep_scrub_stamp":"2023-07-29T02:06:24.494142+0000","last_clean_scrub_stamp":"2023-07-29T02:06:24.494142+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:05:15.948297+0000","scrub_duration":0.001611838,"objects_trimmed":0,"snaptrim_duration":0.36182750899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"39'688","reported_seq":2815,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:55.561116+0000","last_change":"2023-07-29T02:06:55.561244+0000","last_active":"2023-07-29T02:06:55.561116+0000","last_peered":"2023-07-29T02:06:55.561116+0000","last_clean":"2023-07-29T02:06:55.561116+0000","last_became_active":"2023-07-29T02:00:01.989151+0000","last_became_peered":"2023-07-29T02:00:01.989151+0000","last_unstale":"2023-07-29T02:06:55.561116+0000","last_undegraded":"2023-07-29T02:06:55.561116+0000","last_fullsized":"2023-07-29T02:06:55.561116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'688","last_scrub_stamp":"2023-07-29T02:06:55.561092+0000","last_deep_scrub":"39'688","last_deep_scrub_stamp":"2023-07-29T02:06:55.561092+0000","last_clean_scrub_stamp":"2023-07-29T02:06:55.561092+0000","objects_scrubbed":326,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:04:59.339522+0000","scrub_duration":0.13620000500000001,"objects_trimmed":0,"snaptrim_duration":0.54490939800000004,"stat_sum":{"num_bytes":33219663,"num_objects":326,"num_object_clones":0,"num_object_copies":1304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":326,"num_whiteouts":0,"num_read":40,"num_read_kb":16418,"num_write":687,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"39'196","reported_seq":241,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:34.174273+0000","last_change":"2023-07-29T02:06:34.174383+0000","last_active":"2023-07-29T02:06:34.174273+0000","last_peered":"2023-07-29T02:06:34.174273+0000","last_clean":"2023-07-29T02:06:34.174273+0000","last_became_active":"2023-07-29T01:59:57.544120+0000","last_became_peered":"2023-07-29T01:59:57.544120+0000","last_unstale":"2023-07-29T02:06:34.174273+0000","last_undegraded":"2023-07-29T02:06:34.174273+0000","last_fullsized":"2023-07-29T02:06:34.174273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'196","last_scrub_stamp":"2023-07-29T02:06:34.174245+0000","last_deep_scrub":"39'196","last_deep_scrub_stamp":"2023-07-29T02:06:34.174245+0000","last_clean_scrub_stamp":"2023-07-29T02:06:34.174245+0000","objects_scrubbed":5,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:18:24.878615+0000","scrub_duration":0.032465687999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":192,"num_write_kb":12401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24074,"num_omap_keys":41,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"39'93","reported_seq":2145,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.229675+0000","last_change":"2023-07-29T02:03:57.107586+0000","last_active":"2023-07-29T02:06:24.229675+0000","last_peered":"2023-07-29T02:06:24.229675+0000","last_clean":"2023-07-29T02:06:24.229675+0000","last_became_active":"2023-07-29T01:59:57.961975+0000","last_became_peered":"2023-07-29T01:59:57.961975+0000","last_unstale":"2023-07-29T02:06:24.229675+0000","last_undegraded":"2023-07-29T02:06:24.229675+0000","last_fullsized":"2023-07-29T02:06:24.229675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37361334099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"39'646","reported_seq":2740,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.778943+0000","last_change":"2023-07-29T02:03:56.800119+0000","last_active":"2023-07-29T02:06:24.778943+0000","last_peered":"2023-07-29T02:06:24.778943+0000","last_clean":"2023-07-29T02:06:24.778943+0000","last_became_active":"2023-07-29T02:00:01.988155+0000","last_became_peered":"2023-07-29T02:00:01.988155+0000","last_unstale":"2023-07-29T02:06:24.778943+0000","last_undegraded":"2023-07-29T02:06:24.778943+0000","last_fullsized":"2023-07-29T02:06:24.778943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30982225000000002,"stat_sum":{"num_bytes":22073203,"num_objects":313,"num_object_clones":0,"num_object_copies":1252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":44,"num_read_kb":12328,"num_write":643,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"39'66","reported_seq":111,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:56.510348+0000","last_change":"2023-07-29T02:06:56.510436+0000","last_active":"2023-07-29T02:06:56.510348+0000","last_peered":"2023-07-29T02:06:56.510348+0000","last_clean":"2023-07-29T02:06:56.510348+0000","last_became_active":"2023-07-29T01:59:57.549470+0000","last_became_peered":"2023-07-29T01:59:57.549470+0000","last_unstale":"2023-07-29T02:06:56.510348+0000","last_undegraded":"2023-07-29T02:06:56.510348+0000","last_fullsized":"2023-07-29T02:06:56.510348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'66","last_scrub_stamp":"2023-07-29T02:06:56.510325+0000","last_deep_scrub":"39'66","last_deep_scrub_stamp":"2023-07-29T02:06:56.510325+0000","last_clean_scrub_stamp":"2023-07-29T02:06:56.510325+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:48:23.320684+0000","scrub_duration":0.010157708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":64,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20398,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"39'65","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:32.423044+0000","last_change":"2023-07-29T02:06:32.423044+0000","last_active":"2023-07-29T02:06:32.423044+0000","last_peered":"2023-07-29T02:06:32.423044+0000","last_clean":"2023-07-29T02:06:32.423044+0000","last_became_active":"2023-07-29T01:59:57.962016+0000","last_became_peered":"2023-07-29T01:59:57.962016+0000","last_unstale":"2023-07-29T02:06:32.423044+0000","last_undegraded":"2023-07-29T02:06:32.423044+0000","last_fullsized":"2023-07-29T02:06:32.423044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'65","last_scrub_stamp":"2023-07-29T02:06:32.422911+0000","last_deep_scrub":"39'65","last_deep_scrub_stamp":"2023-07-29T02:06:32.422911+0000","last_clean_scrub_stamp":"2023-07-29T02:06:32.422911+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:22.455833+0000","scrub_duration":0.0014239599999999999,"objects_trimmed":0,"snaptrim_duration":0.36599154900000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"39'565","reported_seq":2655,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.229941+0000","last_change":"2023-07-29T02:03:57.082127+0000","last_active":"2023-07-29T02:06:24.229941+0000","last_peered":"2023-07-29T02:06:24.229941+0000","last_clean":"2023-07-29T02:06:24.229941+0000","last_became_active":"2023-07-29T02:00:01.992042+0000","last_became_peered":"2023-07-29T02:00:01.992042+0000","last_unstale":"2023-07-29T02:06:24.229941+0000","last_undegraded":"2023-07-29T02:06:24.229941+0000","last_fullsized":"2023-07-29T02:06:24.229941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36734029699999998,"stat_sum":{"num_bytes":17472104,"num_objects":288,"num_object_clones":0,"num_object_copies":1152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":40,"num_read_kb":12324,"num_write":565,"num_write_kb":21394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"39'15","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:35.000137+0000","last_change":"2023-07-29T02:06:35.000254+0000","last_active":"2023-07-29T02:06:35.000137+0000","last_peered":"2023-07-29T02:06:35.000137+0000","last_clean":"2023-07-29T02:06:35.000137+0000","last_became_active":"2023-07-29T01:59:57.535762+0000","last_became_peered":"2023-07-29T01:59:57.535762+0000","last_unstale":"2023-07-29T02:06:35.000137+0000","last_undegraded":"2023-07-29T02:06:35.000137+0000","last_fullsized":"2023-07-29T02:06:35.000137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'15","last_scrub_stamp":"2023-07-29T02:06:35.000106+0000","last_deep_scrub":"39'15","last_deep_scrub_stamp":"2023-07-29T02:06:35.000106+0000","last_clean_scrub_stamp":"2023-07-29T02:06:35.000106+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:28.141195+0000","scrub_duration":0.010307169,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":13,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30910,"num_omap_keys":52,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"39'87","reported_seq":2150,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.329087+0000","last_change":"2023-07-29T02:06:39.329087+0000","last_active":"2023-07-29T02:06:39.329087+0000","last_peered":"2023-07-29T02:06:39.329087+0000","last_clean":"2023-07-29T02:06:39.329087+0000","last_became_active":"2023-07-29T01:59:57.974834+0000","last_became_peered":"2023-07-29T01:59:57.974834+0000","last_unstale":"2023-07-29T02:06:39.329087+0000","last_undegraded":"2023-07-29T02:06:39.329087+0000","last_fullsized":"2023-07-29T02:06:39.329087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'87","last_scrub_stamp":"2023-07-29T02:06:39.328959+0000","last_deep_scrub":"39'87","last_deep_scrub_stamp":"2023-07-29T02:06:39.328959+0000","last_clean_scrub_stamp":"2023-07-29T02:06:39.328959+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:54.373409+0000","scrub_duration":0.0016042369999999999,"objects_trimmed":0,"snaptrim_duration":0.53560260199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"39'713","reported_seq":2793,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.454413+0000","last_change":"2023-07-29T02:03:57.112720+0000","last_active":"2023-07-29T02:06:19.454413+0000","last_peered":"2023-07-29T02:06:19.454413+0000","last_clean":"2023-07-29T02:06:19.454413+0000","last_became_active":"2023-07-29T02:00:01.990464+0000","last_became_peered":"2023-07-29T02:00:01.990464+0000","last_unstale":"2023-07-29T02:06:19.454413+0000","last_undegraded":"2023-07-29T02:06:19.454413+0000","last_fullsized":"2023-07-29T02:06:19.454413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.356278702,"stat_sum":{"num_bytes":25950589,"num_objects":363,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":363,"num_whiteouts":0,"num_read":30,"num_read_kb":4124,"num_write":712,"num_write_kb":29793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"39'166","reported_seq":216,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.989281+0000","last_change":"2023-07-29T02:06:41.989432+0000","last_active":"2023-07-29T02:06:41.989281+0000","last_peered":"2023-07-29T02:06:41.989281+0000","last_clean":"2023-07-29T02:06:41.989281+0000","last_became_active":"2023-07-29T01:59:57.540292+0000","last_became_peered":"2023-07-29T01:59:57.540292+0000","last_unstale":"2023-07-29T02:06:41.989281+0000","last_undegraded":"2023-07-29T02:06:41.989281+0000","last_fullsized":"2023-07-29T02:06:41.989281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'166","last_scrub_stamp":"2023-07-29T02:06:41.989234+0000","last_deep_scrub":"39'166","last_deep_scrub_stamp":"2023-07-29T02:06:41.989234+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.989234+0000","objects_scrubbed":4,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:33:15.850245+0000","scrub_duration":0.014136332,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":162,"num_write_kb":4206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20550,"num_omap_keys":35,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.534625+0000","last_change":"2023-07-29T02:06:41.534733+0000","last_active":"2023-07-29T02:06:41.534625+0000","last_peered":"2023-07-29T02:06:41.534625+0000","last_clean":"2023-07-29T02:06:41.534625+0000","last_became_active":"2023-07-29T01:59:52.447782+0000","last_became_peered":"2023-07-29T01:59:52.447782+0000","last_unstale":"2023-07-29T02:06:41.534625+0000","last_undegraded":"2023-07-29T02:06:41.534625+0000","last_fullsized":"2023-07-29T02:06:41.534625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:41.534599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:41.534599+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.534599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:58:31.380201+0000","scrub_duration":0.0019006699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"39'83","reported_seq":2146,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:30.896156+0000","last_change":"2023-07-29T02:06:30.896265+0000","last_active":"2023-07-29T02:06:30.896156+0000","last_peered":"2023-07-29T02:06:30.896156+0000","last_clean":"2023-07-29T02:06:30.896156+0000","last_became_active":"2023-07-29T01:59:57.966065+0000","last_became_peered":"2023-07-29T01:59:57.966065+0000","last_unstale":"2023-07-29T02:06:30.896156+0000","last_undegraded":"2023-07-29T02:06:30.896156+0000","last_fullsized":"2023-07-29T02:06:30.896156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'83","last_scrub_stamp":"2023-07-29T02:06:30.896126+0000","last_deep_scrub":"39'83","last_deep_scrub_stamp":"2023-07-29T02:06:30.896126+0000","last_clean_scrub_stamp":"2023-07-29T02:06:30.896126+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:45.940577+0000","scrub_duration":0.002183015,"objects_trimmed":0,"snaptrim_duration":0.37241656400000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"39'677","reported_seq":2811,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:04.217760+0000","last_change":"2023-07-29T02:07:04.217903+0000","last_active":"2023-07-29T02:07:04.217760+0000","last_peered":"2023-07-29T02:07:04.217760+0000","last_clean":"2023-07-29T02:07:04.217760+0000","last_became_active":"2023-07-29T02:00:01.995963+0000","last_became_peered":"2023-07-29T02:00:01.995963+0000","last_unstale":"2023-07-29T02:07:04.217760+0000","last_undegraded":"2023-07-29T02:07:04.217760+0000","last_fullsized":"2023-07-29T02:07:04.217760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'677","last_scrub_stamp":"2023-07-29T02:07:04.217731+0000","last_deep_scrub":"39'677","last_deep_scrub_stamp":"2023-07-29T02:07:04.217731+0000","last_clean_scrub_stamp":"2023-07-29T02:07:04.217731+0000","objects_scrubbed":332,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:24:49.826082+0000","scrub_duration":0.119161874,"objects_trimmed":0,"snaptrim_duration":0.373304892,"stat_sum":{"num_bytes":14135733,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":47,"num_read_kb":4140,"num_write":679,"num_write_kb":14069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:32.905149+0000","last_change":"2023-07-29T02:06:32.905293+0000","last_active":"2023-07-29T02:06:32.905149+0000","last_peered":"2023-07-29T02:06:32.905149+0000","last_clean":"2023-07-29T02:06:32.905149+0000","last_became_active":"2023-07-29T01:59:52.445337+0000","last_became_peered":"2023-07-29T01:59:52.445337+0000","last_unstale":"2023-07-29T02:06:32.905149+0000","last_undegraded":"2023-07-29T02:06:32.905149+0000","last_fullsized":"2023-07-29T02:06:32.905149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:32.905103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:32.905103+0000","last_clean_scrub_stamp":"2023-07-29T02:06:32.905103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:30.420020+0000","scrub_duration":0.0019302989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"39'41","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:37.295159+0000","last_change":"2023-07-29T02:06:37.295159+0000","last_active":"2023-07-29T02:06:37.295159+0000","last_peered":"2023-07-29T02:06:37.295159+0000","last_clean":"2023-07-29T02:06:37.295159+0000","last_became_active":"2023-07-29T01:59:57.537581+0000","last_became_peered":"2023-07-29T01:59:57.537581+0000","last_unstale":"2023-07-29T02:06:37.295159+0000","last_undegraded":"2023-07-29T02:06:37.295159+0000","last_fullsized":"2023-07-29T02:06:37.295159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'40","last_scrub_stamp":"2023-07-29T02:06:37.294992+0000","last_deep_scrub":"39'40","last_deep_scrub_stamp":"2023-07-29T02:06:37.294992+0000","last_clean_scrub_stamp":"2023-07-29T02:06:37.294992+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:30.436081+0000","scrub_duration":0.0068420169999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8,"num_write":86,"num_write_kb":1322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12080,"num_omap_keys":20,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"39'82","reported_seq":2145,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:03.469440+0000","last_change":"2023-07-29T02:07:03.469557+0000","last_active":"2023-07-29T02:07:03.469440+0000","last_peered":"2023-07-29T02:07:03.469440+0000","last_clean":"2023-07-29T02:07:03.469440+0000","last_became_active":"2023-07-29T01:59:57.961298+0000","last_became_peered":"2023-07-29T01:59:57.961298+0000","last_unstale":"2023-07-29T02:07:03.469440+0000","last_undegraded":"2023-07-29T02:07:03.469440+0000","last_fullsized":"2023-07-29T02:07:03.469440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'82","last_scrub_stamp":"2023-07-29T02:07:03.469410+0000","last_deep_scrub":"39'82","last_deep_scrub_stamp":"2023-07-29T02:07:03.469410+0000","last_clean_scrub_stamp":"2023-07-29T02:07:03.469410+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:12:12.974105+0000","scrub_duration":0.0016025049999999999,"objects_trimmed":0,"snaptrim_duration":0.35104021600000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"39'622","reported_seq":2709,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.778872+0000","last_change":"2023-07-29T02:03:56.799516+0000","last_active":"2023-07-29T02:06:24.778872+0000","last_peered":"2023-07-29T02:06:24.778872+0000","last_clean":"2023-07-29T02:06:24.778872+0000","last_became_active":"2023-07-29T02:00:01.986915+0000","last_became_peered":"2023-07-29T02:00:01.986915+0000","last_unstale":"2023-07-29T02:06:24.778872+0000","last_undegraded":"2023-07-29T02:06:24.778872+0000","last_fullsized":"2023-07-29T02:06:24.778872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.30985112500000001,"stat_sum":{"num_bytes":28815426,"num_objects":291,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":291,"num_whiteouts":0,"num_read":37,"num_read_kb":4131,"num_write":621,"num_write_kb":32518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:23.105634+0000","last_change":"2023-07-29T02:06:23.105717+0000","last_active":"2023-07-29T02:06:23.105634+0000","last_peered":"2023-07-29T02:06:23.105634+0000","last_clean":"2023-07-29T02:06:23.105634+0000","last_became_active":"2023-07-29T01:59:52.448052+0000","last_became_peered":"2023-07-29T01:59:52.448052+0000","last_unstale":"2023-07-29T02:06:23.105634+0000","last_undegraded":"2023-07-29T02:06:23.105634+0000","last_fullsized":"2023-07-29T02:06:23.105634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:23.105612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:23.105612+0000","last_clean_scrub_stamp":"2023-07-29T02:06:23.105612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:01:13.810307+0000","scrub_duration":0.0019361350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"39'119","reported_seq":199,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:34.526309+0000","last_change":"2023-07-29T02:06:34.526427+0000","last_active":"2023-07-29T02:06:34.526309+0000","last_peered":"2023-07-29T02:06:34.526309+0000","last_clean":"2023-07-29T02:06:34.526309+0000","last_became_active":"2023-07-29T01:59:52.449582+0000","last_became_peered":"2023-07-29T01:59:52.449582+0000","last_unstale":"2023-07-29T02:06:34.526309+0000","last_undegraded":"2023-07-29T02:06:34.526309+0000","last_fullsized":"2023-07-29T02:06:34.526309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2023-07-29T02:06:34.526281+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2023-07-29T02:06:34.526281+0000","last_clean_scrub_stamp":"2023-07-29T02:06:34.526281+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:54.496650+0000","scrub_duration":0.0069852009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"39'67","reported_seq":177,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:31.365346+0000","last_change":"2023-07-29T02:06:31.365465+0000","last_active":"2023-07-29T02:06:31.365346+0000","last_peered":"2023-07-29T02:06:31.365346+0000","last_clean":"2023-07-29T02:06:31.365346+0000","last_became_active":"2023-07-29T01:59:57.546179+0000","last_became_peered":"2023-07-29T01:59:57.546179+0000","last_unstale":"2023-07-29T02:06:31.365346+0000","last_undegraded":"2023-07-29T02:06:31.365346+0000","last_fullsized":"2023-07-29T02:06:31.365346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'67","last_scrub_stamp":"2023-07-29T02:06:31.365318+0000","last_deep_scrub":"39'67","last_deep_scrub_stamp":"2023-07-29T02:06:31.365318+0000","last_clean_scrub_stamp":"2023-07-29T02:06:31.365318+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:34.619227+0000","scrub_duration":0.0034459820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576264,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":610,"num_write":65,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"39'93","reported_seq":2156,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:27.316704+0000","last_change":"2023-07-29T02:06:27.316704+0000","last_active":"2023-07-29T02:06:27.316704+0000","last_peered":"2023-07-29T02:06:27.316704+0000","last_clean":"2023-07-29T02:06:27.316704+0000","last_became_active":"2023-07-29T01:59:57.975078+0000","last_became_peered":"2023-07-29T01:59:57.975078+0000","last_unstale":"2023-07-29T02:06:27.316704+0000","last_undegraded":"2023-07-29T02:06:27.316704+0000","last_fullsized":"2023-07-29T02:06:27.316704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'93","last_scrub_stamp":"2023-07-29T02:06:27.316579+0000","last_deep_scrub":"39'93","last_deep_scrub_stamp":"2023-07-29T02:06:27.316579+0000","last_clean_scrub_stamp":"2023-07-29T02:06:27.316579+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:22.434730+0000","scrub_duration":0.0015657690000000001,"objects_trimmed":0,"snaptrim_duration":0.55319968200000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"39'709","reported_seq":2846,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:46.161104+0000","last_change":"2023-07-29T02:06:46.161289+0000","last_active":"2023-07-29T02:06:46.161104+0000","last_peered":"2023-07-29T02:06:46.161104+0000","last_clean":"2023-07-29T02:06:46.161104+0000","last_became_active":"2023-07-29T02:00:01.986937+0000","last_became_peered":"2023-07-29T02:00:01.986937+0000","last_unstale":"2023-07-29T02:06:46.161104+0000","last_undegraded":"2023-07-29T02:06:46.161104+0000","last_fullsized":"2023-07-29T02:06:46.161104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'709","last_scrub_stamp":"2023-07-29T02:06:46.161057+0000","last_deep_scrub":"39'709","last_deep_scrub_stamp":"2023-07-29T02:06:46.161057+0000","last_clean_scrub_stamp":"2023-07-29T02:06:46.161057+0000","objects_scrubbed":344,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:39.302145+0000","scrub_duration":0.14397623400000001,"objects_trimmed":2,"snaptrim_duration":0.47715394799999999,"stat_sum":{"num_bytes":40554601,"num_objects":344,"num_object_clones":0,"num_object_copies":1376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":344,"num_whiteouts":0,"num_read":51,"num_read_kb":15453,"num_write":703,"num_write_kb":39978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:28.531585+0000","last_change":"2023-07-29T02:06:28.531707+0000","last_active":"2023-07-29T02:06:28.531585+0000","last_peered":"2023-07-29T02:06:28.531585+0000","last_clean":"2023-07-29T02:06:28.531585+0000","last_became_active":"2023-07-29T01:59:53.171467+0000","last_became_peered":"2023-07-29T01:59:53.171467+0000","last_unstale":"2023-07-29T02:06:28.531585+0000","last_undegraded":"2023-07-29T02:06:28.531585+0000","last_fullsized":"2023-07-29T02:06:28.531585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:28.531559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:28.531559+0000","last_clean_scrub_stamp":"2023-07-29T02:06:28.531559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:01:40.717070+0000","scrub_duration":0.0018899190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"39'254","reported_seq":302,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:29.161357+0000","last_change":"2023-07-29T02:06:29.161511+0000","last_active":"2023-07-29T02:06:29.161357+0000","last_peered":"2023-07-29T02:06:29.161357+0000","last_clean":"2023-07-29T02:06:29.161357+0000","last_became_active":"2023-07-29T01:59:57.549151+0000","last_became_peered":"2023-07-29T01:59:57.549151+0000","last_unstale":"2023-07-29T02:06:29.161357+0000","last_undegraded":"2023-07-29T02:06:29.161357+0000","last_fullsized":"2023-07-29T02:06:29.161357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'254","last_scrub_stamp":"2023-07-29T02:06:29.161311+0000","last_deep_scrub":"39'254","last_deep_scrub_stamp":"2023-07-29T02:06:29.161311+0000","last_clean_scrub_stamp":"2023-07-29T02:06:29.161311+0000","objects_scrubbed":5,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:18:19.865681+0000","scrub_duration":0.023803841999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":11035,"num_write":246,"num_write_kb":12456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25322,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"39'88","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:37.239617+0000","last_change":"2023-07-29T02:06:37.239734+0000","last_active":"2023-07-29T02:06:37.239617+0000","last_peered":"2023-07-29T02:06:37.239617+0000","last_clean":"2023-07-29T02:06:37.239617+0000","last_became_active":"2023-07-29T01:59:57.969273+0000","last_became_peered":"2023-07-29T01:59:57.969273+0000","last_unstale":"2023-07-29T02:06:37.239617+0000","last_undegraded":"2023-07-29T02:06:37.239617+0000","last_fullsized":"2023-07-29T02:06:37.239617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'88","last_scrub_stamp":"2023-07-29T02:06:37.239591+0000","last_deep_scrub":"39'88","last_deep_scrub_stamp":"2023-07-29T02:06:37.239591+0000","last_clean_scrub_stamp":"2023-07-29T02:06:37.239591+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:40.493500+0000","scrub_duration":0.0016482389999999999,"objects_trimmed":0,"snaptrim_duration":0.53741308300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"39'639","reported_seq":2756,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:53.677441+0000","last_change":"2023-07-29T02:06:53.677598+0000","last_active":"2023-07-29T02:06:53.677441+0000","last_peered":"2023-07-29T02:06:53.677441+0000","last_clean":"2023-07-29T02:06:53.677441+0000","last_became_active":"2023-07-29T02:00:01.992406+0000","last_became_peered":"2023-07-29T02:00:01.992406+0000","last_unstale":"2023-07-29T02:06:53.677441+0000","last_undegraded":"2023-07-29T02:06:53.677441+0000","last_fullsized":"2023-07-29T02:06:53.677441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'639","last_scrub_stamp":"2023-07-29T02:06:53.677416+0000","last_deep_scrub":"39'639","last_deep_scrub_stamp":"2023-07-29T02:06:53.677416+0000","last_clean_scrub_stamp":"2023-07-29T02:06:53.677416+0000","objects_scrubbed":323,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:06:50.762214+0000","scrub_duration":0.120386481,"objects_trimmed":0,"snaptrim_duration":0.18856821800000001,"stat_sum":{"num_bytes":24792794,"num_objects":323,"num_object_clones":0,"num_object_copies":1292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":323,"num_whiteouts":0,"num_read":32,"num_read_kb":11492,"num_write":639,"num_write_kb":27823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:33.505179+0000","last_change":"2023-07-29T02:06:33.505289+0000","last_active":"2023-07-29T02:06:33.505179+0000","last_peered":"2023-07-29T02:06:33.505179+0000","last_clean":"2023-07-29T02:06:33.505179+0000","last_became_active":"2023-07-29T01:59:53.171440+0000","last_became_peered":"2023-07-29T01:59:53.171440+0000","last_unstale":"2023-07-29T02:06:33.505179+0000","last_undegraded":"2023-07-29T02:06:33.505179+0000","last_fullsized":"2023-07-29T02:06:33.505179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:33.505144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:33.505144+0000","last_clean_scrub_stamp":"2023-07-29T02:06:33.505144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:28.623295+0000","scrub_duration":0.0017891820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"39'8","reported_seq":54,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:37.053724+0000","last_change":"2023-07-29T02:06:37.053856+0000","last_active":"2023-07-29T02:06:37.053724+0000","last_peered":"2023-07-29T02:06:37.053724+0000","last_clean":"2023-07-29T02:06:37.053724+0000","last_became_active":"2023-07-29T01:59:57.537665+0000","last_became_peered":"2023-07-29T01:59:57.537665+0000","last_unstale":"2023-07-29T02:06:37.053724+0000","last_undegraded":"2023-07-29T02:06:37.053724+0000","last_fullsized":"2023-07-29T02:06:37.053724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2023-07-29T02:06:37.053696+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2023-07-29T02:06:37.053696+0000","last_clean_scrub_stamp":"2023-07-29T02:06:37.053696+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:12:59.646704+0000","scrub_duration":0.016447590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":4,"num_write_kb":8199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6040,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"39'84","reported_seq":2147,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:50.033127+0000","last_change":"2023-07-29T02:06:50.033280+0000","last_active":"2023-07-29T02:06:50.033127+0000","last_peered":"2023-07-29T02:06:50.033127+0000","last_clean":"2023-07-29T02:06:50.033127+0000","last_became_active":"2023-07-29T01:59:57.968373+0000","last_became_peered":"2023-07-29T01:59:57.968373+0000","last_unstale":"2023-07-29T02:06:50.033127+0000","last_undegraded":"2023-07-29T02:06:50.033127+0000","last_fullsized":"2023-07-29T02:06:50.033127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'84","last_scrub_stamp":"2023-07-29T02:06:50.033099+0000","last_deep_scrub":"39'84","last_deep_scrub_stamp":"2023-07-29T02:06:50.033099+0000","last_clean_scrub_stamp":"2023-07-29T02:06:50.033099+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:43.174188+0000","scrub_duration":0.001497473,"objects_trimmed":0,"snaptrim_duration":0.21661398800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"39'634","reported_seq":2722,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.448266+0000","last_change":"2023-07-29T02:03:57.040708+0000","last_active":"2023-07-29T02:06:19.448266+0000","last_peered":"2023-07-29T02:06:19.448266+0000","last_clean":"2023-07-29T02:06:19.448266+0000","last_became_active":"2023-07-29T02:00:01.984476+0000","last_became_peered":"2023-07-29T02:00:01.984476+0000","last_unstale":"2023-07-29T02:06:19.448266+0000","last_undegraded":"2023-07-29T02:06:19.448266+0000","last_fullsized":"2023-07-29T02:06:19.448266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.55548792300000005,"stat_sum":{"num_bytes":35592378,"num_objects":339,"num_object_clones":0,"num_object_copies":1356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":339,"num_whiteouts":0,"num_read":38,"num_read_kb":16563,"num_write":635,"num_write_kb":39103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:34.723044+0000","last_change":"2023-07-29T02:06:34.723187+0000","last_active":"2023-07-29T02:06:34.723044+0000","last_peered":"2023-07-29T02:06:34.723044+0000","last_clean":"2023-07-29T02:06:34.723044+0000","last_became_active":"2023-07-29T01:59:53.171617+0000","last_became_peered":"2023-07-29T01:59:53.171617+0000","last_unstale":"2023-07-29T02:06:34.723044+0000","last_undegraded":"2023-07-29T02:06:34.723044+0000","last_fullsized":"2023-07-29T02:06:34.723044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:34.723018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:34.723018+0000","last_clean_scrub_stamp":"2023-07-29T02:06:34.723018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:37.976927+0000","scrub_duration":0.0020343689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"39'22","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:02.481326+0000","last_change":"2023-07-29T02:07:02.481441+0000","last_active":"2023-07-29T02:07:02.481326+0000","last_peered":"2023-07-29T02:07:02.481326+0000","last_clean":"2023-07-29T02:07:02.481326+0000","last_became_active":"2023-07-29T01:59:57.540449+0000","last_became_peered":"2023-07-29T01:59:57.540449+0000","last_unstale":"2023-07-29T02:07:02.481326+0000","last_undegraded":"2023-07-29T02:07:02.481326+0000","last_fullsized":"2023-07-29T02:07:02.481326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'22","last_scrub_stamp":"2023-07-29T02:07:02.481294+0000","last_deep_scrub":"39'22","last_deep_scrub_stamp":"2023-07-29T02:07:02.481294+0000","last_clean_scrub_stamp":"2023-07-29T02:07:02.481294+0000","objects_scrubbed":8,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:50:08.265414+0000","scrub_duration":0.014142849000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":67930,"num_omap_keys":113,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"39'91","reported_seq":2154,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.383474+0000","last_change":"2023-07-29T02:06:41.383581+0000","last_active":"2023-07-29T02:06:41.383474+0000","last_peered":"2023-07-29T02:06:41.383474+0000","last_clean":"2023-07-29T02:06:41.383474+0000","last_became_active":"2023-07-29T01:59:57.967933+0000","last_became_peered":"2023-07-29T01:59:57.967933+0000","last_unstale":"2023-07-29T02:06:41.383474+0000","last_undegraded":"2023-07-29T02:06:41.383474+0000","last_fullsized":"2023-07-29T02:06:41.383474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'91","last_scrub_stamp":"2023-07-29T02:06:41.383445+0000","last_deep_scrub":"39'91","last_deep_scrub_stamp":"2023-07-29T02:06:41.383445+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.383445+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:38.898362+0000","scrub_duration":0.001572709,"objects_trimmed":0,"snaptrim_duration":0.54069509900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"39'665","reported_seq":2787,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:55.193248+0000","last_change":"2023-07-29T02:06:55.193374+0000","last_active":"2023-07-29T02:06:55.193248+0000","last_peered":"2023-07-29T02:06:55.193248+0000","last_clean":"2023-07-29T02:06:55.193248+0000","last_became_active":"2023-07-29T02:00:01.984691+0000","last_became_peered":"2023-07-29T02:00:01.984691+0000","last_unstale":"2023-07-29T02:06:55.193248+0000","last_undegraded":"2023-07-29T02:06:55.193248+0000","last_fullsized":"2023-07-29T02:06:55.193248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'665","last_scrub_stamp":"2023-07-29T02:06:55.193222+0000","last_deep_scrub":"39'665","last_deep_scrub_stamp":"2023-07-29T02:06:55.193222+0000","last_clean_scrub_stamp":"2023-07-29T02:06:55.193222+0000","objects_scrubbed":316,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:45.226144+0000","scrub_duration":0.11315589700000001,"objects_trimmed":0,"snaptrim_duration":0.204776021,"stat_sum":{"num_bytes":24859419,"num_objects":316,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":316,"num_whiteouts":0,"num_read":37,"num_read_kb":6702,"num_write":664,"num_write_kb":28713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:32.106823+0000","last_change":"2023-07-29T02:06:32.106957+0000","last_active":"2023-07-29T02:06:32.106823+0000","last_peered":"2023-07-29T02:06:32.106823+0000","last_clean":"2023-07-29T02:06:32.106823+0000","last_became_active":"2023-07-29T01:59:53.171463+0000","last_became_peered":"2023-07-29T01:59:53.171463+0000","last_unstale":"2023-07-29T02:06:32.106823+0000","last_undegraded":"2023-07-29T02:06:32.106823+0000","last_fullsized":"2023-07-29T02:06:32.106823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:32.106799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:32.106799+0000","last_clean_scrub_stamp":"2023-07-29T02:06:32.106799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:45.683196+0000","scrub_duration":0.0021981660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"39'9","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:33.194543+0000","last_change":"2023-07-29T02:06:33.194659+0000","last_active":"2023-07-29T02:06:33.194543+0000","last_peered":"2023-07-29T02:06:33.194543+0000","last_clean":"2023-07-29T02:06:33.194543+0000","last_became_active":"2023-07-29T01:59:57.549181+0000","last_became_peered":"2023-07-29T01:59:57.549181+0000","last_unstale":"2023-07-29T02:06:33.194543+0000","last_undegraded":"2023-07-29T02:06:33.194543+0000","last_fullsized":"2023-07-29T02:06:33.194543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'9","last_scrub_stamp":"2023-07-29T02:06:33.194518+0000","last_deep_scrub":"39'9","last_deep_scrub_stamp":"2023-07-29T02:06:33.194518+0000","last_clean_scrub_stamp":"2023-07-29T02:06:33.194518+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:28.312669+0000","scrub_duration":0.0098727299999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11674,"num_omap_keys":20,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"39'97","reported_seq":2160,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:28.363951+0000","last_change":"2023-07-29T02:06:28.364094+0000","last_active":"2023-07-29T02:06:28.363951+0000","last_peered":"2023-07-29T02:06:28.363951+0000","last_clean":"2023-07-29T02:06:28.363951+0000","last_became_active":"2023-07-29T01:59:57.963659+0000","last_became_peered":"2023-07-29T01:59:57.963659+0000","last_unstale":"2023-07-29T02:06:28.363951+0000","last_undegraded":"2023-07-29T02:06:28.363951+0000","last_fullsized":"2023-07-29T02:06:28.363951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'97","last_scrub_stamp":"2023-07-29T02:06:28.363914+0000","last_deep_scrub":"39'97","last_deep_scrub_stamp":"2023-07-29T02:06:28.363914+0000","last_clean_scrub_stamp":"2023-07-29T02:06:28.363914+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:48.334283+0000","scrub_duration":0.001843236,"objects_trimmed":0,"snaptrim_duration":0.55193447900000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"39'682","reported_seq":2772,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.448222+0000","last_change":"2023-07-29T02:03:57.036172+0000","last_active":"2023-07-29T02:06:19.448222+0000","last_peered":"2023-07-29T02:06:19.448222+0000","last_clean":"2023-07-29T02:06:19.448222+0000","last_became_active":"2023-07-29T02:00:01.983744+0000","last_became_peered":"2023-07-29T02:00:01.983744+0000","last_unstale":"2023-07-29T02:06:19.448222+0000","last_undegraded":"2023-07-29T02:06:19.448222+0000","last_fullsized":"2023-07-29T02:06:19.448222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.552203522,"stat_sum":{"num_bytes":32278530,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":40,"num_read_kb":16416,"num_write":683,"num_write_kb":31830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:28.151338+0000","last_change":"2023-07-29T02:06:28.151465+0000","last_active":"2023-07-29T02:06:28.151338+0000","last_peered":"2023-07-29T02:06:28.151338+0000","last_clean":"2023-07-29T02:06:28.151338+0000","last_became_active":"2023-07-29T01:59:52.448814+0000","last_became_peered":"2023-07-29T01:59:52.448814+0000","last_unstale":"2023-07-29T02:06:28.151338+0000","last_undegraded":"2023-07-29T02:06:28.151338+0000","last_fullsized":"2023-07-29T02:06:28.151338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:28.151312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:28.151312+0000","last_clean_scrub_stamp":"2023-07-29T02:06:28.151312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:01:18.856007+0000","scrub_duration":0.0019737660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"39'428","reported_seq":473,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:38.773403+0000","last_change":"2023-07-29T02:06:38.773525+0000","last_active":"2023-07-29T02:06:38.773403+0000","last_peered":"2023-07-29T02:06:38.773403+0000","last_clean":"2023-07-29T02:06:38.773403+0000","last_became_active":"2023-07-29T01:59:57.544317+0000","last_became_peered":"2023-07-29T01:59:57.544317+0000","last_unstale":"2023-07-29T02:06:38.773403+0000","last_undegraded":"2023-07-29T02:06:38.773403+0000","last_fullsized":"2023-07-29T02:06:38.773403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'428","last_scrub_stamp":"2023-07-29T02:06:38.773375+0000","last_deep_scrub":"39'428","last_deep_scrub_stamp":"2023-07-29T02:06:38.773375+0000","last_clean_scrub_stamp":"2023-07-29T02:06:38.773375+0000","objects_scrubbed":3,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:36.288292+0000","scrub_duration":0.023010361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":424,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"39'90","reported_seq":2153,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:34.198334+0000","last_change":"2023-07-29T02:06:34.198474+0000","last_active":"2023-07-29T02:06:34.198334+0000","last_peered":"2023-07-29T02:06:34.198334+0000","last_clean":"2023-07-29T02:06:34.198334+0000","last_became_active":"2023-07-29T01:59:57.969642+0000","last_became_peered":"2023-07-29T01:59:57.969642+0000","last_unstale":"2023-07-29T02:06:34.198334+0000","last_undegraded":"2023-07-29T02:06:34.198334+0000","last_fullsized":"2023-07-29T02:06:34.198334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'90","last_scrub_stamp":"2023-07-29T02:06:34.198306+0000","last_deep_scrub":"39'90","last_deep_scrub_stamp":"2023-07-29T02:06:34.198306+0000","last_clean_scrub_stamp":"2023-07-29T02:06:34.198306+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:54.168675+0000","scrub_duration":0.0019970069999999999,"objects_trimmed":0,"snaptrim_duration":0.53741660000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"39'637","reported_seq":2766,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:52.533133+0000","last_change":"2023-07-29T02:06:52.533376+0000","last_active":"2023-07-29T02:06:52.533133+0000","last_peered":"2023-07-29T02:06:52.533133+0000","last_clean":"2023-07-29T02:06:52.533133+0000","last_became_active":"2023-07-29T02:00:01.998715+0000","last_became_peered":"2023-07-29T02:00:01.998715+0000","last_unstale":"2023-07-29T02:06:52.533133+0000","last_undegraded":"2023-07-29T02:06:52.533133+0000","last_fullsized":"2023-07-29T02:06:52.533133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'637","last_scrub_stamp":"2023-07-29T02:06:52.533107+0000","last_deep_scrub":"39'637","last_deep_scrub_stamp":"2023-07-29T02:06:52.533107+0000","last_clean_scrub_stamp":"2023-07-29T02:06:52.533107+0000","objects_scrubbed":317,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:53:35.163365+0000","scrub_duration":0.114413124,"objects_trimmed":0,"snaptrim_duration":0.54131381700000003,"stat_sum":{"num_bytes":21401745,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":45,"num_read_kb":12330,"num_write":635,"num_write_kb":33528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"39'140","reported_seq":184,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:38.331660+0000","last_change":"2023-07-29T02:06:38.331785+0000","last_active":"2023-07-29T02:06:38.331660+0000","last_peered":"2023-07-29T02:06:38.331660+0000","last_clean":"2023-07-29T02:06:38.331660+0000","last_became_active":"2023-07-29T01:59:57.545744+0000","last_became_peered":"2023-07-29T01:59:57.545744+0000","last_unstale":"2023-07-29T02:06:38.331660+0000","last_undegraded":"2023-07-29T02:06:38.331660+0000","last_fullsized":"2023-07-29T02:06:38.331660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'140","last_scrub_stamp":"2023-07-29T02:06:38.331635+0000","last_deep_scrub":"39'140","last_deep_scrub_stamp":"2023-07-29T02:06:38.331635+0000","last_clean_scrub_stamp":"2023-07-29T02:06:38.331635+0000","objects_scrubbed":4,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:16.541693+0000","scrub_duration":0.014197192000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":139,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22538,"num_omap_keys":38,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"39'92","reported_seq":2154,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:29.765400+0000","last_change":"2023-07-29T02:06:29.765521+0000","last_active":"2023-07-29T02:06:29.765400+0000","last_peered":"2023-07-29T02:06:29.765400+0000","last_clean":"2023-07-29T02:06:29.765400+0000","last_became_active":"2023-07-29T01:59:57.970252+0000","last_became_peered":"2023-07-29T01:59:57.970252+0000","last_unstale":"2023-07-29T02:06:29.765400+0000","last_undegraded":"2023-07-29T02:06:29.765400+0000","last_fullsized":"2023-07-29T02:06:29.765400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'92","last_scrub_stamp":"2023-07-29T02:06:29.765372+0000","last_deep_scrub":"39'92","last_deep_scrub_stamp":"2023-07-29T02:06:29.765372+0000","last_clean_scrub_stamp":"2023-07-29T02:06:29.765372+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:59:27.382387+0000","scrub_duration":0.0016174830000000001,"objects_trimmed":0,"snaptrim_duration":0.46822948199999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"39'637","reported_seq":2724,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.452797+0000","last_change":"2023-07-29T02:03:56.694563+0000","last_active":"2023-07-29T02:06:07.452797+0000","last_peered":"2023-07-29T02:06:07.452797+0000","last_clean":"2023-07-29T02:06:07.452797+0000","last_became_active":"2023-07-29T02:00:01.989481+0000","last_became_peered":"2023-07-29T02:00:01.989481+0000","last_unstale":"2023-07-29T02:06:07.452797+0000","last_undegraded":"2023-07-29T02:06:07.452797+0000","last_fullsized":"2023-07-29T02:06:07.452797+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.187630984,"stat_sum":{"num_bytes":25047033,"num_objects":309,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":38,"num_read_kb":8227,"num_write":637,"num_write_kb":24796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"39'117","reported_seq":166,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.700467+0000","last_change":"2023-07-29T02:06:41.700574+0000","last_active":"2023-07-29T02:06:41.700467+0000","last_peered":"2023-07-29T02:06:41.700467+0000","last_clean":"2023-07-29T02:06:41.700467+0000","last_became_active":"2023-07-29T01:59:57.543445+0000","last_became_peered":"2023-07-29T01:59:57.543445+0000","last_unstale":"2023-07-29T02:06:41.700467+0000","last_undegraded":"2023-07-29T02:06:41.700467+0000","last_fullsized":"2023-07-29T02:06:41.700467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'117","last_scrub_stamp":"2023-07-29T02:06:41.700441+0000","last_deep_scrub":"39'117","last_deep_scrub_stamp":"2023-07-29T02:06:41.700441+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.700441+0000","objects_scrubbed":5,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:19.910499+0000","scrub_duration":0.011827798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":114,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":38984,"num_omap_keys":65,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"39'90","reported_seq":2152,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:28.472206+0000","last_change":"2023-07-29T02:06:28.472340+0000","last_active":"2023-07-29T02:06:28.472206+0000","last_peered":"2023-07-29T02:06:28.472206+0000","last_clean":"2023-07-29T02:06:28.472206+0000","last_became_active":"2023-07-29T01:59:57.964925+0000","last_became_peered":"2023-07-29T01:59:57.964925+0000","last_unstale":"2023-07-29T02:06:28.472206+0000","last_undegraded":"2023-07-29T02:06:28.472206+0000","last_fullsized":"2023-07-29T02:06:28.472206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'90","last_scrub_stamp":"2023-07-29T02:06:28.472178+0000","last_deep_scrub":"39'90","last_deep_scrub_stamp":"2023-07-29T02:06:28.472178+0000","last_clean_scrub_stamp":"2023-07-29T02:06:28.472178+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:06.682236+0000","scrub_duration":0.0018172119999999999,"objects_trimmed":0,"snaptrim_duration":0.35003659399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'665","reported_seq":2751,"reported_epoch":39,"state":"active+clean+scrubbing+deep","last_fresh":"2023-07-29T02:06:24.778932+0000","last_change":"2023-07-29T02:06:52.520390+0000","last_active":"2023-07-29T02:06:24.778932+0000","last_peered":"2023-07-29T02:06:24.778932+0000","last_clean":"2023-07-29T02:06:24.778932+0000","last_became_active":"2023-07-29T02:00:01.985310+0000","last_became_peered":"2023-07-29T02:00:01.985310+0000","last_unstale":"2023-07-29T02:06:24.778932+0000","last_undegraded":"2023-07-29T02:06:24.778932+0000","last_fullsized":"2023-07-29T02:06:24.778932+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.31035642899999999,"stat_sum":{"num_bytes":19557603,"num_objects":304,"num_object_clones":0,"num_object_copies":1216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":304,"num_whiteouts":0,"num_read":36,"num_read_kb":35,"num_write":665,"num_write_kb":19402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"39'94","reported_seq":145,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:42.709299+0000","last_change":"2023-07-29T02:06:42.709432+0000","last_active":"2023-07-29T02:06:42.709299+0000","last_peered":"2023-07-29T02:06:42.709299+0000","last_clean":"2023-07-29T02:06:42.709299+0000","last_became_active":"2023-07-29T01:59:57.541633+0000","last_became_peered":"2023-07-29T01:59:57.541633+0000","last_unstale":"2023-07-29T02:06:42.709299+0000","last_undegraded":"2023-07-29T02:06:42.709299+0000","last_fullsized":"2023-07-29T02:06:42.709299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'94","last_scrub_stamp":"2023-07-29T02:06:42.709271+0000","last_deep_scrub":"39'94","last_deep_scrub_stamp":"2023-07-29T02:06:42.709271+0000","last_clean_scrub_stamp":"2023-07-29T02:06:42.709271+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:13:05.302279+0000","scrub_duration":0.032654646000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":18,"num_read_kb":12303,"num_write":84,"num_write_kb":16462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":29892,"num_omap_keys":51,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"39'85","reported_seq":2147,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:26.458452+0000","last_change":"2023-07-29T02:06:26.458592+0000","last_active":"2023-07-29T02:06:26.458452+0000","last_peered":"2023-07-29T02:06:26.458452+0000","last_clean":"2023-07-29T02:06:26.458452+0000","last_became_active":"2023-07-29T01:59:57.965383+0000","last_became_peered":"2023-07-29T01:59:57.965383+0000","last_unstale":"2023-07-29T02:06:26.458452+0000","last_undegraded":"2023-07-29T02:06:26.458452+0000","last_fullsized":"2023-07-29T02:06:26.458452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'85","last_scrub_stamp":"2023-07-29T02:06:26.458409+0000","last_deep_scrub":"39'85","last_deep_scrub_stamp":"2023-07-29T02:06:26.458409+0000","last_clean_scrub_stamp":"2023-07-29T02:06:26.458409+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:23.973325+0000","scrub_duration":0.0020203869999999998,"objects_trimmed":0,"snaptrim_duration":0.352110162,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"39'676","reported_seq":2764,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:08.041523+0000","last_change":"2023-07-29T02:03:57.114115+0000","last_active":"2023-07-29T02:06:08.041523+0000","last_peered":"2023-07-29T02:06:08.041523+0000","last_clean":"2023-07-29T02:06:08.041523+0000","last_became_active":"2023-07-29T02:00:01.993454+0000","last_became_peered":"2023-07-29T02:00:01.993454+0000","last_unstale":"2023-07-29T02:06:08.041523+0000","last_undegraded":"2023-07-29T02:06:08.041523+0000","last_fullsized":"2023-07-29T02:06:08.041523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.33100711700000002,"stat_sum":{"num_bytes":33339861,"num_objects":341,"num_object_clones":0,"num_object_copies":1364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":0,"num_read":39,"num_read_kb":19097,"num_write":677,"num_write_kb":41065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"39'127","reported_seq":172,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:36.017890+0000","last_change":"2023-07-29T02:06:36.018010+0000","last_active":"2023-07-29T02:06:36.017890+0000","last_peered":"2023-07-29T02:06:36.017890+0000","last_clean":"2023-07-29T02:06:36.017890+0000","last_became_active":"2023-07-29T01:59:57.539181+0000","last_became_peered":"2023-07-29T01:59:57.539181+0000","last_unstale":"2023-07-29T02:06:36.017890+0000","last_undegraded":"2023-07-29T02:06:36.017890+0000","last_fullsized":"2023-07-29T02:06:36.017890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'127","last_scrub_stamp":"2023-07-29T02:06:36.017861+0000","last_deep_scrub":"39'127","last_deep_scrub_stamp":"2023-07-29T02:06:36.017861+0000","last_clean_scrub_stamp":"2023-07-29T02:06:36.017861+0000","objects_scrubbed":5,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:14.227919+0000","scrub_duration":0.025569596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":120,"num_write_kb":12364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18028,"num_omap_keys":30,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"39'91","reported_seq":2153,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:28.854141+0000","last_change":"2023-07-29T02:06:28.854311+0000","last_active":"2023-07-29T02:06:28.854141+0000","last_peered":"2023-07-29T02:06:28.854141+0000","last_clean":"2023-07-29T02:06:28.854141+0000","last_became_active":"2023-07-29T01:59:57.966580+0000","last_became_peered":"2023-07-29T01:59:57.966580+0000","last_unstale":"2023-07-29T02:06:28.854141+0000","last_undegraded":"2023-07-29T02:06:28.854141+0000","last_fullsized":"2023-07-29T02:06:28.854141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'91","last_scrub_stamp":"2023-07-29T02:06:28.854093+0000","last_deep_scrub":"39'91","last_deep_scrub_stamp":"2023-07-29T02:06:28.854093+0000","last_clean_scrub_stamp":"2023-07-29T02:06:28.854093+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:32.108002+0000","scrub_duration":0.001683281,"objects_trimmed":0,"snaptrim_duration":0.38010548900000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"39'649","reported_seq":2769,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:50.570245+0000","last_change":"2023-07-29T02:06:50.570454+0000","last_active":"2023-07-29T02:06:50.570245+0000","last_peered":"2023-07-29T02:06:50.570245+0000","last_clean":"2023-07-29T02:06:50.570245+0000","last_became_active":"2023-07-29T02:00:01.985554+0000","last_became_peered":"2023-07-29T02:00:01.985554+0000","last_unstale":"2023-07-29T02:06:50.570245+0000","last_undegraded":"2023-07-29T02:06:50.570245+0000","last_fullsized":"2023-07-29T02:06:50.570245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'649","last_scrub_stamp":"2023-07-29T02:06:50.570218+0000","last_deep_scrub":"39'649","last_deep_scrub_stamp":"2023-07-29T02:06:50.570218+0000","last_clean_scrub_stamp":"2023-07-29T02:06:50.570218+0000","objects_scrubbed":290,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:33:24.431230+0000","scrub_duration":0.124491425,"objects_trimmed":0,"snaptrim_duration":0.53877218400000004,"stat_sum":{"num_bytes":39819276,"num_objects":290,"num_object_clones":0,"num_object_copies":1160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":290,"num_whiteouts":0,"num_read":38,"num_read_kb":16418,"num_write":646,"num_write_kb":43313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"39'140","reported_seq":191,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:40.302084+0000","last_change":"2023-07-29T02:06:40.302188+0000","last_active":"2023-07-29T02:06:40.302084+0000","last_peered":"2023-07-29T02:06:40.302084+0000","last_clean":"2023-07-29T02:06:40.302084+0000","last_became_active":"2023-07-29T01:59:57.537457+0000","last_became_peered":"2023-07-29T01:59:57.537457+0000","last_unstale":"2023-07-29T02:06:40.302084+0000","last_undegraded":"2023-07-29T02:06:40.302084+0000","last_fullsized":"2023-07-29T02:06:40.302084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'140","last_scrub_stamp":"2023-07-29T02:06:40.302059+0000","last_deep_scrub":"39'140","last_deep_scrub_stamp":"2023-07-29T02:06:40.302059+0000","last_clean_scrub_stamp":"2023-07-29T02:06:40.302059+0000","objects_scrubbed":5,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:45:14.737193+0000","scrub_duration":0.022800549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":132,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12841,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"39'109","reported_seq":2160,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.438026+0000","last_change":"2023-07-29T02:03:57.113779+0000","last_active":"2023-07-29T02:06:18.438026+0000","last_peered":"2023-07-29T02:06:18.438026+0000","last_clean":"2023-07-29T02:06:18.438026+0000","last_became_active":"2023-07-29T01:59:57.960318+0000","last_became_peered":"2023-07-29T01:59:57.960318+0000","last_unstale":"2023-07-29T02:06:18.438026+0000","last_undegraded":"2023-07-29T02:06:18.438026+0000","last_fullsized":"2023-07-29T02:06:18.438026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.32984874600000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"39'107","reported_seq":2171,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:59.145066+0000","last_change":"2023-07-29T02:06:59.145205+0000","last_active":"2023-07-29T02:06:59.145066+0000","last_peered":"2023-07-29T02:06:59.145066+0000","last_clean":"2023-07-29T02:06:59.145066+0000","last_became_active":"2023-07-29T01:59:57.959960+0000","last_became_peered":"2023-07-29T01:59:57.959960+0000","last_unstale":"2023-07-29T02:06:59.145066+0000","last_undegraded":"2023-07-29T02:06:59.145066+0000","last_fullsized":"2023-07-29T02:06:59.145066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'107","last_scrub_stamp":"2023-07-29T02:06:59.145036+0000","last_deep_scrub":"39'107","last_deep_scrub_stamp":"2023-07-29T02:06:59.145036+0000","last_clean_scrub_stamp":"2023-07-29T02:06:59.145036+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:53:41.775294+0000","scrub_duration":0.0028364250000000001,"objects_trimmed":0,"snaptrim_duration":0.22491762700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"39'110","reported_seq":2163,"reported_epoch":39,"state":"active+clean+scrubbing+deep","last_fresh":"2023-07-29T02:06:23.710608+0000","last_change":"2023-07-29T02:06:46.068312+0000","last_active":"2023-07-29T02:06:23.710608+0000","last_peered":"2023-07-29T02:06:23.710608+0000","last_clean":"2023-07-29T02:06:23.710608+0000","last_became_active":"2023-07-29T01:59:57.975384+0000","last_became_peered":"2023-07-29T01:59:57.975384+0000","last_unstale":"2023-07-29T02:06:23.710608+0000","last_undegraded":"2023-07-29T02:06:23.710608+0000","last_fullsized":"2023-07-29T02:06:23.710608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.38175464599999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"39'101","reported_seq":2164,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:30.442599+0000","last_change":"2023-07-29T02:06:30.442707+0000","last_active":"2023-07-29T02:06:30.442599+0000","last_peered":"2023-07-29T02:06:30.442599+0000","last_clean":"2023-07-29T02:06:30.442599+0000","last_became_active":"2023-07-29T01:59:57.967603+0000","last_became_peered":"2023-07-29T01:59:57.967603+0000","last_unstale":"2023-07-29T02:06:30.442599+0000","last_undegraded":"2023-07-29T02:06:30.442599+0000","last_fullsized":"2023-07-29T02:06:30.442599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'101","last_scrub_stamp":"2023-07-29T02:06:30.442572+0000","last_deep_scrub":"39'101","last_deep_scrub_stamp":"2023-07-29T02:06:30.442572+0000","last_clean_scrub_stamp":"2023-07-29T02:06:30.442572+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:12:53.035580+0000","scrub_duration":0.001551853,"objects_trimmed":0,"snaptrim_duration":0.350807488,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"39'99","reported_seq":2162,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:56.069929+0000","last_change":"2023-07-29T02:06:56.070035+0000","last_active":"2023-07-29T02:06:56.069929+0000","last_peered":"2023-07-29T02:06:56.069929+0000","last_clean":"2023-07-29T02:06:56.069929+0000","last_became_active":"2023-07-29T01:59:57.966672+0000","last_became_peered":"2023-07-29T01:59:57.966672+0000","last_unstale":"2023-07-29T02:06:56.069929+0000","last_undegraded":"2023-07-29T02:06:56.069929+0000","last_fullsized":"2023-07-29T02:06:56.069929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'99","last_scrub_stamp":"2023-07-29T02:06:56.069903+0000","last_deep_scrub":"39'99","last_deep_scrub_stamp":"2023-07-29T02:06:56.069903+0000","last_clean_scrub_stamp":"2023-07-29T02:06:56.069903+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:36:54.809998+0000","scrub_duration":0.001739141,"objects_trimmed":0,"snaptrim_duration":0.39433596799999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"39'79","reported_seq":2142,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:46.360697+0000","last_change":"2023-07-29T02:06:46.360780+0000","last_active":"2023-07-29T02:06:46.360697+0000","last_peered":"2023-07-29T02:06:46.360697+0000","last_clean":"2023-07-29T02:06:46.360697+0000","last_became_active":"2023-07-29T01:59:57.968449+0000","last_became_peered":"2023-07-29T01:59:57.968449+0000","last_unstale":"2023-07-29T02:06:46.360697+0000","last_undegraded":"2023-07-29T02:06:46.360697+0000","last_fullsized":"2023-07-29T02:06:46.360697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'79","last_scrub_stamp":"2023-07-29T02:06:46.360676+0000","last_deep_scrub":"39'79","last_deep_scrub_stamp":"2023-07-29T02:06:46.360676+0000","last_clean_scrub_stamp":"2023-07-29T02:06:46.360676+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:13:08.953684+0000","scrub_duration":0.0019273090000000001,"objects_trimmed":0,"snaptrim_duration":0.54020755499999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":918109411,"num_objects":10156,"num_object_clones":0,"num_object_copies":40624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10156,"num_whiteouts":0,"num_read":1251,"num_read_kb":366219,"num_write":20741,"num_write_kb":1040888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1801588736,"data_stored":1952841728,"data_compressed":122947712,"data_compressed_allocated":138481664,"data_compressed_original":289734656,"omap_allocated":0,"internal_metadata":0},"log_size":20769,"ondisk_log_size":20769,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5774,"ondisk_log_size":5774,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":235729337,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":309,"num_read_kb":151139,"num_write":3979,"num_write_kb":234576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":586841,"num_omap_keys":984,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99180544,"data_stored":471458674,"data_compressed":61245834,"data_compressed_allocated":77144064,"data_compressed_original":449486848,"omap_allocated":0,"internal_metadata":0},"log_size":4076,"ondisk_log_size":4076,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313140,"kb_used_data":223852,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94058700,"statfs":{"total":96636764160,"available":96316108800,"internally_reserved":0,"allocated":229224448,"data_stored":300310153,"data_compressed":25236479,"data_compressed_allocated":29581312,"data_compressed_original":100917248,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.59199999999999997,"15min":0.52600000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.8690000000000002,"5min":6.0650000000000004,"15min":6.0650000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.60399999999999998,"15min":0.53600000000000003},"min":{"1min":0.27900000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":5.4450000000000003,"5min":5.4450000000000003,"15min":5.4450000000000003},"last":0.41299999999999998}]},{"osd":1,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68799999999999994,"15min":0.56699999999999995},"min":{"1min":0.30299999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.0230000000000001,"5min":10.303000000000001,"15min":10.303000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.78500000000000003,"15min":0.622},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.77800000000000002,"5min":19.527999999999999,"15min":19.527999999999999},"last":0.433}]},{"osd":2,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":2.835,"5min":1.091,"15min":0.74399999999999999},"min":{"1min":0.35099999999999998,"5min":0.307,"15min":0.307},"max":{"1min":42.037999999999997,"5min":42.037999999999997,"15min":42.037999999999997},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.64400000000000002,"15min":0.58599999999999997},"min":{"1min":0.40200000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":5.524,"5min":5.524,"15min":5.524},"last":0.46999999999999997}]},{"osd":3,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":0.77600000000000002,"15min":0.63100000000000001},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":19.533999999999999,"5min":19.533999999999999,"15min":19.533999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.39100000000000001,"5min":0.308,"15min":0.308},"max":{"1min":4.8099999999999996,"5min":4.8099999999999996,"15min":4.8099999999999996},"last":0.501}]},{"osd":4,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.52700000000000002,"15min":0.54000000000000004},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.5789999999999997,"5min":5.5789999999999997,"15min":5.5789999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.51100000000000001,"15min":0.55800000000000005},"min":{"1min":0.31900000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":0.63400000000000001}]},{"osd":5,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.32800000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":5.5499999999999998,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.57099999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":2.0819999999999999,"5min":3.621,"15min":3.621},"last":0.58499999999999996}]},{"osd":6,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.60199999999999998,"15min":0.61499999999999999},"min":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.492,"5min":5.492,"15min":5.492},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.58799999999999997,"15min":0.626},"min":{"1min":0.433,"5min":0.312,"15min":0.312},"max":{"1min":2.0609999999999999,"5min":3.488,"15min":3.488},"last":0.622}]}]},{"osd":6,"up_from":13,"seq":55834574938,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304904,"kb_used_data":241856,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":94066936,"statfs":{"total":96636764160,"available":96324542464,"internally_reserved":0,"allocated":247660544,"data_stored":288753905,"data_compressed":18888304,"data_compressed_allocated":21577728,"data_compressed_original":62894080,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.57699999999999996,"15min":0.54000000000000004},"min":{"1min":0.33200000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.65300000000000002,"5min":7,"15min":7},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.627,"15min":0.56100000000000005},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.59399999999999997,"5min":6.4619999999999997,"15min":6.4619999999999997},"last":0.56799999999999995}]},{"osd":1,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.64700000000000002,"15min":0.57699999999999996},"min":{"1min":0.317,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.70199999999999996,"5min":12.462,"15min":12.462},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.626,"15min":0.58899999999999997},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.63900000000000001,"5min":6.4130000000000003,"15min":6.4130000000000003},"last":0.54900000000000004}]},{"osd":2,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.54000000000000004,"15min":0.54400000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.629,"5min":1.367,"15min":1.367},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.60299999999999998,"15min":0.57499999999999996},"min":{"1min":0.39800000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.65600000000000003,"5min":5.5330000000000004,"15min":5.5330000000000004},"last":0.53500000000000003}]},{"osd":3,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.65700000000000003,"15min":0.59899999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70799999999999996,"5min":6.4889999999999999,"15min":6.4889999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.64500000000000002,"15min":0.61499999999999999},"min":{"1min":0.40400000000000003,"5min":0.252,"15min":0.252},"max":{"1min":0.69599999999999995,"5min":6.8559999999999999,"15min":6.8559999999999999},"last":0.66700000000000004}]},{"osd":4,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.68600000000000005,"15min":0.58799999999999997},"min":{"1min":0.30199999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.68000000000000005,"5min":24.123999999999999,"15min":24.123999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.32700000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.70999999999999996,"5min":6.3710000000000004,"15min":6.3710000000000004},"last":0.48299999999999998}]},{"osd":5,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48499999999999999,"15min":0.53900000000000003},"min":{"1min":0.33900000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68899999999999995,"5min":0.82999999999999996,"15min":1.1140000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.59499999999999997,"15min":0.58299999999999996},"min":{"1min":0.40999999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73199999999999998,"5min":6.9669999999999996,"15min":6.9669999999999996},"last":0.442}]},{"osd":7,"last update":"Sat Jul 29 02:06:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59599999999999997,"15min":0.58999999999999997},"min":{"1min":0.34999999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73299999999999998,"5min":5.484,"15min":5.484},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59599999999999997,"15min":0.61699999999999999},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.71299999999999997,"5min":5.2300000000000004,"15min":5.2300000000000004},"last":0.46700000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371564,"kb_used_data":268324,"kb_used_omap":0,"kb_used_meta":103232,"kb_avail":94000276,"statfs":{"total":96636764160,"available":96256282624,"internally_reserved":0,"allocated":274763776,"data_stored":329812996,"data_compressed":22331930,"data_compressed_allocated":25985024,"data_compressed_original":81264640,"omap_allocated":0,"internal_metadata":105709568},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.39900000000000002,"15min":0.501},"min":{"1min":0.248,"5min":0.20799999999999999,"15min":0.20399999999999999},"max":{"1min":0.505,"5min":3.7989999999999999,"15min":7.1299999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.439,"15min":0.51300000000000001},"min":{"1min":0.28399999999999997,"5min":0.23200000000000001,"15min":0.22800000000000001},"max":{"1min":4.5179999999999998,"5min":4.5179999999999998,"15min":5.4779999999999998},"last":0.47299999999999998}]},{"osd":2,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.86599999999999999},"min":{"1min":0.252,"5min":0.214,"15min":0.20899999999999999},"max":{"1min":6.1079999999999997,"5min":22.483000000000001,"15min":22.483000000000001},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.47199999999999998,"15min":0.66000000000000003},"min":{"1min":0.30399999999999999,"5min":0.27700000000000002,"15min":0.26300000000000001},"max":{"1min":2.177,"5min":3.0619999999999998,"15min":11.028},"last":0.501}]},{"osd":3,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48299999999999998,"15min":0.58799999999999997},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67400000000000004,"5min":2.9900000000000002,"15min":7.1699999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.47199999999999998,"15min":0.41499999999999998},"min":{"1min":0.33200000000000002,"5min":0.245,"15min":0.245},"max":{"1min":4.484,"5min":4.484,"15min":4.484},"last":0.54100000000000004}]},{"osd":4,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":2.2370000000000001,"5min":1.022,"15min":1.1160000000000001},"min":{"1min":0.36399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":31.68,"5min":31.68,"15min":31.68},"last":0.52500000000000002},{"interface":"front","average":{"1min":1.702,"5min":0.84499999999999997,"15min":0.91400000000000003},"min":{"1min":0.435,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":20.733000000000001,"5min":20.733000000000001,"15min":20.733000000000001},"last":0.57699999999999996}]},{"osd":5,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.65600000000000003,"15min":0.71799999999999997},"min":{"1min":0.48199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.4219999999999997,"5min":4.4219999999999997,"15min":5.391},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70499999999999996,"15min":1.0469999999999999},"min":{"1min":0.47199999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.3480000000000001,"5min":5.8849999999999998,"15min":17.994},"last":0.45900000000000002}]},{"osd":6,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63100000000000001,"15min":0.72999999999999998},"min":{"1min":0.51600000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88900000000000001,"5min":0.91300000000000003,"15min":5.452},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73899999999999999,"15min":1.0389999999999999},"min":{"1min":0.40699999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3779999999999999,"5min":5.8540000000000001,"15min":17.963999999999999},"last":0.59799999999999998}]},{"osd":7,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":0.80500000000000005,"15min":0.90900000000000003},"min":{"1min":0.51900000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":12.16,"5min":12.16,"15min":12.16},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67400000000000004,"15min":0.753},"min":{"1min":0.56100000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0269999999999999,"5min":2.9889999999999999,"15min":5.4249999999999998},"last":0.625}]}]},{"osd":0,"up_from":13,"seq":55834574938,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329076,"kb_used_data":239788,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94042764,"statfs":{"total":96636764160,"available":96299790336,"internally_reserved":0,"allocated":245542912,"data_stored":309139007,"data_compressed":23440797,"data_compressed_allocated":27287552,"data_compressed_original":91111424,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.77600000000000002,"15min":0.47799999999999998},"min":{"1min":0.20999999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.55500000000000005,"5min":39.070999999999998,"15min":39.070999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.435,"15min":0.38900000000000001},"min":{"1min":0.23000000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.439,"5min":5.0049999999999999,"15min":5.0049999999999999},"last":0.41499999999999998}]},{"osd":2,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.54600000000000004,"15min":0.45200000000000001},"min":{"1min":0.311,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.58899999999999997,"5min":10.438000000000001,"15min":10.438000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.55900000000000005,"15min":0.45700000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.51700000000000002,"5min":10.802,"15min":10.802},"last":0.51100000000000001}]},{"osd":3,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.46500000000000002,"15min":0.39900000000000002},"min":{"1min":0.251,"5min":0.246,"15min":0.246},"max":{"1min":0.48699999999999999,"5min":4.6879999999999997,"15min":4.6879999999999997},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.50900000000000001,"15min":0.45300000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.63600000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.39200000000000002}]},{"osd":4,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74099999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.67300000000000004,"15min":0.629},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.84599999999999997,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.54400000000000004}]},{"osd":5,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.374,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76900000000000002,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.63,"15min":0.624},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.84999999999999998,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.53100000000000003}]},{"osd":6,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.68000000000000005,"15min":0.64700000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92200000000000004,"5min":1.663,"15min":1.663},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.65100000000000002,"15min":0.64300000000000002},"min":{"1min":0.40500000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.74099999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.61599999999999999}]},{"osd":7,"last update":"Sat Jul 29 02:06:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.67500000000000004,"15min":0.65000000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":1.496,"15min":1.496},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.67800000000000005,"15min":0.66100000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.58699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268060,"kb_used_data":200916,"kb_used_omap":0,"kb_used_meta":67136,"kb_avail":94103780,"statfs":{"total":96636764160,"available":96362270720,"internally_reserved":0,"allocated":205737984,"data_stored":235440369,"data_compressed":13107136,"data_compressed_allocated":15015936,"data_compressed_original":44941312,"omap_allocated":0,"internal_metadata":68747264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46999999999999997,"15min":0.40000000000000002},"min":{"1min":0.255,"5min":0.222,"15min":0.182},"max":{"1min":1.198,"5min":10.795999999999999,"15min":10.795999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.54800000000000004,"15min":0.64100000000000001},"min":{"1min":0.28100000000000003,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.79300000000000004,"5min":16.536999999999999,"15min":16.536999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45900000000000002,"15min":0.54600000000000004},"min":{"1min":0.30199999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.86099999999999999,"5min":5.2160000000000002,"15min":6.1040000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.49099999999999999,"15min":0.439},"min":{"1min":0.27400000000000002,"5min":0.246,"15min":0.20100000000000001},"max":{"1min":1.2829999999999999,"5min":7.4880000000000004,"15min":7.4880000000000004},"last":0.35099999999999998}]},{"osd":3,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.438,"15min":0.40699999999999997},"min":{"1min":0.28399999999999997,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63800000000000001,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52000000000000002,"15min":0.60399999999999998},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.27300000000000002},"max":{"1min":1.2569999999999999,"5min":5.4240000000000004,"15min":6.0620000000000003},"last":0.496}]},{"osd":4,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.70099999999999996,"15min":0.64100000000000001},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":6.9989999999999997,"5min":6.9989999999999997,"15min":6.9989999999999997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67800000000000005,"15min":0.65900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.353,"5min":6.3300000000000001,"15min":6.3300000000000001},"last":0.41599999999999998}]},{"osd":5,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68600000000000005,"15min":0.65900000000000003},"min":{"1min":0.377,"5min":0.37,"15min":0.37},"max":{"1min":1.3160000000000001,"5min":6.149,"15min":6.149},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.96199999999999997,"15min":0.92800000000000005},"min":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":7.327,"5min":28.702000000000002,"15min":28.702000000000002},"last":0.58099999999999996}]},{"osd":6,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65300000000000002,"15min":0.83599999999999997},"min":{"1min":0.39800000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.90300000000000002,"5min":4.5179999999999998,"15min":9.1199999999999992},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68500000000000005,"15min":0.66000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91800000000000004,"5min":5.2530000000000001,"15min":5.2530000000000001},"last":0.75800000000000001}]},{"osd":7,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70299999999999996,"15min":0.68799999999999994},"min":{"1min":0.438,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":1.419,"5min":6.2930000000000001,"15min":6.2930000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68899999999999995,"15min":0.86699999999999999},"min":{"1min":0.42899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.4450000000000001,"5min":4.4809999999999999,"15min":9.1620000000000008},"last":0.67000000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574938,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":292752,"kb_used_data":203464,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94079088,"statfs":{"total":96636764160,"available":96336986112,"internally_reserved":0,"allocated":208347136,"data_stored":294471050,"data_compressed":26171949,"data_compressed_allocated":31100928,"data_compressed_original":117448704,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.44600000000000001,"15min":0.36799999999999999},"min":{"1min":0.25,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":7.1379999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.443,"15min":0.39300000000000002},"min":{"1min":0.29999999999999999,"5min":0.23200000000000001,"15min":0.22900000000000001},"max":{"1min":7.5380000000000003,"5min":7.5380000000000003,"15min":7.5380000000000003},"last":0.39500000000000002}]},{"osd":1,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.45100000000000001,"15min":0.38900000000000001},"min":{"1min":0.28000000000000003,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57899999999999996,"5min":9.7289999999999992,"15min":9.7289999999999992},"last":0.375},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.55400000000000005,"15min":0.442},"min":{"1min":0.32800000000000001,"5min":0.253,"15min":0.21299999999999999},"max":{"1min":7.0540000000000003,"5min":7.4989999999999997,"15min":7.4989999999999997},"last":0.437}]},{"osd":2,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":2.9060000000000001,"5min":0.90900000000000003,"15min":0.57299999999999995},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":49.343000000000004,"5min":49.343000000000004,"15min":49.343000000000004},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.53800000000000003,"15min":0.45600000000000002},"min":{"1min":0.40300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":7.1870000000000003,"5min":7.1870000000000003,"15min":7.1870000000000003},"last":0.57999999999999996}]},{"osd":4,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.68200000000000005,"15min":0.63800000000000001},"min":{"1min":0.42699999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":7.5999999999999996,"5min":7.5999999999999996,"15min":7.5999999999999996},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71599999999999997,"15min":0.65000000000000002},"min":{"1min":0.498,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.282,"5min":8.6869999999999994,"15min":8.6869999999999994},"last":0.64600000000000002}]},{"osd":5,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.61899999999999999,"15min":0.60199999999999998},"min":{"1min":0.438,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.498},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.70299999999999996,"15min":0.63200000000000001},"min":{"1min":0.49299999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":7.0060000000000002,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.52100000000000002}]},{"osd":6,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.74199999999999999,"15min":0.67100000000000004},"min":{"1min":0.443,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":7.1639999999999997,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":0.63},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.72299999999999998,"15min":0.67800000000000005},"min":{"1min":0.45200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":7.5730000000000004,"5min":7.5730000000000004,"15min":7.5730000000000004},"last":0.53900000000000003}]},{"osd":7,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":0.81899999999999995,"15min":0.68300000000000005},"min":{"1min":0.51200000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":10.901999999999999,"5min":10.901999999999999,"15min":10.901999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":1.1930000000000001,"5min":0.76000000000000001,"15min":0.68700000000000006},"min":{"1min":0.50700000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":10.943,"5min":10.943,"15min":10.943},"last":0.55300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574937,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356300,"kb_used_data":253060,"kb_used_omap":0,"kb_used_meta":103232,"kb_avail":94015540,"statfs":{"total":96636764160,"available":96271912960,"internally_reserved":0,"allocated":259133440,"data_stored":357820356,"data_compressed":30673062,"data_compressed_allocated":36298752,"data_compressed_original":135229440,"omap_allocated":0,"internal_metadata":105709568},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.60399999999999998,"15min":0.54100000000000004},"min":{"1min":0.28399999999999997,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.70099999999999996,"5min":4.4800000000000004,"15min":4.4800000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57299999999999995,"15min":0.81399999999999995},"min":{"1min":0.30099999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.67300000000000004,"5min":7.2679999999999998,"15min":12.231999999999999},"last":0.621}]},{"osd":1,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55800000000000005,"15min":0.51700000000000002},"min":{"1min":0.315,"5min":0.255,"15min":0.255},"max":{"1min":0.70599999999999996,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.38,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.82699999999999996,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.60899999999999999}]},{"osd":2,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68300000000000005,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75,"5min":0.874,"15min":0.874},"last":0.46500000000000002}]},{"osd":3,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56599999999999995,"15min":0.54400000000000004},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66500000000000004,"5min":3.9969999999999999,"15min":3.9969999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.95799999999999996,"15min":0.69399999999999995},"min":{"1min":0.46999999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72599999999999998,"5min":28.837,"15min":28.837},"last":0.57499999999999996}]},{"osd":5,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48899999999999999,"15min":0.496},"min":{"1min":0.32900000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.86299999999999999,"5min":1.8,"15min":1.8},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.34499999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81599999999999995,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.34499999999999997}]},{"osd":6,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.76900000000000002,"5min":1.006,"15min":1.006},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.40000000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.018,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.33100000000000002}]},{"osd":7,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.34999999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.38100000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.91900000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.36199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574939,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313700,"kb_used_data":228508,"kb_used_omap":0,"kb_used_meta":85184,"kb_avail":94058140,"statfs":{"total":96636764160,"available":96315535360,"internally_reserved":0,"allocated":233992192,"data_stored":311454589,"data_compressed":24408749,"data_compressed_allocated":28868608,"data_compressed_original":106561536,"omap_allocated":0,"internal_metadata":87228416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.54400000000000004,"15min":0.51400000000000001},"min":{"1min":0.23000000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.496},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.626,"15min":0.54200000000000004},"min":{"1min":0.29699999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":8.2590000000000003,"5min":8.2590000000000003,"15min":8.2590000000000003},"last":0.67400000000000004}]},{"osd":1,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.58099999999999996,"15min":0.51100000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.9179999999999999,"5min":5.9119999999999999,"15min":5.9119999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.58199999999999996,"15min":0.54800000000000004},"min":{"1min":0.32200000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":3.996,"5min":3.996,"15min":3.996},"last":0.51600000000000001}]},{"osd":2,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56499999999999995,"15min":0.51500000000000001},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":2.8929999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.70199999999999996,"15min":0.59999999999999998},"min":{"1min":0.33100000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":9.8360000000000003,"5min":9.8360000000000003,"15min":9.8360000000000003},"last":0.65700000000000003}]},{"osd":3,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.57899999999999996,"15min":0.55500000000000005},"min":{"1min":0.32100000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.83699999999999997,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.70099999999999996,"15min":0.60399999999999998},"min":{"1min":0.34300000000000003,"5min":0.314,"15min":0.314},"max":{"1min":8.1940000000000008,"5min":8.1940000000000008,"15min":8.1940000000000008},"last":0.46200000000000002}]},{"osd":4,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.49299999999999999,"15min":0.51300000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.498,"15min":0.53200000000000003},"min":{"1min":0.318,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.73299999999999998,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.377}]},{"osd":6,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.51700000000000002,"15min":0.54100000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.55600000000000005},"min":{"1min":0.35499999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.8899999999999999,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.33900000000000002}]},{"osd":7,"last update":"Sat Jul 29 02:06:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56899999999999995,"15min":0.58999999999999997},"min":{"1min":0.40699999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.60299999999999998,"15min":0.61099999999999999},"min":{"1min":0.42499999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":0.41099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12668928,"data_stored":55102798,"data_compressed":7347975,"data_compressed_allocated":9121792,"data_compressed_original":51560448,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8032256,"data_stored":42213619,"data_compressed":5201070,"data_compressed_allocated":6615040,"data_compressed_original":40800256,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":20971520,"data_compressed":2599703,"data_compressed_allocated":3166208,"data_compressed_original":19935232,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20307968,"data_stored":88080474,"data_compressed":11613220,"data_compressed_allocated":14581760,"data_compressed_original":82358272,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18108416,"data_stored":93122259,"data_compressed":11576207,"data_compressed_allocated":14704640,"data_compressed_original":89739264,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13971456,"data_stored":71303820,"data_compressed":9372464,"data_compressed_allocated":11796480,"data_compressed_original":69136384,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":33554432,"data_compressed":4791721,"data_compressed_allocated":5980160,"data_compressed_original":32194560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14548992,"data_stored":67109752,"data_compressed":8743474,"data_compressed_allocated":11177984,"data_compressed_original":63762432,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":232435712,"data_stored":253820928,"data_compressed":16092822,"data_compressed_allocated":18165760,"data_compressed_original":39550976,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":266227712,"data_stored":286793728,"data_compressed":17098430,"data_compressed_allocated":19324928,"data_compressed_original":39890944,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":201097216,"data_stored":214253568,"data_compressed":10507433,"data_compressed_allocated":11849728,"data_compressed_original":25006080,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":187604992,"data_stored":206176256,"data_compressed":14558729,"data_compressed_allocated":16519168,"data_compressed_original":35090432,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":240586752,"data_stored":264482816,"data_compressed":19096855,"data_compressed_allocated":21594112,"data_compressed_original":45490176,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":219582464,"data_stored":239935488,"data_compressed":15036285,"data_compressed_allocated":17072128,"data_compressed_original":37425152,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":239882240,"data_stored":254984192,"data_compressed":14096583,"data_compressed_allocated":15597568,"data_compressed_original":30699520,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":214171648,"data_stored":232394752,"data_compressed":16460575,"data_compressed_allocated":18358272,"data_compressed_original":36581376,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T02:07:07.066 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.067 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.067 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.068 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.068 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.068 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.069 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.069 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.070 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.070 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.070 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.071 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.071 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.071 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.072 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.072 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.072 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.073 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.073 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.074 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.074 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.074 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.075 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.075 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.075 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:07.076 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-29T02:07:07.761 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:07:07.764 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:07:27.076 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T02:07:27.217 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.237+0000 7fbb0e845700 1 Processor -- start 2023-07-29T02:07:27.218 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.237+0000 7fbb0e845700 1 -- start start 2023-07-29T02:07:27.219 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.238+0000 7fbb0e845700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbb081535c0 0x7fbb080c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:27.220 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.238+0000 7fbb0e845700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbb080ca060 0x7fbb080cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:27.220 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.238+0000 7fbb0e845700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb08153990 con 0x7fbb080cf6b0 2023-07-29T02:07:27.220 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.238+0000 7fbb0e845700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb080c5a10 con 0x7fbb081535c0 2023-07-29T02:07:27.221 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.238+0000 7fbb0e845700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0815c760 con 0x7fbb080ca060 2023-07-29T02:07:27.221 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.238+0000 7fbb07fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbb081535c0 0x7fbb080c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:27.221 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.238+0000 7fbb0cde2700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fbb080cf6b0 0x7fbb08159820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52410/0 (socket says 172.21.15.42:52410) 2023-07-29T02:07:27.222 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.238+0000 7fbb0cde2700 1 -- 172.21.15.42:0/3236283593 learned_addr learned my addr 172.21.15.42:0/3236283593 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:07:27.222 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.238+0000 7fbb07fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbb081535c0 0x7fbb080c54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58604/0 (socket says 172.21.15.42:58604) 2023-07-29T02:07:27.222 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.238+0000 7fbb077fe700 1 --2- 172.21.15.42:0/3236283593 >> v2:172.21.15.144:3300/0 conn(0x7fbb080ca060 0x7fbb080cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:27.222 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.239+0000 7fbb07fff700 1 -- 172.21.15.42:0/3236283593 >> v2:172.21.15.144:3300/0 conn(0x7fbb080ca060 msgr2=0x7fbb080cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:07:27.222 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.239+0000 7fbb07fff700 1 --2- 172.21.15.42:0/3236283593 >> v2:172.21.15.144:3300/0 conn(0x7fbb080ca060 0x7fbb080cf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:27.223 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.239+0000 7fbb07fff700 1 -- 172.21.15.42:0/3236283593 >> v1:172.21.15.42:6789/0 conn(0x7fbb080cf6b0 legacy=0x7fbb08159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:27.223 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.239+0000 7fbb07fff700 1 -- 172.21.15.42:0/3236283593 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0815ca00 con 0x7fbb081535c0 2023-07-29T02:07:27.223 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.239+0000 7fbb06ffd700 1 -- 172.21.15.42:0/3236283593 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550551609 0 0) 0x7fbb08153990 con 0x7fbb080cf6b0 2023-07-29T02:07:27.223 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.239+0000 7fbb07fff700 1 --2- 172.21.15.42:0/3236283593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb081535c0 0x7fbb080c54d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbb0808cdf0 tx=0x7fbaf8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4de42660455cf1 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:27.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.239+0000 7fbb06ffd700 1 -- 172.21.15.42:0/3236283593 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8011830 con 0x7fbb081535c0 2023-07-29T02:07:27.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.239+0000 7fbb06ffd700 1 -- 172.21.15.42:0/3236283593 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf8011990 con 0x7fbb081535c0 2023-07-29T02:07:27.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.239+0000 7fbb06ffd700 1 -- 172.21.15.42:0/3236283593 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8011d20 con 0x7fbb081535c0 2023-07-29T02:07:27.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.239+0000 7fbb0e845700 1 -- 172.21.15.42:0/3236283593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb081535c0 msgr2=0x7fbb080c54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:27.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.239+0000 7fbb0e845700 1 --2- 172.21.15.42:0/3236283593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb081535c0 0x7fbb080c54d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbb0808cdf0 tx=0x7fbaf8009b20 comp rx=0 tx=0).stop 2023-07-29T02:07:27.225 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.240+0000 7fbb0e845700 1 -- 172.21.15.42:0/3236283593 shutdown_connections 2023-07-29T02:07:27.225 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.240+0000 7fbb0e845700 1 --2- 172.21.15.42:0/3236283593 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb081535c0 0x7fbb080c54d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:27.225 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.240+0000 7fbb0e845700 1 --2- 172.21.15.42:0/3236283593 >> v2:172.21.15.144:3300/0 conn(0x7fbb080ca060 0x7fbb080cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:27.225 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.240+0000 7fbb0e845700 1 -- 172.21.15.42:0/3236283593 >> 172.21.15.42:0/3236283593 conn(0x7fbb0806cac0 msgr2=0x7fbb0806cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:27.225 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.240+0000 7fbb0e845700 1 -- 172.21.15.42:0/3236283593 shutdown_connections 2023-07-29T02:07:27.226 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.240+0000 7fbb0e845700 1 -- 172.21.15.42:0/3236283593 wait complete. 2023-07-29T02:07:27.227 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.241+0000 7fbb0e845700 1 Processor -- start 2023-07-29T02:07:27.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.241+0000 7fbb0e845700 1 -- start start 2023-07-29T02:07:27.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.242+0000 7fbb0e845700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb080ca060 0x7fbb0814cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:27.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.242+0000 7fbb0e845700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb080cf6b0 0x7fbb081e2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:27.228 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.242+0000 7fbb0e845700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb081535c0 0x7fbb081e3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:27.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.242+0000 7fbb0e845700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb081e2a50 con 0x7fbb080cf6b0 2023-07-29T02:07:27.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.242+0000 7fbb0e845700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08158240 con 0x7fbb081535c0 2023-07-29T02:07:27.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.242+0000 7fbb0e845700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb08158520 con 0x7fbb080ca060 2023-07-29T02:07:27.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.242+0000 7fbb077fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb080cf6b0 0x7fbb081e2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:27.229 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.243+0000 7fbb077fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb080cf6b0 0x7fbb081e2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58610/0 (socket says 172.21.15.42:58610) 2023-07-29T02:07:27.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.243+0000 7fbb077fe700 1 -- 172.21.15.42:0/1485213082 learned_addr learned my addr 172.21.15.42:0/1485213082 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:07:27.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.243+0000 7fbb07fff700 1 --2- 172.21.15.42:0/1485213082 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb080ca060 0x7fbb0814cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:27.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.243+0000 7fbb077fe700 1 -- 172.21.15.42:0/1485213082 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb080ca060 msgr2=0x7fbb0814cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:27.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.243+0000 7fbb077fe700 1 --2- 172.21.15.42:0/1485213082 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb080ca060 0x7fbb0814cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:27.230 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.243+0000 7fbb077fe700 1 -- 172.21.15.42:0/1485213082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb081535c0 msgr2=0x7fbb081e3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:27.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.243+0000 7fbb077fe700 1 --2- 172.21.15.42:0/1485213082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb081535c0 0x7fbb081e3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:27.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.243+0000 7fbb077fe700 1 -- 172.21.15.42:0/1485213082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf80094a0 con 0x7fbb080cf6b0 2023-07-29T02:07:27.231 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.243+0000 7fbb077fe700 1 --2- 172.21.15.42:0/1485213082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb080cf6b0 0x7fbb081e2f50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbafc00e900 tx=0x7fbafc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:27.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.243+0000 7fbb04ff9700 1 -- 172.21.15.42:0/1485213082 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc009650 con 0x7fbb080cf6b0 2023-07-29T02:07:27.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.243+0000 7fbb04ff9700 1 -- 172.21.15.42:0/1485213082 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbafc00c850 con 0x7fbb080cf6b0 2023-07-29T02:07:27.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.243+0000 7fbb04ff9700 1 -- 172.21.15.42:0/1485213082 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbafc00cbc0 con 0x7fbb080cf6b0 2023-07-29T02:07:27.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.243+0000 7fbb0e845700 1 -- 172.21.15.42:0/1485213082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb08158800 con 0x7fbb080cf6b0 2023-07-29T02:07:27.232 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.243+0000 7fbb0e845700 1 -- 172.21.15.42:0/1485213082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb08158dc0 con 0x7fbb080cf6b0 2023-07-29T02:07:27.233 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.244+0000 7fbb0e845700 1 -- 172.21.15.42:0/1485213082 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb080c6260 con 0x7fbb080cf6b0 2023-07-29T02:07:27.233 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.245+0000 7fbb04ff9700 1 -- 172.21.15.42:0/1485213082 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fbafc00cd20 con 0x7fbb080cf6b0 2023-07-29T02:07:27.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.245+0000 7fbb04ff9700 1 --2- 172.21.15.42:0/1485213082 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbaf406a660 0x7fbaf406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:27.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.245+0000 7fbb04ff9700 1 -- 172.21.15.42:0/1485213082 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7fbafc089380 con 0x7fbb080cf6b0 2023-07-29T02:07:27.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.245+0000 7fbb07fff700 1 --2- 172.21.15.42:0/1485213082 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbaf406a660 0x7fbaf406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:27.234 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.246+0000 7fbb07fff700 1 --2- 172.21.15.42:0/1485213082 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbaf406a660 0x7fbaf406cb10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8000c00 tx=0x7fbaf8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:27.235 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.250+0000 7fbb04ff9700 1 -- 172.21.15.42:0/1485213082 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fbafc0542d0 con 0x7fbb080cf6b0 2023-07-29T02:07:27.422 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.443+0000 7fbb0e845700 1 -- 172.21.15.42:0/1485213082 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb0815cfc0 con 0x7fbaf406a660 2023-07-29T02:07:27.434 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.454+0000 7fbb04ff9700 1 -- 172.21.15.42:0/1485213082 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+399208 (secure 0 0 0) 0x7fbaf8011b00 con 0x7fbaf406a660 2023-07-29T02:07:27.438 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:07:27.440 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.458+0000 7fbb0e845700 1 -- 172.21.15.42:0/1485213082 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbaf406a660 msgr2=0x7fbaf406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:27.441 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.458+0000 7fbb0e845700 1 --2- 172.21.15.42:0/1485213082 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbaf406a660 0x7fbaf406cb10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8000c00 tx=0x7fbaf8008030 comp rx=0 tx=0).stop 2023-07-29T02:07:27.441 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.458+0000 7fbb0e845700 1 -- 172.21.15.42:0/1485213082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb080cf6b0 msgr2=0x7fbb081e2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:27.441 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.458+0000 7fbb0e845700 1 --2- 172.21.15.42:0/1485213082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb080cf6b0 0x7fbb081e2f50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbafc00e900 tx=0x7fbafc00ecc0 comp rx=0 tx=0).stop 2023-07-29T02:07:27.441 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.458+0000 7fbb0e845700 1 -- 172.21.15.42:0/1485213082 shutdown_connections 2023-07-29T02:07:27.441 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.458+0000 7fbb0e845700 1 --2- 172.21.15.42:0/1485213082 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbaf406a660 0x7fbaf406cb10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:27.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.458+0000 7fbb0e845700 1 --2- 172.21.15.42:0/1485213082 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbb081535c0 0x7fbb081e3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:27.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.458+0000 7fbb0e845700 1 --2- 172.21.15.42:0/1485213082 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbb080ca060 0x7fbb0814cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:27.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.458+0000 7fbb0e845700 1 --2- 172.21.15.42:0/1485213082 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbb080cf6b0 0x7fbb081e2f50 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:27.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.458+0000 7fbb0e845700 1 -- 172.21.15.42:0/1485213082 >> 172.21.15.42:0/1485213082 conn(0x7fbb0806cac0 msgr2=0x7fbb081514a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:27.442 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.458+0000 7fbb0e845700 1 -- 172.21.15.42:0/1485213082 shutdown_connections 2023-07-29T02:07:27.443 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:27.458+0000 7fbb0e845700 1 -- 172.21.15.42:0/1485213082 wait complete. 2023-07-29T02:07:27.443 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2023-07-29T02:07:27.450 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2023-07-29T02:07:27.359645+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1154491876,"num_objects":10301,"num_object_clones":0,"num_object_copies":40914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10301,"num_whiteouts":0,"num_read":1676,"num_read_kb":517458,"num_write":24882,"num_write_kb":1277942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":586841,"num_omap_keys":984,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30741,"ondisk_log_size":30741,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2549536,"kb_used_data":1859808,"kb_used_omap":0,"kb_used_meta":689664,"kb_avail":752425184,"statfs":{"total":773094113280,"available":770483388416,"internally_reserved":0,"allocated":1904443392,"data_stored":2427327945,"data_compressed":184270656,"data_compressed_allocated":215732224,"data_compressed_original":740466688,"omap_allocated":0,"internal_metadata":706215936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003525"},"pg_stats":[{"pgid":"4.3f","version":"39'86","reported_seq":2149,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:36.889969+0000","last_change":"2023-07-29T02:06:36.890083+0000","last_active":"2023-07-29T02:06:36.889969+0000","last_peered":"2023-07-29T02:06:36.889969+0000","last_clean":"2023-07-29T02:06:36.889969+0000","last_became_active":"2023-07-29T01:59:57.957742+0000","last_became_peered":"2023-07-29T01:59:57.957742+0000","last_unstale":"2023-07-29T02:06:36.889969+0000","last_undegraded":"2023-07-29T02:06:36.889969+0000","last_fullsized":"2023-07-29T02:06:36.889969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'86","last_scrub_stamp":"2023-07-29T02:06:36.889932+0000","last_deep_scrub":"39'86","last_deep_scrub_stamp":"2023-07-29T02:06:36.889932+0000","last_clean_scrub_stamp":"2023-07-29T02:06:36.889932+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:56.860301+0000","scrub_duration":0.0015445599999999999,"objects_trimmed":0,"snaptrim_duration":0.46739399700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"39'75","reported_seq":2138,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:47.633090+0000","last_change":"2023-07-29T02:06:47.633222+0000","last_active":"2023-07-29T02:06:47.633090+0000","last_peered":"2023-07-29T02:06:47.633090+0000","last_clean":"2023-07-29T02:06:47.633090+0000","last_became_active":"2023-07-29T01:59:57.974338+0000","last_became_peered":"2023-07-29T01:59:57.974338+0000","last_unstale":"2023-07-29T02:06:47.633090+0000","last_undegraded":"2023-07-29T02:06:47.633090+0000","last_fullsized":"2023-07-29T02:06:47.633090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'75","last_scrub_stamp":"2023-07-29T02:06:47.633064+0000","last_deep_scrub":"39'75","last_deep_scrub_stamp":"2023-07-29T02:06:47.633064+0000","last_clean_scrub_stamp":"2023-07-29T02:06:47.633064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:33:21.494075+0000","scrub_duration":0.001874503,"objects_trimmed":0,"snaptrim_duration":0.30630966300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"39'90","reported_seq":2142,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.447905+0000","last_change":"2023-07-29T02:03:57.108039+0000","last_active":"2023-07-29T02:06:18.447905+0000","last_peered":"2023-07-29T02:06:18.447905+0000","last_clean":"2023-07-29T02:06:18.447905+0000","last_became_active":"2023-07-29T01:59:57.973406+0000","last_became_peered":"2023-07-29T01:59:57.973406+0000","last_unstale":"2023-07-29T02:06:18.447905+0000","last_undegraded":"2023-07-29T02:06:18.447905+0000","last_fullsized":"2023-07-29T02:06:18.447905+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.37359432399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"39'75","reported_seq":2138,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:43.061322+0000","last_change":"2023-07-29T02:06:43.061439+0000","last_active":"2023-07-29T02:06:43.061322+0000","last_peered":"2023-07-29T02:06:43.061322+0000","last_clean":"2023-07-29T02:06:43.061322+0000","last_became_active":"2023-07-29T01:59:57.964865+0000","last_became_peered":"2023-07-29T01:59:57.964865+0000","last_unstale":"2023-07-29T02:06:43.061322+0000","last_undegraded":"2023-07-29T02:06:43.061322+0000","last_fullsized":"2023-07-29T02:06:43.061322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'75","last_scrub_stamp":"2023-07-29T02:06:43.061294+0000","last_deep_scrub":"39'75","last_deep_scrub_stamp":"2023-07-29T02:06:43.061294+0000","last_clean_scrub_stamp":"2023-07-29T02:06:43.061294+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:05:34.515449+0000","scrub_duration":0.0020787169999999999,"objects_trimmed":0,"snaptrim_duration":0.22913951599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"39'102","reported_seq":2164,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:06.211404+0000","last_change":"2023-07-29T02:07:06.211504+0000","last_active":"2023-07-29T02:07:06.211404+0000","last_peered":"2023-07-29T02:07:06.211404+0000","last_clean":"2023-07-29T02:07:06.211404+0000","last_became_active":"2023-07-29T01:59:57.970733+0000","last_became_peered":"2023-07-29T01:59:57.970733+0000","last_unstale":"2023-07-29T02:07:06.211404+0000","last_undegraded":"2023-07-29T02:07:06.211404+0000","last_fullsized":"2023-07-29T02:07:06.211404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'102","last_scrub_stamp":"2023-07-29T02:07:06.211381+0000","last_deep_scrub":"39'102","last_deep_scrub_stamp":"2023-07-29T02:07:06.211381+0000","last_clean_scrub_stamp":"2023-07-29T02:07:06.211381+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:42:19.087843+0000","scrub_duration":0.001265473,"objects_trimmed":0,"snaptrim_duration":0.55358088100000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"39'92","reported_seq":2143,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:18.444391+0000","last_change":"2023-07-29T02:03:57.111935+0000","last_active":"2023-07-29T02:06:18.444391+0000","last_peered":"2023-07-29T02:06:18.444391+0000","last_clean":"2023-07-29T02:06:18.444391+0000","last_became_active":"2023-07-29T01:59:57.964993+0000","last_became_peered":"2023-07-29T01:59:57.964993+0000","last_unstale":"2023-07-29T02:06:18.444391+0000","last_undegraded":"2023-07-29T02:06:18.444391+0000","last_fullsized":"2023-07-29T02:06:18.444391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35033357399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"39'105","reported_seq":2167,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:51.524392+0000","last_change":"2023-07-29T02:06:51.524562+0000","last_active":"2023-07-29T02:06:51.524392+0000","last_peered":"2023-07-29T02:06:51.524392+0000","last_clean":"2023-07-29T02:06:51.524392+0000","last_became_active":"2023-07-29T01:59:57.970232+0000","last_became_peered":"2023-07-29T01:59:57.970232+0000","last_unstale":"2023-07-29T02:06:51.524392+0000","last_undegraded":"2023-07-29T02:06:51.524392+0000","last_fullsized":"2023-07-29T02:06:51.524392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'105","last_scrub_stamp":"2023-07-29T02:06:51.524349+0000","last_deep_scrub":"39'105","last_deep_scrub_stamp":"2023-07-29T02:06:51.524349+0000","last_clean_scrub_stamp":"2023-07-29T02:06:51.524349+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:11:34.256705+0000","scrub_duration":0.001901168,"objects_trimmed":0,"snaptrim_duration":0.18952802499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"39'74","reported_seq":2136,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:49.596322+0000","last_change":"2023-07-29T02:06:49.596442+0000","last_active":"2023-07-29T02:06:49.596322+0000","last_peered":"2023-07-29T02:06:49.596322+0000","last_clean":"2023-07-29T02:06:49.596322+0000","last_became_active":"2023-07-29T01:59:57.962884+0000","last_became_peered":"2023-07-29T01:59:57.962884+0000","last_unstale":"2023-07-29T02:06:49.596322+0000","last_undegraded":"2023-07-29T02:06:49.596322+0000","last_fullsized":"2023-07-29T02:06:49.596322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'74","last_scrub_stamp":"2023-07-29T02:06:49.596297+0000","last_deep_scrub":"39'74","last_deep_scrub_stamp":"2023-07-29T02:06:49.596297+0000","last_clean_scrub_stamp":"2023-07-29T02:06:49.596297+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:53:32.226555+0000","scrub_duration":0.0014879120000000001,"objects_trimmed":0,"snaptrim_duration":0.30152641200000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"39'84","reported_seq":2147,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:47.265092+0000","last_change":"2023-07-29T02:06:47.265092+0000","last_active":"2023-07-29T02:06:47.265092+0000","last_peered":"2023-07-29T02:06:47.265092+0000","last_clean":"2023-07-29T02:06:47.265092+0000","last_became_active":"2023-07-29T01:59:57.971640+0000","last_became_peered":"2023-07-29T01:59:57.971640+0000","last_unstale":"2023-07-29T02:06:47.265092+0000","last_undegraded":"2023-07-29T02:06:47.265092+0000","last_fullsized":"2023-07-29T02:06:47.265092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'84","last_scrub_stamp":"2023-07-29T02:06:47.264932+0000","last_deep_scrub":"39'84","last_deep_scrub_stamp":"2023-07-29T02:06:47.264932+0000","last_clean_scrub_stamp":"2023-07-29T02:06:47.264932+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:53:29.895190+0000","scrub_duration":0.001323896,"objects_trimmed":0,"snaptrim_duration":0.54966345000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"39'98","reported_seq":2161,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:46.628373+0000","last_change":"2023-07-29T02:06:46.628373+0000","last_active":"2023-07-29T02:06:46.628373+0000","last_peered":"2023-07-29T02:06:46.628373+0000","last_clean":"2023-07-29T02:06:46.628373+0000","last_became_active":"2023-07-29T01:59:57.962799+0000","last_became_peered":"2023-07-29T01:59:57.962799+0000","last_unstale":"2023-07-29T02:06:46.628373+0000","last_undegraded":"2023-07-29T02:06:46.628373+0000","last_fullsized":"2023-07-29T02:06:46.628373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'98","last_scrub_stamp":"2023-07-29T02:06:46.628226+0000","last_deep_scrub":"39'98","last_deep_scrub_stamp":"2023-07-29T02:06:46.628226+0000","last_clean_scrub_stamp":"2023-07-29T02:06:46.628226+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:16:25.595487+0000","scrub_duration":0.001832855,"objects_trimmed":0,"snaptrim_duration":0.30635943199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"39'90","reported_seq":2153,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:37.449786+0000","last_change":"2023-07-29T02:06:37.449786+0000","last_active":"2023-07-29T02:06:37.449786+0000","last_peered":"2023-07-29T02:06:37.449786+0000","last_clean":"2023-07-29T02:06:37.449786+0000","last_became_active":"2023-07-29T01:59:57.969868+0000","last_became_peered":"2023-07-29T01:59:57.969868+0000","last_unstale":"2023-07-29T02:06:37.449786+0000","last_undegraded":"2023-07-29T02:06:37.449786+0000","last_fullsized":"2023-07-29T02:06:37.449786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'90","last_scrub_stamp":"2023-07-29T02:06:37.449587+0000","last_deep_scrub":"39'90","last_deep_scrub_stamp":"2023-07-29T02:06:37.449587+0000","last_clean_scrub_stamp":"2023-07-29T02:06:37.449587+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:11:20.181943+0000","scrub_duration":0.0020192080000000002,"objects_trimmed":0,"snaptrim_duration":0.37294171199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"39'76","reported_seq":2139,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.908940+0000","last_change":"2023-07-29T02:06:39.908940+0000","last_active":"2023-07-29T02:06:39.908940+0000","last_peered":"2023-07-29T02:06:39.908940+0000","last_clean":"2023-07-29T02:06:39.908940+0000","last_became_active":"2023-07-29T01:59:57.963902+0000","last_became_peered":"2023-07-29T01:59:57.963902+0000","last_unstale":"2023-07-29T02:06:39.908940+0000","last_undegraded":"2023-07-29T02:06:39.908940+0000","last_fullsized":"2023-07-29T02:06:39.908940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'76","last_scrub_stamp":"2023-07-29T02:06:39.908800+0000","last_deep_scrub":"39'76","last_deep_scrub_stamp":"2023-07-29T02:06:39.908800+0000","last_clean_scrub_stamp":"2023-07-29T02:06:39.908800+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:43.162709+0000","scrub_duration":0.0020822839999999998,"objects_trimmed":0,"snaptrim_duration":0.46909700500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"39'81","reported_seq":2144,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:25.869573+0000","last_change":"2023-07-29T02:06:25.869573+0000","last_active":"2023-07-29T02:06:25.869573+0000","last_peered":"2023-07-29T02:06:25.869573+0000","last_clean":"2023-07-29T02:06:25.869573+0000","last_became_active":"2023-07-29T01:59:57.963239+0000","last_became_peered":"2023-07-29T01:59:57.963239+0000","last_unstale":"2023-07-29T02:06:25.869573+0000","last_undegraded":"2023-07-29T02:06:25.869573+0000","last_fullsized":"2023-07-29T02:06:25.869573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'81","last_scrub_stamp":"2023-07-29T02:06:25.869472+0000","last_deep_scrub":"39'81","last_deep_scrub_stamp":"2023-07-29T02:06:25.869472+0000","last_clean_scrub_stamp":"2023-07-29T02:06:25.869472+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:01:16.574167+0000","scrub_duration":0.0015035739999999999,"objects_trimmed":0,"snaptrim_duration":0.46603159700000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"39'92","reported_seq":2155,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:51.568747+0000","last_change":"2023-07-29T02:06:51.568747+0000","last_active":"2023-07-29T02:06:51.568747+0000","last_peered":"2023-07-29T02:06:51.568747+0000","last_clean":"2023-07-29T02:06:51.568747+0000","last_became_active":"2023-07-29T01:59:57.960709+0000","last_became_peered":"2023-07-29T01:59:57.960709+0000","last_unstale":"2023-07-29T02:06:51.568747+0000","last_undegraded":"2023-07-29T02:06:51.568747+0000","last_fullsized":"2023-07-29T02:06:51.568747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'92","last_scrub_stamp":"2023-07-29T02:06:51.568595+0000","last_deep_scrub":"39'92","last_deep_scrub_stamp":"2023-07-29T02:06:51.568595+0000","last_clean_scrub_stamp":"2023-07-29T02:06:51.568595+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:29:56.648023+0000","scrub_duration":0.0019764689999999998,"objects_trimmed":0,"snaptrim_duration":0.30181124199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"39'85","reported_seq":2148,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:45.538248+0000","last_change":"2023-07-29T02:06:45.538248+0000","last_active":"2023-07-29T02:06:45.538248+0000","last_peered":"2023-07-29T02:06:45.538248+0000","last_clean":"2023-07-29T02:06:45.538248+0000","last_became_active":"2023-07-29T01:59:57.970263+0000","last_became_peered":"2023-07-29T01:59:57.970263+0000","last_unstale":"2023-07-29T02:06:45.538248+0000","last_undegraded":"2023-07-29T02:06:45.538248+0000","last_fullsized":"2023-07-29T02:06:45.538248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'85","last_scrub_stamp":"2023-07-29T02:06:45.538096+0000","last_deep_scrub":"39'85","last_deep_scrub_stamp":"2023-07-29T02:06:45.538096+0000","last_clean_scrub_stamp":"2023-07-29T02:06:45.538096+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:13:08.131105+0000","scrub_duration":0.0019771799999999998,"objects_trimmed":0,"snaptrim_duration":0.18892089500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"39'97","reported_seq":2160,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:25.491331+0000","last_change":"2023-07-29T02:06:25.491331+0000","last_active":"2023-07-29T02:06:25.491331+0000","last_peered":"2023-07-29T02:06:25.491331+0000","last_clean":"2023-07-29T02:06:25.491331+0000","last_became_active":"2023-07-29T01:59:57.964696+0000","last_became_peered":"2023-07-29T01:59:57.964696+0000","last_unstale":"2023-07-29T02:06:25.491331+0000","last_undegraded":"2023-07-29T02:06:25.491331+0000","last_fullsized":"2023-07-29T02:06:25.491331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'97","last_scrub_stamp":"2023-07-29T02:06:25.491173+0000","last_deep_scrub":"39'97","last_deep_scrub_stamp":"2023-07-29T02:06:25.491173+0000","last_clean_scrub_stamp":"2023-07-29T02:06:25.491173+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:48:25.389074+0000","scrub_duration":0.001642227,"objects_trimmed":0,"snaptrim_duration":0.32990576199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"39'94","reported_seq":2157,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:46.252234+0000","last_change":"2023-07-29T02:06:46.252234+0000","last_active":"2023-07-29T02:06:46.252234+0000","last_peered":"2023-07-29T02:06:46.252234+0000","last_clean":"2023-07-29T02:06:46.252234+0000","last_became_active":"2023-07-29T01:59:57.968885+0000","last_became_peered":"2023-07-29T01:59:57.968885+0000","last_unstale":"2023-07-29T02:06:46.252234+0000","last_undegraded":"2023-07-29T02:06:46.252234+0000","last_fullsized":"2023-07-29T02:06:46.252234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'94","last_scrub_stamp":"2023-07-29T02:06:46.252116+0000","last_deep_scrub":"39'94","last_deep_scrub_stamp":"2023-07-29T02:06:46.252116+0000","last_clean_scrub_stamp":"2023-07-29T02:06:46.252116+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:11:28.984472+0000","scrub_duration":0.0014621020000000001,"objects_trimmed":0,"snaptrim_duration":0.54488360899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"39'88","reported_seq":2140,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.229896+0000","last_change":"2023-07-29T02:03:57.081083+0000","last_active":"2023-07-29T02:06:24.229896+0000","last_peered":"2023-07-29T02:06:24.229896+0000","last_clean":"2023-07-29T02:06:24.229896+0000","last_became_active":"2023-07-29T01:59:57.962919+0000","last_became_peered":"2023-07-29T01:59:57.962919+0000","last_unstale":"2023-07-29T02:06:24.229896+0000","last_undegraded":"2023-07-29T02:06:24.229896+0000","last_fullsized":"2023-07-29T02:06:24.229896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T01:59:57.519170+0000","last_clean_scrub_stamp":"2023-07-29T01:59:57.519170+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36591080100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"39'85","reported_seq":2148,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:35.858539+0000","last_change":"2023-07-29T02:06:35.858539+0000","last_active":"2023-07-29T02:06:35.858539+0000","last_peered":"2023-07-29T02:06:35.858539+0000","last_clean":"2023-07-29T02:06:35.858539+0000","last_became_active":"2023-07-29T01:59:57.960111+0000","last_became_peered":"2023-07-29T01:59:57.960111+0000","last_unstale":"2023-07-29T02:06:35.858539+0000","last_undegraded":"2023-07-29T02:06:35.858539+0000","last_fullsized":"2023-07-29T02:06:35.858539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'85","last_scrub_stamp":"2023-07-29T02:06:35.858385+0000","last_deep_scrub":"39'85","last_deep_scrub_stamp":"2023-07-29T02:06:35.858385+0000","last_clean_scrub_stamp":"2023-07-29T02:06:35.858385+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:30.976536+0000","scrub_duration":0.0025554530000000001,"objects_trimmed":0,"snaptrim_duration":0.47199195399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"39'98","reported_seq":2161,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:27.503464+0000","last_change":"2023-07-29T02:06:27.503464+0000","last_active":"2023-07-29T02:06:27.503464+0000","last_peered":"2023-07-29T02:06:27.503464+0000","last_clean":"2023-07-29T02:06:27.503464+0000","last_became_active":"2023-07-29T01:59:57.961655+0000","last_became_peered":"2023-07-29T01:59:57.961655+0000","last_unstale":"2023-07-29T02:06:27.503464+0000","last_undegraded":"2023-07-29T02:06:27.503464+0000","last_fullsized":"2023-07-29T02:06:27.503464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'98","last_scrub_stamp":"2023-07-29T02:06:27.503321+0000","last_deep_scrub":"39'98","last_deep_scrub_stamp":"2023-07-29T02:06:27.503321+0000","last_clean_scrub_stamp":"2023-07-29T02:06:27.503321+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:20.644410+0000","scrub_duration":0.001657045,"objects_trimmed":0,"snaptrim_duration":0.36267924800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"39'89","reported_seq":2152,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:48.581789+0000","last_change":"2023-07-29T02:06:48.581910+0000","last_active":"2023-07-29T02:06:48.581789+0000","last_peered":"2023-07-29T02:06:48.581789+0000","last_clean":"2023-07-29T02:06:48.581789+0000","last_became_active":"2023-07-29T01:59:57.970757+0000","last_became_peered":"2023-07-29T01:59:57.970757+0000","last_unstale":"2023-07-29T02:06:48.581789+0000","last_undegraded":"2023-07-29T02:06:48.581789+0000","last_fullsized":"2023-07-29T02:06:48.581789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'89","last_scrub_stamp":"2023-07-29T02:06:48.581763+0000","last_deep_scrub":"39'89","last_deep_scrub_stamp":"2023-07-29T02:06:48.581763+0000","last_clean_scrub_stamp":"2023-07-29T02:06:48.581763+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:38.614685+0000","scrub_duration":0.0022151100000000002,"objects_trimmed":0,"snaptrim_duration":0.18738185399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"39'95","reported_seq":2158,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.272264+0000","last_change":"2023-07-29T02:06:41.272264+0000","last_active":"2023-07-29T02:06:41.272264+0000","last_peered":"2023-07-29T02:06:41.272264+0000","last_clean":"2023-07-29T02:06:41.272264+0000","last_became_active":"2023-07-29T01:59:57.974436+0000","last_became_peered":"2023-07-29T01:59:57.974436+0000","last_unstale":"2023-07-29T02:06:41.272264+0000","last_undegraded":"2023-07-29T02:06:41.272264+0000","last_fullsized":"2023-07-29T02:06:41.272264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'95","last_scrub_stamp":"2023-07-29T02:06:41.272136+0000","last_deep_scrub":"39'95","last_deep_scrub_stamp":"2023-07-29T02:06:41.272136+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.272136+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:31.305058+0000","scrub_duration":0.00149913,"objects_trimmed":0,"snaptrim_duration":0.54184882499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"39'92","reported_seq":2155,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:02.090750+0000","last_change":"2023-07-29T02:07:02.090865+0000","last_active":"2023-07-29T02:07:02.090750+0000","last_peered":"2023-07-29T02:07:02.090750+0000","last_clean":"2023-07-29T02:07:02.090750+0000","last_became_active":"2023-07-29T01:59:57.966987+0000","last_became_peered":"2023-07-29T01:59:57.966987+0000","last_unstale":"2023-07-29T02:07:02.090750+0000","last_undegraded":"2023-07-29T02:07:02.090750+0000","last_fullsized":"2023-07-29T02:07:02.090750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'92","last_scrub_stamp":"2023-07-29T02:07:02.090716+0000","last_deep_scrub":"39'92","last_deep_scrub_stamp":"2023-07-29T02:07:02.090716+0000","last_clean_scrub_stamp":"2023-07-29T02:07:02.090716+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:42:14.967178+0000","scrub_duration":0.001745199,"objects_trimmed":0,"snaptrim_duration":0.38162062000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"39'92","reported_seq":2155,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:49.594095+0000","last_change":"2023-07-29T02:06:49.594218+0000","last_active":"2023-07-29T02:06:49.594095+0000","last_peered":"2023-07-29T02:06:49.594095+0000","last_clean":"2023-07-29T02:06:49.594095+0000","last_became_active":"2023-07-29T01:59:57.971733+0000","last_became_peered":"2023-07-29T01:59:57.971733+0000","last_unstale":"2023-07-29T02:06:49.594095+0000","last_undegraded":"2023-07-29T02:06:49.594095+0000","last_fullsized":"2023-07-29T02:06:49.594095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'92","last_scrub_stamp":"2023-07-29T02:06:49.594065+0000","last_deep_scrub":"39'92","last_deep_scrub_stamp":"2023-07-29T02:06:49.594065+0000","last_clean_scrub_stamp":"2023-07-29T02:06:49.594065+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:16:28.561327+0000","scrub_duration":0.0021722790000000001,"objects_trimmed":0,"snaptrim_duration":0.189164111,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"39'83","reported_seq":2146,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:48.389699+0000","last_change":"2023-07-29T02:06:48.389813+0000","last_active":"2023-07-29T02:06:48.389699+0000","last_peered":"2023-07-29T02:06:48.389699+0000","last_clean":"2023-07-29T02:06:48.389699+0000","last_became_active":"2023-07-29T01:59:57.969742+0000","last_became_peered":"2023-07-29T01:59:57.969742+0000","last_unstale":"2023-07-29T02:06:48.389699+0000","last_undegraded":"2023-07-29T02:06:48.389699+0000","last_fullsized":"2023-07-29T02:06:48.389699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'83","last_scrub_stamp":"2023-07-29T02:06:48.389675+0000","last_deep_scrub":"39'83","last_deep_scrub_stamp":"2023-07-29T02:06:48.389675+0000","last_clean_scrub_stamp":"2023-07-29T02:06:48.389675+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:38.422597+0000","scrub_duration":0.0019922020000000002,"objects_trimmed":0,"snaptrim_duration":0.53981922100000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"39'109","reported_seq":2172,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:49.410502+0000","last_change":"2023-07-29T02:06:49.410631+0000","last_active":"2023-07-29T02:06:49.410502+0000","last_peered":"2023-07-29T02:06:49.410502+0000","last_clean":"2023-07-29T02:06:49.410502+0000","last_became_active":"2023-07-29T01:59:57.969409+0000","last_became_peered":"2023-07-29T01:59:57.969409+0000","last_unstale":"2023-07-29T02:06:49.410502+0000","last_undegraded":"2023-07-29T02:06:49.410502+0000","last_fullsized":"2023-07-29T02:06:49.410502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'109","last_scrub_stamp":"2023-07-29T02:06:49.410474+0000","last_deep_scrub":"39'109","last_deep_scrub_stamp":"2023-07-29T02:06:49.410474+0000","last_clean_scrub_stamp":"2023-07-29T02:06:49.410474+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:16:28.377736+0000","scrub_duration":0.0015257249999999999,"objects_trimmed":0,"snaptrim_duration":0.53315132300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"39'74","reported_seq":2137,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:30.637361+0000","last_change":"2023-07-29T02:06:30.637467+0000","last_active":"2023-07-29T02:06:30.637361+0000","last_peered":"2023-07-29T02:06:30.637361+0000","last_clean":"2023-07-29T02:06:30.637361+0000","last_became_active":"2023-07-29T01:59:57.963774+0000","last_became_peered":"2023-07-29T01:59:57.963774+0000","last_unstale":"2023-07-29T02:06:30.637361+0000","last_undegraded":"2023-07-29T02:06:30.637361+0000","last_fullsized":"2023-07-29T02:06:30.637361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'74","last_scrub_stamp":"2023-07-29T02:06:30.637332+0000","last_deep_scrub":"39'74","last_deep_scrub_stamp":"2023-07-29T02:06:30.637332+0000","last_clean_scrub_stamp":"2023-07-29T02:06:30.637332+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:25.755483+0000","scrub_duration":0.0015544249999999999,"objects_trimmed":0,"snaptrim_duration":0.30426659299999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"39'632","reported_seq":2712,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:07.903567+0000","last_change":"2023-07-29T02:03:57.112265+0000","last_active":"2023-07-29T02:06:07.903567+0000","last_peered":"2023-07-29T02:06:07.903567+0000","last_clean":"2023-07-29T02:06:07.903567+0000","last_became_active":"2023-07-29T02:00:01.993731+0000","last_became_peered":"2023-07-29T02:00:01.993731+0000","last_unstale":"2023-07-29T02:06:07.903567+0000","last_undegraded":"2023-07-29T02:06:07.903567+0000","last_fullsized":"2023-07-29T02:06:07.903567+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.35725884499999999,"stat_sum":{"num_bytes":48336376,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":31,"num_read_kb":16407,"num_write":630,"num_write_kb":51633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"39'191","reported_seq":237,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:04.618744+0000","last_change":"2023-07-29T02:06:58.531745+0000","last_active":"2023-07-29T02:07:04.618744+0000","last_peered":"2023-07-29T02:07:04.618744+0000","last_clean":"2023-07-29T02:07:04.618744+0000","last_became_active":"2023-07-29T01:59:57.552673+0000","last_became_peered":"2023-07-29T01:59:57.552673+0000","last_unstale":"2023-07-29T02:07:04.618744+0000","last_undegraded":"2023-07-29T02:07:04.618744+0000","last_fullsized":"2023-07-29T02:07:04.618744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'188","last_scrub_stamp":"2023-07-29T02:06:58.531553+0000","last_deep_scrub":"39'188","last_deep_scrub_stamp":"2023-07-29T02:06:58.531553+0000","last_clean_scrub_stamp":"2023-07-29T02:06:58.531553+0000","objects_scrubbed":8,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:42:11.408015+0000","scrub_duration":0.031327384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17110555,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":182,"num_write_kb":16834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30712,"num_omap_keys":51,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"39'90","reported_seq":2152,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:45.022174+0000","last_change":"2023-07-29T02:06:45.022292+0000","last_active":"2023-07-29T02:06:45.022174+0000","last_peered":"2023-07-29T02:06:45.022174+0000","last_clean":"2023-07-29T02:06:45.022174+0000","last_became_active":"2023-07-29T01:59:57.969821+0000","last_became_peered":"2023-07-29T01:59:57.969821+0000","last_unstale":"2023-07-29T02:06:45.022174+0000","last_undegraded":"2023-07-29T02:06:45.022174+0000","last_fullsized":"2023-07-29T02:06:45.022174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'90","last_scrub_stamp":"2023-07-29T02:06:45.022147+0000","last_deep_scrub":"39'90","last_deep_scrub_stamp":"2023-07-29T02:06:45.022147+0000","last_clean_scrub_stamp":"2023-07-29T02:06:45.022147+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:06:42.106944+0000","scrub_duration":0.0015979880000000001,"objects_trimmed":0,"snaptrim_duration":0.40087768200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'629","reported_seq":2755,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:57.244950+0000","last_change":"2023-07-29T02:06:57.245067+0000","last_active":"2023-07-29T02:06:57.244950+0000","last_peered":"2023-07-29T02:06:57.244950+0000","last_clean":"2023-07-29T02:06:57.244950+0000","last_became_active":"2023-07-29T02:00:01.992338+0000","last_became_peered":"2023-07-29T02:00:01.992338+0000","last_unstale":"2023-07-29T02:06:57.244950+0000","last_undegraded":"2023-07-29T02:06:57.244950+0000","last_fullsized":"2023-07-29T02:06:57.244950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'629","last_scrub_stamp":"2023-07-29T02:06:57.244926+0000","last_deep_scrub":"39'629","last_deep_scrub_stamp":"2023-07-29T02:06:57.244926+0000","last_clean_scrub_stamp":"2023-07-29T02:06:57.244926+0000","objects_scrubbed":308,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:33:31.105937+0000","scrub_duration":0.13632612799999999,"objects_trimmed":0,"snaptrim_duration":0.20956234600000001,"stat_sum":{"num_bytes":44446331,"num_objects":308,"num_object_clones":0,"num_object_copies":1232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":308,"num_whiteouts":0,"num_read":41,"num_read_kb":16418,"num_write":629,"num_write_kb":43687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"39'22","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:27.140252+0000","last_change":"2023-07-29T02:06:27.140252+0000","last_active":"2023-07-29T02:06:27.140252+0000","last_peered":"2023-07-29T02:06:27.140252+0000","last_clean":"2023-07-29T02:06:27.140252+0000","last_became_active":"2023-07-29T01:59:57.547455+0000","last_became_peered":"2023-07-29T01:59:57.547455+0000","last_unstale":"2023-07-29T02:06:27.140252+0000","last_undegraded":"2023-07-29T02:06:27.140252+0000","last_fullsized":"2023-07-29T02:06:27.140252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'22","last_scrub_stamp":"2023-07-29T02:06:27.140101+0000","last_deep_scrub":"39'22","last_deep_scrub_stamp":"2023-07-29T02:06:27.140101+0000","last_clean_scrub_stamp":"2023-07-29T02:06:27.140101+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:40.716498+0000","scrub_duration":0.0090765410000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":4125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16912,"num_omap_keys":28,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"39'92","reported_seq":2155,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:02.188486+0000","last_change":"2023-07-29T02:07:02.188588+0000","last_active":"2023-07-29T02:07:02.188486+0000","last_peered":"2023-07-29T02:07:02.188486+0000","last_clean":"2023-07-29T02:07:02.188486+0000","last_became_active":"2023-07-29T01:59:57.964393+0000","last_became_peered":"2023-07-29T01:59:57.964393+0000","last_unstale":"2023-07-29T02:07:02.188486+0000","last_undegraded":"2023-07-29T02:07:02.188486+0000","last_fullsized":"2023-07-29T02:07:02.188486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'92","last_scrub_stamp":"2023-07-29T02:07:02.188459+0000","last_deep_scrub":"39'92","last_deep_scrub_stamp":"2023-07-29T02:07:02.188459+0000","last_clean_scrub_stamp":"2023-07-29T02:07:02.188459+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:37:00.928554+0000","scrub_duration":0.0018349029999999999,"objects_trimmed":0,"snaptrim_duration":0.55267013499999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"39'624","reported_seq":2741,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:08.318968+0000","last_change":"2023-07-29T02:07:08.319130+0000","last_active":"2023-07-29T02:07:08.318968+0000","last_peered":"2023-07-29T02:07:08.318968+0000","last_clean":"2023-07-29T02:07:08.318968+0000","last_became_active":"2023-07-29T02:00:01.982042+0000","last_became_peered":"2023-07-29T02:00:01.982042+0000","last_unstale":"2023-07-29T02:07:08.318968+0000","last_undegraded":"2023-07-29T02:07:08.318968+0000","last_fullsized":"2023-07-29T02:07:08.318968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'624","last_scrub_stamp":"2023-07-29T02:07:08.318937+0000","last_deep_scrub":"39'624","last_deep_scrub_stamp":"2023-07-29T02:07:08.318937+0000","last_clean_scrub_stamp":"2023-07-29T02:07:08.318937+0000","objects_scrubbed":308,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:06:26.027769+0000","scrub_duration":0.107933345,"objects_trimmed":0,"snaptrim_duration":0.55323541600000004,"stat_sum":{"num_bytes":17887936,"num_objects":308,"num_object_clones":0,"num_object_copies":1232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":308,"num_whiteouts":0,"num_read":32,"num_read_kb":5104,"num_write":624,"num_write_kb":17797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"39'219","reported_seq":265,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:40.995666+0000","last_change":"2023-07-29T02:06:40.995666+0000","last_active":"2023-07-29T02:06:40.995666+0000","last_peered":"2023-07-29T02:06:40.995666+0000","last_clean":"2023-07-29T02:06:40.995666+0000","last_became_active":"2023-07-29T01:59:57.533523+0000","last_became_peered":"2023-07-29T01:59:57.533523+0000","last_unstale":"2023-07-29T02:06:40.995666+0000","last_undegraded":"2023-07-29T02:06:40.995666+0000","last_fullsized":"2023-07-29T02:06:40.995666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'219","last_scrub_stamp":"2023-07-29T02:06:40.995491+0000","last_deep_scrub":"39'219","last_deep_scrub_stamp":"2023-07-29T02:06:40.995491+0000","last_clean_scrub_stamp":"2023-07-29T02:06:40.995491+0000","objects_scrubbed":8,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:16:19.962753+0000","scrub_duration":0.031869078000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":210,"num_write_kb":16504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31952,"num_omap_keys":53,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"39'88","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:53.076715+0000","last_change":"2023-07-29T02:06:53.076831+0000","last_active":"2023-07-29T02:06:53.076715+0000","last_peered":"2023-07-29T02:06:53.076715+0000","last_clean":"2023-07-29T02:06:53.076715+0000","last_became_active":"2023-07-29T01:59:57.963466+0000","last_became_peered":"2023-07-29T01:59:57.963466+0000","last_unstale":"2023-07-29T02:06:53.076715+0000","last_undegraded":"2023-07-29T02:06:53.076715+0000","last_fullsized":"2023-07-29T02:06:53.076715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'88","last_scrub_stamp":"2023-07-29T02:06:53.076686+0000","last_deep_scrub":"39'88","last_deep_scrub_stamp":"2023-07-29T02:06:53.076686+0000","last_clean_scrub_stamp":"2023-07-29T02:06:53.076686+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:13:15.669694+0000","scrub_duration":0.0015148620000000001,"objects_trimmed":0,"snaptrim_duration":0.209911193,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"39'697","reported_seq":2825,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:56.220583+0000","last_change":"2023-07-29T02:06:56.220583+0000","last_active":"2023-07-29T02:06:56.220583+0000","last_peered":"2023-07-29T02:06:56.220583+0000","last_clean":"2023-07-29T02:06:56.220583+0000","last_became_active":"2023-07-29T02:00:01.984000+0000","last_became_peered":"2023-07-29T02:00:01.984000+0000","last_unstale":"2023-07-29T02:06:56.220583+0000","last_undegraded":"2023-07-29T02:06:56.220583+0000","last_fullsized":"2023-07-29T02:06:56.220583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'697","last_scrub_stamp":"2023-07-29T02:06:56.220417+0000","last_deep_scrub":"39'697","last_deep_scrub_stamp":"2023-07-29T02:06:56.220417+0000","last_clean_scrub_stamp":"2023-07-29T02:06:56.220417+0000","objects_scrubbed":367,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:16:35.187678+0000","scrub_duration":0.14049162900000001,"objects_trimmed":0,"snaptrim_duration":0.218444052,"stat_sum":{"num_bytes":33480822,"num_objects":367,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":39,"num_read_kb":11040,"num_write":700,"num_write_kb":41165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"39'4","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:35.267179+0000","last_change":"2023-07-29T02:06:35.267179+0000","last_active":"2023-07-29T02:06:35.267179+0000","last_peered":"2023-07-29T02:06:35.267179+0000","last_clean":"2023-07-29T02:06:35.267179+0000","last_became_active":"2023-07-29T01:59:57.536732+0000","last_became_peered":"2023-07-29T01:59:57.536732+0000","last_unstale":"2023-07-29T02:06:35.267179+0000","last_undegraded":"2023-07-29T02:06:35.267179+0000","last_fullsized":"2023-07-29T02:06:35.267179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2023-07-29T02:06:35.267044+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2023-07-29T02:06:35.267044+0000","last_clean_scrub_stamp":"2023-07-29T02:06:35.267044+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:32.781960+0000","scrub_duration":0.0035102390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11476,"num_omap_keys":19,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"39'88","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:25.880739+0000","last_change":"2023-07-29T02:06:25.880739+0000","last_active":"2023-07-29T02:06:25.880739+0000","last_peered":"2023-07-29T02:06:25.880739+0000","last_clean":"2023-07-29T02:06:25.880739+0000","last_became_active":"2023-07-29T01:59:57.970902+0000","last_became_peered":"2023-07-29T01:59:57.970902+0000","last_unstale":"2023-07-29T02:06:25.880739+0000","last_undegraded":"2023-07-29T02:06:25.880739+0000","last_fullsized":"2023-07-29T02:06:25.880739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'88","last_scrub_stamp":"2023-07-29T02:06:25.880641+0000","last_deep_scrub":"39'88","last_deep_scrub_stamp":"2023-07-29T02:06:25.880641+0000","last_clean_scrub_stamp":"2023-07-29T02:06:25.880641+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:45.851009+0000","scrub_duration":0.0013327549999999999,"objects_trimmed":0,"snaptrim_duration":0.3723399,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'665","reported_seq":2787,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:54.736294+0000","last_change":"2023-07-29T02:06:54.736294+0000","last_active":"2023-07-29T02:06:54.736294+0000","last_peered":"2023-07-29T02:06:54.736294+0000","last_clean":"2023-07-29T02:06:54.736294+0000","last_became_active":"2023-07-29T02:00:01.989456+0000","last_became_peered":"2023-07-29T02:00:01.989456+0000","last_unstale":"2023-07-29T02:06:54.736294+0000","last_undegraded":"2023-07-29T02:06:54.736294+0000","last_fullsized":"2023-07-29T02:06:54.736294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'665","last_scrub_stamp":"2023-07-29T02:06:54.736108+0000","last_deep_scrub":"39'665","last_deep_scrub_stamp":"2023-07-29T02:06:54.736108+0000","last_clean_scrub_stamp":"2023-07-29T02:06:54.736108+0000","objects_scrubbed":318,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:29:59.815537+0000","scrub_duration":0.14528770899999999,"objects_trimmed":0,"snaptrim_duration":0.189839176,"stat_sum":{"num_bytes":37359948,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":38,"num_read_kb":16417,"num_write":659,"num_write_kb":40721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"39'108","reported_seq":153,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:40.695251+0000","last_change":"2023-07-29T02:06:40.695251+0000","last_active":"2023-07-29T02:06:40.695251+0000","last_peered":"2023-07-29T02:06:40.695251+0000","last_clean":"2023-07-29T02:06:40.695251+0000","last_became_active":"2023-07-29T01:59:57.540113+0000","last_became_peered":"2023-07-29T01:59:57.540113+0000","last_unstale":"2023-07-29T02:06:40.695251+0000","last_undegraded":"2023-07-29T02:06:40.695251+0000","last_fullsized":"2023-07-29T02:06:40.695251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'108","last_scrub_stamp":"2023-07-29T02:06:40.695102+0000","last_deep_scrub":"39'108","last_deep_scrub_stamp":"2023-07-29T02:06:40.695102+0000","last_clean_scrub_stamp":"2023-07-29T02:06:40.695102+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:33.836191+0000","scrub_duration":0.036052965999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":100,"num_write_kb":16445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17522,"num_omap_keys":30,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"39'91","reported_seq":2155,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:11.022381+0000","last_change":"2023-07-29T02:07:11.022496+0000","last_active":"2023-07-29T02:07:11.022381+0000","last_peered":"2023-07-29T02:07:11.022381+0000","last_clean":"2023-07-29T02:07:11.022381+0000","last_became_active":"2023-07-29T01:59:57.967083+0000","last_became_peered":"2023-07-29T01:59:57.967083+0000","last_unstale":"2023-07-29T02:07:11.022381+0000","last_undegraded":"2023-07-29T02:07:11.022381+0000","last_fullsized":"2023-07-29T02:07:11.022381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'91","last_scrub_stamp":"2023-07-29T02:07:11.022354+0000","last_deep_scrub":"39'91","last_deep_scrub_stamp":"2023-07-29T02:07:11.022354+0000","last_clean_scrub_stamp":"2023-07-29T02:07:11.022354+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:31:16.182475+0000","scrub_duration":0.0020888349999999998,"objects_trimmed":0,"snaptrim_duration":0.38037237200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"39'632","reported_seq":2761,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:06.164475+0000","last_change":"2023-07-29T02:07:06.164614+0000","last_active":"2023-07-29T02:07:06.164475+0000","last_peered":"2023-07-29T02:07:06.164475+0000","last_clean":"2023-07-29T02:07:06.164475+0000","last_became_active":"2023-07-29T02:00:01.996035+0000","last_became_peered":"2023-07-29T02:00:01.996035+0000","last_unstale":"2023-07-29T02:07:06.164475+0000","last_undegraded":"2023-07-29T02:07:06.164475+0000","last_fullsized":"2023-07-29T02:07:06.164475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'632","last_scrub_stamp":"2023-07-29T02:07:06.164448+0000","last_deep_scrub":"39'632","last_deep_scrub_stamp":"2023-07-29T02:07:06.164448+0000","last_clean_scrub_stamp":"2023-07-29T02:07:06.164448+0000","objects_scrubbed":313,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:50:11.948568+0000","scrub_duration":0.119038639,"objects_trimmed":0,"snaptrim_duration":0.39874443399999998,"stat_sum":{"num_bytes":20875244,"num_objects":313,"num_object_clones":0,"num_object_copies":1252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":44,"num_read_kb":4139,"num_write":632,"num_write_kb":28878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"39'697","reported_seq":750,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.619224+0000","last_change":"2023-07-29T02:06:27.569347+0000","last_active":"2023-07-29T02:06:39.619224+0000","last_peered":"2023-07-29T02:06:39.619224+0000","last_clean":"2023-07-29T02:06:39.619224+0000","last_became_active":"2023-07-29T01:59:57.547803+0000","last_became_peered":"2023-07-29T01:59:57.547803+0000","last_unstale":"2023-07-29T02:06:39.619224+0000","last_undegraded":"2023-07-29T02:06:39.619224+0000","last_fullsized":"2023-07-29T02:06:39.619224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'621","last_scrub_stamp":"2023-07-29T02:06:27.569221+0000","last_deep_scrub":"39'621","last_deep_scrub_stamp":"2023-07-29T02:06:27.569221+0000","last_clean_scrub_stamp":"2023-07-29T02:06:27.569221+0000","objects_scrubbed":5,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:59:25.186236+0000","scrub_duration":0.02490562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583002,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":4114,"num_write":693,"num_write_kb":12634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"39'85","reported_seq":2148,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:43.393307+0000","last_change":"2023-07-29T02:06:43.393307+0000","last_active":"2023-07-29T02:06:43.393307+0000","last_peered":"2023-07-29T02:06:43.393307+0000","last_clean":"2023-07-29T02:06:43.393307+0000","last_became_active":"2023-07-29T01:59:57.969006+0000","last_became_peered":"2023-07-29T01:59:57.969006+0000","last_unstale":"2023-07-29T02:06:43.393307+0000","last_undegraded":"2023-07-29T02:06:43.393307+0000","last_fullsized":"2023-07-29T02:06:43.393307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'85","last_scrub_stamp":"2023-07-29T02:06:43.393180+0000","last_deep_scrub":"39'85","last_deep_scrub_stamp":"2023-07-29T02:06:43.393180+0000","last_clean_scrub_stamp":"2023-07-29T02:06:43.393180+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:36.534269+0000","scrub_duration":0.0019770159999999998,"objects_trimmed":0,"snaptrim_duration":0.53746501300000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"39'641","reported_seq":2771,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:54.571591+0000","last_change":"2023-07-29T02:06:54.571591+0000","last_active":"2023-07-29T02:06:54.571591+0000","last_peered":"2023-07-29T02:06:54.571591+0000","last_clean":"2023-07-29T02:06:54.571591+0000","last_became_active":"2023-07-29T02:00:01.995757+0000","last_became_peered":"2023-07-29T02:00:01.995757+0000","last_unstale":"2023-07-29T02:06:54.571591+0000","last_undegraded":"2023-07-29T02:06:54.571591+0000","last_fullsized":"2023-07-29T02:06:54.571591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'641","last_scrub_stamp":"2023-07-29T02:06:54.571428+0000","last_deep_scrub":"39'641","last_deep_scrub_stamp":"2023-07-29T02:06:54.571428+0000","last_clean_scrub_stamp":"2023-07-29T02:06:54.571428+0000","objects_scrubbed":314,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:29:59.650857+0000","scrub_duration":0.117718709,"objects_trimmed":0,"snaptrim_duration":0.539926876,"stat_sum":{"num_bytes":20101741,"num_objects":314,"num_object_clones":0,"num_object_copies":1256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":45,"num_read_kb":20517,"num_write":638,"num_write_kb":32247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"39'133","reported_seq":195,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:59.507595+0000","last_change":"2023-07-29T02:06:59.507702+0000","last_active":"2023-07-29T02:06:59.507595+0000","last_peered":"2023-07-29T02:06:59.507595+0000","last_clean":"2023-07-29T02:06:59.507595+0000","last_became_active":"2023-07-29T01:59:57.541434+0000","last_became_peered":"2023-07-29T01:59:57.541434+0000","last_unstale":"2023-07-29T02:06:59.507595+0000","last_undegraded":"2023-07-29T02:06:59.507595+0000","last_fullsized":"2023-07-29T02:06:59.507595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'133","last_scrub_stamp":"2023-07-29T02:06:59.507567+0000","last_deep_scrub":"39'133","last_deep_scrub_stamp":"2023-07-29T02:06:59.507567+0000","last_clean_scrub_stamp":"2023-07-29T02:06:59.507567+0000","objects_scrubbed":6,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:06:17.216400+0000","scrub_duration":0.025791858000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":12324,"num_write":121,"num_write_kb":12360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"39'101","reported_seq":2164,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:38.483478+0000","last_change":"2023-07-29T02:06:38.483478+0000","last_active":"2023-07-29T02:06:38.483478+0000","last_peered":"2023-07-29T02:06:38.483478+0000","last_clean":"2023-07-29T02:06:38.483478+0000","last_became_active":"2023-07-29T01:59:57.962459+0000","last_became_peered":"2023-07-29T01:59:57.962459+0000","last_unstale":"2023-07-29T02:06:38.483478+0000","last_undegraded":"2023-07-29T02:06:38.483478+0000","last_fullsized":"2023-07-29T02:06:38.483478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'101","last_scrub_stamp":"2023-07-29T02:06:38.483341+0000","last_deep_scrub":"39'101","last_deep_scrub_stamp":"2023-07-29T02:06:38.483341+0000","last_clean_scrub_stamp":"2023-07-29T02:06:38.483341+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:53:21.113599+0000","scrub_duration":0.0015478099999999999,"objects_trimmed":0,"snaptrim_duration":0.34937986999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'591","reported_seq":2713,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:13.699158+0000","last_change":"2023-07-29T02:07:13.699158+0000","last_active":"2023-07-29T02:07:13.699158+0000","last_peered":"2023-07-29T02:07:13.699158+0000","last_clean":"2023-07-29T02:07:13.699158+0000","last_became_active":"2023-07-29T02:00:01.995827+0000","last_became_peered":"2023-07-29T02:00:01.995827+0000","last_unstale":"2023-07-29T02:07:13.699158+0000","last_undegraded":"2023-07-29T02:07:13.699158+0000","last_fullsized":"2023-07-29T02:07:13.699158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'591","last_scrub_stamp":"2023-07-29T02:07:13.698913+0000","last_deep_scrub":"39'591","last_deep_scrub_stamp":"2023-07-29T02:07:13.698913+0000","last_clean_scrub_stamp":"2023-07-29T02:07:13.698913+0000","objects_scrubbed":268,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:52:43.389134+0000","scrub_duration":0.095134643000000005,"objects_trimmed":0,"snaptrim_duration":0.30893240100000002,"stat_sum":{"num_bytes":24035129,"num_objects":268,"num_object_clones":0,"num_object_copies":1072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":40,"num_read_kb":8228,"num_write":590,"num_write_kb":23787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"39'17","reported_seq":69,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:44.571061+0000","last_change":"2023-07-29T02:06:44.571061+0000","last_active":"2023-07-29T02:06:44.571061+0000","last_peered":"2023-07-29T02:06:44.571061+0000","last_clean":"2023-07-29T02:06:44.571061+0000","last_became_active":"2023-07-29T01:59:57.545406+0000","last_became_peered":"2023-07-29T01:59:57.545406+0000","last_unstale":"2023-07-29T02:06:44.571061+0000","last_undegraded":"2023-07-29T02:06:44.571061+0000","last_fullsized":"2023-07-29T02:06:44.571061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'17","last_scrub_stamp":"2023-07-29T02:06:44.570888+0000","last_deep_scrub":"39'17","last_deep_scrub_stamp":"2023-07-29T02:06:44.570888+0000","last_clean_scrub_stamp":"2023-07-29T02:06:44.570888+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:22.780946+0000","scrub_duration":0.018911788999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":8216,"num_write":11,"num_write_kb":8201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"39'86","reported_seq":2142,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:51.084893+0000","last_change":"2023-07-29T02:06:51.085043+0000","last_active":"2023-07-29T02:06:51.084893+0000","last_peered":"2023-07-29T02:06:51.084893+0000","last_clean":"2023-07-29T02:06:51.084893+0000","last_became_active":"2023-07-29T02:00:46.525331+0000","last_became_peered":"2023-07-29T02:00:46.525331+0000","last_unstale":"2023-07-29T02:06:51.084893+0000","last_undegraded":"2023-07-29T02:06:51.084893+0000","last_fullsized":"2023-07-29T02:06:51.084893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'86","last_scrub_stamp":"2023-07-29T02:06:51.084864+0000","last_deep_scrub":"39'86","last_deep_scrub_stamp":"2023-07-29T02:06:51.084864+0000","last_clean_scrub_stamp":"2023-07-29T02:06:51.084864+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:41.117785+0000","scrub_duration":0.0019762199999999999,"objects_trimmed":0,"snaptrim_duration":0.46925831499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"39'589","reported_seq":2696,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:07.162374+0000","last_change":"2023-07-29T02:07:07.162520+0000","last_active":"2023-07-29T02:07:07.162374+0000","last_peered":"2023-07-29T02:07:07.162374+0000","last_clean":"2023-07-29T02:07:07.162374+0000","last_became_active":"2023-07-29T02:00:01.996969+0000","last_became_peered":"2023-07-29T02:00:01.996969+0000","last_unstale":"2023-07-29T02:07:07.162374+0000","last_undegraded":"2023-07-29T02:07:07.162374+0000","last_fullsized":"2023-07-29T02:07:07.162374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'589","last_scrub_stamp":"2023-07-29T02:07:07.162351+0000","last_deep_scrub":"39'589","last_deep_scrub_stamp":"2023-07-29T02:07:07.162351+0000","last_clean_scrub_stamp":"2023-07-29T02:07:07.162351+0000","objects_scrubbed":297,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:12:16.667046+0000","scrub_duration":0.10039440400000001,"objects_trimmed":0,"snaptrim_duration":0.40090650999999999,"stat_sum":{"num_bytes":23342582,"num_objects":297,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":297,"num_whiteouts":0,"num_read":24,"num_read_kb":4119,"num_write":587,"num_write_kb":31305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"39'7","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:33.304685+0000","last_change":"2023-07-29T02:06:33.304685+0000","last_active":"2023-07-29T02:06:33.304685+0000","last_peered":"2023-07-29T02:06:33.304685+0000","last_clean":"2023-07-29T02:06:33.304685+0000","last_became_active":"2023-07-29T01:59:57.540800+0000","last_became_peered":"2023-07-29T01:59:57.540800+0000","last_unstale":"2023-07-29T02:06:33.304685+0000","last_undegraded":"2023-07-29T02:06:33.304685+0000","last_fullsized":"2023-07-29T02:06:33.304685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'7","last_scrub_stamp":"2023-07-29T02:06:33.304529+0000","last_deep_scrub":"39'7","last_deep_scrub_stamp":"2023-07-29T02:06:33.304529+0000","last_clean_scrub_stamp":"2023-07-29T02:06:33.304529+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:48.348979+0000","scrub_duration":0.0044829869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22906,"num_omap_keys":38,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"39'83","reported_seq":2146,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:31.683441+0000","last_change":"2023-07-29T02:06:31.683441+0000","last_active":"2023-07-29T02:06:31.683441+0000","last_peered":"2023-07-29T02:06:31.683441+0000","last_clean":"2023-07-29T02:06:31.683441+0000","last_became_active":"2023-07-29T01:59:57.963510+0000","last_became_peered":"2023-07-29T01:59:57.963510+0000","last_unstale":"2023-07-29T02:06:31.683441+0000","last_undegraded":"2023-07-29T02:06:31.683441+0000","last_fullsized":"2023-07-29T02:06:31.683441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'83","last_scrub_stamp":"2023-07-29T02:06:31.683303+0000","last_deep_scrub":"39'83","last_deep_scrub_stamp":"2023-07-29T02:06:31.683303+0000","last_clean_scrub_stamp":"2023-07-29T02:06:31.683303+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:51.653672+0000","scrub_duration":0.001434568,"objects_trimmed":0,"snaptrim_duration":0.30420630999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"39'628","reported_seq":2754,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:10.168157+0000","last_change":"2023-07-29T02:07:10.168157+0000","last_active":"2023-07-29T02:07:10.168157+0000","last_peered":"2023-07-29T02:07:10.168157+0000","last_clean":"2023-07-29T02:07:10.168157+0000","last_became_active":"2023-07-29T02:00:01.996084+0000","last_became_peered":"2023-07-29T02:00:01.996084+0000","last_unstale":"2023-07-29T02:07:10.168157+0000","last_undegraded":"2023-07-29T02:07:10.168157+0000","last_fullsized":"2023-07-29T02:07:10.168157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'628","last_scrub_stamp":"2023-07-29T02:07:10.167899+0000","last_deep_scrub":"39'628","last_deep_scrub_stamp":"2023-07-29T02:07:10.167899+0000","last_clean_scrub_stamp":"2023-07-29T02:07:10.167899+0000","objects_scrubbed":317,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:00:01.819680+0000","scrub_duration":0.114492439,"objects_trimmed":0,"snaptrim_duration":0.38362237100000002,"stat_sum":{"num_bytes":15782931,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":41,"num_read_kb":8234,"num_write":627,"num_write_kb":19844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"39'3","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:37.575902+0000","last_change":"2023-07-29T02:06:37.575902+0000","last_active":"2023-07-29T02:06:37.575902+0000","last_peered":"2023-07-29T02:06:37.575902+0000","last_clean":"2023-07-29T02:06:37.575902+0000","last_became_active":"2023-07-29T01:59:57.548109+0000","last_became_peered":"2023-07-29T01:59:57.548109+0000","last_unstale":"2023-07-29T02:06:37.575902+0000","last_undegraded":"2023-07-29T02:06:37.575902+0000","last_fullsized":"2023-07-29T02:06:37.575902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2023-07-29T02:06:37.575767+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2023-07-29T02:06:37.575767+0000","last_clean_scrub_stamp":"2023-07-29T02:06:37.575767+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:40.829676+0000","scrub_duration":0.0030220429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"39'105","reported_seq":2168,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:50.193450+0000","last_change":"2023-07-29T02:06:50.193450+0000","last_active":"2023-07-29T02:06:50.193450+0000","last_peered":"2023-07-29T02:06:50.193450+0000","last_clean":"2023-07-29T02:06:50.193450+0000","last_became_active":"2023-07-29T01:59:57.961759+0000","last_became_peered":"2023-07-29T01:59:57.961759+0000","last_unstale":"2023-07-29T02:06:50.193450+0000","last_undegraded":"2023-07-29T02:06:50.193450+0000","last_fullsized":"2023-07-29T02:06:50.193450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'105","last_scrub_stamp":"2023-07-29T02:06:50.193242+0000","last_deep_scrub":"39'105","last_deep_scrub_stamp":"2023-07-29T02:06:50.193242+0000","last_clean_scrub_stamp":"2023-07-29T02:06:50.193242+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:29:55.272671+0000","scrub_duration":0.00185907,"objects_trimmed":0,"snaptrim_duration":0.55180089099999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"39'661","reported_seq":2791,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:02.729286+0000","last_change":"2023-07-29T02:07:02.729286+0000","last_active":"2023-07-29T02:07:02.729286+0000","last_peered":"2023-07-29T02:07:02.729286+0000","last_clean":"2023-07-29T02:07:02.729286+0000","last_became_active":"2023-07-29T02:00:01.992592+0000","last_became_peered":"2023-07-29T02:00:01.992592+0000","last_unstale":"2023-07-29T02:07:02.729286+0000","last_undegraded":"2023-07-29T02:07:02.729286+0000","last_fullsized":"2023-07-29T02:07:02.729286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'661","last_scrub_stamp":"2023-07-29T02:07:02.729101+0000","last_deep_scrub":"39'661","last_deep_scrub_stamp":"2023-07-29T02:07:02.729101+0000","last_clean_scrub_stamp":"2023-07-29T02:07:02.729101+0000","objects_scrubbed":303,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:37:01.469196+0000","scrub_duration":0.13390676700000001,"objects_trimmed":0,"snaptrim_duration":0.30939737499999997,"stat_sum":{"num_bytes":46419699,"num_objects":303,"num_object_clones":0,"num_object_copies":1212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":303,"num_whiteouts":0,"num_read":45,"num_read_kb":20516,"num_write":660,"num_write_kb":45624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"39'106","reported_seq":172,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:38.170787+0000","last_change":"2023-07-29T02:06:38.170787+0000","last_active":"2023-07-29T02:06:38.170787+0000","last_peered":"2023-07-29T02:06:38.170787+0000","last_clean":"2023-07-29T02:06:38.170787+0000","last_became_active":"2023-07-29T01:59:57.543398+0000","last_became_peered":"2023-07-29T01:59:57.543398+0000","last_unstale":"2023-07-29T02:06:38.170787+0000","last_undegraded":"2023-07-29T02:06:38.170787+0000","last_fullsized":"2023-07-29T02:06:38.170787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'106","last_scrub_stamp":"2023-07-29T02:06:38.170630+0000","last_deep_scrub":"39'106","last_deep_scrub_stamp":"2023-07-29T02:06:38.170630+0000","last_clean_scrub_stamp":"2023-07-29T02:06:38.170630+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:33.288781+0000","scrub_duration":0.020523897999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":8252,"num_write":102,"num_write_kb":8255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24160,"num_omap_keys":40,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"39'90","reported_seq":2153,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.891064+0000","last_change":"2023-07-29T02:06:24.891064+0000","last_active":"2023-07-29T02:06:24.891064+0000","last_peered":"2023-07-29T02:06:24.891064+0000","last_clean":"2023-07-29T02:06:24.891064+0000","last_became_active":"2023-07-29T01:59:57.965962+0000","last_became_peered":"2023-07-29T01:59:57.965962+0000","last_unstale":"2023-07-29T02:06:24.891064+0000","last_undegraded":"2023-07-29T02:06:24.891064+0000","last_fullsized":"2023-07-29T02:06:24.891064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'90","last_scrub_stamp":"2023-07-29T02:06:24.890955+0000","last_deep_scrub":"39'90","last_deep_scrub_stamp":"2023-07-29T02:06:24.890955+0000","last_clean_scrub_stamp":"2023-07-29T02:06:24.890955+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:20.009107+0000","scrub_duration":0.0016125829999999999,"objects_trimmed":0,"snaptrim_duration":0.38151887499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"39'670","reported_seq":2804,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:06.663368+0000","last_change":"2023-07-29T02:07:06.663508+0000","last_active":"2023-07-29T02:07:06.663368+0000","last_peered":"2023-07-29T02:07:06.663368+0000","last_clean":"2023-07-29T02:07:06.663368+0000","last_became_active":"2023-07-29T02:00:01.992384+0000","last_became_peered":"2023-07-29T02:00:01.992384+0000","last_unstale":"2023-07-29T02:07:06.663368+0000","last_undegraded":"2023-07-29T02:07:06.663368+0000","last_fullsized":"2023-07-29T02:07:06.663368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'670","last_scrub_stamp":"2023-07-29T02:07:06.663343+0000","last_deep_scrub":"39'670","last_deep_scrub_stamp":"2023-07-29T02:07:06.663343+0000","last_clean_scrub_stamp":"2023-07-29T02:07:06.663343+0000","objects_scrubbed":318,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:37:05.403438+0000","scrub_duration":0.13376521999999999,"objects_trimmed":0,"snaptrim_duration":0.19044205,"stat_sum":{"num_bytes":36575402,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":49,"num_read_kb":16426,"num_write":669,"num_write_kb":40161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"39'30","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:43.592473+0000","last_change":"2023-07-29T02:06:43.592473+0000","last_active":"2023-07-29T02:06:43.592473+0000","last_peered":"2023-07-29T02:06:43.592473+0000","last_clean":"2023-07-29T02:06:43.592473+0000","last_became_active":"2023-07-29T01:59:57.548084+0000","last_became_peered":"2023-07-29T01:59:57.548084+0000","last_unstale":"2023-07-29T02:06:43.592473+0000","last_undegraded":"2023-07-29T02:06:43.592473+0000","last_fullsized":"2023-07-29T02:06:43.592473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'30","last_scrub_stamp":"2023-07-29T02:06:43.592305+0000","last_deep_scrub":"39'30","last_deep_scrub_stamp":"2023-07-29T02:06:43.592305+0000","last_clean_scrub_stamp":"2023-07-29T02:06:43.592305+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:36.733394+0000","scrub_duration":0.012205482,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":27,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17798,"num_omap_keys":30,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"39'93","reported_seq":2156,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:45.593991+0000","last_change":"2023-07-29T02:06:45.594104+0000","last_active":"2023-07-29T02:06:45.593991+0000","last_peered":"2023-07-29T02:06:45.593991+0000","last_clean":"2023-07-29T02:06:45.593991+0000","last_became_active":"2023-07-29T01:59:57.964626+0000","last_became_peered":"2023-07-29T01:59:57.964626+0000","last_unstale":"2023-07-29T02:06:45.593991+0000","last_undegraded":"2023-07-29T02:06:45.593991+0000","last_fullsized":"2023-07-29T02:06:45.593991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'93","last_scrub_stamp":"2023-07-29T02:06:45.593955+0000","last_deep_scrub":"39'93","last_deep_scrub_stamp":"2023-07-29T02:06:45.593955+0000","last_clean_scrub_stamp":"2023-07-29T02:06:45.593955+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:35.626877+0000","scrub_duration":0.0014249449999999999,"objects_trimmed":0,"snaptrim_duration":0.297089139,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"39'673","reported_seq":2800,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:42.077307+0000","last_change":"2023-07-29T02:06:42.077438+0000","last_active":"2023-07-29T02:06:42.077307+0000","last_peered":"2023-07-29T02:06:42.077307+0000","last_clean":"2023-07-29T02:06:42.077307+0000","last_became_active":"2023-07-29T02:00:01.990579+0000","last_became_peered":"2023-07-29T02:00:01.990579+0000","last_unstale":"2023-07-29T02:06:42.077307+0000","last_undegraded":"2023-07-29T02:06:42.077307+0000","last_fullsized":"2023-07-29T02:06:42.077307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'673","last_scrub_stamp":"2023-07-29T02:06:42.077282+0000","last_deep_scrub":"39'673","last_deep_scrub_stamp":"2023-07-29T02:06:42.077282+0000","last_clean_scrub_stamp":"2023-07-29T02:06:42.077282+0000","objects_scrubbed":333,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:57.121733+0000","scrub_duration":0.13274117899999999,"objects_trimmed":0,"snaptrim_duration":0.47400464199999998,"stat_sum":{"num_bytes":32895626,"num_objects":333,"num_object_clones":0,"num_object_copies":1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":333,"num_whiteouts":0,"num_read":40,"num_read_kb":14736,"num_write":673,"num_write_kb":36572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"39'247","reported_seq":297,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.564540+0000","last_change":"2023-07-29T02:06:41.564540+0000","last_active":"2023-07-29T02:06:41.564540+0000","last_peered":"2023-07-29T02:06:41.564540+0000","last_clean":"2023-07-29T02:06:41.564540+0000","last_became_active":"2023-07-29T01:59:57.548981+0000","last_became_peered":"2023-07-29T01:59:57.548981+0000","last_unstale":"2023-07-29T02:06:41.564540+0000","last_undegraded":"2023-07-29T02:06:41.564540+0000","last_fullsized":"2023-07-29T02:06:41.564540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'247","last_scrub_stamp":"2023-07-29T02:06:41.564325+0000","last_deep_scrub":"39'247","last_deep_scrub_stamp":"2023-07-29T02:06:41.564325+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.564325+0000","objects_scrubbed":4,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:39.079241+0000","scrub_duration":0.018895436000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":244,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14496,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"39'93","reported_seq":2156,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:16.446190+0000","last_change":"2023-07-29T02:07:16.446307+0000","last_active":"2023-07-29T02:07:16.446190+0000","last_peered":"2023-07-29T02:07:16.446190+0000","last_clean":"2023-07-29T02:07:16.446190+0000","last_became_active":"2023-07-29T01:59:57.969501+0000","last_became_peered":"2023-07-29T01:59:57.969501+0000","last_unstale":"2023-07-29T02:07:16.446190+0000","last_undegraded":"2023-07-29T02:07:16.446190+0000","last_fullsized":"2023-07-29T02:07:16.446190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'93","last_scrub_stamp":"2023-07-29T02:07:16.446152+0000","last_deep_scrub":"39'93","last_deep_scrub_stamp":"2023-07-29T02:07:16.446152+0000","last_clean_scrub_stamp":"2023-07-29T02:07:16.446152+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:39:24.756575+0000","scrub_duration":0.002258763,"objects_trimmed":0,"snaptrim_duration":0.35565022000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"39'641","reported_seq":2766,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:48.159456+0000","last_change":"2023-07-29T02:06:48.159456+0000","last_active":"2023-07-29T02:06:48.159456+0000","last_peered":"2023-07-29T02:06:48.159456+0000","last_clean":"2023-07-29T02:06:48.159456+0000","last_became_active":"2023-07-29T02:00:01.989364+0000","last_became_peered":"2023-07-29T02:00:01.989364+0000","last_unstale":"2023-07-29T02:06:48.159456+0000","last_undegraded":"2023-07-29T02:06:48.159456+0000","last_fullsized":"2023-07-29T02:06:48.159456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'641","last_scrub_stamp":"2023-07-29T02:06:48.159299+0000","last_deep_scrub":"39'641","last_deep_scrub_stamp":"2023-07-29T02:06:48.159299+0000","last_clean_scrub_stamp":"2023-07-29T02:06:48.159299+0000","objects_scrubbed":325,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:13:10.752308+0000","scrub_duration":0.124059473,"objects_trimmed":0,"snaptrim_duration":0.47145374600000001,"stat_sum":{"num_bytes":24224399,"num_objects":325,"num_object_clones":0,"num_object_copies":1300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":38,"num_read_kb":8228,"num_write":641,"num_write_kb":23994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"39'12","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.570729+0000","last_change":"2023-07-29T02:06:39.570729+0000","last_active":"2023-07-29T02:06:39.570729+0000","last_peered":"2023-07-29T02:06:39.570729+0000","last_clean":"2023-07-29T02:06:39.570729+0000","last_became_active":"2023-07-29T01:59:57.541056+0000","last_became_peered":"2023-07-29T01:59:57.541056+0000","last_unstale":"2023-07-29T02:06:39.570729+0000","last_undegraded":"2023-07-29T02:06:39.570729+0000","last_fullsized":"2023-07-29T02:06:39.570729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2023-07-29T02:06:39.570584+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2023-07-29T02:06:39.570584+0000","last_clean_scrub_stamp":"2023-07-29T02:06:39.570584+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:54.615034+0000","scrub_duration":0.016833287999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":8,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31920,"num_omap_keys":53,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"39'88","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.129971+0000","last_change":"2023-07-29T02:06:39.130059+0000","last_active":"2023-07-29T02:06:39.129971+0000","last_peered":"2023-07-29T02:06:39.129971+0000","last_clean":"2023-07-29T02:06:39.129971+0000","last_became_active":"2023-07-29T01:59:57.974998+0000","last_became_peered":"2023-07-29T01:59:57.974998+0000","last_unstale":"2023-07-29T02:06:39.129971+0000","last_undegraded":"2023-07-29T02:06:39.129971+0000","last_fullsized":"2023-07-29T02:06:39.129971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'88","last_scrub_stamp":"2023-07-29T02:06:39.129946+0000","last_deep_scrub":"39'88","last_deep_scrub_stamp":"2023-07-29T02:06:39.129946+0000","last_clean_scrub_stamp":"2023-07-29T02:06:39.129946+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:59.100315+0000","scrub_duration":0.0019768939999999999,"objects_trimmed":0,"snaptrim_duration":0.20531364299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"39'660","reported_seq":2776,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:47.144287+0000","last_change":"2023-07-29T02:06:47.144475+0000","last_active":"2023-07-29T02:06:47.144287+0000","last_peered":"2023-07-29T02:06:47.144287+0000","last_clean":"2023-07-29T02:06:47.144287+0000","last_became_active":"2023-07-29T02:00:01.990276+0000","last_became_peered":"2023-07-29T02:00:01.990276+0000","last_unstale":"2023-07-29T02:06:47.144287+0000","last_undegraded":"2023-07-29T02:06:47.144287+0000","last_fullsized":"2023-07-29T02:06:47.144287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'660","last_scrub_stamp":"2023-07-29T02:06:47.144238+0000","last_deep_scrub":"39'660","last_deep_scrub_stamp":"2023-07-29T02:06:47.144238+0000","last_clean_scrub_stamp":"2023-07-29T02:06:47.144238+0000","objects_scrubbed":321,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:25.354296+0000","scrub_duration":0.12368135500000001,"objects_trimmed":0,"snaptrim_duration":0.47581172799999999,"stat_sum":{"num_bytes":20642551,"num_objects":321,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":321,"num_whiteouts":0,"num_read":31,"num_read_kb":1050,"num_write":661,"num_write_kb":24562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"39'11","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:36.751062+0000","last_change":"2023-07-29T02:06:36.751062+0000","last_active":"2023-07-29T02:06:36.751062+0000","last_peered":"2023-07-29T02:06:36.751062+0000","last_clean":"2023-07-29T02:06:36.751062+0000","last_became_active":"2023-07-29T01:59:57.544231+0000","last_became_peered":"2023-07-29T01:59:57.544231+0000","last_unstale":"2023-07-29T02:06:36.751062+0000","last_undegraded":"2023-07-29T02:06:36.751062+0000","last_fullsized":"2023-07-29T02:06:36.751062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'11","last_scrub_stamp":"2023-07-29T02:06:36.750893+0000","last_deep_scrub":"39'11","last_deep_scrub_stamp":"2023-07-29T02:06:36.750893+0000","last_clean_scrub_stamp":"2023-07-29T02:06:36.750893+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:51.795344+0000","scrub_duration":0.011813673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20726,"num_omap_keys":35,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"39'88","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:04.226546+0000","last_change":"2023-07-29T02:07:04.226649+0000","last_active":"2023-07-29T02:07:04.226546+0000","last_peered":"2023-07-29T02:07:04.226546+0000","last_clean":"2023-07-29T02:07:04.226546+0000","last_became_active":"2023-07-29T01:59:57.974525+0000","last_became_peered":"2023-07-29T01:59:57.974525+0000","last_unstale":"2023-07-29T02:07:04.226546+0000","last_undegraded":"2023-07-29T02:07:04.226546+0000","last_fullsized":"2023-07-29T02:07:04.226546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'88","last_scrub_stamp":"2023-07-29T02:07:04.226523+0000","last_deep_scrub":"39'88","last_deep_scrub_stamp":"2023-07-29T02:07:04.226523+0000","last_clean_scrub_stamp":"2023-07-29T02:07:04.226523+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:48:31.036883+0000","scrub_duration":0.0011936620000000001,"objects_trimmed":0,"snaptrim_duration":0.549422509,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"39'632","reported_seq":2758,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:44.103323+0000","last_change":"2023-07-29T02:06:44.103323+0000","last_active":"2023-07-29T02:06:44.103323+0000","last_peered":"2023-07-29T02:06:44.103323+0000","last_clean":"2023-07-29T02:06:44.103323+0000","last_became_active":"2023-07-29T02:00:01.988486+0000","last_became_peered":"2023-07-29T02:00:01.988486+0000","last_unstale":"2023-07-29T02:06:44.103323+0000","last_undegraded":"2023-07-29T02:06:44.103323+0000","last_fullsized":"2023-07-29T02:06:44.103323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'632","last_scrub_stamp":"2023-07-29T02:06:44.103126+0000","last_deep_scrub":"39'632","last_deep_scrub_stamp":"2023-07-29T02:06:44.103126+0000","last_clean_scrub_stamp":"2023-07-29T02:06:44.103126+0000","objects_scrubbed":300,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:41.618043+0000","scrub_duration":0.13271588600000001,"objects_trimmed":0,"snaptrim_duration":0.473472642,"stat_sum":{"num_bytes":32792736,"num_objects":300,"num_object_clones":0,"num_object_copies":1200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":300,"num_whiteouts":0,"num_read":41,"num_read_kb":18442,"num_write":630,"num_write_kb":40548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"39'382","reported_seq":431,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.975797+0000","last_change":"2023-07-29T02:06:39.975797+0000","last_active":"2023-07-29T02:06:39.975797+0000","last_peered":"2023-07-29T02:06:39.975797+0000","last_clean":"2023-07-29T02:06:39.975797+0000","last_became_active":"2023-07-29T01:59:57.534813+0000","last_became_peered":"2023-07-29T01:59:57.534813+0000","last_unstale":"2023-07-29T02:06:39.975797+0000","last_undegraded":"2023-07-29T02:06:39.975797+0000","last_fullsized":"2023-07-29T02:06:39.975797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'382","last_scrub_stamp":"2023-07-29T02:06:39.975672+0000","last_deep_scrub":"39'382","last_deep_scrub_stamp":"2023-07-29T02:06:39.975672+0000","last_clean_scrub_stamp":"2023-07-29T02:06:39.975672+0000","objects_scrubbed":6,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:30.008594+0000","scrub_duration":0.024545006000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":8198,"num_write":371,"num_write_kb":12605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"39'96","reported_seq":2159,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.494296+0000","last_change":"2023-07-29T02:06:24.494296+0000","last_active":"2023-07-29T02:06:24.494296+0000","last_peered":"2023-07-29T02:06:24.494296+0000","last_clean":"2023-07-29T02:06:24.494296+0000","last_became_active":"2023-07-29T01:59:57.962184+0000","last_became_peered":"2023-07-29T01:59:57.962184+0000","last_unstale":"2023-07-29T02:06:24.494296+0000","last_undegraded":"2023-07-29T02:06:24.494296+0000","last_fullsized":"2023-07-29T02:06:24.494296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'96","last_scrub_stamp":"2023-07-29T02:06:24.494142+0000","last_deep_scrub":"39'96","last_deep_scrub_stamp":"2023-07-29T02:06:24.494142+0000","last_clean_scrub_stamp":"2023-07-29T02:06:24.494142+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:05:15.948297+0000","scrub_duration":0.001611838,"objects_trimmed":0,"snaptrim_duration":0.36182750899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"39'688","reported_seq":2815,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:55.561116+0000","last_change":"2023-07-29T02:06:55.561244+0000","last_active":"2023-07-29T02:06:55.561116+0000","last_peered":"2023-07-29T02:06:55.561116+0000","last_clean":"2023-07-29T02:06:55.561116+0000","last_became_active":"2023-07-29T02:00:01.989151+0000","last_became_peered":"2023-07-29T02:00:01.989151+0000","last_unstale":"2023-07-29T02:06:55.561116+0000","last_undegraded":"2023-07-29T02:06:55.561116+0000","last_fullsized":"2023-07-29T02:06:55.561116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'688","last_scrub_stamp":"2023-07-29T02:06:55.561092+0000","last_deep_scrub":"39'688","last_deep_scrub_stamp":"2023-07-29T02:06:55.561092+0000","last_clean_scrub_stamp":"2023-07-29T02:06:55.561092+0000","objects_scrubbed":326,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:04:59.339522+0000","scrub_duration":0.13620000500000001,"objects_trimmed":0,"snaptrim_duration":0.54490939800000004,"stat_sum":{"num_bytes":33219663,"num_objects":326,"num_object_clones":0,"num_object_copies":1304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":326,"num_whiteouts":0,"num_read":40,"num_read_kb":16418,"num_write":687,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"39'196","reported_seq":241,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:34.174273+0000","last_change":"2023-07-29T02:06:34.174383+0000","last_active":"2023-07-29T02:06:34.174273+0000","last_peered":"2023-07-29T02:06:34.174273+0000","last_clean":"2023-07-29T02:06:34.174273+0000","last_became_active":"2023-07-29T01:59:57.544120+0000","last_became_peered":"2023-07-29T01:59:57.544120+0000","last_unstale":"2023-07-29T02:06:34.174273+0000","last_undegraded":"2023-07-29T02:06:34.174273+0000","last_fullsized":"2023-07-29T02:06:34.174273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'196","last_scrub_stamp":"2023-07-29T02:06:34.174245+0000","last_deep_scrub":"39'196","last_deep_scrub_stamp":"2023-07-29T02:06:34.174245+0000","last_clean_scrub_stamp":"2023-07-29T02:06:34.174245+0000","objects_scrubbed":5,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:18:24.878615+0000","scrub_duration":0.032465687999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":192,"num_write_kb":12401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24074,"num_omap_keys":41,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"39'93","reported_seq":2156,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:13.480595+0000","last_change":"2023-07-29T02:07:13.480749+0000","last_active":"2023-07-29T02:07:13.480595+0000","last_peered":"2023-07-29T02:07:13.480595+0000","last_clean":"2023-07-29T02:07:13.480595+0000","last_became_active":"2023-07-29T01:59:57.961975+0000","last_became_peered":"2023-07-29T01:59:57.961975+0000","last_unstale":"2023-07-29T02:07:13.480595+0000","last_undegraded":"2023-07-29T02:07:13.480595+0000","last_fullsized":"2023-07-29T02:07:13.480595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'93","last_scrub_stamp":"2023-07-29T02:07:13.480566+0000","last_deep_scrub":"39'93","last_deep_scrub_stamp":"2023-07-29T02:07:13.480566+0000","last_clean_scrub_stamp":"2023-07-29T02:07:13.480566+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:21:39.493702+0000","scrub_duration":0.0020090049999999999,"objects_trimmed":0,"snaptrim_duration":0.37361334099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"39'646","reported_seq":2775,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:04.744134+0000","last_change":"2023-07-29T02:07:04.744287+0000","last_active":"2023-07-29T02:07:04.744134+0000","last_peered":"2023-07-29T02:07:04.744134+0000","last_clean":"2023-07-29T02:07:04.744134+0000","last_became_active":"2023-07-29T02:00:01.988155+0000","last_became_peered":"2023-07-29T02:00:01.988155+0000","last_unstale":"2023-07-29T02:07:04.744134+0000","last_undegraded":"2023-07-29T02:07:04.744134+0000","last_fullsized":"2023-07-29T02:07:04.744134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'646","last_scrub_stamp":"2023-07-29T02:07:04.744110+0000","last_deep_scrub":"39'646","last_deep_scrub_stamp":"2023-07-29T02:07:04.744110+0000","last_clean_scrub_stamp":"2023-07-29T02:07:04.744110+0000","objects_scrubbed":313,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:48:31.554469+0000","scrub_duration":0.12450196600000001,"objects_trimmed":0,"snaptrim_duration":0.30982225000000002,"stat_sum":{"num_bytes":22073203,"num_objects":313,"num_object_clones":0,"num_object_copies":1252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":44,"num_read_kb":12328,"num_write":643,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"39'66","reported_seq":111,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:56.510348+0000","last_change":"2023-07-29T02:06:56.510436+0000","last_active":"2023-07-29T02:06:56.510348+0000","last_peered":"2023-07-29T02:06:56.510348+0000","last_clean":"2023-07-29T02:06:56.510348+0000","last_became_active":"2023-07-29T01:59:57.549470+0000","last_became_peered":"2023-07-29T01:59:57.549470+0000","last_unstale":"2023-07-29T02:06:56.510348+0000","last_undegraded":"2023-07-29T02:06:56.510348+0000","last_fullsized":"2023-07-29T02:06:56.510348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'66","last_scrub_stamp":"2023-07-29T02:06:56.510325+0000","last_deep_scrub":"39'66","last_deep_scrub_stamp":"2023-07-29T02:06:56.510325+0000","last_clean_scrub_stamp":"2023-07-29T02:06:56.510325+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:48:23.320684+0000","scrub_duration":0.010157708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":64,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20398,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"39'65","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:32.423044+0000","last_change":"2023-07-29T02:06:32.423044+0000","last_active":"2023-07-29T02:06:32.423044+0000","last_peered":"2023-07-29T02:06:32.423044+0000","last_clean":"2023-07-29T02:06:32.423044+0000","last_became_active":"2023-07-29T01:59:57.962016+0000","last_became_peered":"2023-07-29T01:59:57.962016+0000","last_unstale":"2023-07-29T02:06:32.423044+0000","last_undegraded":"2023-07-29T02:06:32.423044+0000","last_fullsized":"2023-07-29T02:06:32.423044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'65","last_scrub_stamp":"2023-07-29T02:06:32.422911+0000","last_deep_scrub":"39'65","last_deep_scrub_stamp":"2023-07-29T02:06:32.422911+0000","last_clean_scrub_stamp":"2023-07-29T02:06:32.422911+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:22.455833+0000","scrub_duration":0.0014239599999999999,"objects_trimmed":0,"snaptrim_duration":0.36599154900000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"39'565","reported_seq":2655,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.229941+0000","last_change":"2023-07-29T02:03:57.082127+0000","last_active":"2023-07-29T02:06:24.229941+0000","last_peered":"2023-07-29T02:06:24.229941+0000","last_clean":"2023-07-29T02:06:24.229941+0000","last_became_active":"2023-07-29T02:00:01.992042+0000","last_became_peered":"2023-07-29T02:00:01.992042+0000","last_unstale":"2023-07-29T02:06:24.229941+0000","last_undegraded":"2023-07-29T02:06:24.229941+0000","last_fullsized":"2023-07-29T02:06:24.229941+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.36734029699999998,"stat_sum":{"num_bytes":17472104,"num_objects":288,"num_object_clones":0,"num_object_copies":1152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":40,"num_read_kb":12324,"num_write":565,"num_write_kb":21394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"39'15","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:35.000137+0000","last_change":"2023-07-29T02:06:35.000254+0000","last_active":"2023-07-29T02:06:35.000137+0000","last_peered":"2023-07-29T02:06:35.000137+0000","last_clean":"2023-07-29T02:06:35.000137+0000","last_became_active":"2023-07-29T01:59:57.535762+0000","last_became_peered":"2023-07-29T01:59:57.535762+0000","last_unstale":"2023-07-29T02:06:35.000137+0000","last_undegraded":"2023-07-29T02:06:35.000137+0000","last_fullsized":"2023-07-29T02:06:35.000137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'15","last_scrub_stamp":"2023-07-29T02:06:35.000106+0000","last_deep_scrub":"39'15","last_deep_scrub_stamp":"2023-07-29T02:06:35.000106+0000","last_clean_scrub_stamp":"2023-07-29T02:06:35.000106+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:28.141195+0000","scrub_duration":0.010307169,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":13,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30910,"num_omap_keys":52,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"39'87","reported_seq":2150,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.329087+0000","last_change":"2023-07-29T02:06:39.329087+0000","last_active":"2023-07-29T02:06:39.329087+0000","last_peered":"2023-07-29T02:06:39.329087+0000","last_clean":"2023-07-29T02:06:39.329087+0000","last_became_active":"2023-07-29T01:59:57.974834+0000","last_became_peered":"2023-07-29T01:59:57.974834+0000","last_unstale":"2023-07-29T02:06:39.329087+0000","last_undegraded":"2023-07-29T02:06:39.329087+0000","last_fullsized":"2023-07-29T02:06:39.329087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'87","last_scrub_stamp":"2023-07-29T02:06:39.328959+0000","last_deep_scrub":"39'87","last_deep_scrub_stamp":"2023-07-29T02:06:39.328959+0000","last_clean_scrub_stamp":"2023-07-29T02:06:39.328959+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:54.373409+0000","scrub_duration":0.0016042369999999999,"objects_trimmed":0,"snaptrim_duration":0.53560260199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"39'713","reported_seq":2793,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:19.454413+0000","last_change":"2023-07-29T02:03:57.112720+0000","last_active":"2023-07-29T02:06:19.454413+0000","last_peered":"2023-07-29T02:06:19.454413+0000","last_clean":"2023-07-29T02:06:19.454413+0000","last_became_active":"2023-07-29T02:00:01.990464+0000","last_became_peered":"2023-07-29T02:00:01.990464+0000","last_unstale":"2023-07-29T02:06:19.454413+0000","last_undegraded":"2023-07-29T02:06:19.454413+0000","last_fullsized":"2023-07-29T02:06:19.454413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.356278702,"stat_sum":{"num_bytes":25950589,"num_objects":363,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":363,"num_whiteouts":0,"num_read":30,"num_read_kb":4124,"num_write":712,"num_write_kb":29793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"39'166","reported_seq":216,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.989281+0000","last_change":"2023-07-29T02:06:41.989432+0000","last_active":"2023-07-29T02:06:41.989281+0000","last_peered":"2023-07-29T02:06:41.989281+0000","last_clean":"2023-07-29T02:06:41.989281+0000","last_became_active":"2023-07-29T01:59:57.540292+0000","last_became_peered":"2023-07-29T01:59:57.540292+0000","last_unstale":"2023-07-29T02:06:41.989281+0000","last_undegraded":"2023-07-29T02:06:41.989281+0000","last_fullsized":"2023-07-29T02:06:41.989281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'166","last_scrub_stamp":"2023-07-29T02:06:41.989234+0000","last_deep_scrub":"39'166","last_deep_scrub_stamp":"2023-07-29T02:06:41.989234+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.989234+0000","objects_scrubbed":4,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:33:15.850245+0000","scrub_duration":0.014136332,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":162,"num_write_kb":4206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20550,"num_omap_keys":35,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.534625+0000","last_change":"2023-07-29T02:06:41.534733+0000","last_active":"2023-07-29T02:06:41.534625+0000","last_peered":"2023-07-29T02:06:41.534625+0000","last_clean":"2023-07-29T02:06:41.534625+0000","last_became_active":"2023-07-29T01:59:52.447782+0000","last_became_peered":"2023-07-29T01:59:52.447782+0000","last_unstale":"2023-07-29T02:06:41.534625+0000","last_undegraded":"2023-07-29T02:06:41.534625+0000","last_fullsized":"2023-07-29T02:06:41.534625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:41.534599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:41.534599+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.534599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:58:31.380201+0000","scrub_duration":0.0019006699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"39'83","reported_seq":2146,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:30.896156+0000","last_change":"2023-07-29T02:06:30.896265+0000","last_active":"2023-07-29T02:06:30.896156+0000","last_peered":"2023-07-29T02:06:30.896156+0000","last_clean":"2023-07-29T02:06:30.896156+0000","last_became_active":"2023-07-29T01:59:57.966065+0000","last_became_peered":"2023-07-29T01:59:57.966065+0000","last_unstale":"2023-07-29T02:06:30.896156+0000","last_undegraded":"2023-07-29T02:06:30.896156+0000","last_fullsized":"2023-07-29T02:06:30.896156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'83","last_scrub_stamp":"2023-07-29T02:06:30.896126+0000","last_deep_scrub":"39'83","last_deep_scrub_stamp":"2023-07-29T02:06:30.896126+0000","last_clean_scrub_stamp":"2023-07-29T02:06:30.896126+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:45.940577+0000","scrub_duration":0.002183015,"objects_trimmed":0,"snaptrim_duration":0.37241656400000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"39'677","reported_seq":2811,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:04.217760+0000","last_change":"2023-07-29T02:07:04.217903+0000","last_active":"2023-07-29T02:07:04.217760+0000","last_peered":"2023-07-29T02:07:04.217760+0000","last_clean":"2023-07-29T02:07:04.217760+0000","last_became_active":"2023-07-29T02:00:01.995963+0000","last_became_peered":"2023-07-29T02:00:01.995963+0000","last_unstale":"2023-07-29T02:07:04.217760+0000","last_undegraded":"2023-07-29T02:07:04.217760+0000","last_fullsized":"2023-07-29T02:07:04.217760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'677","last_scrub_stamp":"2023-07-29T02:07:04.217731+0000","last_deep_scrub":"39'677","last_deep_scrub_stamp":"2023-07-29T02:07:04.217731+0000","last_clean_scrub_stamp":"2023-07-29T02:07:04.217731+0000","objects_scrubbed":332,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:24:49.826082+0000","scrub_duration":0.119161874,"objects_trimmed":0,"snaptrim_duration":0.373304892,"stat_sum":{"num_bytes":14135733,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":47,"num_read_kb":4140,"num_write":679,"num_write_kb":14069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:32.905149+0000","last_change":"2023-07-29T02:06:32.905293+0000","last_active":"2023-07-29T02:06:32.905149+0000","last_peered":"2023-07-29T02:06:32.905149+0000","last_clean":"2023-07-29T02:06:32.905149+0000","last_became_active":"2023-07-29T01:59:52.445337+0000","last_became_peered":"2023-07-29T01:59:52.445337+0000","last_unstale":"2023-07-29T02:06:32.905149+0000","last_undegraded":"2023-07-29T02:06:32.905149+0000","last_fullsized":"2023-07-29T02:06:32.905149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:32.905103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:32.905103+0000","last_clean_scrub_stamp":"2023-07-29T02:06:32.905103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:30.420020+0000","scrub_duration":0.0019302989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"39'41","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:37.295159+0000","last_change":"2023-07-29T02:06:37.295159+0000","last_active":"2023-07-29T02:06:37.295159+0000","last_peered":"2023-07-29T02:06:37.295159+0000","last_clean":"2023-07-29T02:06:37.295159+0000","last_became_active":"2023-07-29T01:59:57.537581+0000","last_became_peered":"2023-07-29T01:59:57.537581+0000","last_unstale":"2023-07-29T02:06:37.295159+0000","last_undegraded":"2023-07-29T02:06:37.295159+0000","last_fullsized":"2023-07-29T02:06:37.295159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'40","last_scrub_stamp":"2023-07-29T02:06:37.294992+0000","last_deep_scrub":"39'40","last_deep_scrub_stamp":"2023-07-29T02:06:37.294992+0000","last_clean_scrub_stamp":"2023-07-29T02:06:37.294992+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:30.436081+0000","scrub_duration":0.0068420169999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8,"num_write":86,"num_write_kb":1322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12080,"num_omap_keys":20,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"39'82","reported_seq":2145,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:03.469440+0000","last_change":"2023-07-29T02:07:03.469557+0000","last_active":"2023-07-29T02:07:03.469440+0000","last_peered":"2023-07-29T02:07:03.469440+0000","last_clean":"2023-07-29T02:07:03.469440+0000","last_became_active":"2023-07-29T01:59:57.961298+0000","last_became_peered":"2023-07-29T01:59:57.961298+0000","last_unstale":"2023-07-29T02:07:03.469440+0000","last_undegraded":"2023-07-29T02:07:03.469440+0000","last_fullsized":"2023-07-29T02:07:03.469440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'82","last_scrub_stamp":"2023-07-29T02:07:03.469410+0000","last_deep_scrub":"39'82","last_deep_scrub_stamp":"2023-07-29T02:07:03.469410+0000","last_clean_scrub_stamp":"2023-07-29T02:07:03.469410+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:12:12.974105+0000","scrub_duration":0.0016025049999999999,"objects_trimmed":0,"snaptrim_duration":0.35104021600000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"39'622","reported_seq":2742,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:08.752307+0000","last_change":"2023-07-29T02:07:08.752476+0000","last_active":"2023-07-29T02:07:08.752307+0000","last_peered":"2023-07-29T02:07:08.752307+0000","last_clean":"2023-07-29T02:07:08.752307+0000","last_became_active":"2023-07-29T02:00:01.986915+0000","last_became_peered":"2023-07-29T02:00:01.986915+0000","last_unstale":"2023-07-29T02:07:08.752307+0000","last_undegraded":"2023-07-29T02:07:08.752307+0000","last_fullsized":"2023-07-29T02:07:08.752307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'622","last_scrub_stamp":"2023-07-29T02:07:08.752283+0000","last_deep_scrub":"39'622","last_deep_scrub_stamp":"2023-07-29T02:07:08.752283+0000","last_clean_scrub_stamp":"2023-07-29T02:07:08.752283+0000","objects_scrubbed":291,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:06:26.461115+0000","scrub_duration":0.11089104,"objects_trimmed":0,"snaptrim_duration":0.30985112500000001,"stat_sum":{"num_bytes":28815426,"num_objects":291,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":291,"num_whiteouts":0,"num_read":37,"num_read_kb":4131,"num_write":621,"num_write_kb":32518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:23.105634+0000","last_change":"2023-07-29T02:06:23.105717+0000","last_active":"2023-07-29T02:06:23.105634+0000","last_peered":"2023-07-29T02:06:23.105634+0000","last_clean":"2023-07-29T02:06:23.105634+0000","last_became_active":"2023-07-29T01:59:52.448052+0000","last_became_peered":"2023-07-29T01:59:52.448052+0000","last_unstale":"2023-07-29T02:06:23.105634+0000","last_undegraded":"2023-07-29T02:06:23.105634+0000","last_fullsized":"2023-07-29T02:06:23.105634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:23.105612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:23.105612+0000","last_clean_scrub_stamp":"2023-07-29T02:06:23.105612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:01:13.810307+0000","scrub_duration":0.0019361350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"39'119","reported_seq":199,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:34.526309+0000","last_change":"2023-07-29T02:06:34.526427+0000","last_active":"2023-07-29T02:06:34.526309+0000","last_peered":"2023-07-29T02:06:34.526309+0000","last_clean":"2023-07-29T02:06:34.526309+0000","last_became_active":"2023-07-29T01:59:52.449582+0000","last_became_peered":"2023-07-29T01:59:52.449582+0000","last_unstale":"2023-07-29T02:06:34.526309+0000","last_undegraded":"2023-07-29T02:06:34.526309+0000","last_fullsized":"2023-07-29T02:06:34.526309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2023-07-29T02:06:34.526281+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2023-07-29T02:06:34.526281+0000","last_clean_scrub_stamp":"2023-07-29T02:06:34.526281+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:54.496650+0000","scrub_duration":0.0069852009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"39'67","reported_seq":177,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:31.365346+0000","last_change":"2023-07-29T02:06:31.365465+0000","last_active":"2023-07-29T02:06:31.365346+0000","last_peered":"2023-07-29T02:06:31.365346+0000","last_clean":"2023-07-29T02:06:31.365346+0000","last_became_active":"2023-07-29T01:59:57.546179+0000","last_became_peered":"2023-07-29T01:59:57.546179+0000","last_unstale":"2023-07-29T02:06:31.365346+0000","last_undegraded":"2023-07-29T02:06:31.365346+0000","last_fullsized":"2023-07-29T02:06:31.365346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'67","last_scrub_stamp":"2023-07-29T02:06:31.365318+0000","last_deep_scrub":"39'67","last_deep_scrub_stamp":"2023-07-29T02:06:31.365318+0000","last_clean_scrub_stamp":"2023-07-29T02:06:31.365318+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:34.619227+0000","scrub_duration":0.0034459820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576264,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":610,"num_write":65,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"39'93","reported_seq":2156,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:27.316704+0000","last_change":"2023-07-29T02:06:27.316704+0000","last_active":"2023-07-29T02:06:27.316704+0000","last_peered":"2023-07-29T02:06:27.316704+0000","last_clean":"2023-07-29T02:06:27.316704+0000","last_became_active":"2023-07-29T01:59:57.975078+0000","last_became_peered":"2023-07-29T01:59:57.975078+0000","last_unstale":"2023-07-29T02:06:27.316704+0000","last_undegraded":"2023-07-29T02:06:27.316704+0000","last_fullsized":"2023-07-29T02:06:27.316704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'93","last_scrub_stamp":"2023-07-29T02:06:27.316579+0000","last_deep_scrub":"39'93","last_deep_scrub_stamp":"2023-07-29T02:06:27.316579+0000","last_clean_scrub_stamp":"2023-07-29T02:06:27.316579+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:22.434730+0000","scrub_duration":0.0015657690000000001,"objects_trimmed":0,"snaptrim_duration":0.55319968200000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"39'709","reported_seq":2846,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:46.161104+0000","last_change":"2023-07-29T02:06:46.161289+0000","last_active":"2023-07-29T02:06:46.161104+0000","last_peered":"2023-07-29T02:06:46.161104+0000","last_clean":"2023-07-29T02:06:46.161104+0000","last_became_active":"2023-07-29T02:00:01.986937+0000","last_became_peered":"2023-07-29T02:00:01.986937+0000","last_unstale":"2023-07-29T02:06:46.161104+0000","last_undegraded":"2023-07-29T02:06:46.161104+0000","last_fullsized":"2023-07-29T02:06:46.161104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'709","last_scrub_stamp":"2023-07-29T02:06:46.161057+0000","last_deep_scrub":"39'709","last_deep_scrub_stamp":"2023-07-29T02:06:46.161057+0000","last_clean_scrub_stamp":"2023-07-29T02:06:46.161057+0000","objects_scrubbed":344,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:39.302145+0000","scrub_duration":0.14397623400000001,"objects_trimmed":2,"snaptrim_duration":0.47715394799999999,"stat_sum":{"num_bytes":40554601,"num_objects":344,"num_object_clones":0,"num_object_copies":1376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":344,"num_whiteouts":0,"num_read":51,"num_read_kb":15453,"num_write":703,"num_write_kb":39978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:28.531585+0000","last_change":"2023-07-29T02:06:28.531707+0000","last_active":"2023-07-29T02:06:28.531585+0000","last_peered":"2023-07-29T02:06:28.531585+0000","last_clean":"2023-07-29T02:06:28.531585+0000","last_became_active":"2023-07-29T01:59:53.171467+0000","last_became_peered":"2023-07-29T01:59:53.171467+0000","last_unstale":"2023-07-29T02:06:28.531585+0000","last_undegraded":"2023-07-29T02:06:28.531585+0000","last_fullsized":"2023-07-29T02:06:28.531585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:28.531559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:28.531559+0000","last_clean_scrub_stamp":"2023-07-29T02:06:28.531559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:01:40.717070+0000","scrub_duration":0.0018899190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"39'254","reported_seq":302,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:29.161357+0000","last_change":"2023-07-29T02:06:29.161511+0000","last_active":"2023-07-29T02:06:29.161357+0000","last_peered":"2023-07-29T02:06:29.161357+0000","last_clean":"2023-07-29T02:06:29.161357+0000","last_became_active":"2023-07-29T01:59:57.549151+0000","last_became_peered":"2023-07-29T01:59:57.549151+0000","last_unstale":"2023-07-29T02:06:29.161357+0000","last_undegraded":"2023-07-29T02:06:29.161357+0000","last_fullsized":"2023-07-29T02:06:29.161357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'254","last_scrub_stamp":"2023-07-29T02:06:29.161311+0000","last_deep_scrub":"39'254","last_deep_scrub_stamp":"2023-07-29T02:06:29.161311+0000","last_clean_scrub_stamp":"2023-07-29T02:06:29.161311+0000","objects_scrubbed":5,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:18:19.865681+0000","scrub_duration":0.023803841999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":11035,"num_write":246,"num_write_kb":12456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25322,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"39'88","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:37.239617+0000","last_change":"2023-07-29T02:06:37.239734+0000","last_active":"2023-07-29T02:06:37.239617+0000","last_peered":"2023-07-29T02:06:37.239617+0000","last_clean":"2023-07-29T02:06:37.239617+0000","last_became_active":"2023-07-29T01:59:57.969273+0000","last_became_peered":"2023-07-29T01:59:57.969273+0000","last_unstale":"2023-07-29T02:06:37.239617+0000","last_undegraded":"2023-07-29T02:06:37.239617+0000","last_fullsized":"2023-07-29T02:06:37.239617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'88","last_scrub_stamp":"2023-07-29T02:06:37.239591+0000","last_deep_scrub":"39'88","last_deep_scrub_stamp":"2023-07-29T02:06:37.239591+0000","last_clean_scrub_stamp":"2023-07-29T02:06:37.239591+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:40.493500+0000","scrub_duration":0.0016482389999999999,"objects_trimmed":0,"snaptrim_duration":0.53741308300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"39'639","reported_seq":2756,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:53.677441+0000","last_change":"2023-07-29T02:06:53.677598+0000","last_active":"2023-07-29T02:06:53.677441+0000","last_peered":"2023-07-29T02:06:53.677441+0000","last_clean":"2023-07-29T02:06:53.677441+0000","last_became_active":"2023-07-29T02:00:01.992406+0000","last_became_peered":"2023-07-29T02:00:01.992406+0000","last_unstale":"2023-07-29T02:06:53.677441+0000","last_undegraded":"2023-07-29T02:06:53.677441+0000","last_fullsized":"2023-07-29T02:06:53.677441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'639","last_scrub_stamp":"2023-07-29T02:06:53.677416+0000","last_deep_scrub":"39'639","last_deep_scrub_stamp":"2023-07-29T02:06:53.677416+0000","last_clean_scrub_stamp":"2023-07-29T02:06:53.677416+0000","objects_scrubbed":323,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:06:50.762214+0000","scrub_duration":0.120386481,"objects_trimmed":0,"snaptrim_duration":0.18856821800000001,"stat_sum":{"num_bytes":24792794,"num_objects":323,"num_object_clones":0,"num_object_copies":1292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":323,"num_whiteouts":0,"num_read":32,"num_read_kb":11492,"num_write":639,"num_write_kb":27823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:33.505179+0000","last_change":"2023-07-29T02:06:33.505289+0000","last_active":"2023-07-29T02:06:33.505179+0000","last_peered":"2023-07-29T02:06:33.505179+0000","last_clean":"2023-07-29T02:06:33.505179+0000","last_became_active":"2023-07-29T01:59:53.171440+0000","last_became_peered":"2023-07-29T01:59:53.171440+0000","last_unstale":"2023-07-29T02:06:33.505179+0000","last_undegraded":"2023-07-29T02:06:33.505179+0000","last_fullsized":"2023-07-29T02:06:33.505179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:33.505144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:33.505144+0000","last_clean_scrub_stamp":"2023-07-29T02:06:33.505144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:28.623295+0000","scrub_duration":0.0017891820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"39'8","reported_seq":54,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:37.053724+0000","last_change":"2023-07-29T02:06:37.053856+0000","last_active":"2023-07-29T02:06:37.053724+0000","last_peered":"2023-07-29T02:06:37.053724+0000","last_clean":"2023-07-29T02:06:37.053724+0000","last_became_active":"2023-07-29T01:59:57.537665+0000","last_became_peered":"2023-07-29T01:59:57.537665+0000","last_unstale":"2023-07-29T02:06:37.053724+0000","last_undegraded":"2023-07-29T02:06:37.053724+0000","last_fullsized":"2023-07-29T02:06:37.053724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2023-07-29T02:06:37.053696+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2023-07-29T02:06:37.053696+0000","last_clean_scrub_stamp":"2023-07-29T02:06:37.053696+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:12:59.646704+0000","scrub_duration":0.016447590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":4,"num_write_kb":8199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6040,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"39'84","reported_seq":2147,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:50.033127+0000","last_change":"2023-07-29T02:06:50.033280+0000","last_active":"2023-07-29T02:06:50.033127+0000","last_peered":"2023-07-29T02:06:50.033127+0000","last_clean":"2023-07-29T02:06:50.033127+0000","last_became_active":"2023-07-29T01:59:57.968373+0000","last_became_peered":"2023-07-29T01:59:57.968373+0000","last_unstale":"2023-07-29T02:06:50.033127+0000","last_undegraded":"2023-07-29T02:06:50.033127+0000","last_fullsized":"2023-07-29T02:06:50.033127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'84","last_scrub_stamp":"2023-07-29T02:06:50.033099+0000","last_deep_scrub":"39'84","last_deep_scrub_stamp":"2023-07-29T02:06:50.033099+0000","last_clean_scrub_stamp":"2023-07-29T02:06:50.033099+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:43.174188+0000","scrub_duration":0.001497473,"objects_trimmed":0,"snaptrim_duration":0.21661398800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"39'634","reported_seq":2759,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:12.387123+0000","last_change":"2023-07-29T02:07:12.387306+0000","last_active":"2023-07-29T02:07:12.387123+0000","last_peered":"2023-07-29T02:07:12.387123+0000","last_clean":"2023-07-29T02:07:12.387123+0000","last_became_active":"2023-07-29T02:00:01.984476+0000","last_became_peered":"2023-07-29T02:00:01.984476+0000","last_unstale":"2023-07-29T02:07:12.387123+0000","last_undegraded":"2023-07-29T02:07:12.387123+0000","last_fullsized":"2023-07-29T02:07:12.387123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'634","last_scrub_stamp":"2023-07-29T02:07:12.387078+0000","last_deep_scrub":"39'634","last_deep_scrub_stamp":"2023-07-29T02:07:12.387078+0000","last_clean_scrub_stamp":"2023-07-29T02:07:12.387078+0000","objects_scrubbed":339,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:12:21.891773+0000","scrub_duration":0.144005365,"objects_trimmed":0,"snaptrim_duration":0.55548792300000005,"stat_sum":{"num_bytes":35592378,"num_objects":339,"num_object_clones":0,"num_object_copies":1356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":339,"num_whiteouts":0,"num_read":38,"num_read_kb":16563,"num_write":635,"num_write_kb":39103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:34.723044+0000","last_change":"2023-07-29T02:06:34.723187+0000","last_active":"2023-07-29T02:06:34.723044+0000","last_peered":"2023-07-29T02:06:34.723044+0000","last_clean":"2023-07-29T02:06:34.723044+0000","last_became_active":"2023-07-29T01:59:53.171617+0000","last_became_peered":"2023-07-29T01:59:53.171617+0000","last_unstale":"2023-07-29T02:06:34.723044+0000","last_undegraded":"2023-07-29T02:06:34.723044+0000","last_fullsized":"2023-07-29T02:06:34.723044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:34.723018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:34.723018+0000","last_clean_scrub_stamp":"2023-07-29T02:06:34.723018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:37.976927+0000","scrub_duration":0.0020343689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"39'22","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:02.481326+0000","last_change":"2023-07-29T02:07:02.481441+0000","last_active":"2023-07-29T02:07:02.481326+0000","last_peered":"2023-07-29T02:07:02.481326+0000","last_clean":"2023-07-29T02:07:02.481326+0000","last_became_active":"2023-07-29T01:59:57.540449+0000","last_became_peered":"2023-07-29T01:59:57.540449+0000","last_unstale":"2023-07-29T02:07:02.481326+0000","last_undegraded":"2023-07-29T02:07:02.481326+0000","last_fullsized":"2023-07-29T02:07:02.481326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'22","last_scrub_stamp":"2023-07-29T02:07:02.481294+0000","last_deep_scrub":"39'22","last_deep_scrub_stamp":"2023-07-29T02:07:02.481294+0000","last_clean_scrub_stamp":"2023-07-29T02:07:02.481294+0000","objects_scrubbed":8,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:50:08.265414+0000","scrub_duration":0.014142849000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":67930,"num_omap_keys":113,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"39'91","reported_seq":2154,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.383474+0000","last_change":"2023-07-29T02:06:41.383581+0000","last_active":"2023-07-29T02:06:41.383474+0000","last_peered":"2023-07-29T02:06:41.383474+0000","last_clean":"2023-07-29T02:06:41.383474+0000","last_became_active":"2023-07-29T01:59:57.967933+0000","last_became_peered":"2023-07-29T01:59:57.967933+0000","last_unstale":"2023-07-29T02:06:41.383474+0000","last_undegraded":"2023-07-29T02:06:41.383474+0000","last_fullsized":"2023-07-29T02:06:41.383474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'91","last_scrub_stamp":"2023-07-29T02:06:41.383445+0000","last_deep_scrub":"39'91","last_deep_scrub_stamp":"2023-07-29T02:06:41.383445+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.383445+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:38.898362+0000","scrub_duration":0.001572709,"objects_trimmed":0,"snaptrim_duration":0.54069509900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"39'665","reported_seq":2787,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:55.193248+0000","last_change":"2023-07-29T02:06:55.193374+0000","last_active":"2023-07-29T02:06:55.193248+0000","last_peered":"2023-07-29T02:06:55.193248+0000","last_clean":"2023-07-29T02:06:55.193248+0000","last_became_active":"2023-07-29T02:00:01.984691+0000","last_became_peered":"2023-07-29T02:00:01.984691+0000","last_unstale":"2023-07-29T02:06:55.193248+0000","last_undegraded":"2023-07-29T02:06:55.193248+0000","last_fullsized":"2023-07-29T02:06:55.193248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'665","last_scrub_stamp":"2023-07-29T02:06:55.193222+0000","last_deep_scrub":"39'665","last_deep_scrub_stamp":"2023-07-29T02:06:55.193222+0000","last_clean_scrub_stamp":"2023-07-29T02:06:55.193222+0000","objects_scrubbed":316,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:45.226144+0000","scrub_duration":0.11315589700000001,"objects_trimmed":0,"snaptrim_duration":0.204776021,"stat_sum":{"num_bytes":24859419,"num_objects":316,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":316,"num_whiteouts":0,"num_read":37,"num_read_kb":6702,"num_write":664,"num_write_kb":28713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:32.106823+0000","last_change":"2023-07-29T02:06:32.106957+0000","last_active":"2023-07-29T02:06:32.106823+0000","last_peered":"2023-07-29T02:06:32.106823+0000","last_clean":"2023-07-29T02:06:32.106823+0000","last_became_active":"2023-07-29T01:59:53.171463+0000","last_became_peered":"2023-07-29T01:59:53.171463+0000","last_unstale":"2023-07-29T02:06:32.106823+0000","last_undegraded":"2023-07-29T02:06:32.106823+0000","last_fullsized":"2023-07-29T02:06:32.106823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:32.106799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:32.106799+0000","last_clean_scrub_stamp":"2023-07-29T02:06:32.106799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:45.683196+0000","scrub_duration":0.0021981660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"39'9","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:33.194543+0000","last_change":"2023-07-29T02:06:33.194659+0000","last_active":"2023-07-29T02:06:33.194543+0000","last_peered":"2023-07-29T02:06:33.194543+0000","last_clean":"2023-07-29T02:06:33.194543+0000","last_became_active":"2023-07-29T01:59:57.549181+0000","last_became_peered":"2023-07-29T01:59:57.549181+0000","last_unstale":"2023-07-29T02:06:33.194543+0000","last_undegraded":"2023-07-29T02:06:33.194543+0000","last_fullsized":"2023-07-29T02:06:33.194543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'9","last_scrub_stamp":"2023-07-29T02:06:33.194518+0000","last_deep_scrub":"39'9","last_deep_scrub_stamp":"2023-07-29T02:06:33.194518+0000","last_clean_scrub_stamp":"2023-07-29T02:06:33.194518+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:28.312669+0000","scrub_duration":0.0098727299999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11674,"num_omap_keys":20,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"39'97","reported_seq":2160,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:28.363951+0000","last_change":"2023-07-29T02:06:28.364094+0000","last_active":"2023-07-29T02:06:28.363951+0000","last_peered":"2023-07-29T02:06:28.363951+0000","last_clean":"2023-07-29T02:06:28.363951+0000","last_became_active":"2023-07-29T01:59:57.963659+0000","last_became_peered":"2023-07-29T01:59:57.963659+0000","last_unstale":"2023-07-29T02:06:28.363951+0000","last_undegraded":"2023-07-29T02:06:28.363951+0000","last_fullsized":"2023-07-29T02:06:28.363951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'97","last_scrub_stamp":"2023-07-29T02:06:28.363914+0000","last_deep_scrub":"39'97","last_deep_scrub_stamp":"2023-07-29T02:06:28.363914+0000","last_clean_scrub_stamp":"2023-07-29T02:06:28.363914+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:48.334283+0000","scrub_duration":0.001843236,"objects_trimmed":0,"snaptrim_duration":0.55193447900000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"39'682","reported_seq":2807,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:10.408081+0000","last_change":"2023-07-29T02:07:10.408227+0000","last_active":"2023-07-29T02:07:10.408081+0000","last_peered":"2023-07-29T02:07:10.408081+0000","last_clean":"2023-07-29T02:07:10.408081+0000","last_became_active":"2023-07-29T02:00:01.983744+0000","last_became_peered":"2023-07-29T02:00:01.983744+0000","last_unstale":"2023-07-29T02:07:10.408081+0000","last_undegraded":"2023-07-29T02:07:10.408081+0000","last_fullsized":"2023-07-29T02:07:10.408081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'682","last_scrub_stamp":"2023-07-29T02:07:10.408058+0000","last_deep_scrub":"39'682","last_deep_scrub_stamp":"2023-07-29T02:07:10.408058+0000","last_clean_scrub_stamp":"2023-07-29T02:07:10.408058+0000","objects_scrubbed":318,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:50:16.192178+0000","scrub_duration":0.13696924599999999,"objects_trimmed":0,"snaptrim_duration":0.552203522,"stat_sum":{"num_bytes":32278530,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":40,"num_read_kb":16416,"num_write":683,"num_write_kb":31830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:28.151338+0000","last_change":"2023-07-29T02:06:28.151465+0000","last_active":"2023-07-29T02:06:28.151338+0000","last_peered":"2023-07-29T02:06:28.151338+0000","last_clean":"2023-07-29T02:06:28.151338+0000","last_became_active":"2023-07-29T01:59:52.448814+0000","last_became_peered":"2023-07-29T01:59:52.448814+0000","last_unstale":"2023-07-29T02:06:28.151338+0000","last_undegraded":"2023-07-29T02:06:28.151338+0000","last_fullsized":"2023-07-29T02:06:28.151338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:28.151312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:28.151312+0000","last_clean_scrub_stamp":"2023-07-29T02:06:28.151312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:01:18.856007+0000","scrub_duration":0.0019737660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"39'428","reported_seq":473,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:38.773403+0000","last_change":"2023-07-29T02:06:38.773525+0000","last_active":"2023-07-29T02:06:38.773403+0000","last_peered":"2023-07-29T02:06:38.773403+0000","last_clean":"2023-07-29T02:06:38.773403+0000","last_became_active":"2023-07-29T01:59:57.544317+0000","last_became_peered":"2023-07-29T01:59:57.544317+0000","last_unstale":"2023-07-29T02:06:38.773403+0000","last_undegraded":"2023-07-29T02:06:38.773403+0000","last_fullsized":"2023-07-29T02:06:38.773403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'428","last_scrub_stamp":"2023-07-29T02:06:38.773375+0000","last_deep_scrub":"39'428","last_deep_scrub_stamp":"2023-07-29T02:06:38.773375+0000","last_clean_scrub_stamp":"2023-07-29T02:06:38.773375+0000","objects_scrubbed":3,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:36.288292+0000","scrub_duration":0.023010361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":424,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"39'90","reported_seq":2153,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:34.198334+0000","last_change":"2023-07-29T02:06:34.198474+0000","last_active":"2023-07-29T02:06:34.198334+0000","last_peered":"2023-07-29T02:06:34.198334+0000","last_clean":"2023-07-29T02:06:34.198334+0000","last_became_active":"2023-07-29T01:59:57.969642+0000","last_became_peered":"2023-07-29T01:59:57.969642+0000","last_unstale":"2023-07-29T02:06:34.198334+0000","last_undegraded":"2023-07-29T02:06:34.198334+0000","last_fullsized":"2023-07-29T02:06:34.198334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'90","last_scrub_stamp":"2023-07-29T02:06:34.198306+0000","last_deep_scrub":"39'90","last_deep_scrub_stamp":"2023-07-29T02:06:34.198306+0000","last_clean_scrub_stamp":"2023-07-29T02:06:34.198306+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:54.168675+0000","scrub_duration":0.0019970069999999999,"objects_trimmed":0,"snaptrim_duration":0.53741660000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"39'637","reported_seq":2766,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:52.533133+0000","last_change":"2023-07-29T02:06:52.533376+0000","last_active":"2023-07-29T02:06:52.533133+0000","last_peered":"2023-07-29T02:06:52.533133+0000","last_clean":"2023-07-29T02:06:52.533133+0000","last_became_active":"2023-07-29T02:00:01.998715+0000","last_became_peered":"2023-07-29T02:00:01.998715+0000","last_unstale":"2023-07-29T02:06:52.533133+0000","last_undegraded":"2023-07-29T02:06:52.533133+0000","last_fullsized":"2023-07-29T02:06:52.533133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'637","last_scrub_stamp":"2023-07-29T02:06:52.533107+0000","last_deep_scrub":"39'637","last_deep_scrub_stamp":"2023-07-29T02:06:52.533107+0000","last_clean_scrub_stamp":"2023-07-29T02:06:52.533107+0000","objects_scrubbed":317,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:53:35.163365+0000","scrub_duration":0.114413124,"objects_trimmed":0,"snaptrim_duration":0.54131381700000003,"stat_sum":{"num_bytes":21401745,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":45,"num_read_kb":12330,"num_write":635,"num_write_kb":33528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"39'140","reported_seq":184,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:38.331660+0000","last_change":"2023-07-29T02:06:38.331785+0000","last_active":"2023-07-29T02:06:38.331660+0000","last_peered":"2023-07-29T02:06:38.331660+0000","last_clean":"2023-07-29T02:06:38.331660+0000","last_became_active":"2023-07-29T01:59:57.545744+0000","last_became_peered":"2023-07-29T01:59:57.545744+0000","last_unstale":"2023-07-29T02:06:38.331660+0000","last_undegraded":"2023-07-29T02:06:38.331660+0000","last_fullsized":"2023-07-29T02:06:38.331660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'140","last_scrub_stamp":"2023-07-29T02:06:38.331635+0000","last_deep_scrub":"39'140","last_deep_scrub_stamp":"2023-07-29T02:06:38.331635+0000","last_clean_scrub_stamp":"2023-07-29T02:06:38.331635+0000","objects_scrubbed":4,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:16.541693+0000","scrub_duration":0.014197192000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":139,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22538,"num_omap_keys":38,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"39'92","reported_seq":2154,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:29.765400+0000","last_change":"2023-07-29T02:06:29.765521+0000","last_active":"2023-07-29T02:06:29.765400+0000","last_peered":"2023-07-29T02:06:29.765400+0000","last_clean":"2023-07-29T02:06:29.765400+0000","last_became_active":"2023-07-29T01:59:57.970252+0000","last_became_peered":"2023-07-29T01:59:57.970252+0000","last_unstale":"2023-07-29T02:06:29.765400+0000","last_undegraded":"2023-07-29T02:06:29.765400+0000","last_fullsized":"2023-07-29T02:06:29.765400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'92","last_scrub_stamp":"2023-07-29T02:06:29.765372+0000","last_deep_scrub":"39'92","last_deep_scrub_stamp":"2023-07-29T02:06:29.765372+0000","last_clean_scrub_stamp":"2023-07-29T02:06:29.765372+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:59:27.382387+0000","scrub_duration":0.0016174830000000001,"objects_trimmed":0,"snaptrim_duration":0.46822948199999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"39'637","reported_seq":2759,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:15.656450+0000","last_change":"2023-07-29T02:07:15.656581+0000","last_active":"2023-07-29T02:07:15.656450+0000","last_peered":"2023-07-29T02:07:15.656450+0000","last_clean":"2023-07-29T02:07:15.656450+0000","last_became_active":"2023-07-29T02:00:01.989481+0000","last_became_peered":"2023-07-29T02:00:01.989481+0000","last_unstale":"2023-07-29T02:07:15.656450+0000","last_undegraded":"2023-07-29T02:07:15.656450+0000","last_fullsized":"2023-07-29T02:07:15.656450+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'637","last_scrub_stamp":"2023-07-29T02:07:15.656424+0000","last_deep_scrub":"39'637","last_deep_scrub_stamp":"2023-07-29T02:07:15.656424+0000","last_clean_scrub_stamp":"2023-07-29T02:07:15.656424+0000","objects_scrubbed":309,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:06:33.365257+0000","scrub_duration":0.124947748,"objects_trimmed":0,"snaptrim_duration":0.187630984,"stat_sum":{"num_bytes":25047033,"num_objects":309,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":38,"num_read_kb":8227,"num_write":637,"num_write_kb":24796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"39'117","reported_seq":166,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.700467+0000","last_change":"2023-07-29T02:06:41.700574+0000","last_active":"2023-07-29T02:06:41.700467+0000","last_peered":"2023-07-29T02:06:41.700467+0000","last_clean":"2023-07-29T02:06:41.700467+0000","last_became_active":"2023-07-29T01:59:57.543445+0000","last_became_peered":"2023-07-29T01:59:57.543445+0000","last_unstale":"2023-07-29T02:06:41.700467+0000","last_undegraded":"2023-07-29T02:06:41.700467+0000","last_fullsized":"2023-07-29T02:06:41.700467+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'117","last_scrub_stamp":"2023-07-29T02:06:41.700441+0000","last_deep_scrub":"39'117","last_deep_scrub_stamp":"2023-07-29T02:06:41.700441+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.700441+0000","objects_scrubbed":5,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:19.910499+0000","scrub_duration":0.011827798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":114,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":38984,"num_omap_keys":65,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"39'90","reported_seq":2152,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:28.472206+0000","last_change":"2023-07-29T02:06:28.472340+0000","last_active":"2023-07-29T02:06:28.472206+0000","last_peered":"2023-07-29T02:06:28.472206+0000","last_clean":"2023-07-29T02:06:28.472206+0000","last_became_active":"2023-07-29T01:59:57.964925+0000","last_became_peered":"2023-07-29T01:59:57.964925+0000","last_unstale":"2023-07-29T02:06:28.472206+0000","last_undegraded":"2023-07-29T02:06:28.472206+0000","last_fullsized":"2023-07-29T02:06:28.472206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'90","last_scrub_stamp":"2023-07-29T02:06:28.472178+0000","last_deep_scrub":"39'90","last_deep_scrub_stamp":"2023-07-29T02:06:28.472178+0000","last_clean_scrub_stamp":"2023-07-29T02:06:28.472178+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:06.682236+0000","scrub_duration":0.0018172119999999999,"objects_trimmed":0,"snaptrim_duration":0.35003659399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'665","reported_seq":2786,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:12.746943+0000","last_change":"2023-07-29T02:07:12.747062+0000","last_active":"2023-07-29T02:07:12.746943+0000","last_peered":"2023-07-29T02:07:12.746943+0000","last_clean":"2023-07-29T02:07:12.746943+0000","last_became_active":"2023-07-29T02:00:01.985310+0000","last_became_peered":"2023-07-29T02:00:01.985310+0000","last_unstale":"2023-07-29T02:07:12.746943+0000","last_undegraded":"2023-07-29T02:07:12.746943+0000","last_fullsized":"2023-07-29T02:07:12.746943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'665","last_scrub_stamp":"2023-07-29T02:07:12.746919+0000","last_deep_scrub":"39'665","last_deep_scrub_stamp":"2023-07-29T02:07:12.746919+0000","last_clean_scrub_stamp":"2023-07-29T02:07:12.746919+0000","objects_scrubbed":304,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:04:40.988936+0000","scrub_duration":0.12251861,"objects_trimmed":0,"snaptrim_duration":0.31035642899999999,"stat_sum":{"num_bytes":19557603,"num_objects":304,"num_object_clones":0,"num_object_copies":1216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":304,"num_whiteouts":0,"num_read":36,"num_read_kb":35,"num_write":665,"num_write_kb":19402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"39'94","reported_seq":145,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:42.709299+0000","last_change":"2023-07-29T02:06:42.709432+0000","last_active":"2023-07-29T02:06:42.709299+0000","last_peered":"2023-07-29T02:06:42.709299+0000","last_clean":"2023-07-29T02:06:42.709299+0000","last_became_active":"2023-07-29T01:59:57.541633+0000","last_became_peered":"2023-07-29T01:59:57.541633+0000","last_unstale":"2023-07-29T02:06:42.709299+0000","last_undegraded":"2023-07-29T02:06:42.709299+0000","last_fullsized":"2023-07-29T02:06:42.709299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'94","last_scrub_stamp":"2023-07-29T02:06:42.709271+0000","last_deep_scrub":"39'94","last_deep_scrub_stamp":"2023-07-29T02:06:42.709271+0000","last_clean_scrub_stamp":"2023-07-29T02:06:42.709271+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:13:05.302279+0000","scrub_duration":0.032654646000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":18,"num_read_kb":12303,"num_write":84,"num_write_kb":16462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":29892,"num_omap_keys":51,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"39'85","reported_seq":2147,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:26.458452+0000","last_change":"2023-07-29T02:06:26.458592+0000","last_active":"2023-07-29T02:06:26.458452+0000","last_peered":"2023-07-29T02:06:26.458452+0000","last_clean":"2023-07-29T02:06:26.458452+0000","last_became_active":"2023-07-29T01:59:57.965383+0000","last_became_peered":"2023-07-29T01:59:57.965383+0000","last_unstale":"2023-07-29T02:06:26.458452+0000","last_undegraded":"2023-07-29T02:06:26.458452+0000","last_fullsized":"2023-07-29T02:06:26.458452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'85","last_scrub_stamp":"2023-07-29T02:06:26.458409+0000","last_deep_scrub":"39'85","last_deep_scrub_stamp":"2023-07-29T02:06:26.458409+0000","last_clean_scrub_stamp":"2023-07-29T02:06:26.458409+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:23.973325+0000","scrub_duration":0.0020203869999999998,"objects_trimmed":0,"snaptrim_duration":0.352110162,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"39'676","reported_seq":2765,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.229930+0000","last_change":"2023-07-29T02:03:57.114115+0000","last_active":"2023-07-29T02:06:24.229930+0000","last_peered":"2023-07-29T02:06:24.229930+0000","last_clean":"2023-07-29T02:06:24.229930+0000","last_became_active":"2023-07-29T02:00:01.993454+0000","last_became_peered":"2023-07-29T02:00:01.993454+0000","last_unstale":"2023-07-29T02:06:24.229930+0000","last_undegraded":"2023-07-29T02:06:24.229930+0000","last_fullsized":"2023-07-29T02:06:24.229930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:00:00.960742+0000","last_clean_scrub_stamp":"2023-07-29T02:00:00.960742+0000","objects_scrubbed":0,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.33100711700000002,"stat_sum":{"num_bytes":33339861,"num_objects":341,"num_object_clones":0,"num_object_copies":1364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":0,"num_read":39,"num_read_kb":19097,"num_write":677,"num_write_kb":41065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"39'127","reported_seq":172,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:36.017890+0000","last_change":"2023-07-29T02:06:36.018010+0000","last_active":"2023-07-29T02:06:36.017890+0000","last_peered":"2023-07-29T02:06:36.017890+0000","last_clean":"2023-07-29T02:06:36.017890+0000","last_became_active":"2023-07-29T01:59:57.539181+0000","last_became_peered":"2023-07-29T01:59:57.539181+0000","last_unstale":"2023-07-29T02:06:36.017890+0000","last_undegraded":"2023-07-29T02:06:36.017890+0000","last_fullsized":"2023-07-29T02:06:36.017890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'127","last_scrub_stamp":"2023-07-29T02:06:36.017861+0000","last_deep_scrub":"39'127","last_deep_scrub_stamp":"2023-07-29T02:06:36.017861+0000","last_clean_scrub_stamp":"2023-07-29T02:06:36.017861+0000","objects_scrubbed":5,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:14.227919+0000","scrub_duration":0.025569596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":120,"num_write_kb":12364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18028,"num_omap_keys":30,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"39'91","reported_seq":2154,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:28.854311+0000","last_change":"2023-07-29T02:06:28.854311+0000","last_active":"2023-07-29T02:06:28.854311+0000","last_peered":"2023-07-29T02:06:28.854311+0000","last_clean":"2023-07-29T02:06:28.854311+0000","last_became_active":"2023-07-29T01:59:57.966580+0000","last_became_peered":"2023-07-29T01:59:57.966580+0000","last_unstale":"2023-07-29T02:06:28.854311+0000","last_undegraded":"2023-07-29T02:06:28.854311+0000","last_fullsized":"2023-07-29T02:06:28.854311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'91","last_scrub_stamp":"2023-07-29T02:06:28.854093+0000","last_deep_scrub":"39'91","last_deep_scrub_stamp":"2023-07-29T02:06:28.854093+0000","last_clean_scrub_stamp":"2023-07-29T02:06:28.854093+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:32.108002+0000","scrub_duration":0.001683281,"objects_trimmed":0,"snaptrim_duration":0.38010548900000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"39'649","reported_seq":2770,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:50.570454+0000","last_change":"2023-07-29T02:06:50.570454+0000","last_active":"2023-07-29T02:06:50.570454+0000","last_peered":"2023-07-29T02:06:50.570454+0000","last_clean":"2023-07-29T02:06:50.570454+0000","last_became_active":"2023-07-29T02:00:01.985554+0000","last_became_peered":"2023-07-29T02:00:01.985554+0000","last_unstale":"2023-07-29T02:06:50.570454+0000","last_undegraded":"2023-07-29T02:06:50.570454+0000","last_fullsized":"2023-07-29T02:06:50.570454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'649","last_scrub_stamp":"2023-07-29T02:06:50.570218+0000","last_deep_scrub":"39'649","last_deep_scrub_stamp":"2023-07-29T02:06:50.570218+0000","last_clean_scrub_stamp":"2023-07-29T02:06:50.570218+0000","objects_scrubbed":290,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:33:24.431230+0000","scrub_duration":0.124491425,"objects_trimmed":0,"snaptrim_duration":0.53877218400000004,"stat_sum":{"num_bytes":39819276,"num_objects":290,"num_object_clones":0,"num_object_copies":1160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":290,"num_whiteouts":0,"num_read":38,"num_read_kb":16418,"num_write":646,"num_write_kb":43313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"39'140","reported_seq":191,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:40.302084+0000","last_change":"2023-07-29T02:06:40.302188+0000","last_active":"2023-07-29T02:06:40.302084+0000","last_peered":"2023-07-29T02:06:40.302084+0000","last_clean":"2023-07-29T02:06:40.302084+0000","last_became_active":"2023-07-29T01:59:57.537457+0000","last_became_peered":"2023-07-29T01:59:57.537457+0000","last_unstale":"2023-07-29T02:06:40.302084+0000","last_undegraded":"2023-07-29T02:06:40.302084+0000","last_fullsized":"2023-07-29T02:06:40.302084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'140","last_scrub_stamp":"2023-07-29T02:06:40.302059+0000","last_deep_scrub":"39'140","last_deep_scrub_stamp":"2023-07-29T02:06:40.302059+0000","last_clean_scrub_stamp":"2023-07-29T02:06:40.302059+0000","objects_scrubbed":5,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:45:14.737193+0000","scrub_duration":0.022800549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":132,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12841,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"39'109","reported_seq":2172,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:07.490784+0000","last_change":"2023-07-29T02:07:07.490784+0000","last_active":"2023-07-29T02:07:07.490784+0000","last_peered":"2023-07-29T02:07:07.490784+0000","last_clean":"2023-07-29T02:07:07.490784+0000","last_became_active":"2023-07-29T01:59:57.960318+0000","last_became_peered":"2023-07-29T01:59:57.960318+0000","last_unstale":"2023-07-29T02:07:07.490784+0000","last_undegraded":"2023-07-29T02:07:07.490784+0000","last_fullsized":"2023-07-29T02:07:07.490784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'109","last_scrub_stamp":"2023-07-29T02:07:07.490662+0000","last_deep_scrub":"39'109","last_deep_scrub_stamp":"2023-07-29T02:07:07.490662+0000","last_clean_scrub_stamp":"2023-07-29T02:07:07.490662+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:53:01.945260+0000","scrub_duration":0.001138392,"objects_trimmed":0,"snaptrim_duration":0.32984874600000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"39'107","reported_seq":2171,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:59.145066+0000","last_change":"2023-07-29T02:06:59.145205+0000","last_active":"2023-07-29T02:06:59.145066+0000","last_peered":"2023-07-29T02:06:59.145066+0000","last_clean":"2023-07-29T02:06:59.145066+0000","last_became_active":"2023-07-29T01:59:57.959960+0000","last_became_peered":"2023-07-29T01:59:57.959960+0000","last_unstale":"2023-07-29T02:06:59.145066+0000","last_undegraded":"2023-07-29T02:06:59.145066+0000","last_fullsized":"2023-07-29T02:06:59.145066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'107","last_scrub_stamp":"2023-07-29T02:06:59.145036+0000","last_deep_scrub":"39'107","last_deep_scrub_stamp":"2023-07-29T02:06:59.145036+0000","last_clean_scrub_stamp":"2023-07-29T02:06:59.145036+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:53:41.775294+0000","scrub_duration":0.0028364250000000001,"objects_trimmed":0,"snaptrim_duration":0.22491762700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"39'110","reported_seq":2174,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:18.058146+0000","last_change":"2023-07-29T02:07:18.058269+0000","last_active":"2023-07-29T02:07:18.058146+0000","last_peered":"2023-07-29T02:07:18.058146+0000","last_clean":"2023-07-29T02:07:18.058146+0000","last_became_active":"2023-07-29T01:59:57.975384+0000","last_became_peered":"2023-07-29T01:59:57.975384+0000","last_unstale":"2023-07-29T02:07:18.058146+0000","last_undegraded":"2023-07-29T02:07:18.058146+0000","last_fullsized":"2023-07-29T02:07:18.058146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'110","last_scrub_stamp":"2023-07-29T02:07:18.058118+0000","last_deep_scrub":"39'110","last_deep_scrub_stamp":"2023-07-29T02:07:18.058118+0000","last_clean_scrub_stamp":"2023-07-29T02:07:18.058118+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:39:26.368541+0000","scrub_duration":0.0016819020000000001,"objects_trimmed":0,"snaptrim_duration":0.38175464599999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"39'101","reported_seq":2164,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:30.442599+0000","last_change":"2023-07-29T02:06:30.442707+0000","last_active":"2023-07-29T02:06:30.442599+0000","last_peered":"2023-07-29T02:06:30.442599+0000","last_clean":"2023-07-29T02:06:30.442599+0000","last_became_active":"2023-07-29T01:59:57.967603+0000","last_became_peered":"2023-07-29T01:59:57.967603+0000","last_unstale":"2023-07-29T02:06:30.442599+0000","last_undegraded":"2023-07-29T02:06:30.442599+0000","last_fullsized":"2023-07-29T02:06:30.442599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'101","last_scrub_stamp":"2023-07-29T02:06:30.442572+0000","last_deep_scrub":"39'101","last_deep_scrub_stamp":"2023-07-29T02:06:30.442572+0000","last_clean_scrub_stamp":"2023-07-29T02:06:30.442572+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:12:53.035580+0000","scrub_duration":0.001551853,"objects_trimmed":0,"snaptrim_duration":0.350807488,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"39'99","reported_seq":2162,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:56.069929+0000","last_change":"2023-07-29T02:06:56.070035+0000","last_active":"2023-07-29T02:06:56.069929+0000","last_peered":"2023-07-29T02:06:56.069929+0000","last_clean":"2023-07-29T02:06:56.069929+0000","last_became_active":"2023-07-29T01:59:57.966672+0000","last_became_peered":"2023-07-29T01:59:57.966672+0000","last_unstale":"2023-07-29T02:06:56.069929+0000","last_undegraded":"2023-07-29T02:06:56.069929+0000","last_fullsized":"2023-07-29T02:06:56.069929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'99","last_scrub_stamp":"2023-07-29T02:06:56.069903+0000","last_deep_scrub":"39'99","last_deep_scrub_stamp":"2023-07-29T02:06:56.069903+0000","last_clean_scrub_stamp":"2023-07-29T02:06:56.069903+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:36:54.809998+0000","scrub_duration":0.001739141,"objects_trimmed":0,"snaptrim_duration":0.39433596799999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"39'79","reported_seq":2142,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:46.360697+0000","last_change":"2023-07-29T02:06:46.360780+0000","last_active":"2023-07-29T02:06:46.360697+0000","last_peered":"2023-07-29T02:06:46.360697+0000","last_clean":"2023-07-29T02:06:46.360697+0000","last_became_active":"2023-07-29T01:59:57.968449+0000","last_became_peered":"2023-07-29T01:59:57.968449+0000","last_unstale":"2023-07-29T02:06:46.360697+0000","last_undegraded":"2023-07-29T02:06:46.360697+0000","last_fullsized":"2023-07-29T02:06:46.360697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'79","last_scrub_stamp":"2023-07-29T02:06:46.360676+0000","last_deep_scrub":"39'79","last_deep_scrub_stamp":"2023-07-29T02:06:46.360676+0000","last_clean_scrub_stamp":"2023-07-29T02:06:46.360676+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:13:08.953684+0000","scrub_duration":0.0019273090000000001,"objects_trimmed":0,"snaptrim_duration":0.54020755499999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":918109411,"num_objects":10156,"num_object_clones":0,"num_object_copies":40624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10156,"num_whiteouts":0,"num_read":1251,"num_read_kb":366219,"num_write":20741,"num_write_kb":1040888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1801588736,"data_stored":1952841728,"data_compressed":122947712,"data_compressed_allocated":138481664,"data_compressed_original":289734656,"omap_allocated":0,"internal_metadata":0},"log_size":20769,"ondisk_log_size":20769,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5774,"ondisk_log_size":5774,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":235792097,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":309,"num_read_kb":151139,"num_write":3982,"num_write_kb":234638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":586841,"num_omap_keys":984,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99221504,"data_stored":471584194,"data_compressed":61258084,"data_compressed_allocated":77160448,"data_compressed_original":449585152,"omap_allocated":0,"internal_metadata":0},"log_size":4079,"ondisk_log_size":4079,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574942,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313140,"kb_used_data":223852,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94058700,"statfs":{"total":96636764160,"available":96316108800,"internally_reserved":0,"allocated":229224448,"data_stored":300310153,"data_compressed":25236479,"data_compressed_allocated":29581312,"data_compressed_original":100917248,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.59199999999999997,"15min":0.52600000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.8690000000000002,"5min":6.0650000000000004,"15min":6.0650000000000004},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.60399999999999998,"15min":0.53600000000000003},"min":{"1min":0.27900000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":5.4450000000000003,"5min":5.4450000000000003,"15min":5.4450000000000003},"last":0.77300000000000002}]},{"osd":1,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68799999999999994,"15min":0.56699999999999995},"min":{"1min":0.30299999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.0230000000000001,"5min":10.303000000000001,"15min":10.303000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.78500000000000003,"15min":0.622},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.77800000000000002,"5min":19.527999999999999,"15min":19.527999999999999},"last":0.66900000000000004}]},{"osd":2,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":2.835,"5min":1.091,"15min":0.74399999999999999},"min":{"1min":0.35099999999999998,"5min":0.307,"15min":0.307},"max":{"1min":42.037999999999997,"5min":42.037999999999997,"15min":42.037999999999997},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.64400000000000002,"15min":0.58599999999999997},"min":{"1min":0.40200000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":5.524,"5min":5.524,"15min":5.524},"last":0.71699999999999997}]},{"osd":3,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":0.77600000000000002,"15min":0.63100000000000001},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":19.533999999999999,"5min":19.533999999999999,"15min":19.533999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.39100000000000001,"5min":0.308,"15min":0.308},"max":{"1min":4.8099999999999996,"5min":4.8099999999999996,"15min":4.8099999999999996},"last":0.755}]},{"osd":4,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.52700000000000002,"15min":0.54000000000000004},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.5789999999999997,"5min":5.5789999999999997,"15min":5.5789999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.51100000000000001,"15min":0.55800000000000005},"min":{"1min":0.31900000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":0.60799999999999998}]},{"osd":5,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.32800000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":5.5499999999999998,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.57099999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":2.0819999999999999,"5min":3.621,"15min":3.621},"last":0.74199999999999999}]},{"osd":6,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.60199999999999998,"15min":0.61499999999999999},"min":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.492,"5min":5.492,"15min":5.492},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.58799999999999997,"15min":0.626},"min":{"1min":0.433,"5min":0.312,"15min":0.312},"max":{"1min":2.0609999999999999,"5min":3.488,"15min":3.488},"last":0.78400000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574942,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304904,"kb_used_data":241856,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":94066936,"statfs":{"total":96636764160,"available":96324542464,"internally_reserved":0,"allocated":247660544,"data_stored":288753905,"data_compressed":18888304,"data_compressed_allocated":21577728,"data_compressed_original":62894080,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.63600000000000001,"15min":0.56299999999999994},"min":{"1min":0.46800000000000003,"5min":0.215,"15min":0.215},"max":{"1min":6.3470000000000004,"5min":7,"15min":7},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.1910000000000001,"5min":0.75700000000000001,"15min":0.60599999999999998},"min":{"1min":0.39300000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":13.166,"5min":13.166,"15min":13.166},"last":0.80300000000000005}]},{"osd":1,"last update":"Sat Jul 29 02:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.69599999999999995,"15min":0.59499999999999997},"min":{"1min":0.42099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":5.6479999999999997,"5min":12.462,"15min":12.462},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.69699999999999995,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":8.2989999999999995,"5min":8.2989999999999995,"15min":8.2989999999999995},"last":0.877}]},{"osd":2,"last update":"Sat Jul 29 02:07:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":0.65000000000000002,"15min":0.58099999999999996},"min":{"1min":0.40699999999999997,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":11.327,"5min":11.327,"15min":11.327},"last":0.73599999999999999},{"interface":"front","average":{"1min":1.0669999999999999,"5min":0.69999999999999996,"15min":0.60799999999999998},"min":{"1min":0.47399999999999998,"5min":0.314,"15min":0.314},"max":{"1min":10.535,"5min":10.535,"15min":10.535},"last":0.89600000000000002}]},{"osd":3,"last update":"Sat Jul 29 02:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.66100000000000003,"15min":0.60099999999999998},"min":{"1min":0.47699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.242,"5min":6.4889999999999999,"15min":6.4889999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.69699999999999995,"15min":0.63100000000000001},"min":{"1min":0.45600000000000002,"5min":0.252,"15min":0.252},"max":{"1min":5.8639999999999999,"5min":6.8559999999999999,"15min":6.8559999999999999},"last":0.66700000000000004}]},{"osd":4,"last update":"Sat Jul 29 02:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.68400000000000005,"15min":0.58399999999999996},"min":{"1min":0.29899999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.69899999999999995,"5min":24.123999999999999,"15min":24.123999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.374,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.272,"5min":6.3710000000000004,"15min":6.3710000000000004},"last":0.67500000000000004}]},{"osd":5,"last update":"Sat Jul 29 02:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48199999999999998,"15min":0.53300000000000003},"min":{"1min":0.32200000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63100000000000001,"5min":0.82999999999999996,"15min":1.1140000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.63800000000000001,"15min":0.59599999999999997},"min":{"1min":0.33600000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":5.6829999999999998,"5min":6.9669999999999996,"15min":6.9669999999999996},"last":0.78700000000000003}]},{"osd":7,"last update":"Sat Jul 29 02:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.66700000000000004,"15min":0.61199999999999999},"min":{"1min":0.36699999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":8.3369999999999997,"5min":8.3369999999999997,"15min":8.3369999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.39700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":1.5780000000000001,"5min":5.2300000000000004,"15min":5.2300000000000004},"last":0.63400000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371584,"kb_used_data":268344,"kb_used_omap":0,"kb_used_meta":103232,"kb_avail":94000256,"statfs":{"total":96636764160,"available":96256262144,"internally_reserved":0,"allocated":274784256,"data_stored":329875756,"data_compressed":22338055,"data_compressed_allocated":25993216,"data_compressed_original":81313792,"omap_allocated":0,"internal_metadata":105709568},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.39900000000000002,"15min":0.501},"min":{"1min":0.248,"5min":0.20799999999999999,"15min":0.20399999999999999},"max":{"1min":0.505,"5min":3.7989999999999999,"15min":7.1299999999999999},"last":0.376},{"interface":"front","average":{"1min":0.627,"5min":0.439,"15min":0.51300000000000001},"min":{"1min":0.28399999999999997,"5min":0.23200000000000001,"15min":0.22800000000000001},"max":{"1min":4.5179999999999998,"5min":4.5179999999999998,"15min":5.4779999999999998},"last":0.34100000000000003}]},{"osd":2,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.86599999999999999},"min":{"1min":0.252,"5min":0.214,"15min":0.20899999999999999},"max":{"1min":6.1079999999999997,"5min":22.483000000000001,"15min":22.483000000000001},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.47199999999999998,"15min":0.66000000000000003},"min":{"1min":0.30399999999999999,"5min":0.27700000000000002,"15min":0.26300000000000001},"max":{"1min":2.177,"5min":3.0619999999999998,"15min":11.028},"last":0.42499999999999999}]},{"osd":3,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48299999999999998,"15min":0.58799999999999997},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67400000000000004,"5min":2.9900000000000002,"15min":7.1699999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.47199999999999998,"15min":0.41499999999999998},"min":{"1min":0.33200000000000002,"5min":0.245,"15min":0.245},"max":{"1min":4.484,"5min":4.484,"15min":4.484},"last":0.39600000000000002}]},{"osd":4,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":2.2370000000000001,"5min":1.022,"15min":1.1160000000000001},"min":{"1min":0.36399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":31.68,"5min":31.68,"15min":31.68},"last":0.61899999999999999},{"interface":"front","average":{"1min":1.702,"5min":0.84499999999999997,"15min":0.91400000000000003},"min":{"1min":0.435,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":20.733000000000001,"5min":20.733000000000001,"15min":20.733000000000001},"last":0.80400000000000005}]},{"osd":5,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.65600000000000003,"15min":0.71799999999999997},"min":{"1min":0.48199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.4219999999999997,"5min":4.4219999999999997,"15min":5.391},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70499999999999996,"15min":1.0469999999999999},"min":{"1min":0.47199999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.3480000000000001,"5min":5.8849999999999998,"15min":17.994},"last":0.70699999999999996}]},{"osd":6,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63100000000000001,"15min":0.72999999999999998},"min":{"1min":0.51600000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88900000000000001,"5min":0.91300000000000003,"15min":5.452},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73899999999999999,"15min":1.0389999999999999},"min":{"1min":0.40699999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3779999999999999,"5min":5.8540000000000001,"15min":17.963999999999999},"last":0.78600000000000003}]},{"osd":7,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":0.80500000000000005,"15min":0.90900000000000003},"min":{"1min":0.51900000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":12.16,"5min":12.16,"15min":12.16},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67400000000000004,"15min":0.753},"min":{"1min":0.56100000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0269999999999999,"5min":2.9889999999999999,"15min":5.4249999999999998},"last":0.56799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329076,"kb_used_data":239788,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94042764,"statfs":{"total":96636764160,"available":96299790336,"internally_reserved":0,"allocated":245542912,"data_stored":309139007,"data_compressed":23440797,"data_compressed_allocated":27287552,"data_compressed_original":91111424,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jul 29 02:07:08 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":0.97699999999999998,"15min":0.54800000000000004},"min":{"1min":0.246,"5min":0.161,"15min":0.161},"max":{"1min":20.379000000000001,"5min":39.070999999999998,"15min":39.070999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":1.321,"5min":0.629,"15min":0.45200000000000001},"min":{"1min":0.23300000000000001,"5min":0.218,"15min":0.21299999999999999},"max":{"1min":18.800999999999998,"5min":18.800999999999998,"15min":18.800999999999998},"last":0.40100000000000002}]},{"osd":2,"last update":"Sat Jul 29 02:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.623,"15min":0.47899999999999998},"min":{"1min":0.315,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":7.6890000000000001,"5min":10.438000000000001,"15min":10.438000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.63600000000000001,"15min":0.48499999999999999},"min":{"1min":0.34499999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":7.0709999999999997,"5min":10.802,"15min":10.802},"last":0.44800000000000001}]},{"osd":3,"last update":"Sat Jul 29 02:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.53700000000000003,"15min":0.42399999999999999},"min":{"1min":0.28699999999999998,"5min":0.246,"15min":0.246},"max":{"1min":7.0529999999999999,"5min":7.0529999999999999,"15min":7.0529999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.58699999999999997,"15min":0.47999999999999998},"min":{"1min":0.29699999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":7.5999999999999996,"5min":7.5999999999999996,"15min":7.5999999999999996},"last":0.42299999999999999}]},{"osd":4,"last update":"Sat Jul 29 02:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.66600000000000004,"15min":0.623},"min":{"1min":0.42299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":7.1390000000000002,"5min":7.1390000000000002,"15min":7.1390000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":1.2490000000000001,"5min":0.80000000000000004,"15min":0.67200000000000004},"min":{"1min":0.45700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":13.398999999999999,"5min":13.398999999999999,"15min":13.398999999999999},"last":0.60699999999999998}]},{"osd":5,"last update":"Sat Jul 29 02:07:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.71499999999999997,"15min":0.63900000000000001},"min":{"1min":0.45400000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":10.106999999999999,"5min":10.106999999999999,"15min":10.106999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.177,"5min":0.74199999999999999,"15min":0.66100000000000003},"min":{"1min":0.44700000000000001,"5min":0.377,"15min":0.377},"max":{"1min":12.324999999999999,"5min":12.324999999999999,"15min":12.324999999999999},"last":0.62}]},{"osd":6,"last update":"Sat Jul 29 02:07:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":0.82799999999999996,"15min":0.69599999999999995},"min":{"1min":0.45700000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":15.609,"5min":15.609,"15min":15.609},"last":0.56699999999999995},{"interface":"front","average":{"1min":1.5569999999999999,"5min":0.84099999999999997,"15min":0.70399999999999996},"min":{"1min":0.437,"5min":0.38,"15min":0.38},"max":{"1min":19.013000000000002,"5min":19.013000000000002,"15min":19.013000000000002},"last":0.58199999999999996}]},{"osd":7,"last update":"Sat Jul 29 02:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.74199999999999999,"15min":0.67200000000000004},"min":{"1min":0.502,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":6.6920000000000002,"5min":6.6920000000000002,"15min":6.6920000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.238,"5min":0.79500000000000004,"15min":0.69999999999999996},"min":{"1min":0.42499999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":12.276999999999999,"5min":12.276999999999999,"15min":12.276999999999999},"last":0.69999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574942,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268060,"kb_used_data":200916,"kb_used_omap":0,"kb_used_meta":67136,"kb_avail":94103780,"statfs":{"total":96636764160,"available":96362270720,"internally_reserved":0,"allocated":205737984,"data_stored":235440369,"data_compressed":13107136,"data_compressed_allocated":15015936,"data_compressed_original":44941312,"omap_allocated":0,"internal_metadata":68747264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46999999999999997,"15min":0.40000000000000002},"min":{"1min":0.255,"5min":0.222,"15min":0.182},"max":{"1min":1.198,"5min":10.795999999999999,"15min":10.795999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.54800000000000004,"15min":0.64100000000000001},"min":{"1min":0.28100000000000003,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.79300000000000004,"5min":16.536999999999999,"15min":16.536999999999999},"last":0.45300000000000001}]},{"osd":1,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45900000000000002,"15min":0.54600000000000004},"min":{"1min":0.30199999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.86099999999999999,"5min":5.2160000000000002,"15min":6.1040000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.49099999999999999,"15min":0.439},"min":{"1min":0.27400000000000002,"5min":0.246,"15min":0.20100000000000001},"max":{"1min":1.2829999999999999,"5min":7.4880000000000004,"15min":7.4880000000000004},"last":0.504}]},{"osd":3,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.438,"15min":0.40699999999999997},"min":{"1min":0.28399999999999997,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63800000000000001,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":0.377},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52000000000000002,"15min":0.60399999999999998},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.27300000000000002},"max":{"1min":1.2569999999999999,"5min":5.4240000000000004,"15min":6.0620000000000003},"last":0.55600000000000005}]},{"osd":4,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.70099999999999996,"15min":0.64100000000000001},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":6.9989999999999997,"5min":6.9989999999999997,"15min":6.9989999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67800000000000005,"15min":0.65900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.353,"5min":6.3300000000000001,"15min":6.3300000000000001},"last":0.80400000000000005}]},{"osd":5,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68600000000000005,"15min":0.65900000000000003},"min":{"1min":0.377,"5min":0.37,"15min":0.37},"max":{"1min":1.3160000000000001,"5min":6.149,"15min":6.149},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.96199999999999997,"15min":0.92800000000000005},"min":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":7.327,"5min":28.702000000000002,"15min":28.702000000000002},"last":0.78800000000000003}]},{"osd":6,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65300000000000002,"15min":0.83599999999999997},"min":{"1min":0.39800000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.90300000000000002,"5min":4.5179999999999998,"15min":9.1199999999999992},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68500000000000005,"15min":0.66000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91800000000000004,"5min":5.2530000000000001,"15min":5.2530000000000001},"last":0.86299999999999999}]},{"osd":7,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70299999999999996,"15min":0.68799999999999994},"min":{"1min":0.438,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":1.419,"5min":6.2930000000000001,"15min":6.2930000000000001},"last":0.746},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68899999999999995,"15min":0.86699999999999999},"min":{"1min":0.42899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.4450000000000001,"5min":4.4809999999999999,"15min":9.1620000000000008},"last":0.84499999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574942,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":292752,"kb_used_data":203464,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94079088,"statfs":{"total":96636764160,"available":96336986112,"internally_reserved":0,"allocated":208347136,"data_stored":294471050,"data_compressed":26171949,"data_compressed_allocated":31100928,"data_compressed_original":117448704,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.44600000000000001,"15min":0.36799999999999999},"min":{"1min":0.25,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":7.1379999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.443,"15min":0.39300000000000002},"min":{"1min":0.29999999999999999,"5min":0.23200000000000001,"15min":0.22900000000000001},"max":{"1min":7.5380000000000003,"5min":7.5380000000000003,"15min":7.5380000000000003},"last":0.38500000000000001}]},{"osd":1,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.45100000000000001,"15min":0.38900000000000001},"min":{"1min":0.28000000000000003,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57899999999999996,"5min":9.7289999999999992,"15min":9.7289999999999992},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.55400000000000005,"15min":0.442},"min":{"1min":0.32800000000000001,"5min":0.253,"15min":0.21299999999999999},"max":{"1min":7.0540000000000003,"5min":7.4989999999999997,"15min":7.4989999999999997},"last":0.42399999999999999}]},{"osd":2,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":2.9060000000000001,"5min":0.90900000000000003,"15min":0.57299999999999995},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":49.343000000000004,"5min":49.343000000000004,"15min":49.343000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.53800000000000003,"15min":0.45600000000000002},"min":{"1min":0.40300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":7.1870000000000003,"5min":7.1870000000000003,"15min":7.1870000000000003},"last":0.48999999999999999}]},{"osd":4,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.68200000000000005,"15min":0.63800000000000001},"min":{"1min":0.42699999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":7.5999999999999996,"5min":7.5999999999999996,"15min":7.5999999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71599999999999997,"15min":0.65000000000000002},"min":{"1min":0.498,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.282,"5min":8.6869999999999994,"15min":8.6869999999999994},"last":0.72799999999999998}]},{"osd":5,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.61899999999999999,"15min":0.60199999999999998},"min":{"1min":0.438,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.70299999999999996,"15min":0.63200000000000001},"min":{"1min":0.49299999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":7.0060000000000002,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.59399999999999997}]},{"osd":6,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.74199999999999999,"15min":0.67100000000000004},"min":{"1min":0.443,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":7.1639999999999997,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.72299999999999998,"15min":0.67800000000000005},"min":{"1min":0.45200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":7.5730000000000004,"5min":7.5730000000000004,"15min":7.5730000000000004},"last":0.74199999999999999}]},{"osd":7,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":0.81899999999999995,"15min":0.68300000000000005},"min":{"1min":0.51200000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":10.901999999999999,"5min":10.901999999999999,"15min":10.901999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.1930000000000001,"5min":0.76000000000000001,"15min":0.68700000000000006},"min":{"1min":0.50700000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":10.943,"5min":10.943,"15min":10.943},"last":0.69599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574941,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356320,"kb_used_data":253080,"kb_used_omap":0,"kb_used_meta":103232,"kb_avail":94015520,"statfs":{"total":96636764160,"available":96271892480,"internally_reserved":0,"allocated":259153920,"data_stored":357883116,"data_compressed":30679187,"data_compressed_allocated":36306944,"data_compressed_original":135278592,"omap_allocated":0,"internal_metadata":105709568},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.60399999999999998,"15min":0.54100000000000004},"min":{"1min":0.28399999999999997,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.70099999999999996,"5min":4.4800000000000004,"15min":4.4800000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57299999999999995,"15min":0.81399999999999995},"min":{"1min":0.30099999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.67300000000000004,"5min":7.2679999999999998,"15min":12.231999999999999},"last":0.70399999999999996}]},{"osd":1,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55800000000000005,"15min":0.51700000000000002},"min":{"1min":0.315,"5min":0.255,"15min":0.255},"max":{"1min":0.70599999999999996,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.38,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.82699999999999996,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.67900000000000005}]},{"osd":2,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68300000000000005,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75,"5min":0.874,"15min":0.874},"last":0.59799999999999998}]},{"osd":3,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56599999999999995,"15min":0.54400000000000004},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66500000000000004,"5min":3.9969999999999999,"15min":3.9969999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.95799999999999996,"15min":0.69399999999999995},"min":{"1min":0.46999999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72599999999999998,"5min":28.837,"15min":28.837},"last":0.72299999999999998}]},{"osd":5,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48899999999999999,"15min":0.496},"min":{"1min":0.32900000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.86299999999999999,"5min":1.8,"15min":1.8},"last":0.438},{"interface":"front","average":{"1min":0.503,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.34499999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81599999999999995,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.47599999999999998}]},{"osd":6,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.76900000000000002,"5min":1.006,"15min":1.006},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.40000000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.018,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.49399999999999999}]},{"osd":7,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.34999999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.38100000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.91900000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.51700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574943,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313700,"kb_used_data":228508,"kb_used_omap":0,"kb_used_meta":85184,"kb_avail":94058140,"statfs":{"total":96636764160,"available":96315535360,"internally_reserved":0,"allocated":233992192,"data_stored":311454589,"data_compressed":24408749,"data_compressed_allocated":28868608,"data_compressed_original":106561536,"omap_allocated":0,"internal_metadata":87228416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:07:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.51700000000000002},"min":{"1min":0.29299999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.68899999999999995,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.63,"15min":0.54500000000000004},"min":{"1min":0.33500000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.70699999999999996,"5min":8.2590000000000003,"15min":8.2590000000000003},"last":0.58499999999999996}]},{"osd":1,"last update":"Sat Jul 29 02:07:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58999999999999997,"15min":0.51700000000000002},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71999999999999997,"5min":5.9119999999999999,"15min":5.9119999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.55100000000000005},"min":{"1min":0.36099999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.749,"5min":3.996,"15min":3.996},"last":0.56999999999999995}]},{"osd":2,"last update":"Sat Jul 29 02:07:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56399999999999995,"15min":0.52000000000000002},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68000000000000005,"5min":2.8929999999999998,"15min":2.8929999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.69899999999999995,"15min":0.59999999999999998},"min":{"1min":0.36199999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72799999999999998,"5min":9.8360000000000003,"15min":9.8360000000000003},"last":0.68400000000000005}]},{"osd":3,"last update":"Sat Jul 29 02:07:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57799999999999996,"15min":0.55800000000000005},"min":{"1min":0.375,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71799999999999997,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.70399999999999996,"15min":0.60599999999999998},"min":{"1min":0.39900000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.76500000000000001,"5min":8.1940000000000008,"15min":8.1940000000000008},"last":0.54100000000000004}]},{"osd":4,"last update":"Sat Jul 29 02:07:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.48199999999999998,"15min":0.50600000000000001},"min":{"1min":0.29899999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.60399999999999998,"5min":1.845,"15min":1.845},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.495,"15min":0.52800000000000002},"min":{"1min":0.314,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.65100000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.48499999999999999}]},{"osd":6,"last update":"Sat Jul 29 02:07:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.50600000000000001,"15min":0.53400000000000003},"min":{"1min":0.313,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66200000000000003,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.52600000000000002,"15min":0.55000000000000004},"min":{"1min":0.33900000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65300000000000002,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.40799999999999997}]},{"osd":7,"last update":"Sat Jul 29 02:07:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.55300000000000005,"15min":0.58199999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.67400000000000004,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.39500000000000002,"5min":0.36799999999999999,"15min":0.35999999999999999},"max":{"1min":0.67800000000000005,"5min":1.994,"15min":1.994},"last":0.50700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12668928,"data_stored":55102798,"data_compressed":7347975,"data_compressed_allocated":9121792,"data_compressed_original":51560448,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8052736,"data_stored":42276379,"data_compressed":5207195,"data_compressed_allocated":6623232,"data_compressed_original":40849408,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":20971520,"data_compressed":2599703,"data_compressed_allocated":3166208,"data_compressed_original":19935232,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20307968,"data_stored":88080474,"data_compressed":11613220,"data_compressed_allocated":14581760,"data_compressed_original":82358272,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18128896,"data_stored":93185019,"data_compressed":11582332,"data_compressed_allocated":14712832,"data_compressed_original":89788416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13971456,"data_stored":71303820,"data_compressed":9372464,"data_compressed_allocated":11796480,"data_compressed_original":69136384,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":33554432,"data_compressed":4791721,"data_compressed_allocated":5980160,"data_compressed_original":32194560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14548992,"data_stored":67109752,"data_compressed":8743474,"data_compressed_allocated":11177984,"data_compressed_original":63762432,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":232435712,"data_stored":253820928,"data_compressed":16092822,"data_compressed_allocated":18165760,"data_compressed_original":39550976,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":266227712,"data_stored":286793728,"data_compressed":17098430,"data_compressed_allocated":19324928,"data_compressed_original":39890944,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":201097216,"data_stored":214253568,"data_compressed":10507433,"data_compressed_allocated":11849728,"data_compressed_original":25006080,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":187604992,"data_stored":206176256,"data_compressed":14558729,"data_compressed_allocated":16519168,"data_compressed_original":35090432,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":240586752,"data_stored":264482816,"data_compressed":19096855,"data_compressed_allocated":21594112,"data_compressed_original":45490176,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":219582464,"data_stored":239935488,"data_compressed":15036285,"data_compressed_allocated":17072128,"data_compressed_original":37425152,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":239882240,"data_stored":254984192,"data_compressed":14096583,"data_compressed_allocated":15597568,"data_compressed_original":30699520,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":214171648,"data_stored":232394752,"data_compressed":16460575,"data_compressed_allocated":18358272,"data_compressed_original":36581376,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T02:07:27.459 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:27.459 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:27.460 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-07-29T01:59:57.519170+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=1, tm_min=59, tm_sec=57, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:27.460 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:27.461 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:27.461 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:27.462 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-07-29T02:00:00.960742+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=0, tm_sec=0, tm_wday=5, tm_yday=210, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=29, tm_hour=2, tm_min=6, tm_sec=20, tm_wday=5, tm_yday=210, tm_isdst=0) 2023-07-29T02:07:27.462 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-29T02:07:37.857 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:07:37.860 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:07:47.463 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-29T02:07:47.603 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.624+0000 7ff51d077700 1 Processor -- start 2023-07-29T02:07:47.604 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.624+0000 7ff51d077700 1 -- start start 2023-07-29T02:07:47.611 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.625+0000 7ff51d077700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7ff5181535c0 0x7ff5180c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:47.611 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.625+0000 7ff51d077700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff5180ca060 0x7ff5180cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:47.612 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.625+0000 7ff51d077700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5180cf6b0 0x7ff518159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:47.612 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.625+0000 7ff51d077700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff518153990 con 0x7ff5180ca060 2023-07-29T02:07:47.613 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.625+0000 7ff51d077700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5180c5a10 con 0x7ff5181535c0 2023-07-29T02:07:47.613 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.625+0000 7ff51d077700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51815c760 con 0x7ff5180cf6b0 2023-07-29T02:07:47.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.625+0000 7ff51659c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff5180ca060 0x7ff5180cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:47.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.625+0000 7ff51659c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7ff5180ca060 0x7ff5180cf170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58616/0 (socket says 172.21.15.42:58616) 2023-07-29T02:07:47.614 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.625+0000 7ff51659c700 1 -- 172.21.15.42:0/669102410 learned_addr learned my addr 172.21.15.42:0/669102410 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:07:47.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.625+0000 7ff51759e700 1 --2- 172.21.15.42:0/669102410 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5180cf6b0 0x7ff518159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:47.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.625+0000 7ff516d9d700 1 --2- 172.21.15.42:0/669102410 >> v2:172.21.15.144:3300/0 conn(0x7ff5181535c0 0x7ff5180c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:47.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.625+0000 7ff51659c700 1 -- 172.21.15.42:0/669102410 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5180cf6b0 msgr2=0x7ff518159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:07:47.615 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.625+0000 7ff51659c700 1 --2- 172.21.15.42:0/669102410 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5180cf6b0 0x7ff518159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:47.616 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.625+0000 7ff51659c700 1 -- 172.21.15.42:0/669102410 >> v2:172.21.15.144:3300/0 conn(0x7ff5181535c0 msgr2=0x7ff5180c54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:07:47.616 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.625+0000 7ff51659c700 1 --2- 172.21.15.42:0/669102410 >> v2:172.21.15.144:3300/0 conn(0x7ff5181535c0 0x7ff5180c54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:47.616 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.625+0000 7ff51659c700 1 -- 172.21.15.42:0/669102410 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51815ca00 con 0x7ff5180ca060 2023-07-29T02:07:47.616 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.625+0000 7ff516d9d700 1 --2- 172.21.15.42:0/669102410 >> v2:172.21.15.144:3300/0 conn(0x7ff5181535c0 0x7ff5180c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:07:47.617 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.625+0000 7ff51759e700 1 --2- 172.21.15.42:0/669102410 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5180cf6b0 0x7ff518159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:07:47.617 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.625+0000 7ff51659c700 1 --2- 172.21.15.42:0/669102410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5180ca060 0x7ff5180cf170 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff518067f70 tx=0x7ff50c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb424ef98f974de4 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:47.617 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.626+0000 7ff515d9b700 1 -- 172.21.15.42:0/669102410 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c005e30 con 0x7ff5180ca060 2023-07-29T02:07:47.617 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.626+0000 7ff515d9b700 1 -- 172.21.15.42:0/669102410 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c004030 con 0x7ff5180ca060 2023-07-29T02:07:47.618 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.626+0000 7ff515d9b700 1 -- 172.21.15.42:0/669102410 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c0043e0 con 0x7ff5180ca060 2023-07-29T02:07:47.618 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.626+0000 7ff51d077700 1 -- 172.21.15.42:0/669102410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5180ca060 msgr2=0x7ff5180cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:47.618 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.626+0000 7ff51d077700 1 --2- 172.21.15.42:0/669102410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5180ca060 0x7ff5180cf170 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff518067f70 tx=0x7ff50c009bd0 comp rx=0 tx=0).stop 2023-07-29T02:07:47.618 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.626+0000 7ff51d077700 1 -- 172.21.15.42:0/669102410 shutdown_connections 2023-07-29T02:07:47.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.626+0000 7ff51d077700 1 --2- 172.21.15.42:0/669102410 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5180cf6b0 0x7ff518159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:47.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.626+0000 7ff51d077700 1 --2- 172.21.15.42:0/669102410 >> v2:172.21.15.144:3300/0 conn(0x7ff5181535c0 0x7ff5180c54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:47.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.626+0000 7ff51d077700 1 --2- 172.21.15.42:0/669102410 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5180ca060 0x7ff5180cf170 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:47.619 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.626+0000 7ff51d077700 1 -- 172.21.15.42:0/669102410 >> 172.21.15.42:0/669102410 conn(0x7ff51806cac0 msgr2=0x7ff51806cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:47.620 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.626+0000 7ff51d077700 1 -- 172.21.15.42:0/669102410 shutdown_connections 2023-07-29T02:07:47.620 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.626+0000 7ff51d077700 1 -- 172.21.15.42:0/669102410 wait complete. 2023-07-29T02:07:47.620 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.628+0000 7ff51d077700 1 Processor -- start 2023-07-29T02:07:47.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.628+0000 7ff51d077700 1 -- start start 2023-07-29T02:07:47.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.628+0000 7ff51d077700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5180ca060 0x7ff51814f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:47.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.628+0000 7ff51d077700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5180cf6b0 0x7ff518152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:47.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.628+0000 7ff51d077700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5181535c0 0x7ff5181f2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:47.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.629+0000 7ff51d077700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5181e4d00 con 0x7ff5180cf6b0 2023-07-29T02:07:47.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.629+0000 7ff51d077700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5181e4410 con 0x7ff5181535c0 2023-07-29T02:07:47.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.629+0000 7ff51d077700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51814fd90 con 0x7ff5180ca060 2023-07-29T02:07:47.622 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.629+0000 7ff51659c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5180cf6b0 0x7ff518152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:47.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.629+0000 7ff51659c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5180cf6b0 0x7ff518152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58622/0 (socket says 172.21.15.42:58622) 2023-07-29T02:07:47.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.629+0000 7ff51659c700 1 -- 172.21.15.42:0/979231326 learned_addr learned my addr 172.21.15.42:0/979231326 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:07:47.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.629+0000 7ff51759e700 1 --2- 172.21.15.42:0/979231326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5181535c0 0x7ff5181f2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:47.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.629+0000 7ff516d9d700 1 --2- 172.21.15.42:0/979231326 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5180ca060 0x7ff51814f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:47.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.629+0000 7ff51659c700 1 -- 172.21.15.42:0/979231326 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5180ca060 msgr2=0x7ff51814f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:47.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.629+0000 7ff51659c700 1 --2- 172.21.15.42:0/979231326 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5180ca060 0x7ff51814f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:47.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.629+0000 7ff51659c700 1 -- 172.21.15.42:0/979231326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5181535c0 msgr2=0x7ff5181f2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:47.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.629+0000 7ff51659c700 1 --2- 172.21.15.42:0/979231326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5181535c0 0x7ff5181f2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:47.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.629+0000 7ff51659c700 1 -- 172.21.15.42:0/979231326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c009500 con 0x7ff5180cf6b0 2023-07-29T02:07:47.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.629+0000 7ff51759e700 1 --2- 172.21.15.42:0/979231326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5181535c0 0x7ff5181f2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:07:47.626 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.629+0000 7ff51659c700 1 --2- 172.21.15.42:0/979231326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5180cf6b0 0x7ff518152440 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff50c009c10 tx=0x7ff50c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:47.626 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.629+0000 7ff4ff7fe700 1 -- 172.21.15.42:0/979231326 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c004580 con 0x7ff5180cf6b0 2023-07-29T02:07:47.626 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.629+0000 7ff4ff7fe700 1 -- 172.21.15.42:0/979231326 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c011420 con 0x7ff5180cf6b0 2023-07-29T02:07:47.626 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.629+0000 7ff51d077700 1 -- 172.21.15.42:0/979231326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff518150040 con 0x7ff5180cf6b0 2023-07-29T02:07:47.627 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.629+0000 7ff4ff7fe700 1 -- 172.21.15.42:0/979231326 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c0117d0 con 0x7ff5180cf6b0 2023-07-29T02:07:47.627 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.629+0000 7ff51d077700 1 -- 172.21.15.42:0/979231326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5181e46b0 con 0x7ff5180cf6b0 2023-07-29T02:07:47.627 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.630+0000 7ff51d077700 1 -- 172.21.15.42:0/979231326 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5180d0040 con 0x7ff5180cf6b0 2023-07-29T02:07:47.627 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.631+0000 7ff4ff7fe700 1 -- 172.21.15.42:0/979231326 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7ff50c011930 con 0x7ff5180cf6b0 2023-07-29T02:07:47.628 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.631+0000 7ff4ff7fe700 1 --2- 172.21.15.42:0/979231326 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff50406a690 0x7ff50406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:47.628 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.631+0000 7ff4ff7fe700 1 -- 172.21.15.42:0/979231326 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7ff50c08a5c0 con 0x7ff5180cf6b0 2023-07-29T02:07:47.628 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.632+0000 7ff516d9d700 1 --2- 172.21.15.42:0/979231326 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff50406a690 0x7ff50406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:47.629 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.632+0000 7ff516d9d700 1 --2- 172.21.15.42:0/979231326 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff50406a690 0x7ff50406cb40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff508006fd0 tx=0x7ff508008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:47.629 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.636+0000 7ff4ff7fe700 1 -- 172.21.15.42:0/979231326 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7ff50c055470 con 0x7ff5180cf6b0 2023-07-29T02:07:47.812 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.833+0000 7ff51d077700 1 -- 172.21.15.42:0/979231326 --> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff51815cfc0 con 0x7ff50406a690 2023-07-29T02:07:47.823 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.844+0000 7ff4ff7fe700 1 -- 172.21.15.42:0/979231326 <== mgr.4100 v2:172.21.15.144:6832/130830 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+399494 (secure 0 0 0) 0x7ff50800c040 con 0x7ff50406a690 2023-07-29T02:07:47.828 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:07:47.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.848+0000 7ff51d077700 1 -- 172.21.15.42:0/979231326 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff50406a690 msgr2=0x7ff50406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:47.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.848+0000 7ff51d077700 1 --2- 172.21.15.42:0/979231326 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff50406a690 0x7ff50406cb40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff508006fd0 tx=0x7ff508008040 comp rx=0 tx=0).stop 2023-07-29T02:07:47.830 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.848+0000 7ff51d077700 1 -- 172.21.15.42:0/979231326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5180cf6b0 msgr2=0x7ff518152440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:47.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.848+0000 7ff51d077700 1 --2- 172.21.15.42:0/979231326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5180cf6b0 0x7ff518152440 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff50c009c10 tx=0x7ff50c004750 comp rx=0 tx=0).stop 2023-07-29T02:07:47.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.848+0000 7ff51d077700 1 -- 172.21.15.42:0/979231326 shutdown_connections 2023-07-29T02:07:47.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.848+0000 7ff51d077700 1 --2- 172.21.15.42:0/979231326 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7ff50406a690 0x7ff50406cb40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:47.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.848+0000 7ff51d077700 1 --2- 172.21.15.42:0/979231326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5181535c0 0x7ff5181f2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:47.831 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.848+0000 7ff51d077700 1 --2- 172.21.15.42:0/979231326 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7ff5180ca060 0x7ff51814f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:47.832 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.848+0000 7ff51d077700 1 --2- 172.21.15.42:0/979231326 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7ff5180cf6b0 0x7ff518152440 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:47.832 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.848+0000 7ff51d077700 1 -- 172.21.15.42:0/979231326 >> 172.21.15.42:0/979231326 conn(0x7ff51806cac0 msgr2=0x7ff518150de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:47.832 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.848+0000 7ff51d077700 1 -- 172.21.15.42:0/979231326 shutdown_connections 2023-07-29T02:07:47.832 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:47.848+0000 7ff51d077700 1 -- 172.21.15.42:0/979231326 wait complete. 2023-07-29T02:07:47.832 INFO:teuthology.orchestra.run.smithi042.stderr:dumped all 2023-07-29T02:07:47.839 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":271,"stamp":"2023-07-29T02:07:47.365219+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1154491876,"num_objects":10301,"num_object_clones":0,"num_object_copies":40914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10301,"num_whiteouts":0,"num_read":1676,"num_read_kb":517458,"num_write":24882,"num_write_kb":1277942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":586841,"num_omap_keys":984,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30741,"ondisk_log_size":30741,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2549536,"kb_used_data":1859808,"kb_used_omap":0,"kb_used_meta":689664,"kb_avail":752425184,"statfs":{"total":773094113280,"available":770483388416,"internally_reserved":0,"allocated":1904443392,"data_stored":2427327945,"data_compressed":184270656,"data_compressed_allocated":215732224,"data_compressed_original":740466688,"omap_allocated":0,"internal_metadata":706215936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003355"},"pg_stats":[{"pgid":"4.3f","version":"39'86","reported_seq":2149,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:36.889969+0000","last_change":"2023-07-29T02:06:36.890083+0000","last_active":"2023-07-29T02:06:36.889969+0000","last_peered":"2023-07-29T02:06:36.889969+0000","last_clean":"2023-07-29T02:06:36.889969+0000","last_became_active":"2023-07-29T01:59:57.957742+0000","last_became_peered":"2023-07-29T01:59:57.957742+0000","last_unstale":"2023-07-29T02:06:36.889969+0000","last_undegraded":"2023-07-29T02:06:36.889969+0000","last_fullsized":"2023-07-29T02:06:36.889969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'86","last_scrub_stamp":"2023-07-29T02:06:36.889932+0000","last_deep_scrub":"39'86","last_deep_scrub_stamp":"2023-07-29T02:06:36.889932+0000","last_clean_scrub_stamp":"2023-07-29T02:06:36.889932+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:56.860301+0000","scrub_duration":0.0015445599999999999,"objects_trimmed":0,"snaptrim_duration":0.46739399700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"39'75","reported_seq":2138,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:47.633090+0000","last_change":"2023-07-29T02:06:47.633222+0000","last_active":"2023-07-29T02:06:47.633090+0000","last_peered":"2023-07-29T02:06:47.633090+0000","last_clean":"2023-07-29T02:06:47.633090+0000","last_became_active":"2023-07-29T01:59:57.974338+0000","last_became_peered":"2023-07-29T01:59:57.974338+0000","last_unstale":"2023-07-29T02:06:47.633090+0000","last_undegraded":"2023-07-29T02:06:47.633090+0000","last_fullsized":"2023-07-29T02:06:47.633090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'75","last_scrub_stamp":"2023-07-29T02:06:47.633064+0000","last_deep_scrub":"39'75","last_deep_scrub_stamp":"2023-07-29T02:06:47.633064+0000","last_clean_scrub_stamp":"2023-07-29T02:06:47.633064+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:33:21.494075+0000","scrub_duration":0.001874503,"objects_trimmed":0,"snaptrim_duration":0.30630966300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"39'90","reported_seq":2153,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:24.508906+0000","last_change":"2023-07-29T02:07:24.509027+0000","last_active":"2023-07-29T02:07:24.508906+0000","last_peered":"2023-07-29T02:07:24.508906+0000","last_clean":"2023-07-29T02:07:24.508906+0000","last_became_active":"2023-07-29T01:59:57.973406+0000","last_became_peered":"2023-07-29T01:59:57.973406+0000","last_unstale":"2023-07-29T02:07:24.508906+0000","last_undegraded":"2023-07-29T02:07:24.508906+0000","last_fullsized":"2023-07-29T02:07:24.508906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'90","last_scrub_stamp":"2023-07-29T02:07:24.508878+0000","last_deep_scrub":"39'90","last_deep_scrub_stamp":"2023-07-29T02:07:24.508878+0000","last_clean_scrub_stamp":"2023-07-29T02:07:24.508878+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:13:09.590241+0000","scrub_duration":0.001710313,"objects_trimmed":0,"snaptrim_duration":0.37359432399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"39'75","reported_seq":2138,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:43.061322+0000","last_change":"2023-07-29T02:06:43.061439+0000","last_active":"2023-07-29T02:06:43.061322+0000","last_peered":"2023-07-29T02:06:43.061322+0000","last_clean":"2023-07-29T02:06:43.061322+0000","last_became_active":"2023-07-29T01:59:57.964865+0000","last_became_peered":"2023-07-29T01:59:57.964865+0000","last_unstale":"2023-07-29T02:06:43.061322+0000","last_undegraded":"2023-07-29T02:06:43.061322+0000","last_fullsized":"2023-07-29T02:06:43.061322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'75","last_scrub_stamp":"2023-07-29T02:06:43.061294+0000","last_deep_scrub":"39'75","last_deep_scrub_stamp":"2023-07-29T02:06:43.061294+0000","last_clean_scrub_stamp":"2023-07-29T02:06:43.061294+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:05:34.515449+0000","scrub_duration":0.0020787169999999999,"objects_trimmed":0,"snaptrim_duration":0.22913951599999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"39'102","reported_seq":2165,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:06.211504+0000","last_change":"2023-07-29T02:07:06.211504+0000","last_active":"2023-07-29T02:07:06.211504+0000","last_peered":"2023-07-29T02:07:06.211504+0000","last_clean":"2023-07-29T02:07:06.211504+0000","last_became_active":"2023-07-29T01:59:57.970733+0000","last_became_peered":"2023-07-29T01:59:57.970733+0000","last_unstale":"2023-07-29T02:07:06.211504+0000","last_undegraded":"2023-07-29T02:07:06.211504+0000","last_fullsized":"2023-07-29T02:07:06.211504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'102","last_scrub_stamp":"2023-07-29T02:07:06.211381+0000","last_deep_scrub":"39'102","last_deep_scrub_stamp":"2023-07-29T02:07:06.211381+0000","last_clean_scrub_stamp":"2023-07-29T02:07:06.211381+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:42:19.087843+0000","scrub_duration":0.001265473,"objects_trimmed":0,"snaptrim_duration":0.55358088100000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"39'92","reported_seq":2155,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:25.460785+0000","last_change":"2023-07-29T02:07:25.460785+0000","last_active":"2023-07-29T02:07:25.460785+0000","last_peered":"2023-07-29T02:07:25.460785+0000","last_clean":"2023-07-29T02:07:25.460785+0000","last_became_active":"2023-07-29T01:59:57.964993+0000","last_became_peered":"2023-07-29T01:59:57.964993+0000","last_unstale":"2023-07-29T02:07:25.460785+0000","last_undegraded":"2023-07-29T02:07:25.460785+0000","last_fullsized":"2023-07-29T02:07:25.460785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'92","last_scrub_stamp":"2023-07-29T02:07:25.460650+0000","last_deep_scrub":"39'92","last_deep_scrub_stamp":"2023-07-29T02:07:25.460650+0000","last_clean_scrub_stamp":"2023-07-29T02:07:25.460650+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:59:04.996610+0000","scrub_duration":0.001897068,"objects_trimmed":0,"snaptrim_duration":0.35033357399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"39'105","reported_seq":2168,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:51.524562+0000","last_change":"2023-07-29T02:06:51.524562+0000","last_active":"2023-07-29T02:06:51.524562+0000","last_peered":"2023-07-29T02:06:51.524562+0000","last_clean":"2023-07-29T02:06:51.524562+0000","last_became_active":"2023-07-29T01:59:57.970232+0000","last_became_peered":"2023-07-29T01:59:57.970232+0000","last_unstale":"2023-07-29T02:06:51.524562+0000","last_undegraded":"2023-07-29T02:06:51.524562+0000","last_fullsized":"2023-07-29T02:06:51.524562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'105","last_scrub_stamp":"2023-07-29T02:06:51.524349+0000","last_deep_scrub":"39'105","last_deep_scrub_stamp":"2023-07-29T02:06:51.524349+0000","last_clean_scrub_stamp":"2023-07-29T02:06:51.524349+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:11:34.256705+0000","scrub_duration":0.001901168,"objects_trimmed":0,"snaptrim_duration":0.18952802499999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"39'74","reported_seq":2137,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:49.596442+0000","last_change":"2023-07-29T02:06:49.596442+0000","last_active":"2023-07-29T02:06:49.596442+0000","last_peered":"2023-07-29T02:06:49.596442+0000","last_clean":"2023-07-29T02:06:49.596442+0000","last_became_active":"2023-07-29T01:59:57.962884+0000","last_became_peered":"2023-07-29T01:59:57.962884+0000","last_unstale":"2023-07-29T02:06:49.596442+0000","last_undegraded":"2023-07-29T02:06:49.596442+0000","last_fullsized":"2023-07-29T02:06:49.596442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'74","last_scrub_stamp":"2023-07-29T02:06:49.596297+0000","last_deep_scrub":"39'74","last_deep_scrub_stamp":"2023-07-29T02:06:49.596297+0000","last_clean_scrub_stamp":"2023-07-29T02:06:49.596297+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:53:32.226555+0000","scrub_duration":0.0014879120000000001,"objects_trimmed":0,"snaptrim_duration":0.30152641200000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"39'84","reported_seq":2147,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:47.265092+0000","last_change":"2023-07-29T02:06:47.265092+0000","last_active":"2023-07-29T02:06:47.265092+0000","last_peered":"2023-07-29T02:06:47.265092+0000","last_clean":"2023-07-29T02:06:47.265092+0000","last_became_active":"2023-07-29T01:59:57.971640+0000","last_became_peered":"2023-07-29T01:59:57.971640+0000","last_unstale":"2023-07-29T02:06:47.265092+0000","last_undegraded":"2023-07-29T02:06:47.265092+0000","last_fullsized":"2023-07-29T02:06:47.265092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'84","last_scrub_stamp":"2023-07-29T02:06:47.264932+0000","last_deep_scrub":"39'84","last_deep_scrub_stamp":"2023-07-29T02:06:47.264932+0000","last_clean_scrub_stamp":"2023-07-29T02:06:47.264932+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:53:29.895190+0000","scrub_duration":0.001323896,"objects_trimmed":0,"snaptrim_duration":0.54966345000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"39'98","reported_seq":2161,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:46.628373+0000","last_change":"2023-07-29T02:06:46.628373+0000","last_active":"2023-07-29T02:06:46.628373+0000","last_peered":"2023-07-29T02:06:46.628373+0000","last_clean":"2023-07-29T02:06:46.628373+0000","last_became_active":"2023-07-29T01:59:57.962799+0000","last_became_peered":"2023-07-29T01:59:57.962799+0000","last_unstale":"2023-07-29T02:06:46.628373+0000","last_undegraded":"2023-07-29T02:06:46.628373+0000","last_fullsized":"2023-07-29T02:06:46.628373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'98","last_scrub_stamp":"2023-07-29T02:06:46.628226+0000","last_deep_scrub":"39'98","last_deep_scrub_stamp":"2023-07-29T02:06:46.628226+0000","last_clean_scrub_stamp":"2023-07-29T02:06:46.628226+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:16:25.595487+0000","scrub_duration":0.001832855,"objects_trimmed":0,"snaptrim_duration":0.30635943199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"39'90","reported_seq":2153,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:37.449786+0000","last_change":"2023-07-29T02:06:37.449786+0000","last_active":"2023-07-29T02:06:37.449786+0000","last_peered":"2023-07-29T02:06:37.449786+0000","last_clean":"2023-07-29T02:06:37.449786+0000","last_became_active":"2023-07-29T01:59:57.969868+0000","last_became_peered":"2023-07-29T01:59:57.969868+0000","last_unstale":"2023-07-29T02:06:37.449786+0000","last_undegraded":"2023-07-29T02:06:37.449786+0000","last_fullsized":"2023-07-29T02:06:37.449786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'90","last_scrub_stamp":"2023-07-29T02:06:37.449587+0000","last_deep_scrub":"39'90","last_deep_scrub_stamp":"2023-07-29T02:06:37.449587+0000","last_clean_scrub_stamp":"2023-07-29T02:06:37.449587+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:11:20.181943+0000","scrub_duration":0.0020192080000000002,"objects_trimmed":0,"snaptrim_duration":0.37294171199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"39'76","reported_seq":2139,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.908940+0000","last_change":"2023-07-29T02:06:39.908940+0000","last_active":"2023-07-29T02:06:39.908940+0000","last_peered":"2023-07-29T02:06:39.908940+0000","last_clean":"2023-07-29T02:06:39.908940+0000","last_became_active":"2023-07-29T01:59:57.963902+0000","last_became_peered":"2023-07-29T01:59:57.963902+0000","last_unstale":"2023-07-29T02:06:39.908940+0000","last_undegraded":"2023-07-29T02:06:39.908940+0000","last_fullsized":"2023-07-29T02:06:39.908940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'76","last_scrub_stamp":"2023-07-29T02:06:39.908800+0000","last_deep_scrub":"39'76","last_deep_scrub_stamp":"2023-07-29T02:06:39.908800+0000","last_clean_scrub_stamp":"2023-07-29T02:06:39.908800+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:43.162709+0000","scrub_duration":0.0020822839999999998,"objects_trimmed":0,"snaptrim_duration":0.46909700500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"39'81","reported_seq":2144,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:25.869573+0000","last_change":"2023-07-29T02:06:25.869573+0000","last_active":"2023-07-29T02:06:25.869573+0000","last_peered":"2023-07-29T02:06:25.869573+0000","last_clean":"2023-07-29T02:06:25.869573+0000","last_became_active":"2023-07-29T01:59:57.963239+0000","last_became_peered":"2023-07-29T01:59:57.963239+0000","last_unstale":"2023-07-29T02:06:25.869573+0000","last_undegraded":"2023-07-29T02:06:25.869573+0000","last_fullsized":"2023-07-29T02:06:25.869573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'81","last_scrub_stamp":"2023-07-29T02:06:25.869472+0000","last_deep_scrub":"39'81","last_deep_scrub_stamp":"2023-07-29T02:06:25.869472+0000","last_clean_scrub_stamp":"2023-07-29T02:06:25.869472+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:01:16.574167+0000","scrub_duration":0.0015035739999999999,"objects_trimmed":0,"snaptrim_duration":0.46603159700000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"39'92","reported_seq":2155,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:51.568747+0000","last_change":"2023-07-29T02:06:51.568747+0000","last_active":"2023-07-29T02:06:51.568747+0000","last_peered":"2023-07-29T02:06:51.568747+0000","last_clean":"2023-07-29T02:06:51.568747+0000","last_became_active":"2023-07-29T01:59:57.960709+0000","last_became_peered":"2023-07-29T01:59:57.960709+0000","last_unstale":"2023-07-29T02:06:51.568747+0000","last_undegraded":"2023-07-29T02:06:51.568747+0000","last_fullsized":"2023-07-29T02:06:51.568747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'92","last_scrub_stamp":"2023-07-29T02:06:51.568595+0000","last_deep_scrub":"39'92","last_deep_scrub_stamp":"2023-07-29T02:06:51.568595+0000","last_clean_scrub_stamp":"2023-07-29T02:06:51.568595+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:29:56.648023+0000","scrub_duration":0.0019764689999999998,"objects_trimmed":0,"snaptrim_duration":0.30181124199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"39'85","reported_seq":2148,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:45.538248+0000","last_change":"2023-07-29T02:06:45.538248+0000","last_active":"2023-07-29T02:06:45.538248+0000","last_peered":"2023-07-29T02:06:45.538248+0000","last_clean":"2023-07-29T02:06:45.538248+0000","last_became_active":"2023-07-29T01:59:57.970263+0000","last_became_peered":"2023-07-29T01:59:57.970263+0000","last_unstale":"2023-07-29T02:06:45.538248+0000","last_undegraded":"2023-07-29T02:06:45.538248+0000","last_fullsized":"2023-07-29T02:06:45.538248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'85","last_scrub_stamp":"2023-07-29T02:06:45.538096+0000","last_deep_scrub":"39'85","last_deep_scrub_stamp":"2023-07-29T02:06:45.538096+0000","last_clean_scrub_stamp":"2023-07-29T02:06:45.538096+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:13:08.131105+0000","scrub_duration":0.0019771799999999998,"objects_trimmed":0,"snaptrim_duration":0.18892089500000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"39'97","reported_seq":2160,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:25.491331+0000","last_change":"2023-07-29T02:06:25.491331+0000","last_active":"2023-07-29T02:06:25.491331+0000","last_peered":"2023-07-29T02:06:25.491331+0000","last_clean":"2023-07-29T02:06:25.491331+0000","last_became_active":"2023-07-29T01:59:57.964696+0000","last_became_peered":"2023-07-29T01:59:57.964696+0000","last_unstale":"2023-07-29T02:06:25.491331+0000","last_undegraded":"2023-07-29T02:06:25.491331+0000","last_fullsized":"2023-07-29T02:06:25.491331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'97","last_scrub_stamp":"2023-07-29T02:06:25.491173+0000","last_deep_scrub":"39'97","last_deep_scrub_stamp":"2023-07-29T02:06:25.491173+0000","last_clean_scrub_stamp":"2023-07-29T02:06:25.491173+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:48:25.389074+0000","scrub_duration":0.001642227,"objects_trimmed":0,"snaptrim_duration":0.32990576199999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"39'94","reported_seq":2157,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:46.252234+0000","last_change":"2023-07-29T02:06:46.252234+0000","last_active":"2023-07-29T02:06:46.252234+0000","last_peered":"2023-07-29T02:06:46.252234+0000","last_clean":"2023-07-29T02:06:46.252234+0000","last_became_active":"2023-07-29T01:59:57.968885+0000","last_became_peered":"2023-07-29T01:59:57.968885+0000","last_unstale":"2023-07-29T02:06:46.252234+0000","last_undegraded":"2023-07-29T02:06:46.252234+0000","last_fullsized":"2023-07-29T02:06:46.252234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'94","last_scrub_stamp":"2023-07-29T02:06:46.252116+0000","last_deep_scrub":"39'94","last_deep_scrub_stamp":"2023-07-29T02:06:46.252116+0000","last_clean_scrub_stamp":"2023-07-29T02:06:46.252116+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:11:28.984472+0000","scrub_duration":0.0014621020000000001,"objects_trimmed":0,"snaptrim_duration":0.54488360899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"39'88","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:27.507720+0000","last_change":"2023-07-29T02:07:27.507847+0000","last_active":"2023-07-29T02:07:27.507720+0000","last_peered":"2023-07-29T02:07:27.507720+0000","last_clean":"2023-07-29T02:07:27.507720+0000","last_became_active":"2023-07-29T01:59:57.962919+0000","last_became_peered":"2023-07-29T01:59:57.962919+0000","last_unstale":"2023-07-29T02:07:27.507720+0000","last_undegraded":"2023-07-29T02:07:27.507720+0000","last_fullsized":"2023-07-29T02:07:27.507720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'88","last_scrub_stamp":"2023-07-29T02:07:27.507696+0000","last_deep_scrub":"39'88","last_deep_scrub_stamp":"2023-07-29T02:07:27.507696+0000","last_clean_scrub_stamp":"2023-07-29T02:07:27.507696+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:50:41.095666+0000","scrub_duration":0.0018879050000000001,"objects_trimmed":0,"snaptrim_duration":0.36591080100000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"39'85","reported_seq":2148,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:35.858539+0000","last_change":"2023-07-29T02:06:35.858539+0000","last_active":"2023-07-29T02:06:35.858539+0000","last_peered":"2023-07-29T02:06:35.858539+0000","last_clean":"2023-07-29T02:06:35.858539+0000","last_became_active":"2023-07-29T01:59:57.960111+0000","last_became_peered":"2023-07-29T01:59:57.960111+0000","last_unstale":"2023-07-29T02:06:35.858539+0000","last_undegraded":"2023-07-29T02:06:35.858539+0000","last_fullsized":"2023-07-29T02:06:35.858539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'85","last_scrub_stamp":"2023-07-29T02:06:35.858385+0000","last_deep_scrub":"39'85","last_deep_scrub_stamp":"2023-07-29T02:06:35.858385+0000","last_clean_scrub_stamp":"2023-07-29T02:06:35.858385+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:30.976536+0000","scrub_duration":0.0025554530000000001,"objects_trimmed":0,"snaptrim_duration":0.47199195399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"39'98","reported_seq":2161,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:27.503464+0000","last_change":"2023-07-29T02:06:27.503464+0000","last_active":"2023-07-29T02:06:27.503464+0000","last_peered":"2023-07-29T02:06:27.503464+0000","last_clean":"2023-07-29T02:06:27.503464+0000","last_became_active":"2023-07-29T01:59:57.961655+0000","last_became_peered":"2023-07-29T01:59:57.961655+0000","last_unstale":"2023-07-29T02:06:27.503464+0000","last_undegraded":"2023-07-29T02:06:27.503464+0000","last_fullsized":"2023-07-29T02:06:27.503464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'98","last_scrub_stamp":"2023-07-29T02:06:27.503321+0000","last_deep_scrub":"39'98","last_deep_scrub_stamp":"2023-07-29T02:06:27.503321+0000","last_clean_scrub_stamp":"2023-07-29T02:06:27.503321+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:20.644410+0000","scrub_duration":0.001657045,"objects_trimmed":0,"snaptrim_duration":0.36267924800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"39'89","reported_seq":2152,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:48.581789+0000","last_change":"2023-07-29T02:06:48.581910+0000","last_active":"2023-07-29T02:06:48.581789+0000","last_peered":"2023-07-29T02:06:48.581789+0000","last_clean":"2023-07-29T02:06:48.581789+0000","last_became_active":"2023-07-29T01:59:57.970757+0000","last_became_peered":"2023-07-29T01:59:57.970757+0000","last_unstale":"2023-07-29T02:06:48.581789+0000","last_undegraded":"2023-07-29T02:06:48.581789+0000","last_fullsized":"2023-07-29T02:06:48.581789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'89","last_scrub_stamp":"2023-07-29T02:06:48.581763+0000","last_deep_scrub":"39'89","last_deep_scrub_stamp":"2023-07-29T02:06:48.581763+0000","last_clean_scrub_stamp":"2023-07-29T02:06:48.581763+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:38.614685+0000","scrub_duration":0.0022151100000000002,"objects_trimmed":0,"snaptrim_duration":0.18738185399999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"39'95","reported_seq":2158,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.272264+0000","last_change":"2023-07-29T02:06:41.272264+0000","last_active":"2023-07-29T02:06:41.272264+0000","last_peered":"2023-07-29T02:06:41.272264+0000","last_clean":"2023-07-29T02:06:41.272264+0000","last_became_active":"2023-07-29T01:59:57.974436+0000","last_became_peered":"2023-07-29T01:59:57.974436+0000","last_unstale":"2023-07-29T02:06:41.272264+0000","last_undegraded":"2023-07-29T02:06:41.272264+0000","last_fullsized":"2023-07-29T02:06:41.272264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'95","last_scrub_stamp":"2023-07-29T02:06:41.272136+0000","last_deep_scrub":"39'95","last_deep_scrub_stamp":"2023-07-29T02:06:41.272136+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.272136+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:31.305058+0000","scrub_duration":0.00149913,"objects_trimmed":0,"snaptrim_duration":0.54184882499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"39'92","reported_seq":2155,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:02.090750+0000","last_change":"2023-07-29T02:07:02.090865+0000","last_active":"2023-07-29T02:07:02.090750+0000","last_peered":"2023-07-29T02:07:02.090750+0000","last_clean":"2023-07-29T02:07:02.090750+0000","last_became_active":"2023-07-29T01:59:57.966987+0000","last_became_peered":"2023-07-29T01:59:57.966987+0000","last_unstale":"2023-07-29T02:07:02.090750+0000","last_undegraded":"2023-07-29T02:07:02.090750+0000","last_fullsized":"2023-07-29T02:07:02.090750+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'92","last_scrub_stamp":"2023-07-29T02:07:02.090716+0000","last_deep_scrub":"39'92","last_deep_scrub_stamp":"2023-07-29T02:07:02.090716+0000","last_clean_scrub_stamp":"2023-07-29T02:07:02.090716+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:42:14.967178+0000","scrub_duration":0.001745199,"objects_trimmed":0,"snaptrim_duration":0.38162062000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"39'92","reported_seq":2155,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:49.594095+0000","last_change":"2023-07-29T02:06:49.594218+0000","last_active":"2023-07-29T02:06:49.594095+0000","last_peered":"2023-07-29T02:06:49.594095+0000","last_clean":"2023-07-29T02:06:49.594095+0000","last_became_active":"2023-07-29T01:59:57.971733+0000","last_became_peered":"2023-07-29T01:59:57.971733+0000","last_unstale":"2023-07-29T02:06:49.594095+0000","last_undegraded":"2023-07-29T02:06:49.594095+0000","last_fullsized":"2023-07-29T02:06:49.594095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'92","last_scrub_stamp":"2023-07-29T02:06:49.594065+0000","last_deep_scrub":"39'92","last_deep_scrub_stamp":"2023-07-29T02:06:49.594065+0000","last_clean_scrub_stamp":"2023-07-29T02:06:49.594065+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:16:28.561327+0000","scrub_duration":0.0021722790000000001,"objects_trimmed":0,"snaptrim_duration":0.189164111,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"39'83","reported_seq":2146,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:48.389699+0000","last_change":"2023-07-29T02:06:48.389813+0000","last_active":"2023-07-29T02:06:48.389699+0000","last_peered":"2023-07-29T02:06:48.389699+0000","last_clean":"2023-07-29T02:06:48.389699+0000","last_became_active":"2023-07-29T01:59:57.969742+0000","last_became_peered":"2023-07-29T01:59:57.969742+0000","last_unstale":"2023-07-29T02:06:48.389699+0000","last_undegraded":"2023-07-29T02:06:48.389699+0000","last_fullsized":"2023-07-29T02:06:48.389699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'83","last_scrub_stamp":"2023-07-29T02:06:48.389675+0000","last_deep_scrub":"39'83","last_deep_scrub_stamp":"2023-07-29T02:06:48.389675+0000","last_clean_scrub_stamp":"2023-07-29T02:06:48.389675+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:38.422597+0000","scrub_duration":0.0019922020000000002,"objects_trimmed":0,"snaptrim_duration":0.53981922100000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"39'109","reported_seq":2172,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:49.410502+0000","last_change":"2023-07-29T02:06:49.410631+0000","last_active":"2023-07-29T02:06:49.410502+0000","last_peered":"2023-07-29T02:06:49.410502+0000","last_clean":"2023-07-29T02:06:49.410502+0000","last_became_active":"2023-07-29T01:59:57.969409+0000","last_became_peered":"2023-07-29T01:59:57.969409+0000","last_unstale":"2023-07-29T02:06:49.410502+0000","last_undegraded":"2023-07-29T02:06:49.410502+0000","last_fullsized":"2023-07-29T02:06:49.410502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'109","last_scrub_stamp":"2023-07-29T02:06:49.410474+0000","last_deep_scrub":"39'109","last_deep_scrub_stamp":"2023-07-29T02:06:49.410474+0000","last_clean_scrub_stamp":"2023-07-29T02:06:49.410474+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:16:28.377736+0000","scrub_duration":0.0015257249999999999,"objects_trimmed":0,"snaptrim_duration":0.53315132300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"39'74","reported_seq":2137,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:30.637361+0000","last_change":"2023-07-29T02:06:30.637467+0000","last_active":"2023-07-29T02:06:30.637361+0000","last_peered":"2023-07-29T02:06:30.637361+0000","last_clean":"2023-07-29T02:06:30.637361+0000","last_became_active":"2023-07-29T01:59:57.963774+0000","last_became_peered":"2023-07-29T01:59:57.963774+0000","last_unstale":"2023-07-29T02:06:30.637361+0000","last_undegraded":"2023-07-29T02:06:30.637361+0000","last_fullsized":"2023-07-29T02:06:30.637361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'74","last_scrub_stamp":"2023-07-29T02:06:30.637332+0000","last_deep_scrub":"39'74","last_deep_scrub_stamp":"2023-07-29T02:06:30.637332+0000","last_clean_scrub_stamp":"2023-07-29T02:06:30.637332+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:25.755483+0000","scrub_duration":0.0015544249999999999,"objects_trimmed":0,"snaptrim_duration":0.30426659299999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"39'632","reported_seq":2750,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:35.549698+0000","last_change":"2023-07-29T02:07:35.549824+0000","last_active":"2023-07-29T02:07:35.549698+0000","last_peered":"2023-07-29T02:07:35.549698+0000","last_clean":"2023-07-29T02:07:35.549698+0000","last_became_active":"2023-07-29T02:00:01.993731+0000","last_became_peered":"2023-07-29T02:00:01.993731+0000","last_unstale":"2023-07-29T02:07:35.549698+0000","last_undegraded":"2023-07-29T02:07:35.549698+0000","last_fullsized":"2023-07-29T02:07:35.549698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'632","last_scrub_stamp":"2023-07-29T02:07:35.549672+0000","last_deep_scrub":"39'632","last_deep_scrub_stamp":"2023-07-29T02:07:35.549672+0000","last_clean_scrub_stamp":"2023-07-29T02:07:35.549672+0000","objects_scrubbed":332,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:57:30.715215+0000","scrub_duration":0.12550244099999999,"objects_trimmed":0,"snaptrim_duration":0.35725884499999999,"stat_sum":{"num_bytes":48336376,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":31,"num_read_kb":16407,"num_write":630,"num_write_kb":51633,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"39'191","reported_seq":238,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:04.621645+0000","last_change":"2023-07-29T02:06:58.531745+0000","last_active":"2023-07-29T02:07:04.621645+0000","last_peered":"2023-07-29T02:07:04.621645+0000","last_clean":"2023-07-29T02:07:04.621645+0000","last_became_active":"2023-07-29T01:59:57.552673+0000","last_became_peered":"2023-07-29T01:59:57.552673+0000","last_unstale":"2023-07-29T02:07:04.621645+0000","last_undegraded":"2023-07-29T02:07:04.621645+0000","last_fullsized":"2023-07-29T02:07:04.621645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'188","last_scrub_stamp":"2023-07-29T02:06:58.531553+0000","last_deep_scrub":"39'188","last_deep_scrub_stamp":"2023-07-29T02:06:58.531553+0000","last_clean_scrub_stamp":"2023-07-29T02:06:58.531553+0000","objects_scrubbed":8,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:42:11.408015+0000","scrub_duration":0.031327384,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17110555,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":182,"num_write_kb":16834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30712,"num_omap_keys":51,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"39'90","reported_seq":2153,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:45.022292+0000","last_change":"2023-07-29T02:06:45.022292+0000","last_active":"2023-07-29T02:06:45.022292+0000","last_peered":"2023-07-29T02:06:45.022292+0000","last_clean":"2023-07-29T02:06:45.022292+0000","last_became_active":"2023-07-29T01:59:57.969821+0000","last_became_peered":"2023-07-29T01:59:57.969821+0000","last_unstale":"2023-07-29T02:06:45.022292+0000","last_undegraded":"2023-07-29T02:06:45.022292+0000","last_fullsized":"2023-07-29T02:06:45.022292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'90","last_scrub_stamp":"2023-07-29T02:06:45.022147+0000","last_deep_scrub":"39'90","last_deep_scrub_stamp":"2023-07-29T02:06:45.022147+0000","last_clean_scrub_stamp":"2023-07-29T02:06:45.022147+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:06:42.106944+0000","scrub_duration":0.0015979880000000001,"objects_trimmed":0,"snaptrim_duration":0.40087768200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"39'629","reported_seq":2755,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:57.244950+0000","last_change":"2023-07-29T02:06:57.245067+0000","last_active":"2023-07-29T02:06:57.244950+0000","last_peered":"2023-07-29T02:06:57.244950+0000","last_clean":"2023-07-29T02:06:57.244950+0000","last_became_active":"2023-07-29T02:00:01.992338+0000","last_became_peered":"2023-07-29T02:00:01.992338+0000","last_unstale":"2023-07-29T02:06:57.244950+0000","last_undegraded":"2023-07-29T02:06:57.244950+0000","last_fullsized":"2023-07-29T02:06:57.244950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'629","last_scrub_stamp":"2023-07-29T02:06:57.244926+0000","last_deep_scrub":"39'629","last_deep_scrub_stamp":"2023-07-29T02:06:57.244926+0000","last_clean_scrub_stamp":"2023-07-29T02:06:57.244926+0000","objects_scrubbed":308,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:33:31.105937+0000","scrub_duration":0.13632612799999999,"objects_trimmed":0,"snaptrim_duration":0.20956234600000001,"stat_sum":{"num_bytes":44446331,"num_objects":308,"num_object_clones":0,"num_object_copies":1232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":308,"num_whiteouts":0,"num_read":41,"num_read_kb":16418,"num_write":629,"num_write_kb":43687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"39'22","reported_seq":67,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:27.140252+0000","last_change":"2023-07-29T02:06:27.140252+0000","last_active":"2023-07-29T02:06:27.140252+0000","last_peered":"2023-07-29T02:06:27.140252+0000","last_clean":"2023-07-29T02:06:27.140252+0000","last_became_active":"2023-07-29T01:59:57.547455+0000","last_became_peered":"2023-07-29T01:59:57.547455+0000","last_unstale":"2023-07-29T02:06:27.140252+0000","last_undegraded":"2023-07-29T02:06:27.140252+0000","last_fullsized":"2023-07-29T02:06:27.140252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'22","last_scrub_stamp":"2023-07-29T02:06:27.140101+0000","last_deep_scrub":"39'22","last_deep_scrub_stamp":"2023-07-29T02:06:27.140101+0000","last_clean_scrub_stamp":"2023-07-29T02:06:27.140101+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:40.716498+0000","scrub_duration":0.0090765410000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":20,"num_write_kb":4125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":16912,"num_omap_keys":28,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"39'92","reported_seq":2155,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:02.188486+0000","last_change":"2023-07-29T02:07:02.188588+0000","last_active":"2023-07-29T02:07:02.188486+0000","last_peered":"2023-07-29T02:07:02.188486+0000","last_clean":"2023-07-29T02:07:02.188486+0000","last_became_active":"2023-07-29T01:59:57.964393+0000","last_became_peered":"2023-07-29T01:59:57.964393+0000","last_unstale":"2023-07-29T02:07:02.188486+0000","last_undegraded":"2023-07-29T02:07:02.188486+0000","last_fullsized":"2023-07-29T02:07:02.188486+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'92","last_scrub_stamp":"2023-07-29T02:07:02.188459+0000","last_deep_scrub":"39'92","last_deep_scrub_stamp":"2023-07-29T02:07:02.188459+0000","last_clean_scrub_stamp":"2023-07-29T02:07:02.188459+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:37:00.928554+0000","scrub_duration":0.0018349029999999999,"objects_trimmed":0,"snaptrim_duration":0.55267013499999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"39'624","reported_seq":2741,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:08.318968+0000","last_change":"2023-07-29T02:07:08.319130+0000","last_active":"2023-07-29T02:07:08.318968+0000","last_peered":"2023-07-29T02:07:08.318968+0000","last_clean":"2023-07-29T02:07:08.318968+0000","last_became_active":"2023-07-29T02:00:01.982042+0000","last_became_peered":"2023-07-29T02:00:01.982042+0000","last_unstale":"2023-07-29T02:07:08.318968+0000","last_undegraded":"2023-07-29T02:07:08.318968+0000","last_fullsized":"2023-07-29T02:07:08.318968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'624","last_scrub_stamp":"2023-07-29T02:07:08.318937+0000","last_deep_scrub":"39'624","last_deep_scrub_stamp":"2023-07-29T02:07:08.318937+0000","last_clean_scrub_stamp":"2023-07-29T02:07:08.318937+0000","objects_scrubbed":308,"log_size":624,"log_dups_size":0,"ondisk_log_size":624,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:06:26.027769+0000","scrub_duration":0.107933345,"objects_trimmed":0,"snaptrim_duration":0.55323541600000004,"stat_sum":{"num_bytes":17887936,"num_objects":308,"num_object_clones":0,"num_object_copies":1232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":308,"num_whiteouts":0,"num_read":32,"num_read_kb":5104,"num_write":624,"num_write_kb":17797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"39'219","reported_seq":265,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:40.995666+0000","last_change":"2023-07-29T02:06:40.995666+0000","last_active":"2023-07-29T02:06:40.995666+0000","last_peered":"2023-07-29T02:06:40.995666+0000","last_clean":"2023-07-29T02:06:40.995666+0000","last_became_active":"2023-07-29T01:59:57.533523+0000","last_became_peered":"2023-07-29T01:59:57.533523+0000","last_unstale":"2023-07-29T02:06:40.995666+0000","last_undegraded":"2023-07-29T02:06:40.995666+0000","last_fullsized":"2023-07-29T02:06:40.995666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'219","last_scrub_stamp":"2023-07-29T02:06:40.995491+0000","last_deep_scrub":"39'219","last_deep_scrub_stamp":"2023-07-29T02:06:40.995491+0000","last_clean_scrub_stamp":"2023-07-29T02:06:40.995491+0000","objects_scrubbed":8,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:16:19.962753+0000","scrub_duration":0.031869078000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":210,"num_write_kb":16504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31952,"num_omap_keys":53,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"39'88","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:53.076715+0000","last_change":"2023-07-29T02:06:53.076831+0000","last_active":"2023-07-29T02:06:53.076715+0000","last_peered":"2023-07-29T02:06:53.076715+0000","last_clean":"2023-07-29T02:06:53.076715+0000","last_became_active":"2023-07-29T01:59:57.963466+0000","last_became_peered":"2023-07-29T01:59:57.963466+0000","last_unstale":"2023-07-29T02:06:53.076715+0000","last_undegraded":"2023-07-29T02:06:53.076715+0000","last_fullsized":"2023-07-29T02:06:53.076715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'88","last_scrub_stamp":"2023-07-29T02:06:53.076686+0000","last_deep_scrub":"39'88","last_deep_scrub_stamp":"2023-07-29T02:06:53.076686+0000","last_clean_scrub_stamp":"2023-07-29T02:06:53.076686+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:13:15.669694+0000","scrub_duration":0.0015148620000000001,"objects_trimmed":0,"snaptrim_duration":0.209911193,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"39'697","reported_seq":2825,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:56.220583+0000","last_change":"2023-07-29T02:06:56.220583+0000","last_active":"2023-07-29T02:06:56.220583+0000","last_peered":"2023-07-29T02:06:56.220583+0000","last_clean":"2023-07-29T02:06:56.220583+0000","last_became_active":"2023-07-29T02:00:01.984000+0000","last_became_peered":"2023-07-29T02:00:01.984000+0000","last_unstale":"2023-07-29T02:06:56.220583+0000","last_undegraded":"2023-07-29T02:06:56.220583+0000","last_fullsized":"2023-07-29T02:06:56.220583+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'697","last_scrub_stamp":"2023-07-29T02:06:56.220417+0000","last_deep_scrub":"39'697","last_deep_scrub_stamp":"2023-07-29T02:06:56.220417+0000","last_clean_scrub_stamp":"2023-07-29T02:06:56.220417+0000","objects_scrubbed":367,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:16:35.187678+0000","scrub_duration":0.14049162900000001,"objects_trimmed":0,"snaptrim_duration":0.218444052,"stat_sum":{"num_bytes":33480822,"num_objects":367,"num_object_clones":0,"num_object_copies":1468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":367,"num_whiteouts":0,"num_read":39,"num_read_kb":11040,"num_write":700,"num_write_kb":41165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"39'4","reported_seq":48,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:35.267179+0000","last_change":"2023-07-29T02:06:35.267179+0000","last_active":"2023-07-29T02:06:35.267179+0000","last_peered":"2023-07-29T02:06:35.267179+0000","last_clean":"2023-07-29T02:06:35.267179+0000","last_became_active":"2023-07-29T01:59:57.536732+0000","last_became_peered":"2023-07-29T01:59:57.536732+0000","last_unstale":"2023-07-29T02:06:35.267179+0000","last_undegraded":"2023-07-29T02:06:35.267179+0000","last_fullsized":"2023-07-29T02:06:35.267179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'4","last_scrub_stamp":"2023-07-29T02:06:35.267044+0000","last_deep_scrub":"39'4","last_deep_scrub_stamp":"2023-07-29T02:06:35.267044+0000","last_clean_scrub_stamp":"2023-07-29T02:06:35.267044+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:32.781960+0000","scrub_duration":0.0035102390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11476,"num_omap_keys":19,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"39'88","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:25.880739+0000","last_change":"2023-07-29T02:06:25.880739+0000","last_active":"2023-07-29T02:06:25.880739+0000","last_peered":"2023-07-29T02:06:25.880739+0000","last_clean":"2023-07-29T02:06:25.880739+0000","last_became_active":"2023-07-29T01:59:57.970902+0000","last_became_peered":"2023-07-29T01:59:57.970902+0000","last_unstale":"2023-07-29T02:06:25.880739+0000","last_undegraded":"2023-07-29T02:06:25.880739+0000","last_fullsized":"2023-07-29T02:06:25.880739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'88","last_scrub_stamp":"2023-07-29T02:06:25.880641+0000","last_deep_scrub":"39'88","last_deep_scrub_stamp":"2023-07-29T02:06:25.880641+0000","last_clean_scrub_stamp":"2023-07-29T02:06:25.880641+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:45.851009+0000","scrub_duration":0.0013327549999999999,"objects_trimmed":0,"snaptrim_duration":0.3723399,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'665","reported_seq":2787,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:54.736294+0000","last_change":"2023-07-29T02:06:54.736294+0000","last_active":"2023-07-29T02:06:54.736294+0000","last_peered":"2023-07-29T02:06:54.736294+0000","last_clean":"2023-07-29T02:06:54.736294+0000","last_became_active":"2023-07-29T02:00:01.989456+0000","last_became_peered":"2023-07-29T02:00:01.989456+0000","last_unstale":"2023-07-29T02:06:54.736294+0000","last_undegraded":"2023-07-29T02:06:54.736294+0000","last_fullsized":"2023-07-29T02:06:54.736294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'665","last_scrub_stamp":"2023-07-29T02:06:54.736108+0000","last_deep_scrub":"39'665","last_deep_scrub_stamp":"2023-07-29T02:06:54.736108+0000","last_clean_scrub_stamp":"2023-07-29T02:06:54.736108+0000","objects_scrubbed":318,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:29:59.815537+0000","scrub_duration":0.14528770899999999,"objects_trimmed":0,"snaptrim_duration":0.189839176,"stat_sum":{"num_bytes":37359948,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":38,"num_read_kb":16417,"num_write":659,"num_write_kb":40721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"39'108","reported_seq":153,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:40.695251+0000","last_change":"2023-07-29T02:06:40.695251+0000","last_active":"2023-07-29T02:06:40.695251+0000","last_peered":"2023-07-29T02:06:40.695251+0000","last_clean":"2023-07-29T02:06:40.695251+0000","last_became_active":"2023-07-29T01:59:57.540113+0000","last_became_peered":"2023-07-29T01:59:57.540113+0000","last_unstale":"2023-07-29T02:06:40.695251+0000","last_undegraded":"2023-07-29T02:06:40.695251+0000","last_fullsized":"2023-07-29T02:06:40.695251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'108","last_scrub_stamp":"2023-07-29T02:06:40.695102+0000","last_deep_scrub":"39'108","last_deep_scrub_stamp":"2023-07-29T02:06:40.695102+0000","last_clean_scrub_stamp":"2023-07-29T02:06:40.695102+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:33.836191+0000","scrub_duration":0.036052965999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":100,"num_write_kb":16445,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17522,"num_omap_keys":30,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"39'91","reported_seq":2155,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:11.022381+0000","last_change":"2023-07-29T02:07:11.022496+0000","last_active":"2023-07-29T02:07:11.022381+0000","last_peered":"2023-07-29T02:07:11.022381+0000","last_clean":"2023-07-29T02:07:11.022381+0000","last_became_active":"2023-07-29T01:59:57.967083+0000","last_became_peered":"2023-07-29T01:59:57.967083+0000","last_unstale":"2023-07-29T02:07:11.022381+0000","last_undegraded":"2023-07-29T02:07:11.022381+0000","last_fullsized":"2023-07-29T02:07:11.022381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'91","last_scrub_stamp":"2023-07-29T02:07:11.022354+0000","last_deep_scrub":"39'91","last_deep_scrub_stamp":"2023-07-29T02:07:11.022354+0000","last_clean_scrub_stamp":"2023-07-29T02:07:11.022354+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T05:31:16.182475+0000","scrub_duration":0.0020888349999999998,"objects_trimmed":0,"snaptrim_duration":0.38037237200000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"39'632","reported_seq":2761,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:06.164475+0000","last_change":"2023-07-29T02:07:06.164614+0000","last_active":"2023-07-29T02:07:06.164475+0000","last_peered":"2023-07-29T02:07:06.164475+0000","last_clean":"2023-07-29T02:07:06.164475+0000","last_became_active":"2023-07-29T02:00:01.996035+0000","last_became_peered":"2023-07-29T02:00:01.996035+0000","last_unstale":"2023-07-29T02:07:06.164475+0000","last_undegraded":"2023-07-29T02:07:06.164475+0000","last_fullsized":"2023-07-29T02:07:06.164475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'632","last_scrub_stamp":"2023-07-29T02:07:06.164448+0000","last_deep_scrub":"39'632","last_deep_scrub_stamp":"2023-07-29T02:07:06.164448+0000","last_clean_scrub_stamp":"2023-07-29T02:07:06.164448+0000","objects_scrubbed":313,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:50:11.948568+0000","scrub_duration":0.119038639,"objects_trimmed":0,"snaptrim_duration":0.39874443399999998,"stat_sum":{"num_bytes":20875244,"num_objects":313,"num_object_clones":0,"num_object_copies":1252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":44,"num_read_kb":4139,"num_write":632,"num_write_kb":28878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"39'697","reported_seq":750,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.619224+0000","last_change":"2023-07-29T02:06:27.569347+0000","last_active":"2023-07-29T02:06:39.619224+0000","last_peered":"2023-07-29T02:06:39.619224+0000","last_clean":"2023-07-29T02:06:39.619224+0000","last_became_active":"2023-07-29T01:59:57.547803+0000","last_became_peered":"2023-07-29T01:59:57.547803+0000","last_unstale":"2023-07-29T02:06:39.619224+0000","last_undegraded":"2023-07-29T02:06:39.619224+0000","last_fullsized":"2023-07-29T02:06:39.619224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'621","last_scrub_stamp":"2023-07-29T02:06:27.569221+0000","last_deep_scrub":"39'621","last_deep_scrub_stamp":"2023-07-29T02:06:27.569221+0000","last_clean_scrub_stamp":"2023-07-29T02:06:27.569221+0000","objects_scrubbed":5,"log_size":697,"log_dups_size":0,"ondisk_log_size":697,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:59:25.186236+0000","scrub_duration":0.02490562,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583002,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":19,"num_read_kb":4114,"num_write":693,"num_write_kb":12634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"39'85","reported_seq":2148,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:43.393307+0000","last_change":"2023-07-29T02:06:43.393307+0000","last_active":"2023-07-29T02:06:43.393307+0000","last_peered":"2023-07-29T02:06:43.393307+0000","last_clean":"2023-07-29T02:06:43.393307+0000","last_became_active":"2023-07-29T01:59:57.969006+0000","last_became_peered":"2023-07-29T01:59:57.969006+0000","last_unstale":"2023-07-29T02:06:43.393307+0000","last_undegraded":"2023-07-29T02:06:43.393307+0000","last_fullsized":"2023-07-29T02:06:43.393307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'85","last_scrub_stamp":"2023-07-29T02:06:43.393180+0000","last_deep_scrub":"39'85","last_deep_scrub_stamp":"2023-07-29T02:06:43.393180+0000","last_clean_scrub_stamp":"2023-07-29T02:06:43.393180+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:36.534269+0000","scrub_duration":0.0019770159999999998,"objects_trimmed":0,"snaptrim_duration":0.53746501300000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"39'641","reported_seq":2771,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:54.571591+0000","last_change":"2023-07-29T02:06:54.571591+0000","last_active":"2023-07-29T02:06:54.571591+0000","last_peered":"2023-07-29T02:06:54.571591+0000","last_clean":"2023-07-29T02:06:54.571591+0000","last_became_active":"2023-07-29T02:00:01.995757+0000","last_became_peered":"2023-07-29T02:00:01.995757+0000","last_unstale":"2023-07-29T02:06:54.571591+0000","last_undegraded":"2023-07-29T02:06:54.571591+0000","last_fullsized":"2023-07-29T02:06:54.571591+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'641","last_scrub_stamp":"2023-07-29T02:06:54.571428+0000","last_deep_scrub":"39'641","last_deep_scrub_stamp":"2023-07-29T02:06:54.571428+0000","last_clean_scrub_stamp":"2023-07-29T02:06:54.571428+0000","objects_scrubbed":314,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:29:59.650857+0000","scrub_duration":0.117718709,"objects_trimmed":0,"snaptrim_duration":0.539926876,"stat_sum":{"num_bytes":20101741,"num_objects":314,"num_object_clones":0,"num_object_copies":1256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":314,"num_whiteouts":0,"num_read":45,"num_read_kb":20517,"num_write":638,"num_write_kb":32247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"39'133","reported_seq":195,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:59.507595+0000","last_change":"2023-07-29T02:06:59.507702+0000","last_active":"2023-07-29T02:06:59.507595+0000","last_peered":"2023-07-29T02:06:59.507595+0000","last_clean":"2023-07-29T02:06:59.507595+0000","last_became_active":"2023-07-29T01:59:57.541434+0000","last_became_peered":"2023-07-29T01:59:57.541434+0000","last_unstale":"2023-07-29T02:06:59.507595+0000","last_undegraded":"2023-07-29T02:06:59.507595+0000","last_fullsized":"2023-07-29T02:06:59.507595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'133","last_scrub_stamp":"2023-07-29T02:06:59.507567+0000","last_deep_scrub":"39'133","last_deep_scrub_stamp":"2023-07-29T02:06:59.507567+0000","last_clean_scrub_stamp":"2023-07-29T02:06:59.507567+0000","objects_scrubbed":6,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:06:17.216400+0000","scrub_duration":0.025791858000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":12324,"num_write":121,"num_write_kb":12360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"39'101","reported_seq":2164,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:38.483478+0000","last_change":"2023-07-29T02:06:38.483478+0000","last_active":"2023-07-29T02:06:38.483478+0000","last_peered":"2023-07-29T02:06:38.483478+0000","last_clean":"2023-07-29T02:06:38.483478+0000","last_became_active":"2023-07-29T01:59:57.962459+0000","last_became_peered":"2023-07-29T01:59:57.962459+0000","last_unstale":"2023-07-29T02:06:38.483478+0000","last_undegraded":"2023-07-29T02:06:38.483478+0000","last_fullsized":"2023-07-29T02:06:38.483478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'101","last_scrub_stamp":"2023-07-29T02:06:38.483341+0000","last_deep_scrub":"39'101","last_deep_scrub_stamp":"2023-07-29T02:06:38.483341+0000","last_clean_scrub_stamp":"2023-07-29T02:06:38.483341+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:53:21.113599+0000","scrub_duration":0.0015478099999999999,"objects_trimmed":0,"snaptrim_duration":0.34937986999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"39'591","reported_seq":2713,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:13.699158+0000","last_change":"2023-07-29T02:07:13.699158+0000","last_active":"2023-07-29T02:07:13.699158+0000","last_peered":"2023-07-29T02:07:13.699158+0000","last_clean":"2023-07-29T02:07:13.699158+0000","last_became_active":"2023-07-29T02:00:01.995827+0000","last_became_peered":"2023-07-29T02:00:01.995827+0000","last_unstale":"2023-07-29T02:07:13.699158+0000","last_undegraded":"2023-07-29T02:07:13.699158+0000","last_fullsized":"2023-07-29T02:07:13.699158+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'591","last_scrub_stamp":"2023-07-29T02:07:13.698913+0000","last_deep_scrub":"39'591","last_deep_scrub_stamp":"2023-07-29T02:07:13.698913+0000","last_clean_scrub_stamp":"2023-07-29T02:07:13.698913+0000","objects_scrubbed":268,"log_size":591,"log_dups_size":0,"ondisk_log_size":591,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:52:43.389134+0000","scrub_duration":0.095134643000000005,"objects_trimmed":0,"snaptrim_duration":0.30893240100000002,"stat_sum":{"num_bytes":24035129,"num_objects":268,"num_object_clones":0,"num_object_copies":1072,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":268,"num_whiteouts":0,"num_read":40,"num_read_kb":8228,"num_write":590,"num_write_kb":23787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"39'17","reported_seq":69,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:44.571061+0000","last_change":"2023-07-29T02:06:44.571061+0000","last_active":"2023-07-29T02:06:44.571061+0000","last_peered":"2023-07-29T02:06:44.571061+0000","last_clean":"2023-07-29T02:06:44.571061+0000","last_became_active":"2023-07-29T01:59:57.545406+0000","last_became_peered":"2023-07-29T01:59:57.545406+0000","last_unstale":"2023-07-29T02:06:44.571061+0000","last_undegraded":"2023-07-29T02:06:44.571061+0000","last_fullsized":"2023-07-29T02:06:44.571061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'17","last_scrub_stamp":"2023-07-29T02:06:44.570888+0000","last_deep_scrub":"39'17","last_deep_scrub_stamp":"2023-07-29T02:06:44.570888+0000","last_clean_scrub_stamp":"2023-07-29T02:06:44.570888+0000","objects_scrubbed":5,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:22.780946+0000","scrub_duration":0.018911788999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":8216,"num_write":11,"num_write_kb":8201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"39'86","reported_seq":2142,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:51.084893+0000","last_change":"2023-07-29T02:06:51.085043+0000","last_active":"2023-07-29T02:06:51.084893+0000","last_peered":"2023-07-29T02:06:51.084893+0000","last_clean":"2023-07-29T02:06:51.084893+0000","last_became_active":"2023-07-29T02:00:46.525331+0000","last_became_peered":"2023-07-29T02:00:46.525331+0000","last_unstale":"2023-07-29T02:06:51.084893+0000","last_undegraded":"2023-07-29T02:06:51.084893+0000","last_fullsized":"2023-07-29T02:06:51.084893+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'86","last_scrub_stamp":"2023-07-29T02:06:51.084864+0000","last_deep_scrub":"39'86","last_deep_scrub_stamp":"2023-07-29T02:06:51.084864+0000","last_clean_scrub_stamp":"2023-07-29T02:06:51.084864+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:41.117785+0000","scrub_duration":0.0019762199999999999,"objects_trimmed":0,"snaptrim_duration":0.46925831499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"39'589","reported_seq":2696,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:07.162374+0000","last_change":"2023-07-29T02:07:07.162520+0000","last_active":"2023-07-29T02:07:07.162374+0000","last_peered":"2023-07-29T02:07:07.162374+0000","last_clean":"2023-07-29T02:07:07.162374+0000","last_became_active":"2023-07-29T02:00:01.996969+0000","last_became_peered":"2023-07-29T02:00:01.996969+0000","last_unstale":"2023-07-29T02:07:07.162374+0000","last_undegraded":"2023-07-29T02:07:07.162374+0000","last_fullsized":"2023-07-29T02:07:07.162374+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'589","last_scrub_stamp":"2023-07-29T02:07:07.162351+0000","last_deep_scrub":"39'589","last_deep_scrub_stamp":"2023-07-29T02:07:07.162351+0000","last_clean_scrub_stamp":"2023-07-29T02:07:07.162351+0000","objects_scrubbed":297,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:12:16.667046+0000","scrub_duration":0.10039440400000001,"objects_trimmed":0,"snaptrim_duration":0.40090650999999999,"stat_sum":{"num_bytes":23342582,"num_objects":297,"num_object_clones":0,"num_object_copies":1188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":297,"num_whiteouts":0,"num_read":24,"num_read_kb":4119,"num_write":587,"num_write_kb":31305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"39'7","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:33.304685+0000","last_change":"2023-07-29T02:06:33.304685+0000","last_active":"2023-07-29T02:06:33.304685+0000","last_peered":"2023-07-29T02:06:33.304685+0000","last_clean":"2023-07-29T02:06:33.304685+0000","last_became_active":"2023-07-29T01:59:57.540800+0000","last_became_peered":"2023-07-29T01:59:57.540800+0000","last_unstale":"2023-07-29T02:06:33.304685+0000","last_undegraded":"2023-07-29T02:06:33.304685+0000","last_fullsized":"2023-07-29T02:06:33.304685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'7","last_scrub_stamp":"2023-07-29T02:06:33.304529+0000","last_deep_scrub":"39'7","last_deep_scrub_stamp":"2023-07-29T02:06:33.304529+0000","last_clean_scrub_stamp":"2023-07-29T02:06:33.304529+0000","objects_scrubbed":3,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:48.348979+0000","scrub_duration":0.0044829869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22906,"num_omap_keys":38,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"39'83","reported_seq":2146,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:31.683441+0000","last_change":"2023-07-29T02:06:31.683441+0000","last_active":"2023-07-29T02:06:31.683441+0000","last_peered":"2023-07-29T02:06:31.683441+0000","last_clean":"2023-07-29T02:06:31.683441+0000","last_became_active":"2023-07-29T01:59:57.963510+0000","last_became_peered":"2023-07-29T01:59:57.963510+0000","last_unstale":"2023-07-29T02:06:31.683441+0000","last_undegraded":"2023-07-29T02:06:31.683441+0000","last_fullsized":"2023-07-29T02:06:31.683441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'83","last_scrub_stamp":"2023-07-29T02:06:31.683303+0000","last_deep_scrub":"39'83","last_deep_scrub_stamp":"2023-07-29T02:06:31.683303+0000","last_clean_scrub_stamp":"2023-07-29T02:06:31.683303+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:51.653672+0000","scrub_duration":0.001434568,"objects_trimmed":0,"snaptrim_duration":0.30420630999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"39'628","reported_seq":2754,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:10.168157+0000","last_change":"2023-07-29T02:07:10.168157+0000","last_active":"2023-07-29T02:07:10.168157+0000","last_peered":"2023-07-29T02:07:10.168157+0000","last_clean":"2023-07-29T02:07:10.168157+0000","last_became_active":"2023-07-29T02:00:01.996084+0000","last_became_peered":"2023-07-29T02:00:01.996084+0000","last_unstale":"2023-07-29T02:07:10.168157+0000","last_undegraded":"2023-07-29T02:07:10.168157+0000","last_fullsized":"2023-07-29T02:07:10.168157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'628","last_scrub_stamp":"2023-07-29T02:07:10.167899+0000","last_deep_scrub":"39'628","last_deep_scrub_stamp":"2023-07-29T02:07:10.167899+0000","last_clean_scrub_stamp":"2023-07-29T02:07:10.167899+0000","objects_scrubbed":317,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:00:01.819680+0000","scrub_duration":0.114492439,"objects_trimmed":0,"snaptrim_duration":0.38362237100000002,"stat_sum":{"num_bytes":15782931,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":41,"num_read_kb":8234,"num_write":627,"num_write_kb":19844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"39'3","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:37.575902+0000","last_change":"2023-07-29T02:06:37.575902+0000","last_active":"2023-07-29T02:06:37.575902+0000","last_peered":"2023-07-29T02:06:37.575902+0000","last_clean":"2023-07-29T02:06:37.575902+0000","last_became_active":"2023-07-29T01:59:57.548109+0000","last_became_peered":"2023-07-29T01:59:57.548109+0000","last_unstale":"2023-07-29T02:06:37.575902+0000","last_undegraded":"2023-07-29T02:06:37.575902+0000","last_fullsized":"2023-07-29T02:06:37.575902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2023-07-29T02:06:37.575767+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2023-07-29T02:06:37.575767+0000","last_clean_scrub_stamp":"2023-07-29T02:06:37.575767+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:40.829676+0000","scrub_duration":0.0030220429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"39'105","reported_seq":2168,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:50.193450+0000","last_change":"2023-07-29T02:06:50.193450+0000","last_active":"2023-07-29T02:06:50.193450+0000","last_peered":"2023-07-29T02:06:50.193450+0000","last_clean":"2023-07-29T02:06:50.193450+0000","last_became_active":"2023-07-29T01:59:57.961759+0000","last_became_peered":"2023-07-29T01:59:57.961759+0000","last_unstale":"2023-07-29T02:06:50.193450+0000","last_undegraded":"2023-07-29T02:06:50.193450+0000","last_fullsized":"2023-07-29T02:06:50.193450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'105","last_scrub_stamp":"2023-07-29T02:06:50.193242+0000","last_deep_scrub":"39'105","last_deep_scrub_stamp":"2023-07-29T02:06:50.193242+0000","last_clean_scrub_stamp":"2023-07-29T02:06:50.193242+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:29:55.272671+0000","scrub_duration":0.00185907,"objects_trimmed":0,"snaptrim_duration":0.55180089099999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"39'661","reported_seq":2791,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:02.729286+0000","last_change":"2023-07-29T02:07:02.729286+0000","last_active":"2023-07-29T02:07:02.729286+0000","last_peered":"2023-07-29T02:07:02.729286+0000","last_clean":"2023-07-29T02:07:02.729286+0000","last_became_active":"2023-07-29T02:00:01.992592+0000","last_became_peered":"2023-07-29T02:00:01.992592+0000","last_unstale":"2023-07-29T02:07:02.729286+0000","last_undegraded":"2023-07-29T02:07:02.729286+0000","last_fullsized":"2023-07-29T02:07:02.729286+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'661","last_scrub_stamp":"2023-07-29T02:07:02.729101+0000","last_deep_scrub":"39'661","last_deep_scrub_stamp":"2023-07-29T02:07:02.729101+0000","last_clean_scrub_stamp":"2023-07-29T02:07:02.729101+0000","objects_scrubbed":303,"log_size":661,"log_dups_size":0,"ondisk_log_size":661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:37:01.469196+0000","scrub_duration":0.13390676700000001,"objects_trimmed":0,"snaptrim_duration":0.30939737499999997,"stat_sum":{"num_bytes":46419699,"num_objects":303,"num_object_clones":0,"num_object_copies":1212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":303,"num_whiteouts":0,"num_read":45,"num_read_kb":20516,"num_write":660,"num_write_kb":45624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"39'106","reported_seq":172,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:38.170787+0000","last_change":"2023-07-29T02:06:38.170787+0000","last_active":"2023-07-29T02:06:38.170787+0000","last_peered":"2023-07-29T02:06:38.170787+0000","last_clean":"2023-07-29T02:06:38.170787+0000","last_became_active":"2023-07-29T01:59:57.543398+0000","last_became_peered":"2023-07-29T01:59:57.543398+0000","last_unstale":"2023-07-29T02:06:38.170787+0000","last_undegraded":"2023-07-29T02:06:38.170787+0000","last_fullsized":"2023-07-29T02:06:38.170787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'106","last_scrub_stamp":"2023-07-29T02:06:38.170630+0000","last_deep_scrub":"39'106","last_deep_scrub_stamp":"2023-07-29T02:06:38.170630+0000","last_clean_scrub_stamp":"2023-07-29T02:06:38.170630+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:33.288781+0000","scrub_duration":0.020523897999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":62,"num_read_kb":8252,"num_write":102,"num_write_kb":8255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24160,"num_omap_keys":40,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"39'90","reported_seq":2153,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.891064+0000","last_change":"2023-07-29T02:06:24.891064+0000","last_active":"2023-07-29T02:06:24.891064+0000","last_peered":"2023-07-29T02:06:24.891064+0000","last_clean":"2023-07-29T02:06:24.891064+0000","last_became_active":"2023-07-29T01:59:57.965962+0000","last_became_peered":"2023-07-29T01:59:57.965962+0000","last_unstale":"2023-07-29T02:06:24.891064+0000","last_undegraded":"2023-07-29T02:06:24.891064+0000","last_fullsized":"2023-07-29T02:06:24.891064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'90","last_scrub_stamp":"2023-07-29T02:06:24.890955+0000","last_deep_scrub":"39'90","last_deep_scrub_stamp":"2023-07-29T02:06:24.890955+0000","last_clean_scrub_stamp":"2023-07-29T02:06:24.890955+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:20.009107+0000","scrub_duration":0.0016125829999999999,"objects_trimmed":0,"snaptrim_duration":0.38151887499999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"39'670","reported_seq":2804,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:06.663368+0000","last_change":"2023-07-29T02:07:06.663508+0000","last_active":"2023-07-29T02:07:06.663368+0000","last_peered":"2023-07-29T02:07:06.663368+0000","last_clean":"2023-07-29T02:07:06.663368+0000","last_became_active":"2023-07-29T02:00:01.992384+0000","last_became_peered":"2023-07-29T02:00:01.992384+0000","last_unstale":"2023-07-29T02:07:06.663368+0000","last_undegraded":"2023-07-29T02:07:06.663368+0000","last_fullsized":"2023-07-29T02:07:06.663368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'670","last_scrub_stamp":"2023-07-29T02:07:06.663343+0000","last_deep_scrub":"39'670","last_deep_scrub_stamp":"2023-07-29T02:07:06.663343+0000","last_clean_scrub_stamp":"2023-07-29T02:07:06.663343+0000","objects_scrubbed":318,"log_size":670,"log_dups_size":0,"ondisk_log_size":670,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:37:05.403438+0000","scrub_duration":0.13376521999999999,"objects_trimmed":0,"snaptrim_duration":0.19044205,"stat_sum":{"num_bytes":36575402,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":49,"num_read_kb":16426,"num_write":669,"num_write_kb":40161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"39'30","reported_seq":78,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:43.592473+0000","last_change":"2023-07-29T02:06:43.592473+0000","last_active":"2023-07-29T02:06:43.592473+0000","last_peered":"2023-07-29T02:06:43.592473+0000","last_clean":"2023-07-29T02:06:43.592473+0000","last_became_active":"2023-07-29T01:59:57.548084+0000","last_became_peered":"2023-07-29T01:59:57.548084+0000","last_unstale":"2023-07-29T02:06:43.592473+0000","last_undegraded":"2023-07-29T02:06:43.592473+0000","last_fullsized":"2023-07-29T02:06:43.592473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'30","last_scrub_stamp":"2023-07-29T02:06:43.592305+0000","last_deep_scrub":"39'30","last_deep_scrub_stamp":"2023-07-29T02:06:43.592305+0000","last_clean_scrub_stamp":"2023-07-29T02:06:43.592305+0000","objects_scrubbed":4,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:36.733394+0000","scrub_duration":0.012205482,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":27,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":17798,"num_omap_keys":30,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"39'93","reported_seq":2156,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:45.593991+0000","last_change":"2023-07-29T02:06:45.594104+0000","last_active":"2023-07-29T02:06:45.593991+0000","last_peered":"2023-07-29T02:06:45.593991+0000","last_clean":"2023-07-29T02:06:45.593991+0000","last_became_active":"2023-07-29T01:59:57.964626+0000","last_became_peered":"2023-07-29T01:59:57.964626+0000","last_unstale":"2023-07-29T02:06:45.593991+0000","last_undegraded":"2023-07-29T02:06:45.593991+0000","last_fullsized":"2023-07-29T02:06:45.593991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'93","last_scrub_stamp":"2023-07-29T02:06:45.593955+0000","last_deep_scrub":"39'93","last_deep_scrub_stamp":"2023-07-29T02:06:45.593955+0000","last_clean_scrub_stamp":"2023-07-29T02:06:45.593955+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:35.626877+0000","scrub_duration":0.0014249449999999999,"objects_trimmed":0,"snaptrim_duration":0.297089139,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"39'673","reported_seq":2800,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:42.077307+0000","last_change":"2023-07-29T02:06:42.077438+0000","last_active":"2023-07-29T02:06:42.077307+0000","last_peered":"2023-07-29T02:06:42.077307+0000","last_clean":"2023-07-29T02:06:42.077307+0000","last_became_active":"2023-07-29T02:00:01.990579+0000","last_became_peered":"2023-07-29T02:00:01.990579+0000","last_unstale":"2023-07-29T02:06:42.077307+0000","last_undegraded":"2023-07-29T02:06:42.077307+0000","last_fullsized":"2023-07-29T02:06:42.077307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'673","last_scrub_stamp":"2023-07-29T02:06:42.077282+0000","last_deep_scrub":"39'673","last_deep_scrub_stamp":"2023-07-29T02:06:42.077282+0000","last_clean_scrub_stamp":"2023-07-29T02:06:42.077282+0000","objects_scrubbed":333,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:57.121733+0000","scrub_duration":0.13274117899999999,"objects_trimmed":0,"snaptrim_duration":0.47400464199999998,"stat_sum":{"num_bytes":32895626,"num_objects":333,"num_object_clones":0,"num_object_copies":1332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":333,"num_whiteouts":0,"num_read":40,"num_read_kb":14736,"num_write":673,"num_write_kb":36572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"39'247","reported_seq":297,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.564540+0000","last_change":"2023-07-29T02:06:41.564540+0000","last_active":"2023-07-29T02:06:41.564540+0000","last_peered":"2023-07-29T02:06:41.564540+0000","last_clean":"2023-07-29T02:06:41.564540+0000","last_became_active":"2023-07-29T01:59:57.548981+0000","last_became_peered":"2023-07-29T01:59:57.548981+0000","last_unstale":"2023-07-29T02:06:41.564540+0000","last_undegraded":"2023-07-29T02:06:41.564540+0000","last_fullsized":"2023-07-29T02:06:41.564540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'247","last_scrub_stamp":"2023-07-29T02:06:41.564325+0000","last_deep_scrub":"39'247","last_deep_scrub_stamp":"2023-07-29T02:06:41.564325+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.564325+0000","objects_scrubbed":4,"log_size":247,"log_dups_size":0,"ondisk_log_size":247,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:39.079241+0000","scrub_duration":0.018895436000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":244,"num_write_kb":4270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":14496,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"39'93","reported_seq":2156,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:16.446190+0000","last_change":"2023-07-29T02:07:16.446307+0000","last_active":"2023-07-29T02:07:16.446190+0000","last_peered":"2023-07-29T02:07:16.446190+0000","last_clean":"2023-07-29T02:07:16.446190+0000","last_became_active":"2023-07-29T01:59:57.969501+0000","last_became_peered":"2023-07-29T01:59:57.969501+0000","last_unstale":"2023-07-29T02:07:16.446190+0000","last_undegraded":"2023-07-29T02:07:16.446190+0000","last_fullsized":"2023-07-29T02:07:16.446190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'93","last_scrub_stamp":"2023-07-29T02:07:16.446152+0000","last_deep_scrub":"39'93","last_deep_scrub_stamp":"2023-07-29T02:07:16.446152+0000","last_clean_scrub_stamp":"2023-07-29T02:07:16.446152+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:39:24.756575+0000","scrub_duration":0.002258763,"objects_trimmed":0,"snaptrim_duration":0.35565022000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"39'641","reported_seq":2766,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:48.159456+0000","last_change":"2023-07-29T02:06:48.159456+0000","last_active":"2023-07-29T02:06:48.159456+0000","last_peered":"2023-07-29T02:06:48.159456+0000","last_clean":"2023-07-29T02:06:48.159456+0000","last_became_active":"2023-07-29T02:00:01.989364+0000","last_became_peered":"2023-07-29T02:00:01.989364+0000","last_unstale":"2023-07-29T02:06:48.159456+0000","last_undegraded":"2023-07-29T02:06:48.159456+0000","last_fullsized":"2023-07-29T02:06:48.159456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'641","last_scrub_stamp":"2023-07-29T02:06:48.159299+0000","last_deep_scrub":"39'641","last_deep_scrub_stamp":"2023-07-29T02:06:48.159299+0000","last_clean_scrub_stamp":"2023-07-29T02:06:48.159299+0000","objects_scrubbed":325,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:13:10.752308+0000","scrub_duration":0.124059473,"objects_trimmed":0,"snaptrim_duration":0.47145374600000001,"stat_sum":{"num_bytes":24224399,"num_objects":325,"num_object_clones":0,"num_object_copies":1300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":325,"num_whiteouts":0,"num_read":38,"num_read_kb":8228,"num_write":641,"num_write_kb":23994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"39'12","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.570729+0000","last_change":"2023-07-29T02:06:39.570729+0000","last_active":"2023-07-29T02:06:39.570729+0000","last_peered":"2023-07-29T02:06:39.570729+0000","last_clean":"2023-07-29T02:06:39.570729+0000","last_became_active":"2023-07-29T01:59:57.541056+0000","last_became_peered":"2023-07-29T01:59:57.541056+0000","last_unstale":"2023-07-29T02:06:39.570729+0000","last_undegraded":"2023-07-29T02:06:39.570729+0000","last_fullsized":"2023-07-29T02:06:39.570729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'12","last_scrub_stamp":"2023-07-29T02:06:39.570584+0000","last_deep_scrub":"39'12","last_deep_scrub_stamp":"2023-07-29T02:06:39.570584+0000","last_clean_scrub_stamp":"2023-07-29T02:06:39.570584+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:54.615034+0000","scrub_duration":0.016833287999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":8,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":31920,"num_omap_keys":53,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"39'88","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.129971+0000","last_change":"2023-07-29T02:06:39.130059+0000","last_active":"2023-07-29T02:06:39.129971+0000","last_peered":"2023-07-29T02:06:39.129971+0000","last_clean":"2023-07-29T02:06:39.129971+0000","last_became_active":"2023-07-29T01:59:57.974998+0000","last_became_peered":"2023-07-29T01:59:57.974998+0000","last_unstale":"2023-07-29T02:06:39.129971+0000","last_undegraded":"2023-07-29T02:06:39.129971+0000","last_fullsized":"2023-07-29T02:06:39.129971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'88","last_scrub_stamp":"2023-07-29T02:06:39.129946+0000","last_deep_scrub":"39'88","last_deep_scrub_stamp":"2023-07-29T02:06:39.129946+0000","last_clean_scrub_stamp":"2023-07-29T02:06:39.129946+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:59.100315+0000","scrub_duration":0.0019768939999999999,"objects_trimmed":0,"snaptrim_duration":0.20531364299999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"39'660","reported_seq":2776,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:47.144287+0000","last_change":"2023-07-29T02:06:47.144475+0000","last_active":"2023-07-29T02:06:47.144287+0000","last_peered":"2023-07-29T02:06:47.144287+0000","last_clean":"2023-07-29T02:06:47.144287+0000","last_became_active":"2023-07-29T02:00:01.990276+0000","last_became_peered":"2023-07-29T02:00:01.990276+0000","last_unstale":"2023-07-29T02:06:47.144287+0000","last_undegraded":"2023-07-29T02:06:47.144287+0000","last_fullsized":"2023-07-29T02:06:47.144287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'660","last_scrub_stamp":"2023-07-29T02:06:47.144238+0000","last_deep_scrub":"39'660","last_deep_scrub_stamp":"2023-07-29T02:06:47.144238+0000","last_clean_scrub_stamp":"2023-07-29T02:06:47.144238+0000","objects_scrubbed":321,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:25.354296+0000","scrub_duration":0.12368135500000001,"objects_trimmed":0,"snaptrim_duration":0.47581172799999999,"stat_sum":{"num_bytes":20642551,"num_objects":321,"num_object_clones":0,"num_object_copies":1284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":321,"num_whiteouts":0,"num_read":31,"num_read_kb":1050,"num_write":661,"num_write_kb":24562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"39'11","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:36.751062+0000","last_change":"2023-07-29T02:06:36.751062+0000","last_active":"2023-07-29T02:06:36.751062+0000","last_peered":"2023-07-29T02:06:36.751062+0000","last_clean":"2023-07-29T02:06:36.751062+0000","last_became_active":"2023-07-29T01:59:57.544231+0000","last_became_peered":"2023-07-29T01:59:57.544231+0000","last_unstale":"2023-07-29T02:06:36.751062+0000","last_undegraded":"2023-07-29T02:06:36.751062+0000","last_fullsized":"2023-07-29T02:06:36.751062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'11","last_scrub_stamp":"2023-07-29T02:06:36.750893+0000","last_deep_scrub":"39'11","last_deep_scrub_stamp":"2023-07-29T02:06:36.750893+0000","last_clean_scrub_stamp":"2023-07-29T02:06:36.750893+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:51.795344+0000","scrub_duration":0.011813673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20726,"num_omap_keys":35,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"39'88","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:04.226546+0000","last_change":"2023-07-29T02:07:04.226649+0000","last_active":"2023-07-29T02:07:04.226546+0000","last_peered":"2023-07-29T02:07:04.226546+0000","last_clean":"2023-07-29T02:07:04.226546+0000","last_became_active":"2023-07-29T01:59:57.974525+0000","last_became_peered":"2023-07-29T01:59:57.974525+0000","last_unstale":"2023-07-29T02:07:04.226546+0000","last_undegraded":"2023-07-29T02:07:04.226546+0000","last_fullsized":"2023-07-29T02:07:04.226546+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'88","last_scrub_stamp":"2023-07-29T02:07:04.226523+0000","last_deep_scrub":"39'88","last_deep_scrub_stamp":"2023-07-29T02:07:04.226523+0000","last_clean_scrub_stamp":"2023-07-29T02:07:04.226523+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:48:31.036883+0000","scrub_duration":0.0011936620000000001,"objects_trimmed":0,"snaptrim_duration":0.549422509,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"39'632","reported_seq":2758,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:44.103323+0000","last_change":"2023-07-29T02:06:44.103323+0000","last_active":"2023-07-29T02:06:44.103323+0000","last_peered":"2023-07-29T02:06:44.103323+0000","last_clean":"2023-07-29T02:06:44.103323+0000","last_became_active":"2023-07-29T02:00:01.988486+0000","last_became_peered":"2023-07-29T02:00:01.988486+0000","last_unstale":"2023-07-29T02:06:44.103323+0000","last_undegraded":"2023-07-29T02:06:44.103323+0000","last_fullsized":"2023-07-29T02:06:44.103323+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'632","last_scrub_stamp":"2023-07-29T02:06:44.103126+0000","last_deep_scrub":"39'632","last_deep_scrub_stamp":"2023-07-29T02:06:44.103126+0000","last_clean_scrub_stamp":"2023-07-29T02:06:44.103126+0000","objects_scrubbed":300,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:41.618043+0000","scrub_duration":0.13271588600000001,"objects_trimmed":0,"snaptrim_duration":0.473472642,"stat_sum":{"num_bytes":32792736,"num_objects":300,"num_object_clones":0,"num_object_copies":1200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":300,"num_whiteouts":0,"num_read":41,"num_read_kb":18442,"num_write":630,"num_write_kb":40548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"39'382","reported_seq":431,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.975797+0000","last_change":"2023-07-29T02:06:39.975797+0000","last_active":"2023-07-29T02:06:39.975797+0000","last_peered":"2023-07-29T02:06:39.975797+0000","last_clean":"2023-07-29T02:06:39.975797+0000","last_became_active":"2023-07-29T01:59:57.534813+0000","last_became_peered":"2023-07-29T01:59:57.534813+0000","last_unstale":"2023-07-29T02:06:39.975797+0000","last_undegraded":"2023-07-29T02:06:39.975797+0000","last_fullsized":"2023-07-29T02:06:39.975797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'382","last_scrub_stamp":"2023-07-29T02:06:39.975672+0000","last_deep_scrub":"39'382","last_deep_scrub_stamp":"2023-07-29T02:06:39.975672+0000","last_clean_scrub_stamp":"2023-07-29T02:06:39.975672+0000","objects_scrubbed":6,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:30.008594+0000","scrub_duration":0.024545006000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":8198,"num_write":371,"num_write_kb":12605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"39'96","reported_seq":2159,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:24.494296+0000","last_change":"2023-07-29T02:06:24.494296+0000","last_active":"2023-07-29T02:06:24.494296+0000","last_peered":"2023-07-29T02:06:24.494296+0000","last_clean":"2023-07-29T02:06:24.494296+0000","last_became_active":"2023-07-29T01:59:57.962184+0000","last_became_peered":"2023-07-29T01:59:57.962184+0000","last_unstale":"2023-07-29T02:06:24.494296+0000","last_undegraded":"2023-07-29T02:06:24.494296+0000","last_fullsized":"2023-07-29T02:06:24.494296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'96","last_scrub_stamp":"2023-07-29T02:06:24.494142+0000","last_deep_scrub":"39'96","last_deep_scrub_stamp":"2023-07-29T02:06:24.494142+0000","last_clean_scrub_stamp":"2023-07-29T02:06:24.494142+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:05:15.948297+0000","scrub_duration":0.001611838,"objects_trimmed":0,"snaptrim_duration":0.36182750899999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"39'688","reported_seq":2815,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:55.561116+0000","last_change":"2023-07-29T02:06:55.561244+0000","last_active":"2023-07-29T02:06:55.561116+0000","last_peered":"2023-07-29T02:06:55.561116+0000","last_clean":"2023-07-29T02:06:55.561116+0000","last_became_active":"2023-07-29T02:00:01.989151+0000","last_became_peered":"2023-07-29T02:00:01.989151+0000","last_unstale":"2023-07-29T02:06:55.561116+0000","last_undegraded":"2023-07-29T02:06:55.561116+0000","last_fullsized":"2023-07-29T02:06:55.561116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'688","last_scrub_stamp":"2023-07-29T02:06:55.561092+0000","last_deep_scrub":"39'688","last_deep_scrub_stamp":"2023-07-29T02:06:55.561092+0000","last_clean_scrub_stamp":"2023-07-29T02:06:55.561092+0000","objects_scrubbed":326,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:04:59.339522+0000","scrub_duration":0.13620000500000001,"objects_trimmed":0,"snaptrim_duration":0.54490939800000004,"stat_sum":{"num_bytes":33219663,"num_objects":326,"num_object_clones":0,"num_object_copies":1304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":326,"num_whiteouts":0,"num_read":40,"num_read_kb":16418,"num_write":687,"num_write_kb":40961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"39'196","reported_seq":241,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:34.174273+0000","last_change":"2023-07-29T02:06:34.174383+0000","last_active":"2023-07-29T02:06:34.174273+0000","last_peered":"2023-07-29T02:06:34.174273+0000","last_clean":"2023-07-29T02:06:34.174273+0000","last_became_active":"2023-07-29T01:59:57.544120+0000","last_became_peered":"2023-07-29T01:59:57.544120+0000","last_unstale":"2023-07-29T02:06:34.174273+0000","last_undegraded":"2023-07-29T02:06:34.174273+0000","last_fullsized":"2023-07-29T02:06:34.174273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'196","last_scrub_stamp":"2023-07-29T02:06:34.174245+0000","last_deep_scrub":"39'196","last_deep_scrub_stamp":"2023-07-29T02:06:34.174245+0000","last_clean_scrub_stamp":"2023-07-29T02:06:34.174245+0000","objects_scrubbed":5,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:18:24.878615+0000","scrub_duration":0.032465687999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":192,"num_write_kb":12401,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24074,"num_omap_keys":41,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"39'93","reported_seq":2156,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:13.480595+0000","last_change":"2023-07-29T02:07:13.480749+0000","last_active":"2023-07-29T02:07:13.480595+0000","last_peered":"2023-07-29T02:07:13.480595+0000","last_clean":"2023-07-29T02:07:13.480595+0000","last_became_active":"2023-07-29T01:59:57.961975+0000","last_became_peered":"2023-07-29T01:59:57.961975+0000","last_unstale":"2023-07-29T02:07:13.480595+0000","last_undegraded":"2023-07-29T02:07:13.480595+0000","last_fullsized":"2023-07-29T02:07:13.480595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'93","last_scrub_stamp":"2023-07-29T02:07:13.480566+0000","last_deep_scrub":"39'93","last_deep_scrub_stamp":"2023-07-29T02:07:13.480566+0000","last_clean_scrub_stamp":"2023-07-29T02:07:13.480566+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:21:39.493702+0000","scrub_duration":0.0020090049999999999,"objects_trimmed":0,"snaptrim_duration":0.37361334099999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"39'646","reported_seq":2775,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:04.744134+0000","last_change":"2023-07-29T02:07:04.744287+0000","last_active":"2023-07-29T02:07:04.744134+0000","last_peered":"2023-07-29T02:07:04.744134+0000","last_clean":"2023-07-29T02:07:04.744134+0000","last_became_active":"2023-07-29T02:00:01.988155+0000","last_became_peered":"2023-07-29T02:00:01.988155+0000","last_unstale":"2023-07-29T02:07:04.744134+0000","last_undegraded":"2023-07-29T02:07:04.744134+0000","last_fullsized":"2023-07-29T02:07:04.744134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'646","last_scrub_stamp":"2023-07-29T02:07:04.744110+0000","last_deep_scrub":"39'646","last_deep_scrub_stamp":"2023-07-29T02:07:04.744110+0000","last_clean_scrub_stamp":"2023-07-29T02:07:04.744110+0000","objects_scrubbed":313,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:48:31.554469+0000","scrub_duration":0.12450196600000001,"objects_trimmed":0,"snaptrim_duration":0.30982225000000002,"stat_sum":{"num_bytes":22073203,"num_objects":313,"num_object_clones":0,"num_object_copies":1252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":313,"num_whiteouts":0,"num_read":44,"num_read_kb":12328,"num_write":643,"num_write_kb":30077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"39'66","reported_seq":111,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:56.510348+0000","last_change":"2023-07-29T02:06:56.510436+0000","last_active":"2023-07-29T02:06:56.510348+0000","last_peered":"2023-07-29T02:06:56.510348+0000","last_clean":"2023-07-29T02:06:56.510348+0000","last_became_active":"2023-07-29T01:59:57.549470+0000","last_became_peered":"2023-07-29T01:59:57.549470+0000","last_unstale":"2023-07-29T02:06:56.510348+0000","last_undegraded":"2023-07-29T02:06:56.510348+0000","last_fullsized":"2023-07-29T02:06:56.510348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'66","last_scrub_stamp":"2023-07-29T02:06:56.510325+0000","last_deep_scrub":"39'66","last_deep_scrub_stamp":"2023-07-29T02:06:56.510325+0000","last_clean_scrub_stamp":"2023-07-29T02:06:56.510325+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:48:23.320684+0000","scrub_duration":0.010157708,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":64,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20398,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"39'65","reported_seq":2128,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:32.423044+0000","last_change":"2023-07-29T02:06:32.423044+0000","last_active":"2023-07-29T02:06:32.423044+0000","last_peered":"2023-07-29T02:06:32.423044+0000","last_clean":"2023-07-29T02:06:32.423044+0000","last_became_active":"2023-07-29T01:59:57.962016+0000","last_became_peered":"2023-07-29T01:59:57.962016+0000","last_unstale":"2023-07-29T02:06:32.423044+0000","last_undegraded":"2023-07-29T02:06:32.423044+0000","last_fullsized":"2023-07-29T02:06:32.423044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'65","last_scrub_stamp":"2023-07-29T02:06:32.422911+0000","last_deep_scrub":"39'65","last_deep_scrub_stamp":"2023-07-29T02:06:32.422911+0000","last_clean_scrub_stamp":"2023-07-29T02:06:32.422911+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:22.455833+0000","scrub_duration":0.0014239599999999999,"objects_trimmed":0,"snaptrim_duration":0.36599154900000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"39'565","reported_seq":2688,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:37.552524+0000","last_change":"2023-07-29T02:07:37.552712+0000","last_active":"2023-07-29T02:07:37.552524+0000","last_peered":"2023-07-29T02:07:37.552524+0000","last_clean":"2023-07-29T02:07:37.552524+0000","last_became_active":"2023-07-29T02:00:01.992042+0000","last_became_peered":"2023-07-29T02:00:01.992042+0000","last_unstale":"2023-07-29T02:07:37.552524+0000","last_undegraded":"2023-07-29T02:07:37.552524+0000","last_fullsized":"2023-07-29T02:07:37.552524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'565","last_scrub_stamp":"2023-07-29T02:07:37.552472+0000","last_deep_scrub":"39'565","last_deep_scrub_stamp":"2023-07-29T02:07:37.552472+0000","last_clean_scrub_stamp":"2023-07-29T02:07:37.552472+0000","objects_scrubbed":288,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:58:59.937829+0000","scrub_duration":0.107138597,"objects_trimmed":0,"snaptrim_duration":0.36734029699999998,"stat_sum":{"num_bytes":17472104,"num_objects":288,"num_object_clones":0,"num_object_copies":1152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":288,"num_whiteouts":0,"num_read":40,"num_read_kb":12324,"num_write":565,"num_write_kb":21394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"39'15","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:35.000137+0000","last_change":"2023-07-29T02:06:35.000254+0000","last_active":"2023-07-29T02:06:35.000137+0000","last_peered":"2023-07-29T02:06:35.000137+0000","last_clean":"2023-07-29T02:06:35.000137+0000","last_became_active":"2023-07-29T01:59:57.535762+0000","last_became_peered":"2023-07-29T01:59:57.535762+0000","last_unstale":"2023-07-29T02:06:35.000137+0000","last_undegraded":"2023-07-29T02:06:35.000137+0000","last_fullsized":"2023-07-29T02:06:35.000137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'15","last_scrub_stamp":"2023-07-29T02:06:35.000106+0000","last_deep_scrub":"39'15","last_deep_scrub_stamp":"2023-07-29T02:06:35.000106+0000","last_clean_scrub_stamp":"2023-07-29T02:06:35.000106+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:28.141195+0000","scrub_duration":0.010307169,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":13,"num_write_kb":4139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30910,"num_omap_keys":52,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"39'87","reported_seq":2150,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:39.329087+0000","last_change":"2023-07-29T02:06:39.329087+0000","last_active":"2023-07-29T02:06:39.329087+0000","last_peered":"2023-07-29T02:06:39.329087+0000","last_clean":"2023-07-29T02:06:39.329087+0000","last_became_active":"2023-07-29T01:59:57.974834+0000","last_became_peered":"2023-07-29T01:59:57.974834+0000","last_unstale":"2023-07-29T02:06:39.329087+0000","last_undegraded":"2023-07-29T02:06:39.329087+0000","last_fullsized":"2023-07-29T02:06:39.329087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'87","last_scrub_stamp":"2023-07-29T02:06:39.328959+0000","last_deep_scrub":"39'87","last_deep_scrub_stamp":"2023-07-29T02:06:39.328959+0000","last_clean_scrub_stamp":"2023-07-29T02:06:39.328959+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:54.373409+0000","scrub_duration":0.0016042369999999999,"objects_trimmed":0,"snaptrim_duration":0.53560260199999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"39'713","reported_seq":2832,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:31.527809+0000","last_change":"2023-07-29T02:07:31.527964+0000","last_active":"2023-07-29T02:07:31.527809+0000","last_peered":"2023-07-29T02:07:31.527809+0000","last_clean":"2023-07-29T02:07:31.527809+0000","last_became_active":"2023-07-29T02:00:01.990464+0000","last_became_peered":"2023-07-29T02:00:01.990464+0000","last_unstale":"2023-07-29T02:07:31.527809+0000","last_undegraded":"2023-07-29T02:07:31.527809+0000","last_fullsized":"2023-07-29T02:07:31.527809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'713","last_scrub_stamp":"2023-07-29T02:07:31.527784+0000","last_deep_scrub":"39'713","last_deep_scrub_stamp":"2023-07-29T02:07:31.527784+0000","last_clean_scrub_stamp":"2023-07-29T02:07:31.527784+0000","objects_scrubbed":363,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:25:44.224253+0000","scrub_duration":0.13626682200000001,"objects_trimmed":0,"snaptrim_duration":0.356278702,"stat_sum":{"num_bytes":25950589,"num_objects":363,"num_object_clones":0,"num_object_copies":1452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":363,"num_whiteouts":0,"num_read":30,"num_read_kb":4124,"num_write":712,"num_write_kb":29793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"39'166","reported_seq":216,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.989281+0000","last_change":"2023-07-29T02:06:41.989432+0000","last_active":"2023-07-29T02:06:41.989281+0000","last_peered":"2023-07-29T02:06:41.989281+0000","last_clean":"2023-07-29T02:06:41.989281+0000","last_became_active":"2023-07-29T01:59:57.540292+0000","last_became_peered":"2023-07-29T01:59:57.540292+0000","last_unstale":"2023-07-29T02:06:41.989281+0000","last_undegraded":"2023-07-29T02:06:41.989281+0000","last_fullsized":"2023-07-29T02:06:41.989281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'166","last_scrub_stamp":"2023-07-29T02:06:41.989234+0000","last_deep_scrub":"39'166","last_deep_scrub_stamp":"2023-07-29T02:06:41.989234+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.989234+0000","objects_scrubbed":4,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:33:15.850245+0000","scrub_duration":0.014136332,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":162,"num_write_kb":4206,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":20550,"num_omap_keys":35,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.534625+0000","last_change":"2023-07-29T02:06:41.534733+0000","last_active":"2023-07-29T02:06:41.534625+0000","last_peered":"2023-07-29T02:06:41.534625+0000","last_clean":"2023-07-29T02:06:41.534625+0000","last_became_active":"2023-07-29T01:59:52.447782+0000","last_became_peered":"2023-07-29T01:59:52.447782+0000","last_unstale":"2023-07-29T02:06:41.534625+0000","last_undegraded":"2023-07-29T02:06:41.534625+0000","last_fullsized":"2023-07-29T02:06:41.534625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:41.534599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:41.534599+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.534599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:58:31.380201+0000","scrub_duration":0.0019006699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"39'83","reported_seq":2146,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:30.896156+0000","last_change":"2023-07-29T02:06:30.896265+0000","last_active":"2023-07-29T02:06:30.896156+0000","last_peered":"2023-07-29T02:06:30.896156+0000","last_clean":"2023-07-29T02:06:30.896156+0000","last_became_active":"2023-07-29T01:59:57.966065+0000","last_became_peered":"2023-07-29T01:59:57.966065+0000","last_unstale":"2023-07-29T02:06:30.896156+0000","last_undegraded":"2023-07-29T02:06:30.896156+0000","last_fullsized":"2023-07-29T02:06:30.896156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'83","last_scrub_stamp":"2023-07-29T02:06:30.896126+0000","last_deep_scrub":"39'83","last_deep_scrub_stamp":"2023-07-29T02:06:30.896126+0000","last_clean_scrub_stamp":"2023-07-29T02:06:30.896126+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:20:45.940577+0000","scrub_duration":0.002183015,"objects_trimmed":0,"snaptrim_duration":0.37241656400000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"39'677","reported_seq":2811,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:04.217760+0000","last_change":"2023-07-29T02:07:04.217903+0000","last_active":"2023-07-29T02:07:04.217760+0000","last_peered":"2023-07-29T02:07:04.217760+0000","last_clean":"2023-07-29T02:07:04.217760+0000","last_became_active":"2023-07-29T02:00:01.995963+0000","last_became_peered":"2023-07-29T02:00:01.995963+0000","last_unstale":"2023-07-29T02:07:04.217760+0000","last_undegraded":"2023-07-29T02:07:04.217760+0000","last_fullsized":"2023-07-29T02:07:04.217760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'677","last_scrub_stamp":"2023-07-29T02:07:04.217731+0000","last_deep_scrub":"39'677","last_deep_scrub_stamp":"2023-07-29T02:07:04.217731+0000","last_clean_scrub_stamp":"2023-07-29T02:07:04.217731+0000","objects_scrubbed":332,"log_size":677,"log_dups_size":0,"ondisk_log_size":677,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T03:24:49.826082+0000","scrub_duration":0.119161874,"objects_trimmed":0,"snaptrim_duration":0.373304892,"stat_sum":{"num_bytes":14135733,"num_objects":332,"num_object_clones":0,"num_object_copies":1328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":332,"num_whiteouts":0,"num_read":47,"num_read_kb":4140,"num_write":679,"num_write_kb":14069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:32.905149+0000","last_change":"2023-07-29T02:06:32.905293+0000","last_active":"2023-07-29T02:06:32.905149+0000","last_peered":"2023-07-29T02:06:32.905149+0000","last_clean":"2023-07-29T02:06:32.905149+0000","last_became_active":"2023-07-29T01:59:52.445337+0000","last_became_peered":"2023-07-29T01:59:52.445337+0000","last_unstale":"2023-07-29T02:06:32.905149+0000","last_undegraded":"2023-07-29T02:06:32.905149+0000","last_fullsized":"2023-07-29T02:06:32.905149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:32.905103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:32.905103+0000","last_clean_scrub_stamp":"2023-07-29T02:06:32.905103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:30.420020+0000","scrub_duration":0.0019302989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"39'41","reported_seq":88,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:37.295159+0000","last_change":"2023-07-29T02:06:37.295159+0000","last_active":"2023-07-29T02:06:37.295159+0000","last_peered":"2023-07-29T02:06:37.295159+0000","last_clean":"2023-07-29T02:06:37.295159+0000","last_became_active":"2023-07-29T01:59:57.537581+0000","last_became_peered":"2023-07-29T01:59:57.537581+0000","last_unstale":"2023-07-29T02:06:37.295159+0000","last_undegraded":"2023-07-29T02:06:37.295159+0000","last_fullsized":"2023-07-29T02:06:37.295159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'40","last_scrub_stamp":"2023-07-29T02:06:37.294992+0000","last_deep_scrub":"39'40","last_deep_scrub_stamp":"2023-07-29T02:06:37.294992+0000","last_clean_scrub_stamp":"2023-07-29T02:06:37.294992+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:30.436081+0000","scrub_duration":0.0068420169999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":8,"num_write":86,"num_write_kb":1322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12080,"num_omap_keys":20,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"39'82","reported_seq":2145,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:03.469440+0000","last_change":"2023-07-29T02:07:03.469557+0000","last_active":"2023-07-29T02:07:03.469440+0000","last_peered":"2023-07-29T02:07:03.469440+0000","last_clean":"2023-07-29T02:07:03.469440+0000","last_became_active":"2023-07-29T01:59:57.961298+0000","last_became_peered":"2023-07-29T01:59:57.961298+0000","last_unstale":"2023-07-29T02:07:03.469440+0000","last_undegraded":"2023-07-29T02:07:03.469440+0000","last_fullsized":"2023-07-29T02:07:03.469440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'82","last_scrub_stamp":"2023-07-29T02:07:03.469410+0000","last_deep_scrub":"39'82","last_deep_scrub_stamp":"2023-07-29T02:07:03.469410+0000","last_clean_scrub_stamp":"2023-07-29T02:07:03.469410+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:12:12.974105+0000","scrub_duration":0.0016025049999999999,"objects_trimmed":0,"snaptrim_duration":0.35104021600000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"39'622","reported_seq":2742,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:08.752307+0000","last_change":"2023-07-29T02:07:08.752476+0000","last_active":"2023-07-29T02:07:08.752307+0000","last_peered":"2023-07-29T02:07:08.752307+0000","last_clean":"2023-07-29T02:07:08.752307+0000","last_became_active":"2023-07-29T02:00:01.986915+0000","last_became_peered":"2023-07-29T02:00:01.986915+0000","last_unstale":"2023-07-29T02:07:08.752307+0000","last_undegraded":"2023-07-29T02:07:08.752307+0000","last_fullsized":"2023-07-29T02:07:08.752307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'622","last_scrub_stamp":"2023-07-29T02:07:08.752283+0000","last_deep_scrub":"39'622","last_deep_scrub_stamp":"2023-07-29T02:07:08.752283+0000","last_clean_scrub_stamp":"2023-07-29T02:07:08.752283+0000","objects_scrubbed":291,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:06:26.461115+0000","scrub_duration":0.11089104,"objects_trimmed":0,"snaptrim_duration":0.30985112500000001,"stat_sum":{"num_bytes":28815426,"num_objects":291,"num_object_clones":0,"num_object_copies":1164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":291,"num_whiteouts":0,"num_read":37,"num_read_kb":4131,"num_write":621,"num_write_kb":32518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:23.105634+0000","last_change":"2023-07-29T02:06:23.105717+0000","last_active":"2023-07-29T02:06:23.105634+0000","last_peered":"2023-07-29T02:06:23.105634+0000","last_clean":"2023-07-29T02:06:23.105634+0000","last_became_active":"2023-07-29T01:59:52.448052+0000","last_became_peered":"2023-07-29T01:59:52.448052+0000","last_unstale":"2023-07-29T02:06:23.105634+0000","last_undegraded":"2023-07-29T02:06:23.105634+0000","last_fullsized":"2023-07-29T02:06:23.105634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:23.105612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:23.105612+0000","last_clean_scrub_stamp":"2023-07-29T02:06:23.105612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:01:13.810307+0000","scrub_duration":0.0019361350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"39'119","reported_seq":199,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:34.526309+0000","last_change":"2023-07-29T02:06:34.526427+0000","last_active":"2023-07-29T02:06:34.526309+0000","last_peered":"2023-07-29T02:06:34.526309+0000","last_clean":"2023-07-29T02:06:34.526309+0000","last_became_active":"2023-07-29T01:59:52.449582+0000","last_became_peered":"2023-07-29T01:59:52.449582+0000","last_unstale":"2023-07-29T02:06:34.526309+0000","last_undegraded":"2023-07-29T02:06:34.526309+0000","last_fullsized":"2023-07-29T02:06:34.526309+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2023-07-29T02:06:34.526281+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2023-07-29T02:06:34.526281+0000","last_clean_scrub_stamp":"2023-07-29T02:06:34.526281+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:54.496650+0000","scrub_duration":0.0069852009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"39'67","reported_seq":177,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:31.365346+0000","last_change":"2023-07-29T02:06:31.365465+0000","last_active":"2023-07-29T02:06:31.365346+0000","last_peered":"2023-07-29T02:06:31.365346+0000","last_clean":"2023-07-29T02:06:31.365346+0000","last_became_active":"2023-07-29T01:59:57.546179+0000","last_became_peered":"2023-07-29T01:59:57.546179+0000","last_unstale":"2023-07-29T02:06:31.365346+0000","last_undegraded":"2023-07-29T02:06:31.365346+0000","last_fullsized":"2023-07-29T02:06:31.365346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'67","last_scrub_stamp":"2023-07-29T02:06:31.365318+0000","last_deep_scrub":"39'67","last_deep_scrub_stamp":"2023-07-29T02:06:31.365318+0000","last_clean_scrub_stamp":"2023-07-29T02:06:31.365318+0000","objects_scrubbed":1,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:34.619227+0000","scrub_duration":0.0034459820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":576264,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":66,"num_read_kb":610,"num_write":65,"num_write_kb":610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"39'93","reported_seq":2156,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:27.316704+0000","last_change":"2023-07-29T02:06:27.316704+0000","last_active":"2023-07-29T02:06:27.316704+0000","last_peered":"2023-07-29T02:06:27.316704+0000","last_clean":"2023-07-29T02:06:27.316704+0000","last_became_active":"2023-07-29T01:59:57.975078+0000","last_became_peered":"2023-07-29T01:59:57.975078+0000","last_unstale":"2023-07-29T02:06:27.316704+0000","last_undegraded":"2023-07-29T02:06:27.316704+0000","last_fullsized":"2023-07-29T02:06:27.316704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'93","last_scrub_stamp":"2023-07-29T02:06:27.316579+0000","last_deep_scrub":"39'93","last_deep_scrub_stamp":"2023-07-29T02:06:27.316579+0000","last_clean_scrub_stamp":"2023-07-29T02:06:27.316579+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:22.434730+0000","scrub_duration":0.0015657690000000001,"objects_trimmed":0,"snaptrim_duration":0.55319968200000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"39'709","reported_seq":2846,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:46.161104+0000","last_change":"2023-07-29T02:06:46.161289+0000","last_active":"2023-07-29T02:06:46.161104+0000","last_peered":"2023-07-29T02:06:46.161104+0000","last_clean":"2023-07-29T02:06:46.161104+0000","last_became_active":"2023-07-29T02:00:01.986937+0000","last_became_peered":"2023-07-29T02:00:01.986937+0000","last_unstale":"2023-07-29T02:06:46.161104+0000","last_undegraded":"2023-07-29T02:06:46.161104+0000","last_fullsized":"2023-07-29T02:06:46.161104+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'709","last_scrub_stamp":"2023-07-29T02:06:46.161057+0000","last_deep_scrub":"39'709","last_deep_scrub_stamp":"2023-07-29T02:06:46.161057+0000","last_clean_scrub_stamp":"2023-07-29T02:06:46.161057+0000","objects_scrubbed":344,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:39.302145+0000","scrub_duration":0.14397623400000001,"objects_trimmed":2,"snaptrim_duration":0.47715394799999999,"stat_sum":{"num_bytes":40554601,"num_objects":344,"num_object_clones":0,"num_object_copies":1376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":344,"num_whiteouts":0,"num_read":51,"num_read_kb":15453,"num_write":703,"num_write_kb":39978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:28.531585+0000","last_change":"2023-07-29T02:06:28.531707+0000","last_active":"2023-07-29T02:06:28.531585+0000","last_peered":"2023-07-29T02:06:28.531585+0000","last_clean":"2023-07-29T02:06:28.531585+0000","last_became_active":"2023-07-29T01:59:53.171467+0000","last_became_peered":"2023-07-29T01:59:53.171467+0000","last_unstale":"2023-07-29T02:06:28.531585+0000","last_undegraded":"2023-07-29T02:06:28.531585+0000","last_fullsized":"2023-07-29T02:06:28.531585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:28.531559+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:28.531559+0000","last_clean_scrub_stamp":"2023-07-29T02:06:28.531559+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T12:01:40.717070+0000","scrub_duration":0.0018899190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"39'254","reported_seq":302,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:29.161357+0000","last_change":"2023-07-29T02:06:29.161511+0000","last_active":"2023-07-29T02:06:29.161357+0000","last_peered":"2023-07-29T02:06:29.161357+0000","last_clean":"2023-07-29T02:06:29.161357+0000","last_became_active":"2023-07-29T01:59:57.549151+0000","last_became_peered":"2023-07-29T01:59:57.549151+0000","last_unstale":"2023-07-29T02:06:29.161357+0000","last_undegraded":"2023-07-29T02:06:29.161357+0000","last_fullsized":"2023-07-29T02:06:29.161357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'254","last_scrub_stamp":"2023-07-29T02:06:29.161311+0000","last_deep_scrub":"39'254","last_deep_scrub_stamp":"2023-07-29T02:06:29.161311+0000","last_clean_scrub_stamp":"2023-07-29T02:06:29.161311+0000","objects_scrubbed":5,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:18:19.865681+0000","scrub_duration":0.023803841999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":11035,"num_write":246,"num_write_kb":12456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25322,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"39'88","reported_seq":2151,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:37.239617+0000","last_change":"2023-07-29T02:06:37.239734+0000","last_active":"2023-07-29T02:06:37.239617+0000","last_peered":"2023-07-29T02:06:37.239617+0000","last_clean":"2023-07-29T02:06:37.239617+0000","last_became_active":"2023-07-29T01:59:57.969273+0000","last_became_peered":"2023-07-29T01:59:57.969273+0000","last_unstale":"2023-07-29T02:06:37.239617+0000","last_undegraded":"2023-07-29T02:06:37.239617+0000","last_fullsized":"2023-07-29T02:06:37.239617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'88","last_scrub_stamp":"2023-07-29T02:06:37.239591+0000","last_deep_scrub":"39'88","last_deep_scrub_stamp":"2023-07-29T02:06:37.239591+0000","last_clean_scrub_stamp":"2023-07-29T02:06:37.239591+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:40.493500+0000","scrub_duration":0.0016482389999999999,"objects_trimmed":0,"snaptrim_duration":0.53741308300000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"39'639","reported_seq":2756,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:53.677441+0000","last_change":"2023-07-29T02:06:53.677598+0000","last_active":"2023-07-29T02:06:53.677441+0000","last_peered":"2023-07-29T02:06:53.677441+0000","last_clean":"2023-07-29T02:06:53.677441+0000","last_became_active":"2023-07-29T02:00:01.992406+0000","last_became_peered":"2023-07-29T02:00:01.992406+0000","last_unstale":"2023-07-29T02:06:53.677441+0000","last_undegraded":"2023-07-29T02:06:53.677441+0000","last_fullsized":"2023-07-29T02:06:53.677441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'639","last_scrub_stamp":"2023-07-29T02:06:53.677416+0000","last_deep_scrub":"39'639","last_deep_scrub_stamp":"2023-07-29T02:06:53.677416+0000","last_clean_scrub_stamp":"2023-07-29T02:06:53.677416+0000","objects_scrubbed":323,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:06:50.762214+0000","scrub_duration":0.120386481,"objects_trimmed":0,"snaptrim_duration":0.18856821800000001,"stat_sum":{"num_bytes":24792794,"num_objects":323,"num_object_clones":0,"num_object_copies":1292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":323,"num_whiteouts":0,"num_read":32,"num_read_kb":11492,"num_write":639,"num_write_kb":27823,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:33.505179+0000","last_change":"2023-07-29T02:06:33.505289+0000","last_active":"2023-07-29T02:06:33.505179+0000","last_peered":"2023-07-29T02:06:33.505179+0000","last_clean":"2023-07-29T02:06:33.505179+0000","last_became_active":"2023-07-29T01:59:53.171440+0000","last_became_peered":"2023-07-29T01:59:53.171440+0000","last_unstale":"2023-07-29T02:06:33.505179+0000","last_undegraded":"2023-07-29T02:06:33.505179+0000","last_fullsized":"2023-07-29T02:06:33.505179+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:33.505144+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:33.505144+0000","last_clean_scrub_stamp":"2023-07-29T02:06:33.505144+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:28.623295+0000","scrub_duration":0.0017891820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"39'8","reported_seq":54,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:37.053724+0000","last_change":"2023-07-29T02:06:37.053856+0000","last_active":"2023-07-29T02:06:37.053724+0000","last_peered":"2023-07-29T02:06:37.053724+0000","last_clean":"2023-07-29T02:06:37.053724+0000","last_became_active":"2023-07-29T01:59:57.537665+0000","last_became_peered":"2023-07-29T01:59:57.537665+0000","last_unstale":"2023-07-29T02:06:37.053724+0000","last_undegraded":"2023-07-29T02:06:37.053724+0000","last_fullsized":"2023-07-29T02:06:37.053724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'8","last_scrub_stamp":"2023-07-29T02:06:37.053696+0000","last_deep_scrub":"39'8","last_deep_scrub_stamp":"2023-07-29T02:06:37.053696+0000","last_clean_scrub_stamp":"2023-07-29T02:06:37.053696+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:12:59.646704+0000","scrub_duration":0.016447590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":4,"num_write_kb":8199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6040,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"39'84","reported_seq":2147,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:50.033127+0000","last_change":"2023-07-29T02:06:50.033280+0000","last_active":"2023-07-29T02:06:50.033127+0000","last_peered":"2023-07-29T02:06:50.033127+0000","last_clean":"2023-07-29T02:06:50.033127+0000","last_became_active":"2023-07-29T01:59:57.968373+0000","last_became_peered":"2023-07-29T01:59:57.968373+0000","last_unstale":"2023-07-29T02:06:50.033127+0000","last_undegraded":"2023-07-29T02:06:50.033127+0000","last_fullsized":"2023-07-29T02:06:50.033127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'84","last_scrub_stamp":"2023-07-29T02:06:50.033099+0000","last_deep_scrub":"39'84","last_deep_scrub_stamp":"2023-07-29T02:06:50.033099+0000","last_clean_scrub_stamp":"2023-07-29T02:06:50.033099+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:39:43.174188+0000","scrub_duration":0.001497473,"objects_trimmed":0,"snaptrim_duration":0.21661398800000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"39'634","reported_seq":2759,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:12.387123+0000","last_change":"2023-07-29T02:07:12.387306+0000","last_active":"2023-07-29T02:07:12.387123+0000","last_peered":"2023-07-29T02:07:12.387123+0000","last_clean":"2023-07-29T02:07:12.387123+0000","last_became_active":"2023-07-29T02:00:01.984476+0000","last_became_peered":"2023-07-29T02:00:01.984476+0000","last_unstale":"2023-07-29T02:07:12.387123+0000","last_undegraded":"2023-07-29T02:07:12.387123+0000","last_fullsized":"2023-07-29T02:07:12.387123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'634","last_scrub_stamp":"2023-07-29T02:07:12.387078+0000","last_deep_scrub":"39'634","last_deep_scrub_stamp":"2023-07-29T02:07:12.387078+0000","last_clean_scrub_stamp":"2023-07-29T02:07:12.387078+0000","objects_scrubbed":339,"log_size":634,"log_dups_size":0,"ondisk_log_size":634,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T04:12:21.891773+0000","scrub_duration":0.144005365,"objects_trimmed":0,"snaptrim_duration":0.55548792300000005,"stat_sum":{"num_bytes":35592378,"num_objects":339,"num_object_clones":0,"num_object_copies":1356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":339,"num_whiteouts":0,"num_read":38,"num_read_kb":16563,"num_write":635,"num_write_kb":39103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:34.723044+0000","last_change":"2023-07-29T02:06:34.723187+0000","last_active":"2023-07-29T02:06:34.723044+0000","last_peered":"2023-07-29T02:06:34.723044+0000","last_clean":"2023-07-29T02:06:34.723044+0000","last_became_active":"2023-07-29T01:59:53.171617+0000","last_became_peered":"2023-07-29T01:59:53.171617+0000","last_unstale":"2023-07-29T02:06:34.723044+0000","last_undegraded":"2023-07-29T02:06:34.723044+0000","last_fullsized":"2023-07-29T02:06:34.723044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:34.723018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:34.723018+0000","last_clean_scrub_stamp":"2023-07-29T02:06:34.723018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:37.976927+0000","scrub_duration":0.0020343689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"39'22","reported_seq":66,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:02.481326+0000","last_change":"2023-07-29T02:07:02.481441+0000","last_active":"2023-07-29T02:07:02.481326+0000","last_peered":"2023-07-29T02:07:02.481326+0000","last_clean":"2023-07-29T02:07:02.481326+0000","last_became_active":"2023-07-29T01:59:57.540449+0000","last_became_peered":"2023-07-29T01:59:57.540449+0000","last_unstale":"2023-07-29T02:07:02.481326+0000","last_undegraded":"2023-07-29T02:07:02.481326+0000","last_fullsized":"2023-07-29T02:07:02.481326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'22","last_scrub_stamp":"2023-07-29T02:07:02.481294+0000","last_deep_scrub":"39'22","last_deep_scrub_stamp":"2023-07-29T02:07:02.481294+0000","last_clean_scrub_stamp":"2023-07-29T02:07:02.481294+0000","objects_scrubbed":8,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:50:08.265414+0000","scrub_duration":0.014142849000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":67930,"num_omap_keys":113,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"39'91","reported_seq":2154,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.383474+0000","last_change":"2023-07-29T02:06:41.383581+0000","last_active":"2023-07-29T02:06:41.383474+0000","last_peered":"2023-07-29T02:06:41.383474+0000","last_clean":"2023-07-29T02:06:41.383474+0000","last_became_active":"2023-07-29T01:59:57.967933+0000","last_became_peered":"2023-07-29T01:59:57.967933+0000","last_unstale":"2023-07-29T02:06:41.383474+0000","last_undegraded":"2023-07-29T02:06:41.383474+0000","last_fullsized":"2023-07-29T02:06:41.383474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'91","last_scrub_stamp":"2023-07-29T02:06:41.383445+0000","last_deep_scrub":"39'91","last_deep_scrub_stamp":"2023-07-29T02:06:41.383445+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.383445+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:38.898362+0000","scrub_duration":0.001572709,"objects_trimmed":0,"snaptrim_duration":0.54069509900000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"39'665","reported_seq":2787,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:55.193248+0000","last_change":"2023-07-29T02:06:55.193374+0000","last_active":"2023-07-29T02:06:55.193248+0000","last_peered":"2023-07-29T02:06:55.193248+0000","last_clean":"2023-07-29T02:06:55.193248+0000","last_became_active":"2023-07-29T02:00:01.984691+0000","last_became_peered":"2023-07-29T02:00:01.984691+0000","last_unstale":"2023-07-29T02:06:55.193248+0000","last_undegraded":"2023-07-29T02:06:55.193248+0000","last_fullsized":"2023-07-29T02:06:55.193248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'665","last_scrub_stamp":"2023-07-29T02:06:55.193222+0000","last_deep_scrub":"39'665","last_deep_scrub_stamp":"2023-07-29T02:06:55.193222+0000","last_clean_scrub_stamp":"2023-07-29T02:06:55.193222+0000","objects_scrubbed":316,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:38:45.226144+0000","scrub_duration":0.11315589700000001,"objects_trimmed":0,"snaptrim_duration":0.204776021,"stat_sum":{"num_bytes":24859419,"num_objects":316,"num_object_clones":0,"num_object_copies":1264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":316,"num_whiteouts":0,"num_read":37,"num_read_kb":6702,"num_write":664,"num_write_kb":28713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:32.106823+0000","last_change":"2023-07-29T02:06:32.106957+0000","last_active":"2023-07-29T02:06:32.106823+0000","last_peered":"2023-07-29T02:06:32.106823+0000","last_clean":"2023-07-29T02:06:32.106823+0000","last_became_active":"2023-07-29T01:59:53.171463+0000","last_became_peered":"2023-07-29T01:59:53.171463+0000","last_unstale":"2023-07-29T02:06:32.106823+0000","last_undegraded":"2023-07-29T02:06:32.106823+0000","last_fullsized":"2023-07-29T02:06:32.106823+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:32.106799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:32.106799+0000","last_clean_scrub_stamp":"2023-07-29T02:06:32.106799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:14:45.683196+0000","scrub_duration":0.0021981660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"39'9","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:33.194543+0000","last_change":"2023-07-29T02:06:33.194659+0000","last_active":"2023-07-29T02:06:33.194543+0000","last_peered":"2023-07-29T02:06:33.194543+0000","last_clean":"2023-07-29T02:06:33.194543+0000","last_became_active":"2023-07-29T01:59:57.549181+0000","last_became_peered":"2023-07-29T01:59:57.549181+0000","last_unstale":"2023-07-29T02:06:33.194543+0000","last_undegraded":"2023-07-29T02:06:33.194543+0000","last_fullsized":"2023-07-29T02:06:33.194543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'9","last_scrub_stamp":"2023-07-29T02:06:33.194518+0000","last_deep_scrub":"39'9","last_deep_scrub_stamp":"2023-07-29T02:06:33.194518+0000","last_clean_scrub_stamp":"2023-07-29T02:06:33.194518+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T10:59:28.312669+0000","scrub_duration":0.0098727299999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11674,"num_omap_keys":20,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"39'97","reported_seq":2160,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:28.363951+0000","last_change":"2023-07-29T02:06:28.364094+0000","last_active":"2023-07-29T02:06:28.363951+0000","last_peered":"2023-07-29T02:06:28.363951+0000","last_clean":"2023-07-29T02:06:28.363951+0000","last_became_active":"2023-07-29T01:59:57.963659+0000","last_became_peered":"2023-07-29T01:59:57.963659+0000","last_unstale":"2023-07-29T02:06:28.363951+0000","last_undegraded":"2023-07-29T02:06:28.363951+0000","last_fullsized":"2023-07-29T02:06:28.363951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'97","last_scrub_stamp":"2023-07-29T02:06:28.363914+0000","last_deep_scrub":"39'97","last_deep_scrub_stamp":"2023-07-29T02:06:28.363914+0000","last_clean_scrub_stamp":"2023-07-29T02:06:28.363914+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:48.334283+0000","scrub_duration":0.001843236,"objects_trimmed":0,"snaptrim_duration":0.55193447900000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"39'682","reported_seq":2807,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:10.408081+0000","last_change":"2023-07-29T02:07:10.408227+0000","last_active":"2023-07-29T02:07:10.408081+0000","last_peered":"2023-07-29T02:07:10.408081+0000","last_clean":"2023-07-29T02:07:10.408081+0000","last_became_active":"2023-07-29T02:00:01.983744+0000","last_became_peered":"2023-07-29T02:00:01.983744+0000","last_unstale":"2023-07-29T02:07:10.408081+0000","last_undegraded":"2023-07-29T02:07:10.408081+0000","last_fullsized":"2023-07-29T02:07:10.408081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'682","last_scrub_stamp":"2023-07-29T02:07:10.408058+0000","last_deep_scrub":"39'682","last_deep_scrub_stamp":"2023-07-29T02:07:10.408058+0000","last_clean_scrub_stamp":"2023-07-29T02:07:10.408058+0000","objects_scrubbed":318,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:50:16.192178+0000","scrub_duration":0.13696924599999999,"objects_trimmed":0,"snaptrim_duration":0.552203522,"stat_sum":{"num_bytes":32278530,"num_objects":318,"num_object_clones":0,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":318,"num_whiteouts":0,"num_read":40,"num_read_kb":16416,"num_write":683,"num_write_kb":31830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:28.151338+0000","last_change":"2023-07-29T02:06:28.151465+0000","last_active":"2023-07-29T02:06:28.151338+0000","last_peered":"2023-07-29T02:06:28.151338+0000","last_clean":"2023-07-29T02:06:28.151338+0000","last_became_active":"2023-07-29T01:59:52.448814+0000","last_became_peered":"2023-07-29T01:59:52.448814+0000","last_unstale":"2023-07-29T02:06:28.151338+0000","last_undegraded":"2023-07-29T02:06:28.151338+0000","last_fullsized":"2023-07-29T02:06:28.151338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-29T02:06:28.151312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-29T02:06:28.151312+0000","last_clean_scrub_stamp":"2023-07-29T02:06:28.151312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:01:18.856007+0000","scrub_duration":0.0019737660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"39'428","reported_seq":473,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:38.773403+0000","last_change":"2023-07-29T02:06:38.773525+0000","last_active":"2023-07-29T02:06:38.773403+0000","last_peered":"2023-07-29T02:06:38.773403+0000","last_clean":"2023-07-29T02:06:38.773403+0000","last_became_active":"2023-07-29T01:59:57.544317+0000","last_became_peered":"2023-07-29T01:59:57.544317+0000","last_unstale":"2023-07-29T02:06:38.773403+0000","last_undegraded":"2023-07-29T02:06:38.773403+0000","last_fullsized":"2023-07-29T02:06:38.773403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'428","last_scrub_stamp":"2023-07-29T02:06:38.773375+0000","last_deep_scrub":"39'428","last_deep_scrub_stamp":"2023-07-29T02:06:38.773375+0000","last_clean_scrub_stamp":"2023-07-29T02:06:38.773375+0000","objects_scrubbed":3,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:36.288292+0000","scrub_duration":0.023010361,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":424,"num_write_kb":8458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"39'90","reported_seq":2153,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:34.198334+0000","last_change":"2023-07-29T02:06:34.198474+0000","last_active":"2023-07-29T02:06:34.198334+0000","last_peered":"2023-07-29T02:06:34.198334+0000","last_clean":"2023-07-29T02:06:34.198334+0000","last_became_active":"2023-07-29T01:59:57.969642+0000","last_became_peered":"2023-07-29T01:59:57.969642+0000","last_unstale":"2023-07-29T02:06:34.198334+0000","last_undegraded":"2023-07-29T02:06:34.198334+0000","last_fullsized":"2023-07-29T02:06:34.198334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'90","last_scrub_stamp":"2023-07-29T02:06:34.198306+0000","last_deep_scrub":"39'90","last_deep_scrub_stamp":"2023-07-29T02:06:34.198306+0000","last_clean_scrub_stamp":"2023-07-29T02:06:34.198306+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:32:54.168675+0000","scrub_duration":0.0019970069999999999,"objects_trimmed":0,"snaptrim_duration":0.53741660000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"39'637","reported_seq":2767,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:52.533376+0000","last_change":"2023-07-29T02:06:52.533376+0000","last_active":"2023-07-29T02:06:52.533376+0000","last_peered":"2023-07-29T02:06:52.533376+0000","last_clean":"2023-07-29T02:06:52.533376+0000","last_became_active":"2023-07-29T02:00:01.998715+0000","last_became_peered":"2023-07-29T02:00:01.998715+0000","last_unstale":"2023-07-29T02:06:52.533376+0000","last_undegraded":"2023-07-29T02:06:52.533376+0000","last_fullsized":"2023-07-29T02:06:52.533376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'637","last_scrub_stamp":"2023-07-29T02:06:52.533107+0000","last_deep_scrub":"39'637","last_deep_scrub_stamp":"2023-07-29T02:06:52.533107+0000","last_clean_scrub_stamp":"2023-07-29T02:06:52.533107+0000","objects_scrubbed":317,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:53:35.163365+0000","scrub_duration":0.114413124,"objects_trimmed":0,"snaptrim_duration":0.54131381700000003,"stat_sum":{"num_bytes":21401745,"num_objects":317,"num_object_clones":0,"num_object_copies":1268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":317,"num_whiteouts":0,"num_read":45,"num_read_kb":12330,"num_write":635,"num_write_kb":33528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"39'140","reported_seq":185,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:38.331785+0000","last_change":"2023-07-29T02:06:38.331785+0000","last_active":"2023-07-29T02:06:38.331785+0000","last_peered":"2023-07-29T02:06:38.331785+0000","last_clean":"2023-07-29T02:06:38.331785+0000","last_became_active":"2023-07-29T01:59:57.545744+0000","last_became_peered":"2023-07-29T01:59:57.545744+0000","last_unstale":"2023-07-29T02:06:38.331785+0000","last_undegraded":"2023-07-29T02:06:38.331785+0000","last_fullsized":"2023-07-29T02:06:38.331785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'140","last_scrub_stamp":"2023-07-29T02:06:38.331635+0000","last_deep_scrub":"39'140","last_deep_scrub_stamp":"2023-07-29T02:06:38.331635+0000","last_clean_scrub_stamp":"2023-07-29T02:06:38.331635+0000","objects_scrubbed":4,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:16.541693+0000","scrub_duration":0.014197192000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":139,"num_write_kb":4274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22538,"num_omap_keys":38,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"39'92","reported_seq":2155,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:29.765521+0000","last_change":"2023-07-29T02:06:29.765521+0000","last_active":"2023-07-29T02:06:29.765521+0000","last_peered":"2023-07-29T02:06:29.765521+0000","last_clean":"2023-07-29T02:06:29.765521+0000","last_became_active":"2023-07-29T01:59:57.970252+0000","last_became_peered":"2023-07-29T01:59:57.970252+0000","last_unstale":"2023-07-29T02:06:29.765521+0000","last_undegraded":"2023-07-29T02:06:29.765521+0000","last_fullsized":"2023-07-29T02:06:29.765521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'92","last_scrub_stamp":"2023-07-29T02:06:29.765372+0000","last_deep_scrub":"39'92","last_deep_scrub_stamp":"2023-07-29T02:06:29.765372+0000","last_clean_scrub_stamp":"2023-07-29T02:06:29.765372+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:59:27.382387+0000","scrub_duration":0.0016174830000000001,"objects_trimmed":0,"snaptrim_duration":0.46822948199999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"39'637","reported_seq":2760,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:15.656581+0000","last_change":"2023-07-29T02:07:15.656581+0000","last_active":"2023-07-29T02:07:15.656581+0000","last_peered":"2023-07-29T02:07:15.656581+0000","last_clean":"2023-07-29T02:07:15.656581+0000","last_became_active":"2023-07-29T02:00:01.989481+0000","last_became_peered":"2023-07-29T02:00:01.989481+0000","last_unstale":"2023-07-29T02:07:15.656581+0000","last_undegraded":"2023-07-29T02:07:15.656581+0000","last_fullsized":"2023-07-29T02:07:15.656581+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'637","last_scrub_stamp":"2023-07-29T02:07:15.656424+0000","last_deep_scrub":"39'637","last_deep_scrub_stamp":"2023-07-29T02:07:15.656424+0000","last_clean_scrub_stamp":"2023-07-29T02:07:15.656424+0000","objects_scrubbed":309,"log_size":637,"log_dups_size":0,"ondisk_log_size":637,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:06:33.365257+0000","scrub_duration":0.124947748,"objects_trimmed":0,"snaptrim_duration":0.187630984,"stat_sum":{"num_bytes":25047033,"num_objects":309,"num_object_clones":0,"num_object_copies":1236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":309,"num_whiteouts":0,"num_read":38,"num_read_kb":8227,"num_write":637,"num_write_kb":24796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"39'117","reported_seq":167,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:41.700574+0000","last_change":"2023-07-29T02:06:41.700574+0000","last_active":"2023-07-29T02:06:41.700574+0000","last_peered":"2023-07-29T02:06:41.700574+0000","last_clean":"2023-07-29T02:06:41.700574+0000","last_became_active":"2023-07-29T01:59:57.543445+0000","last_became_peered":"2023-07-29T01:59:57.543445+0000","last_unstale":"2023-07-29T02:06:41.700574+0000","last_undegraded":"2023-07-29T02:06:41.700574+0000","last_fullsized":"2023-07-29T02:06:41.700574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'117","last_scrub_stamp":"2023-07-29T02:06:41.700441+0000","last_deep_scrub":"39'117","last_deep_scrub_stamp":"2023-07-29T02:06:41.700441+0000","last_clean_scrub_stamp":"2023-07-29T02:06:41.700441+0000","objects_scrubbed":5,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:19.910499+0000","scrub_duration":0.011827798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":4111,"num_write":114,"num_write_kb":4208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":38984,"num_omap_keys":65,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"39'90","reported_seq":2153,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:28.472340+0000","last_change":"2023-07-29T02:06:28.472340+0000","last_active":"2023-07-29T02:06:28.472340+0000","last_peered":"2023-07-29T02:06:28.472340+0000","last_clean":"2023-07-29T02:06:28.472340+0000","last_became_active":"2023-07-29T01:59:57.964925+0000","last_became_peered":"2023-07-29T01:59:57.964925+0000","last_unstale":"2023-07-29T02:06:28.472340+0000","last_undegraded":"2023-07-29T02:06:28.472340+0000","last_fullsized":"2023-07-29T02:06:28.472340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'90","last_scrub_stamp":"2023-07-29T02:06:28.472178+0000","last_deep_scrub":"39'90","last_deep_scrub_stamp":"2023-07-29T02:06:28.472178+0000","last_clean_scrub_stamp":"2023-07-29T02:06:28.472178+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:06.682236+0000","scrub_duration":0.0018172119999999999,"objects_trimmed":0,"snaptrim_duration":0.35003659399999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"39'665","reported_seq":2787,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:12.747062+0000","last_change":"2023-07-29T02:07:12.747062+0000","last_active":"2023-07-29T02:07:12.747062+0000","last_peered":"2023-07-29T02:07:12.747062+0000","last_clean":"2023-07-29T02:07:12.747062+0000","last_became_active":"2023-07-29T02:00:01.985310+0000","last_became_peered":"2023-07-29T02:00:01.985310+0000","last_unstale":"2023-07-29T02:07:12.747062+0000","last_undegraded":"2023-07-29T02:07:12.747062+0000","last_fullsized":"2023-07-29T02:07:12.747062+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'665","last_scrub_stamp":"2023-07-29T02:07:12.746919+0000","last_deep_scrub":"39'665","last_deep_scrub_stamp":"2023-07-29T02:07:12.746919+0000","last_clean_scrub_stamp":"2023-07-29T02:07:12.746919+0000","objects_scrubbed":304,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:04:40.988936+0000","scrub_duration":0.12251861,"objects_trimmed":0,"snaptrim_duration":0.31035642899999999,"stat_sum":{"num_bytes":19557603,"num_objects":304,"num_object_clones":0,"num_object_copies":1216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":304,"num_whiteouts":0,"num_read":36,"num_read_kb":35,"num_write":665,"num_write_kb":19402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"39'94","reported_seq":146,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:42.709432+0000","last_change":"2023-07-29T02:06:42.709432+0000","last_active":"2023-07-29T02:06:42.709432+0000","last_peered":"2023-07-29T02:06:42.709432+0000","last_clean":"2023-07-29T02:06:42.709432+0000","last_became_active":"2023-07-29T01:59:57.541633+0000","last_became_peered":"2023-07-29T01:59:57.541633+0000","last_unstale":"2023-07-29T02:06:42.709432+0000","last_undegraded":"2023-07-29T02:06:42.709432+0000","last_fullsized":"2023-07-29T02:06:42.709432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'94","last_scrub_stamp":"2023-07-29T02:06:42.709271+0000","last_deep_scrub":"39'94","last_deep_scrub_stamp":"2023-07-29T02:06:42.709271+0000","last_clean_scrub_stamp":"2023-07-29T02:06:42.709271+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:13:05.302279+0000","scrub_duration":0.032654646000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":18,"num_read_kb":12303,"num_write":84,"num_write_kb":16462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":29892,"num_omap_keys":51,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"39'85","reported_seq":2148,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:26.458592+0000","last_change":"2023-07-29T02:06:26.458592+0000","last_active":"2023-07-29T02:06:26.458592+0000","last_peered":"2023-07-29T02:06:26.458592+0000","last_clean":"2023-07-29T02:06:26.458592+0000","last_became_active":"2023-07-29T01:59:57.965383+0000","last_became_peered":"2023-07-29T01:59:57.965383+0000","last_unstale":"2023-07-29T02:06:26.458592+0000","last_undegraded":"2023-07-29T02:06:26.458592+0000","last_fullsized":"2023-07-29T02:06:26.458592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'85","last_scrub_stamp":"2023-07-29T02:06:26.458409+0000","last_deep_scrub":"39'85","last_deep_scrub_stamp":"2023-07-29T02:06:26.458409+0000","last_clean_scrub_stamp":"2023-07-29T02:06:26.458409+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:41:23.973325+0000","scrub_duration":0.0020203869999999998,"objects_trimmed":0,"snaptrim_duration":0.352110162,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"39'676","reported_seq":2802,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:32.494163+0000","last_change":"2023-07-29T02:07:32.494333+0000","last_active":"2023-07-29T02:07:32.494163+0000","last_peered":"2023-07-29T02:07:32.494163+0000","last_clean":"2023-07-29T02:07:32.494163+0000","last_became_active":"2023-07-29T02:00:01.993454+0000","last_became_peered":"2023-07-29T02:00:01.993454+0000","last_unstale":"2023-07-29T02:07:32.494163+0000","last_undegraded":"2023-07-29T02:07:32.494163+0000","last_fullsized":"2023-07-29T02:07:32.494163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'676","last_scrub_stamp":"2023-07-29T02:07:32.494138+0000","last_deep_scrub":"39'676","last_deep_scrub_stamp":"2023-07-29T02:07:32.494138+0000","last_clean_scrub_stamp":"2023-07-29T02:07:32.494138+0000","objects_scrubbed":341,"log_size":676,"log_dups_size":0,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T09:15:21.174797+0000","scrub_duration":0.125994316,"objects_trimmed":0,"snaptrim_duration":0.33100711700000002,"stat_sum":{"num_bytes":33339861,"num_objects":341,"num_object_clones":0,"num_object_copies":1364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":0,"num_read":39,"num_read_kb":19097,"num_write":677,"num_write_kb":41065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"39'127","reported_seq":172,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:36.017890+0000","last_change":"2023-07-29T02:06:36.018010+0000","last_active":"2023-07-29T02:06:36.017890+0000","last_peered":"2023-07-29T02:06:36.017890+0000","last_clean":"2023-07-29T02:06:36.017890+0000","last_became_active":"2023-07-29T01:59:57.539181+0000","last_became_peered":"2023-07-29T01:59:57.539181+0000","last_unstale":"2023-07-29T02:06:36.017890+0000","last_undegraded":"2023-07-29T02:06:36.017890+0000","last_fullsized":"2023-07-29T02:06:36.017890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'127","last_scrub_stamp":"2023-07-29T02:06:36.017861+0000","last_deep_scrub":"39'127","last_deep_scrub_stamp":"2023-07-29T02:06:36.017861+0000","last_clean_scrub_stamp":"2023-07-29T02:06:36.017861+0000","objects_scrubbed":5,"log_size":127,"log_dups_size":0,"ondisk_log_size":127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:55:14.227919+0000","scrub_duration":0.025569596,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":120,"num_write_kb":12364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18028,"num_omap_keys":30,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"39'91","reported_seq":2154,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:28.854311+0000","last_change":"2023-07-29T02:06:28.854311+0000","last_active":"2023-07-29T02:06:28.854311+0000","last_peered":"2023-07-29T02:06:28.854311+0000","last_clean":"2023-07-29T02:06:28.854311+0000","last_became_active":"2023-07-29T01:59:57.966580+0000","last_became_peered":"2023-07-29T01:59:57.966580+0000","last_unstale":"2023-07-29T02:06:28.854311+0000","last_undegraded":"2023-07-29T02:06:28.854311+0000","last_fullsized":"2023-07-29T02:06:28.854311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'91","last_scrub_stamp":"2023-07-29T02:06:28.854093+0000","last_deep_scrub":"39'91","last_deep_scrub_stamp":"2023-07-29T02:06:28.854093+0000","last_clean_scrub_stamp":"2023-07-29T02:06:28.854093+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T14:02:32.108002+0000","scrub_duration":0.001683281,"objects_trimmed":0,"snaptrim_duration":0.38010548900000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"39'649","reported_seq":2770,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:50.570454+0000","last_change":"2023-07-29T02:06:50.570454+0000","last_active":"2023-07-29T02:06:50.570454+0000","last_peered":"2023-07-29T02:06:50.570454+0000","last_clean":"2023-07-29T02:06:50.570454+0000","last_became_active":"2023-07-29T02:00:01.985554+0000","last_became_peered":"2023-07-29T02:00:01.985554+0000","last_unstale":"2023-07-29T02:06:50.570454+0000","last_undegraded":"2023-07-29T02:06:50.570454+0000","last_fullsized":"2023-07-29T02:06:50.570454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'649","last_scrub_stamp":"2023-07-29T02:06:50.570218+0000","last_deep_scrub":"39'649","last_deep_scrub_stamp":"2023-07-29T02:06:50.570218+0000","last_clean_scrub_stamp":"2023-07-29T02:06:50.570218+0000","objects_scrubbed":290,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:33:24.431230+0000","scrub_duration":0.124491425,"objects_trimmed":0,"snaptrim_duration":0.53877218400000004,"stat_sum":{"num_bytes":39819276,"num_objects":290,"num_object_clones":0,"num_object_copies":1160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":290,"num_whiteouts":0,"num_read":38,"num_read_kb":16418,"num_write":646,"num_write_kb":43313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"39'140","reported_seq":191,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:40.302084+0000","last_change":"2023-07-29T02:06:40.302188+0000","last_active":"2023-07-29T02:06:40.302084+0000","last_peered":"2023-07-29T02:06:40.302084+0000","last_clean":"2023-07-29T02:06:40.302084+0000","last_became_active":"2023-07-29T01:59:57.537457+0000","last_became_peered":"2023-07-29T01:59:57.537457+0000","last_unstale":"2023-07-29T02:06:40.302084+0000","last_undegraded":"2023-07-29T02:06:40.302084+0000","last_fullsized":"2023-07-29T02:06:40.302084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'140","last_scrub_stamp":"2023-07-29T02:06:40.302059+0000","last_deep_scrub":"39'140","last_deep_scrub_stamp":"2023-07-29T02:06:40.302059+0000","last_clean_scrub_stamp":"2023-07-29T02:06:40.302059+0000","objects_scrubbed":5,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T08:45:14.737193+0000","scrub_duration":0.022800549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":4108,"num_write":132,"num_write_kb":8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":12841,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"39'109","reported_seq":2172,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:07.490784+0000","last_change":"2023-07-29T02:07:07.490784+0000","last_active":"2023-07-29T02:07:07.490784+0000","last_peered":"2023-07-29T02:07:07.490784+0000","last_clean":"2023-07-29T02:07:07.490784+0000","last_became_active":"2023-07-29T01:59:57.960318+0000","last_became_peered":"2023-07-29T01:59:57.960318+0000","last_unstale":"2023-07-29T02:07:07.490784+0000","last_undegraded":"2023-07-29T02:07:07.490784+0000","last_fullsized":"2023-07-29T02:07:07.490784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'109","last_scrub_stamp":"2023-07-29T02:07:07.490662+0000","last_deep_scrub":"39'109","last_deep_scrub_stamp":"2023-07-29T02:07:07.490662+0000","last_clean_scrub_stamp":"2023-07-29T02:07:07.490662+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T06:53:01.945260+0000","scrub_duration":0.001138392,"objects_trimmed":0,"snaptrim_duration":0.32984874600000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"39'107","reported_seq":2171,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:59.145066+0000","last_change":"2023-07-29T02:06:59.145205+0000","last_active":"2023-07-29T02:06:59.145066+0000","last_peered":"2023-07-29T02:06:59.145066+0000","last_clean":"2023-07-29T02:06:59.145066+0000","last_became_active":"2023-07-29T01:59:57.959960+0000","last_became_peered":"2023-07-29T01:59:57.959960+0000","last_unstale":"2023-07-29T02:06:59.145066+0000","last_undegraded":"2023-07-29T02:06:59.145066+0000","last_fullsized":"2023-07-29T02:06:59.145066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'107","last_scrub_stamp":"2023-07-29T02:06:59.145036+0000","last_deep_scrub":"39'107","last_deep_scrub_stamp":"2023-07-29T02:06:59.145036+0000","last_clean_scrub_stamp":"2023-07-29T02:06:59.145036+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T11:53:41.775294+0000","scrub_duration":0.0028364250000000001,"objects_trimmed":0,"snaptrim_duration":0.22491762700000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"39'110","reported_seq":2174,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:07:18.058146+0000","last_change":"2023-07-29T02:07:18.058269+0000","last_active":"2023-07-29T02:07:18.058146+0000","last_peered":"2023-07-29T02:07:18.058146+0000","last_clean":"2023-07-29T02:07:18.058146+0000","last_became_active":"2023-07-29T01:59:57.975384+0000","last_became_peered":"2023-07-29T01:59:57.975384+0000","last_unstale":"2023-07-29T02:07:18.058146+0000","last_undegraded":"2023-07-29T02:07:18.058146+0000","last_fullsized":"2023-07-29T02:07:18.058146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'110","last_scrub_stamp":"2023-07-29T02:07:18.058118+0000","last_deep_scrub":"39'110","last_deep_scrub_stamp":"2023-07-29T02:07:18.058118+0000","last_clean_scrub_stamp":"2023-07-29T02:07:18.058118+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T02:39:26.368541+0000","scrub_duration":0.0016819020000000001,"objects_trimmed":0,"snaptrim_duration":0.38175464599999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"39'101","reported_seq":2164,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:30.442599+0000","last_change":"2023-07-29T02:06:30.442707+0000","last_active":"2023-07-29T02:06:30.442599+0000","last_peered":"2023-07-29T02:06:30.442599+0000","last_clean":"2023-07-29T02:06:30.442599+0000","last_became_active":"2023-07-29T01:59:57.967603+0000","last_became_peered":"2023-07-29T01:59:57.967603+0000","last_unstale":"2023-07-29T02:06:30.442599+0000","last_undegraded":"2023-07-29T02:06:30.442599+0000","last_fullsized":"2023-07-29T02:06:30.442599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'101","last_scrub_stamp":"2023-07-29T02:06:30.442572+0000","last_deep_scrub":"39'101","last_deep_scrub_stamp":"2023-07-29T02:06:30.442572+0000","last_clean_scrub_stamp":"2023-07-29T02:06:30.442572+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:12:53.035580+0000","scrub_duration":0.001551853,"objects_trimmed":0,"snaptrim_duration":0.350807488,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"39'99","reported_seq":2162,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:56.069929+0000","last_change":"2023-07-29T02:06:56.070035+0000","last_active":"2023-07-29T02:06:56.069929+0000","last_peered":"2023-07-29T02:06:56.069929+0000","last_clean":"2023-07-29T02:06:56.069929+0000","last_became_active":"2023-07-29T01:59:57.966672+0000","last_became_peered":"2023-07-29T01:59:57.966672+0000","last_unstale":"2023-07-29T02:06:56.069929+0000","last_undegraded":"2023-07-29T02:06:56.069929+0000","last_fullsized":"2023-07-29T02:06:56.069929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'99","last_scrub_stamp":"2023-07-29T02:06:56.069903+0000","last_deep_scrub":"39'99","last_deep_scrub_stamp":"2023-07-29T02:06:56.069903+0000","last_clean_scrub_stamp":"2023-07-29T02:06:56.069903+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T07:36:54.809998+0000","scrub_duration":0.001739141,"objects_trimmed":0,"snaptrim_duration":0.39433596799999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"39'79","reported_seq":2142,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-29T02:06:46.360697+0000","last_change":"2023-07-29T02:06:46.360780+0000","last_active":"2023-07-29T02:06:46.360697+0000","last_peered":"2023-07-29T02:06:46.360697+0000","last_clean":"2023-07-29T02:06:46.360697+0000","last_became_active":"2023-07-29T01:59:57.968449+0000","last_became_peered":"2023-07-29T01:59:57.968449+0000","last_unstale":"2023-07-29T02:06:46.360697+0000","last_undegraded":"2023-07-29T02:06:46.360697+0000","last_fullsized":"2023-07-29T02:06:46.360697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'79","last_scrub_stamp":"2023-07-29T02:06:46.360676+0000","last_deep_scrub":"39'79","last_deep_scrub_stamp":"2023-07-29T02:06:46.360676+0000","last_clean_scrub_stamp":"2023-07-29T02:06:46.360676+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-30T13:13:08.953684+0000","scrub_duration":0.0019273090000000001,"objects_trimmed":0,"snaptrim_duration":0.54020755499999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":918109411,"num_objects":10156,"num_object_clones":0,"num_object_copies":40624,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10156,"num_whiteouts":0,"num_read":1251,"num_read_kb":366219,"num_write":20741,"num_write_kb":1040888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1801588736,"data_stored":1952841728,"data_compressed":122947712,"data_compressed_allocated":138481664,"data_compressed_original":289734656,"omap_allocated":0,"internal_metadata":0},"log_size":20769,"ondisk_log_size":20769,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5774,"ondisk_log_size":5774,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":235792097,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":309,"num_read_kb":151139,"num_write":3982,"num_write_kb":234638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":586841,"num_omap_keys":984,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":99221504,"data_stored":471584194,"data_compressed":61258084,"data_compressed_allocated":77160448,"data_compressed_original":449585152,"omap_allocated":0,"internal_metadata":0},"log_size":4079,"ondisk_log_size":4079,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64860,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313140,"kb_used_data":223852,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94058700,"statfs":{"total":96636764160,"available":96316108800,"internally_reserved":0,"allocated":229224448,"data_stored":300310153,"data_compressed":25236479,"data_compressed_allocated":29581312,"data_compressed_original":100917248,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.59199999999999997,"15min":0.52600000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":3.8690000000000002,"5min":6.0650000000000004,"15min":6.0650000000000004},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.60399999999999998,"15min":0.53600000000000003},"min":{"1min":0.27900000000000003,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":5.4450000000000003,"5min":5.4450000000000003,"15min":5.4450000000000003},"last":0.71799999999999997}]},{"osd":1,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68799999999999994,"15min":0.56699999999999995},"min":{"1min":0.30299999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":2.0230000000000001,"5min":10.303000000000001,"15min":10.303000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.78500000000000003,"15min":0.622},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.77800000000000002,"5min":19.527999999999999,"15min":19.527999999999999},"last":0.747}]},{"osd":2,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":2.835,"5min":1.091,"15min":0.74399999999999999},"min":{"1min":0.35099999999999998,"5min":0.307,"15min":0.307},"max":{"1min":42.037999999999997,"5min":42.037999999999997,"15min":42.037999999999997},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.64400000000000002,"15min":0.58599999999999997},"min":{"1min":0.40200000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":5.524,"5min":5.524,"15min":5.524},"last":0.73799999999999999}]},{"osd":3,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":0.77600000000000002,"15min":0.63100000000000001},"min":{"1min":0.34699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":19.533999999999999,"5min":19.533999999999999,"15min":19.533999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.39100000000000001,"5min":0.308,"15min":0.308},"max":{"1min":4.8099999999999996,"5min":4.8099999999999996,"15min":4.8099999999999996},"last":0.66100000000000003}]},{"osd":4,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.52700000000000002,"15min":0.54000000000000004},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.5789999999999997,"5min":5.5789999999999997,"15min":5.5789999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.51100000000000001,"15min":0.55800000000000005},"min":{"1min":0.31900000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"last":0.56299999999999994}]},{"osd":5,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.55800000000000005,"15min":0.57199999999999995},"min":{"1min":0.32800000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":5.5499999999999998,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.57099999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":2.0819999999999999,"5min":3.621,"15min":3.621},"last":0.62}]},{"osd":6,"last update":"Sat Jul 29 02:07:00 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.60199999999999998,"15min":0.61499999999999999},"min":{"1min":0.36199999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.492,"5min":5.492,"15min":5.492},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.58799999999999997,"15min":0.626},"min":{"1min":0.433,"5min":0.312,"15min":0.312},"max":{"1min":2.0609999999999999,"5min":3.488,"15min":3.488},"last":0.67000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574946,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304904,"kb_used_data":241856,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":94066936,"statfs":{"total":96636764160,"available":96324542464,"internally_reserved":0,"allocated":247660544,"data_stored":288753905,"data_compressed":18888304,"data_compressed_allocated":21577728,"data_compressed_original":62894080,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.63600000000000001,"15min":0.56299999999999994},"min":{"1min":0.46800000000000003,"5min":0.215,"15min":0.215},"max":{"1min":6.3470000000000004,"5min":7,"15min":7},"last":0.53000000000000003},{"interface":"front","average":{"1min":1.1910000000000001,"5min":0.75700000000000001,"15min":0.60599999999999998},"min":{"1min":0.39300000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":13.166,"5min":13.166,"15min":13.166},"last":0.498}]},{"osd":1,"last update":"Sat Jul 29 02:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.69599999999999995,"15min":0.59499999999999997},"min":{"1min":0.42099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":5.6479999999999997,"5min":12.462,"15min":12.462},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.69699999999999995,"15min":0.61399999999999999},"min":{"1min":0.40000000000000002,"5min":0.318,"15min":0.318},"max":{"1min":8.2989999999999995,"5min":8.2989999999999995,"15min":8.2989999999999995},"last":0.54000000000000004}]},{"osd":2,"last update":"Sat Jul 29 02:07:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":0.65000000000000002,"15min":0.58099999999999996},"min":{"1min":0.40699999999999997,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":11.327,"5min":11.327,"15min":11.327},"last":0.47299999999999998},{"interface":"front","average":{"1min":1.0669999999999999,"5min":0.69999999999999996,"15min":0.60799999999999998},"min":{"1min":0.47399999999999998,"5min":0.314,"15min":0.314},"max":{"1min":10.535,"5min":10.535,"15min":10.535},"last":0.48599999999999999}]},{"osd":3,"last update":"Sat Jul 29 02:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.66100000000000003,"15min":0.60099999999999998},"min":{"1min":0.47699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.242,"5min":6.4889999999999999,"15min":6.4889999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.69699999999999995,"15min":0.63100000000000001},"min":{"1min":0.45600000000000002,"5min":0.252,"15min":0.252},"max":{"1min":5.8639999999999999,"5min":6.8559999999999999,"15min":6.8559999999999999},"last":0.50900000000000001}]},{"osd":4,"last update":"Sat Jul 29 02:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.68400000000000005,"15min":0.58399999999999996},"min":{"1min":0.29899999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.69899999999999995,"5min":24.123999999999999,"15min":24.123999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.374,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.272,"5min":6.3710000000000004,"15min":6.3710000000000004},"last":0.45500000000000002}]},{"osd":5,"last update":"Sat Jul 29 02:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48199999999999998,"15min":0.53300000000000003},"min":{"1min":0.32200000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63100000000000001,"5min":0.82999999999999996,"15min":1.1140000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.63800000000000001,"15min":0.59599999999999997},"min":{"1min":0.33600000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":5.6829999999999998,"5min":6.9669999999999996,"15min":6.9669999999999996},"last":0.441}]},{"osd":7,"last update":"Sat Jul 29 02:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.66700000000000004,"15min":0.61199999999999999},"min":{"1min":0.36699999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":8.3369999999999997,"5min":8.3369999999999997,"15min":8.3369999999999997},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.39700000000000002,"5min":0.31,"15min":0.31},"max":{"1min":1.5780000000000001,"5min":5.2300000000000004,"15min":5.2300000000000004},"last":0.41999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":371584,"kb_used_data":268344,"kb_used_omap":0,"kb_used_meta":103232,"kb_avail":94000256,"statfs":{"total":96636764160,"available":96256262144,"internally_reserved":0,"allocated":274784256,"data_stored":329875756,"data_compressed":22338055,"data_compressed_allocated":25993216,"data_compressed_original":81313792,"omap_allocated":0,"internal_metadata":105709568},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.39900000000000002,"15min":0.501},"min":{"1min":0.248,"5min":0.20799999999999999,"15min":0.20399999999999999},"max":{"1min":0.505,"5min":3.7989999999999999,"15min":7.1299999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.439,"15min":0.51300000000000001},"min":{"1min":0.28399999999999997,"5min":0.23200000000000001,"15min":0.22800000000000001},"max":{"1min":4.5179999999999998,"5min":4.5179999999999998,"15min":5.4779999999999998},"last":0.497}]},{"osd":2,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.86599999999999999},"min":{"1min":0.252,"5min":0.214,"15min":0.20899999999999999},"max":{"1min":6.1079999999999997,"5min":22.483000000000001,"15min":22.483000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.47199999999999998,"15min":0.66000000000000003},"min":{"1min":0.30399999999999999,"5min":0.27700000000000002,"15min":0.26300000000000001},"max":{"1min":2.177,"5min":3.0619999999999998,"15min":11.028},"last":0.56299999999999994}]},{"osd":3,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48299999999999998,"15min":0.58799999999999997},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67400000000000004,"5min":2.9900000000000002,"15min":7.1699999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.47199999999999998,"15min":0.41499999999999998},"min":{"1min":0.33200000000000002,"5min":0.245,"15min":0.245},"max":{"1min":4.484,"5min":4.484,"15min":4.484},"last":0.54900000000000004}]},{"osd":4,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":2.2370000000000001,"5min":1.022,"15min":1.1160000000000001},"min":{"1min":0.36399999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":31.68,"5min":31.68,"15min":31.68},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.702,"5min":0.84499999999999997,"15min":0.91400000000000003},"min":{"1min":0.435,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":20.733000000000001,"5min":20.733000000000001,"15min":20.733000000000001},"last":0.68100000000000005}]},{"osd":5,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.65600000000000003,"15min":0.71799999999999997},"min":{"1min":0.48199999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":4.4219999999999997,"5min":4.4219999999999997,"15min":5.391},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.70499999999999996,"15min":1.0469999999999999},"min":{"1min":0.47199999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.3480000000000001,"5min":5.8849999999999998,"15min":17.994},"last":0.69599999999999995}]},{"osd":6,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63100000000000001,"15min":0.72999999999999998},"min":{"1min":0.51600000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88900000000000001,"5min":0.91300000000000003,"15min":5.452},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.73899999999999999,"15min":1.0389999999999999},"min":{"1min":0.40699999999999997,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.3779999999999999,"5min":5.8540000000000001,"15min":17.963999999999999},"last":0.73699999999999999}]},{"osd":7,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":0.80500000000000005,"15min":0.90900000000000003},"min":{"1min":0.51900000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":12.16,"5min":12.16,"15min":12.16},"last":0.75},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67400000000000004,"15min":0.753},"min":{"1min":0.56100000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0269999999999999,"5min":2.9889999999999999,"15min":5.4249999999999998},"last":0.83299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329076,"kb_used_data":239788,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94042764,"statfs":{"total":96636764160,"available":96299790336,"internally_reserved":0,"allocated":245542912,"data_stored":309139007,"data_compressed":23440797,"data_compressed_allocated":27287552,"data_compressed_original":91111424,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jul 29 02:07:08 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":0.97699999999999998,"15min":0.54800000000000004},"min":{"1min":0.246,"5min":0.161,"15min":0.161},"max":{"1min":20.379000000000001,"5min":39.070999999999998,"15min":39.070999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":1.321,"5min":0.629,"15min":0.45200000000000001},"min":{"1min":0.23300000000000001,"5min":0.218,"15min":0.21299999999999999},"max":{"1min":18.800999999999998,"5min":18.800999999999998,"15min":18.800999999999998},"last":0.307}]},{"osd":2,"last update":"Sat Jul 29 02:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.623,"15min":0.47899999999999998},"min":{"1min":0.315,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":7.6890000000000001,"5min":10.438000000000001,"15min":10.438000000000001},"last":0.378},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.63600000000000001,"15min":0.48499999999999999},"min":{"1min":0.34499999999999997,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":7.0709999999999997,"5min":10.802,"15min":10.802},"last":0.45100000000000001}]},{"osd":3,"last update":"Sat Jul 29 02:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.53700000000000003,"15min":0.42399999999999999},"min":{"1min":0.28699999999999998,"5min":0.246,"15min":0.246},"max":{"1min":7.0529999999999999,"5min":7.0529999999999999,"15min":7.0529999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.58699999999999997,"15min":0.47999999999999998},"min":{"1min":0.29699999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":7.5999999999999996,"5min":7.5999999999999996,"15min":7.5999999999999996},"last":0.47899999999999998}]},{"osd":4,"last update":"Sat Jul 29 02:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.66600000000000004,"15min":0.623},"min":{"1min":0.42299999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":7.1390000000000002,"5min":7.1390000000000002,"15min":7.1390000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":1.2490000000000001,"5min":0.80000000000000004,"15min":0.67200000000000004},"min":{"1min":0.45700000000000002,"5min":0.318,"15min":0.318},"max":{"1min":13.398999999999999,"5min":13.398999999999999,"15min":13.398999999999999},"last":0.53700000000000003}]},{"osd":5,"last update":"Sat Jul 29 02:07:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.71499999999999997,"15min":0.63900000000000001},"min":{"1min":0.45400000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":10.106999999999999,"5min":10.106999999999999,"15min":10.106999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":1.177,"5min":0.74199999999999999,"15min":0.66100000000000003},"min":{"1min":0.44700000000000001,"5min":0.377,"15min":0.377},"max":{"1min":12.324999999999999,"5min":12.324999999999999,"15min":12.324999999999999},"last":0.502}]},{"osd":6,"last update":"Sat Jul 29 02:07:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":0.82799999999999996,"15min":0.69599999999999995},"min":{"1min":0.45700000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":15.609,"5min":15.609,"15min":15.609},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.5569999999999999,"5min":0.84099999999999997,"15min":0.70399999999999996},"min":{"1min":0.437,"5min":0.38,"15min":0.38},"max":{"1min":19.013000000000002,"5min":19.013000000000002,"15min":19.013000000000002},"last":0.60599999999999998}]},{"osd":7,"last update":"Sat Jul 29 02:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.74199999999999999,"15min":0.67200000000000004},"min":{"1min":0.502,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":6.6920000000000002,"5min":6.6920000000000002,"15min":6.6920000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.238,"5min":0.79500000000000004,"15min":0.69999999999999996},"min":{"1min":0.42499999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":12.276999999999999,"5min":12.276999999999999,"15min":12.276999999999999},"last":0.64600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574946,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":268060,"kb_used_data":200916,"kb_used_omap":0,"kb_used_meta":67136,"kb_avail":94103780,"statfs":{"total":96636764160,"available":96362270720,"internally_reserved":0,"allocated":205737984,"data_stored":235440369,"data_compressed":13107136,"data_compressed_allocated":15015936,"data_compressed_original":44941312,"omap_allocated":0,"internal_metadata":68747264},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46999999999999997,"15min":0.40000000000000002},"min":{"1min":0.255,"5min":0.222,"15min":0.182},"max":{"1min":1.198,"5min":10.795999999999999,"15min":10.795999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.54800000000000004,"15min":0.64100000000000001},"min":{"1min":0.28100000000000003,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.79300000000000004,"5min":16.536999999999999,"15min":16.536999999999999},"last":0.34399999999999997}]},{"osd":1,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.45900000000000002,"15min":0.54600000000000004},"min":{"1min":0.30199999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.86099999999999999,"5min":5.2160000000000002,"15min":6.1040000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.49099999999999999,"15min":0.439},"min":{"1min":0.27400000000000002,"5min":0.246,"15min":0.20100000000000001},"max":{"1min":1.2829999999999999,"5min":7.4880000000000004,"15min":7.4880000000000004},"last":0.46999999999999997}]},{"osd":3,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.438,"15min":0.40699999999999997},"min":{"1min":0.28399999999999997,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.63800000000000001,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":0.311},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52000000000000002,"15min":0.60399999999999998},"min":{"1min":0.35099999999999998,"5min":0.30199999999999999,"15min":0.27300000000000002},"max":{"1min":1.2569999999999999,"5min":5.4240000000000004,"15min":6.0620000000000003},"last":0.505}]},{"osd":4,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.70099999999999996,"15min":0.64100000000000001},"min":{"1min":0.42999999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":6.9989999999999997,"5min":6.9989999999999997,"15min":6.9989999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.67800000000000005,"15min":0.65900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.353,"5min":6.3300000000000001,"15min":6.3300000000000001},"last":0.58999999999999997}]},{"osd":5,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68600000000000005,"15min":0.65900000000000003},"min":{"1min":0.377,"5min":0.37,"15min":0.37},"max":{"1min":1.3160000000000001,"5min":6.149,"15min":6.149},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.96199999999999997,"15min":0.92800000000000005},"min":{"1min":0.34899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":7.327,"5min":28.702000000000002,"15min":28.702000000000002},"last":0.46000000000000002}]},{"osd":6,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.65300000000000002,"15min":0.83599999999999997},"min":{"1min":0.39800000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.90300000000000002,"5min":4.5179999999999998,"15min":9.1199999999999992},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68500000000000005,"15min":0.66000000000000003},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91800000000000004,"5min":5.2530000000000001,"15min":5.2530000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70299999999999996,"15min":0.68799999999999994},"min":{"1min":0.438,"5min":0.434,"15min":0.40899999999999997},"max":{"1min":1.419,"5min":6.2930000000000001,"15min":6.2930000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.68899999999999995,"15min":0.86699999999999999},"min":{"1min":0.42899999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.4450000000000001,"5min":4.4809999999999999,"15min":9.1620000000000008},"last":0.56799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574946,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":292752,"kb_used_data":203464,"kb_used_omap":0,"kb_used_meta":89280,"kb_avail":94079088,"statfs":{"total":96636764160,"available":96336986112,"internally_reserved":0,"allocated":208347136,"data_stored":294471050,"data_compressed":26171949,"data_compressed_allocated":31100928,"data_compressed_original":117448704,"omap_allocated":0,"internal_metadata":91422720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.44600000000000001,"15min":0.36799999999999999},"min":{"1min":0.25,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":7.1379999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.443,"15min":0.39300000000000002},"min":{"1min":0.29999999999999999,"5min":0.23200000000000001,"15min":0.22900000000000001},"max":{"1min":7.5380000000000003,"5min":7.5380000000000003,"15min":7.5380000000000003},"last":0.42899999999999999}]},{"osd":1,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.45100000000000001,"15min":0.38900000000000001},"min":{"1min":0.28000000000000003,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57899999999999996,"5min":9.7289999999999992,"15min":9.7289999999999992},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.55400000000000005,"15min":0.442},"min":{"1min":0.32800000000000001,"5min":0.253,"15min":0.21299999999999999},"max":{"1min":7.0540000000000003,"5min":7.4989999999999997,"15min":7.4989999999999997},"last":0.45100000000000001}]},{"osd":2,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":2.9060000000000001,"5min":0.90900000000000003,"15min":0.57299999999999995},"min":{"1min":0.32300000000000001,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":49.343000000000004,"5min":49.343000000000004,"15min":49.343000000000004},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.53800000000000003,"15min":0.45600000000000002},"min":{"1min":0.40300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":7.1870000000000003,"5min":7.1870000000000003,"15min":7.1870000000000003},"last":0.498}]},{"osd":4,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.68200000000000005,"15min":0.63800000000000001},"min":{"1min":0.42699999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":7.5999999999999996,"5min":7.5999999999999996,"15min":7.5999999999999996},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71599999999999997,"15min":0.65000000000000002},"min":{"1min":0.498,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":3.282,"5min":8.6869999999999994,"15min":8.6869999999999994},"last":0.745}]},{"osd":5,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.61899999999999999,"15min":0.60199999999999998},"min":{"1min":0.438,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.70299999999999996,"15min":0.63200000000000001},"min":{"1min":0.49299999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":7.0060000000000002,"5min":7.0060000000000002,"15min":7.0060000000000002},"last":0.75700000000000001}]},{"osd":6,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.74199999999999999,"15min":0.67100000000000004},"min":{"1min":0.443,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":7.1639999999999997,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.72299999999999998,"15min":0.67800000000000005},"min":{"1min":0.45200000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":7.5730000000000004,"5min":7.5730000000000004,"15min":7.5730000000000004},"last":0.73499999999999999}]},{"osd":7,"last update":"Sat Jul 29 02:07:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":0.81899999999999995,"15min":0.68300000000000005},"min":{"1min":0.51200000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":10.901999999999999,"5min":10.901999999999999,"15min":10.901999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.1930000000000001,"5min":0.76000000000000001,"15min":0.68700000000000006},"min":{"1min":0.50700000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":10.943,"5min":10.943,"15min":10.943},"last":0.78600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574945,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356320,"kb_used_data":253080,"kb_used_omap":0,"kb_used_meta":103232,"kb_avail":94015520,"statfs":{"total":96636764160,"available":96271892480,"internally_reserved":0,"allocated":259153920,"data_stored":357883116,"data_compressed":30679187,"data_compressed_allocated":36306944,"data_compressed_original":135278592,"omap_allocated":0,"internal_metadata":105709568},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.60399999999999998,"15min":0.54100000000000004},"min":{"1min":0.28399999999999997,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.70099999999999996,"5min":4.4800000000000004,"15min":4.4800000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.57299999999999995,"15min":0.81399999999999995},"min":{"1min":0.30099999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.67300000000000004,"5min":7.2679999999999998,"15min":12.231999999999999},"last":0.621}]},{"osd":1,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55800000000000005,"15min":0.51700000000000002},"min":{"1min":0.315,"5min":0.255,"15min":0.255},"max":{"1min":0.70599999999999996,"5min":3.9020000000000001,"15min":3.9020000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.38,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.82699999999999996,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.64000000000000001}]},{"osd":2,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53900000000000003,"15min":0.53500000000000003},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68300000000000005,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75,"5min":0.874,"15min":0.874},"last":0.503}]},{"osd":3,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56599999999999995,"15min":0.54400000000000004},"min":{"1min":0.34200000000000003,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66500000000000004,"5min":3.9969999999999999,"15min":3.9969999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.95799999999999996,"15min":0.69399999999999995},"min":{"1min":0.46999999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72599999999999998,"5min":28.837,"15min":28.837},"last":0.58199999999999996}]},{"osd":5,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48899999999999999,"15min":0.496},"min":{"1min":0.32900000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.86299999999999999,"5min":1.8,"15min":1.8},"last":0.375},{"interface":"front","average":{"1min":0.503,"5min":0.49099999999999999,"15min":0.5},"min":{"1min":0.34499999999999997,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81599999999999995,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.42599999999999999}]},{"osd":6,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.76900000000000002,"5min":1.006,"15min":1.006},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.40000000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.018,"5min":1.8320000000000001,"15min":1.8320000000000001},"last":0.55500000000000005}]},{"osd":7,"last update":"Sat Jul 29 02:06:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.34999999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57499999999999996,"15min":0.57799999999999996},"min":{"1min":0.38100000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.91900000000000004,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.69199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574947,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":313700,"kb_used_data":228508,"kb_used_omap":0,"kb_used_meta":85184,"kb_avail":94058140,"statfs":{"total":96636764160,"available":96315535360,"internally_reserved":0,"allocated":233992192,"data_stored":311454589,"data_compressed":24408749,"data_compressed_allocated":28868608,"data_compressed_original":106561536,"omap_allocated":0,"internal_metadata":87228416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jul 29 02:07:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.51700000000000002},"min":{"1min":0.29299999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.68899999999999995,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.63,"15min":0.54500000000000004},"min":{"1min":0.33500000000000002,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.70699999999999996,"5min":8.2590000000000003,"15min":8.2590000000000003},"last":0.63800000000000001}]},{"osd":1,"last update":"Sat Jul 29 02:07:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.58999999999999997,"15min":0.51700000000000002},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71999999999999997,"5min":5.9119999999999999,"15min":5.9119999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58399999999999996,"15min":0.55100000000000005},"min":{"1min":0.36099999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.749,"5min":3.996,"15min":3.996},"last":0.60899999999999999}]},{"osd":2,"last update":"Sat Jul 29 02:07:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56399999999999995,"15min":0.52000000000000002},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68000000000000005,"5min":2.8929999999999998,"15min":2.8929999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.69899999999999995,"15min":0.59999999999999998},"min":{"1min":0.36199999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.72799999999999998,"5min":9.8360000000000003,"15min":9.8360000000000003},"last":0.65100000000000002}]},{"osd":3,"last update":"Sat Jul 29 02:07:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57799999999999996,"15min":0.55800000000000005},"min":{"1min":0.375,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71799999999999997,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.70399999999999996,"15min":0.60599999999999998},"min":{"1min":0.39900000000000002,"5min":0.314,"15min":0.314},"max":{"1min":0.76500000000000001,"5min":8.1940000000000008,"15min":8.1940000000000008},"last":0.67700000000000005}]},{"osd":4,"last update":"Sat Jul 29 02:07:07 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.48199999999999998,"15min":0.50600000000000001},"min":{"1min":0.29899999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.60399999999999998,"5min":1.845,"15min":1.845},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.495,"15min":0.52800000000000002},"min":{"1min":0.314,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.65100000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.38400000000000001}]},{"osd":6,"last update":"Sat Jul 29 02:07:07 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.50600000000000001,"15min":0.53400000000000003},"min":{"1min":0.313,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.66200000000000003,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.52600000000000002,"15min":0.55000000000000004},"min":{"1min":0.33900000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65300000000000002,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.40200000000000002}]},{"osd":7,"last update":"Sat Jul 29 02:07:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.55300000000000005,"15min":0.58199999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.67400000000000004,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.39500000000000002,"5min":0.36799999999999999,"15min":0.35999999999999999},"max":{"1min":0.67800000000000005,"5min":1.994,"15min":1.994},"last":0.48399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32430,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12668928,"data_stored":55102798,"data_compressed":7347975,"data_compressed_allocated":9121792,"data_compressed_original":51560448,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8052736,"data_stored":42276379,"data_compressed":5207195,"data_compressed_allocated":6623232,"data_compressed_original":40849408,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":20971520,"data_compressed":2599703,"data_compressed_allocated":3166208,"data_compressed_original":19935232,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20307968,"data_stored":88080474,"data_compressed":11613220,"data_compressed_allocated":14581760,"data_compressed_original":82358272,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18128896,"data_stored":93185019,"data_compressed":11582332,"data_compressed_allocated":14712832,"data_compressed_original":89788416,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13971456,"data_stored":71303820,"data_compressed":9372464,"data_compressed_allocated":11796480,"data_compressed_original":69136384,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":7340032,"data_stored":33554432,"data_compressed":4791721,"data_compressed_allocated":5980160,"data_compressed_original":32194560,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14548992,"data_stored":67109752,"data_compressed":8743474,"data_compressed_allocated":11177984,"data_compressed_original":63762432,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":232435712,"data_stored":253820928,"data_compressed":16092822,"data_compressed_allocated":18165760,"data_compressed_original":39550976,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":266227712,"data_stored":286793728,"data_compressed":17098430,"data_compressed_allocated":19324928,"data_compressed_original":39890944,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":201097216,"data_stored":214253568,"data_compressed":10507433,"data_compressed_allocated":11849728,"data_compressed_original":25006080,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":187604992,"data_stored":206176256,"data_compressed":14558729,"data_compressed_allocated":16519168,"data_compressed_original":35090432,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":240586752,"data_stored":264482816,"data_compressed":19096855,"data_compressed_allocated":21594112,"data_compressed_original":45490176,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":219582464,"data_stored":239935488,"data_compressed":15036285,"data_compressed_allocated":17072128,"data_compressed_original":37425152,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":239882240,"data_stored":254984192,"data_compressed":14096583,"data_compressed_allocated":15597568,"data_compressed_original":30699520,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":214171648,"data_stored":232394752,"data_compressed":16460575,"data_compressed_allocated":18358272,"data_compressed_original":36581376,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-29T02:07:47.852 DEBUG:teuthology.orchestra.run.smithi042:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-07-29T02:07:48.004 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.024+0000 7f0340d5c700 1 Processor -- start 2023-07-29T02:07:48.004 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.024+0000 7f0340d5c700 1 -- start start 2023-07-29T02:07:48.006 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.025+0000 7f0340d5c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f033c0b4250 0x7f033c06b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:48.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.025+0000 7f0340d5c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f033c0c6190 0x7f033c15c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:48.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.025+0000 7f0340d5c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033c1598a0 con 0x7f033c159d30 2023-07-29T02:07:48.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.025+0000 7f0340d5c700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033c06c680 con 0x7f033c0c6190 2023-07-29T02:07:48.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.025+0000 7f0340d5c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033c153850 con 0x7f033c0b4250 2023-07-29T02:07:48.007 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.025+0000 7f0339d9b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f033c0c6190 0x7f033c15c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:48.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.025+0000 7f0339d9b700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f033c0c6190 0x7f033c15c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58628/0 (socket says 172.21.15.42:58628) 2023-07-29T02:07:48.008 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.025+0000 7f0339d9b700 1 -- 172.21.15.42:0/1945123305 learned_addr learned my addr 172.21.15.42:0/1945123305 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:07:48.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.025+0000 7f033a59c700 1 --2- 172.21.15.42:0/1945123305 >> v2:172.21.15.144:3300/0 conn(0x7f033c0b4250 0x7f033c06b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:48.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.025+0000 7f0339d9b700 1 -- 172.21.15.42:0/1945123305 >> v2:172.21.15.144:3300/0 conn(0x7f033c0b4250 msgr2=0x7f033c06b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:07:48.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.025+0000 7f0339d9b700 1 --2- 172.21.15.42:0/1945123305 >> v2:172.21.15.144:3300/0 conn(0x7f033c0b4250 0x7f033c06b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.025+0000 7f0339d9b700 1 -- 172.21.15.42:0/1945123305 >> v1:172.21.15.144:6789/0 conn(0x7f033c159d30 legacy=0x7f033c0c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:07:48.009 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.025+0000 7f0339d9b700 1 -- 172.21.15.42:0/1945123305 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c15cb50 con 0x7f033c0c6190 2023-07-29T02:07:48.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.026+0000 7f0339d9b700 1 --2- 172.21.15.42:0/1945123305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f033c0c6190 0x7f033c15c610 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f033c072f50 tx=0x7f032c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e573cf7e997040 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:48.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.026+0000 7f033959a700 1 -- 172.21.15.42:0/1945123305 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c004230 con 0x7f033c0c6190 2023-07-29T02:07:48.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.026+0000 7f033959a700 1 -- 172.21.15.42:0/1945123305 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032c004390 con 0x7f033c0c6190 2023-07-29T02:07:48.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.026+0000 7f033959a700 1 -- 172.21.15.42:0/1945123305 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c0036a0 con 0x7f033c0c6190 2023-07-29T02:07:48.010 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.026+0000 7f0340d5c700 1 -- 172.21.15.42:0/1945123305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f033c0c6190 msgr2=0x7f033c15c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:48.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.026+0000 7f0340d5c700 1 --2- 172.21.15.42:0/1945123305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f033c0c6190 0x7f033c15c610 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f033c072f50 tx=0x7f032c009c00 comp rx=0 tx=0).stop 2023-07-29T02:07:48.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.026+0000 7f0340d5c700 1 -- 172.21.15.42:0/1945123305 shutdown_connections 2023-07-29T02:07:48.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.026+0000 7f0340d5c700 1 --2- 172.21.15.42:0/1945123305 >> v2:172.21.15.144:3300/0 conn(0x7f033c0b4250 0x7f033c06b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.011 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.026+0000 7f0340d5c700 1 --2- 172.21.15.42:0/1945123305 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f033c0c6190 0x7f033c15c610 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.012 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.026+0000 7f0340d5c700 1 -- 172.21.15.42:0/1945123305 >> 172.21.15.42:0/1945123305 conn(0x7f033c06ca30 msgr2=0x7f033c06ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:48.012 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.027+0000 7f0340d5c700 1 -- 172.21.15.42:0/1945123305 shutdown_connections 2023-07-29T02:07:48.012 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.027+0000 7f0340d5c700 1 -- 172.21.15.42:0/1945123305 wait complete. 2023-07-29T02:07:48.014 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.028+0000 7f0340d5c700 1 Processor -- start 2023-07-29T02:07:48.014 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.028+0000 7f0340d5c700 1 -- start start 2023-07-29T02:07:48.015 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f0340d5c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f033c0b4250 0x7f033c146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:48.015 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f0340d5c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f033c0c6190 0x7f033c1ef0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:48.015 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f0340d5c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f033c159d30 0x7f033c1577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:48.015 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f0340d5c700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c155380 con 0x7f033c0c6190 2023-07-29T02:07:48.015 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f0340d5c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033c1eec30 con 0x7f033c159d30 2023-07-29T02:07:48.016 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f0340d5c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f033c1496b0 con 0x7f033c0b4250 2023-07-29T02:07:48.016 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f0339d9b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f033c0c6190 0x7f033c1ef0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:48.016 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f0339d9b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f033c0c6190 0x7f033c1ef0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58636/0 (socket says 172.21.15.42:58636) 2023-07-29T02:07:48.016 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f0339d9b700 1 -- 172.21.15.42:0/2747680868 learned_addr learned my addr 172.21.15.42:0/2747680868 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:07:48.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f033a59c700 1 --2- 172.21.15.42:0/2747680868 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f033c0b4250 0x7f033c146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:48.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f033ad9d700 1 --2- 172.21.15.42:0/2747680868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f033c159d30 0x7f033c1577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:48.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f0339d9b700 1 -- 172.21.15.42:0/2747680868 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f033c0b4250 msgr2=0x7f033c146db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:48.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f0339d9b700 1 --2- 172.21.15.42:0/2747680868 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f033c0b4250 0x7f033c146db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f0339d9b700 1 -- 172.21.15.42:0/2747680868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f033c159d30 msgr2=0x7f033c1577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:48.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f0339d9b700 1 --2- 172.21.15.42:0/2747680868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f033c159d30 0x7f033c1577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f0339d9b700 1 -- 172.21.15.42:0/2747680868 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032c009550 con 0x7f033c0c6190 2023-07-29T02:07:48.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f033a59c700 1 --2- 172.21.15.42:0/2747680868 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f033c0b4250 0x7f033c146db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:07:48.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f033ad9d700 1 --2- 172.21.15.42:0/2747680868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f033c159d30 0x7f033c1577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:07:48.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f0339d9b700 1 --2- 172.21.15.42:0/2747680868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f033c0c6190 0x7f033c1ef0c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f032c009130 tx=0x7f032c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:48.019 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f032affd700 1 -- 172.21.15.42:0/2747680868 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c003df0 con 0x7f033c0c6190 2023-07-29T02:07:48.019 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f032affd700 1 -- 172.21.15.42:0/2747680868 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032c01f070 con 0x7f033c0c6190 2023-07-29T02:07:48.019 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f0340d5c700 1 -- 172.21.15.42:0/2747680868 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033c1ee920 con 0x7f033c0c6190 2023-07-29T02:07:48.019 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f032affd700 1 -- 172.21.15.42:0/2747680868 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c011870 con 0x7f033c0c6190 2023-07-29T02:07:48.019 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.029+0000 7f0340d5c700 1 -- 172.21.15.42:0/2747680868 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033c155f00 con 0x7f033c0c6190 2023-07-29T02:07:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.031+0000 7f0340d5c700 1 -- 172.21.15.42:0/2747680868 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f033c04ea50 con 0x7f033c0c6190 2023-07-29T02:07:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.031+0000 7f032affd700 1 -- 172.21.15.42:0/2747680868 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f032c021030 con 0x7f033c0c6190 2023-07-29T02:07:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.031+0000 7f032affd700 1 --2- 172.21.15.42:0/2747680868 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f031c06a630 0x7f031c06cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.031+0000 7f032affd700 1 -- 172.21.15.42:0/2747680868 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f032c08a200 con 0x7f033c0c6190 2023-07-29T02:07:48.020 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.032+0000 7f033a59c700 1 --2- 172.21.15.42:0/2747680868 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f031c06a630 0x7f031c06cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:48.021 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.032+0000 7f033a59c700 1 --2- 172.21.15.42:0/2747680868 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f031c06a630 0x7f031c06cae0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f033000aa50 tx=0x7f0330008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:48.021 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.036+0000 7f032affd700 1 -- 172.21.15.42:0/2747680868 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f032c055150 con 0x7f033c0c6190 2023-07-29T02:07:48.214 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.235+0000 7f0340d5c700 1 -- 172.21.15.42:0/2747680868 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f033c04ea50 con 0x7f033c0c6190 2023-07-29T02:07:48.218 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.239+0000 7f032affd700 1 -- 172.21.15.42:0/2747680868 <== mon.0 v2:172.21.15.42:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f032c055150 con 0x7f033c0c6190 2023-07-29T02:07:48.219 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.240+0000 7f032affd700 1 -- 172.21.15.42:0/2747680868 <== mon.0 v2:172.21.15.42:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f032c058770 con 0x7f033c0c6190 2023-07-29T02:07:48.221 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.242+0000 7f0340d5c700 1 -- 172.21.15.42:0/2747680868 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f031c06a630 msgr2=0x7f031c06cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:48.222 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.242+0000 7f0340d5c700 1 --2- 172.21.15.42:0/2747680868 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f031c06a630 0x7f031c06cae0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f033000aa50 tx=0x7f0330008040 comp rx=0 tx=0).stop 2023-07-29T02:07:48.222 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.242+0000 7f0340d5c700 1 -- 172.21.15.42:0/2747680868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f033c0c6190 msgr2=0x7f033c1ef0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:48.222 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.242+0000 7f0340d5c700 1 --2- 172.21.15.42:0/2747680868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f033c0c6190 0x7f033c1ef0c0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f032c009130 tx=0x7f032c004750 comp rx=0 tx=0).stop 2023-07-29T02:07:48.222 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.242+0000 7f0340d5c700 1 -- 172.21.15.42:0/2747680868 shutdown_connections 2023-07-29T02:07:48.223 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.242+0000 7f0340d5c700 1 --2- 172.21.15.42:0/2747680868 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f031c06a630 0x7f031c06cae0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.223 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.242+0000 7f0340d5c700 1 --2- 172.21.15.42:0/2747680868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f033c159d30 0x7f033c1577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.223 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.242+0000 7f0340d5c700 1 --2- 172.21.15.42:0/2747680868 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f033c0b4250 0x7f033c146db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.223 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.242+0000 7f0340d5c700 1 --2- 172.21.15.42:0/2747680868 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f033c0c6190 0x7f033c1ef0c0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.223 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.242+0000 7f0340d5c700 1 -- 172.21.15.42:0/2747680868 >> 172.21.15.42:0/2747680868 conn(0x7f033c06ca30 msgr2=0x7f033c156ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:48.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.242+0000 7f0340d5c700 1 -- 172.21.15.42:0/2747680868 shutdown_connections 2023-07-29T02:07:48.224 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.242+0000 7f0340d5c700 1 -- 172.21.15.42:0/2747680868 wait complete. 2023-07-29T02:07:48.233 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-29T02:07:48.234 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:07:48.359 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.380+0000 7f834f1f5700 1 Processor -- start 2023-07-29T02:07:48.360 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.380+0000 7f834f1f5700 1 -- start start 2023-07-29T02:07:48.362 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.381+0000 7f834f1f5700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f8348156740 0x7f8348159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:48.362 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.381+0000 7f834f1f5700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f83480710b0 0x7f83480c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:48.362 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.381+0000 7f834f1f5700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83480c9900 con 0x7f83480c8140 2023-07-29T02:07:48.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.381+0000 7f834f1f5700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f834815a210 con 0x7f83480710b0 2023-07-29T02:07:48.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.381+0000 7f834f1f5700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83480c46f0 con 0x7f8348156740 2023-07-29T02:07:48.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.381+0000 7f8347fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f83480710b0 0x7f83480c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:48.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.381+0000 7f8347fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f83480710b0 0x7f83480c4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58644/0 (socket says 172.21.15.42:58644) 2023-07-29T02:07:48.363 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.381+0000 7f8347fff700 1 -- 172.21.15.42:0/4173591957 learned_addr learned my addr 172.21.15.42:0/4173591957 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:07:48.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.381+0000 7f834cf91700 1 --2- 172.21.15.42:0/4173591957 >> v2:172.21.15.144:3300/0 conn(0x7f8348156740 0x7f8348159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:48.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.381+0000 7f8347fff700 1 -- 172.21.15.42:0/4173591957 >> v2:172.21.15.144:3300/0 conn(0x7f8348156740 msgr2=0x7f8348159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:07:48.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.381+0000 7f8347fff700 1 --2- 172.21.15.42:0/4173591957 >> v2:172.21.15.144:3300/0 conn(0x7f8348156740 0x7f8348159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.381+0000 7f8347fff700 1 -- 172.21.15.42:0/4173591957 >> v1:172.21.15.144:6789/0 conn(0x7f83480c8140 legacy=0x7f83480c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:07:48.364 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.381+0000 7f8347fff700 1 -- 172.21.15.42:0/4173591957 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83480c3460 con 0x7f83480710b0 2023-07-29T02:07:48.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.381+0000 7f834cf91700 1 --2- 172.21.15.42:0/4173591957 >> v2:172.21.15.144:3300/0 conn(0x7f8348156740 0x7f8348159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:07:48.366 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.381+0000 7f8347fff700 1 --2- 172.21.15.42:0/4173591957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83480710b0 0x7f83480c4b80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8348074700 tx=0x7f8334009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae89b335ea852fd5 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:48.366 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.382+0000 7f83477fe700 1 -- 172.21.15.42:0/4173591957 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8334004230 con 0x7f83480710b0 2023-07-29T02:07:48.366 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.382+0000 7f83477fe700 1 -- 172.21.15.42:0/4173591957 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8334004390 con 0x7f83480710b0 2023-07-29T02:07:48.366 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.382+0000 7f83477fe700 1 -- 172.21.15.42:0/4173591957 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83340036a0 con 0x7f83480710b0 2023-07-29T02:07:48.367 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.382+0000 7f834f1f5700 1 -- 172.21.15.42:0/4173591957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83480710b0 msgr2=0x7f83480c4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:48.367 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.382+0000 7f834f1f5700 1 --2- 172.21.15.42:0/4173591957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83480710b0 0x7f83480c4b80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8348074700 tx=0x7f8334009bd0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.367 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.382+0000 7f834f1f5700 1 -- 172.21.15.42:0/4173591957 shutdown_connections 2023-07-29T02:07:48.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.382+0000 7f834f1f5700 1 --2- 172.21.15.42:0/4173591957 >> v2:172.21.15.144:3300/0 conn(0x7f8348156740 0x7f8348159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.382+0000 7f834f1f5700 1 --2- 172.21.15.42:0/4173591957 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f83480710b0 0x7f83480c4b80 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.368 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.382+0000 7f834f1f5700 1 -- 172.21.15.42:0/4173591957 >> 172.21.15.42:0/4173591957 conn(0x7f83480c8970 msgr2=0x7f83480c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:48.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.382+0000 7f834f1f5700 1 -- 172.21.15.42:0/4173591957 shutdown_connections 2023-07-29T02:07:48.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.382+0000 7f834f1f5700 1 -- 172.21.15.42:0/4173591957 wait complete. 2023-07-29T02:07:48.371 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.383+0000 7f834f1f5700 1 Processor -- start 2023-07-29T02:07:48.371 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.383+0000 7f834f1f5700 1 -- start start 2023-07-29T02:07:48.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.384+0000 7f834f1f5700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83480710b0 0x7f83480c21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:48.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.384+0000 7f834f1f5700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83480c8140 0x7f83481efbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:48.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.384+0000 7f834f1f5700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8348156740 0x7f83481f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:48.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.384+0000 7f834f1f5700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8348156f50 con 0x7f8348156740 2023-07-29T02:07:48.372 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.384+0000 7f834f1f5700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83480c0b10 con 0x7f83480710b0 2023-07-29T02:07:48.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.384+0000 7f834f1f5700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834806d3f0 con 0x7f83480c8140 2023-07-29T02:07:48.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.384+0000 7f834d792700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8348156740 0x7f83481f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:48.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.385+0000 7f834d792700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8348156740 0x7f83481f0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58652/0 (socket says 172.21.15.42:58652) 2023-07-29T02:07:48.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.385+0000 7f834d792700 1 -- 172.21.15.42:0/622553602 learned_addr learned my addr 172.21.15.42:0/622553602 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:07:48.373 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.385+0000 7f8347fff700 1 --2- 172.21.15.42:0/622553602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83480c8140 0x7f83481efbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:48.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.385+0000 7f834cf91700 1 --2- 172.21.15.42:0/622553602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83480710b0 0x7f83480c21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:48.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.385+0000 7f834d792700 1 -- 172.21.15.42:0/622553602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83480c8140 msgr2=0x7f83481efbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:48.374 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.385+0000 7f834d792700 1 --2- 172.21.15.42:0/622553602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83480c8140 0x7f83481efbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.375 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.385+0000 7f834d792700 1 -- 172.21.15.42:0/622553602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83480710b0 msgr2=0x7f83480c21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:48.375 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.385+0000 7f834d792700 1 --2- 172.21.15.42:0/622553602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83480710b0 0x7f83480c21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.375 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.385+0000 7f834d792700 1 -- 172.21.15.42:0/622553602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8334009550 con 0x7f8348156740 2023-07-29T02:07:48.375 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.385+0000 7f834d792700 1 --2- 172.21.15.42:0/622553602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8348156740 0x7f83481f0120 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f834000cc40 tx=0x7f834000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:48.375 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.385+0000 7f83457fa700 1 -- 172.21.15.42:0/622553602 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834000aa80 con 0x7f8348156740 2023-07-29T02:07:48.376 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.385+0000 7f83457fa700 1 -- 172.21.15.42:0/622553602 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f834000abe0 con 0x7f8348156740 2023-07-29T02:07:48.376 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.385+0000 7f83457fa700 1 -- 172.21.15.42:0/622553602 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340012420 con 0x7f8348156740 2023-07-29T02:07:48.376 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.385+0000 7f834f1f5700 1 -- 172.21.15.42:0/622553602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8348156c90 con 0x7f8348156740 2023-07-29T02:07:48.376 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.385+0000 7f834f1f5700 1 -- 172.21.15.42:0/622553602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f834806cda0 con 0x7f8348156740 2023-07-29T02:07:48.376 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.386+0000 7f834f1f5700 1 -- 172.21.15.42:0/622553602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834806c920 con 0x7f8348156740 2023-07-29T02:07:48.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.387+0000 7f83457fa700 1 -- 172.21.15.42:0/622553602 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f8340012580 con 0x7f8348156740 2023-07-29T02:07:48.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.387+0000 7f83457fa700 1 --2- 172.21.15.42:0/622553602 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f832c06a660 0x7f832c06cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:48.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.387+0000 7f83457fa700 1 -- 172.21.15.42:0/622553602 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f8340089500 con 0x7f8348156740 2023-07-29T02:07:48.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.387+0000 7f834cf91700 1 --2- 172.21.15.42:0/622553602 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f832c06a660 0x7f832c06cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:48.377 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.388+0000 7f834cf91700 1 --2- 172.21.15.42:0/622553602 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f832c06a660 0x7f832c06cb10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f833c0099c0 tx=0x7f833c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:48.378 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.391+0000 7f83457fa700 1 -- 172.21.15.42:0/622553602 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f834806c920 con 0x7f8348156740 2023-07-29T02:07:48.620 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.641+0000 7f834f1f5700 1 -- 172.21.15.42:0/622553602 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f834806c920 con 0x7f8348156740 2023-07-29T02:07:48.621 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.641+0000 7f83457fa700 1 -- 172.21.15.42:0/622553602 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+6169 (secure 0 0 0) 0x7f834806c920 con 0x7f8348156740 2023-07-29T02:07:48.621 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:07:48.622 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5394,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/3070427916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3070427916},{"type":"v1","addr":"172.21.15.42:6837","nonce":3070427916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:04:39.593871+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4874":{"gid":4874,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":30,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:07:48.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.643+0000 7f834f1f5700 1 -- 172.21.15.42:0/622553602 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f832c06a660 msgr2=0x7f832c06cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:48.623 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.643+0000 7f834f1f5700 1 --2- 172.21.15.42:0/622553602 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f832c06a660 0x7f832c06cb10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f833c0099c0 tx=0x7f833c008040 comp rx=0 tx=0).stop 2023-07-29T02:07:48.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.643+0000 7f834f1f5700 1 -- 172.21.15.42:0/622553602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8348156740 msgr2=0x7f83481f0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:48.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.643+0000 7f834f1f5700 1 --2- 172.21.15.42:0/622553602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8348156740 0x7f83481f0120 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f834000cc40 tx=0x7f834000cf50 comp rx=0 tx=0).stop 2023-07-29T02:07:48.624 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.644+0000 7f834f1f5700 1 -- 172.21.15.42:0/622553602 shutdown_connections 2023-07-29T02:07:48.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.644+0000 7f834f1f5700 1 --2- 172.21.15.42:0/622553602 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f832c06a660 0x7f832c06cb10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.644+0000 7f834f1f5700 1 --2- 172.21.15.42:0/622553602 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f8348156740 0x7f83481f0120 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.625 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.644+0000 7f834f1f5700 1 --2- 172.21.15.42:0/622553602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83480710b0 0x7f83480c21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.626 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.644+0000 7f834f1f5700 1 --2- 172.21.15.42:0/622553602 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f83480c8140 0x7f83481efbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.626 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.644+0000 7f834f1f5700 1 -- 172.21.15.42:0/622553602 >> 172.21.15.42:0/622553602 conn(0x7f83480c8970 msgr2=0x7f83480c6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:48.626 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.644+0000 7f834f1f5700 1 -- 172.21.15.42:0/622553602 shutdown_connections 2023-07-29T02:07:48.626 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.644+0000 7f834f1f5700 1 -- 172.21.15.42:0/622553602 wait complete. 2023-07-29T02:07:48.627 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 25 2023-07-29T02:07:48.635 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-29T02:07:48.760 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.781+0000 7fbebb99c700 1 Processor -- start 2023-07-29T02:07:48.761 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.781+0000 7fbebb99c700 1 -- start start 2023-07-29T02:07:48.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.782+0000 7fbebb99c700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbeb414f7d0 0x7fbeb406a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:48.762 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.782+0000 7fbebb99c700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fbeb40c6850 0x7fbeb4159260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:48.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.782+0000 7fbebb99c700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb40c77a0 con 0x7fbeb40c6000 2023-07-29T02:07:48.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.782+0000 7fbebb99c700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb40c7fb0 con 0x7fbeb414f7d0 2023-07-29T02:07:48.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.782+0000 7fbebb99c700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb41597a0 con 0x7fbeb40c6850 2023-07-29T02:07:48.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.782+0000 7fbeb9738700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbeb414f7d0 0x7fbeb406a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:48.763 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.782+0000 7fbeb9738700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fbeb414f7d0 0x7fbeb406a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58656/0 (socket says 172.21.15.42:58656) 2023-07-29T02:07:48.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.782+0000 7fbeb9738700 1 -- 172.21.15.42:0/2600989205 learned_addr learned my addr 172.21.15.42:0/2600989205 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:07:48.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.782+0000 7fbeb9f39700 1 --2- 172.21.15.42:0/2600989205 >> v2:172.21.15.144:3300/0 conn(0x7fbeb40c6850 0x7fbeb4159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:48.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.782+0000 7fbeb9738700 1 -- 172.21.15.42:0/2600989205 >> v2:172.21.15.144:3300/0 conn(0x7fbeb40c6850 msgr2=0x7fbeb4159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:07:48.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.782+0000 7fbeb9738700 1 --2- 172.21.15.42:0/2600989205 >> v2:172.21.15.144:3300/0 conn(0x7fbeb40c6850 0x7fbeb4159260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.764 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.782+0000 7fbeb9738700 1 -- 172.21.15.42:0/2600989205 >> v1:172.21.15.144:6789/0 conn(0x7fbeb40c6000 legacy=0x7fbeb4158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:48.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.782+0000 7fbeb9738700 1 -- 172.21.15.42:0/2600989205 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb4071410 con 0x7fbeb414f7d0 2023-07-29T02:07:48.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.782+0000 7fbeb9738700 1 --2- 172.21.15.42:0/2600989205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeb414f7d0 0x7fbeb406a750 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbeb40c2b40 tx=0x7fbeb0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3c1858bdd7650d server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:48.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.783+0000 7fbeabfff700 1 -- 172.21.15.42:0/2600989205 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0011830 con 0x7fbeb414f7d0 2023-07-29T02:07:48.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.783+0000 7fbeabfff700 1 -- 172.21.15.42:0/2600989205 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbeb0011990 con 0x7fbeb414f7d0 2023-07-29T02:07:48.765 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.783+0000 7fbeabfff700 1 -- 172.21.15.42:0/2600989205 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0011d40 con 0x7fbeb414f7d0 2023-07-29T02:07:48.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.783+0000 7fbebb99c700 1 -- 172.21.15.42:0/2600989205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeb414f7d0 msgr2=0x7fbeb406a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:48.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.783+0000 7fbebb99c700 1 --2- 172.21.15.42:0/2600989205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeb414f7d0 0x7fbeb406a750 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fbeb40c2b40 tx=0x7fbeb0009c00 comp rx=0 tx=0).stop 2023-07-29T02:07:48.768 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.783+0000 7fbebb99c700 1 -- 172.21.15.42:0/2600989205 shutdown_connections 2023-07-29T02:07:48.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.783+0000 7fbebb99c700 1 --2- 172.21.15.42:0/2600989205 >> v2:172.21.15.144:3300/0 conn(0x7fbeb40c6850 0x7fbeb4159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.783+0000 7fbebb99c700 1 --2- 172.21.15.42:0/2600989205 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeb414f7d0 0x7fbeb406a750 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.783+0000 7fbebb99c700 1 -- 172.21.15.42:0/2600989205 >> 172.21.15.42:0/2600989205 conn(0x7fbeb40cc360 msgr2=0x7fbeb40c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:48.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.783+0000 7fbebb99c700 1 -- 172.21.15.42:0/2600989205 shutdown_connections 2023-07-29T02:07:48.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.783+0000 7fbebb99c700 1 -- 172.21.15.42:0/2600989205 wait complete. 2023-07-29T02:07:48.769 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.784+0000 7fbebb99c700 1 Processor -- start 2023-07-29T02:07:48.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.785+0000 7fbebb99c700 1 -- start start 2023-07-29T02:07:48.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.785+0000 7fbebb99c700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbeb40c6000 0x7fbeb40c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:48.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.785+0000 7fbebb99c700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeb40c6850 0x7fbeb4156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:48.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.785+0000 7fbebb99c700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbeb414f7d0 0x7fbeb40c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:48.770 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.785+0000 7fbebb99c700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb4158440 con 0x7fbeb40c6850 2023-07-29T02:07:48.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.785+0000 7fbebb99c700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb413c840 con 0x7fbeb40c6000 2023-07-29T02:07:48.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.785+0000 7fbebb99c700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb40c42c0 con 0x7fbeb414f7d0 2023-07-29T02:07:48.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.785+0000 7fbeb8f37700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeb40c6850 0x7fbeb4156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:48.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.785+0000 7fbeb8f37700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeb40c6850 0x7fbeb4156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58664/0 (socket says 172.21.15.42:58664) 2023-07-29T02:07:48.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.785+0000 7fbeb8f37700 1 -- 172.21.15.42:0/6469000 learned_addr learned my addr 172.21.15.42:0/6469000 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:07:48.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.786+0000 7fbeb9738700 1 --2- 172.21.15.42:0/6469000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbeb40c6000 0x7fbeb40c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:48.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.786+0000 7fbeb8f37700 1 -- 172.21.15.42:0/6469000 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbeb414f7d0 msgr2=0x7fbeb40c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:48.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.786+0000 7fbeb8f37700 1 --2- 172.21.15.42:0/6469000 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbeb414f7d0 0x7fbeb40c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.772 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.786+0000 7fbeb8f37700 1 -- 172.21.15.42:0/6469000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbeb40c6000 msgr2=0x7fbeb40c3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:48.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.786+0000 7fbeb8f37700 1 --2- 172.21.15.42:0/6469000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbeb40c6000 0x7fbeb40c3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:48.773 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.786+0000 7fbeb8f37700 1 -- 172.21.15.42:0/6469000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb0009550 con 0x7fbeb40c6850 2023-07-29T02:07:48.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.786+0000 7fbeb8f37700 1 --2- 172.21.15.42:0/6469000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeb40c6850 0x7fbeb4156990 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fbea400c490 tx=0x7fbea400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:48.774 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.786+0000 7fbea9ffb700 1 -- 172.21.15.42:0/6469000 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea40052d0 con 0x7fbeb40c6850 2023-07-29T02:07:48.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.786+0000 7fbea9ffb700 1 -- 172.21.15.42:0/6469000 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbea4005430 con 0x7fbeb40c6850 2023-07-29T02:07:48.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.786+0000 7fbebb99c700 1 -- 172.21.15.42:0/6469000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb413ca70 con 0x7fbeb40c6850 2023-07-29T02:07:48.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.786+0000 7fbea9ffb700 1 -- 172.21.15.42:0/6469000 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea40038e0 con 0x7fbeb40c6850 2023-07-29T02:07:48.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.786+0000 7fbebb99c700 1 -- 172.21.15.42:0/6469000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb4158060 con 0x7fbeb40c6850 2023-07-29T02:07:48.775 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.787+0000 7fbebb99c700 1 -- 172.21.15.42:0/6469000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb413cf90 con 0x7fbeb40c6850 2023-07-29T02:07:48.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.788+0000 7fbea9ffb700 1 -- 172.21.15.42:0/6469000 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fbea4003a40 con 0x7fbeb40c6850 2023-07-29T02:07:48.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.788+0000 7fbea9ffb700 1 --2- 172.21.15.42:0/6469000 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbe9806a690 0x7fbe9806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:48.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.788+0000 7fbea9ffb700 1 -- 172.21.15.42:0/6469000 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7fbea40883e0 con 0x7fbeb40c6850 2023-07-29T02:07:48.776 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.788+0000 7fbeb9738700 1 --2- 172.21.15.42:0/6469000 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbe9806a690 0x7fbe9806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:48.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.789+0000 7fbeb9738700 1 --2- 172.21.15.42:0/6469000 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbe9806a690 0x7fbe9806cb40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0014040 tx=0x7fbeb0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:48.777 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:48.793+0000 7fbea9ffb700 1 -- 172.21.15.42:0/6469000 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fbeb413cf90 con 0x7fbeb40c6850 2023-07-29T02:07:49.013 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.034+0000 7fbebb99c700 1 -- 172.21.15.42:0/6469000 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbeb413cf90 con 0x7fbeb40c6850 2023-07-29T02:07:49.014 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.034+0000 7fbea9ffb700 1 -- 172.21.15.42:0/6469000 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+6169 (secure 0 0 0) 0x7fbeb413cf90 con 0x7fbeb40c6850 2023-07-29T02:07:49.014 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:07:49.014 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6833/3242692321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6832","nonce":3242692321},{"type":"v1","addr":"172.21.15.42:6833","nonce":3242692321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6835/1860885615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6834","nonce":1860885615},{"type":"v1","addr":"172.21.15.42:6835","nonce":1860885615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4291,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/400694688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":400694688},{"type":"v1","addr":"172.21.15.144:6835","nonce":400694688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6838/2604441175","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":2604441175},{"type":"v1","addr":"172.21.15.144:6838","nonce":2604441175}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":5394,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.42:6837/3070427916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6836","nonce":3070427916},{"type":"v1","addr":"172.21.15.42:6837","nonce":3070427916}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-29T01:59:57.946839+0000","modified":"2023-07-29T02:04:39.593871+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":39,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4874},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4874":{"gid":4874,"name":"d","rank":0,"incarnation":21,"state":"up:active","state_seq":30,"addr":"172.21.15.144:6839/4219857785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6837","nonce":4219857785},{"type":"v1","addr":"172.21.15.144:6839","nonce":4219857785}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-29T02:07:49.016 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.036+0000 7fbebb99c700 1 -- 172.21.15.42:0/6469000 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbe9806a690 msgr2=0x7fbe9806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:49.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.036+0000 7fbebb99c700 1 --2- 172.21.15.42:0/6469000 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbe9806a690 0x7fbe9806cb40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0014040 tx=0x7fbeb0008030 comp rx=0 tx=0).stop 2023-07-29T02:07:49.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.036+0000 7fbebb99c700 1 -- 172.21.15.42:0/6469000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeb40c6850 msgr2=0x7fbeb4156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:49.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.036+0000 7fbebb99c700 1 --2- 172.21.15.42:0/6469000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeb40c6850 0x7fbeb4156990 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fbea400c490 tx=0x7fbea400c850 comp rx=0 tx=0).stop 2023-07-29T02:07:49.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.036+0000 7fbebb99c700 1 -- 172.21.15.42:0/6469000 shutdown_connections 2023-07-29T02:07:49.017 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.036+0000 7fbebb99c700 1 --2- 172.21.15.42:0/6469000 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fbe9806a690 0x7fbe9806cb40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:49.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.036+0000 7fbebb99c700 1 --2- 172.21.15.42:0/6469000 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fbeb414f7d0 0x7fbeb40c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:49.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.036+0000 7fbebb99c700 1 --2- 172.21.15.42:0/6469000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbeb40c6000 0x7fbeb40c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:49.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.036+0000 7fbebb99c700 1 --2- 172.21.15.42:0/6469000 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fbeb40c6850 0x7fbeb4156990 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:49.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.036+0000 7fbebb99c700 1 -- 172.21.15.42:0/6469000 >> 172.21.15.42:0/6469000 conn(0x7fbeb40cc360 msgr2=0x7fbeb40707d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:49.018 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.037+0000 7fbebb99c700 1 -- 172.21.15.42:0/6469000 shutdown_connections 2023-07-29T02:07:49.019 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.037+0000 7fbebb99c700 1 -- 172.21.15.42:0/6469000 wait complete. 2023-07-29T02:07:49.019 INFO:teuthology.orchestra.run.smithi042.stderr:dumped fsmap epoch 25 2023-07-29T02:07:49.028 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-29T02:07:49.152 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.173+0000 7effe2eca700 1 Processor -- start 2023-07-29T02:07:49.153 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.173+0000 7effe2eca700 1 -- start start 2023-07-29T02:07:49.154 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.174+0000 7effe2eca700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7effdc06bea0 0x7effdc159da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:49.154 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.174+0000 7effe2eca700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effdc0709f0 con 0x7effdc0c8d70 2023-07-29T02:07:49.155 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.174+0000 7effe2eca700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effdc061830 con 0x7effdc06bad0 2023-07-29T02:07:49.155 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.174+0000 7effe2eca700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effdc0c5ff0 con 0x7effdc06bea0 2023-07-29T02:07:49.155 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.174+0000 7effe1467700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7effdc0c8d70 0x7effdc14fc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52478/0 (socket says 172.21.15.42:52478) 2023-07-29T02:07:49.155 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.174+0000 7effe1467700 1 -- 172.21.15.42:0/793237287 learned_addr learned my addr 172.21.15.42:0/793237287 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:07:49.155 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.174+0000 7effdbfff700 1 --2- 172.21.15.42:0/793237287 >> v2:172.21.15.144:3300/0 conn(0x7effdc06bea0 0x7effdc159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:49.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.174+0000 7effdb7fe700 1 -- 172.21.15.42:0/793237287 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090950960 0 0) 0x7effdc0709f0 con 0x7effdc0c8d70 2023-07-29T02:07:49.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.174+0000 7effdb7fe700 1 -- 172.21.15.42:0/793237287 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effcc0035b0 con 0x7effdc0c8d70 2023-07-29T02:07:49.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.174+0000 7effdbfff700 1 -- 172.21.15.42:0/793237287 >> v1:172.21.15.144:6789/0 conn(0x7effdc06bad0 legacy=0x7effdc0c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:49.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.174+0000 7effdb7fe700 1 -- 172.21.15.42:0/793237287 <== mon.0 v1:172.21.15.42:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4264387583 0 0) 0x7effcc0035b0 con 0x7effdc0c8d70 2023-07-29T02:07:49.156 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.174+0000 7effdbfff700 1 -- 172.21.15.42:0/793237287 >> v1:172.21.15.42:6789/0 conn(0x7effdc0c8d70 legacy=0x7effdc14fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:49.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.174+0000 7effdbfff700 1 -- 172.21.15.42:0/793237287 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effdc0c7910 con 0x7effdc06bea0 2023-07-29T02:07:49.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.175+0000 7effdbfff700 1 --2- 172.21.15.42:0/793237287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effdc06bea0 0x7effdc159da0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7effc8009840 tx=0x7effc8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0924bba670d15b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:49.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.175+0000 7effdb7fe700 1 -- 172.21.15.42:0/793237287 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd40019f0 con 0x7effdc06bea0 2023-07-29T02:07:49.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.175+0000 7effdb7fe700 1 -- 172.21.15.42:0/793237287 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7effc8004030 con 0x7effdc06bea0 2023-07-29T02:07:49.157 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.175+0000 7effdb7fe700 1 -- 172.21.15.42:0/793237287 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc80043e0 con 0x7effdc06bea0 2023-07-29T02:07:49.160 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.175+0000 7effe2eca700 1 -- 172.21.15.42:0/793237287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effdc06bea0 msgr2=0x7effdc159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:49.160 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.175+0000 7effe2eca700 1 --2- 172.21.15.42:0/793237287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effdc06bea0 0x7effdc159da0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7effc8009840 tx=0x7effc8009b50 comp rx=0 tx=0).stop 2023-07-29T02:07:49.160 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.175+0000 7effe2eca700 1 -- 172.21.15.42:0/793237287 shutdown_connections 2023-07-29T02:07:49.161 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.175+0000 7effe2eca700 1 --2- 172.21.15.42:0/793237287 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effdc06bea0 0x7effdc159da0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:49.161 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.175+0000 7effe2eca700 1 -- 172.21.15.42:0/793237287 >> 172.21.15.42:0/793237287 conn(0x7effdc0cc360 msgr2=0x7effdc0c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:49.161 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.175+0000 7effe2eca700 1 -- 172.21.15.42:0/793237287 shutdown_connections 2023-07-29T02:07:49.161 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.175+0000 7effe2eca700 1 -- 172.21.15.42:0/793237287 wait complete. 2023-07-29T02:07:49.161 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.176+0000 7effe2eca700 1 Processor -- start 2023-07-29T02:07:49.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.177+0000 7effe2eca700 1 -- start start 2023-07-29T02:07:49.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.177+0000 7effe2eca700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effdc06bad0 0x7effdc140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:49.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.177+0000 7effe2eca700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effdc06bea0 0x7effdc0c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:49.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.177+0000 7effe2eca700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effdc0c8d70 0x7effdc0c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:49.162 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.177+0000 7effe2eca700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effdc0c9f90 con 0x7effdc06bad0 2023-07-29T02:07:49.163 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.177+0000 7effe2eca700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effdc0ca480 con 0x7effdc06bea0 2023-07-29T02:07:49.163 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.177+0000 7effe2eca700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effdc0ca1a0 con 0x7effdc0c8d70 2023-07-29T02:07:49.163 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.177+0000 7effe0c66700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effdc06bad0 0x7effdc140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:49.163 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.178+0000 7effe0c66700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effdc06bad0 0x7effdc140d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58676/0 (socket says 172.21.15.42:58676) 2023-07-29T02:07:49.163 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.178+0000 7effe0c66700 1 -- 172.21.15.42:0/520280604 learned_addr learned my addr 172.21.15.42:0/520280604 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:07:49.164 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.178+0000 7effe1467700 1 --2- 172.21.15.42:0/520280604 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effdc0c8d70 0x7effdc0c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:49.164 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.178+0000 7effdbfff700 1 --2- 172.21.15.42:0/520280604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effdc06bea0 0x7effdc0c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:49.164 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.178+0000 7effe0c66700 1 -- 172.21.15.42:0/520280604 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effdc0c8d70 msgr2=0x7effdc0c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:49.164 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.178+0000 7effe0c66700 1 --2- 172.21.15.42:0/520280604 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effdc0c8d70 0x7effdc0c4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:49.164 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.178+0000 7effe0c66700 1 -- 172.21.15.42:0/520280604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effdc06bea0 msgr2=0x7effdc0c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:49.165 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.178+0000 7effe0c66700 1 --2- 172.21.15.42:0/520280604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effdc06bea0 0x7effdc0c4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:49.165 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.178+0000 7effe0c66700 1 -- 172.21.15.42:0/520280604 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc80094a0 con 0x7effdc06bad0 2023-07-29T02:07:49.165 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.178+0000 7effe1467700 1 --2- 172.21.15.42:0/520280604 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effdc0c8d70 0x7effdc0c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-29T02:07:49.165 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.178+0000 7effe0c66700 1 --2- 172.21.15.42:0/520280604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effdc06bad0 0x7effdc140d00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7effd000c4e0 tx=0x7effd000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:49.165 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.178+0000 7effd97fa700 1 -- 172.21.15.42:0/520280604 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd00052d0 con 0x7effdc06bad0 2023-07-29T02:07:49.166 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.178+0000 7effd97fa700 1 -- 172.21.15.42:0/520280604 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7effd0005430 con 0x7effdc06bad0 2023-07-29T02:07:49.166 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.178+0000 7effe2eca700 1 -- 172.21.15.42:0/520280604 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effdc1e3370 con 0x7effdc06bad0 2023-07-29T02:07:49.166 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.178+0000 7effd97fa700 1 -- 172.21.15.42:0/520280604 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd00038e0 con 0x7effdc06bad0 2023-07-29T02:07:49.166 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.178+0000 7effe2eca700 1 -- 172.21.15.42:0/520280604 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effdc1e3930 con 0x7effdc06bad0 2023-07-29T02:07:49.166 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.179+0000 7effe2eca700 1 -- 172.21.15.42:0/520280604 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effdc1e3b20 con 0x7effdc06bad0 2023-07-29T02:07:49.167 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.180+0000 7effd97fa700 1 -- 172.21.15.42:0/520280604 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7effd0003a40 con 0x7effdc06bad0 2023-07-29T02:07:49.167 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.180+0000 7effd97fa700 1 --2- 172.21.15.42:0/520280604 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7effc006a690 0x7effc006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:49.167 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.180+0000 7effd97fa700 1 -- 172.21.15.42:0/520280604 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7effd0088430 con 0x7effdc06bad0 2023-07-29T02:07:49.167 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.180+0000 7effdbfff700 1 --2- 172.21.15.42:0/520280604 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7effc006a690 0x7effc006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:49.167 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.181+0000 7effdbfff700 1 --2- 172.21.15.42:0/520280604 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7effc006a690 0x7effc006cb40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7effdc14f8d0 tx=0x7effc8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:49.168 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.185+0000 7effd97fa700 1 -- 172.21.15.42:0/520280604 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7effd0053410 con 0x7effdc06bad0 2023-07-29T02:07:49.365 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.386+0000 7effe2eca700 1 -- 172.21.15.42:0/520280604 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effdc04ea50 con 0x7effdc06bad0 2023-07-29T02:07:49.366 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.387+0000 7effd97fa700 1 -- 172.21.15.42:0/520280604 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+20196 (secure 0 0 0) 0x7effd0056a30 con 0x7effdc06bad0 2023-07-29T02:07:49.367 INFO:teuthology.orchestra.run.smithi042.stdout: 2023-07-29T02:07:49.367 INFO:teuthology.orchestra.run.smithi042.stdout:{"epoch":39,"fsid":"f97a53ee-a392-4212-b8f0-a81cb72fe6f6","created":"2023-07-29T01:59:39.621017+0000","modified":"2023-07-29T02:04:19.439695+0000","last_up_change":"2023-07-29T01:59:49.293663+0000","last_in_change":"2023-07-29T01:59:42.057866+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-29T01:59:50.906228+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-29T01:59:51.290583+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-29T01:59:55.827461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-29T01:59:56.924040+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-29T01:59:59.996470+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"fdf64905-a76d-4d05-b23e-22a6d0792e2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6816","nonce":131312},{"type":"v1","addr":"172.21.15.42:6817","nonce":131312}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6818","nonce":131312},{"type":"v1","addr":"172.21.15.42:6819","nonce":131312}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6822","nonce":131312},{"type":"v1","addr":"172.21.15.42:6823","nonce":131312}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6820","nonce":131312},{"type":"v1","addr":"172.21.15.42:6821","nonce":131312}]},"public_addr":"172.21.15.42:6817/131312","cluster_addr":"172.21.15.42:6819/131312","heartbeat_back_addr":"172.21.15.42:6823/131312","heartbeat_front_addr":"172.21.15.42:6821/131312","state":["exists","up"]},{"osd":1,"uuid":"e36fc394-42da-4732-87b2-b7fa6b2d4d0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6800","nonce":131311},{"type":"v1","addr":"172.21.15.42:6801","nonce":131311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6802","nonce":131311},{"type":"v1","addr":"172.21.15.42:6803","nonce":131311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6806","nonce":131311},{"type":"v1","addr":"172.21.15.42:6807","nonce":131311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6804","nonce":131311},{"type":"v1","addr":"172.21.15.42:6805","nonce":131311}]},"public_addr":"172.21.15.42:6801/131311","cluster_addr":"172.21.15.42:6803/131311","heartbeat_back_addr":"172.21.15.42:6807/131311","heartbeat_front_addr":"172.21.15.42:6805/131311","state":["exists","up"]},{"osd":2,"uuid":"b99ddaf3-1eae-419d-a886-c573ba210780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6808","nonce":131313},{"type":"v1","addr":"172.21.15.42:6809","nonce":131313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6810","nonce":131313},{"type":"v1","addr":"172.21.15.42:6811","nonce":131313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6814","nonce":131313},{"type":"v1","addr":"172.21.15.42:6815","nonce":131313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6812","nonce":131313},{"type":"v1","addr":"172.21.15.42:6813","nonce":131313}]},"public_addr":"172.21.15.42:6809/131313","cluster_addr":"172.21.15.42:6811/131313","heartbeat_back_addr":"172.21.15.42:6815/131313","heartbeat_front_addr":"172.21.15.42:6813/131313","state":["exists","up"]},{"osd":3,"uuid":"b5076220-edcf-4760-9a01-946dd8a781cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6824","nonce":131326},{"type":"v1","addr":"172.21.15.42:6825","nonce":131326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6826","nonce":131326},{"type":"v1","addr":"172.21.15.42:6827","nonce":131326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6830","nonce":131326},{"type":"v1","addr":"172.21.15.42:6831","nonce":131326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.42:6828","nonce":131326},{"type":"v1","addr":"172.21.15.42:6829","nonce":131326}]},"public_addr":"172.21.15.42:6825/131326","cluster_addr":"172.21.15.42:6827/131326","heartbeat_back_addr":"172.21.15.42:6831/131326","heartbeat_front_addr":"172.21.15.42:6829/131326","state":["exists","up"]},{"osd":4,"uuid":"d5d15d77-8516-41ab-882b-c16450be0603","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":131482},{"type":"v1","addr":"172.21.15.144:6801","nonce":131482}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":131482},{"type":"v1","addr":"172.21.15.144:6803","nonce":131482}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":131482},{"type":"v1","addr":"172.21.15.144:6807","nonce":131482}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":131482},{"type":"v1","addr":"172.21.15.144:6805","nonce":131482}]},"public_addr":"172.21.15.144:6801/131482","cluster_addr":"172.21.15.144:6803/131482","heartbeat_back_addr":"172.21.15.144:6807/131482","heartbeat_front_addr":"172.21.15.144:6805/131482","state":["exists","up"]},{"osd":5,"uuid":"1d18158d-082a-4454-a171-799298ba0005","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":131483},{"type":"v1","addr":"172.21.15.144:6809","nonce":131483}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":131483},{"type":"v1","addr":"172.21.15.144:6811","nonce":131483}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":131483},{"type":"v1","addr":"172.21.15.144:6815","nonce":131483}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":131483},{"type":"v1","addr":"172.21.15.144:6813","nonce":131483}]},"public_addr":"172.21.15.144:6809/131483","cluster_addr":"172.21.15.144:6811/131483","heartbeat_back_addr":"172.21.15.144:6815/131483","heartbeat_front_addr":"172.21.15.144:6813/131483","state":["exists","up"]},{"osd":6,"uuid":"84894abb-9795-4cc8-bc72-8f6c0767e93a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":131504},{"type":"v1","addr":"172.21.15.144:6825","nonce":131504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":131504},{"type":"v1","addr":"172.21.15.144:6827","nonce":131504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":131504},{"type":"v1","addr":"172.21.15.144:6831","nonce":131504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":131504},{"type":"v1","addr":"172.21.15.144:6829","nonce":131504}]},"public_addr":"172.21.15.144:6825/131504","cluster_addr":"172.21.15.144:6827/131504","heartbeat_back_addr":"172.21.15.144:6831/131504","heartbeat_front_addr":"172.21.15.144:6829/131504","state":["exists","up"]},{"osd":7,"uuid":"74d10cab-82c0-4da4-b971-365cd3885bb3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":131507},{"type":"v1","addr":"172.21.15.144:6817","nonce":131507}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":131507},{"type":"v1","addr":"172.21.15.144:6819","nonce":131507}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":131507},{"type":"v1","addr":"172.21.15.144:6823","nonce":131507}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":131507},{"type":"v1","addr":"172.21.15.144:6821","nonce":131507}]},"public_addr":"172.21.15.144:6817/131507","cluster_addr":"172.21.15.144:6819/131507","heartbeat_back_addr":"172.21.15.144:6823/131507","heartbeat_front_addr":"172.21.15.144:6821/131507","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.226751+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.256842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.290012+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.225418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.270005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.214327+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.305773+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-29T01:59:47.340380+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":3,"to":2},{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.42:6836/2695599859":"2023-07-30T02:04:19.439641+0000","172.21.15.42:6837/2695599859":"2023-07-30T02:04:19.439641+0000","172.21.15.144:6837/3824722756":"2023-07-30T02:02:24.415811+0000","172.21.15.42:6836/1851767861":"2023-07-30T02:01:34.406178+0000","172.21.15.144:6839/3824722756":"2023-07-30T02:02:24.415811+0000","172.21.15.42:6837/1851767861":"2023-07-30T02:01:34.406178+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-29T02:07:49.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.389+0000 7effe2eca700 1 -- 172.21.15.42:0/520280604 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7effc006a690 msgr2=0x7effc006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:49.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.389+0000 7effe2eca700 1 --2- 172.21.15.42:0/520280604 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7effc006a690 0x7effc006cb40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7effdc14f8d0 tx=0x7effc8008030 comp rx=0 tx=0).stop 2023-07-29T02:07:49.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.389+0000 7effe2eca700 1 -- 172.21.15.42:0/520280604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effdc06bad0 msgr2=0x7effdc140d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:49.369 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.389+0000 7effe2eca700 1 --2- 172.21.15.42:0/520280604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effdc06bad0 0x7effdc140d00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7effd000c4e0 tx=0x7effd000c8a0 comp rx=0 tx=0).stop 2023-07-29T02:07:49.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.389+0000 7effe2eca700 1 -- 172.21.15.42:0/520280604 shutdown_connections 2023-07-29T02:07:49.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.389+0000 7effe2eca700 1 --2- 172.21.15.42:0/520280604 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7effc006a690 0x7effc006cb40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:49.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.389+0000 7effe2eca700 1 --2- 172.21.15.42:0/520280604 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7effdc0c8d70 0x7effdc0c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:49.370 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.389+0000 7effe2eca700 1 --2- 172.21.15.42:0/520280604 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7effdc06bad0 0x7effdc140d00 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:49.371 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.389+0000 7effe2eca700 1 --2- 172.21.15.42:0/520280604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effdc06bea0 0x7effdc0c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:49.371 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.389+0000 7effe2eca700 1 -- 172.21.15.42:0/520280604 >> 172.21.15.42:0/520280604 conn(0x7effdc0cc360 msgr2=0x7effdc152a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:49.371 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.389+0000 7effe2eca700 1 -- 172.21.15.42:0/520280604 shutdown_connections 2023-07-29T02:07:49.371 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.389+0000 7effe2eca700 1 -- 172.21.15.42:0/520280604 wait complete. 2023-07-29T02:07:49.381 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-29T02:07:49.507 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.528+0000 7f5d90982700 1 Processor -- start 2023-07-29T02:07:49.508 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.528+0000 7f5d90982700 1 -- start start 2023-07-29T02:07:49.511 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.529+0000 7f5d90982700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f5d8c0b2950 0x7f5d8c0c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:49.512 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.529+0000 7f5d90982700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d8c0b2d20 0x7f5d8c150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:49.512 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.529+0000 7f5d90982700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5d8c0ca6d0 0x7f5d8c1513f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:49.513 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.529+0000 7f5d90982700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d8c0c1f40 con 0x7f5d8c0ca6d0 2023-07-29T02:07:49.513 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.529+0000 7f5d90982700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d8c0c4150 con 0x7f5d8c0b2950 2023-07-29T02:07:49.513 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.529+0000 7f5d90982700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c0ca040 con 0x7f5d8c0b2d20 2023-07-29T02:07:49.514 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.529+0000 7f5d8ad9d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5d8c0ca6d0 0x7f5d8c1513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:49.514 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.529+0000 7f5d8ad9d700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f5d8c0ca6d0 0x7f5d8c1513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58688/0 (socket says 172.21.15.42:58688) 2023-07-29T02:07:49.514 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.529+0000 7f5d8ad9d700 1 -- 172.21.15.42:0/3883205368 learned_addr learned my addr 172.21.15.42:0/3883205368 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:07:49.515 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.529+0000 7f5d8a59c700 1 --2- 172.21.15.42:0/3883205368 >> v2:172.21.15.144:3300/0 conn(0x7f5d8c0b2950 0x7f5d8c0c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:49.515 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.529+0000 7f5d89d9b700 1 --2- 172.21.15.42:0/3883205368 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d8c0b2d20 0x7f5d8c150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:49.516 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.529+0000 7f5d8ad9d700 1 -- 172.21.15.42:0/3883205368 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d8c0b2d20 msgr2=0x7f5d8c150eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:07:49.516 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.529+0000 7f5d8ad9d700 1 --2- 172.21.15.42:0/3883205368 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d8c0b2d20 0x7f5d8c150eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:49.516 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.529+0000 7f5d8ad9d700 1 -- 172.21.15.42:0/3883205368 >> v2:172.21.15.144:3300/0 conn(0x7f5d8c0b2950 msgr2=0x7f5d8c0c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:07:49.517 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.529+0000 7f5d8ad9d700 1 --2- 172.21.15.42:0/3883205368 >> v2:172.21.15.144:3300/0 conn(0x7f5d8c0b2950 0x7f5d8c0c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:49.517 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.529+0000 7f5d8ad9d700 1 -- 172.21.15.42:0/3883205368 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c0ca320 con 0x7f5d8c0ca6d0 2023-07-29T02:07:49.517 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.529+0000 7f5d8ad9d700 1 --2- 172.21.15.42:0/3883205368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0ca6d0 0x7f5d8c1513f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c072f50 tx=0x7f5d8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c6e3dc481b1dfc server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:49.518 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.531+0000 7f5d8959a700 1 -- 172.21.15.42:0/3883205368 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8400e070 con 0x7f5d8c0ca6d0 2023-07-29T02:07:49.518 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.531+0000 7f5d8959a700 1 -- 172.21.15.42:0/3883205368 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5d8400b910 con 0x7f5d8c0ca6d0 2023-07-29T02:07:49.519 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.531+0000 7f5d8959a700 1 -- 172.21.15.42:0/3883205368 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8400bce0 con 0x7f5d8c0ca6d0 2023-07-29T02:07:49.519 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.531+0000 7f5d90982700 1 -- 172.21.15.42:0/3883205368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0ca6d0 msgr2=0x7f5d8c1513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:49.519 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.531+0000 7f5d90982700 1 --2- 172.21.15.42:0/3883205368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0ca6d0 0x7f5d8c1513f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c072f50 tx=0x7f5d8400b330 comp rx=0 tx=0).stop 2023-07-29T02:07:49.520 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.532+0000 7f5d90982700 1 -- 172.21.15.42:0/3883205368 shutdown_connections 2023-07-29T02:07:49.520 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.532+0000 7f5d90982700 1 --2- 172.21.15.42:0/3883205368 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0ca6d0 0x7f5d8c1513f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:49.521 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.532+0000 7f5d90982700 1 --2- 172.21.15.42:0/3883205368 >> v2:172.21.15.144:3300/0 conn(0x7f5d8c0b2950 0x7f5d8c0c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:49.521 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.532+0000 7f5d90982700 1 --2- 172.21.15.42:0/3883205368 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d8c0b2d20 0x7f5d8c150eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:49.521 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.532+0000 7f5d90982700 1 -- 172.21.15.42:0/3883205368 >> 172.21.15.42:0/3883205368 conn(0x7f5d8c0721c0 msgr2=0x7f5d8c0725c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:49.522 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.532+0000 7f5d90982700 1 -- 172.21.15.42:0/3883205368 shutdown_connections 2023-07-29T02:07:49.522 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.532+0000 7f5d90982700 1 -- 172.21.15.42:0/3883205368 wait complete. 2023-07-29T02:07:49.526 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.533+0000 7f5d90982700 1 Processor -- start 2023-07-29T02:07:49.527 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.533+0000 7f5d90982700 1 -- start start 2023-07-29T02:07:49.527 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.534+0000 7f5d90982700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d8c0b2950 0x7f5d8c0cd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:49.527 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.534+0000 7f5d90982700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d8c0b2d20 0x7f5d8c153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:49.528 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.534+0000 7f5d90982700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0ca6d0 0x7f5d8c14f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:49.528 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.534+0000 7f5d90982700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c152ba0 con 0x7f5d8c0ca6d0 2023-07-29T02:07:49.529 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.534+0000 7f5d90982700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c153a40 con 0x7f5d8c0b2d20 2023-07-29T02:07:49.529 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.534+0000 7f5d90982700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c153740 con 0x7f5d8c0b2950 2023-07-29T02:07:49.529 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.534+0000 7f5d8ad9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0ca6d0 0x7f5d8c14f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:49.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.534+0000 7f5d8ad9d700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0ca6d0 0x7f5d8c14f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58694/0 (socket says 172.21.15.42:58694) 2023-07-29T02:07:49.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.534+0000 7f5d8ad9d700 1 -- 172.21.15.42:0/3908976651 learned_addr learned my addr 172.21.15.42:0/3908976651 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:07:49.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.534+0000 7f5d8a59c700 1 --2- 172.21.15.42:0/3908976651 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d8c0b2950 0x7f5d8c0cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:49.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.534+0000 7f5d89d9b700 1 --2- 172.21.15.42:0/3908976651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d8c0b2d20 0x7f5d8c153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:49.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.534+0000 7f5d8ad9d700 1 -- 172.21.15.42:0/3908976651 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d8c0b2950 msgr2=0x7f5d8c0cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:49.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.534+0000 7f5d8ad9d700 1 --2- 172.21.15.42:0/3908976651 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d8c0b2950 0x7f5d8c0cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:49.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.534+0000 7f5d8ad9d700 1 -- 172.21.15.42:0/3908976651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d8c0b2d20 msgr2=0x7f5d8c153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:49.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.534+0000 7f5d8ad9d700 1 --2- 172.21.15.42:0/3908976651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d8c0b2d20 0x7f5d8c153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:49.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.534+0000 7f5d8ad9d700 1 -- 172.21.15.42:0/3908976651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d84009b30 con 0x7f5d8c0ca6d0 2023-07-29T02:07:49.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.534+0000 7f5d8a59c700 1 --2- 172.21.15.42:0/3908976651 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d8c0b2950 0x7f5d8c0cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-29T02:07:49.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.534+0000 7f5d8ad9d700 1 --2- 172.21.15.42:0/3908976651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0ca6d0 0x7f5d8c14f2b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c068b60 tx=0x7f5d84004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:49.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.536+0000 7f5d7affd700 1 -- 172.21.15.42:0/3908976651 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d840099b0 con 0x7f5d8c0ca6d0 2023-07-29T02:07:49.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.536+0000 7f5d7affd700 1 -- 172.21.15.42:0/3908976651 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5d840092e0 con 0x7f5d8c0ca6d0 2023-07-29T02:07:49.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.536+0000 7f5d7affd700 1 -- 172.21.15.42:0/3908976651 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84004490 con 0x7f5d8c0ca6d0 2023-07-29T02:07:49.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.536+0000 7f5d90982700 1 -- 172.21.15.42:0/3908976651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8c0ccee0 con 0x7f5d8c0ca6d0 2023-07-29T02:07:49.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.537+0000 7f5d90982700 1 -- 172.21.15.42:0/3908976651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d8c151a20 con 0x7f5d8c0ca6d0 2023-07-29T02:07:49.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.537+0000 7f5d90982700 1 -- 172.21.15.42:0/3908976651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8c153bb0 con 0x7f5d8c0ca6d0 2023-07-29T02:07:49.533 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.538+0000 7f5d7affd700 1 -- 172.21.15.42:0/3908976651 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f5d840045f0 con 0x7f5d8c0ca6d0 2023-07-29T02:07:49.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.538+0000 7f5d7affd700 1 --2- 172.21.15.42:0/3908976651 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f5d6c06a690 0x7f5d6c06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:49.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.539+0000 7f5d7affd700 1 -- 172.21.15.42:0/3908976651 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 7108+0+0 (secure 0 0 0) 0x7f5d84089fa0 con 0x7f5d8c0ca6d0 2023-07-29T02:07:49.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.539+0000 7f5d8a59c700 1 --2- 172.21.15.42:0/3908976651 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f5d6c06a690 0x7f5d6c06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:49.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.539+0000 7f5d8a59c700 1 --2- 172.21.15.42:0/3908976651 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f5d6c06a690 0x7f5d6c06cb40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c009f50 tx=0x7f5d7c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:49.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.543+0000 7f5d7affd700 1 -- 172.21.15.42:0/3908976651 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f5d84054e60 con 0x7f5d8c0ca6d0 2023-07-29T02:07:49.771 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:49.791+0000 7f5d90982700 1 -- 172.21.15.42:0/3908976651 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5d8c04ea50 con 0x7f5d8c0ca6d0 2023-07-29T02:07:50.517 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.538+0000 7f5d7affd700 1 -- 172.21.15.42:0/3908976651 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5d8401f020 con 0x7f5d8c0ca6d0 2023-07-29T02:07:50.520 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.541+0000 7f5d90982700 1 -- 172.21.15.42:0/3908976651 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f5d6c06a690 msgr2=0x7f5d6c06cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:50.521 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.541+0000 7f5d90982700 1 --2- 172.21.15.42:0/3908976651 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f5d6c06a690 0x7f5d6c06cb40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c009f50 tx=0x7f5d7c009210 comp rx=0 tx=0).stop 2023-07-29T02:07:50.521 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.541+0000 7f5d90982700 1 -- 172.21.15.42:0/3908976651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0ca6d0 msgr2=0x7f5d8c14f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:50.521 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.541+0000 7f5d90982700 1 --2- 172.21.15.42:0/3908976651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0ca6d0 0x7f5d8c14f2b0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c068b60 tx=0x7f5d84004ad0 comp rx=0 tx=0).stop 2023-07-29T02:07:50.521 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.541+0000 7f5d90982700 1 -- 172.21.15.42:0/3908976651 shutdown_connections 2023-07-29T02:07:50.521 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.541+0000 7f5d90982700 1 --2- 172.21.15.42:0/3908976651 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f5d6c06a690 0x7f5d6c06cb40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:50.522 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.541+0000 7f5d90982700 1 --2- 172.21.15.42:0/3908976651 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f5d8c0ca6d0 0x7f5d8c14f2b0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:50.522 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.541+0000 7f5d90982700 1 --2- 172.21.15.42:0/3908976651 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f5d8c0b2950 0x7f5d8c0cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:50.522 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.541+0000 7f5d90982700 1 --2- 172.21.15.42:0/3908976651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d8c0b2d20 0x7f5d8c153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:50.522 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.541+0000 7f5d90982700 1 -- 172.21.15.42:0/3908976651 >> 172.21.15.42:0/3908976651 conn(0x7f5d8c0721c0 msgr2=0x7f5d8c14e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:50.522 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.541+0000 7f5d90982700 1 -- 172.21.15.42:0/3908976651 shutdown_connections 2023-07-29T02:07:50.523 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.541+0000 7f5d90982700 1 -- 172.21.15.42:0/3908976651 wait complete. 2023-07-29T02:07:50.523 INFO:teuthology.orchestra.run.smithi042.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-29T02:07:50.535 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-29T02:07:50.564 INFO:tasks.ceph.mds.d.smithi144.stdout:starting mds.d at 2023-07-29T02:07:50.670 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.690+0000 7f4e3718f700 1 Processor -- start 2023-07-29T02:07:50.670 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.690+0000 7f4e3718f700 1 -- start start 2023-07-29T02:07:50.672 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.691+0000 7f4e3718f700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7f4e3006eda0 0x7f4e30155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:50.673 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.691+0000 7f4e3718f700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3006cb10 con 0x7f4e3006cfa0 2023-07-29T02:07:50.673 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.691+0000 7f4e3718f700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e30156280 con 0x7f4e30150030 2023-07-29T02:07:50.673 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.691+0000 7f4e3718f700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e30156560 con 0x7f4e3006eda0 2023-07-29T02:07:50.673 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.691+0000 7f4e2ffff700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f4e3006cfa0 0x7f4e3014f920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52502/0 (socket says 172.21.15.42:52502) 2023-07-29T02:07:50.673 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.691+0000 7f4e2ffff700 1 -- 172.21.15.42:0/2560624661 learned_addr learned my addr 172.21.15.42:0/2560624661 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:07:50.674 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.692+0000 7f4e34f2b700 1 --2- 172.21.15.42:0/2560624661 >> v2:172.21.15.144:3300/0 conn(0x7f4e3006eda0 0x7f4e30155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:50.674 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.692+0000 7f4e2f7fe700 1 -- 172.21.15.42:0/2560624661 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2487300478 0 0) 0x7f4e3006cb10 con 0x7f4e3006cfa0 2023-07-29T02:07:50.674 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.692+0000 7f4e2f7fe700 1 -- 172.21.15.42:0/2560624661 --> v1:172.21.15.42:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e200057c0 con 0x7f4e3006cfa0 2023-07-29T02:07:50.674 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.692+0000 7f4e34f2b700 1 -- 172.21.15.42:0/2560624661 >> v1:172.21.15.144:6789/0 conn(0x7f4e30150030 legacy=0x7f4e3006f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:50.674 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.692+0000 7f4e2f7fe700 1 -- 172.21.15.42:0/2560624661 <== mon.1 v1:172.21.15.144:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894313853 0 0) 0x7f4e30156280 con 0x7f4e30150030 2023-07-29T02:07:50.675 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.692+0000 7f4e34f2b700 1 -- 172.21.15.42:0/2560624661 >> v1:172.21.15.42:6789/0 conn(0x7f4e3006cfa0 legacy=0x7f4e3014f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:50.675 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.692+0000 7f4e34f2b700 1 -- 172.21.15.42:0/2560624661 --> v2:172.21.15.144:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e30156840 con 0x7f4e3006eda0 2023-07-29T02:07:50.675 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.692+0000 7f4e34f2b700 1 --2- 172.21.15.42:0/2560624661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e3006eda0 0x7f4e30155bd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009840 tx=0x7f4e24009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e73a8dbbcd77aa04 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:50.675 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.692+0000 7f4e2f7fe700 1 -- 172.21.15.42:0/2560624661 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e24011830 con 0x7f4e3006eda0 2023-07-29T02:07:50.675 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.692+0000 7f4e2f7fe700 1 -- 172.21.15.42:0/2560624661 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4e24011990 con 0x7f4e3006eda0 2023-07-29T02:07:50.676 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.692+0000 7f4e2f7fe700 1 -- 172.21.15.42:0/2560624661 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e24011d40 con 0x7f4e3006eda0 2023-07-29T02:07:50.676 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.693+0000 7f4e3718f700 1 -- 172.21.15.42:0/2560624661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e3006eda0 msgr2=0x7f4e30155bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:50.676 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.693+0000 7f4e3718f700 1 --2- 172.21.15.42:0/2560624661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e3006eda0 0x7f4e30155bd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4e24009840 tx=0x7f4e24009b50 comp rx=0 tx=0).stop 2023-07-29T02:07:50.676 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.693+0000 7f4e3718f700 1 -- 172.21.15.42:0/2560624661 shutdown_connections 2023-07-29T02:07:50.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.693+0000 7f4e3718f700 1 --2- 172.21.15.42:0/2560624661 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e3006eda0 0x7f4e30155bd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:50.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.693+0000 7f4e3718f700 1 -- 172.21.15.42:0/2560624661 >> 172.21.15.42:0/2560624661 conn(0x7f4e300cbf10 msgr2=0x7f4e300cc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:50.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.693+0000 7f4e3718f700 1 -- 172.21.15.42:0/2560624661 shutdown_connections 2023-07-29T02:07:50.677 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.693+0000 7f4e3718f700 1 -- 172.21.15.42:0/2560624661 wait complete. 2023-07-29T02:07:50.679 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.694+0000 7f4e3718f700 1 Processor -- start 2023-07-29T02:07:50.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.694+0000 7f4e3718f700 1 -- start start 2023-07-29T02:07:50.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.695+0000 7f4e3718f700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e3006cfa0 0x7f4e30145430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:50.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.695+0000 7f4e3718f700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e3006eda0 0x7f4e301545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:50.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.695+0000 7f4e3718f700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e30150030 0x7f4e301f2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:50.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.695+0000 7f4e3718f700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e300cb490 con 0x7f4e3006cfa0 2023-07-29T02:07:50.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.695+0000 7f4e3718f700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e30153b70 con 0x7f4e3006eda0 2023-07-29T02:07:50.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.695+0000 7f4e3718f700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3014d820 con 0x7f4e30150030 2023-07-29T02:07:50.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.695+0000 7f4e34f2b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e3006cfa0 0x7f4e30145430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:50.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.695+0000 7f4e34f2b700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e3006cfa0 0x7f4e30145430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58704/0 (socket says 172.21.15.42:58704) 2023-07-29T02:07:50.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.695+0000 7f4e34f2b700 1 -- 172.21.15.42:0/1039901978 learned_addr learned my addr 172.21.15.42:0/1039901978 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:07:50.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.695+0000 7f4e2ffff700 1 --2- 172.21.15.42:0/1039901978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e3006eda0 0x7f4e301545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:50.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.695+0000 7f4e3572c700 1 --2- 172.21.15.42:0/1039901978 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e30150030 0x7f4e301f2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:50.683 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.695+0000 7f4e34f2b700 1 -- 172.21.15.42:0/1039901978 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e30150030 msgr2=0x7f4e301f2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:50.683 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.695+0000 7f4e34f2b700 1 --2- 172.21.15.42:0/1039901978 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e30150030 0x7f4e301f2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:50.683 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.695+0000 7f4e34f2b700 1 -- 172.21.15.42:0/1039901978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e3006eda0 msgr2=0x7f4e301545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:50.683 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.695+0000 7f4e34f2b700 1 --2- 172.21.15.42:0/1039901978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e3006eda0 0x7f4e301545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:50.683 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.695+0000 7f4e34f2b700 1 -- 172.21.15.42:0/1039901978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e240094a0 con 0x7f4e3006cfa0 2023-07-29T02:07:50.684 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.695+0000 7f4e3572c700 1 --2- 172.21.15.42:0/1039901978 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e30150030 0x7f4e301f2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:07:50.684 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.695+0000 7f4e2ffff700 1 --2- 172.21.15.42:0/1039901978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e3006eda0 0x7f4e301545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:07:50.684 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.696+0000 7f4e34f2b700 1 --2- 172.21.15.42:0/1039901978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e3006cfa0 0x7f4e30145430 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4e240090b0 tx=0x7f4e24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:50.684 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.696+0000 7f4e2d7fa700 1 -- 172.21.15.42:0/1039901978 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2401a9c0 con 0x7f4e3006cfa0 2023-07-29T02:07:50.684 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.696+0000 7f4e2d7fa700 1 -- 172.21.15.42:0/1039901978 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4e2401ab20 con 0x7f4e3006cfa0 2023-07-29T02:07:50.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.696+0000 7f4e3718f700 1 -- 172.21.15.42:0/1039901978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e300cb750 con 0x7f4e3006cfa0 2023-07-29T02:07:50.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.696+0000 7f4e2d7fa700 1 -- 172.21.15.42:0/1039901978 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e24024420 con 0x7f4e3006cfa0 2023-07-29T02:07:50.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.696+0000 7f4e3718f700 1 -- 172.21.15.42:0/1039901978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e300cba10 con 0x7f4e3006cfa0 2023-07-29T02:07:50.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.697+0000 7f4e3718f700 1 -- 172.21.15.42:0/1039901978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e30154460 con 0x7f4e3006cfa0 2023-07-29T02:07:50.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.697+0000 7f4e2d7fa700 1 -- 172.21.15.42:0/1039901978 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f4e24022070 con 0x7f4e3006cfa0 2023-07-29T02:07:50.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.698+0000 7f4e2d7fa700 1 --2- 172.21.15.42:0/1039901978 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4e1406a660 0x7f4e1406cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:50.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.698+0000 7f4e2d7fa700 1 -- 172.21.15.42:0/1039901978 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 7194+0+0 (secure 0 0 0) 0x7f4e24089f80 con 0x7f4e3006cfa0 2023-07-29T02:07:50.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.698+0000 7f4e2ffff700 1 --2- 172.21.15.42:0/1039901978 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4e1406a660 0x7f4e1406cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:50.686 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.698+0000 7f4e2ffff700 1 --2- 172.21.15.42:0/1039901978 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4e1406a660 0x7f4e1406cb10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4e30155d20 tx=0x7f4e1c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:50.687 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.702+0000 7f4e2d7fa700 1 -- 172.21.15.42:0/1039901978 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f4e24054df0 con 0x7f4e3006cfa0 2023-07-29T02:07:50.927 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:50.948+0000 7f4e3718f700 1 -- 172.21.15.42:0/1039901978 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4e3004ea50 con 0x7f4e3006cfa0 2023-07-29T02:07:51.527 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.548+0000 7f4e2d7fa700 1 -- 172.21.15.42:0/1039901978 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4e240150a0 con 0x7f4e3006cfa0 2023-07-29T02:07:51.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.550+0000 7f4e3718f700 1 -- 172.21.15.42:0/1039901978 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4e1406a660 msgr2=0x7f4e1406cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:51.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.550+0000 7f4e3718f700 1 --2- 172.21.15.42:0/1039901978 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4e1406a660 0x7f4e1406cb10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4e30155d20 tx=0x7f4e1c009040 comp rx=0 tx=0).stop 2023-07-29T02:07:51.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.550+0000 7f4e3718f700 1 -- 172.21.15.42:0/1039901978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e3006cfa0 msgr2=0x7f4e30145430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:51.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.550+0000 7f4e3718f700 1 --2- 172.21.15.42:0/1039901978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e3006cfa0 0x7f4e30145430 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4e240090b0 tx=0x7f4e24004750 comp rx=0 tx=0).stop 2023-07-29T02:07:51.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.551+0000 7f4e3718f700 1 -- 172.21.15.42:0/1039901978 shutdown_connections 2023-07-29T02:07:51.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.551+0000 7f4e3718f700 1 --2- 172.21.15.42:0/1039901978 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f4e1406a660 0x7f4e1406cb10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:51.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.551+0000 7f4e3718f700 1 --2- 172.21.15.42:0/1039901978 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f4e30150030 0x7f4e301f2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:51.531 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.551+0000 7f4e3718f700 1 --2- 172.21.15.42:0/1039901978 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f4e3006cfa0 0x7f4e30145430 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:51.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.551+0000 7f4e3718f700 1 --2- 172.21.15.42:0/1039901978 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e3006eda0 0x7f4e301545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:51.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.551+0000 7f4e3718f700 1 -- 172.21.15.42:0/1039901978 >> 172.21.15.42:0/1039901978 conn(0x7f4e300cbf10 msgr2=0x7f4e300c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:51.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.551+0000 7f4e3718f700 1 -- 172.21.15.42:0/1039901978 shutdown_connections 2023-07-29T02:07:51.532 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.551+0000 7f4e3718f700 1 -- 172.21.15.42:0/1039901978 wait complete. 2023-07-29T02:07:51.545 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-29T02:07:51.680 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.701+0000 7fee73001700 1 Processor -- start 2023-07-29T02:07:51.681 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.701+0000 7fee73001700 1 -- start start 2023-07-29T02:07:51.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.702+0000 7fee73001700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fee6c06ece0 0x7fee6c06f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:51.682 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.702+0000 7fee73001700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6c15d5f0 con 0x7fee6c153440 2023-07-29T02:07:51.683 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.702+0000 7fee73001700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6c15d090 con 0x7fee6c1619d0 2023-07-29T02:07:51.683 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.702+0000 7fee73001700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6c0c7bb0 con 0x7fee6c06ece0 2023-07-29T02:07:51.683 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.702+0000 7fee70d9d700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7fee6c153440 0x7fee6c0c6a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52516/0 (socket says 172.21.15.42:52516) 2023-07-29T02:07:51.683 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.702+0000 7fee70d9d700 1 -- 172.21.15.42:0/895288676 learned_addr learned my addr 172.21.15.42:0/895288676 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:07:51.683 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.702+0000 7fee6bfff700 1 --2- 172.21.15.42:0/895288676 >> v2:172.21.15.42:3300/0 conn(0x7fee6c06ece0 0x7fee6c06f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:51.684 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.702+0000 7fee6bfff700 1 -- 172.21.15.42:0/895288676 >> v1:172.21.15.144:6789/0 conn(0x7fee6c1619d0 legacy=0x7fee6c163db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:07:51.684 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.702+0000 7fee6bfff700 1 -- 172.21.15.42:0/895288676 >> v1:172.21.15.42:6789/0 conn(0x7fee6c153440 legacy=0x7fee6c0c6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:51.684 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.702+0000 7fee6bfff700 1 -- 172.21.15.42:0/895288676 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c0711c0 con 0x7fee6c06ece0 2023-07-29T02:07:51.684 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.702+0000 7fee6b7fe700 1 -- 172.21.15.42:0/895288676 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3494225682 0 0) 0x7fee6c15d5f0 con 0x7fee6c153440 2023-07-29T02:07:51.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.703+0000 7fee6bfff700 1 --2- 172.21.15.42:0/895288676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee6c06ece0 0x7fee6c06f140 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fee58009840 tx=0x7fee58009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d71eaccce430d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:51.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.703+0000 7fee6b7fe700 1 -- 172.21.15.42:0/895288676 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58004230 con 0x7fee6c06ece0 2023-07-29T02:07:51.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.703+0000 7fee6b7fe700 1 -- 172.21.15.42:0/895288676 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fee58004390 con 0x7fee6c06ece0 2023-07-29T02:07:51.685 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.703+0000 7fee6b7fe700 1 -- 172.21.15.42:0/895288676 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee580036a0 con 0x7fee6c06ece0 2023-07-29T02:07:51.687 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.703+0000 7fee73001700 1 -- 172.21.15.42:0/895288676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee6c06ece0 msgr2=0x7fee6c06f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:51.688 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.703+0000 7fee73001700 1 --2- 172.21.15.42:0/895288676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee6c06ece0 0x7fee6c06f140 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fee58009840 tx=0x7fee58009b50 comp rx=0 tx=0).stop 2023-07-29T02:07:51.688 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.703+0000 7fee73001700 1 -- 172.21.15.42:0/895288676 shutdown_connections 2023-07-29T02:07:51.688 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.703+0000 7fee73001700 1 --2- 172.21.15.42:0/895288676 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee6c06ece0 0x7fee6c06f140 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:51.688 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.703+0000 7fee73001700 1 -- 172.21.15.42:0/895288676 >> 172.21.15.42:0/895288676 conn(0x7fee6c06d040 msgr2=0x7fee6c06d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:51.688 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.703+0000 7fee73001700 1 -- 172.21.15.42:0/895288676 shutdown_connections 2023-07-29T02:07:51.689 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.703+0000 7fee73001700 1 -- 172.21.15.42:0/895288676 wait complete. 2023-07-29T02:07:51.689 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.705+0000 7fee73001700 1 Processor -- start 2023-07-29T02:07:51.689 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.705+0000 7fee73001700 1 -- start start 2023-07-29T02:07:51.689 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.706+0000 7fee73001700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee6c06ece0 0x7fee6c150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:51.689 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.706+0000 7fee73001700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee6c153440 0x7fee6c0c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:51.690 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.706+0000 7fee73001700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee6c1619d0 0x7fee6c15e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:51.690 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.706+0000 7fee73001700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c1ee4c0 con 0x7fee6c1619d0 2023-07-29T02:07:51.690 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.706+0000 7fee73001700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c1ef450 con 0x7fee6c06ece0 2023-07-29T02:07:51.690 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.706+0000 7fee73001700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c1ee6b0 con 0x7fee6c153440 2023-07-29T02:07:51.690 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.706+0000 7fee7159e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee6c1619d0 0x7fee6c15e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:51.691 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.706+0000 7fee7159e700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee6c1619d0 0x7fee6c15e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58722/0 (socket says 172.21.15.42:58722) 2023-07-29T02:07:51.691 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.706+0000 7fee7159e700 1 -- 172.21.15.42:0/4241997615 learned_addr learned my addr 172.21.15.42:0/4241997615 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:07:51.691 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.707+0000 7fee6bfff700 1 --2- 172.21.15.42:0/4241997615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee6c153440 0x7fee6c0c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:51.691 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.707+0000 7fee70d9d700 1 --2- 172.21.15.42:0/4241997615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee6c06ece0 0x7fee6c150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:51.691 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.707+0000 7fee7159e700 1 -- 172.21.15.42:0/4241997615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee6c153440 msgr2=0x7fee6c0c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:51.692 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.707+0000 7fee7159e700 1 --2- 172.21.15.42:0/4241997615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee6c153440 0x7fee6c0c43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:51.692 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.707+0000 7fee7159e700 1 -- 172.21.15.42:0/4241997615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee6c06ece0 msgr2=0x7fee6c150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:51.692 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.707+0000 7fee7159e700 1 --2- 172.21.15.42:0/4241997615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee6c06ece0 0x7fee6c150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:51.692 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.707+0000 7fee7159e700 1 -- 172.21.15.42:0/4241997615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee580094a0 con 0x7fee6c1619d0 2023-07-29T02:07:51.692 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.707+0000 7fee70d9d700 1 --2- 172.21.15.42:0/4241997615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee6c06ece0 0x7fee6c150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:07:51.693 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.707+0000 7fee7159e700 1 --2- 172.21.15.42:0/4241997615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee6c1619d0 0x7fee6c15e9e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fee6400cc40 tx=0x7fee6400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:51.693 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.707+0000 7fee697fa700 1 -- 172.21.15.42:0/4241997615 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6400ab30 con 0x7fee6c1619d0 2023-07-29T02:07:51.693 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.707+0000 7fee697fa700 1 -- 172.21.15.42:0/4241997615 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fee6400ac90 con 0x7fee6c1619d0 2023-07-29T02:07:51.693 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.707+0000 7fee73001700 1 -- 172.21.15.42:0/4241997615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6c072180 con 0x7fee6c1619d0 2023-07-29T02:07:51.693 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.707+0000 7fee697fa700 1 -- 172.21.15.42:0/4241997615 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee64012420 con 0x7fee6c1619d0 2023-07-29T02:07:51.694 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.707+0000 7fee73001700 1 -- 172.21.15.42:0/4241997615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6c1eec50 con 0x7fee6c1619d0 2023-07-29T02:07:51.694 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.708+0000 7fee73001700 1 -- 172.21.15.42:0/4241997615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6c04ea50 con 0x7fee6c1619d0 2023-07-29T02:07:51.695 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.709+0000 7fee697fa700 1 -- 172.21.15.42:0/4241997615 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fee64012580 con 0x7fee6c1619d0 2023-07-29T02:07:51.695 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.709+0000 7fee697fa700 1 --2- 172.21.15.42:0/4241997615 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fee5006a660 0x7fee5006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:51.695 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.709+0000 7fee697fa700 1 -- 172.21.15.42:0/4241997615 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 7194+0+0 (secure 0 0 0) 0x7fee64089660 con 0x7fee6c1619d0 2023-07-29T02:07:51.695 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.709+0000 7fee70d9d700 1 --2- 172.21.15.42:0/4241997615 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fee5006a660 0x7fee5006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:51.696 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.710+0000 7fee70d9d700 1 --2- 172.21.15.42:0/4241997615 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fee5006a660 0x7fee5006cb10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fee60000f60 tx=0x7fee60007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:51.696 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.713+0000 7fee697fa700 1 -- 172.21.15.42:0/4241997615 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fee64054560 con 0x7fee6c1619d0 2023-07-29T02:07:51.891 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:51.912+0000 7fee73001700 1 -- 172.21.15.42:0/4241997615 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fee6c072a60 con 0x7fee6c1619d0 2023-07-29T02:07:52.530 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.550+0000 7fee697fa700 1 -- 172.21.15.42:0/4241997615 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v41) v1 ==== 181+0+0 (secure 0 0 0) 0x7fee64016020 con 0x7fee6c1619d0 2023-07-29T02:07:52.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.554+0000 7fee73001700 1 -- 172.21.15.42:0/4241997615 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fee5006a660 msgr2=0x7fee5006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:52.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.554+0000 7fee73001700 1 --2- 172.21.15.42:0/4241997615 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fee5006a660 0x7fee5006cb10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fee60000f60 tx=0x7fee60007ca0 comp rx=0 tx=0).stop 2023-07-29T02:07:52.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.554+0000 7fee73001700 1 -- 172.21.15.42:0/4241997615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee6c1619d0 msgr2=0x7fee6c15e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:52.534 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.554+0000 7fee73001700 1 --2- 172.21.15.42:0/4241997615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee6c1619d0 0x7fee6c15e9e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fee6400cc40 tx=0x7fee6400cf50 comp rx=0 tx=0).stop 2023-07-29T02:07:52.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.555+0000 7fee73001700 1 -- 172.21.15.42:0/4241997615 shutdown_connections 2023-07-29T02:07:52.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.555+0000 7fee73001700 1 --2- 172.21.15.42:0/4241997615 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fee5006a660 0x7fee5006cb10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:52.535 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.555+0000 7fee73001700 1 --2- 172.21.15.42:0/4241997615 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fee6c1619d0 0x7fee6c15e9e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:52.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.555+0000 7fee73001700 1 --2- 172.21.15.42:0/4241997615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee6c06ece0 0x7fee6c150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:52.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.555+0000 7fee73001700 1 --2- 172.21.15.42:0/4241997615 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fee6c153440 0x7fee6c0c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:52.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.555+0000 7fee73001700 1 -- 172.21.15.42:0/4241997615 >> 172.21.15.42:0/4241997615 conn(0x7fee6c06d040 msgr2=0x7fee6c15ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:52.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.555+0000 7fee73001700 1 -- 172.21.15.42:0/4241997615 shutdown_connections 2023-07-29T02:07:52.536 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.555+0000 7fee73001700 1 -- 172.21.15.42:0/4241997615 wait complete. 2023-07-29T02:07:52.537 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_metadata' removed 2023-07-29T02:07:52.551 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-29T02:07:52.687 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.708+0000 7fb21b0e9700 1 Processor -- start 2023-07-29T02:07:52.688 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.708+0000 7fb21b0e9700 1 -- start start 2023-07-29T02:07:52.690 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.709+0000 7fb21b0e9700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb21406b340 0x7fb214159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:52.690 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.709+0000 7fb21b0e9700 1 --2- >> v2:172.21.15.144:3300/0 conn(0x7fb214061190 0x7fb2140c7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:52.690 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.709+0000 7fb21b0e9700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb21406c710 con 0x7fb2141500e0 2023-07-29T02:07:52.690 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.709+0000 7fb21b0e9700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2141504b0 con 0x7fb21406b340 2023-07-29T02:07:52.690 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.709+0000 7fb21b0e9700 1 -- --> v2:172.21.15.144:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb21406bf30 con 0x7fb214061190 2023-07-29T02:07:52.691 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.709+0000 7fb213fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb21406b340 0x7fb214159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:52.691 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.709+0000 7fb213fff700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7fb21406b340 0x7fb214159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58728/0 (socket says 172.21.15.42:58728) 2023-07-29T02:07:52.691 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.709+0000 7fb213fff700 1 -- 172.21.15.42:0/2472787520 learned_addr learned my addr 172.21.15.42:0/2472787520 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:07:52.691 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.709+0000 7fb219686700 1 --2- 172.21.15.42:0/2472787520 >> v2:172.21.15.144:3300/0 conn(0x7fb214061190 0x7fb2140c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:52.691 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.709+0000 7fb213fff700 1 -- 172.21.15.42:0/2472787520 >> v2:172.21.15.144:3300/0 conn(0x7fb214061190 msgr2=0x7fb2140c7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-29T02:07:52.692 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.709+0000 7fb213fff700 1 --2- 172.21.15.42:0/2472787520 >> v2:172.21.15.144:3300/0 conn(0x7fb214061190 0x7fb2140c7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:52.692 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.709+0000 7fb213fff700 1 -- 172.21.15.42:0/2472787520 >> v1:172.21.15.144:6789/0 conn(0x7fb2141500e0 legacy=0x7fb214070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:52.692 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.709+0000 7fb213fff700 1 -- 172.21.15.42:0/2472787520 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21406c1d0 con 0x7fb21406b340 2023-07-29T02:07:52.692 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.710+0000 7fb213fff700 1 --2- 172.21.15.42:0/2472787520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb21406b340 0x7fb214159cf0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb2140c5750 tx=0x7fb200009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ee51146262aa89 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:52.692 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.710+0000 7fb2137fe700 1 -- 172.21.15.42:0/2472787520 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb200011830 con 0x7fb21406b340 2023-07-29T02:07:52.693 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.710+0000 7fb2137fe700 1 -- 172.21.15.42:0/2472787520 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb200011990 con 0x7fb21406b340 2023-07-29T02:07:52.693 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.710+0000 7fb2137fe700 1 -- 172.21.15.42:0/2472787520 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb200011d40 con 0x7fb21406b340 2023-07-29T02:07:52.693 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.710+0000 7fb21b0e9700 1 -- 172.21.15.42:0/2472787520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb21406b340 msgr2=0x7fb214159cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:52.693 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.710+0000 7fb21b0e9700 1 --2- 172.21.15.42:0/2472787520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb21406b340 0x7fb214159cf0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb2140c5750 tx=0x7fb200009bd0 comp rx=0 tx=0).stop 2023-07-29T02:07:52.693 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.710+0000 7fb21b0e9700 1 -- 172.21.15.42:0/2472787520 shutdown_connections 2023-07-29T02:07:52.694 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.710+0000 7fb21b0e9700 1 --2- 172.21.15.42:0/2472787520 >> v2:172.21.15.144:3300/0 conn(0x7fb214061190 0x7fb2140c7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:52.694 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.710+0000 7fb21b0e9700 1 --2- 172.21.15.42:0/2472787520 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb21406b340 0x7fb214159cf0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:52.694 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.710+0000 7fb21b0e9700 1 -- 172.21.15.42:0/2472787520 >> 172.21.15.42:0/2472787520 conn(0x7fb2140c8130 msgr2=0x7fb2140c8530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:52.694 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.710+0000 7fb21b0e9700 1 -- 172.21.15.42:0/2472787520 shutdown_connections 2023-07-29T02:07:52.694 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.710+0000 7fb21b0e9700 1 -- 172.21.15.42:0/2472787520 wait complete. 2023-07-29T02:07:52.697 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.711+0000 7fb21b0e9700 1 Processor -- start 2023-07-29T02:07:52.697 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.712+0000 7fb21b0e9700 1 -- start start 2023-07-29T02:07:52.697 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.712+0000 7fb21b0e9700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb214061190 0x7fb2141e0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:52.697 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.712+0000 7fb21b0e9700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb21406b340 0x7fb214072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:52.697 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.712+0000 7fb21b0e9700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2141500e0 0x7fb21413b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:52.698 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.712+0000 7fb21b0e9700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb214145bf0 con 0x7fb214061190 2023-07-29T02:07:52.698 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.712+0000 7fb21b0e9700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb214071450 con 0x7fb2141500e0 2023-07-29T02:07:52.698 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.712+0000 7fb21b0e9700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2141e00d0 con 0x7fb21406b340 2023-07-29T02:07:52.698 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.712+0000 7fb218e85700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb214061190 0x7fb2141e0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:52.698 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.712+0000 7fb218e85700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb214061190 0x7fb2141e0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58732/0 (socket says 172.21.15.42:58732) 2023-07-29T02:07:52.699 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.712+0000 7fb218e85700 1 -- 172.21.15.42:0/3178748068 learned_addr learned my addr 172.21.15.42:0/3178748068 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:07:52.699 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.713+0000 7fb213fff700 1 --2- 172.21.15.42:0/3178748068 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb21406b340 0x7fb214072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:52.699 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.713+0000 7fb219686700 1 --2- 172.21.15.42:0/3178748068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2141500e0 0x7fb21413b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:52.699 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.713+0000 7fb218e85700 1 -- 172.21.15.42:0/3178748068 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb21406b340 msgr2=0x7fb214072140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:52.700 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.713+0000 7fb218e85700 1 --2- 172.21.15.42:0/3178748068 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb21406b340 0x7fb214072140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:52.700 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.713+0000 7fb218e85700 1 -- 172.21.15.42:0/3178748068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2141500e0 msgr2=0x7fb21413b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:52.700 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.713+0000 7fb218e85700 1 --2- 172.21.15.42:0/3178748068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2141500e0 0x7fb21413b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:52.700 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.713+0000 7fb218e85700 1 -- 172.21.15.42:0/3178748068 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb200009550 con 0x7fb214061190 2023-07-29T02:07:52.700 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.713+0000 7fb219686700 1 --2- 172.21.15.42:0/3178748068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2141500e0 0x7fb21413b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-29T02:07:52.701 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.713+0000 7fb218e85700 1 --2- 172.21.15.42:0/3178748068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb214061190 0x7fb2141e0560 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb20800c450 tx=0x7fb20800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:52.701 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.713+0000 7fb2117fa700 1 -- 172.21.15.42:0/3178748068 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2080052d0 con 0x7fb214061190 2023-07-29T02:07:52.701 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.713+0000 7fb2117fa700 1 -- 172.21.15.42:0/3178748068 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb208005430 con 0x7fb214061190 2023-07-29T02:07:52.701 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.713+0000 7fb21b0e9700 1 -- 172.21.15.42:0/3178748068 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2141df1e0 con 0x7fb214061190 2023-07-29T02:07:52.701 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.713+0000 7fb2117fa700 1 -- 172.21.15.42:0/3178748068 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2080038e0 con 0x7fb214061190 2023-07-29T02:07:52.702 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.713+0000 7fb21b0e9700 1 -- 172.21.15.42:0/3178748068 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2141df7a0 con 0x7fb214061190 2023-07-29T02:07:52.702 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.714+0000 7fb21b0e9700 1 -- 172.21.15.42:0/3178748068 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2141e0aa0 con 0x7fb214061190 2023-07-29T02:07:52.702 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.715+0000 7fb2117fa700 1 -- 172.21.15.42:0/3178748068 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7fb208003a40 con 0x7fb214061190 2023-07-29T02:07:52.702 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.715+0000 7fb2117fa700 1 --2- 172.21.15.42:0/3178748068 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb1f806a660 0x7fb1f806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:52.702 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.715+0000 7fb2117fa700 1 -- 172.21.15.42:0/3178748068 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6756+0+0 (secure 0 0 0) 0x7fb2080881f0 con 0x7fb214061190 2023-07-29T02:07:52.703 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.715+0000 7fb213fff700 1 --2- 172.21.15.42:0/3178748068 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb1f806a660 0x7fb1f806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:52.703 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.716+0000 7fb213fff700 1 --2- 172.21.15.42:0/3178748068 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb1f806a660 0x7fb1f806cb10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb200009c10 tx=0x7fb200008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:52.703 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.719+0000 7fb2117fa700 1 -- 172.21.15.42:0/3178748068 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7fb2080532a0 con 0x7fb214061190 2023-07-29T02:07:52.896 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:52.917+0000 7fb21b0e9700 1 -- 172.21.15.42:0/3178748068 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb21404ea50 con 0x7fb214061190 2023-07-29T02:07:53.541 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.562+0000 7fb2117fa700 1 -- 172.21.15.42:0/3178748068 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v42) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb2080568c0 con 0x7fb214061190 2023-07-29T02:07:53.545 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.566+0000 7fb21b0e9700 1 -- 172.21.15.42:0/3178748068 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb1f806a660 msgr2=0x7fb1f806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:53.545 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.566+0000 7fb21b0e9700 1 --2- 172.21.15.42:0/3178748068 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb1f806a660 0x7fb1f806cb10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb200009c10 tx=0x7fb200008030 comp rx=0 tx=0).stop 2023-07-29T02:07:53.546 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.566+0000 7fb21b0e9700 1 -- 172.21.15.42:0/3178748068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb214061190 msgr2=0x7fb2141e0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:53.546 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.566+0000 7fb21b0e9700 1 --2- 172.21.15.42:0/3178748068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb214061190 0x7fb2141e0560 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb20800c450 tx=0x7fb20800c760 comp rx=0 tx=0).stop 2023-07-29T02:07:53.546 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.566+0000 7fb21b0e9700 1 -- 172.21.15.42:0/3178748068 shutdown_connections 2023-07-29T02:07:53.546 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.566+0000 7fb21b0e9700 1 --2- 172.21.15.42:0/3178748068 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7fb1f806a660 0x7fb1f806cb10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:53.546 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.566+0000 7fb21b0e9700 1 --2- 172.21.15.42:0/3178748068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2141500e0 0x7fb21413b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:53.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.566+0000 7fb21b0e9700 1 --2- 172.21.15.42:0/3178748068 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7fb214061190 0x7fb2141e0560 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:53.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.566+0000 7fb21b0e9700 1 --2- 172.21.15.42:0/3178748068 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7fb21406b340 0x7fb214072140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:53.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.566+0000 7fb21b0e9700 1 -- 172.21.15.42:0/3178748068 >> 172.21.15.42:0/3178748068 conn(0x7fb2140c8130 msgr2=0x7fb2140c3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:53.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.566+0000 7fb21b0e9700 1 -- 172.21.15.42:0/3178748068 shutdown_connections 2023-07-29T02:07:53.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.566+0000 7fb21b0e9700 1 -- 172.21.15.42:0/3178748068 wait complete. 2023-07-29T02:07:53.551 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data' removed 2023-07-29T02:07:53.563 DEBUG:teuthology.orchestra.run.smithi042:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-07-29T02:07:53.697 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.718+0000 7f0eea7b1700 1 Processor -- start 2023-07-29T02:07:53.698 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.718+0000 7f0eea7b1700 1 -- start start 2023-07-29T02:07:53.699 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.719+0000 7f0eea7b1700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0ee40c8390 0x7f0ee4072930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:53.699 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.719+0000 7f0eea7b1700 1 -- --> v1:172.21.15.42:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee415d190 con 0x7f0ee406ce60 2023-07-29T02:07:53.699 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.719+0000 7f0eea7b1700 1 -- --> v1:172.21.15.144:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee41538a0 con 0x7f0ee41534d0 2023-07-29T02:07:53.700 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.719+0000 7f0eea7b1700 1 -- --> v2:172.21.15.42:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee415d6c0 con 0x7f0ee40c8390 2023-07-29T02:07:53.700 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.719+0000 7f0ee37fe700 1 --2- >> v2:172.21.15.42:3300/0 conn(0x7f0ee40c8390 0x7f0ee4072930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:53.700 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.719+0000 7f0ee8d4e700 1 --1- >> v1:172.21.15.42:6789/0 conn(0x7f0ee406ce60 0x7f0ee406d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.42:6789/0 says I am v1:172.21.15.42:52548/0 (socket says 172.21.15.42:52548) 2023-07-29T02:07:53.700 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.719+0000 7f0ee8d4e700 1 -- 172.21.15.42:0/3355034193 learned_addr learned my addr 172.21.15.42:0/3355034193 (peer_addr_for_me v1:172.21.15.42:0/0) 2023-07-29T02:07:53.701 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.719+0000 7f0ee37fe700 1 -- 172.21.15.42:0/3355034193 >> v1:172.21.15.144:6789/0 conn(0x7f0ee41534d0 legacy=0x7f0ee40c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:53.701 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.719+0000 7f0ee37fe700 1 -- 172.21.15.42:0/3355034193 >> v1:172.21.15.42:6789/0 conn(0x7f0ee406ce60 legacy=0x7f0ee406d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:53.701 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.719+0000 7f0ee37fe700 1 -- 172.21.15.42:0/3355034193 --> v2:172.21.15.42:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee415a0f0 con 0x7f0ee40c8390 2023-07-29T02:07:53.701 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.719+0000 7f0ee2ffd700 1 -- 172.21.15.42:0/3355034193 <== mon.0 v1:172.21.15.42:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214424356 0 0) 0x7f0ee415d190 con 0x7f0ee406ce60 2023-07-29T02:07:53.701 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.719+0000 7f0ee37fe700 1 --2- 172.21.15.42:0/3355034193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ee40c8390 0x7f0ee4072930 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009840 tx=0x7f0ed4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265902f6223f67be server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:53.702 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.720+0000 7f0ee2ffd700 1 -- 172.21.15.42:0/3355034193 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4011830 con 0x7f0ee40c8390 2023-07-29T02:07:53.702 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.720+0000 7f0ee2ffd700 1 -- 172.21.15.42:0/3355034193 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0ed4011990 con 0x7f0ee40c8390 2023-07-29T02:07:53.702 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.720+0000 7f0ee2ffd700 1 -- 172.21.15.42:0/3355034193 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4011d40 con 0x7f0ee40c8390 2023-07-29T02:07:53.704 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.720+0000 7f0eea7b1700 1 -- 172.21.15.42:0/3355034193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ee40c8390 msgr2=0x7f0ee4072930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:53.705 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.720+0000 7f0eea7b1700 1 --2- 172.21.15.42:0/3355034193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ee40c8390 0x7f0ee4072930 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009840 tx=0x7f0ed4009b50 comp rx=0 tx=0).stop 2023-07-29T02:07:53.705 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.720+0000 7f0eea7b1700 1 -- 172.21.15.42:0/3355034193 shutdown_connections 2023-07-29T02:07:53.705 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.720+0000 7f0eea7b1700 1 --2- 172.21.15.42:0/3355034193 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ee40c8390 0x7f0ee4072930 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:53.705 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.720+0000 7f0eea7b1700 1 -- 172.21.15.42:0/3355034193 >> 172.21.15.42:0/3355034193 conn(0x7f0ee40c8980 msgr2=0x7f0ee40c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:53.706 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.720+0000 7f0eea7b1700 1 -- 172.21.15.42:0/3355034193 shutdown_connections 2023-07-29T02:07:53.706 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.720+0000 7f0eea7b1700 1 -- 172.21.15.42:0/3355034193 wait complete. 2023-07-29T02:07:53.706 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.721+0000 7f0eea7b1700 1 Processor -- start 2023-07-29T02:07:53.706 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.722+0000 7f0eea7b1700 1 -- start start 2023-07-29T02:07:53.706 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.722+0000 7f0eea7b1700 1 --2- >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ee406ce60 0x7f0ee406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:53.707 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.722+0000 7f0eea7b1700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ee40c8390 0x7f0ee41470f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:53.707 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.722+0000 7f0eea7b1700 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ee41534d0 0x7f0ee4147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:53.707 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.722+0000 7f0eea7b1700 1 -- --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee4148210 con 0x7f0ee40c8390 2023-07-29T02:07:53.707 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.722+0000 7f0eea7b1700 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee415b730 con 0x7f0ee41534d0 2023-07-29T02:07:53.707 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.722+0000 7f0eea7b1700 1 -- --> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee415aab0 con 0x7f0ee406ce60 2023-07-29T02:07:53.708 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.722+0000 7f0ee37fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ee40c8390 0x7f0ee41470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:53.708 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.722+0000 7f0ee37fe700 1 --2- >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ee40c8390 0x7f0ee41470f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.42:3300/0 says I am v2:172.21.15.42:58748/0 (socket says 172.21.15.42:58748) 2023-07-29T02:07:53.708 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.722+0000 7f0ee37fe700 1 -- 172.21.15.42:0/236872445 learned_addr learned my addr 172.21.15.42:0/236872445 (peer_addr_for_me v2:172.21.15.42:0/0) 2023-07-29T02:07:53.708 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.723+0000 7f0ee3fff700 1 --2- 172.21.15.42:0/236872445 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ee406ce60 0x7f0ee406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:53.708 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.723+0000 7f0ee8d4e700 1 --2- 172.21.15.42:0/236872445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ee41534d0 0x7f0ee4147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:53.709 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.723+0000 7f0ee37fe700 1 -- 172.21.15.42:0/236872445 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ee406ce60 msgr2=0x7f0ee406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:53.709 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.723+0000 7f0ee37fe700 1 --2- 172.21.15.42:0/236872445 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ee406ce60 0x7f0ee406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:53.709 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.723+0000 7f0ee37fe700 1 -- 172.21.15.42:0/236872445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ee41534d0 msgr2=0x7f0ee4147630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:53.709 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.723+0000 7f0ee37fe700 1 --2- 172.21.15.42:0/236872445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ee41534d0 0x7f0ee4147630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:53.709 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.723+0000 7f0ee37fe700 1 -- 172.21.15.42:0/236872445 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed40094a0 con 0x7f0ee40c8390 2023-07-29T02:07:53.710 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.723+0000 7f0ee37fe700 1 --2- 172.21.15.42:0/236872445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ee40c8390 0x7f0ee41470f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40090b0 tx=0x7f0ed4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:53.710 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.723+0000 7f0ee0ff9700 1 -- 172.21.15.42:0/236872445 <== mon.0 v2:172.21.15.42:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed401ab70 con 0x7f0ee40c8390 2023-07-29T02:07:53.710 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.723+0000 7f0ee0ff9700 1 -- 172.21.15.42:0/236872445 <== mon.0 v2:172.21.15.42:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0ed401acd0 con 0x7f0ee40c8390 2023-07-29T02:07:53.710 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.723+0000 7f0eea7b1700 1 -- 172.21.15.42:0/236872445 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee4146c60 con 0x7f0ee40c8390 2023-07-29T02:07:53.711 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.723+0000 7f0ee0ff9700 1 -- 172.21.15.42:0/236872445 <== mon.0 v2:172.21.15.42:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4024660 con 0x7f0ee40c8390 2023-07-29T02:07:53.711 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.723+0000 7f0eea7b1700 1 -- 172.21.15.42:0/236872445 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee415c6a0 con 0x7f0ee40c8390 2023-07-29T02:07:53.711 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.724+0000 7f0eea7b1700 1 -- 172.21.15.42:0/236872445 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee4146df0 con 0x7f0ee40c8390 2023-07-29T02:07:53.711 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.724+0000 7f0ee0ff9700 1 -- 172.21.15.42:0/236872445 <== mon.0 v2:172.21.15.42:3300/0 4 ==== mgrmap(e 5) v1 ==== 88209+0+0 (secure 0 0 0) 0x7f0ed4022070 con 0x7f0ee40c8390 2023-07-29T02:07:53.711 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.725+0000 7f0ee0ff9700 1 --2- 172.21.15.42:0/236872445 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f0ed006a660 0x7f0ed006cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-29T02:07:53.712 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.725+0000 7f0ee0ff9700 1 -- 172.21.15.42:0/236872445 <== mon.0 v2:172.21.15.42:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6305+0+0 (secure 0 0 0) 0x7f0ed408a150 con 0x7f0ee40c8390 2023-07-29T02:07:53.712 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.725+0000 7f0ee3fff700 1 --2- 172.21.15.42:0/236872445 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f0ed006a660 0x7f0ed006cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-29T02:07:53.712 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.725+0000 7f0ee3fff700 1 --2- 172.21.15.42:0/236872445 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f0ed006a660 0x7f0ed006cb10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8000f60 tx=0x7f0ed8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-29T02:07:53.713 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.729+0000 7f0ee0ff9700 1 -- 172.21.15.42:0/236872445 <== mon.0 v2:172.21.15.42:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176809 (secure 0 0 0) 0x7f0ed4055330 con 0x7f0ee40c8390 2023-07-29T02:07:53.904 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:53.925+0000 7f0eea7b1700 1 -- 172.21.15.42:0/236872445 --> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0ee404ea50 con 0x7f0ee40c8390 2023-07-29T02:07:54.542 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:54.563+0000 7f0ee0ff9700 1 -- 172.21.15.42:0/236872445 <== mon.0 v2:172.21.15.42:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v43) v1 ==== 178+0+0 (secure 0 0 0) 0x7f0ed40150d0 con 0x7f0ee40c8390 2023-07-29T02:07:54.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:54.567+0000 7f0eea7b1700 1 -- 172.21.15.42:0/236872445 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f0ed006a660 msgr2=0x7f0ed006cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:54.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:54.567+0000 7f0eea7b1700 1 --2- 172.21.15.42:0/236872445 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f0ed006a660 0x7f0ed006cb10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8000f60 tx=0x7f0ed8009040 comp rx=0 tx=0).stop 2023-07-29T02:07:54.547 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:54.567+0000 7f0eea7b1700 1 -- 172.21.15.42:0/236872445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ee40c8390 msgr2=0x7f0ee41470f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-29T02:07:54.548 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:54.567+0000 7f0eea7b1700 1 --2- 172.21.15.42:0/236872445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ee40c8390 0x7f0ee41470f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40090b0 tx=0x7f0ed4004750 comp rx=0 tx=0).stop 2023-07-29T02:07:54.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:54.570+0000 7f0eea7b1700 1 -- 172.21.15.42:0/236872445 shutdown_connections 2023-07-29T02:07:54.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:54.570+0000 7f0eea7b1700 1 --2- 172.21.15.42:0/236872445 >> [v2:172.21.15.144:6832/130830,v1:172.21.15.144:6833/130830] conn(0x7f0ed006a660 0x7f0ed006cb10 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:54.549 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:54.570+0000 7f0eea7b1700 1 --2- 172.21.15.42:0/236872445 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ee41534d0 0x7f0ee4147630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:54.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:54.570+0000 7f0eea7b1700 1 --2- 172.21.15.42:0/236872445 >> [v2:172.21.15.144:3301/0,v1:172.21.15.144:6790/0] conn(0x7f0ee406ce60 0x7f0ee406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:54.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:54.570+0000 7f0eea7b1700 1 --2- 172.21.15.42:0/236872445 >> [v2:172.21.15.42:3300/0,v1:172.21.15.42:6789/0] conn(0x7f0ee40c8390 0x7f0ee41470f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-29T02:07:54.550 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:54.570+0000 7f0eea7b1700 1 -- 172.21.15.42:0/236872445 >> 172.21.15.42:0/236872445 conn(0x7f0ee40c8980 msgr2=0x7f0ee4071090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-29T02:07:54.551 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:54.571+0000 7f0eea7b1700 1 -- 172.21.15.42:0/236872445 shutdown_connections 2023-07-29T02:07:54.552 INFO:teuthology.orchestra.run.smithi042.stderr:2023-07-29T02:07:54.573+0000 7f0eea7b1700 1 -- 172.21.15.42:0/236872445 wait complete. 2023-07-29T02:07:54.555 INFO:teuthology.orchestra.run.smithi042.stderr:pool 'cephfs_data_ec' removed 2023-07-29T02:07:54.574 INFO:teuthology.misc:Shutting down mds daemons... 2023-07-29T02:07:54.575 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-29T02:07:54.575 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:07:54.588 INFO:tasks.ceph.mds.a:Stopped 2023-07-29T02:07:54.588 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-29T02:07:54.588 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:07:54.645 INFO:tasks.ceph.mds.c:Stopped 2023-07-29T02:07:54.645 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2023-07-29T02:07:54.646 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:07:54.698 INFO:tasks.ceph.mds.e:Stopped 2023-07-29T02:07:54.698 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-29T02:07:54.699 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:07:54.711 INFO:tasks.ceph.mds.b:Stopped 2023-07-29T02:07:54.711 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-29T02:07:54.712 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:07:54.765 INFO:tasks.ceph.mds.d:Stopped 2023-07-29T02:07:54.765 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2023-07-29T02:07:54.766 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:07:54.824 INFO:tasks.ceph.mds.f:Stopped 2023-07-29T02:07:54.825 INFO:teuthology.misc:Shutting down osd daemons... 2023-07-29T02:07:54.825 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-07-29T02:07:54.826 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:07:54.869 INFO:tasks.ceph.osd.0:Stopped 2023-07-29T02:07:54.869 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-07-29T02:07:54.870 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:07:54.908 INFO:tasks.ceph.osd.1:Stopped 2023-07-29T02:07:54.909 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-07-29T02:07:54.909 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:07:54.987 INFO:tasks.ceph.osd.2:Stopped 2023-07-29T02:07:54.988 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-07-29T02:07:54.989 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:07:55.065 INFO:tasks.ceph.osd.3:Stopped 2023-07-29T02:07:55.066 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-07-29T02:07:55.066 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:07:55.105 INFO:tasks.ceph.osd.4:Stopped 2023-07-29T02:07:55.106 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-07-29T02:07:55.106 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:07:55.189 INFO:tasks.ceph.osd.5:Stopped 2023-07-29T02:07:55.190 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-07-29T02:07:55.190 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:07:55.238 INFO:tasks.ceph.osd.6:Stopped 2023-07-29T02:07:55.239 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-07-29T02:07:55.239 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:07:55.283 INFO:tasks.ceph.osd.7:Stopped 2023-07-29T02:07:55.283 INFO:teuthology.misc:Shutting down mgr daemons... 2023-07-29T02:07:55.284 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-29T02:07:55.284 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:07:55.307 INFO:tasks.ceph.mgr.y:Stopped 2023-07-29T02:07:55.307 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-29T02:07:55.307 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:07:55.331 INFO:tasks.ceph.mgr.x:Stopped 2023-07-29T02:07:55.331 INFO:teuthology.misc:Shutting down mon daemons... 2023-07-29T02:07:55.332 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-07-29T02:07:55.332 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:07:55.358 INFO:tasks.ceph.mon.a:Stopped 2023-07-29T02:07:55.358 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-07-29T02:07:55.359 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:07:55.381 INFO:tasks.ceph.mon.b:Stopped 2023-07-29T02:07:55.381 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-07-29T02:07:55.382 INFO:teuthology.orchestra.run:waiting for 300 2023-07-29T02:07:55.431 INFO:tasks.ceph.mon.c:Stopped 2023-07-29T02:07:55.431 INFO:tasks.ceph:Checking cluster log for badness... 2023-07-29T02:07:55.432 DEBUG:teuthology.orchestra.run.smithi042:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v 'Replacing daemon mds' | head -n 1 2023-07-29T02:07:55.470 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi042.front.sepia.ceph.com 2023-07-29T02:07:55.470 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-07-29T02:07:56.261 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi042.front.sepia.ceph.com 2023-07-29T02:07:56.262 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-07-29T02:07:56.376 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi042.front.sepia.ceph.com 2023-07-29T02:07:56.376 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-07-29T02:07:56.478 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi042.front.sepia.ceph.com 2023-07-29T02:07:56.478 DEBUG:teuthology.orchestra.run.smithi042:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-07-29T02:07:56.571 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi144.front.sepia.ceph.com 2023-07-29T02:07:56.572 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-07-29T02:07:57.604 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi144.front.sepia.ceph.com 2023-07-29T02:07:57.604 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-07-29T02:07:57.698 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi144.front.sepia.ceph.com 2023-07-29T02:07:57.699 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-07-29T02:07:57.774 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi144.front.sepia.ceph.com 2023-07-29T02:07:57.775 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-07-29T02:07:57.829 INFO:tasks.ceph:Archiving mon data... 2023-07-29T02:07:57.830 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-07-28_23:11:59-fs-reef-release-distro-default-smithi/7355992/data/mon.a.tgz 2023-07-29T02:07:57.831 DEBUG:teuthology.orchestra.run.smithi042:> mktemp 2023-07-29T02:07:57.853 INFO:teuthology.orchestra.run.smithi042.stdout:/tmp/tmp.RDarHWWhm8 2023-07-29T02:07:57.853 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.RDarHWWhm8 2023-07-29T02:07:58.016 DEBUG:teuthology.orchestra.run.smithi042:> sudo chmod 0666 /tmp/tmp.RDarHWWhm8 2023-07-29T02:07:58.107 DEBUG:teuthology.orchestra.remote:smithi042:/tmp/tmp.RDarHWWhm8 is 306KB 2023-07-29T02:07:58.199 DEBUG:teuthology.orchestra.run.smithi042:> rm -fr /tmp/tmp.RDarHWWhm8 2023-07-29T02:07:58.217 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-07-28_23:11:59-fs-reef-release-distro-default-smithi/7355992/data/mon.b.tgz 2023-07-29T02:07:58.217 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2023-07-29T02:07:58.235 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.HWlsXl8mzT 2023-07-29T02:07:58.236 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.HWlsXl8mzT 2023-07-29T02:07:58.379 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.HWlsXl8mzT 2023-07-29T02:07:58.464 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.HWlsXl8mzT is 309KB 2023-07-29T02:07:58.529 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.HWlsXl8mzT 2023-07-29T02:07:58.546 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-07-28_23:11:59-fs-reef-release-distro-default-smithi/7355992/data/mon.c.tgz 2023-07-29T02:07:58.546 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2023-07-29T02:07:58.601 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.ij8BsOTycr 2023-07-29T02:07:58.602 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ij8BsOTycr 2023-07-29T02:07:58.725 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.ij8BsOTycr 2023-07-29T02:07:58.810 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.ij8BsOTycr is 309KB 2023-07-29T02:07:58.901 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.ij8BsOTycr 2023-07-29T02:07:58.918 INFO:tasks.ceph:Cleaning ceph cluster... 2023-07-29T02:07:58.918 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-29T02:07:58.921 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-29T02:07:58.983 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-07-29T02:07:58.983 DEBUG:teuthology.orchestra.run.smithi042:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-29T02:07:58.994 DEBUG:teuthology.orchestra.run.smithi144:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-29T02:07:59.035 INFO:teuthology.orchestra.run.smithi042.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-29T02:07:59.058 INFO:teuthology.orchestra.run.smithi144.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-29T02:07:59.063 INFO:tasks.ceph:Archiving crash dumps... 2023-07-29T02:07:59.065 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-07-28_23:11:59-fs-reef-release-distro-default-smithi/7355992/remote/smithi042/crash 2023-07-29T02:07:59.066 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-29T02:07:59.111 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-07-28_23:11:59-fs-reef-release-distro-default-smithi/7355992/remote/smithi144/crash 2023-07-29T02:07:59.112 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-29T02:07:59.138 INFO:tasks.ceph:Shutting down logrotate 2023-07-29T02:07:59.139 DEBUG:teuthology.orchestra.run.smithi042:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:07:59.156 DEBUG:teuthology.orchestra.run.smithi144:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-29T02:07:59.232 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-29T02:07:59.260 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-29T02:07:59.286 INFO:tasks.ceph:Compressing logs... 2023-07-29T02:07:59.287 DEBUG:teuthology.orchestra.run.smithi042:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-29T02:07:59.302 DEBUG:teuthology.orchestra.run.smithi144:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-29T02:08:51.791 INFO:tasks.ceph:Archiving logs... 2023-07-29T02:08:51.792 DEBUG:teuthology.misc:Transferring archived files from smithi042:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-07-28_23:11:59-fs-reef-release-distro-default-smithi/7355992/remote/smithi042/log 2023-07-29T02:08:51.793 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-29T02:08:56.733 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-07-28_23:11:59-fs-reef-release-distro-default-smithi/7355992/remote/smithi144/log 2023-07-29T02:08:56.734 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-29T02:09:01.617 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-29T02:09:01.627 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-29T02:09:01.627 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-29T02:09:01.630 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-29T02:09:01.730 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-29T02:09:01.740 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-29T02:09:01.740 DEBUG:teuthology.orchestra.run.smithi042:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-29T02:09:01.743 DEBUG:teuthology.orchestra.run.smithi144:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-29T02:09:01.760 INFO:teuthology.orchestra.run.smithi042.stderr:bash: ntpq: command not found 2023-07-29T02:09:01.761 INFO:teuthology.orchestra.run.smithi144.stderr:bash: ntpq: command not found 2023-07-29T02:09:01.765 INFO:teuthology.orchestra.run.smithi042.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-29T02:09:01.765 INFO:teuthology.orchestra.run.smithi042.stdout:=============================================================================== 2023-07-29T02:09:01.765 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 13 -729us[ -729us] +/- 92ms 2023-07-29T02:09:01.765 INFO:teuthology.orchestra.run.smithi042.stdout:^* hv02.front.sepia.ceph.com 3 6 377 14 -1763us[-1758us] +/- 64ms 2023-07-29T02:09:01.766 INFO:teuthology.orchestra.run.smithi042.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 +2310us[+2310us] +/- 64ms 2023-07-29T02:09:01.766 INFO:teuthology.orchestra.run.smithi042.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T02:09:01.767 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-29T02:09:01.767 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2023-07-29T02:09:01.767 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 13 -688us[ -719us] +/- 92ms 2023-07-29T02:09:01.768 INFO:teuthology.orchestra.run.smithi144.stdout:^* hv02.front.sepia.ceph.com 3 6 377 13 -1730us[-1761us] +/- 64ms 2023-07-29T02:09:01.768 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 +2347us[+2347us] +/- 64ms 2023-07-29T02:09:01.768 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-07-29T02:09:01.768 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-29T02:09:01.778 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-29T02:09:01.779 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-29T02:09:01.790 DEBUG:teuthology.orchestra.run.smithi042:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-29T02:09:01.915 DEBUG:teuthology.orchestra.run.smithi144:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-29T02:09:02.014 DEBUG:teuthology.orchestra.run.smithi042:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-29T02:09:02.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T02:09:02.049 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-29T02:09:02.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T02:09:02.082 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-29T02:09:02.093 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-29T02:09:02.107 INFO:teuthology.task.internal:Duration was 1733.146157 seconds 2023-07-29T02:09:02.108 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-29T02:09:02.121 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-29T02:09:02.121 DEBUG:teuthology.orchestra.run.smithi042:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-29T02:09:02.124 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-29T02:09:02.171 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-29T02:09:02.171 INFO:teuthology.orchestra.run.smithi042.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-29T02:09:02.444 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-29T02:09:02.445 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi042.front.sepia.ceph.com 2023-07-29T02:09:02.445 DEBUG:teuthology.orchestra.run.smithi042:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-29T02:09:02.468 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi144.front.sepia.ceph.com 2023-07-29T02:09:02.468 DEBUG:teuthology.orchestra.run.smithi144:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-29T02:09:02.490 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-29T02:09:02.490 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-29T02:09:02.510 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-29T02:09:02.568 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-29T02:09:02.569 DEBUG:teuthology.orchestra.run.smithi042:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-29T02:09:02.571 DEBUG:teuthology.orchestra.run.smithi144:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-29T02:09:02.681 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-29T02:09:02.691 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-29T02:09:02.691 DEBUG:teuthology.orchestra.run.smithi042:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-29T02:09:02.718 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-29T02:09:02.745 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-29T02:09:02.754 DEBUG:teuthology.orchestra.run.smithi042:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-29T02:09:02.760 DEBUG:teuthology.orchestra.run.smithi144:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-29T02:09:02.785 INFO:teuthology.orchestra.run.smithi042.stdout:kernel.core_pattern = core 2023-07-29T02:09:02.810 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = core 2023-07-29T02:09:02.852 DEBUG:teuthology.orchestra.run.smithi042:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-29T02:09:02.867 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T02:09:02.868 DEBUG:teuthology.orchestra.run.smithi144:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-29T02:09:02.907 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-29T02:09:02.908 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-29T02:09:02.926 INFO:teuthology.task.internal:Transferring archived files... 2023-07-29T02:09:02.927 DEBUG:teuthology.misc:Transferring archived files from smithi042:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-07-28_23:11:59-fs-reef-release-distro-default-smithi/7355992/remote/smithi042 2023-07-29T02:09:02.927 DEBUG:teuthology.orchestra.run.smithi042:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-29T02:09:02.964 DEBUG:teuthology.misc:Transferring archived files from smithi144:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-07-28_23:11:59-fs-reef-release-distro-default-smithi/7355992/remote/smithi144 2023-07-29T02:09:02.965 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-29T02:09:03.000 INFO:teuthology.task.internal:Removing archive directory... 2023-07-29T02:09:03.000 DEBUG:teuthology.orchestra.run.smithi042:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-29T02:09:03.003 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-29T02:09:03.051 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-29T02:09:03.064 INFO:teuthology.task.internal:Not uploading archives. 2023-07-29T02:09:03.064 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-29T02:09:03.079 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-29T02:09:03.079 DEBUG:teuthology.orchestra.run.smithi042:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-29T02:09:03.081 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-29T02:09:03.096 INFO:teuthology.orchestra.run.smithi042.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 29 02:09 /home/ubuntu/cephtest 2023-07-29T02:09:03.106 INFO:teuthology.orchestra.run.smithi144.stdout: 262181 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 29 02:09 /home/ubuntu/cephtest 2023-07-29T02:09:03.108 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-29T02:09:03.118 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-29T02:09:03.147 INFO:teuthology.nuke:Checking targets against current locks 2023-07-29T02:09:08.179 DEBUG:teuthology.nuke:shortname: smithi042 2023-07-29T02:09:08.180 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T02:09:08.205 DEBUG:teuthology.nuke:shortname: smithi144 2023-07-29T02:09:08.206 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T02:09:08.209 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi042.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-28_23:11:59-fs-reef-release-distro-default-smithi/7355992', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 01:34:37.080035', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-29T02:09:08.237 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-28_23:11:59-fs-reef-release-distro-default-smithi/7355992', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 01:34:37.081772', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-29T02:09:08.265 INFO:teuthology.orchestra.console.smithi042:Power off 2023-07-29T02:09:08.266 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T02:09:08.288 DEBUG:teuthology.orchestra.console.smithi042:power off output: Chassis Power Control: Down/Off 2023-07-29T02:09:08.289 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T02:09:08.305 INFO:teuthology.orchestra.console.smithi144:Power off 2023-07-29T02:09:08.306 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T02:09:08.315 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on 2023-07-29T02:09:08.328 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-07-29T02:09:08.328 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T02:09:08.350 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-07-29T02:09:12.317 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T02:09:12.352 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T02:09:13.430 DEBUG:teuthology.orchestra.console.smithi042:check power output: 2023-07-29T02:09:13.465 DEBUG:teuthology.orchestra.console.smithi144:check power output: 2023-07-29T02:09:17.431 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T02:09:17.466 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T02:09:17.580 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-07-29T02:09:17.681 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-07-29T02:09:18.544 DEBUG:teuthology.orchestra.console.smithi042:check power output: 2023-07-29T02:09:22.545 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T02:09:23.656 DEBUG:teuthology.orchestra.console.smithi042:check power output: 2023-07-29T02:09:27.662 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T02:09:28.773 DEBUG:teuthology.orchestra.console.smithi042:check power output: 2023-07-29T02:09:32.776 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T02:09:33.888 DEBUG:teuthology.orchestra.console.smithi042:check power output: 2023-07-29T02:09:37.892 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T02:09:39.003 DEBUG:teuthology.orchestra.console.smithi042:check power output: 2023-07-29T02:09:43.006 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T02:09:43.118 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off 2023-07-29T02:09:43.220 INFO:teuthology.orchestra.console.smithi042:Power off completed 2023-07-29T02:09:43.326 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-comp-ec-root overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mds 2-workunit/fs/snaps}} duration: 1733.1461565494537 failure_reason: 'Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi042 with status 128: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0484097b0572e96f42cf6402cbe0ac8dcb046577 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=f8caac81bd1745ca996c3f84743b8773 status: fail success: false 2023-07-29T02:09:43.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T02:09:48.416 INFO:teuthology.run:FAIL